2024-09-16T16:31:54.370 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-16T16:31:54.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-16T16:31:54.466 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7907362 branch: wip-matanb-crimson-testing-59543 description: crimson-rados/rbd/{clusters/fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore tasks/rbd_api_tests} email: null first_in_suite: false job_id: '7907362' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-matanb-crimson-testing-59543 ceph: conf: global: enable experimental unrecoverable data corrupting features: crimson ms client mode: crc ms cluster mode: crc ms mon client mode: crc ms mon cluster mode: crc ms mon service mode: crc ms service mode: crc mgr: debug mgr: 20 debug ms: 1 mgr stats period: 30 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd pool default crimson: true osd: bluestore block size: 96636764160 bluestore compression algorithm: snappy bluestore compression mode: aggressive bluestore fsck on mount: true bluestore rocksdb cf: false crimson alien thread cpu cores: 6-7 crimson osd obc lru size: 10 debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 err to stderr: true log flush on exit: true log to file: false log to stderr: true mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd.0: crimson seastar cpu cores: 0-1 osd.1: crimson seastar cpu cores: 2-3 osd.2: crimson seastar cpu cores: 4-5 flavor: crimson fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(CACHE_POOL_NO_HIT_SET\) - \(POOL_APP_NOT_ENABLED\) - is full \(reached quota - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(POOL_FULL\) sha1: 81fedcb3b484c843d22ffbc8d179cb567b7083b5 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log global: osd crush chooseleaf type: 0 osd pool default pg num: 128 osd pool default pgp num: 128 osd pool default size: 2 mon: {} install: ceph: flavor: crimson sha1: 81fedcb3b484c843d22ffbc8d179cb567b7083b5 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 workunit: branch: main env: CRIMSON_COMPAT: '1' sha1: 0325fd3c11a225c0fd9eb38fab88aad1370ad779 owner: scheduled_matan@teuthology priority: 60 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 seed: 6678 sha1: 81fedcb3b484c843d22ffbc8d179cb567b7083b5 sleep_before_teardown: 0 suite: crimson-rados suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 0325fd3c11a225c0fd9eb38fab88aad1370ad779 targets: smithi122.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMGjr++wQGbi6yokBTI1FufLLiyxAlfeTkEw9+1Ko8NuZymqLqPnaZS1wHYF7pSTaSQPxxmEfCXACumdUbepXn0= tasks: - install: null - ceph: conf: mon: mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 paxos service trim min: 10 osd: debug monc: 20 flavor: crimson - workunit: clients: client.0: - rbd/crimson/test_crimson_librbd.sh env: RBD_FEATURES: '61' teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-16_16:23:48 tube: smithi user: matan verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-16T16:31:54.466 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa; will attempt to use it 2024-09-16T16:31:54.467 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa/tasks 2024-09-16T16:31:54.467 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-16T16:31:54.469 INFO:teuthology.task.internal:Checking packages... 2024-09-16T16:31:54.491 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'crimson' and ceph hash '81fedcb3b484c843d22ffbc8d179cb567b7083b5' 2024-09-16T16:31:54.491 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-16T16:31:54.491 INFO:teuthology.packaging:ref: None 2024-09-16T16:31:54.491 INFO:teuthology.packaging:tag: None 2024-09-16T16:31:54.491 INFO:teuthology.packaging:branch: wip-matanb-crimson-testing-59543 2024-09-16T16:31:54.491 INFO:teuthology.packaging:sha1: 81fedcb3b484c843d22ffbc8d179cb567b7083b5 2024-09-16T16:31:54.491 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&ref=wip-matanb-crimson-testing-59543 2024-09-16T16:31:54.633 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4879.g81fedcb3 2024-09-16T16:31:54.635 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-16T16:31:54.641 INFO:teuthology.task.internal:no buildpackages task found 2024-09-16T16:31:54.641 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-16T16:31:54.661 INFO:teuthology.task.internal:Saving configuration 2024-09-16T16:31:54.674 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-16T16:31:54.680 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-16T16:31:54.702 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi122.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7907362', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-16 16:24:47.676254', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMGjr++wQGbi6yokBTI1FufLLiyxAlfeTkEw9+1Ko8NuZymqLqPnaZS1wHYF7pSTaSQPxxmEfCXACumdUbepXn0='} 2024-09-16T16:31:54.703 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-16T16:31:54.708 INFO:teuthology.task.internal:roles: ubuntu@smithi122.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2024-09-16T16:31:54.708 INFO:teuthology.run_tasks:Running task console_log... 2024-09-16T16:31:54.741 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f88fbd9bbe0>, signals=[15]) 2024-09-16T16:31:54.741 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-16T16:31:54.747 INFO:teuthology.task.internal:Opening connections... 2024-09-16T16:31:54.747 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi122.front.sepia.ceph.com 2024-09-16T16:31:54.748 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T16:31:54.840 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-16T16:31:54.845 DEBUG:teuthology.orchestra.run.smithi122:> uname -m 2024-09-16T16:31:54.927 INFO:teuthology.orchestra.run.smithi122.stdout:x86_64 2024-09-16T16:31:54.927 DEBUG:teuthology.orchestra.run.smithi122:> cat /etc/os-release 2024-09-16T16:31:54.985 INFO:teuthology.orchestra.run.smithi122.stdout:NAME="CentOS Stream" 2024-09-16T16:31:54.985 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION="9" 2024-09-16T16:31:54.985 INFO:teuthology.orchestra.run.smithi122.stdout:ID="centos" 2024-09-16T16:31:54.985 INFO:teuthology.orchestra.run.smithi122.stdout:ID_LIKE="rhel fedora" 2024-09-16T16:31:54.985 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION_ID="9" 2024-09-16T16:31:54.985 INFO:teuthology.orchestra.run.smithi122.stdout:PLATFORM_ID="platform:el9" 2024-09-16T16:31:54.985 INFO:teuthology.orchestra.run.smithi122.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-16T16:31:54.986 INFO:teuthology.orchestra.run.smithi122.stdout:ANSI_COLOR="0;31" 2024-09-16T16:31:54.986 INFO:teuthology.orchestra.run.smithi122.stdout:LOGO="fedora-logo-icon" 2024-09-16T16:31:54.986 INFO:teuthology.orchestra.run.smithi122.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-16T16:31:54.986 INFO:teuthology.orchestra.run.smithi122.stdout:HOME_URL="https://centos.org/" 2024-09-16T16:31:54.986 INFO:teuthology.orchestra.run.smithi122.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-16T16:31:54.986 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-16T16:31:54.986 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-16T16:31:54.987 INFO:teuthology.lock.ops:Updating smithi122.front.sepia.ceph.com on lock server 2024-09-16T16:31:55.010 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-16T16:31:55.019 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-16T16:31:55.023 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-16T16:31:55.024 DEBUG:teuthology.orchestra.run.smithi122:> test '!' -e /home/ubuntu/cephtest 2024-09-16T16:31:55.041 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-16T16:31:55.047 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-16T16:31:55.047 DEBUG:teuthology.orchestra.run.smithi122:> test -z $(ls -A /var/lib/ceph) 2024-09-16T16:31:55.204 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-16T16:31:55.237 INFO:teuthology.run_tasks:Running task kernel... 2024-09-16T16:31:55.251 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-09-16T16:31:55.251 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-09-16T16:31:55.253 DEBUG:teuthology.orchestra.run.smithi122:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-16T16:31:55.270 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T16:31:55.270 DEBUG:teuthology.orchestra.run.smithi122:> uname -r 2024-09-16T16:31:55.328 INFO:teuthology.orchestra.run.smithi122.stdout:5.14.0-503.el9.x86_64 2024-09-16T16:31:55.328 INFO:teuthology.task.kernel:Running kernel on smithi122: 5.14.0-503.el9.x86_64 2024-09-16T16:31:55.328 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum install -y kernel 2024-09-16T16:31:59.129 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 9 - BaseOS 4.1 MB/s | 8.2 MB 00:02 2024-09-16T16:32:00.830 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 9 - AppStream 35 MB/s | 20 MB 00:00 2024-09-16T16:32:05.448 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 9 - CRB 8.0 MB/s | 6.5 MB 00:00 2024-09-16T16:32:06.882 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 9 - Extras packages 96 kB/s | 19 kB 00:00 2024-09-16T16:32:08.128 INFO:teuthology.orchestra.run.smithi122.stdout:Extra Packages for Enterprise Linux 20 MB/s | 23 MB 00:01 2024-09-16T16:32:13.492 INFO:teuthology.orchestra.run.smithi122.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-16T16:32:15.599 INFO:teuthology.orchestra.run.smithi122.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-16T16:32:15.599 INFO:teuthology.orchestra.run.smithi122.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-16T16:32:15.689 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-16T16:32:15.700 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-16T16:32:15.700 INFO:teuthology.orchestra.run.smithi122.stdout: Package Architecture Version Repository Size 2024-09-16T16:32:15.700 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-16T16:32:15.700 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-09-16T16:32:15.700 INFO:teuthology.orchestra.run.smithi122.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-16T16:32:15.700 INFO:teuthology.orchestra.run.smithi122.stdout:Installing dependencies: 2024-09-16T16:32:15.700 INFO:teuthology.orchestra.run.smithi122.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-16T16:32:15.701 INFO:teuthology.orchestra.run.smithi122.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-16T16:32:15.701 INFO:teuthology.orchestra.run.smithi122.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-16T16:32:15.701 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:32:15.701 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-09-16T16:32:15.701 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-16T16:32:15.701 INFO:teuthology.orchestra.run.smithi122.stdout:Install 4 Packages 2024-09-16T16:32:15.701 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:32:15.702 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 79 M 2024-09-16T16:32:15.702 INFO:teuthology.orchestra.run.smithi122.stdout:Installed size: 126 M 2024-09-16T16:32:15.702 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-09-16T16:32:15.886 INFO:teuthology.orchestra.run.smithi122.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 262 kB/s | 23 kB 00:00 2024-09-16T16:32:16.253 INFO:teuthology.orchestra.run.smithi122.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 34 MB/s | 16 MB 00:00 2024-09-16T16:32:16.644 INFO:teuthology.orchestra.run.smithi122.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 41 MB/s | 35 MB 00:00 2024-09-16T16:32:17.012 INFO:teuthology.orchestra.run.smithi122.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 25 MB/s | 29 MB 00:01 2024-09-16T16:32:17.012 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:32:17.012 INFO:teuthology.orchestra.run.smithi122.stdout:Total 60 MB/s | 79 MB 00:01 2024-09-16T16:32:17.696 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-09-16T16:32:18.043 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-09-16T16:32:18.043 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-09-16T16:32:19.011 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-09-16T16:32:19.011 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-09-16T16:32:21.444 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-09-16T16:32:22.174 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-16T16:32:22.273 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T16:32:25.068 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T16:32:25.200 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T16:32:30.028 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T16:32:30.142 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T16:32:34.989 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T16:33:13.300 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T16:33:13.339 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-16T16:33:13.714 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T16:33:13.714 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-16T16:33:13.714 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T16:33:13.714 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T16:33:14.554 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T16:33:14.554 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:33:14.555 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-09-16T16:33:14.555 INFO:teuthology.orchestra.run.smithi122.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-16T16:33:14.555 INFO:teuthology.orchestra.run.smithi122.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-16T16:33:14.555 INFO:teuthology.orchestra.run.smithi122.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-16T16:33:14.555 INFO:teuthology.orchestra.run.smithi122.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-16T16:33:14.555 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:33:14.555 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-16T16:33:14.904 DEBUG:teuthology.orchestra.run.smithi122:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T16:33:15.030 INFO:teuthology.orchestra.run.smithi122.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T16:33:15.030 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T16:33:15.030 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-16T16:33:15.031 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-16T16:33:15.031 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-16T16:33:15.031 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-16T16:33:15.031 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi122.front.sepia.ceph.com, path=None, version=distro) 2024-09-16T16:33:15.031 DEBUG:teuthology.orchestra.run.smithi122:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T16:33:15.089 INFO:teuthology.orchestra.run.smithi122.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T16:33:15.089 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T16:33:15.090 DEBUG:teuthology.orchestra.run.smithi122:> sudo rpm -qi grub2-tools 2024-09-16T16:33:15.126 INFO:teuthology.orchestra.run.smithi122.stdout:Name : grub2-tools 2024-09-16T16:33:15.126 INFO:teuthology.orchestra.run.smithi122.stdout:Epoch : 1 2024-09-16T16:33:15.126 INFO:teuthology.orchestra.run.smithi122.stdout:Version : 2.06 2024-09-16T16:33:15.127 INFO:teuthology.orchestra.run.smithi122.stdout:Release : 82.el9 2024-09-16T16:33:15.127 INFO:teuthology.orchestra.run.smithi122.stdout:Architecture: x86_64 2024-09-16T16:33:15.127 INFO:teuthology.orchestra.run.smithi122.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-16T16:33:15.127 INFO:teuthology.orchestra.run.smithi122.stdout:Group : Unspecified 2024-09-16T16:33:15.127 INFO:teuthology.orchestra.run.smithi122.stdout:Size : 8274670 2024-09-16T16:33:15.127 INFO:teuthology.orchestra.run.smithi122.stdout:License : GPLv3+ 2024-09-16T16:33:15.127 INFO:teuthology.orchestra.run.smithi122.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-16T16:33:15.127 INFO:teuthology.orchestra.run.smithi122.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-16T16:33:15.127 INFO:teuthology.orchestra.run.smithi122.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-16T16:33:15.127 INFO:teuthology.orchestra.run.smithi122.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-16T16:33:15.127 INFO:teuthology.orchestra.run.smithi122.stdout:Packager : builder@centos.org 2024-09-16T16:33:15.127 INFO:teuthology.orchestra.run.smithi122.stdout:Vendor : CentOS 2024-09-16T16:33:15.127 INFO:teuthology.orchestra.run.smithi122.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-16T16:33:15.127 INFO:teuthology.orchestra.run.smithi122.stdout:Summary : Support tools for GRUB. 2024-09-16T16:33:15.128 INFO:teuthology.orchestra.run.smithi122.stdout:Description : 2024-09-16T16:33:15.128 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:33:15.128 INFO:teuthology.orchestra.run.smithi122.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-16T16:33:15.128 INFO:teuthology.orchestra.run.smithi122.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-16T16:33:15.128 INFO:teuthology.orchestra.run.smithi122.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-16T16:33:15.128 INFO:teuthology.orchestra.run.smithi122.stdout:hardware devices. 2024-09-16T16:33:15.128 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:33:15.128 INFO:teuthology.orchestra.run.smithi122.stdout:This subpackage provides tools for support of all platforms. 2024-09-16T16:33:15.129 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-16T16:33:15.129 INFO:teuthology.task.kernel:Updating grub on smithi122 to boot 5.14.0-505.el9.x86_64 2024-09-16T16:33:15.129 DEBUG:teuthology.orchestra.run.smithi122:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-16T16:33:15.768 INFO:teuthology.orchestra.run.smithi122.stderr:Generating grub configuration file ... 2024-09-16T16:33:17.056 INFO:teuthology.orchestra.run.smithi122.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-16T16:33:17.086 INFO:teuthology.orchestra.run.smithi122.stderr:done 2024-09-16T16:33:17.089 DEBUG:teuthology.orchestra.run.smithi122:> mktemp 2024-09-16T16:33:17.104 INFO:teuthology.orchestra.run.smithi122.stdout:/tmp/tmp.qlDCg2wBcD 2024-09-16T16:33:17.104 DEBUG:teuthology.orchestra.run.smithi122:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.qlDCg2wBcD 2024-09-16T16:33:17.171 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 0666 /tmp/tmp.qlDCg2wBcD 2024-09-16T16:33:17.309 DEBUG:teuthology.orchestra.remote:smithi122:/tmp/tmp.qlDCg2wBcD is 6KB 2024-09-16T16:33:17.358 DEBUG:teuthology.orchestra.run.smithi122:> rm -fr /tmp/tmp.qlDCg2wBcD 2024-09-16T16:33:17.373 DEBUG:teuthology.orchestra.run.smithi122:> sudo /bin/ls /boot/loader/entries || true 2024-09-16T16:33:17.436 INFO:teuthology.orchestra.run.smithi122.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-16T16:33:17.436 INFO:teuthology.orchestra.run.smithi122.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-16T16:33:17.436 INFO:teuthology.orchestra.run.smithi122.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-16T16:33:17.436 INFO:teuthology.orchestra.run.smithi122.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-16T16:33:17.438 DEBUG:teuthology.orchestra.run.smithi122:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-16T16:33:17.627 DEBUG:teuthology.orchestra.run.smithi122:> sudo shutdown -r now 2024-09-16T16:33:47.658 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-16T16:33:47.659 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-09-16T16:33:47.660 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T16:34:06.017 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.122 2024-09-16T16:34:15.026 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-09-16T16:34:15.027 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T16:34:18.077 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.122 2024-09-16T16:34:30.089 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-09-16T16:34:30.091 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T16:34:48.509 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.122 2024-09-16T16:35:03.525 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-09-16T16:35:03.526 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T16:35:03.889 DEBUG:teuthology.orchestra.run.smithi122:> true 2024-09-16T16:35:04.267 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-09-16T16:35:04.267 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-16T16:35:04.267 DEBUG:teuthology.orchestra.run.smithi122:> uname -r 2024-09-16T16:35:04.318 INFO:teuthology.orchestra.run.smithi122.stdout:5.14.0-505.el9.x86_64 2024-09-16T16:35:04.319 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-16T16:35:04.319 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-16T16:35:04.319 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-16T16:35:05.320 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-16T16:35:05.320 DEBUG:teuthology.orchestra.run.smithi122:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-16T16:35:05.429 INFO:teuthology.orchestra.run.smithi122.stdout:ttyS1 2024-09-16T16:35:05.449 DEBUG:teuthology.parallel:result is None 2024-09-16T16:35:05.450 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-16T16:35:05.461 INFO:teuthology.task.internal:Creating test directory... 2024-09-16T16:35:05.461 DEBUG:teuthology.orchestra.run.smithi122:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-16T16:35:05.504 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-16T16:35:05.511 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-16T16:35:05.517 INFO:teuthology.task.internal:Creating archive directory... 2024-09-16T16:35:05.517 DEBUG:teuthology.orchestra.run.smithi122:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-16T16:35:05.593 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-16T16:35:05.599 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-16T16:35:05.600 DEBUG:teuthology.orchestra.run.smithi122:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-16T16:35:05.671 INFO:teuthology.orchestra.run.smithi122.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T16:35:05.689 INFO:teuthology.orchestra.run.smithi122.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T16:35:05.691 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-16T16:35:05.698 INFO:teuthology.task.internal:Configuring sudo... 2024-09-16T16:35:05.699 DEBUG:teuthology.orchestra.run.smithi122:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-16T16:35:05.759 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-16T16:35:05.768 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-16T16:35:05.768 DEBUG:teuthology.orchestra.run.smithi122:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-16T16:35:05.812 DEBUG:teuthology.orchestra.run.smithi122:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T16:35:05.887 DEBUG:teuthology.orchestra.run.smithi122:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T16:35:05.956 DEBUG:teuthology.orchestra.run.smithi122:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T16:35:06.031 DEBUG:teuthology.orchestra.run.smithi122:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T16:35:06.059 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-16T16:35:06.059 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-16T16:35:06.121 DEBUG:teuthology.orchestra.run.smithi122:> sudo service rsyslog restart 2024-09-16T16:35:06.206 INFO:teuthology.orchestra.run.smithi122.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T16:35:06.578 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-16T16:35:06.586 INFO:teuthology.task.internal:Starting timer... 2024-09-16T16:35:06.586 INFO:teuthology.run_tasks:Running task pcp... 2024-09-16T16:35:06.599 INFO:teuthology.run_tasks:Running task selinux... 2024-09-16T16:35:06.608 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-09-16T16:35:06.608 DEBUG:teuthology.orchestra.run.smithi122:> sudo service auditd rotate 2024-09-16T16:35:06.722 INFO:teuthology.orchestra.run.smithi122.stdout:Rotating logs: 2024-09-16T16:35:06.724 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-16T16:35:06.724 DEBUG:teuthology.orchestra.run.smithi122:> /usr/sbin/getenforce 2024-09-16T16:35:06.749 INFO:teuthology.orchestra.run.smithi122.stdout:Permissive 2024-09-16T16:35:06.750 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi122.front.sepia.ceph.com': 'permissive'} 2024-09-16T16:35:06.750 DEBUG:teuthology.orchestra.run.smithi122:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T16:35:06.815 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T16:35:06.815 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-16T16:35:06.816 DEBUG:teuthology.orchestra.run.smithi122:> sudo /usr/sbin/setenforce permissive 2024-09-16T16:35:06.916 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-16T16:35:06.926 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-16T16:35:06.938 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-16T16:35:06.939 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi122.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-16T16:39:28.451 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi122.front.sepia.ceph.com')] 2024-09-16T16:39:28.453 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-09-16T16:39:28.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T16:39:28.574 DEBUG:teuthology.orchestra.run.smithi122:> true 2024-09-16T16:39:28.652 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-09-16T16:39:28.653 INFO:teuthology.run_tasks:Running task clock... 2024-09-16T16:39:28.663 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-16T16:39:28.664 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-16T16:39:28.664 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T16:39:28.722 INFO:teuthology.orchestra.run.smithi122.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-16T16:39:28.736 INFO:teuthology.orchestra.run.smithi122.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-16T16:39:28.762 INFO:teuthology.orchestra.run.smithi122.stderr:sudo: ntpd: command not found 2024-09-16T16:39:28.772 INFO:teuthology.orchestra.run.smithi122.stdout:506 Cannot talk to daemon 2024-09-16T16:39:28.786 INFO:teuthology.orchestra.run.smithi122.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-16T16:39:28.800 INFO:teuthology.orchestra.run.smithi122.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-16T16:39:28.858 INFO:teuthology.orchestra.run.smithi122.stderr:bash: line 1: ntpq: command not found 2024-09-16T16:39:28.861 INFO:teuthology.orchestra.run.smithi122.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T16:39:28.861 INFO:teuthology.orchestra.run.smithi122.stdout:=============================================================================== 2024-09-16T16:39:28.861 INFO:teuthology.orchestra.run.smithi122.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T16:39:28.861 INFO:teuthology.orchestra.run.smithi122.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T16:39:28.861 INFO:teuthology.orchestra.run.smithi122.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T16:39:28.861 INFO:teuthology.orchestra.run.smithi122.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T16:39:28.862 INFO:teuthology.run_tasks:Running task install... 2024-09-16T16:39:28.870 DEBUG:teuthology.task.install:project ceph 2024-09-16T16:39:28.871 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'crimson', 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'}} 2024-09-16T16:39:28.871 DEBUG:teuthology.task.install:config {'flavor': 'crimson', 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'} 2024-09-16T16:39:28.871 INFO:teuthology.task.install:Using flavor: crimson 2024-09-16T16:39:28.877 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-16T16:39:28.877 INFO:teuthology.task.install:extra packages: [] 2024-09-16T16:39:28.877 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'crimson', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5', 'tag': None, 'wait_for_package': False} 2024-09-16T16:39:28.878 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=81fedcb3b484c843d22ffbc8d179cb567b7083b5 2024-09-16T16:39:29.026 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/ 2024-09-16T16:39:29.026 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4879.g81fedcb3 2024-09-16T16:39:29.370 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-16T16:39:29.371 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-16T16:39:29.371 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-16T16:39:29.399 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-16T16:39:29.399 DEBUG:teuthology.orchestra.run.smithi122:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/81fedcb3b484c843d22ffbc8d179cb567b7083b5/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-16T16:39:29.467 DEBUG:teuthology.orchestra.run.smithi122:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-16T16:39:29.546 DEBUG:teuthology.orchestra.run.smithi122:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-16T16:39:29.613 INFO:teuthology.orchestra.run.smithi122.stdout:check_obsoletes = 1 2024-09-16T16:39:29.614 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum clean all 2024-09-16T16:39:29.857 INFO:teuthology.orchestra.run.smithi122.stdout:45 files removed 2024-09-16T16:39:29.877 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install ceph-radosgw 2024-09-16T16:39:30.465 INFO:teuthology.orchestra.run.smithi122.stdout:ceph packages for x86_64 293 kB/s | 88 kB 00:00 2024-09-16T16:39:31.005 INFO:teuthology.orchestra.run.smithi122.stdout:ceph noarch packages 48 kB/s | 24 kB 00:00 2024-09-16T16:39:31.589 INFO:teuthology.orchestra.run.smithi122.stdout:ceph source packages 3.8 kB/s | 2.1 kB 00:00 2024-09-16T16:39:33.389 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 9 - BaseOS 4.7 MB/s | 8.2 MB 00:01 2024-09-16T16:39:35.115 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 9 - AppStream 33 MB/s | 20 MB 00:00 2024-09-16T16:39:39.516 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.5 MB 00:00 2024-09-16T16:39:41.313 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 9 - Extras packages 33 kB/s | 19 kB 00:00 2024-09-16T16:39:42.604 INFO:teuthology.orchestra.run.smithi122.stdout:Extra Packages for Enterprise Linux 19 MB/s | 23 MB 00:01 2024-09-16T16:39:47.994 INFO:teuthology.orchestra.run.smithi122.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-16T16:39:50.386 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-16T16:39:50.402 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-16T16:39:50.402 INFO:teuthology.orchestra.run.smithi122.stdout: Package Arch Version Repository Size 2024-09-16T16:39:50.402 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-16T16:39:50.402 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-09-16T16:39:50.403 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-radosgw x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 10 M 2024-09-16T16:39:50.403 INFO:teuthology.orchestra.run.smithi122.stdout:Upgrading: 2024-09-16T16:39:50.403 INFO:teuthology.orchestra.run.smithi122.stdout: librados2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.5 M 2024-09-16T16:39:50.403 INFO:teuthology.orchestra.run.smithi122.stdout: librbd1 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.8 M 2024-09-16T16:39:50.403 INFO:teuthology.orchestra.run.smithi122.stdout:Installing dependencies: 2024-09-16T16:39:50.403 INFO:teuthology.orchestra.run.smithi122.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-16T16:39:50.403 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-base x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 6.1 M 2024-09-16T16:39:50.403 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-common x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 20 M 2024-09-16T16:39:50.403 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-selinux x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 25 k 2024-09-16T16:39:50.403 INFO:teuthology.orchestra.run.smithi122.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-16T16:39:50.403 INFO:teuthology.orchestra.run.smithi122.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-16T16:39:50.403 INFO:teuthology.orchestra.run.smithi122.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-16T16:39:50.404 INFO:teuthology.orchestra.run.smithi122.stdout: libcephfs2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 809 k 2024-09-16T16:39:50.404 INFO:teuthology.orchestra.run.smithi122.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-16T16:39:50.404 INFO:teuthology.orchestra.run.smithi122.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-16T16:39:50.404 INFO:teuthology.orchestra.run.smithi122.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-16T16:39:50.404 INFO:teuthology.orchestra.run.smithi122.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-16T16:39:50.404 INFO:teuthology.orchestra.run.smithi122.stdout: libradosstriper1 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 558 k 2024-09-16T16:39:50.404 INFO:teuthology.orchestra.run.smithi122.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-16T16:39:50.404 INFO:teuthology.orchestra.run.smithi122.stdout: librgw2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 5.4 M 2024-09-16T16:39:50.404 INFO:teuthology.orchestra.run.smithi122.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-16T16:39:50.404 INFO:teuthology.orchestra.run.smithi122.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-16T16:39:50.404 INFO:teuthology.orchestra.run.smithi122.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-16T16:39:50.404 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ceph-argparse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 45 k 2024-09-16T16:39:50.404 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ceph-common x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 143 k 2024-09-16T16:39:50.405 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cephfs x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 160 k 2024-09-16T16:39:50.405 INFO:teuthology.orchestra.run.smithi122.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-16T16:39:50.405 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rados x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 315 k 2024-09-16T16:39:50.405 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rbd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 302 k 2024-09-16T16:39:50.405 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rgw x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 99 k 2024-09-16T16:39:50.405 INFO:teuthology.orchestra.run.smithi122.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-16T16:39:50.405 INFO:teuthology.orchestra.run.smithi122.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-16T16:39:50.405 INFO:teuthology.orchestra.run.smithi122.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-16T16:39:50.405 INFO:teuthology.orchestra.run.smithi122.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-16T16:39:50.405 INFO:teuthology.orchestra.run.smithi122.stdout:Installing weak dependencies: 2024-09-16T16:39:50.405 INFO:teuthology.orchestra.run.smithi122.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-16T16:39:50.405 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:39:50.405 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-09-16T16:39:50.406 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-16T16:39:50.406 INFO:teuthology.orchestra.run.smithi122.stdout:Install 31 Packages 2024-09-16T16:39:50.406 INFO:teuthology.orchestra.run.smithi122.stdout:Upgrade 2 Packages 2024-09-16T16:39:50.406 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:39:50.406 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 60 M 2024-09-16T16:39:50.407 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-09-16T16:39:51.237 INFO:teuthology.orchestra.run.smithi122.stdout:(1/33): ceph-base-19.3.0-4879.g81fedcb3.el9.x86 11 MB/s | 6.1 MB 00:00 2024-09-16T16:39:51.312 INFO:teuthology.orchestra.run.smithi122.stdout:(2/33): ceph-selinux-19.3.0-4879.g81fedcb3.el9. 335 kB/s | 25 kB 00:00 2024-09-16T16:39:51.496 INFO:teuthology.orchestra.run.smithi122.stdout:(3/33): ceph-radosgw-19.3.0-4879.g81fedcb3.el9. 13 MB/s | 10 MB 00:00 2024-09-16T16:39:51.538 INFO:teuthology.orchestra.run.smithi122.stdout:(4/33): libcephfs2-19.3.0-4879.g81fedcb3.el9.x8 3.5 MB/s | 809 kB 00:00 2024-09-16T16:39:51.579 INFO:teuthology.orchestra.run.smithi122.stdout:(5/33): libradosstriper1-19.3.0-4879.g81fedcb3. 6.5 MB/s | 558 kB 00:00 2024-09-16T16:39:51.655 INFO:teuthology.orchestra.run.smithi122.stdout:(6/33): python3-ceph-argparse-19.3.0-4879.g81fe 601 kB/s | 45 kB 00:00 2024-09-16T16:39:51.755 INFO:teuthology.orchestra.run.smithi122.stdout:(7/33): python3-ceph-common-19.3.0-4879.g81fedc 1.4 MB/s | 143 kB 00:00 2024-09-16T16:39:51.898 INFO:teuthology.orchestra.run.smithi122.stdout:(8/33): librgw2-19.3.0-4879.g81fedcb3.el9.x86_6 15 MB/s | 5.4 MB 00:00 2024-09-16T16:39:51.922 INFO:teuthology.orchestra.run.smithi122.stdout:(9/33): python3-cephfs-19.3.0-4879.g81fedcb3.el 956 kB/s | 160 kB 00:00 2024-09-16T16:39:51.948 INFO:teuthology.orchestra.run.smithi122.stdout:(10/33): python3-rados-19.3.0-4879.g81fedcb3.el 6.2 MB/s | 315 kB 00:00 2024-09-16T16:39:51.978 INFO:teuthology.orchestra.run.smithi122.stdout:(11/33): python3-rbd-19.3.0-4879.g81fedcb3.el9. 5.9 MB/s | 302 kB 00:00 2024-09-16T16:39:51.998 INFO:teuthology.orchestra.run.smithi122.stdout:(12/33): python3-rgw-19.3.0-4879.g81fedcb3.el9. 1.9 MB/s | 99 kB 00:00 2024-09-16T16:39:52.200 INFO:teuthology.orchestra.run.smithi122.stdout:(13/33): ceph-common-19.3.0-4879.g81fedcb3.el9. 13 MB/s | 20 MB 00:01 2024-09-16T16:39:52.232 INFO:teuthology.orchestra.run.smithi122.stdout:(14/33): boost-program-options-1.75.0-8.el9.x86 413 kB/s | 107 kB 00:00 2024-09-16T16:39:52.316 INFO:teuthology.orchestra.run.smithi122.stdout:(15/33): libnbd-1.20.2-2.el9.x86_64.rpm 538 kB/s | 171 kB 00:00 2024-09-16T16:39:52.341 INFO:teuthology.orchestra.run.smithi122.stdout:(16/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 417 kB/s | 45 kB 00:00 2024-09-16T16:39:52.400 INFO:teuthology.orchestra.run.smithi122.stdout:(17/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 798 kB/s | 160 kB 00:00 2024-09-16T16:39:52.442 INFO:teuthology.orchestra.run.smithi122.stdout:(18/33): librdkafka-1.6.1-102.el9.x86_64.rpm 5.2 MB/s | 662 kB 00:00 2024-09-16T16:39:52.467 INFO:teuthology.orchestra.run.smithi122.stdout:(19/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.3 MB/s | 292 kB 00:00 2024-09-16T16:39:52.492 INFO:teuthology.orchestra.run.smithi122.stdout:(20/33): python3-prettytable-0.7.2-27.el9.noarc 459 kB/s | 42 kB 00:00 2024-09-16T16:39:52.518 INFO:teuthology.orchestra.run.smithi122.stdout:(21/33): qatlib-24.02.0-1.el9.x86_64.rpm 2.9 MB/s | 221 kB 00:00 2024-09-16T16:39:52.543 INFO:teuthology.orchestra.run.smithi122.stdout:(22/33): qatlib-service-24.02.0-1.el9.x86_64.rp 474 kB/s | 36 kB 00:00 2024-09-16T16:39:52.576 INFO:teuthology.orchestra.run.smithi122.stdout:(23/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 564 kB/s | 47 kB 00:00 2024-09-16T16:39:52.627 INFO:teuthology.orchestra.run.smithi122.stdout:(24/33): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.8 MB/s | 308 kB 00:00 2024-09-16T16:39:52.669 INFO:teuthology.orchestra.run.smithi122.stdout:(25/33): liboath-2.6.7-2.el9.x86_64.rpm 1.2 MB/s | 49 kB 00:00 2024-09-16T16:39:52.694 INFO:teuthology.orchestra.run.smithi122.stdout:(26/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 239 kB/s | 26 kB 00:00 2024-09-16T16:39:52.719 INFO:teuthology.orchestra.run.smithi122.stdout:(27/33): libunwind-1.6.2-1.el9.x86_64.rpm 1.4 MB/s | 67 kB 00:00 2024-09-16T16:39:52.753 INFO:teuthology.orchestra.run.smithi122.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-16T16:39:52.803 INFO:teuthology.orchestra.run.smithi122.stdout:(29/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.5 MB/s | 839 kB 00:00 2024-09-16T16:39:52.896 INFO:teuthology.orchestra.run.smithi122.stdout:(30/33): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-09-16T16:39:52.996 INFO:teuthology.orchestra.run.smithi122.stdout:(31/33): libarrow-9.0.0-11.el9.x86_64.rpm 9.9 MB/s | 4.4 MB 00:00 2024-09-16T16:39:53.063 INFO:teuthology.orchestra.run.smithi122.stdout:(32/33): librados2-19.3.0-4879.g81fedcb3.el9.x8 13 MB/s | 3.5 MB 00:00 2024-09-16T16:39:53.163 INFO:teuthology.orchestra.run.smithi122.stdout:(33/33): librbd1-19.3.0-4879.g81fedcb3.el9.x86_ 14 MB/s | 3.8 MB 00:00 2024-09-16T16:39:53.167 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:39:53.168 INFO:teuthology.orchestra.run.smithi122.stdout:Total 22 MB/s | 60 MB 00:02 2024-09-16T16:39:53.274 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-09-16T16:39:53.310 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-09-16T16:39:53.311 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-09-16T16:39:53.978 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-09-16T16:39:53.978 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-09-16T16:39:55.491 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-09-16T16:39:55.964 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-16T16:39:56.073 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-16T16:39:56.149 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-16T16:39:56.252 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/35 2024-09-16T16:39:56.284 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-16T16:39:56.338 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-16T16:39:56.392 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : liboath-2.6.7-2.el9.x86_64 5/35 2024-09-16T16:39:56.421 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/35 2024-09-16T16:39:56.456 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/35 2024-09-16T16:39:56.478 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-16T16:39:56.501 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-16T16:39:56.696 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-16T16:39:56.727 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-16T16:39:56.762 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/35 2024-09-16T16:39:56.806 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9. 11/35 2024-09-16T16:39:56.837 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 12/35 2024-09-16T16:39:56.924 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 13/35 2024-09-16T16:39:56.958 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 14/35 2024-09-16T16:39:57.029 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 14/35 2024-09-16T16:39:57.073 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : thrift-0.15.0-2.el9.x86_64 15/35 2024-09-16T16:39:57.185 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : re2-1:20211101-20.el9.x86_64 16/35 2024-09-16T16:39:57.225 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/35 2024-09-16T16:39:57.266 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 18/35 2024-09-16T16:39:57.306 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 19/35 2024-09-16T16:39:57.336 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 20/35 2024-09-16T16:39:57.391 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 21/35 2024-09-16T16:39:57.787 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-16T16:39:57.856 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 23/35 2024-09-16T16:39:57.947 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 23/35 2024-09-16T16:39:57.978 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 24/35 2024-09-16T16:39:58.014 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-16T16:39:58.599 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-16T16:39:58.634 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 27/35 2024-09-16T16:39:58.705 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 27/35 2024-09-16T16:39:58.791 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 28/35 2024-09-16T16:39:58.820 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x8 29/35 2024-09-16T16:40:01.328 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-16T16:40:01.366 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-16T16:40:02.056 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-16T16:40:02.101 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 31/35 2024-09-16T16:40:02.183 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 31/35 2024-09-16T16:40:02.183 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-16T16:40:02.183 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-16T16:40:02.183 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:40:02.223 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-16T16:40:12.881 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-16T16:40:12.881 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /sys 2024-09-16T16:40:12.881 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /proc 2024-09-16T16:40:12.881 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /mnt 2024-09-16T16:40:12.881 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /var/tmp 2024-09-16T16:40:12.881 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /home 2024-09-16T16:40:12.882 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /root 2024-09-16T16:40:12.882 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /tmp 2024-09-16T16:40:12.882 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:40:13.999 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/35 2024-09-16T16:40:14.024 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/35 2024-09-16T16:40:14.024 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:40:14.024 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-16T16:40:14.024 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T16:40:14.024 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T16:40:14.025 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:40:14.026 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-16T16:40:14.121 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-16T16:40:14.121 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-16T16:40:15.451 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-16T16:40:15.452 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/35 2024-09-16T16:40:15.452 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-16T16:40:15.452 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/35 2024-09-16T16:40:15.452 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-16T16:40:15.452 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 5/35 2024-09-16T16:40:15.452 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 6/35 2024-09-16T16:40:15.452 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 7/35 2024-09-16T16:40:15.452 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9. 8/35 2024-09-16T16:40:15.452 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x8 9/35 2024-09-16T16:40:15.452 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 10/35 2024-09-16T16:40:15.452 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 11/35 2024-09-16T16:40:15.453 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 12/35 2024-09-16T16:40:15.453 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 13/35 2024-09-16T16:40:15.453 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-16T16:40:15.453 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-16T16:40:15.453 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-16T16:40:15.453 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-16T16:40:15.453 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-16T16:40:15.453 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-16T16:40:15.453 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-16T16:40:15.453 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-16T16:40:15.454 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-16T16:40:15.454 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-16T16:40:15.454 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 24/35 2024-09-16T16:40:15.454 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-16T16:40:15.454 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-16T16:40:15.454 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-16T16:40:15.454 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-16T16:40:15.454 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-16T16:40:15.454 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-16T16:40:15.454 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-16T16:40:15.454 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-16T16:40:15.454 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-16T16:40:15.454 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/35 2024-09-16T16:40:16.392 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-16T16:40:16.392 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:40:16.393 INFO:teuthology.orchestra.run.smithi122.stdout:Upgraded: 2024-09-16T16:40:16.393 INFO:teuthology.orchestra.run.smithi122.stdout: librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:40:16.393 INFO:teuthology.orchestra.run.smithi122.stdout: librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:40:16.393 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-09-16T16:40:16.393 INFO:teuthology.orchestra.run.smithi122.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-16T16:40:16.393 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:40:16.393 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:40:16.393 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:40:16.393 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:40:16.393 INFO:teuthology.orchestra.run.smithi122.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-16T16:40:16.393 INFO:teuthology.orchestra.run.smithi122.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-16T16:40:16.393 INFO:teuthology.orchestra.run.smithi122.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-16T16:40:16.393 INFO:teuthology.orchestra.run.smithi122.stdout: libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:40:16.394 INFO:teuthology.orchestra.run.smithi122.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-16T16:40:16.394 INFO:teuthology.orchestra.run.smithi122.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-16T16:40:16.394 INFO:teuthology.orchestra.run.smithi122.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-16T16:40:16.394 INFO:teuthology.orchestra.run.smithi122.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-16T16:40:16.394 INFO:teuthology.orchestra.run.smithi122.stdout: libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:40:16.394 INFO:teuthology.orchestra.run.smithi122.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-16T16:40:16.394 INFO:teuthology.orchestra.run.smithi122.stdout: librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:40:16.394 INFO:teuthology.orchestra.run.smithi122.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-16T16:40:16.394 INFO:teuthology.orchestra.run.smithi122.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-16T16:40:16.394 INFO:teuthology.orchestra.run.smithi122.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-16T16:40:16.394 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:40:16.394 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:40:16.394 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:40:16.395 INFO:teuthology.orchestra.run.smithi122.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-16T16:40:16.395 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:40:16.395 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:40:16.395 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:40:16.395 INFO:teuthology.orchestra.run.smithi122.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-16T16:40:16.395 INFO:teuthology.orchestra.run.smithi122.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-16T16:40:16.395 INFO:teuthology.orchestra.run.smithi122.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-16T16:40:16.395 INFO:teuthology.orchestra.run.smithi122.stdout: re2-1:20211101-20.el9.x86_64 2024-09-16T16:40:16.395 INFO:teuthology.orchestra.run.smithi122.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-16T16:40:16.395 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:40:16.395 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-16T16:40:16.767 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install ceph-test 2024-09-16T16:40:17.327 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:00:30 ago on Mon 16 Sep 2024 04:39:47 PM UTC. 2024-09-16T16:40:17.468 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-16T16:40:17.469 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-16T16:40:17.469 INFO:teuthology.orchestra.run.smithi122.stdout: Package Arch Version Repository Size 2024-09-16T16:40:17.469 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-16T16:40:17.469 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-09-16T16:40:17.469 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-test x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 85 M 2024-09-16T16:40:17.469 INFO:teuthology.orchestra.run.smithi122.stdout:Installing dependencies: 2024-09-16T16:40:17.469 INFO:teuthology.orchestra.run.smithi122.stdout: libasan8 x86_64 14.2.1-1.2.el9 appstream 513 k 2024-09-16T16:40:17.469 INFO:teuthology.orchestra.run.smithi122.stdout: libcephsqlite x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 175 k 2024-09-16T16:40:17.469 INFO:teuthology.orchestra.run.smithi122.stdout: libubsan x86_64 11.5.0-2.el9 appstream 183 k 2024-09-16T16:40:17.470 INFO:teuthology.orchestra.run.smithi122.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-16T16:40:17.470 INFO:teuthology.orchestra.run.smithi122.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-16T16:40:17.470 INFO:teuthology.orchestra.run.smithi122.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-16T16:40:17.470 INFO:teuthology.orchestra.run.smithi122.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-16T16:40:17.470 INFO:teuthology.orchestra.run.smithi122.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2024-09-16T16:40:17.470 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:40:17.470 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-09-16T16:40:17.470 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-16T16:40:17.470 INFO:teuthology.orchestra.run.smithi122.stdout:Install 9 Packages 2024-09-16T16:40:17.470 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:40:17.471 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 87 M 2024-09-16T16:40:17.471 INFO:teuthology.orchestra.run.smithi122.stdout:Installed size: 797 M 2024-09-16T16:40:17.471 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-09-16T16:40:17.941 INFO:teuthology.orchestra.run.smithi122.stdout:(1/9): lksctp-tools-1.0.19-2.el9.x86_64.rpm 629 kB/s | 94 kB 00:00 2024-09-16T16:40:18.341 INFO:teuthology.orchestra.run.smithi122.stdout:(2/9): libcephsqlite-19.3.0-4879.g81fedcb3.el9. 318 kB/s | 175 kB 00:00 2024-09-16T16:40:18.675 INFO:teuthology.orchestra.run.smithi122.stdout:(3/9): libasan8-14.2.1-1.2.el9.x86_64.rpm 701 kB/s | 513 kB 00:00 2024-09-16T16:40:18.892 INFO:teuthology.orchestra.run.smithi122.stdout:(4/9): libubsan-11.5.0-2.el9.x86_64.rpm 332 kB/s | 183 kB 00:00 2024-09-16T16:40:18.992 INFO:teuthology.orchestra.run.smithi122.stdout:(5/9): protobuf-3.14.0-13.el9.x86_64.rpm 3.2 MB/s | 1.0 MB 00:00 2024-09-16T16:40:19.109 INFO:teuthology.orchestra.run.smithi122.stdout:(6/9): xmlstarlet-1.6.1-20.el9.x86_64.rpm 545 kB/s | 64 kB 00:00 2024-09-16T16:40:19.185 INFO:teuthology.orchestra.run.smithi122.stdout:(7/9): socat-1.7.4.1-6.el9.x86_64.rpm 1.0 MB/s | 304 kB 00:00 2024-09-16T16:40:19.210 INFO:teuthology.orchestra.run.smithi122.stdout:(8/9): yaml-cpp-0.6.3-5.el9.x86_64.rpm 1.2 MB/s | 122 kB 00:00 2024-09-16T16:42:24.541 INFO:teuthology.orchestra.run.smithi122.stdout:(9/9): ceph-test-19.3.0-4879.g81fedcb3.el9.x86_ 684 kB/s | 85 MB 02:06 2024-09-16T16:42:24.542 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:42:24.542 INFO:teuthology.orchestra.run.smithi122.stdout:Total 702 kB/s | 87 MB 02:07 2024-09-16T16:42:24.612 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-09-16T16:42:24.634 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-09-16T16:42:24.634 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-09-16T16:42:25.258 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-09-16T16:42:25.258 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-09-16T16:42:26.153 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-09-16T16:42:26.234 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/9 2024-09-16T16:42:26.283 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 2/9 2024-09-16T16:42:26.343 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 3/9 2024-09-16T16:42:26.370 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 4/9 2024-09-16T16:42:26.401 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-16T16:42:26.426 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-16T16:42:26.516 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-16T16:42:26.560 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 7/9 2024-09-16T16:42:26.586 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 8/9 2024-09-16T16:42:37.807 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 8/9 2024-09-16T16:42:37.913 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 9/9 2024-09-16T16:42:44.309 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 9/9 2024-09-16T16:42:44.309 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/9 2024-09-16T16:42:44.310 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/9 2024-09-16T16:42:44.310 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 3/9 2024-09-16T16:42:44.310 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libasan8-14.2.1-1.2.el9.x86_64 4/9 2024-09-16T16:42:44.310 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-16T16:42:44.310 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 6/9 2024-09-16T16:42:44.310 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 7/9 2024-09-16T16:42:44.310 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 8/9 2024-09-16T16:42:44.748 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 9/9 2024-09-16T16:42:44.748 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:42:44.748 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-09-16T16:42:44.748 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:42:44.749 INFO:teuthology.orchestra.run.smithi122.stdout: libasan8-14.2.1-1.2.el9.x86_64 2024-09-16T16:42:44.749 INFO:teuthology.orchestra.run.smithi122.stdout: libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:42:44.749 INFO:teuthology.orchestra.run.smithi122.stdout: libubsan-11.5.0-2.el9.x86_64 2024-09-16T16:42:44.749 INFO:teuthology.orchestra.run.smithi122.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-16T16:42:44.749 INFO:teuthology.orchestra.run.smithi122.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-16T16:42:44.749 INFO:teuthology.orchestra.run.smithi122.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-16T16:42:44.749 INFO:teuthology.orchestra.run.smithi122.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-16T16:42:44.749 INFO:teuthology.orchestra.run.smithi122.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2024-09-16T16:42:44.749 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:42:44.749 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-16T16:42:45.100 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install ceph 2024-09-16T16:42:45.668 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:02:58 ago on Mon 16 Sep 2024 04:39:47 PM UTC. 2024-09-16T16:42:45.803 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-16T16:42:45.806 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-16T16:42:45.806 INFO:teuthology.orchestra.run.smithi122.stdout: Package Arch Version Repository Size 2024-09-16T16:42:45.806 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-16T16:42:45.806 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-09-16T16:42:45.806 INFO:teuthology.orchestra.run.smithi122.stdout: ceph x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 6.5 k 2024-09-16T16:42:45.806 INFO:teuthology.orchestra.run.smithi122.stdout:Installing dependencies: 2024-09-16T16:42:45.806 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mds x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 2.2 M 2024-09-16T16:42:45.806 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 1.6 M 2024-09-16T16:42:45.806 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 291 k 2024-09-16T16:42:45.806 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mon x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 5.1 M 2024-09-16T16:42:45.806 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-osd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 70 M 2024-09-16T16:42:45.806 INFO:teuthology.orchestra.run.smithi122.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-16T16:42:45.806 INFO:teuthology.orchestra.run.smithi122.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-16T16:42:45.807 INFO:teuthology.orchestra.run.smithi122.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-16T16:42:45.807 INFO:teuthology.orchestra.run.smithi122.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-16T16:42:45.807 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-16T16:42:45.807 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-16T16:42:45.807 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-16T16:42:45.807 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-16T16:42:45.807 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-16T16:42:45.807 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-16T16:42:45.807 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-collections 2024-09-16T16:42:45.807 INFO:teuthology.orchestra.run.smithi122.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-16T16:42:45.807 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-16T16:42:45.807 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-16T16:42:45.807 INFO:teuthology.orchestra.run.smithi122.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-16T16:42:45.808 INFO:teuthology.orchestra.run.smithi122.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-16T16:42:45.808 INFO:teuthology.orchestra.run.smithi122.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-16T16:42:45.808 INFO:teuthology.orchestra.run.smithi122.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-16T16:42:45.808 INFO:teuthology.orchestra.run.smithi122.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-16T16:42:45.808 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-16T16:42:45.808 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-16T16:42:45.808 INFO:teuthology.orchestra.run.smithi122.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-16T16:42:45.808 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-16T16:42:45.808 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-16T16:42:45.808 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-16T16:42:45.808 INFO:teuthology.orchestra.run.smithi122.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-16T16:42:45.808 INFO:teuthology.orchestra.run.smithi122.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-16T16:42:45.808 INFO:teuthology.orchestra.run.smithi122.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-16T16:42:45.808 INFO:teuthology.orchestra.run.smithi122.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-16T16:42:45.808 INFO:teuthology.orchestra.run.smithi122.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-16T16:42:45.809 INFO:teuthology.orchestra.run.smithi122.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-16T16:42:45.809 INFO:teuthology.orchestra.run.smithi122.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-16T16:42:45.809 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:42:45.809 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-09-16T16:42:45.809 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-16T16:42:45.809 INFO:teuthology.orchestra.run.smithi122.stdout:Install 37 Packages 2024-09-16T16:42:45.809 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:42:45.809 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 84 M 2024-09-16T16:42:45.809 INFO:teuthology.orchestra.run.smithi122.stdout:Installed size: 897 M 2024-09-16T16:42:45.810 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-09-16T16:42:46.357 INFO:teuthology.orchestra.run.smithi122.stdout:(1/37): ceph-19.3.0-4879.g81fedcb3.el9.x86_64.r 17 kB/s | 6.5 kB 00:00 2024-09-16T16:42:47.432 INFO:teuthology.orchestra.run.smithi122.stdout:(2/37): ceph-mon-19.3.0-4879.g81fedcb3.el9.x86_ 4.8 MB/s | 5.1 MB 00:01 2024-09-16T16:42:48.557 INFO:teuthology.orchestra.run.smithi122.stdout:(3/37): ceph-mds-19.3.0-4879.g81fedcb3.el9.x86_ 873 kB/s | 2.2 MB 00:02 2024-09-16T16:42:48.882 INFO:teuthology.orchestra.run.smithi122.stdout:(4/37): ceph-mgr-modules-core-19.3.0-4879.g81fe 895 kB/s | 291 kB 00:00 2024-09-16T16:42:48.958 INFO:teuthology.orchestra.run.smithi122.stdout:(5/37): ceph-mgr-19.3.0-4879.g81fedcb3.el9.x86_ 548 kB/s | 1.6 MB 00:02 2024-09-16T16:42:49.075 INFO:teuthology.orchestra.run.smithi122.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.3 MB/s | 253 kB 00:00 2024-09-16T16:42:49.158 INFO:teuthology.orchestra.run.smithi122.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 1.3 MB/s | 106 kB 00:00 2024-09-16T16:42:49.234 INFO:teuthology.orchestra.run.smithi122.stdout:(8/37): python3-pycparser-2.20-6.el9.noarch.rpm 1.8 MB/s | 135 kB 00:00 2024-09-16T16:42:49.341 INFO:teuthology.orchestra.run.smithi122.stdout:(9/37): python3-requests-2.25.1-8.el9.noarch.rp 1.1 MB/s | 125 kB 00:00 2024-09-16T16:42:49.451 INFO:teuthology.orchestra.run.smithi122.stdout:(10/37): python3-cryptography-36.0.1-4.el9.x86_ 2.5 MB/s | 1.2 MB 00:00 2024-09-16T16:42:49.476 INFO:teuthology.orchestra.run.smithi122.stdout:(11/37): python3-urllib3-1.26.5-6.el9.noarch.rp 1.5 MB/s | 215 kB 00:00 2024-09-16T16:42:50.027 INFO:teuthology.orchestra.run.smithi122.stdout:(12/37): lua-5.4.4-4.el9.x86_64.rpm 327 kB/s | 188 kB 00:00 2024-09-16T16:42:50.053 INFO:teuthology.orchestra.run.smithi122.stdout:(13/37): python3-mako-1.1.4-6.el9.noarch.rpm 298 kB/s | 172 kB 00:00 2024-09-16T16:42:50.145 INFO:teuthology.orchestra.run.smithi122.stdout:(14/37): python3-markupsafe-1.1.1-12.el9.x86_64 293 kB/s | 35 kB 00:00 2024-09-16T16:42:50.171 INFO:teuthology.orchestra.run.smithi122.stdout:(15/37): python3-packaging-20.9-5.el9.noarch.rp 660 kB/s | 77 kB 00:00 2024-09-16T16:42:50.254 INFO:teuthology.orchestra.run.smithi122.stdout:(16/37): python3-pytz-2021.1-5.el9.noarch.rpm 470 kB/s | 51 kB 00:00 2024-09-16T16:42:50.280 INFO:teuthology.orchestra.run.smithi122.stdout:(17/37): python3-toml-0.10.2-6.el9.noarch.rpm 384 kB/s | 42 kB 00:00 2024-09-16T16:42:50.330 INFO:teuthology.orchestra.run.smithi122.stdout:(18/37): luarocks-3.9.2-5.el9.noarch.rpm 3.0 MB/s | 151 kB 00:00 2024-09-16T16:42:50.355 INFO:teuthology.orchestra.run.smithi122.stdout:(19/37): lua-devel-5.4.4-4.el9.x86_64.rpm 222 kB/s | 22 kB 00:00 2024-09-16T16:42:50.380 INFO:teuthology.orchestra.run.smithi122.stdout:(20/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 865 kB/s | 43 kB 00:00 2024-09-16T16:42:50.439 INFO:teuthology.orchestra.run.smithi122.stdout:(21/37): python3-cherrypy-18.6.1-2.el9.noarch.r 6.8 MB/s | 358 kB 00:00 2024-09-16T16:42:50.464 INFO:teuthology.orchestra.run.smithi122.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 426 kB/s | 11 kB 00:00 2024-09-16T16:42:50.490 INFO:teuthology.orchestra.run.smithi122.stdout:(23/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.2 MB/s | 172 kB 00:00 2024-09-16T16:42:50.515 INFO:teuthology.orchestra.run.smithi122.stdout:(24/37): python3-jaraco-classes-3.2.1-5.el9.noa 352 kB/s | 18 kB 00:00 2024-09-16T16:42:50.540 INFO:teuthology.orchestra.run.smithi122.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 461 kB/s | 23 kB 00:00 2024-09-16T16:42:50.566 INFO:teuthology.orchestra.run.smithi122.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 387 kB/s | 19 kB 00:00 2024-09-16T16:42:50.591 INFO:teuthology.orchestra.run.smithi122.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 390 kB/s | 20 kB 00:00 2024-09-16T16:42:50.633 INFO:teuthology.orchestra.run.smithi122.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 692 kB/s | 46 kB 00:00 2024-09-16T16:42:50.658 INFO:teuthology.orchestra.run.smithi122.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.1 MB/s | 79 kB 00:00 2024-09-16T16:42:50.683 INFO:teuthology.orchestra.run.smithi122.stdout:(30/37): python3-portend-3.1.0-2.el9.noarch.rpm 663 kB/s | 16 kB 00:00 2024-09-16T16:42:50.726 INFO:teuthology.orchestra.run.smithi122.stdout:(31/37): python3-pecan-1.4.2-3.el9.noarch.rpm 2.9 MB/s | 272 kB 00:00 2024-09-16T16:42:50.751 INFO:teuthology.orchestra.run.smithi122.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.3 MB/s | 90 kB 00:00 2024-09-16T16:42:50.767 INFO:teuthology.orchestra.run.smithi122.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 856 kB/s | 36 kB 00:00 2024-09-16T16:42:50.801 INFO:teuthology.orchestra.run.smithi122.stdout:(34/37): python3-webob-1.8.8-2.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-09-16T16:42:50.818 INFO:teuthology.orchestra.run.smithi122.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 1.2 MB/s | 20 kB 00:00 2024-09-16T16:42:50.852 INFO:teuthology.orchestra.run.smithi122.stdout:(36/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 5.0 MB/s | 427 kB 00:00 2024-09-16T16:43:12.709 INFO:teuthology.orchestra.run.smithi122.stdout:(37/37): ceph-osd-19.3.0-4879.g81fedcb3.el9.x86 2.8 MB/s | 70 MB 00:25 2024-09-16T16:43:12.712 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:43:12.712 INFO:teuthology.orchestra.run.smithi122.stdout:Total 3.1 MB/s | 84 MB 00:26 2024-09-16T16:43:12.859 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-09-16T16:43:12.901 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-09-16T16:43:12.901 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-09-16T16:43:13.697 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-09-16T16:43:13.698 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-09-16T16:43:15.353 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-09-16T16:43:15.419 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-16T16:43:15.452 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-16T16:43:15.480 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-16T16:43:15.550 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-16T16:43:15.587 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-16T16:43:15.619 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-16T16:43:15.713 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-16T16:43:15.797 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-16T16:43:15.838 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-16T16:43:15.882 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-16T16:43:15.912 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-16T16:43:15.946 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-16T16:43:15.981 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-16T16:43:16.029 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-16T16:43:16.064 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-16T16:43:16.099 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-16T16:43:16.147 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-16T16:43:16.179 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-16T16:43:16.282 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-16T16:43:16.430 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-16T16:43:16.511 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-16T16:43:16.564 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-16T16:43:16.606 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-16T16:43:16.654 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-16T16:43:16.709 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-16T16:43:16.894 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-16T16:43:16.943 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-16T16:43:17.022 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-16T16:43:17.109 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-16T16:43:17.154 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-16T16:43:17.285 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-16T16:43:17.479 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9. 32/37 2024-09-16T16:43:17.503 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/37 2024-09-16T16:43:17.528 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/37 2024-09-16T16:43:17.528 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:43:17.528 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-16T16:43:17.528 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T16:43:17.529 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T16:43:17.529 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:43:28.129 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/37 2024-09-16T16:43:28.158 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/37 2024-09-16T16:43:28.158 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:43:28.158 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-16T16:43:28.158 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T16:43:28.158 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T16:43:28.158 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:43:28.697 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 35/37 2024-09-16T16:43:28.720 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 35/37 2024-09-16T16:43:28.721 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:43:28.721 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-16T16:43:28.721 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T16:43:28.721 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T16:43:28.721 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:43:28.947 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 36/37 2024-09-16T16:43:28.971 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 36/37 2024-09-16T16:43:28.971 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:43:28.971 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-16T16:43:28.971 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T16:43:28.971 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T16:43:28.971 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:43:29.027 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 37/37 2024-09-16T16:43:35.839 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 37/37 2024-09-16T16:43:35.839 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/37 2024-09-16T16:43:35.839 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/37 2024-09-16T16:43:35.839 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/37 2024-09-16T16:43:35.839 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/37 2024-09-16T16:43:35.839 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 5/37 2024-09-16T16:43:35.839 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9. 6/37 2024-09-16T16:43:35.839 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-16T16:43:35.839 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-16T16:43:35.839 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-16T16:43:35.840 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-16T16:43:35.840 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-16T16:43:35.840 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-16T16:43:35.840 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-16T16:43:35.840 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-16T16:43:35.840 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-16T16:43:35.840 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-16T16:43:35.840 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-16T16:43:35.840 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-16T16:43:35.840 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-16T16:43:35.840 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-16T16:43:35.840 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-16T16:43:35.840 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-16T16:43:35.840 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-16T16:43:35.840 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-16T16:43:35.841 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-16T16:43:35.842 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-16T16:43:35.842 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-16T16:43:35.842 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-16T16:43:35.842 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-16T16:43:35.842 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-16T16:43:35.842 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-16T16:43:35.842 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-16T16:43:35.842 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-16T16:43:35.842 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-16T16:43:35.842 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-16T16:43:35.842 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-16T16:43:36.643 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-16T16:43:36.643 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:43:36.643 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-09-16T16:43:36.643 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:43:36.644 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:43:36.644 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:43:36.644 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:43:36.644 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:43:36.644 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:43:36.644 INFO:teuthology.orchestra.run.smithi122.stdout: lua-5.4.4-4.el9.x86_64 2024-09-16T16:43:36.644 INFO:teuthology.orchestra.run.smithi122.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-16T16:43:36.644 INFO:teuthology.orchestra.run.smithi122.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-16T16:43:36.644 INFO:teuthology.orchestra.run.smithi122.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-16T16:43:36.644 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-16T16:43:36.644 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-16T16:43:36.644 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-16T16:43:36.644 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-16T16:43:36.645 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-16T16:43:36.645 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-16T16:43:36.645 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-16T16:43:36.645 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-16T16:43:36.645 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-16T16:43:36.645 INFO:teuthology.orchestra.run.smithi122.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-16T16:43:36.645 INFO:teuthology.orchestra.run.smithi122.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-16T16:43:36.645 INFO:teuthology.orchestra.run.smithi122.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-16T16:43:36.645 INFO:teuthology.orchestra.run.smithi122.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-16T16:43:36.645 INFO:teuthology.orchestra.run.smithi122.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-16T16:43:36.645 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-16T16:43:36.645 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ply-3.11-14.el9.noarch 2024-09-16T16:43:36.645 INFO:teuthology.orchestra.run.smithi122.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-16T16:43:36.645 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-16T16:43:36.646 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-16T16:43:36.646 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-16T16:43:36.646 INFO:teuthology.orchestra.run.smithi122.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-16T16:43:36.646 INFO:teuthology.orchestra.run.smithi122.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-16T16:43:36.646 INFO:teuthology.orchestra.run.smithi122.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-16T16:43:36.646 INFO:teuthology.orchestra.run.smithi122.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-16T16:43:36.646 INFO:teuthology.orchestra.run.smithi122.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-16T16:43:36.646 INFO:teuthology.orchestra.run.smithi122.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-16T16:43:36.646 INFO:teuthology.orchestra.run.smithi122.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-16T16:43:36.646 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:43:36.646 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-16T16:43:36.912 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install ceph-base 2024-09-16T16:43:37.479 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:03:50 ago on Mon 16 Sep 2024 04:39:47 PM UTC. 2024-09-16T16:43:37.569 INFO:teuthology.orchestra.run.smithi122.stdout:Package ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:43:37.611 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-16T16:43:37.612 INFO:teuthology.orchestra.run.smithi122.stdout:Nothing to do. 2024-09-16T16:43:37.612 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-16T16:43:37.685 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install cephadm 2024-09-16T16:43:38.242 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:03:51 ago on Mon 16 Sep 2024 04:39:47 PM UTC. 2024-09-16T16:43:38.373 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-16T16:43:38.374 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-16T16:43:38.374 INFO:teuthology.orchestra.run.smithi122.stdout: Package Arch Version Repository Size 2024-09-16T16:43:38.374 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-16T16:43:38.374 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-09-16T16:43:38.374 INFO:teuthology.orchestra.run.smithi122.stdout: cephadm noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 785 k 2024-09-16T16:43:38.374 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:43:38.374 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-09-16T16:43:38.375 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-16T16:43:38.375 INFO:teuthology.orchestra.run.smithi122.stdout:Install 1 Package 2024-09-16T16:43:38.375 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:43:38.375 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 785 k 2024-09-16T16:43:38.375 INFO:teuthology.orchestra.run.smithi122.stdout:Installed size: 791 k 2024-09-16T16:43:38.375 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-09-16T16:43:40.497 INFO:teuthology.orchestra.run.smithi122.stdout:cephadm-19.3.0-4879.g81fedcb3.el9.noarch.rpm 370 kB/s | 785 kB 00:02 2024-09-16T16:43:40.497 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:43:40.498 INFO:teuthology.orchestra.run.smithi122.stdout:Total 370 kB/s | 785 kB 00:02 2024-09-16T16:43:40.498 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-09-16T16:43:40.504 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-09-16T16:43:40.504 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-09-16T16:43:40.511 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-09-16T16:43:40.511 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-09-16T16:43:40.588 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-09-16T16:43:41.064 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:43:41.177 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:43:41.576 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:43:41.839 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:43:41.840 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:43:41.840 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-09-16T16:43:41.840 INFO:teuthology.orchestra.run.smithi122.stdout: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:43:41.840 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:43:41.840 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-16T16:43:42.060 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install ceph-immutable-object-cache 2024-09-16T16:43:42.650 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:03:55 ago on Mon 16 Sep 2024 04:39:47 PM UTC. 2024-09-16T16:43:42.781 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-16T16:43:42.782 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-16T16:43:42.782 INFO:teuthology.orchestra.run.smithi122.stdout: Package Arch Version Repo Size 2024-09-16T16:43:42.782 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-16T16:43:42.782 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-09-16T16:43:42.782 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 158 k 2024-09-16T16:43:42.782 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:43:42.782 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-09-16T16:43:42.783 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-16T16:43:42.783 INFO:teuthology.orchestra.run.smithi122.stdout:Install 1 Package 2024-09-16T16:43:42.783 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:43:42.783 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 158 k 2024-09-16T16:43:42.783 INFO:teuthology.orchestra.run.smithi122.stdout:Installed size: 644 k 2024-09-16T16:43:42.783 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-09-16T16:43:43.778 INFO:teuthology.orchestra.run.smithi122.stdout:ceph-immutable-object-cache-19.3.0-4879.g81fedc 159 kB/s | 158 kB 00:00 2024-09-16T16:43:43.778 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:43:43.779 INFO:teuthology.orchestra.run.smithi122.stdout:Total 159 kB/s | 158 kB 00:00 2024-09-16T16:43:43.779 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-09-16T16:43:43.793 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-09-16T16:43:43.793 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-09-16T16:43:43.850 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-09-16T16:43:43.850 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-09-16T16:43:43.999 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-09-16T16:43:44.070 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-16T16:43:44.096 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-16T16:43:44.096 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:43:44.096 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-16T16:43:44.096 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:43:45.030 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-16T16:43:45.030 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:43:45.030 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-09-16T16:43:45.030 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:43:45.030 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:43:45.030 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-16T16:43:45.290 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install ceph-mgr 2024-09-16T16:43:45.866 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:03:58 ago on Mon 16 Sep 2024 04:39:47 PM UTC. 2024-09-16T16:43:45.957 INFO:teuthology.orchestra.run.smithi122.stdout:Package ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:43:45.999 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-16T16:43:46.000 INFO:teuthology.orchestra.run.smithi122.stdout:Nothing to do. 2024-09-16T16:43:46.000 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-16T16:43:46.078 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install ceph-mgr-dashboard 2024-09-16T16:43:46.641 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:03:59 ago on Mon 16 Sep 2024 04:39:47 PM UTC. 2024-09-16T16:43:46.775 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-16T16:43:46.776 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-16T16:43:46.776 INFO:teuthology.orchestra.run.smithi122.stdout: Package Arch Version Repository Size 2024-09-16T16:43:46.776 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-16T16:43:46.776 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-09-16T16:43:46.776 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 14 M 2024-09-16T16:43:46.776 INFO:teuthology.orchestra.run.smithi122.stdout:Installing dependencies: 2024-09-16T16:43:46.776 INFO:teuthology.orchestra.run.smithi122.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-16T16:43:46.776 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 34 k 2024-09-16T16:43:46.776 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 16 k 2024-09-16T16:43:46.776 INFO:teuthology.orchestra.run.smithi122.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-16T16:43:46.777 INFO:teuthology.orchestra.run.smithi122.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-16T16:43:46.777 INFO:teuthology.orchestra.run.smithi122.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-16T16:43:46.777 INFO:teuthology.orchestra.run.smithi122.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-16T16:43:46.777 INFO:teuthology.orchestra.run.smithi122.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-16T16:43:46.777 INFO:teuthology.orchestra.run.smithi122.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-16T16:43:46.777 INFO:teuthology.orchestra.run.smithi122.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-16T16:43:46.777 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:43:46.777 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-09-16T16:43:46.777 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-16T16:43:46.777 INFO:teuthology.orchestra.run.smithi122.stdout:Install 11 Packages 2024-09-16T16:43:46.777 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:43:46.778 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 18 M 2024-09-16T16:43:46.778 INFO:teuthology.orchestra.run.smithi122.stdout:Installed size: 155 M 2024-09-16T16:43:46.778 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-09-16T16:43:47.615 INFO:teuthology.orchestra.run.smithi122.stdout:(1/11): ceph-grafana-dashboards-19.3.0-4879.g81 76 kB/s | 34 kB 00:00 2024-09-16T16:43:47.640 INFO:teuthology.orchestra.run.smithi122.stdout:(2/11): ceph-prometheus-alerts-19.3.0-4879.g81f 35 kB/s | 16 kB 00:00 2024-09-16T16:43:47.815 INFO:teuthology.orchestra.run.smithi122.stdout:(3/11): protobuf-compiler-3.14.0-13.el9.x86_64. 4.8 MB/s | 863 kB 00:00 2024-09-16T16:43:47.841 INFO:teuthology.orchestra.run.smithi122.stdout:(4/11): python3-protobuf-3.14.0-13.el9.noarch.r 1.2 MB/s | 269 kB 00:00 2024-09-16T16:43:47.891 INFO:teuthology.orchestra.run.smithi122.stdout:(5/11): grpc-data-1.46.7-10.el9.noarch.rpm 389 kB/s | 19 kB 00:00 2024-09-16T16:43:47.933 INFO:teuthology.orchestra.run.smithi122.stdout:(6/11): abseil-cpp-20211102.0-3.el9.x86_64.rpm 4.5 MB/s | 548 kB 00:00 2024-09-16T16:43:47.967 INFO:teuthology.orchestra.run.smithi122.stdout:(7/11): python3-grpcio-tools-1.46.7-10.el9.x86_ 4.3 MB/s | 144 kB 00:00 2024-09-16T16:43:47.992 INFO:teuthology.orchestra.run.smithi122.stdout:(8/11): python3-repoze-lru-0.7-16.el9.noarch.rp 1.2 MB/s | 31 kB 00:00 2024-09-16T16:43:48.034 INFO:teuthology.orchestra.run.smithi122.stdout:(9/11): python3-routes-2.5.1-5.el9.noarch.rpm 4.4 MB/s | 188 kB 00:00 2024-09-16T16:43:48.159 INFO:teuthology.orchestra.run.smithi122.stdout:(10/11): python3-grpcio-1.46.7-10.el9.x86_64.rp 7.6 MB/s | 2.0 MB 00:00 2024-09-16T16:43:58.650 INFO:teuthology.orchestra.run.smithi122.stdout:(11/11): ceph-mgr-dashboard-19.3.0-4879.g81fedc 1.2 MB/s | 14 MB 00:11 2024-09-16T16:43:58.655 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:43:58.655 INFO:teuthology.orchestra.run.smithi122.stdout:Total 1.5 MB/s | 18 MB 00:11 2024-09-16T16:43:58.687 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-09-16T16:43:58.708 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-09-16T16:43:58.708 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-09-16T16:43:58.974 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-09-16T16:43:58.975 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-09-16T16:43:59.524 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-09-16T16:43:59.598 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/11 2024-09-16T16:43:59.628 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/11 2024-09-16T16:43:59.719 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 3/11 2024-09-16T16:43:59.847 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 4/11 2024-09-16T16:43:59.899 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 5/11 2024-09-16T16:43:59.991 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 6/11 2024-09-16T16:44:00.042 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 7/11 2024-09-16T16:44:00.071 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 8/11 2024-09-16T16:44:00.103 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9 9/11 2024-09-16T16:44:03.286 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el 10/11 2024-09-16T16:44:03.350 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 11/11 2024-09-16T16:44:05.301 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 11/11 2024-09-16T16:44:05.301 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el 1/11 2024-09-16T16:44:05.302 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 2/11 2024-09-16T16:44:05.302 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9 3/11 2024-09-16T16:44:05.302 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 4/11 2024-09-16T16:44:05.302 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 5/11 2024-09-16T16:44:05.302 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 6/11 2024-09-16T16:44:05.302 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 7/11 2024-09-16T16:44:05.302 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 8/11 2024-09-16T16:44:05.302 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/11 2024-09-16T16:44:05.302 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 10/11 2024-09-16T16:44:05.633 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 11/11 2024-09-16T16:44:05.633 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:44:05.633 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-09-16T16:44:05.633 INFO:teuthology.orchestra.run.smithi122.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-16T16:44:05.633 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:44:05.633 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:44:05.633 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:44:05.633 INFO:teuthology.orchestra.run.smithi122.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-16T16:44:05.633 INFO:teuthology.orchestra.run.smithi122.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-16T16:44:05.633 INFO:teuthology.orchestra.run.smithi122.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-16T16:44:05.634 INFO:teuthology.orchestra.run.smithi122.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-16T16:44:05.634 INFO:teuthology.orchestra.run.smithi122.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-16T16:44:05.634 INFO:teuthology.orchestra.run.smithi122.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-16T16:44:05.634 INFO:teuthology.orchestra.run.smithi122.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-16T16:44:05.634 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:44:05.634 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-16T16:44:05.894 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-16T16:44:06.458 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:04:19 ago on Mon 16 Sep 2024 04:39:47 PM UTC. 2024-09-16T16:44:06.590 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-16T16:44:06.591 INFO:teuthology.orchestra.run.smithi122.stdout:======================================================================================= 2024-09-16T16:44:06.591 INFO:teuthology.orchestra.run.smithi122.stdout: Package Arch Version Repository Size 2024-09-16T16:44:06.592 INFO:teuthology.orchestra.run.smithi122.stdout:======================================================================================= 2024-09-16T16:44:06.592 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-09-16T16:44:06.592 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 7.4 M 2024-09-16T16:44:06.592 INFO:teuthology.orchestra.run.smithi122.stdout:Installing dependencies: 2024-09-16T16:44:06.592 INFO:teuthology.orchestra.run.smithi122.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-16T16:44:06.592 INFO:teuthology.orchestra.run.smithi122.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-16T16:44:06.592 INFO:teuthology.orchestra.run.smithi122.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-16T16:44:06.592 INFO:teuthology.orchestra.run.smithi122.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-16T16:44:06.592 INFO:teuthology.orchestra.run.smithi122.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-16T16:44:06.592 INFO:teuthology.orchestra.run.smithi122.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-16T16:44:06.592 INFO:teuthology.orchestra.run.smithi122.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-16T16:44:06.592 INFO:teuthology.orchestra.run.smithi122.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-16T16:44:06.593 INFO:teuthology.orchestra.run.smithi122.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-16T16:44:06.593 INFO:teuthology.orchestra.run.smithi122.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-16T16:44:06.593 INFO:teuthology.orchestra.run.smithi122.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-16T16:44:06.593 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:44:06.593 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-09-16T16:44:06.593 INFO:teuthology.orchestra.run.smithi122.stdout:======================================================================================= 2024-09-16T16:44:06.593 INFO:teuthology.orchestra.run.smithi122.stdout:Install 12 Packages 2024-09-16T16:44:06.593 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:44:06.594 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 38 M 2024-09-16T16:44:06.594 INFO:teuthology.orchestra.run.smithi122.stdout:Installed size: 212 M 2024-09-16T16:44:06.594 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-09-16T16:44:06.808 INFO:teuthology.orchestra.run.smithi122.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.6 MB/s | 191 kB 00:00 2024-09-16T16:44:06.874 INFO:teuthology.orchestra.run.smithi122.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 4.2 MB/s | 801 kB 00:00 2024-09-16T16:44:06.908 INFO:teuthology.orchestra.run.smithi122.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 349 kB/s | 33 kB 00:00 2024-09-16T16:44:06.958 INFO:teuthology.orchestra.run.smithi122.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 371 kB/s | 18 kB 00:00 2024-09-16T16:44:07.017 INFO:teuthology.orchestra.run.smithi122.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 659 kB/s | 38 kB 00:00 2024-09-16T16:44:07.192 INFO:teuthology.orchestra.run.smithi122.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 9.4 MB/s | 3.0 MB 00:00 2024-09-16T16:44:07.251 INFO:teuthology.orchestra.run.smithi122.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 4.1 MB/s | 245 kB 00:00 2024-09-16T16:44:07.343 INFO:teuthology.orchestra.run.smithi122.stdout:(8/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 15 MB/s | 4.9 MB 00:00 2024-09-16T16:44:07.401 INFO:teuthology.orchestra.run.smithi122.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 4.2 MB/s | 250 kB 00:00 2024-09-16T16:44:07.468 INFO:teuthology.orchestra.run.smithi122.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 23 MB/s | 5.1 MB 00:00 2024-09-16T16:44:07.744 INFO:teuthology.orchestra.run.smithi122.stdout:(11/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 48 MB/s | 16 MB 00:00 2024-09-16T16:44:12.002 INFO:teuthology.orchestra.run.smithi122.stdout:(12/12): ceph-mgr-diskprediction-local-19.3.0-4 1.4 MB/s | 7.4 MB 00:05 2024-09-16T16:44:12.003 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:44:12.003 INFO:teuthology.orchestra.run.smithi122.stdout:Total 7.1 MB/s | 38 MB 00:05 2024-09-16T16:44:12.365 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-09-16T16:44:12.390 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-09-16T16:44:12.390 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-09-16T16:44:12.821 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-09-16T16:44:12.821 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-09-16T16:44:13.606 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-09-16T16:44:13.669 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-16T16:44:13.708 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-16T16:44:13.817 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-16T16:44:13.868 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-16T16:44:14.054 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-16T16:44:14.083 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-16T16:44:14.160 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-16T16:44:14.820 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-16T16:44:14.947 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-16T16:44:16.191 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-16T16:44:17.222 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-16T16:44:17.258 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 12/12 2024-09-16T16:44:19.893 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 12/12 2024-09-16T16:44:19.894 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 1/12 2024-09-16T16:44:19.894 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-16T16:44:19.894 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-16T16:44:19.894 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-16T16:44:19.894 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-16T16:44:19.894 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-16T16:44:19.894 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-16T16:44:19.894 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-16T16:44:19.894 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-16T16:44:19.894 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-16T16:44:19.894 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-16T16:44:20.299 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-16T16:44:20.299 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:44:20.299 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-09-16T16:44:20.299 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:44:20.299 INFO:teuthology.orchestra.run.smithi122.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-16T16:44:20.299 INFO:teuthology.orchestra.run.smithi122.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-16T16:44:20.299 INFO:teuthology.orchestra.run.smithi122.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-16T16:44:20.300 INFO:teuthology.orchestra.run.smithi122.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-16T16:44:20.300 INFO:teuthology.orchestra.run.smithi122.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-16T16:44:20.300 INFO:teuthology.orchestra.run.smithi122.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-16T16:44:20.300 INFO:teuthology.orchestra.run.smithi122.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-16T16:44:20.300 INFO:teuthology.orchestra.run.smithi122.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-16T16:44:20.300 INFO:teuthology.orchestra.run.smithi122.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-16T16:44:20.300 INFO:teuthology.orchestra.run.smithi122.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-16T16:44:20.300 INFO:teuthology.orchestra.run.smithi122.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-16T16:44:20.300 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:44:20.300 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-16T16:44:20.703 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install ceph-mgr-rook 2024-09-16T16:44:21.275 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:04:34 ago on Mon 16 Sep 2024 04:39:47 PM UTC. 2024-09-16T16:44:21.408 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-16T16:44:21.409 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-16T16:44:21.410 INFO:teuthology.orchestra.run.smithi122.stdout: Package Arch Version Repository Size 2024-09-16T16:44:21.410 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-16T16:44:21.410 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-09-16T16:44:21.410 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-rook noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 49 k 2024-09-16T16:44:21.410 INFO:teuthology.orchestra.run.smithi122.stdout:Installing dependencies: 2024-09-16T16:44:21.410 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-16T16:44:21.410 INFO:teuthology.orchestra.run.smithi122.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-16T16:44:21.410 INFO:teuthology.orchestra.run.smithi122.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-16T16:44:21.410 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-16T16:44:21.410 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-16T16:44:21.410 INFO:teuthology.orchestra.run.smithi122.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-16T16:44:21.410 INFO:teuthology.orchestra.run.smithi122.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-16T16:44:21.411 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-16T16:44:21.411 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-16T16:44:21.411 INFO:teuthology.orchestra.run.smithi122.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-16T16:44:21.411 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-16T16:44:21.411 INFO:teuthology.orchestra.run.smithi122.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-16T16:44:21.411 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:44:21.411 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-09-16T16:44:21.411 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-16T16:44:21.411 INFO:teuthology.orchestra.run.smithi122.stdout:Install 13 Packages 2024-09-16T16:44:21.411 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:44:21.412 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 2.2 M 2024-09-16T16:44:21.412 INFO:teuthology.orchestra.run.smithi122.stdout:Installed size: 26 M 2024-09-16T16:44:21.412 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-09-16T16:44:21.967 INFO:teuthology.orchestra.run.smithi122.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 303 kB/s | 26 kB 00:00 2024-09-16T16:44:22.001 INFO:teuthology.orchestra.run.smithi122.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 162 kB/s | 19 kB 00:00 2024-09-16T16:44:22.110 INFO:teuthology.orchestra.run.smithi122.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.6 MB/s | 222 kB 00:00 2024-09-16T16:44:22.135 INFO:teuthology.orchestra.run.smithi122.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-09-16T16:44:22.185 INFO:teuthology.orchestra.run.smithi122.stdout:(5/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-09-16T16:44:22.235 INFO:teuthology.orchestra.run.smithi122.stdout:(6/13): python3-cachetools-4.2.4-1.el9.noarch.r 644 kB/s | 32 kB 00:00 2024-09-16T16:44:22.261 INFO:teuthology.orchestra.run.smithi122.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.8 MB/s | 279 kB 00:00 2024-09-16T16:44:22.278 INFO:teuthology.orchestra.run.smithi122.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 336 kB/s | 14 kB 00:00 2024-09-16T16:44:22.336 INFO:teuthology.orchestra.run.smithi122.stdout:(9/13): python3-google-auth-2.34.0-1.el9.noarch 2.9 MB/s | 220 kB 00:00 2024-09-16T16:44:22.370 INFO:teuthology.orchestra.run.smithi122.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 1.7 MB/s | 59 kB 00:00 2024-09-16T16:44:22.404 INFO:teuthology.orchestra.run.smithi122.stdout:(11/13): python3-kubernetes-26.1.0-2.el9.noarch 8.6 MB/s | 1.0 MB 00:00 2024-09-16T16:44:22.429 INFO:teuthology.orchestra.run.smithi122.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.5 MB/s | 90 kB 00:00 2024-09-16T16:44:22.471 INFO:teuthology.orchestra.run.smithi122.stdout:(13/13): ceph-mgr-rook-19.3.0-4879.g81fedcb3.el 84 kB/s | 49 kB 00:00 2024-09-16T16:44:22.473 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:44:22.474 INFO:teuthology.orchestra.run.smithi122.stdout:Total 2.1 MB/s | 2.2 MB 00:01 2024-09-16T16:44:22.540 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-09-16T16:44:22.555 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-09-16T16:44:22.555 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-09-16T16:44:22.643 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-09-16T16:44:22.645 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-09-16T16:44:23.153 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-09-16T16:44:23.316 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-16T16:44:23.380 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-16T16:44:23.435 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-16T16:44:23.473 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-16T16:44:23.514 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-16T16:44:23.624 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-16T16:44:23.726 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-16T16:44:23.783 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-16T16:44:24.491 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-16T16:44:24.547 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-16T16:44:24.580 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-16T16:44:24.629 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-16T16:44:24.650 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 13/13 2024-09-16T16:44:25.476 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 13/13 2024-09-16T16:44:25.476 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 1/13 2024-09-16T16:44:25.476 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-16T16:44:25.476 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-16T16:44:25.477 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-16T16:44:25.477 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-16T16:44:25.477 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-16T16:44:25.477 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-16T16:44:25.477 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-16T16:44:25.477 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-16T16:44:25.477 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-16T16:44:25.477 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-16T16:44:25.477 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-16T16:44:25.814 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-16T16:44:25.814 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:44:25.814 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-09-16T16:44:25.814 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:44:25.814 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-16T16:44:25.815 INFO:teuthology.orchestra.run.smithi122.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-16T16:44:25.815 INFO:teuthology.orchestra.run.smithi122.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-16T16:44:25.815 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-16T16:44:25.815 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-16T16:44:25.815 INFO:teuthology.orchestra.run.smithi122.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-16T16:44:25.815 INFO:teuthology.orchestra.run.smithi122.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-16T16:44:25.815 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-16T16:44:25.815 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-16T16:44:25.815 INFO:teuthology.orchestra.run.smithi122.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-16T16:44:25.815 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-16T16:44:25.815 INFO:teuthology.orchestra.run.smithi122.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-16T16:44:25.815 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:44:25.815 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-16T16:44:26.093 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install ceph-mgr-cephadm 2024-09-16T16:44:26.662 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:04:39 ago on Mon 16 Sep 2024 04:39:47 PM UTC. 2024-09-16T16:44:26.795 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-16T16:44:26.796 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-16T16:44:26.796 INFO:teuthology.orchestra.run.smithi122.stdout: Package Arch Version Repository Size 2024-09-16T16:44:26.796 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-16T16:44:26.796 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-09-16T16:44:26.796 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 154 k 2024-09-16T16:44:26.796 INFO:teuthology.orchestra.run.smithi122.stdout:Installing dependencies: 2024-09-16T16:44:26.796 INFO:teuthology.orchestra.run.smithi122.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-16T16:44:26.797 INFO:teuthology.orchestra.run.smithi122.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-16T16:44:26.797 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-16T16:44:26.797 INFO:teuthology.orchestra.run.smithi122.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-16T16:44:26.797 INFO:teuthology.orchestra.run.smithi122.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-16T16:44:26.797 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:44:26.797 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-09-16T16:44:26.797 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-16T16:44:26.797 INFO:teuthology.orchestra.run.smithi122.stdout:Install 6 Packages 2024-09-16T16:44:26.797 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:44:26.798 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 7.0 M 2024-09-16T16:44:26.798 INFO:teuthology.orchestra.run.smithi122.stdout:Installed size: 33 M 2024-09-16T16:44:26.798 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-09-16T16:44:27.690 INFO:teuthology.orchestra.run.smithi122.stdout:(1/6): ceph-mgr-cephadm-19.3.0-4879.g81fedcb3.e 252 kB/s | 154 kB 00:00 2024-09-16T16:44:27.757 INFO:teuthology.orchestra.run.smithi122.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 8.1 MB/s | 548 kB 00:00 2024-09-16T16:44:27.782 INFO:teuthology.orchestra.run.smithi122.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.3 MB/s | 58 kB 00:00 2024-09-16T16:44:27.807 INFO:teuthology.orchestra.run.smithi122.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.9 MB/s | 74 kB 00:00 2024-09-16T16:44:27.982 INFO:teuthology.orchestra.run.smithi122.stdout:(5/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 274 kB/s | 248 kB 00:00 2024-09-16T16:44:31.877 INFO:teuthology.orchestra.run.smithi122.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 1.2 MB/s | 6.0 MB 00:04 2024-09-16T16:44:31.877 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:44:31.877 INFO:teuthology.orchestra.run.smithi122.stdout:Total 1.4 MB/s | 7.0 MB 00:05 2024-09-16T16:44:31.950 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-09-16T16:44:31.963 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-09-16T16:44:31.963 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-09-16T16:44:32.066 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-09-16T16:44:32.066 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-09-16T16:44:32.383 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-09-16T16:44:32.540 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-16T16:44:32.592 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-16T16:44:33.131 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-16T16:44:33.220 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-16T16:44:33.288 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-16T16:44:33.313 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 6/6 2024-09-16T16:44:34.118 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 6/6 2024-09-16T16:44:34.118 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/6 2024-09-16T16:44:34.119 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-16T16:44:34.119 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-16T16:44:34.119 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-16T16:44:34.119 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-16T16:44:34.397 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-16T16:44:34.397 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:44:34.397 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-09-16T16:44:34.397 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:44:34.397 INFO:teuthology.orchestra.run.smithi122.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-16T16:44:34.397 INFO:teuthology.orchestra.run.smithi122.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-16T16:44:34.397 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-16T16:44:34.397 INFO:teuthology.orchestra.run.smithi122.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-16T16:44:34.398 INFO:teuthology.orchestra.run.smithi122.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-16T16:44:34.398 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:44:34.398 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-16T16:44:34.674 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install ceph-fuse 2024-09-16T16:44:35.252 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:04:48 ago on Mon 16 Sep 2024 04:39:47 PM UTC. 2024-09-16T16:44:35.386 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-16T16:44:35.387 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-16T16:44:35.387 INFO:teuthology.orchestra.run.smithi122.stdout: Package Arch Version Repository Size 2024-09-16T16:44:35.387 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-16T16:44:35.387 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-09-16T16:44:35.387 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-fuse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 884 k 2024-09-16T16:44:35.387 INFO:teuthology.orchestra.run.smithi122.stdout:Installing dependencies: 2024-09-16T16:44:35.387 INFO:teuthology.orchestra.run.smithi122.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-16T16:44:35.387 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:44:35.387 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-09-16T16:44:35.387 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-16T16:44:35.387 INFO:teuthology.orchestra.run.smithi122.stdout:Install 2 Packages 2024-09-16T16:44:35.388 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:44:35.388 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 964 k 2024-09-16T16:44:35.388 INFO:teuthology.orchestra.run.smithi122.stdout:Installed size: 4.1 M 2024-09-16T16:44:35.388 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-09-16T16:44:35.593 INFO:teuthology.orchestra.run.smithi122.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 514 kB/s | 80 kB 00:00 2024-09-16T16:44:36.510 INFO:teuthology.orchestra.run.smithi122.stdout:(2/2): ceph-fuse-19.3.0-4879.g81fedcb3.el9.x86_ 825 kB/s | 884 kB 00:01 2024-09-16T16:44:36.511 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:44:36.511 INFO:teuthology.orchestra.run.smithi122.stdout:Total 858 kB/s | 964 kB 00:01 2024-09-16T16:44:36.523 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-09-16T16:44:36.548 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-09-16T16:44:36.548 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-09-16T16:44:36.630 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-09-16T16:44:36.630 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-09-16T16:44:36.818 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-09-16T16:44:36.962 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-16T16:44:37.034 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/2 2024-09-16T16:44:37.714 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/2 2024-09-16T16:44:37.714 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/2 2024-09-16T16:44:38.003 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-16T16:44:38.003 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:44:38.003 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-09-16T16:44:38.004 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-16T16:44:38.004 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:44:38.004 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-16T16:44:38.262 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install ceph-volume 2024-09-16T16:44:38.840 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:04:51 ago on Mon 16 Sep 2024 04:39:47 PM UTC. 2024-09-16T16:44:38.982 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-16T16:44:38.983 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-16T16:44:38.983 INFO:teuthology.orchestra.run.smithi122.stdout: Package Arch Version Repository Size 2024-09-16T16:44:38.983 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-16T16:44:38.983 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-09-16T16:44:38.983 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-volume noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 285 k 2024-09-16T16:44:38.983 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:44:38.983 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-09-16T16:44:38.983 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-16T16:44:38.983 INFO:teuthology.orchestra.run.smithi122.stdout:Install 1 Package 2024-09-16T16:44:38.983 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:44:38.984 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 285 k 2024-09-16T16:44:38.984 INFO:teuthology.orchestra.run.smithi122.stdout:Installed size: 1.3 M 2024-09-16T16:44:38.984 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-09-16T16:44:39.573 INFO:teuthology.orchestra.run.smithi122.stdout:ceph-volume-19.3.0-4879.g81fedcb3.el9.noarch.rp 484 kB/s | 285 kB 00:00 2024-09-16T16:44:39.573 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:44:39.574 INFO:teuthology.orchestra.run.smithi122.stdout:Total 483 kB/s | 285 kB 00:00 2024-09-16T16:44:39.574 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-09-16T16:44:39.583 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-09-16T16:44:39.584 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-09-16T16:44:39.613 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-09-16T16:44:39.613 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-09-16T16:44:39.838 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-09-16T16:44:39.925 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:44:39.941 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:44:39.941 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:44:39.941 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-16T16:44:39.941 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:44:40.937 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:44:40.937 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:44:40.938 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-09-16T16:44:40.938 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:44:40.938 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:44:40.938 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-16T16:44:41.228 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install librados-devel 2024-09-16T16:44:41.806 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:04:54 ago on Mon 16 Sep 2024 04:39:47 PM UTC. 2024-09-16T16:44:41.944 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-16T16:44:41.945 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-16T16:44:41.945 INFO:teuthology.orchestra.run.smithi122.stdout: Package Arch Version Repo Size 2024-09-16T16:44:41.945 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-16T16:44:41.945 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-09-16T16:44:41.946 INFO:teuthology.orchestra.run.smithi122.stdout: librados-devel x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 125 k 2024-09-16T16:44:41.946 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:44:41.946 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-09-16T16:44:41.946 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-16T16:44:41.946 INFO:teuthology.orchestra.run.smithi122.stdout:Install 1 Package 2024-09-16T16:44:41.946 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:44:41.946 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 125 k 2024-09-16T16:44:41.946 INFO:teuthology.orchestra.run.smithi122.stdout:Installed size: 445 k 2024-09-16T16:44:41.946 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-09-16T16:44:42.412 INFO:teuthology.orchestra.run.smithi122.stdout:librados-devel-19.3.0-4879.g81fedcb3.el9.x86_64 268 kB/s | 125 kB 00:00 2024-09-16T16:44:42.413 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:44:42.413 INFO:teuthology.orchestra.run.smithi122.stdout:Total 267 kB/s | 125 kB 00:00 2024-09-16T16:44:42.413 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-09-16T16:44:42.418 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-09-16T16:44:42.419 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-09-16T16:44:42.482 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-09-16T16:44:42.483 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-09-16T16:44:42.654 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-09-16T16:44:42.767 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:44:43.221 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:44:43.478 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:44:43.478 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:44:43.478 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-09-16T16:44:43.478 INFO:teuthology.orchestra.run.smithi122.stdout: librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:44:43.478 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:44:43.479 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-16T16:44:43.704 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install libcephfs2 2024-09-16T16:44:44.281 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:04:57 ago on Mon 16 Sep 2024 04:39:47 PM UTC. 2024-09-16T16:44:44.377 INFO:teuthology.orchestra.run.smithi122.stdout:Package libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:44:44.423 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-16T16:44:44.424 INFO:teuthology.orchestra.run.smithi122.stdout:Nothing to do. 2024-09-16T16:44:44.424 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-16T16:44:44.501 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install libcephfs-devel 2024-09-16T16:44:45.097 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:04:58 ago on Mon 16 Sep 2024 04:39:47 PM UTC. 2024-09-16T16:44:45.230 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-16T16:44:45.231 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-16T16:44:45.231 INFO:teuthology.orchestra.run.smithi122.stdout: Package Arch Version Repo Size 2024-09-16T16:44:45.231 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-16T16:44:45.231 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-09-16T16:44:45.231 INFO:teuthology.orchestra.run.smithi122.stdout: libcephfs-devel x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 32 k 2024-09-16T16:44:45.231 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:44:45.231 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-09-16T16:44:45.231 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-16T16:44:45.231 INFO:teuthology.orchestra.run.smithi122.stdout:Install 1 Package 2024-09-16T16:44:45.231 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:44:45.232 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 32 k 2024-09-16T16:44:45.232 INFO:teuthology.orchestra.run.smithi122.stdout:Installed size: 142 k 2024-09-16T16:44:45.232 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-09-16T16:44:45.599 INFO:teuthology.orchestra.run.smithi122.stdout:libcephfs-devel-19.3.0-4879.g81fedcb3.el9.x86_6 86 kB/s | 32 kB 00:00 2024-09-16T16:44:45.599 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:44:45.599 INFO:teuthology.orchestra.run.smithi122.stdout:Total 86 kB/s | 32 kB 00:00 2024-09-16T16:44:45.600 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-09-16T16:44:45.603 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-09-16T16:44:45.603 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-09-16T16:44:45.634 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-09-16T16:44:45.634 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-09-16T16:44:45.723 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-09-16T16:44:45.838 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:44:46.241 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:44:46.469 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:44:46.469 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:44:46.470 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-09-16T16:44:46.470 INFO:teuthology.orchestra.run.smithi122.stdout: libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:44:46.470 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:44:46.470 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-16T16:44:46.657 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install librados2 2024-09-16T16:44:47.217 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:05:00 ago on Mon 16 Sep 2024 04:39:47 PM UTC. 2024-09-16T16:44:47.307 INFO:teuthology.orchestra.run.smithi122.stdout:Package librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:44:47.350 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-16T16:44:47.351 INFO:teuthology.orchestra.run.smithi122.stdout:Nothing to do. 2024-09-16T16:44:47.352 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-16T16:44:47.423 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install librbd1 2024-09-16T16:44:47.987 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:05:00 ago on Mon 16 Sep 2024 04:39:47 PM UTC. 2024-09-16T16:44:48.076 INFO:teuthology.orchestra.run.smithi122.stdout:Package librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:44:48.119 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-16T16:44:48.120 INFO:teuthology.orchestra.run.smithi122.stdout:Nothing to do. 2024-09-16T16:44:48.120 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-16T16:44:48.189 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install python3-rados 2024-09-16T16:44:48.757 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:05:01 ago on Mon 16 Sep 2024 04:39:47 PM UTC. 2024-09-16T16:44:48.848 INFO:teuthology.orchestra.run.smithi122.stdout:Package python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:44:48.891 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-16T16:44:48.892 INFO:teuthology.orchestra.run.smithi122.stdout:Nothing to do. 2024-09-16T16:44:48.892 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-16T16:44:48.966 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install python3-rgw 2024-09-16T16:44:49.530 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:05:02 ago on Mon 16 Sep 2024 04:39:47 PM UTC. 2024-09-16T16:44:49.620 INFO:teuthology.orchestra.run.smithi122.stdout:Package python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:44:49.663 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-16T16:44:49.664 INFO:teuthology.orchestra.run.smithi122.stdout:Nothing to do. 2024-09-16T16:44:49.664 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-16T16:44:49.741 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install python3-cephfs 2024-09-16T16:44:50.310 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:05:03 ago on Mon 16 Sep 2024 04:39:47 PM UTC. 2024-09-16T16:44:50.401 INFO:teuthology.orchestra.run.smithi122.stdout:Package python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:44:50.444 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-16T16:44:50.445 INFO:teuthology.orchestra.run.smithi122.stdout:Nothing to do. 2024-09-16T16:44:50.445 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-16T16:44:50.525 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install python3-rbd 2024-09-16T16:44:51.088 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:05:04 ago on Mon 16 Sep 2024 04:39:47 PM UTC. 2024-09-16T16:44:51.178 INFO:teuthology.orchestra.run.smithi122.stdout:Package python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:44:51.221 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-16T16:44:51.222 INFO:teuthology.orchestra.run.smithi122.stdout:Nothing to do. 2024-09-16T16:44:51.222 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-16T16:44:51.309 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install rbd-fuse 2024-09-16T16:44:51.874 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:05:04 ago on Mon 16 Sep 2024 04:39:47 PM UTC. 2024-09-16T16:44:52.007 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-16T16:44:52.008 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-16T16:44:52.008 INFO:teuthology.orchestra.run.smithi122.stdout: Package Architecture Version Repository Size 2024-09-16T16:44:52.008 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-16T16:44:52.008 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-09-16T16:44:52.008 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-fuse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 91 k 2024-09-16T16:44:52.008 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:44:52.008 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-09-16T16:44:52.008 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-16T16:44:52.008 INFO:teuthology.orchestra.run.smithi122.stdout:Install 1 Package 2024-09-16T16:44:52.008 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:44:52.008 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 91 k 2024-09-16T16:44:52.008 INFO:teuthology.orchestra.run.smithi122.stdout:Installed size: 321 k 2024-09-16T16:44:52.009 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-09-16T16:44:52.211 INFO:teuthology.orchestra.run.smithi122.stdout:rbd-fuse-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 450 kB/s | 91 kB 00:00 2024-09-16T16:44:52.212 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:44:52.212 INFO:teuthology.orchestra.run.smithi122.stdout:Total 447 kB/s | 91 kB 00:00 2024-09-16T16:44:52.212 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-09-16T16:44:52.220 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-09-16T16:44:52.220 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-09-16T16:44:52.283 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-09-16T16:44:52.283 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-09-16T16:44:52.428 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-09-16T16:44:52.541 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:44:52.977 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:44:53.261 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:44:53.261 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:44:53.261 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-09-16T16:44:53.262 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:44:53.262 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:44:53.262 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-16T16:44:53.538 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install rbd-mirror 2024-09-16T16:44:54.118 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:05:07 ago on Mon 16 Sep 2024 04:39:47 PM UTC. 2024-09-16T16:44:54.257 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-16T16:44:54.257 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-16T16:44:54.258 INFO:teuthology.orchestra.run.smithi122.stdout: Package Arch Version Repo Size 2024-09-16T16:44:54.258 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-16T16:44:54.258 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-09-16T16:44:54.258 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-mirror x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.5 M 2024-09-16T16:44:54.258 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:44:54.258 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-09-16T16:44:54.258 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-16T16:44:54.258 INFO:teuthology.orchestra.run.smithi122.stdout:Install 1 Package 2024-09-16T16:44:54.258 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:44:54.258 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 3.5 M 2024-09-16T16:44:54.258 INFO:teuthology.orchestra.run.smithi122.stdout:Installed size: 30 M 2024-09-16T16:44:54.259 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-09-16T16:44:55.248 INFO:teuthology.orchestra.run.smithi122.stdout:rbd-mirror-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 3.5 MB/s | 3.5 MB 00:00 2024-09-16T16:44:55.249 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:44:55.249 INFO:teuthology.orchestra.run.smithi122.stdout:Total 3.5 MB/s | 3.5 MB 00:00 2024-09-16T16:44:55.249 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-09-16T16:44:55.261 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-09-16T16:44:55.262 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-09-16T16:44:55.347 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-09-16T16:44:55.347 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-09-16T16:44:55.935 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-09-16T16:44:55.999 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:44:56.024 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:44:56.024 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:44:56.024 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-16T16:44:56.024 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T16:44:56.025 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T16:44:56.025 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:44:57.335 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:44:57.335 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:44:57.335 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-09-16T16:44:57.335 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:44:57.335 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:44:57.335 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-16T16:44:57.628 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install rbd-nbd 2024-09-16T16:44:58.206 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:05:11 ago on Mon 16 Sep 2024 04:39:47 PM UTC. 2024-09-16T16:44:58.341 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-16T16:44:58.341 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-16T16:44:58.341 INFO:teuthology.orchestra.run.smithi122.stdout: Package Architecture Version Repository Size 2024-09-16T16:44:58.341 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-16T16:44:58.342 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-09-16T16:44:58.342 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-nbd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 177 k 2024-09-16T16:44:58.342 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:44:58.342 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-09-16T16:44:58.342 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-16T16:44:58.342 INFO:teuthology.orchestra.run.smithi122.stdout:Install 1 Package 2024-09-16T16:44:58.342 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:44:58.342 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 177 k 2024-09-16T16:44:58.342 INFO:teuthology.orchestra.run.smithi122.stdout:Installed size: 685 k 2024-09-16T16:44:58.342 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-09-16T16:44:58.545 INFO:teuthology.orchestra.run.smithi122.stdout:rbd-nbd-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 874 kB/s | 177 kB 00:00 2024-09-16T16:44:58.545 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:44:58.545 INFO:teuthology.orchestra.run.smithi122.stdout:Total 867 kB/s | 177 kB 00:00 2024-09-16T16:44:58.545 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-09-16T16:44:58.555 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-09-16T16:44:58.555 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-09-16T16:44:58.623 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-09-16T16:44:58.624 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-09-16T16:44:58.787 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-09-16T16:44:58.884 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:44:59.334 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:44:59.577 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:44:59.577 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:44:59.577 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-09-16T16:44:59.578 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:44:59.578 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:44:59.578 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-16T16:44:59.833 DEBUG:teuthology.parallel:result is None 2024-09-16T16:44:59.834 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=81fedcb3b484c843d22ffbc8d179cb567b7083b5 2024-09-16T16:44:59.977 DEBUG:teuthology.orchestra.run.smithi122:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-16T16:45:00.000 INFO:teuthology.orchestra.run.smithi122.stdout:19.3.0-4879.g81fedcb3.el9 2024-09-16T16:45:00.000 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4879.g81fedcb3.el9 2024-09-16T16:45:00.000 INFO:teuthology.task.install:The correct ceph version 19.3.0-4879.g81fedcb3 is installed. 2024-09-16T16:45:00.002 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-16T16:45:00.002 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-16T16:45:00.002 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-16T16:45:00.066 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-16T16:45:00.066 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-16T16:45:00.066 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/usr/bin/daemon-helper 2024-09-16T16:45:00.131 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-16T16:45:00.195 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-16T16:45:00.196 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-16T16:45:00.196 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-16T16:45:00.260 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-16T16:45:00.324 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-16T16:45:00.324 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-16T16:45:00.324 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/usr/bin/stdin-killer 2024-09-16T16:45:00.388 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-16T16:45:00.452 INFO:teuthology.run_tasks:Running task ceph... 2024-09-16T16:45:00.527 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-16T16:45:00.527 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 777 /var/log/ceph 2024-09-16T16:45:00.551 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-16T16:45:00.551 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-16T16:45:00.627 INFO:tasks.ceph:Creating extra log directories... 2024-09-16T16:45:00.628 DEBUG:teuthology.orchestra.run.smithi122:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-16T16:45:00.699 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-16T16:45:00.699 INFO:tasks.ceph:config {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr stats period': 30}, 'osd.0': {'crimson seastar cpu cores': '0-1'}, 'osd.1': {'crimson seastar cpu cores': '2-3'}, 'osd.2': {'crimson seastar cpu cores': '4-5'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'is full \\(reached quota', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(POOL_FULL\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-16T16:45:00.699 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7907362', 'branch': 'wip-matanb-crimson-testing-59543', 'description': 'crimson-rados/rbd/{clusters/fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore tasks/rbd_api_tests}', 'email': None, 'first_in_suite': False, 'job_id': '7907362', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-matanb-crimson-testing-59543'}, 'ceph': {'conf': {'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr stats period': 30}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'osd pool default crimson': True}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'osd.0': {'crimson seastar cpu cores': '0-1'}, 'osd.1': {'crimson seastar cpu cores': '2-3'}, 'osd.2': {'crimson seastar cpu cores': '4-5'}}, 'flavor': 'crimson', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'is full \\(reached quota', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(POOL_FULL\\)'], 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'global': {'osd crush chooseleaf type': 0, 'osd pool default pg num': 128, 'osd pool default pgp num': 128, 'osd pool default size': 2}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'crimson', 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'workunit': {'branch': 'main', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': '0325fd3c11a225c0fd9eb38fab88aad1370ad779'}}, 'owner': 'scheduled_matan@teuthology', 'priority': 60, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0']], 'seed': 6678, 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5', 'sleep_before_teardown': 0, 'suite': 'crimson-rados', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '0325fd3c11a225c0fd9eb38fab88aad1370ad779', 'targets': {'smithi122.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMGjr++wQGbi6yokBTI1FufLLiyxAlfeTkEw9+1Ko8NuZymqLqPnaZS1wHYF7pSTaSQPxxmEfCXACumdUbepXn0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr stats period': 30}, 'osd.0': {'crimson seastar cpu cores': '0-1'}, 'osd.1': {'crimson seastar cpu cores': '2-3'}, 'osd.2': {'crimson seastar cpu cores': '4-5'}}, 'flavor': 'crimson', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'is full \\(reached quota', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(POOL_FULL\\)'], 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5', 'cluster': 'ceph'}}, {'workunit': {'clients': {'client.0': ['rbd/crimson/test_crimson_librbd.sh']}, 'env': {'RBD_FEATURES': '61'}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-16_16:23:48', 'tube': 'smithi', 'user': 'matan', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-16T16:45:00.699 DEBUG:teuthology.orchestra.run.smithi122:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-16T16:45:00.748 DEBUG:teuthology.orchestra.run.smithi122:> sudo install -d -m0777 -- /var/run/ceph 2024-09-16T16:45:00.812 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-16T16:45:00.812 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/scratch_devs of=/dev/stdout 2024-09-16T16:45:00.868 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-16T16:45:00.868 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_1 2024-09-16T16:45:00.923 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-16T16:45:00.923 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T16:45:00.923 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-16T16:45:00.923 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T16:45:00.923 INFO:teuthology.orchestra.run.smithi122.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T16:45:00.923 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2024-09-16 16:44:56.280880862 +0000 2024-09-16T16:45:00.923 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2024-09-16 16:39:02.036677079 +0000 2024-09-16T16:45:00.923 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2024-09-16 16:39:02.036677079 +0000 2024-09-16T16:45:00.924 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: 2024-09-16 16:39:02.036677079 +0000 2024-09-16T16:45:00.924 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-16T16:45:00.986 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2024-09-16T16:45:00.986 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2024-09-16T16:45:00.986 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.000182696 s, 2.8 MB/s 2024-09-16T16:45:00.987 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-16T16:45:01.043 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_2 2024-09-16T16:45:01.098 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-16T16:45:01.098 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T16:45:01.098 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-16T16:45:01.098 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T16:45:01.099 INFO:teuthology.orchestra.run.smithi122.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T16:45:01.099 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2024-09-16 16:44:56.280880862 +0000 2024-09-16T16:45:01.099 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2024-09-16 16:39:02.389668534 +0000 2024-09-16T16:45:01.099 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2024-09-16 16:39:02.389668534 +0000 2024-09-16T16:45:01.099 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: 2024-09-16 16:39:02.389668534 +0000 2024-09-16T16:45:01.099 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-16T16:45:01.161 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2024-09-16T16:45:01.161 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2024-09-16T16:45:01.161 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.000296804 s, 1.7 MB/s 2024-09-16T16:45:01.163 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-16T16:45:01.219 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_3 2024-09-16T16:45:01.274 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-16T16:45:01.274 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T16:45:01.274 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-16T16:45:01.274 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T16:45:01.274 INFO:teuthology.orchestra.run.smithi122.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T16:45:01.274 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2024-09-16 16:44:56.280880862 +0000 2024-09-16T16:45:01.274 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2024-09-16 16:39:02.776659166 +0000 2024-09-16T16:45:01.275 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2024-09-16 16:39:02.776659166 +0000 2024-09-16T16:45:01.275 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: 2024-09-16 16:39:02.776659166 +0000 2024-09-16T16:45:01.275 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-16T16:45:01.337 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2024-09-16T16:45:01.337 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2024-09-16T16:45:01.337 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.000166856 s, 3.1 MB/s 2024-09-16T16:45:01.338 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-16T16:45:01.395 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_4 2024-09-16T16:45:01.450 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-16T16:45:01.450 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T16:45:01.450 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-16T16:45:01.450 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T16:45:01.450 INFO:teuthology.orchestra.run.smithi122.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T16:45:01.450 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2024-09-16 16:44:56.281880838 +0000 2024-09-16T16:45:01.450 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2024-09-16 16:39:03.124650742 +0000 2024-09-16T16:45:01.450 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2024-09-16 16:39:03.124650742 +0000 2024-09-16T16:45:01.450 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: 2024-09-16 16:39:03.124650742 +0000 2024-09-16T16:45:01.451 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-16T16:45:01.513 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2024-09-16T16:45:01.513 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2024-09-16T16:45:01.513 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.000172118 s, 3.0 MB/s 2024-09-16T16:45:01.514 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-16T16:45:01.570 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-16T16:45:01.570 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi122.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2024-09-16T16:45:01.570 INFO:tasks.ceph:Generating config... 2024-09-16T16:45:01.571 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2024-09-16T16:45:01.571 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2024-09-16T16:45:01.571 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2024-09-16T16:45:01.571 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2024-09-16T16:45:01.572 INFO:tasks.ceph:[mon] paxos service trim min = 10 2024-09-16T16:45:01.572 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-16T16:45:01.572 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-16T16:45:01.572 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-16T16:45:01.572 INFO:tasks.ceph:[mon] osd pool default crimson = True 2024-09-16T16:45:01.572 INFO:tasks.ceph:[osd] debug monc = 20 2024-09-16T16:45:01.572 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-16T16:45:01.572 INFO:tasks.ceph:[osd] bluestore compression algorithm = snappy 2024-09-16T16:45:01.572 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-09-16T16:45:01.572 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-16T16:45:01.572 INFO:tasks.ceph:[osd] bluestore rocksdb cf = False 2024-09-16T16:45:01.572 INFO:tasks.ceph:[osd] crimson alien thread cpu cores = 6-7 2024-09-16T16:45:01.572 INFO:tasks.ceph:[osd] crimson osd obc lru size = 10 2024-09-16T16:45:01.572 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-16T16:45:01.572 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-16T16:45:01.573 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-16T16:45:01.573 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-16T16:45:01.573 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-16T16:45:01.573 INFO:tasks.ceph:[osd] err to stderr = True 2024-09-16T16:45:01.573 INFO:tasks.ceph:[osd] log flush on exit = True 2024-09-16T16:45:01.573 INFO:tasks.ceph:[osd] log to file = False 2024-09-16T16:45:01.573 INFO:tasks.ceph:[osd] log to stderr = True 2024-09-16T16:45:01.573 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-16T16:45:01.573 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-16T16:45:01.573 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-16T16:45:01.573 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-16T16:45:01.573 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-16T16:45:01.573 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-16T16:45:01.574 INFO:tasks.ceph:[global] enable experimental unrecoverable data corrupting features = crimson 2024-09-16T16:45:01.574 INFO:tasks.ceph:[global] ms client mode = crc 2024-09-16T16:45:01.574 INFO:tasks.ceph:[global] ms cluster mode = crc 2024-09-16T16:45:01.574 INFO:tasks.ceph:[global] ms mon client mode = crc 2024-09-16T16:45:01.574 INFO:tasks.ceph:[global] ms mon cluster mode = crc 2024-09-16T16:45:01.574 INFO:tasks.ceph:[global] ms mon service mode = crc 2024-09-16T16:45:01.574 INFO:tasks.ceph:[global] ms service mode = crc 2024-09-16T16:45:01.574 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-16T16:45:01.574 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-16T16:45:01.574 INFO:tasks.ceph:[mgr] mgr stats period = 30 2024-09-16T16:45:01.574 INFO:tasks.ceph:[osd.0] crimson seastar cpu cores = 0-1 2024-09-16T16:45:01.574 INFO:tasks.ceph:[osd.1] crimson seastar cpu cores = 2-3 2024-09-16T16:45:01.574 INFO:tasks.ceph:[osd.2] crimson seastar cpu cores = 4-5 2024-09-16T16:45:01.575 INFO:tasks.ceph:Setting up mon.a... 2024-09-16T16:45:01.575 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-16T16:45:01.669 INFO:teuthology.orchestra.run.smithi122.stdout:creating /etc/ceph/ceph.keyring 2024-09-16T16:45:01.672 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-16T16:45:01.723 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-16T16:45:01.747 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.122')] 2024-09-16T16:45:01.748 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.122', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'mgr stats period': 30}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'osd pool default crimson': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'osd.0': {'crimson seastar cpu cores': '0-1'}, 'osd.1': {'crimson seastar cpu cores': '2-3'}, 'osd.2': {'crimson seastar cpu cores': '4-5'}} 2024-09-16T16:45:01.749 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-16T16:45:01.749 DEBUG:teuthology.orchestra.run.smithi122:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-16T16:45:01.804 DEBUG:teuthology.orchestra.run.smithi122:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.122 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-16T16:45:01.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T16:45:01.895+0000 7f3fbe23ef00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:45:01.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T16:45:01.895+0000 7f3fbe23ef00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:45:01.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T16:45:01.895+0000 7f3fbe23ef00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:45:01.896 INFO:teuthology.orchestra.run.smithi122.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-16T16:45:01.897 INFO:teuthology.orchestra.run.smithi122.stdout:monmaptool: generated fsid fd01cf2a-db9f-495a-a112-c9787c9c6bf1 2024-09-16T16:45:01.897 INFO:teuthology.orchestra.run.smithi122.stdout:setting min_mon_release = quincy 2024-09-16T16:45:01.897 INFO:teuthology.orchestra.run.smithi122.stdout:epoch 0 2024-09-16T16:45:01.897 INFO:teuthology.orchestra.run.smithi122.stdout:fsid fd01cf2a-db9f-495a-a112-c9787c9c6bf1 2024-09-16T16:45:01.897 INFO:teuthology.orchestra.run.smithi122.stdout:last_changed 2024-09-16T16:45:01.896848+0000 2024-09-16T16:45:01.897 INFO:teuthology.orchestra.run.smithi122.stdout:created 2024-09-16T16:45:01.896848+0000 2024-09-16T16:45:01.897 INFO:teuthology.orchestra.run.smithi122.stdout:min_mon_release 17 (quincy) 2024-09-16T16:45:01.897 INFO:teuthology.orchestra.run.smithi122.stdout:election_strategy: 1 2024-09-16T16:45:01.897 INFO:teuthology.orchestra.run.smithi122.stdout:0: [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] mon.a 2024-09-16T16:45:01.897 INFO:teuthology.orchestra.run.smithi122.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-09-16T16:45:01.898 DEBUG:teuthology.orchestra.run.smithi122:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-16T16:45:01.913 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID fd01cf2a-db9f-495a-a112-c9787c9c6bf1... 2024-09-16T16:45:01.914 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-16T16:45:01.995 INFO:teuthology.orchestra.run.smithi122.stdout:[global] 2024-09-16T16:45:01.996 INFO:teuthology.orchestra.run.smithi122.stdout: chdir = "" 2024-09-16T16:45:01.996 INFO:teuthology.orchestra.run.smithi122.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-16T16:45:01.996 INFO:teuthology.orchestra.run.smithi122.stdout: auth supported = cephx 2024-09-16T16:45:01.996 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:45:01.996 INFO:teuthology.orchestra.run.smithi122.stdout: filestore xattr use omap = true 2024-09-16T16:45:01.996 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:45:01.996 INFO:teuthology.orchestra.run.smithi122.stdout: mon clock drift allowed = 1.000 2024-09-16T16:45:01.996 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:45:01.996 INFO:teuthology.orchestra.run.smithi122.stdout: osd crush chooseleaf type = 0 2024-09-16T16:45:01.996 INFO:teuthology.orchestra.run.smithi122.stdout: auth debug = true 2024-09-16T16:45:01.996 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:45:01.996 INFO:teuthology.orchestra.run.smithi122.stdout: ms die on old message = true 2024-09-16T16:45:01.996 INFO:teuthology.orchestra.run.smithi122.stdout: ms die on bug = true 2024-09-16T16:45:01.996 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:45:01.996 INFO:teuthology.orchestra.run.smithi122.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-16T16:45:01.997 INFO:teuthology.orchestra.run.smithi122.stdout: mon pg warn max object skew = 0 2024-09-16T16:45:01.997 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:45:01.997 INFO:teuthology.orchestra.run.smithi122.stdout: # disable pg_autoscaler by default for new pools 2024-09-16T16:45:01.997 INFO:teuthology.orchestra.run.smithi122.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-16T16:45:01.997 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:45:01.997 INFO:teuthology.orchestra.run.smithi122.stdout: osd pool default size = 2 2024-09-16T16:45:01.997 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:45:01.997 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd allow primary affinity = true 2024-09-16T16:45:01.997 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd allow pg remap = true 2024-09-16T16:45:01.997 INFO:teuthology.orchestra.run.smithi122.stdout: mon warn on legacy crush tunables = false 2024-09-16T16:45:01.997 INFO:teuthology.orchestra.run.smithi122.stdout: mon warn on crush straw calc version zero = false 2024-09-16T16:45:01.997 INFO:teuthology.orchestra.run.smithi122.stdout: mon warn on no sortbitwise = false 2024-09-16T16:45:01.997 INFO:teuthology.orchestra.run.smithi122.stdout: mon warn on osd down out interval zero = false 2024-09-16T16:45:01.998 INFO:teuthology.orchestra.run.smithi122.stdout: mon warn on too few osds = false 2024-09-16T16:45:01.998 INFO:teuthology.orchestra.run.smithi122.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-16T16:45:01.998 INFO:teuthology.orchestra.run.smithi122.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-16T16:45:01.998 INFO:teuthology.orchestra.run.smithi122.stdout: mon_allow_pool_size_one = true 2024-09-16T16:45:01.998 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:45:01.998 INFO:teuthology.orchestra.run.smithi122.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-16T16:45:01.998 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:45:01.998 INFO:teuthology.orchestra.run.smithi122.stdout: osd default data pool replay window = 5 2024-09-16T16:45:01.998 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:45:01.998 INFO:teuthology.orchestra.run.smithi122.stdout: mon allow pool delete = true 2024-09-16T16:45:01.998 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:45:01.998 INFO:teuthology.orchestra.run.smithi122.stdout: mon cluster log file level = debug 2024-09-16T16:45:01.998 INFO:teuthology.orchestra.run.smithi122.stdout: debug asserts on shutdown = true 2024-09-16T16:45:01.999 INFO:teuthology.orchestra.run.smithi122.stdout: mon health detail to clog = false 2024-09-16T16:45:01.999 INFO:teuthology.orchestra.run.smithi122.stdout: mon host = 172.21.15.122 2024-09-16T16:45:01.999 INFO:teuthology.orchestra.run.smithi122.stdout: enable experimental unrecoverable data corrupting features = crimson 2024-09-16T16:45:01.999 INFO:teuthology.orchestra.run.smithi122.stdout: ms client mode = crc 2024-09-16T16:45:01.999 INFO:teuthology.orchestra.run.smithi122.stdout: ms cluster mode = crc 2024-09-16T16:45:01.999 INFO:teuthology.orchestra.run.smithi122.stdout: ms mon client mode = crc 2024-09-16T16:45:01.999 INFO:teuthology.orchestra.run.smithi122.stdout: ms mon cluster mode = crc 2024-09-16T16:45:01.999 INFO:teuthology.orchestra.run.smithi122.stdout: ms mon service mode = crc 2024-09-16T16:45:01.999 INFO:teuthology.orchestra.run.smithi122.stdout: ms service mode = crc 2024-09-16T16:45:01.999 INFO:teuthology.orchestra.run.smithi122.stdout: fsid = fd01cf2a-db9f-495a-a112-c9787c9c6bf1 2024-09-16T16:45:01.999 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:45:01.999 INFO:teuthology.orchestra.run.smithi122.stdout:[osd] 2024-09-16T16:45:01.999 INFO:teuthology.orchestra.run.smithi122.stdout: osd journal size = 100 2024-09-16T16:45:01.999 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:45:02.000 INFO:teuthology.orchestra.run.smithi122.stdout: osd scrub load threshold = 5.0 2024-09-16T16:45:02.000 INFO:teuthology.orchestra.run.smithi122.stdout: osd scrub max interval = 600 2024-09-16T16:45:02.000 INFO:teuthology.orchestra.run.smithi122.stdout: osd mclock profile = high_recovery_ops 2024-09-16T16:45:02.000 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:45:02.000 INFO:teuthology.orchestra.run.smithi122.stdout: osd recover clone overlap = true 2024-09-16T16:45:02.000 INFO:teuthology.orchestra.run.smithi122.stdout: osd recovery max chunk = 1048576 2024-09-16T16:45:02.000 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:45:02.000 INFO:teuthology.orchestra.run.smithi122.stdout: osd debug shutdown = true 2024-09-16T16:45:02.000 INFO:teuthology.orchestra.run.smithi122.stdout: osd debug op order = true 2024-09-16T16:45:02.000 INFO:teuthology.orchestra.run.smithi122.stdout: osd debug verify stray on activate = true 2024-09-16T16:45:02.000 INFO:teuthology.orchestra.run.smithi122.stdout: osd debug trim objects = true 2024-09-16T16:45:02.000 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:45:02.000 INFO:teuthology.orchestra.run.smithi122.stdout: osd open classes on start = true 2024-09-16T16:45:02.000 INFO:teuthology.orchestra.run.smithi122.stdout: osd debug pg log writeout = true 2024-09-16T16:45:02.000 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:45:02.001 INFO:teuthology.orchestra.run.smithi122.stdout: osd deep scrub update digest min age = 30 2024-09-16T16:45:02.001 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:45:02.001 INFO:teuthology.orchestra.run.smithi122.stdout: osd map max advance = 10 2024-09-16T16:45:02.001 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:45:02.001 INFO:teuthology.orchestra.run.smithi122.stdout: journal zero on create = true 2024-09-16T16:45:02.001 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:45:02.001 INFO:teuthology.orchestra.run.smithi122.stdout: filestore ondisk finisher threads = 3 2024-09-16T16:45:02.001 INFO:teuthology.orchestra.run.smithi122.stdout: filestore apply finisher threads = 3 2024-09-16T16:45:02.001 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:45:02.001 INFO:teuthology.orchestra.run.smithi122.stdout: bdev debug aio = true 2024-09-16T16:45:02.001 INFO:teuthology.orchestra.run.smithi122.stdout: osd debug misdirected ops = true 2024-09-16T16:45:02.001 INFO:teuthology.orchestra.run.smithi122.stdout: debug monc = 20 2024-09-16T16:45:02.001 INFO:teuthology.orchestra.run.smithi122.stdout: bluestore block size = 96636764160 2024-09-16T16:45:02.001 INFO:teuthology.orchestra.run.smithi122.stdout: bluestore compression algorithm = snappy 2024-09-16T16:45:02.002 INFO:teuthology.orchestra.run.smithi122.stdout: bluestore compression mode = aggressive 2024-09-16T16:45:02.002 INFO:teuthology.orchestra.run.smithi122.stdout: bluestore fsck on mount = True 2024-09-16T16:45:02.002 INFO:teuthology.orchestra.run.smithi122.stdout: bluestore rocksdb cf = False 2024-09-16T16:45:02.002 INFO:teuthology.orchestra.run.smithi122.stdout: crimson alien thread cpu cores = 6-7 2024-09-16T16:45:02.002 INFO:teuthology.orchestra.run.smithi122.stdout: crimson osd obc lru size = 10 2024-09-16T16:45:02.002 INFO:teuthology.orchestra.run.smithi122.stdout: debug bluefs = 20 2024-09-16T16:45:02.002 INFO:teuthology.orchestra.run.smithi122.stdout: debug bluestore = 20 2024-09-16T16:45:02.002 INFO:teuthology.orchestra.run.smithi122.stdout: debug ms = 1 2024-09-16T16:45:02.002 INFO:teuthology.orchestra.run.smithi122.stdout: debug osd = 20 2024-09-16T16:45:02.002 INFO:teuthology.orchestra.run.smithi122.stdout: debug rocksdb = 10 2024-09-16T16:45:02.002 INFO:teuthology.orchestra.run.smithi122.stdout: err to stderr = True 2024-09-16T16:45:02.002 INFO:teuthology.orchestra.run.smithi122.stdout: log flush on exit = True 2024-09-16T16:45:02.002 INFO:teuthology.orchestra.run.smithi122.stdout: log to file = False 2024-09-16T16:45:02.002 INFO:teuthology.orchestra.run.smithi122.stdout: log to stderr = True 2024-09-16T16:45:02.002 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd backfillfull_ratio = 0.85 2024-09-16T16:45:02.003 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd full ratio = 0.9 2024-09-16T16:45:02.003 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd nearfull ratio = 0.8 2024-09-16T16:45:02.003 INFO:teuthology.orchestra.run.smithi122.stdout: osd failsafe full ratio = 0.95 2024-09-16T16:45:02.003 INFO:teuthology.orchestra.run.smithi122.stdout: osd objectstore = bluestore 2024-09-16T16:45:02.003 INFO:teuthology.orchestra.run.smithi122.stdout: osd shutdown pgref assert = True 2024-09-16T16:45:02.003 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:45:02.003 INFO:teuthology.orchestra.run.smithi122.stdout:[mgr] 2024-09-16T16:45:02.003 INFO:teuthology.orchestra.run.smithi122.stdout: debug ms = 1 2024-09-16T16:45:02.003 INFO:teuthology.orchestra.run.smithi122.stdout: debug mgr = 20 2024-09-16T16:45:02.003 INFO:teuthology.orchestra.run.smithi122.stdout: debug mon = 20 2024-09-16T16:45:02.003 INFO:teuthology.orchestra.run.smithi122.stdout: debug auth = 20 2024-09-16T16:45:02.003 INFO:teuthology.orchestra.run.smithi122.stdout: mon reweight min pgs per osd = 4 2024-09-16T16:45:02.003 INFO:teuthology.orchestra.run.smithi122.stdout: mon reweight min bytes per osd = 10 2024-09-16T16:45:02.003 INFO:teuthology.orchestra.run.smithi122.stdout: mgr/telemetry/nag = false 2024-09-16T16:45:02.003 INFO:teuthology.orchestra.run.smithi122.stdout: mgr stats period = 30 2024-09-16T16:45:02.003 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:45:02.003 INFO:teuthology.orchestra.run.smithi122.stdout:[mon] 2024-09-16T16:45:02.004 INFO:teuthology.orchestra.run.smithi122.stdout: debug ms = 1 2024-09-16T16:45:02.004 INFO:teuthology.orchestra.run.smithi122.stdout: debug mon = 20 2024-09-16T16:45:02.004 INFO:teuthology.orchestra.run.smithi122.stdout: debug paxos = 20 2024-09-16T16:45:02.004 INFO:teuthology.orchestra.run.smithi122.stdout: debug auth = 20 2024-09-16T16:45:02.004 INFO:teuthology.orchestra.run.smithi122.stdout: mon data avail warn = 5 2024-09-16T16:45:02.004 INFO:teuthology.orchestra.run.smithi122.stdout: mon mgr mkfs grace = 240 2024-09-16T16:45:02.004 INFO:teuthology.orchestra.run.smithi122.stdout: mon reweight min pgs per osd = 4 2024-09-16T16:45:02.004 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd reporter subtree level = osd 2024-09-16T16:45:02.004 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd prime pg temp = true 2024-09-16T16:45:02.004 INFO:teuthology.orchestra.run.smithi122.stdout: mon reweight min bytes per osd = 10 2024-09-16T16:45:02.004 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:45:02.004 INFO:teuthology.orchestra.run.smithi122.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-16T16:45:02.004 INFO:teuthology.orchestra.run.smithi122.stdout: auth mon ticket ttl = 660 # 11m 2024-09-16T16:45:02.004 INFO:teuthology.orchestra.run.smithi122.stdout: auth service ticket ttl = 240 # 4m 2024-09-16T16:45:02.004 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:45:02.005 INFO:teuthology.orchestra.run.smithi122.stdout: # don't complain about insecure global_id in the test suite 2024-09-16T16:45:02.005 INFO:teuthology.orchestra.run.smithi122.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-16T16:45:02.005 INFO:teuthology.orchestra.run.smithi122.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-16T16:45:02.005 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:45:02.005 INFO:teuthology.orchestra.run.smithi122.stdout: # 1m isn't quite enough 2024-09-16T16:45:02.005 INFO:teuthology.orchestra.run.smithi122.stdout: mon_down_mkfs_grace = 2m 2024-09-16T16:45:02.005 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:45:02.005 INFO:teuthology.orchestra.run.smithi122.stdout: mon_warn_on_filestore_osds = false 2024-09-16T16:45:02.005 INFO:teuthology.orchestra.run.smithi122.stdout: mon min osdmap epochs = 50 2024-09-16T16:45:02.005 INFO:teuthology.orchestra.run.smithi122.stdout: mon osdmap full prune interval = 2 2024-09-16T16:45:02.005 INFO:teuthology.orchestra.run.smithi122.stdout: mon osdmap full prune min = 15 2024-09-16T16:45:02.005 INFO:teuthology.orchestra.run.smithi122.stdout: mon osdmap full prune txsize = 2 2024-09-16T16:45:02.005 INFO:teuthology.orchestra.run.smithi122.stdout: paxos service trim min = 10 2024-09-16T16:45:02.005 INFO:teuthology.orchestra.run.smithi122.stdout: osd pool default crimson = True 2024-09-16T16:45:02.005 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:45:02.005 INFO:teuthology.orchestra.run.smithi122.stdout:[client] 2024-09-16T16:45:02.006 INFO:teuthology.orchestra.run.smithi122.stdout: rgw cache enabled = true 2024-09-16T16:45:02.006 INFO:teuthology.orchestra.run.smithi122.stdout: rgw enable ops log = true 2024-09-16T16:45:02.006 INFO:teuthology.orchestra.run.smithi122.stdout: rgw enable usage log = true 2024-09-16T16:45:02.006 INFO:teuthology.orchestra.run.smithi122.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-16T16:45:02.006 INFO:teuthology.orchestra.run.smithi122.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-16T16:45:02.006 INFO:teuthology.orchestra.run.smithi122.stdout:[mon.a] 2024-09-16T16:45:02.006 INFO:teuthology.orchestra.run.smithi122.stdout:[osd.0] 2024-09-16T16:45:02.006 INFO:teuthology.orchestra.run.smithi122.stdout: crimson seastar cpu cores = 0-1 2024-09-16T16:45:02.006 INFO:teuthology.orchestra.run.smithi122.stdout:[osd.1] 2024-09-16T16:45:02.006 INFO:teuthology.orchestra.run.smithi122.stdout: crimson seastar cpu cores = 2-3 2024-09-16T16:45:02.006 INFO:teuthology.orchestra.run.smithi122.stdout:[osd.2] 2024-09-16T16:45:02.006 INFO:teuthology.orchestra.run.smithi122.stdout: crimson seastar cpu cores = 4-5 2024-09-16T16:45:02.007 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-16T16:45:02.007 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-16T16:45:02.112 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-16T16:45:02.112 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-16T16:45:02.112 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-16T16:45:02.127 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-16T16:45:02.127 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-16T16:45:02.182 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi122.front.sepia.ceph.com 2024-09-16T16:45:02.182 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-16T16:45:02.182 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-16T16:45:02.182 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-16T16:45:02.256 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-16T16:45:02.256 DEBUG:teuthology.orchestra.run.smithi122:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-16T16:45:02.311 INFO:tasks.ceph:Setting up mon nodes... 2024-09-16T16:45:02.312 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-16T16:45:02.312 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-16T16:45:02.411 INFO:teuthology.orchestra.run.smithi122.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-16T16:45:02.414 INFO:tasks.ceph:Setting up mds nodes... 2024-09-16T16:45:02.415 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-16T16:45:02.415 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-16T16:45:02.464 INFO:teuthology.orchestra.run.smithi122.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-16T16:45:02.477 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-16T16:45:02.477 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi122.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2024-09-16T16:45:02.477 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-16T16:45:02.501 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-16T16:45:02.501 INFO:tasks.ceph:role: osd.0 2024-09-16T16:45:02.501 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi122.front.sepia.ceph.com 2024-09-16T16:45:02.501 DEBUG:teuthology.orchestra.run.smithi122:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-16T16:45:02.573 INFO:teuthology.orchestra.run.smithi122.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T16:45:02.573 INFO:teuthology.orchestra.run.smithi122.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T16:45:02.573 INFO:teuthology.orchestra.run.smithi122.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T16:45:02.573 INFO:teuthology.orchestra.run.smithi122.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-16T16:45:02.574 INFO:teuthology.orchestra.run.smithi122.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T16:45:02.574 INFO:teuthology.orchestra.run.smithi122.stdout: = sunit=0 swidth=0 blks 2024-09-16T16:45:02.574 INFO:teuthology.orchestra.run.smithi122.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T16:45:02.574 INFO:teuthology.orchestra.run.smithi122.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-16T16:45:02.574 INFO:teuthology.orchestra.run.smithi122.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T16:45:02.574 INFO:teuthology.orchestra.run.smithi122.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T16:45:03.083 INFO:teuthology.orchestra.run.smithi122.stdout:Discarding blocks...Done. 2024-09-16T16:45:03.085 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi122.front.sepia.ceph.com -o noatime 2024-09-16T16:45:03.085 DEBUG:teuthology.orchestra.run.smithi122:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-16T16:45:03.200 DEBUG:teuthology.orchestra.run.smithi122:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-16T16:45:03.232 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-16T16:45:03.297 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-16T16:45:03.297 INFO:tasks.ceph:role: osd.1 2024-09-16T16:45:03.297 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi122.front.sepia.ceph.com 2024-09-16T16:45:03.297 DEBUG:teuthology.orchestra.run.smithi122:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-16T16:45:03.370 INFO:teuthology.orchestra.run.smithi122.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T16:45:03.370 INFO:teuthology.orchestra.run.smithi122.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T16:45:03.370 INFO:teuthology.orchestra.run.smithi122.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T16:45:03.370 INFO:teuthology.orchestra.run.smithi122.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-16T16:45:03.370 INFO:teuthology.orchestra.run.smithi122.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T16:45:03.370 INFO:teuthology.orchestra.run.smithi122.stdout: = sunit=0 swidth=0 blks 2024-09-16T16:45:03.371 INFO:teuthology.orchestra.run.smithi122.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T16:45:03.371 INFO:teuthology.orchestra.run.smithi122.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-16T16:45:03.371 INFO:teuthology.orchestra.run.smithi122.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T16:45:03.371 INFO:teuthology.orchestra.run.smithi122.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T16:45:03.828 INFO:teuthology.orchestra.run.smithi122.stdout:Discarding blocks...Done. 2024-09-16T16:45:03.830 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi122.front.sepia.ceph.com -o noatime 2024-09-16T16:45:03.830 DEBUG:teuthology.orchestra.run.smithi122:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-16T16:45:03.914 DEBUG:teuthology.orchestra.run.smithi122:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-16T16:45:03.983 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-16T16:45:04.048 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-16T16:45:04.048 INFO:tasks.ceph:role: osd.2 2024-09-16T16:45:04.048 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi122.front.sepia.ceph.com 2024-09-16T16:45:04.048 DEBUG:teuthology.orchestra.run.smithi122:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-16T16:45:04.120 INFO:teuthology.orchestra.run.smithi122.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T16:45:04.120 INFO:teuthology.orchestra.run.smithi122.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T16:45:04.120 INFO:teuthology.orchestra.run.smithi122.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T16:45:04.120 INFO:teuthology.orchestra.run.smithi122.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-16T16:45:04.120 INFO:teuthology.orchestra.run.smithi122.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T16:45:04.121 INFO:teuthology.orchestra.run.smithi122.stdout: = sunit=0 swidth=0 blks 2024-09-16T16:45:04.121 INFO:teuthology.orchestra.run.smithi122.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T16:45:04.121 INFO:teuthology.orchestra.run.smithi122.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-16T16:45:04.121 INFO:teuthology.orchestra.run.smithi122.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T16:45:04.121 INFO:teuthology.orchestra.run.smithi122.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T16:45:04.621 INFO:teuthology.orchestra.run.smithi122.stdout:Discarding blocks...Done. 2024-09-16T16:45:04.623 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi122.front.sepia.ceph.com -o noatime 2024-09-16T16:45:04.623 DEBUG:teuthology.orchestra.run.smithi122:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-16T16:45:04.748 DEBUG:teuthology.orchestra.run.smithi122:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-16T16:45:04.780 DEBUG:teuthology.orchestra.run.smithi122:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T16:45:05.081 INFO:teuthology.orchestra.run.smithi122.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T16:45:05.082 INFO:teuthology.orchestra.run.smithi122.stderr:INFO 2024-09-16 16:45:05,083 seastar - Reactor backend: linux-aio 2024-09-16T16:45:05.098 INFO:teuthology.orchestra.run.smithi122.stderr:==27880==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T16:45:05.218 INFO:teuthology.orchestra.run.smithi122.stderr:INFO 2024-09-16 16:45:05,218 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-16T16:45:05.218 INFO:teuthology.orchestra.run.smithi122.stderr:INFO 2024-09-16 16:45:05,218 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 0-1 2024-09-16T16:45:05.218 INFO:teuthology.orchestra.run.smithi122.stderr:DEBUG 2024-09-16 16:45:05,219 [shard 0:main] seastar - reactor::drain 2024-09-16T16:45:05.736 INFO:teuthology.orchestra.run.smithi122.stderr:----------------------------------------------------- 2024-09-16T16:45:05.737 INFO:teuthology.orchestra.run.smithi122.stderr:Suppressions used: 2024-09-16T16:45:05.737 INFO:teuthology.orchestra.run.smithi122.stderr: count bytes template 2024-09-16T16:45:05.737 INFO:teuthology.orchestra.run.smithi122.stderr: 1 8 MallocExtension::Register 2024-09-16T16:45:05.737 INFO:teuthology.orchestra.run.smithi122.stderr:----------------------------------------------------- 2024-09-16T16:45:05.737 INFO:teuthology.orchestra.run.smithi122.stderr: 2024-09-16T16:45:05.788 INFO:teuthology.orchestra.run.smithi122.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T16:45:05.792 INFO:teuthology.orchestra.run.smithi122.stderr:INFO 2024-09-16 16:45:05,792 seastar - Reactor backend: linux-aio 2024-09-16T16:45:05.800 INFO:teuthology.orchestra.run.smithi122.stderr:==27878==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T16:45:10.471 INFO:teuthology.orchestra.run.smithi122.stderr:----------------------------------------------------- 2024-09-16T16:45:10.471 INFO:teuthology.orchestra.run.smithi122.stderr:Suppressions used: 2024-09-16T16:45:10.471 INFO:teuthology.orchestra.run.smithi122.stderr: count bytes template 2024-09-16T16:45:10.471 INFO:teuthology.orchestra.run.smithi122.stderr: 1 8 MallocExtension::Register 2024-09-16T16:45:10.471 INFO:teuthology.orchestra.run.smithi122.stderr:----------------------------------------------------- 2024-09-16T16:45:10.471 INFO:teuthology.orchestra.run.smithi122.stderr: 2024-09-16T16:45:10.493 DEBUG:teuthology.orchestra.run.smithi122:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-16T16:45:10.518 DEBUG:teuthology.orchestra.run.smithi122:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T16:45:10.795 INFO:teuthology.orchestra.run.smithi122.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T16:45:10.796 INFO:teuthology.orchestra.run.smithi122.stderr:INFO 2024-09-16 16:45:10,797 seastar - Reactor backend: linux-aio 2024-09-16T16:45:10.801 INFO:teuthology.orchestra.run.smithi122.stderr:==28064==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T16:45:10.909 INFO:teuthology.orchestra.run.smithi122.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x4b140 0x362a270 0x382b1d8 0x416dc9b 0x5fb8ce4 0x5fb8ee0 0x5fb946c 0x5e00fef 0x5e19231 0x71579d2 0x71691a5 0x716a642 0x716a6c7 0x716a7c9 0x716a8c1 0x716aace 0x716acb4 0x716b003 0x716b3a7 0x716b5d7 0x716b841 0x716bb0e 0x716bd2c 0x716bde4 0x716beaa 0x716bf8b 0x5c63e30 0x5c63f3a 0x5c63ff6 0x5c640b2 0x5c6416e 0x5c642bb 0x5c64446 0x5c64807 0x5c7e60a 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3962bc0 0x396439a 0x3804c28 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:45:10.909 INFO:teuthology.orchestra.run.smithi122.stderr:kernel callstack: 2024-09-16T16:45:10.924 INFO:teuthology.orchestra.run.smithi122.stderr:INFO 2024-09-16 16:45:10,924 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-16T16:45:10.924 INFO:teuthology.orchestra.run.smithi122.stderr:INFO 2024-09-16 16:45:10,924 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 2-3 2024-09-16T16:45:10.924 INFO:teuthology.orchestra.run.smithi122.stderr:DEBUG 2024-09-16 16:45:10,925 [shard 0:main] seastar - reactor::drain 2024-09-16T16:45:11.425 INFO:teuthology.orchestra.run.smithi122.stderr:----------------------------------------------------- 2024-09-16T16:45:11.425 INFO:teuthology.orchestra.run.smithi122.stderr:Suppressions used: 2024-09-16T16:45:11.425 INFO:teuthology.orchestra.run.smithi122.stderr: count bytes template 2024-09-16T16:45:11.425 INFO:teuthology.orchestra.run.smithi122.stderr: 1 8 MallocExtension::Register 2024-09-16T16:45:11.425 INFO:teuthology.orchestra.run.smithi122.stderr:----------------------------------------------------- 2024-09-16T16:45:11.425 INFO:teuthology.orchestra.run.smithi122.stderr: 2024-09-16T16:45:11.483 INFO:teuthology.orchestra.run.smithi122.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T16:45:11.487 INFO:teuthology.orchestra.run.smithi122.stderr:INFO 2024-09-16 16:45:11,488 seastar - Reactor backend: linux-aio 2024-09-16T16:45:11.502 INFO:teuthology.orchestra.run.smithi122.stderr:==28062==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T16:45:16.184 INFO:teuthology.orchestra.run.smithi122.stderr:----------------------------------------------------- 2024-09-16T16:45:16.184 INFO:teuthology.orchestra.run.smithi122.stderr:Suppressions used: 2024-09-16T16:45:16.184 INFO:teuthology.orchestra.run.smithi122.stderr: count bytes template 2024-09-16T16:45:16.184 INFO:teuthology.orchestra.run.smithi122.stderr: 1 8 MallocExtension::Register 2024-09-16T16:45:16.184 INFO:teuthology.orchestra.run.smithi122.stderr:----------------------------------------------------- 2024-09-16T16:45:16.184 INFO:teuthology.orchestra.run.smithi122.stderr: 2024-09-16T16:45:16.205 DEBUG:teuthology.orchestra.run.smithi122:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-16T16:45:16.230 DEBUG:teuthology.orchestra.run.smithi122:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T16:45:16.509 INFO:teuthology.orchestra.run.smithi122.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T16:45:16.510 INFO:teuthology.orchestra.run.smithi122.stderr:INFO 2024-09-16 16:45:16,511 seastar - Reactor backend: linux-aio 2024-09-16T16:45:16.516 INFO:teuthology.orchestra.run.smithi122.stderr:==28248==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T16:45:16.635 INFO:teuthology.orchestra.run.smithi122.stderr:INFO 2024-09-16 16:45:16,636 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-16T16:45:16.636 INFO:teuthology.orchestra.run.smithi122.stderr:INFO 2024-09-16 16:45:16,636 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 4-5 2024-09-16T16:45:16.636 INFO:teuthology.orchestra.run.smithi122.stderr:DEBUG 2024-09-16 16:45:16,637 [shard 0:main] seastar - reactor::drain 2024-09-16T16:45:17.142 INFO:teuthology.orchestra.run.smithi122.stderr:----------------------------------------------------- 2024-09-16T16:45:17.142 INFO:teuthology.orchestra.run.smithi122.stderr:Suppressions used: 2024-09-16T16:45:17.142 INFO:teuthology.orchestra.run.smithi122.stderr: count bytes template 2024-09-16T16:45:17.142 INFO:teuthology.orchestra.run.smithi122.stderr: 1 8 MallocExtension::Register 2024-09-16T16:45:17.142 INFO:teuthology.orchestra.run.smithi122.stderr:----------------------------------------------------- 2024-09-16T16:45:17.142 INFO:teuthology.orchestra.run.smithi122.stderr: 2024-09-16T16:45:17.199 INFO:teuthology.orchestra.run.smithi122.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T16:45:17.203 INFO:teuthology.orchestra.run.smithi122.stderr:INFO 2024-09-16 16:45:17,203 seastar - Reactor backend: linux-aio 2024-09-16T16:45:17.217 INFO:teuthology.orchestra.run.smithi122.stderr:==28246==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T16:45:21.876 INFO:teuthology.orchestra.run.smithi122.stderr:----------------------------------------------------- 2024-09-16T16:45:21.876 INFO:teuthology.orchestra.run.smithi122.stderr:Suppressions used: 2024-09-16T16:45:21.877 INFO:teuthology.orchestra.run.smithi122.stderr: count bytes template 2024-09-16T16:45:21.877 INFO:teuthology.orchestra.run.smithi122.stderr: 1 8 MallocExtension::Register 2024-09-16T16:45:21.877 INFO:teuthology.orchestra.run.smithi122.stderr:----------------------------------------------------- 2024-09-16T16:45:21.877 INFO:teuthology.orchestra.run.smithi122.stderr: 2024-09-16T16:45:21.899 DEBUG:teuthology.orchestra.run.smithi122:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-16T16:45:21.923 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-16T16:45:21.924 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-16T16:45:21.924 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-16T16:45:21.987 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-16T16:45:21.987 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-16T16:45:22.051 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-16T16:45:22.051 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-16T16:45:22.116 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-16T16:45:22.116 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-16T16:45:22.180 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-16T16:45:22.181 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-16T16:45:22.236 INFO:tasks.ceph:Adding keys to all mons... 2024-09-16T16:45:22.236 DEBUG:teuthology.orchestra.run.smithi122:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-16T16:45:22.299 INFO:teuthology.orchestra.run.smithi122.stdout:[mgr.x] 2024-09-16T16:45:22.299 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQCOYOhmKdmWGBAABOPrcF3IMv+YVIf0NQXmxA== 2024-09-16T16:45:22.299 INFO:teuthology.orchestra.run.smithi122.stdout:[osd.0] 2024-09-16T16:45:22.299 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQCRYOhmRKNqOBAA1yb8+wNaUFe5fjVe4ZtYNQ== 2024-09-16T16:45:22.299 INFO:teuthology.orchestra.run.smithi122.stdout:[osd.1] 2024-09-16T16:45:22.299 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQCXYOhmLQ2pJhAA9amk3FiyfI8UpuDbSAXQSw== 2024-09-16T16:45:22.299 INFO:teuthology.orchestra.run.smithi122.stdout:[osd.2] 2024-09-16T16:45:22.299 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQCdYOhmSFVKFRAASBhEQX3BmMoxZTABPkuxMQ== 2024-09-16T16:45:22.300 INFO:teuthology.orchestra.run.smithi122.stdout:[client.0] 2024-09-16T16:45:22.300 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQCOYOhmyBW4GxAA6rxIf3o37AsAIcmcNLNthw== 2024-09-16T16:45:22.301 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-16T16:45:22.402 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T16:45:22.462 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T16:45:22.523 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T16:45:22.584 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-16T16:45:22.648 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-16T16:45:22.648 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-16T16:45:22.673 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-16T16:45:22.791 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T16:45:22.791+0000 7fc1b364ac00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:45:22.792 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T16:45:22.791+0000 7fc1b364ac00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:45:22.805 DEBUG:teuthology.orchestra.run.smithi122:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-16T16:45:22.829 DEBUG:teuthology.orchestra.run.smithi122:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-16T16:45:22.884 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-16T16:45:22.884 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-16T16:45:22.885 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-16T16:45:22.926 INFO:tasks.ceph.mon.a:Started 2024-09-16T16:45:22.926 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-16T16:45:22.927 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-16T16:45:22.927 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-16T16:45:22.929 INFO:tasks.ceph.mgr.x:Started 2024-09-16T16:45:22.929 DEBUG:tasks.ceph:set 0 configs 2024-09-16T16:45:22.929 INFO:tasks.ceph:Setting crush tunables to default 2024-09-16T16:45:22.929 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph osd crush tunables default 2024-09-16T16:45:23.008 INFO:tasks.ceph.mgr.x.smithi122.stderr:2024-09-16T16:45:23.008+0000 7f3cb9bbe000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:45:23.009 INFO:tasks.ceph.mon.a.smithi122.stderr:2024-09-16T16:45:23.008+0000 7f983922dc00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:45:23.009 INFO:tasks.ceph.mon.a.smithi122.stderr:2024-09-16T16:45:23.008+0000 7f983922dc00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:45:23.009 INFO:tasks.ceph.mon.a.smithi122.stderr:2024-09-16T16:45:23.008+0000 7f983922dc00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:45:23.038 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T16:45:23.032+0000 7f1616111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:45:23.045 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T16:45:23.045+0000 7f1616111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:45:23.114 INFO:teuthology.orchestra.run.smithi122.stderr:adjusted tunables profile to default 2024-09-16T16:45:23.125 INFO:tasks.ceph:check_enable_crimson: True 2024-09-16T16:45:23.125 INFO:tasks.ceph:check_enable_crimson: setting set-allow-crimson 2024-09-16T16:45:23.125 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph osd set-allow-crimson --yes-i-really-mean-it 2024-09-16T16:45:23.214 INFO:tasks.ceph.mgr.x.smithi122.stderr:2024-09-16T16:45:23.213+0000 7f3cb9bbe000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:45:23.214 INFO:tasks.ceph.mgr.x.smithi122.stderr:2024-09-16T16:45:23.214+0000 7f3cb9bbe000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:45:23.230 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T16:45:23.225+0000 7fb9dc711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:45:23.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T16:45:23.234+0000 7fb9dc711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:45:23.316 INFO:tasks.ceph.mon.a.smithi122.stderr:2024-09-16T16:45:23.315+0000 7f982fbf4640 -1 WARNING: experimental feature 'crimson' is enabled 2024-09-16T16:45:23.316 INFO:tasks.ceph.mon.a.smithi122.stderr:Please be aware that this feature is experimental, untested, 2024-09-16T16:45:23.316 INFO:tasks.ceph.mon.a.smithi122.stderr:unsupported, and may result in data corruption, data loss, 2024-09-16T16:45:23.316 INFO:tasks.ceph.mon.a.smithi122.stderr:and/or irreparable damage to your cluster. Do not use 2024-09-16T16:45:23.316 INFO:tasks.ceph.mon.a.smithi122.stderr:feature with important data. 2024-09-16T16:45:23.316 INFO:tasks.ceph.mon.a.smithi122.stderr: 2024-09-16T16:45:24.126 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-16T16:45:24.127 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-16T16:45:24.127 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-16T16:45:24.151 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-16T16:45:24.151 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-16T16:45:24.215 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-16T16:45:24.216 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-16T16:45:24.281 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph osd new 03d0aba2-c284-4cb3-8fd6-4b91155c8fd0 0 2024-09-16T16:45:24.429 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T16:45:24.423+0000 7f9efc29c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:45:24.433 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T16:45:24.433+0000 7f9efc29c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:45:24.529 INFO:teuthology.orchestra.run.smithi122.stdout:0 2024-09-16T16:45:24.540 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph osd new 6ae551e1-7b06-4bcc-a978-6c6ca56a263b 1 2024-09-16T16:45:24.647 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T16:45:24.641+0000 7fdb87991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:45:24.651 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T16:45:24.651+0000 7fdb87991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:45:24.729 INFO:teuthology.orchestra.run.smithi122.stdout:1 2024-09-16T16:45:24.741 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph osd new a07a1f7f-1ce5-4ecd-b0be-8ee4de2f94e8 2 2024-09-16T16:45:24.849 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T16:45:24.842+0000 7f7538591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:45:24.852 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T16:45:24.852+0000 7f7538591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:45:24.930 INFO:teuthology.orchestra.run.smithi122.stdout:2 2024-09-16T16:45:24.941 DEBUG:teuthology.orchestra.run.smithi122:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.0.log 2024-09-16T16:45:24.970 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-16T16:45:24.971 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2024-09-16T16:45:25.013 INFO:tasks.ceph.osd.0:Started 2024-09-16T16:45:25.014 DEBUG:teuthology.orchestra.run.smithi122:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.1.log 2024-09-16T16:45:25.041 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-16T16:45:25.042 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2>> /var/log/ceph/ceph-osd.1.log 2024-09-16T16:45:25.085 INFO:tasks.ceph.osd.1:Started 2024-09-16T16:45:25.085 DEBUG:teuthology.orchestra.run.smithi122:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.2.log 2024-09-16T16:45:25.116 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-16T16:45:25.116 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log 2024-09-16T16:45:25.158 INFO:tasks.ceph.osd.2:Started 2024-09-16T16:45:25.159 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T16:45:25.330 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T16:45:25.325+0000 7fa9df46c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:45:25.335 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T16:45:25.335+0000 7fa9df46c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:45:25.424 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:45:25.424 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":6,"fsid":"fd01cf2a-db9f-495a-a112-c9787c9c6bf1","created":"2024-09-16T16:45:23.033556+0000","modified":"2024-09-16T16:45:24.930266+0000","last_up_change":"0.000000","last_in_change":"2024-09-16T16:45:24.930266+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"03d0aba2-c284-4cb3-8fd6-4b91155c8fd0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6ae551e1-7b06-4bcc-a978-6c6ca56a263b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a07a1f7f-1ce5-4ecd-b0be-8ee4de2f94e8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T16:45:25.437 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-16T16:45:25.437 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-16T16:45:25.739 DEBUG:teuthology.orchestra.run.smithi122:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-16T16:45:25.842 INFO:teuthology.misc.health.smithi122.stderr:2024-09-16T16:45:25.838+0000 7fc91dd11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:45:25.847 INFO:teuthology.misc.health.smithi122.stderr:2024-09-16T16:45:25.846+0000 7fc91dd11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:45:25.916 INFO:teuthology.misc.health.smithi122.stdout: 2024-09-16T16:45:25.916 INFO:teuthology.misc.health.smithi122.stdout:{"epoch":6,"fsid":"fd01cf2a-db9f-495a-a112-c9787c9c6bf1","created":"2024-09-16T16:45:23.033556+0000","modified":"2024-09-16T16:45:24.930266+0000","last_up_change":"0.000000","last_in_change":"2024-09-16T16:45:24.930266+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"03d0aba2-c284-4cb3-8fd6-4b91155c8fd0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6ae551e1-7b06-4bcc-a978-6c6ca56a263b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a07a1f7f-1ce5-4ecd-b0be-8ee4de2f94e8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T16:45:25.927 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-09-16T16:45:28.626 INFO:tasks.ceph.mgr.x.smithi122.stderr:2024-09-16T16:45:28.625+0000 7f3c56ec4640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-16T16:45:32.230 DEBUG:teuthology.orchestra.run.smithi122:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-16T16:45:32.340 INFO:teuthology.misc.health.smithi122.stderr:2024-09-16T16:45:32.336+0000 7f5ab9b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:45:32.343 INFO:teuthology.misc.health.smithi122.stderr:2024-09-16T16:45:32.343+0000 7f5ab9b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:45:32.536 INFO:teuthology.misc.health.smithi122.stdout: 2024-09-16T16:45:32.536 INFO:teuthology.misc.health.smithi122.stdout:{"epoch":8,"fsid":"fd01cf2a-db9f-495a-a112-c9787c9c6bf1","created":"2024-09-16T16:45:23.033556+0000","modified":"2024-09-16T16:45:31.631344+0000","last_up_change":"2024-09-16T16:45:31.631344+0000","last_in_change":"2024-09-16T16:45:24.930266+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"03d0aba2-c284-4cb3-8fd6-4b91155c8fd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6807","nonce":2116540039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":2116540039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6813","nonce":2116540039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":2116540039}]},"public_addr":"172.21.15.122:6807/2116540039","cluster_addr":"172.21.15.122:6804/2116540039","heartbeat_back_addr":"172.21.15.122:6813/2116540039","heartbeat_front_addr":"172.21.15.122:6814/2116540039","state":["exists","up"]},{"osd":1,"uuid":"6ae551e1-7b06-4bcc-a978-6c6ca56a263b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6805","nonce":322370007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":322370007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":322370007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6803","nonce":322370007}]},"public_addr":"172.21.15.122:6805/322370007","cluster_addr":"172.21.15.122:6806/322370007","heartbeat_back_addr":"172.21.15.122:6802/322370007","heartbeat_front_addr":"172.21.15.122:6803/322370007","state":["exists","up"]},{"osd":2,"uuid":"a07a1f7f-1ce5-4ecd-b0be-8ee4de2f94e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6809","nonce":82673049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":82673049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":82673049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6811","nonce":82673049}]},"public_addr":"172.21.15.122:6809/82673049","cluster_addr":"172.21.15.122:6808/82673049","heartbeat_back_addr":"172.21.15.122:6810/82673049","heartbeat_front_addr":"172.21.15.122:6811/82673049","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T16:45:32.545 DEBUG:teuthology.misc:3 of 3 OSDs are up 2024-09-16T16:45:32.545 INFO:tasks.ceph:Creating RBD pool 2024-09-16T16:45:32.545 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-16T16:45:32.660 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T16:45:32.650+0000 7f824cb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:45:32.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T16:45:32.662+0000 7f824cb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:45:33.641 INFO:teuthology.orchestra.run.smithi122.stderr:pool 'rbd' created 2024-09-16T16:45:33.665 DEBUG:teuthology.orchestra.run.smithi122:> rbd --cluster ceph pool init rbd 2024-09-16T16:45:33.767 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T16:45:33.765+0000 7f864be53ac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:45:33.767 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T16:45:33.765+0000 7f864be53ac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:45:33.774 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T16:45:33.773+0000 7f864be53ac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:45:36.702 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-16T16:45:36.703 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-16T16:45:36.703 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-16T16:45:36.814 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T16:45:36.808+0000 7f3498f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:45:36.817 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T16:45:36.817+0000 7f3498f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:45:37.004 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:45:37.016 INFO:teuthology.orchestra.run.smithi122.stdout:[{"version":1,"timestamp":"0.000000","name":"","changes":[]}] 2024-09-16T16:45:37.017 INFO:tasks.ceph_manager:config epoch is 1 2024-09-16T16:45:37.017 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-16T16:45:37.017 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-16T16:45:37.017 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-16T16:45:37.125 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T16:45:37.120+0000 7f193407f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:45:37.128 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T16:45:37.128+0000 7f193407f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:45:37.363 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:45:37.375 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":5,"flags":0,"active_gid":4101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":4159774827},{"type":"v1","addr":"172.21.15.122:6801","nonce":4159774827}]},"active_addr":"172.21.15.122:6801/4159774827","active_change":"2024-09-16T16:45:27.617318+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.122:0","nonce":2883704828}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.122:0","nonce":1581402050}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.122:0","nonce":3890851538}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.122:0","nonce":3168242453}]}]} 2024-09-16T16:45:37.382 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-16T16:45:37.382 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-16T16:45:37.382 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T16:45:37.491 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T16:45:37.487+0000 7f6fe7b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:45:37.494 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T16:45:37.494+0000 7f6fe7b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:45:37.682 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:45:37.683 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":13,"fsid":"fd01cf2a-db9f-495a-a112-c9787c9c6bf1","created":"2024-09-16T16:45:23.033556+0000","modified":"2024-09-16T16:45:36.654029+0000","last_up_change":"2024-09-16T16:45:31.631344+0000","last_in_change":"2024-09-16T16:45:24.930266+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T16:45:31.645635+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-16T16:45:32.853094+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":13,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"03d0aba2-c284-4cb3-8fd6-4b91155c8fd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6807","nonce":2116540039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":2116540039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6813","nonce":2116540039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":2116540039}]},"public_addr":"172.21.15.122:6807/2116540039","cluster_addr":"172.21.15.122:6804/2116540039","heartbeat_back_addr":"172.21.15.122:6813/2116540039","heartbeat_front_addr":"172.21.15.122:6814/2116540039","state":["exists","up"]},{"osd":1,"uuid":"6ae551e1-7b06-4bcc-a978-6c6ca56a263b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6805","nonce":322370007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":322370007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":322370007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6803","nonce":322370007}]},"public_addr":"172.21.15.122:6805/322370007","cluster_addr":"172.21.15.122:6806/322370007","heartbeat_back_addr":"172.21.15.122:6802/322370007","heartbeat_front_addr":"172.21.15.122:6803/322370007","state":["exists","up"]},{"osd":2,"uuid":"a07a1f7f-1ce5-4ecd-b0be-8ee4de2f94e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6809","nonce":82673049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":82673049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":82673049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6811","nonce":82673049}]},"public_addr":"172.21.15.122:6809/82673049","cluster_addr":"172.21.15.122:6808/82673049","heartbeat_back_addr":"172.21.15.122:6810/82673049","heartbeat_front_addr":"172.21.15.122:6811/82673049","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T16:45:37.696 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-16T16:45:37.696 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T16:45:37.804 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T16:45:37.800+0000 7f6ed7791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:45:37.807 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T16:45:37.807+0000 7f6ed7791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:45:37.992 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:45:37.992 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":13,"fsid":"fd01cf2a-db9f-495a-a112-c9787c9c6bf1","created":"2024-09-16T16:45:23.033556+0000","modified":"2024-09-16T16:45:36.654029+0000","last_up_change":"2024-09-16T16:45:31.631344+0000","last_in_change":"2024-09-16T16:45:24.930266+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T16:45:31.645635+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-16T16:45:32.853094+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":13,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"03d0aba2-c284-4cb3-8fd6-4b91155c8fd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6807","nonce":2116540039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":2116540039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6813","nonce":2116540039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":2116540039}]},"public_addr":"172.21.15.122:6807/2116540039","cluster_addr":"172.21.15.122:6804/2116540039","heartbeat_back_addr":"172.21.15.122:6813/2116540039","heartbeat_front_addr":"172.21.15.122:6814/2116540039","state":["exists","up"]},{"osd":1,"uuid":"6ae551e1-7b06-4bcc-a978-6c6ca56a263b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6805","nonce":322370007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":322370007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":322370007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6803","nonce":322370007}]},"public_addr":"172.21.15.122:6805/322370007","cluster_addr":"172.21.15.122:6806/322370007","heartbeat_back_addr":"172.21.15.122:6802/322370007","heartbeat_front_addr":"172.21.15.122:6803/322370007","state":["exists","up"]},{"osd":2,"uuid":"a07a1f7f-1ce5-4ecd-b0be-8ee4de2f94e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6809","nonce":82673049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":82673049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":82673049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6811","nonce":82673049}]},"public_addr":"172.21.15.122:6809/82673049","cluster_addr":"172.21.15.122:6808/82673049","heartbeat_back_addr":"172.21.15.122:6810/82673049","heartbeat_front_addr":"172.21.15.122:6811/82673049","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T16:45:38.005 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-16T16:45:38.006 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-16T16:45:38.006 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-16T16:45:38.119 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T16:45:38.114+0000 7ff776cbd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:45:38.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T16:45:38.114+0000 7f3aba308640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:45:38.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T16:45:38.115+0000 7f81c24ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:45:38.124 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T16:45:38.124+0000 7ff776cbd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:45:38.124 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T16:45:38.124+0000 7f81c24ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:45:38.124 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T16:45:38.124+0000 7f3aba308640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:45:38.155 INFO:teuthology.orchestra.run.smithi122.stdout:34359738374 2024-09-16T16:45:38.155 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-16T16:45:38.162 INFO:teuthology.orchestra.run.smithi122.stdout:34359738374 2024-09-16T16:45:38.163 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-16T16:45:38.163 INFO:teuthology.orchestra.run.smithi122.stdout:34359738374 2024-09-16T16:45:38.164 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-16T16:45:38.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T16:45:38.261+0000 7fd1e5191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:45:38.270 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T16:45:38.270+0000 7fd1e5191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:45:38.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T16:45:38.312+0000 7fbb4166c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:45:38.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T16:45:38.315+0000 7faa98474640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:45:38.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T16:45:38.321+0000 7fbb4166c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:45:38.325 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T16:45:38.325+0000 7faa98474640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:45:38.474 INFO:teuthology.orchestra.run.smithi122.stdout:34359738374 2024-09-16T16:45:38.487 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738374 for osd.1 2024-09-16T16:45:38.487 DEBUG:teuthology.parallel:result is None 2024-09-16T16:45:38.519 INFO:teuthology.orchestra.run.smithi122.stdout:34359738374 2024-09-16T16:45:38.524 INFO:teuthology.orchestra.run.smithi122.stdout:34359738374 2024-09-16T16:45:38.533 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738374 for osd.2 2024-09-16T16:45:38.534 DEBUG:teuthology.parallel:result is None 2024-09-16T16:45:38.537 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738374 for osd.0 2024-09-16T16:45:38.537 DEBUG:teuthology.parallel:result is None 2024-09-16T16:45:38.538 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T16:45:38.538 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:45:38.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T16:45:38.682+0000 7fb453391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:45:38.689 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T16:45:38.689+0000 7fb453391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:45:38.873 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:45:38.873 INFO:teuthology.orchestra.run.smithi122.stderr:dumped all 2024-09-16T16:45:38.886 INFO:teuthology.orchestra.run.smithi122.stdout:{"pg_ready":true,"pg_map":{"version":10,"stamp":"2024-09-16T16:45:38.147028+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":283115520,"kb_used":80980,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":80448,"kb_avail":283034540,"statfs":{"total":289910292480,"available":289827368960,"internally_reserved":0,"allocated":462848,"data_stored":1262998,"data_compressed":60088,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":82378752},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-09-16T16:45:36.678790+0000","last_change":"2024-09-16T16:45:36.683962+0000","last_active":"2024-09-16T16:45:36.678790+0000","last_peered":"2024-09-16T16:45:36.678790+0000","last_clean":"2024-09-16T16:45:36.678790+0000","last_became_active":"2024-09-16T16:45:34.727276+0000","last_became_peered":"2024-09-16T16:45:34.727276+0000","last_unstale":"2024-09-16T16:45:36.678790+0000","last_undegraded":"2024-09-16T16:45:36.678790+0000","last_fullsized":"2024-09-16T16:45:36.678790+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_clean_scrub_stamp":"2024-09-16T16:45:33.640839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-09-16T16:45:36.685963+0000","last_change":"2024-09-16T16:45:36.691655+0000","last_active":"2024-09-16T16:45:36.685963+0000","last_peered":"2024-09-16T16:45:36.685963+0000","last_clean":"2024-09-16T16:45:36.685963+0000","last_became_active":"2024-09-16T16:45:34.768510+0000","last_became_peered":"2024-09-16T16:45:34.768510+0000","last_unstale":"2024-09-16T16:45:36.685963+0000","last_undegraded":"2024-09-16T16:45:36.685963+0000","last_fullsized":"2024-09-16T16:45:36.685963+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_clean_scrub_stamp":"2024-09-16T16:45:33.640839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-09-16T16:45:36.676117+0000","last_change":"2024-09-16T16:45:36.683615+0000","last_active":"2024-09-16T16:45:36.676117+0000","last_peered":"2024-09-16T16:45:36.676117+0000","last_clean":"2024-09-16T16:45:36.676117+0000","last_became_active":"2024-09-16T16:45:34.751996+0000","last_became_peered":"2024-09-16T16:45:34.751996+0000","last_unstale":"2024-09-16T16:45:36.676117+0000","last_undegraded":"2024-09-16T16:45:36.676117+0000","last_fullsized":"2024-09-16T16:45:36.676117+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_clean_scrub_stamp":"2024-09-16T16:45:33.640839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-09-16T16:45:36.683334+0000","last_change":"2024-09-16T16:45:36.690821+0000","last_active":"2024-09-16T16:45:36.683334+0000","last_peered":"2024-09-16T16:45:36.683334+0000","last_clean":"2024-09-16T16:45:36.683334+0000","last_became_active":"2024-09-16T16:45:34.762441+0000","last_became_peered":"2024-09-16T16:45:34.762441+0000","last_unstale":"2024-09-16T16:45:36.683334+0000","last_undegraded":"2024-09-16T16:45:36.683334+0000","last_fullsized":"2024-09-16T16:45:36.683334+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_clean_scrub_stamp":"2024-09-16T16:45:33.640839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"13'2","reported_seq":17,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-09-16T16:45:36.681924+0000","last_change":"2024-09-16T16:45:36.681924+0000","last_active":"2024-09-16T16:45:36.681924+0000","last_peered":"2024-09-16T16:45:36.681924+0000","last_clean":"2024-09-16T16:45:36.681924+0000","last_became_active":"2024-09-16T16:45:34.742686+0000","last_became_peered":"2024-09-16T16:45:34.742686+0000","last_unstale":"2024-09-16T16:45:36.681924+0000","last_undegraded":"2024-09-16T16:45:36.681924+0000","last_fullsized":"2024-09-16T16:45:36.681924+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_clean_scrub_stamp":"2024-09-16T16:45:33.640839+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-09-16T16:45:36.679367+0000","last_change":"2024-09-16T16:45:36.681720+0000","last_active":"2024-09-16T16:45:36.679367+0000","last_peered":"2024-09-16T16:45:36.679367+0000","last_clean":"2024-09-16T16:45:36.679367+0000","last_became_active":"2024-09-16T16:45:34.770776+0000","last_became_peered":"2024-09-16T16:45:34.770776+0000","last_unstale":"2024-09-16T16:45:36.679367+0000","last_undegraded":"2024-09-16T16:45:36.679367+0000","last_fullsized":"2024-09-16T16:45:36.679367+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_clean_scrub_stamp":"2024-09-16T16:45:33.640839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-09-16T16:45:36.675272+0000","last_change":"2024-09-16T16:45:36.679871+0000","last_active":"2024-09-16T16:45:36.675272+0000","last_peered":"2024-09-16T16:45:36.675272+0000","last_clean":"2024-09-16T16:45:36.675272+0000","last_became_active":"2024-09-16T16:45:34.772861+0000","last_became_peered":"2024-09-16T16:45:34.772861+0000","last_unstale":"2024-09-16T16:45:36.675272+0000","last_undegraded":"2024-09-16T16:45:36.675272+0000","last_fullsized":"2024-09-16T16:45:36.675272+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_clean_scrub_stamp":"2024-09-16T16:45:33.640839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"11'1","reported_seq":16,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-09-16T16:45:36.686880+0000","last_change":"2024-09-16T16:45:36.691910+0000","last_active":"2024-09-16T16:45:36.686880+0000","last_peered":"2024-09-16T16:45:36.686880+0000","last_clean":"2024-09-16T16:45:36.686880+0000","last_became_active":"2024-09-16T16:45:34.740122+0000","last_became_peered":"2024-09-16T16:45:34.740122+0000","last_unstale":"2024-09-16T16:45:36.686880+0000","last_undegraded":"2024-09-16T16:45:36.686880+0000","last_fullsized":"2024-09-16T16:45:36.686880+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_clean_scrub_stamp":"2024-09-16T16:45:33.640839+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'52","reported_seq":84,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-09-16T16:45:36.677467+0000","last_change":"2024-09-16T16:45:33.709010+0000","last_active":"2024-09-16T16:45:36.677467+0000","last_peered":"2024-09-16T16:45:36.677467+0000","last_clean":"2024-09-16T16:45:36.677467+0000","last_became_active":"2024-09-16T16:45:33.697521+0000","last_became_peered":"2024-09-16T16:45:33.697521+0000","last_unstale":"2024-09-16T16:45:36.677467+0000","last_undegraded":"2024-09-16T16:45:36.677467+0000","last_fullsized":"2024-09-16T16:45:36.677467+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:45:32.637441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:45:32.637441+0000","last_clean_scrub_stamp":"2024-09-16T16:45:32.637441+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26940,"kb_used_data":108,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344900,"statfs":{"total":96636764160,"available":96609177600,"internally_reserved":0,"allocated":110592,"data_stored":27408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27020,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344820,"statfs":{"total":96636764160,"available":96609095680,"internally_reserved":0,"allocated":176128,"data_stored":617795,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27020,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344820,"statfs":{"total":96636764160,"available":96609095680,"internally_reserved":0,"allocated":176128,"data_stored":617795,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:45:38.887 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:45:38.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T16:45:38.989+0000 7f3cf8911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:45:38.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T16:45:38.997+0000 7f3cf8911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:45:39.178 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:45:39.179 INFO:teuthology.orchestra.run.smithi122.stderr:dumped all 2024-09-16T16:45:39.191 INFO:teuthology.orchestra.run.smithi122.stdout:{"pg_ready":true,"pg_map":{"version":10,"stamp":"2024-09-16T16:45:38.147028+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":283115520,"kb_used":80980,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":80448,"kb_avail":283034540,"statfs":{"total":289910292480,"available":289827368960,"internally_reserved":0,"allocated":462848,"data_stored":1262998,"data_compressed":60088,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":82378752},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-09-16T16:45:36.678790+0000","last_change":"2024-09-16T16:45:36.683962+0000","last_active":"2024-09-16T16:45:36.678790+0000","last_peered":"2024-09-16T16:45:36.678790+0000","last_clean":"2024-09-16T16:45:36.678790+0000","last_became_active":"2024-09-16T16:45:34.727276+0000","last_became_peered":"2024-09-16T16:45:34.727276+0000","last_unstale":"2024-09-16T16:45:36.678790+0000","last_undegraded":"2024-09-16T16:45:36.678790+0000","last_fullsized":"2024-09-16T16:45:36.678790+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_clean_scrub_stamp":"2024-09-16T16:45:33.640839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-09-16T16:45:36.685963+0000","last_change":"2024-09-16T16:45:36.691655+0000","last_active":"2024-09-16T16:45:36.685963+0000","last_peered":"2024-09-16T16:45:36.685963+0000","last_clean":"2024-09-16T16:45:36.685963+0000","last_became_active":"2024-09-16T16:45:34.768510+0000","last_became_peered":"2024-09-16T16:45:34.768510+0000","last_unstale":"2024-09-16T16:45:36.685963+0000","last_undegraded":"2024-09-16T16:45:36.685963+0000","last_fullsized":"2024-09-16T16:45:36.685963+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_clean_scrub_stamp":"2024-09-16T16:45:33.640839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-09-16T16:45:36.676117+0000","last_change":"2024-09-16T16:45:36.683615+0000","last_active":"2024-09-16T16:45:36.676117+0000","last_peered":"2024-09-16T16:45:36.676117+0000","last_clean":"2024-09-16T16:45:36.676117+0000","last_became_active":"2024-09-16T16:45:34.751996+0000","last_became_peered":"2024-09-16T16:45:34.751996+0000","last_unstale":"2024-09-16T16:45:36.676117+0000","last_undegraded":"2024-09-16T16:45:36.676117+0000","last_fullsized":"2024-09-16T16:45:36.676117+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_clean_scrub_stamp":"2024-09-16T16:45:33.640839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-09-16T16:45:36.683334+0000","last_change":"2024-09-16T16:45:36.690821+0000","last_active":"2024-09-16T16:45:36.683334+0000","last_peered":"2024-09-16T16:45:36.683334+0000","last_clean":"2024-09-16T16:45:36.683334+0000","last_became_active":"2024-09-16T16:45:34.762441+0000","last_became_peered":"2024-09-16T16:45:34.762441+0000","last_unstale":"2024-09-16T16:45:36.683334+0000","last_undegraded":"2024-09-16T16:45:36.683334+0000","last_fullsized":"2024-09-16T16:45:36.683334+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_clean_scrub_stamp":"2024-09-16T16:45:33.640839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"13'2","reported_seq":17,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-09-16T16:45:36.681924+0000","last_change":"2024-09-16T16:45:36.681924+0000","last_active":"2024-09-16T16:45:36.681924+0000","last_peered":"2024-09-16T16:45:36.681924+0000","last_clean":"2024-09-16T16:45:36.681924+0000","last_became_active":"2024-09-16T16:45:34.742686+0000","last_became_peered":"2024-09-16T16:45:34.742686+0000","last_unstale":"2024-09-16T16:45:36.681924+0000","last_undegraded":"2024-09-16T16:45:36.681924+0000","last_fullsized":"2024-09-16T16:45:36.681924+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_clean_scrub_stamp":"2024-09-16T16:45:33.640839+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-09-16T16:45:36.679367+0000","last_change":"2024-09-16T16:45:36.681720+0000","last_active":"2024-09-16T16:45:36.679367+0000","last_peered":"2024-09-16T16:45:36.679367+0000","last_clean":"2024-09-16T16:45:36.679367+0000","last_became_active":"2024-09-16T16:45:34.770776+0000","last_became_peered":"2024-09-16T16:45:34.770776+0000","last_unstale":"2024-09-16T16:45:36.679367+0000","last_undegraded":"2024-09-16T16:45:36.679367+0000","last_fullsized":"2024-09-16T16:45:36.679367+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_clean_scrub_stamp":"2024-09-16T16:45:33.640839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-09-16T16:45:36.675272+0000","last_change":"2024-09-16T16:45:36.679871+0000","last_active":"2024-09-16T16:45:36.675272+0000","last_peered":"2024-09-16T16:45:36.675272+0000","last_clean":"2024-09-16T16:45:36.675272+0000","last_became_active":"2024-09-16T16:45:34.772861+0000","last_became_peered":"2024-09-16T16:45:34.772861+0000","last_unstale":"2024-09-16T16:45:36.675272+0000","last_undegraded":"2024-09-16T16:45:36.675272+0000","last_fullsized":"2024-09-16T16:45:36.675272+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_clean_scrub_stamp":"2024-09-16T16:45:33.640839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"11'1","reported_seq":16,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-09-16T16:45:36.686880+0000","last_change":"2024-09-16T16:45:36.691910+0000","last_active":"2024-09-16T16:45:36.686880+0000","last_peered":"2024-09-16T16:45:36.686880+0000","last_clean":"2024-09-16T16:45:36.686880+0000","last_became_active":"2024-09-16T16:45:34.740122+0000","last_became_peered":"2024-09-16T16:45:34.740122+0000","last_unstale":"2024-09-16T16:45:36.686880+0000","last_undegraded":"2024-09-16T16:45:36.686880+0000","last_fullsized":"2024-09-16T16:45:36.686880+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_clean_scrub_stamp":"2024-09-16T16:45:33.640839+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'52","reported_seq":84,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-09-16T16:45:36.677467+0000","last_change":"2024-09-16T16:45:33.709010+0000","last_active":"2024-09-16T16:45:36.677467+0000","last_peered":"2024-09-16T16:45:36.677467+0000","last_clean":"2024-09-16T16:45:36.677467+0000","last_became_active":"2024-09-16T16:45:33.697521+0000","last_became_peered":"2024-09-16T16:45:33.697521+0000","last_unstale":"2024-09-16T16:45:36.677467+0000","last_undegraded":"2024-09-16T16:45:36.677467+0000","last_fullsized":"2024-09-16T16:45:36.677467+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:45:32.637441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:45:32.637441+0000","last_clean_scrub_stamp":"2024-09-16T16:45:32.637441+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26940,"kb_used_data":108,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344900,"statfs":{"total":96636764160,"available":96609177600,"internally_reserved":0,"allocated":110592,"data_stored":27408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27020,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344820,"statfs":{"total":96636764160,"available":96609095680,"internally_reserved":0,"allocated":176128,"data_stored":617795,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27020,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344820,"statfs":{"total":96636764160,"available":96609095680,"internally_reserved":0,"allocated":176128,"data_stored":617795,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:45:39.192 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T16:45:39.192 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-16T16:45:39.192 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-16T16:45:39.193 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-16T16:45:39.300 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T16:45:39.296+0000 7f3081351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:45:39.303 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T16:45:39.303+0000 7f3081351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:45:39.524 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T16:45:39.524 INFO:teuthology.orchestra.run.smithi122.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-16T16:45:39.537 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-16T16:45:39.537 INFO:teuthology.run_tasks:Running task workunit... 2024-09-16T16:45:39.551 INFO:tasks.workunit:Pulling workunits from ref 0325fd3c11a225c0fd9eb38fab88aad1370ad779 2024-09-16T16:45:39.551 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-16T16:45:39.551 DEBUG:teuthology.orchestra.run.smithi122:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-16T16:45:39.566 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T16:45:39.567 INFO:teuthology.orchestra.run.smithi122.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-16T16:45:39.567 DEBUG:teuthology.orchestra.run.smithi122:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-16T16:45:39.622 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-16T16:45:39.623 DEBUG:teuthology.orchestra.run.smithi122:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-16T16:45:39.677 INFO:tasks.workunit:timeout=3h 2024-09-16T16:45:39.677 INFO:tasks.workunit:cleanup=True 2024-09-16T16:45:39.678 DEBUG:teuthology.orchestra.run.smithi122:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 0325fd3c11a225c0fd9eb38fab88aad1370ad779 2024-09-16T16:45:39.734 INFO:tasks.workunit.client.0.smithi122.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-16T16:46:31.552 INFO:tasks.workunit.client.0.smithi122.stderr:Note: switching to '0325fd3c11a225c0fd9eb38fab88aad1370ad779'. 2024-09-16T16:46:31.552 INFO:tasks.workunit.client.0.smithi122.stderr: 2024-09-16T16:46:31.552 INFO:tasks.workunit.client.0.smithi122.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-16T16:46:31.552 INFO:tasks.workunit.client.0.smithi122.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-16T16:46:31.553 INFO:tasks.workunit.client.0.smithi122.stderr:state without impacting any branches by switching back to a branch. 2024-09-16T16:46:31.553 INFO:tasks.workunit.client.0.smithi122.stderr: 2024-09-16T16:46:31.553 INFO:tasks.workunit.client.0.smithi122.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-16T16:46:31.553 INFO:tasks.workunit.client.0.smithi122.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-16T16:46:31.553 INFO:tasks.workunit.client.0.smithi122.stderr: 2024-09-16T16:46:31.553 INFO:tasks.workunit.client.0.smithi122.stderr: git switch -c 2024-09-16T16:46:31.553 INFO:tasks.workunit.client.0.smithi122.stderr: 2024-09-16T16:46:31.553 INFO:tasks.workunit.client.0.smithi122.stderr:Or undo this operation with: 2024-09-16T16:46:31.553 INFO:tasks.workunit.client.0.smithi122.stderr: 2024-09-16T16:46:31.553 INFO:tasks.workunit.client.0.smithi122.stderr: git switch - 2024-09-16T16:46:31.553 INFO:tasks.workunit.client.0.smithi122.stderr: 2024-09-16T16:46:31.553 INFO:tasks.workunit.client.0.smithi122.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-16T16:46:31.553 INFO:tasks.workunit.client.0.smithi122.stderr: 2024-09-16T16:46:31.553 INFO:tasks.workunit.client.0.smithi122.stderr:HEAD is now at 0325fd3c11a Merge pull request #58530 from zdover23/wip-doc-2024-07-11-radosgw-s3-authentication 2024-09-16T16:46:31.556 DEBUG:teuthology.orchestra.run.smithi122:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-16T16:46:31.714 INFO:tasks.workunit.client.0.smithi122.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-16T16:46:31.716 INFO:tasks.workunit.client.0.smithi122.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-16T16:46:31.716 INFO:tasks.workunit.client.0.smithi122.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-16T16:46:32.341 INFO:tasks.workunit.client.0.smithi122.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-16T16:46:32.421 INFO:tasks.workunit.client.0.smithi122.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-16T16:46:32.461 INFO:tasks.workunit.client.0.smithi122.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-16T16:46:32.463 INFO:tasks.workunit.client.0.smithi122.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-16T16:46:32.463 INFO:tasks.workunit.client.0.smithi122.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-16T16:46:32.502 INFO:tasks.workunit.client.0.smithi122.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-16T16:46:32.505 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-16T16:46:32.506 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-16T16:46:32.521 INFO:tasks.workunit:Running workunits matching rbd/crimson/test_crimson_librbd.sh on client.0... 2024-09-16T16:46:32.523 INFO:tasks.workunit:Running workunit rbd/crimson/test_crimson_librbd.sh... 2024-09-16T16:46:32.523 DEBUG:teuthology.orchestra.run.smithi122:workunit test rbd/crimson/test_crimson_librbd.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0325fd3c11a225c0fd9eb38fab88aad1370ad779 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_FEATURES=61 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/crimson/test_crimson_librbd.sh 2024-09-16T16:46:32.629 INFO:tasks.workunit.client.0.smithi122.stdout:seed 30518 2024-09-16T16:46:32.630 INFO:tasks.workunit.client.0.smithi122.stdout:Note: Google Test filter = TestLibRBD.* 2024-09-16T16:46:32.630 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] Running 171 tests from 1 test suite. 2024-09-16T16:46:32.630 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment set-up. 2024-09-16T16:46:32.630 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 171 tests from TestLibRBD 2024-09-16T16:46:32.677 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.CreateAndStat 2024-09-16T16:46:34.065 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:46:36.283 INFO:tasks.workunit.client.0.smithi122.stdout:image has size 2097152 and order 22 2024-09-16T16:46:36.284 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.CreateAndStat (3606 ms) 2024-09-16T16:46:36.284 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.CreateWithSameDataPool 2024-09-16T16:46:36.284 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:46:36.458 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.CreateWithSameDataPool (174 ms) 2024-09-16T16:46:36.458 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.CreateAndStatPP 2024-09-16T16:46:36.458 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:46:36.636 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.CreateAndStatPP (179 ms) 2024-09-16T16:46:36.636 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.GetId 2024-09-16T16:46:36.637 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:46:36.887 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.GetId (250 ms) 2024-09-16T16:46:36.887 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.GetIdPP 2024-09-16T16:46:36.887 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:46:37.150 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.GetIdPP (263 ms) 2024-09-16T16:46:37.150 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.GetBlockNamePrefix 2024-09-16T16:46:37.150 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:46:37.318 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.GetBlockNamePrefix (168 ms) 2024-09-16T16:46:37.318 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.GetBlockNamePrefixPP 2024-09-16T16:46:37.318 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:46:37.485 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.GetBlockNamePrefixPP (168 ms) 2024-09-16T16:46:37.485 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.TestGetCreateTimestamp 2024-09-16T16:46:37.485 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:46:37.649 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.TestGetCreateTimestamp (163 ms) 2024-09-16T16:46:37.649 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.GetCreateTimestampPP 2024-09-16T16:46:37.649 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:46:37.819 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.GetCreateTimestampPP (170 ms) 2024-09-16T16:46:37.819 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.OpenAio 2024-09-16T16:46:37.819 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:46:37.989 INFO:tasks.workunit.client.0.smithi122.stdout:image has size 2097152 and order 22 2024-09-16T16:46:37.989 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.OpenAio (171 ms) 2024-09-16T16:46:37.989 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.OpenAioFail 2024-09-16T16:46:38.001 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.OpenAioFail (11 ms) 2024-09-16T16:46:38.001 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.OpenAioPP 2024-09-16T16:46:38.001 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:46:38.255 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.OpenAioPP (255 ms) 2024-09-16T16:46:38.256 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.OpenAioFailPP 2024-09-16T16:46:38.267 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.OpenAioFailPP (12 ms) 2024-09-16T16:46:38.267 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.ResizeAndStat 2024-09-16T16:46:38.267 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:46:38.693 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.ResizeAndStat (425 ms) 2024-09-16T16:46:38.693 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.ResizeAndStatPP 2024-09-16T16:46:38.694 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:46:39.074 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.ResizeAndStatPP (382 ms) 2024-09-16T16:46:39.075 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.UpdateWatchAndResize 2024-09-16T16:46:39.075 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:46:39.504 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.UpdateWatchAndResize (429 ms) 2024-09-16T16:46:39.504 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.UpdateWatchAndResizePP 2024-09-16T16:46:39.504 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:46:39.950 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.UpdateWatchAndResizePP (446 ms) 2024-09-16T16:46:39.950 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.TestCreateLsDelete 2024-09-16T16:46:41.406 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:46:43.243 INFO:tasks.workunit.client.0.smithi122.stdout:image: image18 2024-09-16T16:46:43.243 INFO:tasks.workunit.client.0.smithi122.stdout:expected = image18 2024-09-16T16:46:43.243 INFO:tasks.workunit.client.0.smithi122.stdout:found image18 2024-09-16T16:46:43.243 INFO:tasks.workunit.client.0.smithi122.stdout:erased image18 2024-09-16T16:46:43.243 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:46:44.071 INFO:tasks.workunit.client.0.smithi122.stdout:image: image18 2024-09-16T16:46:44.071 INFO:tasks.workunit.client.0.smithi122.stdout:image: image19 2024-09-16T16:46:44.071 INFO:tasks.workunit.client.0.smithi122.stdout:expected = image18 2024-09-16T16:46:44.071 INFO:tasks.workunit.client.0.smithi122.stdout:found image18 2024-09-16T16:46:44.071 INFO:tasks.workunit.client.0.smithi122.stdout:erased image18 2024-09-16T16:46:44.071 INFO:tasks.workunit.client.0.smithi122.stdout:expected = image19 2024-09-16T16:46:44.071 INFO:tasks.workunit.client.0.smithi122.stdout:found image19 2024-09-16T16:46:44.072 INFO:tasks.workunit.client.0.smithi122.stdout:erased image19 2024-09-16T16:46:44.072 INFO:tasks.workunit.client.0.smithi122.stdout:image: image19 2024-09-16T16:46:44.072 INFO:tasks.workunit.client.0.smithi122.stdout:expected = image19 2024-09-16T16:46:44.072 INFO:tasks.workunit.client.0.smithi122.stdout:found image19 2024-09-16T16:46:44.072 INFO:tasks.workunit.client.0.smithi122.stdout:erased image19 2024-09-16T16:46:44.072 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.TestCreateLsDelete (4121 ms) 2024-09-16T16:46:44.072 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.TestCreateLsDeletePP 2024-09-16T16:46:45.161 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:46:47.321 INFO:tasks.workunit.client.0.smithi122.stdout:num images is: 1 2024-09-16T16:46:47.321 INFO:tasks.workunit.client.0.smithi122.stdout:expected: 1 2024-09-16T16:46:47.322 INFO:tasks.workunit.client.0.smithi122.stdout:image: image20 2024-09-16T16:46:47.322 INFO:tasks.workunit.client.0.smithi122.stdout:expected = image20 2024-09-16T16:46:47.322 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:46:47.408 INFO:tasks.workunit.client.0.smithi122.stdout:num images is: 2 2024-09-16T16:46:47.409 INFO:tasks.workunit.client.0.smithi122.stdout:expected: 2 2024-09-16T16:46:47.409 INFO:tasks.workunit.client.0.smithi122.stdout:image: image20 2024-09-16T16:46:47.409 INFO:tasks.workunit.client.0.smithi122.stdout:image: image21 2024-09-16T16:46:47.409 INFO:tasks.workunit.client.0.smithi122.stdout:expected = image20 2024-09-16T16:46:47.409 INFO:tasks.workunit.client.0.smithi122.stdout:expected = image21 2024-09-16T16:46:48.090 INFO:tasks.workunit.client.0.smithi122.stdout:num images is: 1 2024-09-16T16:46:48.090 INFO:tasks.workunit.client.0.smithi122.stdout:expected: 1 2024-09-16T16:46:48.091 INFO:tasks.workunit.client.0.smithi122.stdout:image: image21 2024-09-16T16:46:48.091 INFO:tasks.workunit.client.0.smithi122.stdout:expected = image21 2024-09-16T16:46:48.091 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.TestCreateLsDeletePP (4020 ms) 2024-09-16T16:46:48.091 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.TestCopy 2024-09-16T16:46:49.184 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:46:56.641 INFO:tasks.workunit.client.0.smithi122.stdout:image: image22 2024-09-16T16:46:56.641 INFO:tasks.workunit.client.0.smithi122.stdout:expected = image22 2024-09-16T16:46:56.641 INFO:tasks.workunit.client.0.smithi122.stdout:found image22 2024-09-16T16:46:56.641 INFO:tasks.workunit.client.0.smithi122.stdout:erased image22 2024-09-16T16:46:56.641 INFO:tasks.workunit.client.0.smithi122.stdout:image: image22 2024-09-16T16:46:56.641 INFO:tasks.workunit.client.0.smithi122.stdout:image: image23 2024-09-16T16:46:56.641 INFO:tasks.workunit.client.0.smithi122.stdout:expected = image22 2024-09-16T16:46:56.641 INFO:tasks.workunit.client.0.smithi122.stdout:found image22 2024-09-16T16:46:56.642 INFO:tasks.workunit.client.0.smithi122.stdout:erased image22 2024-09-16T16:46:56.642 INFO:tasks.workunit.client.0.smithi122.stdout:expected = image23 2024-09-16T16:46:56.642 INFO:tasks.workunit.client.0.smithi122.stdout:found image23 2024-09-16T16:46:56.642 INFO:tasks.workunit.client.0.smithi122.stdout:erased image23 2024-09-16T16:46:56.642 INFO:tasks.workunit.client.0.smithi122.stdout:100.00% done 2024-09-16T16:46:56.642 INFO:tasks.workunit.client.0.smithi122.stdout:image: image22 2024-09-16T16:46:56.642 INFO:tasks.workunit.client.0.smithi122.stdout:image: image23 2024-09-16T16:46:56.642 INFO:tasks.workunit.client.0.smithi122.stdout:image: image24 2024-09-16T16:46:56.642 INFO:tasks.workunit.client.0.smithi122.stdout:expected = image22 2024-09-16T16:46:56.642 INFO:tasks.workunit.client.0.smithi122.stdout:found image22 2024-09-16T16:46:56.642 INFO:tasks.workunit.client.0.smithi122.stdout:erased image22 2024-09-16T16:46:56.642 INFO:tasks.workunit.client.0.smithi122.stdout:expected = image23 2024-09-16T16:46:56.643 INFO:tasks.workunit.client.0.smithi122.stdout:found image23 2024-09-16T16:46:56.643 INFO:tasks.workunit.client.0.smithi122.stdout:erased image23 2024-09-16T16:46:56.643 INFO:tasks.workunit.client.0.smithi122.stdout:expected = image24 2024-09-16T16:46:56.643 INFO:tasks.workunit.client.0.smithi122.stdout:found image24 2024-09-16T16:46:56.643 INFO:tasks.workunit.client.0.smithi122.stdout:erased image24 2024-09-16T16:46:56.643 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.TestCopy (8550 ms) 2024-09-16T16:46:56.643 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.TestCopyPP 2024-09-16T16:46:58.208 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:47:04.431 INFO:tasks.workunit.client.0.smithi122.stdout:num images is: 1 2024-09-16T16:47:04.432 INFO:tasks.workunit.client.0.smithi122.stdout:expected: 1 2024-09-16T16:47:04.432 INFO:tasks.workunit.client.0.smithi122.stdout:image: image25 2024-09-16T16:47:04.432 INFO:tasks.workunit.client.0.smithi122.stdout:expected = image25 2024-09-16T16:47:04.637 INFO:tasks.workunit.client.0.smithi122.stdout:num images is: 2 2024-09-16T16:47:04.637 INFO:tasks.workunit.client.0.smithi122.stdout:expected: 2 2024-09-16T16:47:04.637 INFO:tasks.workunit.client.0.smithi122.stdout:image: image25 2024-09-16T16:47:04.637 INFO:tasks.workunit.client.0.smithi122.stdout:image: image26 2024-09-16T16:47:04.637 INFO:tasks.workunit.client.0.smithi122.stdout:expected = image25 2024-09-16T16:47:04.637 INFO:tasks.workunit.client.0.smithi122.stdout:expected = image26 2024-09-16T16:47:05.326 INFO:tasks.workunit.client.0.smithi122.stdout:100.00% done 2024-09-16T16:47:05.326 INFO:tasks.workunit.client.0.smithi122.stdout:num images is: 3 2024-09-16T16:47:05.326 INFO:tasks.workunit.client.0.smithi122.stdout:expected: 3 2024-09-16T16:47:05.327 INFO:tasks.workunit.client.0.smithi122.stdout:image: image25 2024-09-16T16:47:05.327 INFO:tasks.workunit.client.0.smithi122.stdout:image: image26 2024-09-16T16:47:05.327 INFO:tasks.workunit.client.0.smithi122.stdout:image: image27 2024-09-16T16:47:05.327 INFO:tasks.workunit.client.0.smithi122.stdout:expected = image25 2024-09-16T16:47:05.327 INFO:tasks.workunit.client.0.smithi122.stdout:expected = image26 2024-09-16T16:47:05.327 INFO:tasks.workunit.client.0.smithi122.stdout:expected = image27 2024-09-16T16:47:05.970 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.TestCopyPP (9329 ms) 2024-09-16T16:47:05.970 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.TestDeepCopy 2024-09-16T16:47:07.229 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:47:21.049 INFO:tasks.workunit.client.0.smithi122.stdout:image: image28 2024-09-16T16:47:21.049 INFO:tasks.workunit.client.0.smithi122.stdout:expected = image28 2024-09-16T16:47:21.049 INFO:tasks.workunit.client.0.smithi122.stdout:found image28 2024-09-16T16:47:21.049 INFO:tasks.workunit.client.0.smithi122.stdout:erased image28 2024-09-16T16:47:21.049 INFO:tasks.workunit.client.0.smithi122.stdout:image: image28 2024-09-16T16:47:21.049 INFO:tasks.workunit.client.0.smithi122.stdout:image: image29 2024-09-16T16:47:21.049 INFO:tasks.workunit.client.0.smithi122.stdout:expected = image28 2024-09-16T16:47:21.049 INFO:tasks.workunit.client.0.smithi122.stdout:found image28 2024-09-16T16:47:21.049 INFO:tasks.workunit.client.0.smithi122.stdout:erased image28 2024-09-16T16:47:21.049 INFO:tasks.workunit.client.0.smithi122.stdout:expected = image29 2024-09-16T16:47:21.050 INFO:tasks.workunit.client.0.smithi122.stdout:found image29 2024-09-16T16:47:21.050 INFO:tasks.workunit.client.0.smithi122.stdout:erased image29 2024-09-16T16:47:21.050 INFO:tasks.workunit.client.0.smithi122.stdout:100.00% done 2024-09-16T16:47:21.050 INFO:tasks.workunit.client.0.smithi122.stdout:image: image28 2024-09-16T16:47:21.050 INFO:tasks.workunit.client.0.smithi122.stdout:image: image29 2024-09-16T16:47:21.050 INFO:tasks.workunit.client.0.smithi122.stdout:image: image30 2024-09-16T16:47:21.050 INFO:tasks.workunit.client.0.smithi122.stdout:expected = image28 2024-09-16T16:47:21.050 INFO:tasks.workunit.client.0.smithi122.stdout:found image28 2024-09-16T16:47:21.050 INFO:tasks.workunit.client.0.smithi122.stdout:erased image28 2024-09-16T16:47:21.050 INFO:tasks.workunit.client.0.smithi122.stdout:expected = image29 2024-09-16T16:47:21.050 INFO:tasks.workunit.client.0.smithi122.stdout:found image29 2024-09-16T16:47:21.050 INFO:tasks.workunit.client.0.smithi122.stdout:erased image29 2024-09-16T16:47:21.050 INFO:tasks.workunit.client.0.smithi122.stdout:expected = image30 2024-09-16T16:47:21.051 INFO:tasks.workunit.client.0.smithi122.stdout:found image30 2024-09-16T16:47:21.051 INFO:tasks.workunit.client.0.smithi122.stdout:erased image30 2024-09-16T16:47:21.051 INFO:tasks.workunit.client.0.smithi122.stdout:image: image28 2024-09-16T16:47:21.051 INFO:tasks.workunit.client.0.smithi122.stdout:image: image29 2024-09-16T16:47:21.051 INFO:tasks.workunit.client.0.smithi122.stdout:image: image30 2024-09-16T16:47:21.051 INFO:tasks.workunit.client.0.smithi122.stdout:image: image31 2024-09-16T16:47:21.051 INFO:tasks.workunit.client.0.smithi122.stdout:expected = image28 2024-09-16T16:47:21.051 INFO:tasks.workunit.client.0.smithi122.stdout:found image28 2024-09-16T16:47:21.051 INFO:tasks.workunit.client.0.smithi122.stdout:erased image28 2024-09-16T16:47:21.051 INFO:tasks.workunit.client.0.smithi122.stdout:expected = image29 2024-09-16T16:47:21.052 INFO:tasks.workunit.client.0.smithi122.stdout:found image29 2024-09-16T16:47:21.052 INFO:tasks.workunit.client.0.smithi122.stdout:erased image29 2024-09-16T16:47:21.052 INFO:tasks.workunit.client.0.smithi122.stdout:expected = image30 2024-09-16T16:47:21.052 INFO:tasks.workunit.client.0.smithi122.stdout:found image30 2024-09-16T16:47:21.052 INFO:tasks.workunit.client.0.smithi122.stdout:erased image30 2024-09-16T16:47:21.052 INFO:tasks.workunit.client.0.smithi122.stdout:expected = image31 2024-09-16T16:47:21.053 INFO:tasks.workunit.client.0.smithi122.stdout:found image31 2024-09-16T16:47:21.053 INFO:tasks.workunit.client.0.smithi122.stdout:erased image31 2024-09-16T16:47:21.053 INFO:tasks.workunit.client.0.smithi122.stdout:image: image28 2024-09-16T16:47:21.053 INFO:tasks.workunit.client.0.smithi122.stdout:image: image29 2024-09-16T16:47:21.053 INFO:tasks.workunit.client.0.smithi122.stdout:image: image30 2024-09-16T16:47:21.053 INFO:tasks.workunit.client.0.smithi122.stdout:image: image31 2024-09-16T16:47:21.053 INFO:tasks.workunit.client.0.smithi122.stdout:image: image32 2024-09-16T16:47:21.053 INFO:tasks.workunit.client.0.smithi122.stdout:expected = image28 2024-09-16T16:47:21.053 INFO:tasks.workunit.client.0.smithi122.stdout:found image28 2024-09-16T16:47:21.053 INFO:tasks.workunit.client.0.smithi122.stdout:erased image28 2024-09-16T16:47:21.053 INFO:tasks.workunit.client.0.smithi122.stdout:expected = image29 2024-09-16T16:47:21.053 INFO:tasks.workunit.client.0.smithi122.stdout:found image29 2024-09-16T16:47:21.053 INFO:tasks.workunit.client.0.smithi122.stdout:erased image29 2024-09-16T16:47:21.054 INFO:tasks.workunit.client.0.smithi122.stdout:expected = image30 2024-09-16T16:47:21.054 INFO:tasks.workunit.client.0.smithi122.stdout:found image30 2024-09-16T16:47:21.054 INFO:tasks.workunit.client.0.smithi122.stdout:erased image30 2024-09-16T16:47:21.054 INFO:tasks.workunit.client.0.smithi122.stdout:expected = image31 2024-09-16T16:47:21.054 INFO:tasks.workunit.client.0.smithi122.stdout:found image31 2024-09-16T16:47:21.054 INFO:tasks.workunit.client.0.smithi122.stdout:erased image31 2024-09-16T16:47:21.054 INFO:tasks.workunit.client.0.smithi122.stdout:expected = image32 2024-09-16T16:47:21.054 INFO:tasks.workunit.client.0.smithi122.stdout:found image32 2024-09-16T16:47:21.054 INFO:tasks.workunit.client.0.smithi122.stdout:erased image32 2024-09-16T16:47:21.054 INFO:tasks.workunit.client.0.smithi122.stdout:100.00% done 2024-09-16T16:47:21.054 INFO:tasks.workunit.client.0.smithi122.stdout:image: image28 2024-09-16T16:47:21.054 INFO:tasks.workunit.client.0.smithi122.stdout:image: image29 2024-09-16T16:47:21.054 INFO:tasks.workunit.client.0.smithi122.stdout:image: image30 2024-09-16T16:47:21.054 INFO:tasks.workunit.client.0.smithi122.stdout:image: image31 2024-09-16T16:47:21.054 INFO:tasks.workunit.client.0.smithi122.stdout:image: image32 2024-09-16T16:47:21.055 INFO:tasks.workunit.client.0.smithi122.stdout:image: image33 2024-09-16T16:47:21.055 INFO:tasks.workunit.client.0.smithi122.stdout:expected = image28 2024-09-16T16:47:21.055 INFO:tasks.workunit.client.0.smithi122.stdout:found image28 2024-09-16T16:47:21.055 INFO:tasks.workunit.client.0.smithi122.stdout:erased image28 2024-09-16T16:47:21.055 INFO:tasks.workunit.client.0.smithi122.stdout:expected = image29 2024-09-16T16:47:21.055 INFO:tasks.workunit.client.0.smithi122.stdout:found image29 2024-09-16T16:47:21.055 INFO:tasks.workunit.client.0.smithi122.stdout:erased image29 2024-09-16T16:47:21.055 INFO:tasks.workunit.client.0.smithi122.stdout:expected = image30 2024-09-16T16:47:21.055 INFO:tasks.workunit.client.0.smithi122.stdout:found image30 2024-09-16T16:47:21.055 INFO:tasks.workunit.client.0.smithi122.stdout:erased image30 2024-09-16T16:47:21.055 INFO:tasks.workunit.client.0.smithi122.stdout:expected = image31 2024-09-16T16:47:21.055 INFO:tasks.workunit.client.0.smithi122.stdout:found image31 2024-09-16T16:47:21.055 INFO:tasks.workunit.client.0.smithi122.stdout:erased image31 2024-09-16T16:47:21.055 INFO:tasks.workunit.client.0.smithi122.stdout:expected = image32 2024-09-16T16:47:21.055 INFO:tasks.workunit.client.0.smithi122.stdout:found image32 2024-09-16T16:47:21.056 INFO:tasks.workunit.client.0.smithi122.stdout:erased image32 2024-09-16T16:47:21.056 INFO:tasks.workunit.client.0.smithi122.stdout:expected = image33 2024-09-16T16:47:21.056 INFO:tasks.workunit.client.0.smithi122.stdout:found image33 2024-09-16T16:47:21.056 INFO:tasks.workunit.client.0.smithi122.stdout:erased image33 2024-09-16T16:47:21.056 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.TestDeepCopy (15079 ms) 2024-09-16T16:47:21.056 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.TestDeepCopyPP 2024-09-16T16:47:23.074 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:47:29.176 INFO:tasks.workunit.client.0.smithi122.stdout:num images is: 1 2024-09-16T16:47:29.176 INFO:tasks.workunit.client.0.smithi122.stdout:expected: 1 2024-09-16T16:47:29.176 INFO:tasks.workunit.client.0.smithi122.stdout:image: image34 2024-09-16T16:47:29.176 INFO:tasks.workunit.client.0.smithi122.stdout:expected = image34 2024-09-16T16:47:29.536 INFO:tasks.workunit.client.0.smithi122.stdout:num images is: 2 2024-09-16T16:47:29.537 INFO:tasks.workunit.client.0.smithi122.stdout:expected: 2 2024-09-16T16:47:29.537 INFO:tasks.workunit.client.0.smithi122.stdout:image: image34 2024-09-16T16:47:29.537 INFO:tasks.workunit.client.0.smithi122.stdout:image: image35 2024-09-16T16:47:29.537 INFO:tasks.workunit.client.0.smithi122.stdout:expected = image34 2024-09-16T16:47:29.537 INFO:tasks.workunit.client.0.smithi122.stdout:expected = image35 2024-09-16T16:47:30.396 INFO:tasks.workunit.client.0.smithi122.stdout:100.00% done 2024-09-16T16:47:30.396 INFO:tasks.workunit.client.0.smithi122.stdout:num images is: 3 2024-09-16T16:47:30.396 INFO:tasks.workunit.client.0.smithi122.stdout:expected: 3 2024-09-16T16:47:30.396 INFO:tasks.workunit.client.0.smithi122.stdout:image: image34 2024-09-16T16:47:30.396 INFO:tasks.workunit.client.0.smithi122.stdout:image: image35 2024-09-16T16:47:30.396 INFO:tasks.workunit.client.0.smithi122.stdout:image: image36 2024-09-16T16:47:30.396 INFO:tasks.workunit.client.0.smithi122.stdout:expected = image34 2024-09-16T16:47:30.396 INFO:tasks.workunit.client.0.smithi122.stdout:expected = image35 2024-09-16T16:47:30.397 INFO:tasks.workunit.client.0.smithi122.stdout:expected = image36 2024-09-16T16:47:31.023 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.TestDeepCopyPP (9974 ms) 2024-09-16T16:47:31.023 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.TestCreateLsDeleteSnap 2024-09-16T16:47:31.023 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:47:35.347 INFO:tasks.workunit.client.0.smithi122.stdout:num snaps is: 1 2024-09-16T16:47:35.347 INFO:tasks.workunit.client.0.smithi122.stdout:expected: 1 2024-09-16T16:47:35.348 INFO:tasks.workunit.client.0.smithi122.stdout:snap: snap1 2024-09-16T16:47:35.348 INFO:tasks.workunit.client.0.smithi122.stdout:found snap1 with size 2097152 2024-09-16T16:47:35.348 INFO:tasks.workunit.client.0.smithi122.stdout:num snaps is: 2 2024-09-16T16:47:35.348 INFO:tasks.workunit.client.0.smithi122.stdout:expected: 2 2024-09-16T16:47:35.348 INFO:tasks.workunit.client.0.smithi122.stdout:snap: snap1 2024-09-16T16:47:35.348 INFO:tasks.workunit.client.0.smithi122.stdout:snap: snap2 2024-09-16T16:47:35.348 INFO:tasks.workunit.client.0.smithi122.stdout:found snap1 with size 2097152 2024-09-16T16:47:35.348 INFO:tasks.workunit.client.0.smithi122.stdout:found snap2 with size 4194304 2024-09-16T16:47:35.348 INFO:tasks.workunit.client.0.smithi122.stdout:num snaps is: 1 2024-09-16T16:47:35.348 INFO:tasks.workunit.client.0.smithi122.stdout:expected: 1 2024-09-16T16:47:35.348 INFO:tasks.workunit.client.0.smithi122.stdout:snap: snap2 2024-09-16T16:47:35.348 INFO:tasks.workunit.client.0.smithi122.stdout:found snap2 with size 4194304 2024-09-16T16:47:35.349 INFO:tasks.workunit.client.0.smithi122.stdout:num snaps is: 0 2024-09-16T16:47:35.349 INFO:tasks.workunit.client.0.smithi122.stdout:expected: 0 2024-09-16T16:47:35.349 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.TestCreateLsDeleteSnap (4325 ms) 2024-09-16T16:47:35.349 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.TestGetSnapShotTimeStamp 2024-09-16T16:47:35.349 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:47:37.406 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.TestGetSnapShotTimeStamp (2059 ms) 2024-09-16T16:47:37.407 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.TestCreateLsDeleteSnapPP 2024-09-16T16:47:37.407 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:47:38.360 INFO:tasks.workunit.client.0.smithi122.stdout:num snaps is: 1 2024-09-16T16:47:38.360 INFO:tasks.workunit.client.0.smithi122.stdout:expected: 1 2024-09-16T16:47:38.360 INFO:tasks.workunit.client.0.smithi122.stdout:snap: snap1 2024-09-16T16:47:38.360 INFO:tasks.workunit.client.0.smithi122.stdout:found snap1 with size 2097152 2024-09-16T16:47:39.350 INFO:tasks.workunit.client.0.smithi122.stdout:num snaps is: 2 2024-09-16T16:47:39.350 INFO:tasks.workunit.client.0.smithi122.stdout:expected: 2 2024-09-16T16:47:39.350 INFO:tasks.workunit.client.0.smithi122.stdout:snap: snap1 2024-09-16T16:47:39.350 INFO:tasks.workunit.client.0.smithi122.stdout:snap: snap2 2024-09-16T16:47:39.350 INFO:tasks.workunit.client.0.smithi122.stdout:found snap1 with size 2097152 2024-09-16T16:47:39.350 INFO:tasks.workunit.client.0.smithi122.stdout:found snap2 with size 4194304 2024-09-16T16:47:40.324 INFO:tasks.workunit.client.0.smithi122.stdout:num snaps is: 1 2024-09-16T16:47:40.324 INFO:tasks.workunit.client.0.smithi122.stdout:expected: 1 2024-09-16T16:47:40.324 INFO:tasks.workunit.client.0.smithi122.stdout:snap: snap2 2024-09-16T16:47:40.324 INFO:tasks.workunit.client.0.smithi122.stdout:found snap2 with size 4194304 2024-09-16T16:47:41.315 INFO:tasks.workunit.client.0.smithi122.stdout:num snaps is: 0 2024-09-16T16:47:41.315 INFO:tasks.workunit.client.0.smithi122.stdout:expected: 0 2024-09-16T16:47:41.362 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.TestCreateLsDeleteSnapPP (3956 ms) 2024-09-16T16:47:41.363 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.TestGetNameIdSnapPP 2024-09-16T16:47:41.363 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:47:47.359 INFO:tasks.workunit.client.0.smithi122.stdout:num snaps is: 0 2024-09-16T16:47:47.359 INFO:tasks.workunit.client.0.smithi122.stdout:expected: 0 2024-09-16T16:47:47.418 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.TestGetNameIdSnapPP (6055 ms) 2024-09-16T16:47:47.418 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.TestCreateLsRenameSnapPP 2024-09-16T16:47:47.418 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:47:48.410 INFO:tasks.workunit.client.0.smithi122.stdout:num snaps is: 1 2024-09-16T16:47:48.410 INFO:tasks.workunit.client.0.smithi122.stdout:expected: 1 2024-09-16T16:47:48.410 INFO:tasks.workunit.client.0.smithi122.stdout:snap: snap1 2024-09-16T16:47:48.410 INFO:tasks.workunit.client.0.smithi122.stdout:found snap1 with size 2097152 2024-09-16T16:47:49.438 INFO:tasks.workunit.client.0.smithi122.stdout:num snaps is: 2 2024-09-16T16:47:49.438 INFO:tasks.workunit.client.0.smithi122.stdout:expected: 2 2024-09-16T16:47:49.438 INFO:tasks.workunit.client.0.smithi122.stdout:snap: snap1 2024-09-16T16:47:49.438 INFO:tasks.workunit.client.0.smithi122.stdout:snap: snap2 2024-09-16T16:47:49.438 INFO:tasks.workunit.client.0.smithi122.stdout:found snap1 with size 2097152 2024-09-16T16:47:49.438 INFO:tasks.workunit.client.0.smithi122.stdout:found snap2 with size 4194304 2024-09-16T16:47:49.537 INFO:tasks.workunit.client.0.smithi122.stdout:num snaps is: 2 2024-09-16T16:47:49.538 INFO:tasks.workunit.client.0.smithi122.stdout:expected: 2 2024-09-16T16:47:49.538 INFO:tasks.workunit.client.0.smithi122.stdout:snap: snap1-rename 2024-09-16T16:47:49.538 INFO:tasks.workunit.client.0.smithi122.stdout:snap: snap2 2024-09-16T16:47:49.538 INFO:tasks.workunit.client.0.smithi122.stdout:found snap1-rename with size 2097152 2024-09-16T16:47:49.538 INFO:tasks.workunit.client.0.smithi122.stdout:found snap2 with size 4194304 2024-09-16T16:47:50.481 INFO:tasks.workunit.client.0.smithi122.stdout:num snaps is: 1 2024-09-16T16:47:50.481 INFO:tasks.workunit.client.0.smithi122.stdout:expected: 1 2024-09-16T16:47:50.481 INFO:tasks.workunit.client.0.smithi122.stdout:snap: snap2-rename 2024-09-16T16:47:50.481 INFO:tasks.workunit.client.0.smithi122.stdout:found snap2-rename with size 4194304 2024-09-16T16:47:51.383 INFO:tasks.workunit.client.0.smithi122.stdout:num snaps is: 0 2024-09-16T16:47:51.383 INFO:tasks.workunit.client.0.smithi122.stdout:expected: 0 2024-09-16T16:47:51.428 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.TestCreateLsRenameSnapPP (4009 ms) 2024-09-16T16:47:51.428 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.ConcurrentCreatesUnvalidatedPool 2024-09-16T16:47:53.055 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:47:53.055 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:47:53.055 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:47:53.055 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:47:58.533 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.ConcurrentCreatesUnvalidatedPool (7105 ms) 2024-09-16T16:47:58.533 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.RemoveFullTry 2024-09-16T16:48:03.467 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:48:39.869 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.RemoveFullTry (41336 ms) 2024-09-16T16:48:39.870 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.RemoveFullTryDataPool 2024-09-16T16:48:46.363 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:49:10.080 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:49:11.372 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:49:12.451 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:49:13.535 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:49:14.463 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.RemoveFullTryDataPool (34595 ms) 2024-09-16T16:49:14.464 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.RemoveFullTryNamespace 2024-09-16T16:49:16.810 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:49:39.220 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.RemoveFullTryNamespace (24756 ms) 2024-09-16T16:49:39.220 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.RemoveFullTryNamespaceDataPool 2024-09-16T16:49:43.786 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:50:09.079 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:50:10.543 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:50:11.645 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:50:12.733 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:50:13.811 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:50:14.629 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.RemoveFullTryNamespaceDataPool (35410 ms) 2024-09-16T16:50:14.630 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.TestIO 2024-09-16T16:50:14.630 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:50:44.274 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 512 2024-09-16T16:50:44.274 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 512 2024-09-16T16:50:44.274 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 512 2024-09-16T16:50:44.274 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 512 2024-09-16T16:50:44.274 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 512 2024-09-16T16:50:44.274 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:50:44.275 INFO:tasks.workunit.client.0.smithi122.stdout:started write 2024-09-16T16:50:44.275 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:50:44.275 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:50:44.275 INFO:tasks.workunit.client.0.smithi122.stdout:finished write 2024-09-16T16:50:44.275 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:50:44.275 INFO:tasks.workunit.client.0.smithi122.stdout:started write 2024-09-16T16:50:44.275 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:50:44.275 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:50:44.275 INFO:tasks.workunit.client.0.smithi122.stdout:finished write 2024-09-16T16:50:44.275 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:50:44.275 INFO:tasks.workunit.client.0.smithi122.stdout:started write 2024-09-16T16:50:44.275 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:50:44.275 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:50:44.275 INFO:tasks.workunit.client.0.smithi122.stdout:finished write 2024-09-16T16:50:44.276 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:50:44.276 INFO:tasks.workunit.client.0.smithi122.stdout:started write 2024-09-16T16:50:44.276 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:50:44.276 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:50:44.276 INFO:tasks.workunit.client.0.smithi122.stdout:finished write 2024-09-16T16:50:44.276 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:50:44.276 INFO:tasks.workunit.client.0.smithi122.stdout:started write 2024-09-16T16:50:44.276 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:50:44.276 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:50:44.276 INFO:tasks.workunit.client.0.smithi122.stdout:finished write 2024-09-16T16:50:44.276 INFO:tasks.workunit.client.0.smithi122.stdout:start compare and write 2024-09-16T16:50:44.276 INFO:tasks.workunit.client.0.smithi122.stdout:compare and wrote: 512 2024-09-16T16:50:44.277 INFO:tasks.workunit.client.0.smithi122.stdout:start compare and write 2024-09-16T16:50:44.277 INFO:tasks.workunit.client.0.smithi122.stdout:compare and wrote: 512 2024-09-16T16:50:44.277 INFO:tasks.workunit.client.0.smithi122.stdout:start compare and write 2024-09-16T16:50:44.277 INFO:tasks.workunit.client.0.smithi122.stdout:compare and wrote: 512 2024-09-16T16:50:44.277 INFO:tasks.workunit.client.0.smithi122.stdout:start compare and write 2024-09-16T16:50:44.277 INFO:tasks.workunit.client.0.smithi122.stdout:compare and wrote: 512 2024-09-16T16:50:44.277 INFO:tasks.workunit.client.0.smithi122.stdout:start compare and write 2024-09-16T16:50:44.277 INFO:tasks.workunit.client.0.smithi122.stdout:compare and wrote: 512 2024-09-16T16:50:44.277 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:50:44.277 INFO:tasks.workunit.client.0.smithi122.stdout:started aio compare and write 2024-09-16T16:50:44.277 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:50:44.277 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:50:44.277 INFO:tasks.workunit.client.0.smithi122.stdout:finished aio compare and write 2024-09-16T16:50:44.278 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:50:44.278 INFO:tasks.workunit.client.0.smithi122.stdout:started aio compare and write 2024-09-16T16:50:44.278 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:50:44.278 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:50:44.278 INFO:tasks.workunit.client.0.smithi122.stdout:finished aio compare and write 2024-09-16T16:50:44.278 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:50:44.278 INFO:tasks.workunit.client.0.smithi122.stdout:started aio compare and write 2024-09-16T16:50:44.278 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:50:44.278 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:50:44.278 INFO:tasks.workunit.client.0.smithi122.stdout:finished aio compare and write 2024-09-16T16:50:44.278 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:50:44.278 INFO:tasks.workunit.client.0.smithi122.stdout:started aio compare and write 2024-09-16T16:50:44.278 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:50:44.278 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:50:44.278 INFO:tasks.workunit.client.0.smithi122.stdout:finished aio compare and write 2024-09-16T16:50:44.279 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:50:44.279 INFO:tasks.workunit.client.0.smithi122.stdout:started aio compare and write 2024-09-16T16:50:44.279 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:50:44.279 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:50:44.279 INFO:tasks.workunit.client.0.smithi122.stdout:finished aio compare and write 2024-09-16T16:50:44.279 INFO:tasks.workunit.client.0.smithi122.stdout:read: 512 2024-09-16T16:50:44.279 INFO:tasks.workunit.client.0.smithi122.stdout:read: 512 2024-09-16T16:50:44.279 INFO:tasks.workunit.client.0.smithi122.stdout:read: 512 2024-09-16T16:50:44.279 INFO:tasks.workunit.client.0.smithi122.stdout:read: 512 2024-09-16T16:50:44.279 INFO:tasks.workunit.client.0.smithi122.stdout:read: 512 2024-09-16T16:50:44.279 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:50:44.279 INFO:tasks.workunit.client.0.smithi122.stdout:started read 2024-09-16T16:50:44.279 INFO:tasks.workunit.client.0.smithi122.stdout:read completion cb called! 2024-09-16T16:50:44.280 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 512 2024-09-16T16:50:44.280 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:50:44.280 INFO:tasks.workunit.client.0.smithi122.stdout:started read 2024-09-16T16:50:44.280 INFO:tasks.workunit.client.0.smithi122.stdout:read completion cb called! 2024-09-16T16:50:44.280 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 512 2024-09-16T16:50:44.280 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:50:44.280 INFO:tasks.workunit.client.0.smithi122.stdout:started read 2024-09-16T16:50:44.280 INFO:tasks.workunit.client.0.smithi122.stdout:read completion cb called! 2024-09-16T16:50:44.280 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 512 2024-09-16T16:50:44.280 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:50:44.280 INFO:tasks.workunit.client.0.smithi122.stdout:started read 2024-09-16T16:50:44.280 INFO:tasks.workunit.client.0.smithi122.stdout:read completion cb called! 2024-09-16T16:50:44.280 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 512 2024-09-16T16:50:44.280 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:50:44.280 INFO:tasks.workunit.client.0.smithi122.stdout:started read 2024-09-16T16:50:44.281 INFO:tasks.workunit.client.0.smithi122.stdout:read completion cb called! 2024-09-16T16:50:44.281 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 512 2024-09-16T16:50:44.281 INFO:tasks.workunit.client.0.smithi122.stdout:discard: 512~512 = 512 2024-09-16T16:50:44.281 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:50:44.281 INFO:tasks.workunit.client.0.smithi122.stdout:aio discard: 1536~512 = 0 2024-09-16T16:50:44.281 INFO:tasks.workunit.client.0.smithi122.stdout:read: 512 2024-09-16T16:50:44.281 INFO:tasks.workunit.client.0.smithi122.stdout:read: 512 2024-09-16T16:50:44.281 INFO:tasks.workunit.client.0.smithi122.stdout:read: 512 2024-09-16T16:50:44.281 INFO:tasks.workunit.client.0.smithi122.stdout:read: 512 2024-09-16T16:50:44.282 INFO:tasks.workunit.client.0.smithi122.stdout:read: 512 2024-09-16T16:50:44.282 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 0 2024-09-16T16:50:44.282 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:50:44.282 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:50:44.282 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 0 2024-09-16T16:50:44.282 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:50:44.282 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:50:44.282 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 16384 2024-09-16T16:50:44.282 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:50:44.282 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:50:44.282 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 16384 2024-09-16T16:50:44.282 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:50:44.282 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:50:44.282 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:50:44.282 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:50:44.283 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 49152 2024-09-16T16:50:44.283 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:50:44.283 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:50:44.283 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 49152 2024-09-16T16:50:44.283 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:50:44.283 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:50:44.283 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 65536 2024-09-16T16:50:44.283 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:50:44.283 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:50:44.283 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 65536 2024-09-16T16:50:44.283 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:50:44.283 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:50:44.283 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:50:44.283 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:50:44.284 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 98304 2024-09-16T16:50:44.284 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:50:44.284 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:50:44.284 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 98304 2024-09-16T16:50:44.284 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:50:44.284 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:50:44.284 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 114688 2024-09-16T16:50:44.284 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:50:44.284 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:50:44.284 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 114688 2024-09-16T16:50:44.284 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:50:44.284 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:50:44.284 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:50:44.284 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:50:44.285 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 147456 2024-09-16T16:50:44.285 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:50:44.285 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:50:44.285 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 147456 2024-09-16T16:50:44.285 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:50:44.285 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:50:44.285 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 163840 2024-09-16T16:50:44.285 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:50:44.285 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:50:44.285 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 163840 2024-09-16T16:50:44.285 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:50:44.285 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:50:44.285 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:50:44.285 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:50:44.286 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 196608 2024-09-16T16:50:44.286 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:50:44.286 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:50:44.286 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 196608 2024-09-16T16:50:44.286 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:50:44.286 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:50:44.286 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 212992 2024-09-16T16:50:44.286 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:50:44.286 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:50:44.286 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 212992 2024-09-16T16:50:44.286 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:50:44.286 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:50:44.286 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:50:44.286 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:50:44.287 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:50:44.287 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:50:44.287 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:50:44.287 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:50:44.287 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:50:44.287 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:50:44.287 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:50:44.287 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:50:44.287 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:50:44.287 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:50:44.287 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:50:44.287 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:50:44.287 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:50:44.287 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:50:44.287 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:50:44.288 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:50:44.288 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:50:44.288 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:50:44.288 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:50:44.288 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:50:44.288 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:50:44.288 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:50:44.288 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:50:44.288 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:50:44.288 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:50:44.288 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:50:44.288 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:50:44.288 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:50:44.289 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:50:44.289 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:50:44.289 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:50:44.289 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:50:44.289 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:50:44.289 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:50:44.289 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:50:44.289 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:50:44.289 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:50:44.289 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:50:44.289 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:50:44.289 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:50:44.289 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:50:44.290 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:50:44.290 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:50:44.290 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:50:44.290 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:50:44.290 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:50:44.290 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:50:44.290 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:50:44.290 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:51:09.272 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:51:09.273 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:51:09.273 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:51:09.273 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:51:09.273 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:51:09.273 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:51:09.273 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:51:09.273 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:51:09.273 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:51:09.273 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:51:09.273 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:51:09.273 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:51:09.273 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:51:09.274 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:51:09.274 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:51:09.274 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:51:09.274 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:51:09.274 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:51:09.274 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:51:09.274 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:51:09.274 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:51:09.274 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:51:09.274 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:51:09.274 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:51:09.274 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:51:09.274 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:51:09.274 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:51:09.274 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:51:09.275 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:51:09.275 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:51:09.275 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:51:09.275 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:51:09.275 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:51:09.275 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:51:09.275 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:51:09.275 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:51:09.275 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:51:09.275 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:51:09.275 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:51:09.275 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:51:09.275 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:51:09.275 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:51:09.275 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:51:09.276 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:51:09.276 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:51:09.276 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:51:09.276 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:51:09.276 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:51:09.276 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:51:09.276 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:51:09.276 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:51:09.276 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:51:09.276 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:51:09.276 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:51:09.276 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:51:09.276 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:51:09.276 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:51:09.277 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:51:09.277 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:51:09.277 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:51:09.277 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:51:09.277 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:51:09.277 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:51:09.277 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:51:09.277 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:51:09.277 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:51:09.277 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:51:09.277 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:51:09.277 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:51:09.277 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:51:09.277 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:51:09.278 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:51:09.278 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:51:09.278 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:51:09.278 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:51:09.278 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:51:09.278 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:51:09.278 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:51:09.278 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:51:09.278 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:51:09.278 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:51:09.278 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:51:09.278 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:51:09.278 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:51:09.278 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:51:09.278 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:51:09.279 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:51:09.279 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:51:09.279 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:51:09.279 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:51:09.279 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:51:09.279 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:51:09.279 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:51:09.279 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:51:09.279 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:51:09.279 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:51:09.279 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:51:09.279 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:51:09.279 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:51:09.279 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:51:09.279 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:51:09.280 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:51:09.280 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:51:09.280 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:51:09.280 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:51:09.280 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:51:09.280 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:51:09.280 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:51:09.280 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:51:09.280 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:51:09.280 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:51:09.280 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:51:09.280 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:51:09.280 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:51:09.280 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:51:09.281 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:51:09.281 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:51:09.281 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:51:09.281 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:51:09.281 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:51:09.281 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:51:09.281 INFO:tasks.workunit.client.0.smithi122.stdout:read completion cb called! 2024-09-16T16:51:09.281 INFO:tasks.workunit.client.0.smithi122.stdout:read completion cb called! 2024-09-16T16:51:09.281 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 512 2024-09-16T16:51:09.281 INFO:tasks.workunit.client.0.smithi122.stdout:read completion cb called! 2024-09-16T16:51:09.281 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.TestIO (54642 ms) 2024-09-16T16:51:09.281 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.TestEncryptionLUKS1 2024-09-16T16:51:09.281 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:51:43.336 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 512 2024-09-16T16:51:43.336 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 512 2024-09-16T16:51:43.336 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 512 2024-09-16T16:51:43.336 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 512 2024-09-16T16:51:43.336 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 512 2024-09-16T16:51:43.336 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:51:43.336 INFO:tasks.workunit.client.0.smithi122.stdout:started write 2024-09-16T16:51:43.337 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:51:43.337 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:51:43.337 INFO:tasks.workunit.client.0.smithi122.stdout:finished write 2024-09-16T16:51:43.337 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:51:43.337 INFO:tasks.workunit.client.0.smithi122.stdout:started write 2024-09-16T16:51:43.337 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:51:43.337 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:51:43.337 INFO:tasks.workunit.client.0.smithi122.stdout:finished write 2024-09-16T16:51:43.337 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:51:43.337 INFO:tasks.workunit.client.0.smithi122.stdout:started write 2024-09-16T16:51:43.337 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:51:43.337 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:51:43.337 INFO:tasks.workunit.client.0.smithi122.stdout:finished write 2024-09-16T16:51:43.338 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:51:43.338 INFO:tasks.workunit.client.0.smithi122.stdout:started write 2024-09-16T16:51:43.338 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:51:43.338 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:51:43.338 INFO:tasks.workunit.client.0.smithi122.stdout:finished write 2024-09-16T16:51:43.338 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:51:43.338 INFO:tasks.workunit.client.0.smithi122.stdout:started write 2024-09-16T16:51:43.338 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:51:43.338 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:51:43.338 INFO:tasks.workunit.client.0.smithi122.stdout:finished write 2024-09-16T16:51:43.338 INFO:tasks.workunit.client.0.smithi122.stdout:start compare and write 2024-09-16T16:51:43.339 INFO:tasks.workunit.client.0.smithi122.stdout:compare and wrote: 512 2024-09-16T16:51:43.339 INFO:tasks.workunit.client.0.smithi122.stdout:start compare and write 2024-09-16T16:51:43.339 INFO:tasks.workunit.client.0.smithi122.stdout:compare and wrote: 512 2024-09-16T16:51:43.339 INFO:tasks.workunit.client.0.smithi122.stdout:start compare and write 2024-09-16T16:51:43.339 INFO:tasks.workunit.client.0.smithi122.stdout:compare and wrote: 512 2024-09-16T16:51:43.339 INFO:tasks.workunit.client.0.smithi122.stdout:start compare and write 2024-09-16T16:51:43.339 INFO:tasks.workunit.client.0.smithi122.stdout:compare and wrote: 512 2024-09-16T16:51:43.339 INFO:tasks.workunit.client.0.smithi122.stdout:start compare and write 2024-09-16T16:51:43.339 INFO:tasks.workunit.client.0.smithi122.stdout:compare and wrote: 512 2024-09-16T16:51:43.339 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:51:43.339 INFO:tasks.workunit.client.0.smithi122.stdout:started aio compare and write 2024-09-16T16:51:43.339 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:51:43.339 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:51:43.339 INFO:tasks.workunit.client.0.smithi122.stdout:finished aio compare and write 2024-09-16T16:51:43.339 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:51:43.340 INFO:tasks.workunit.client.0.smithi122.stdout:started aio compare and write 2024-09-16T16:51:43.340 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:51:43.340 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:51:43.340 INFO:tasks.workunit.client.0.smithi122.stdout:finished aio compare and write 2024-09-16T16:51:43.340 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:51:43.340 INFO:tasks.workunit.client.0.smithi122.stdout:started aio compare and write 2024-09-16T16:51:43.340 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:51:43.340 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:51:43.340 INFO:tasks.workunit.client.0.smithi122.stdout:finished aio compare and write 2024-09-16T16:51:43.340 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:51:43.340 INFO:tasks.workunit.client.0.smithi122.stdout:started aio compare and write 2024-09-16T16:51:43.340 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:51:43.340 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:51:43.340 INFO:tasks.workunit.client.0.smithi122.stdout:finished aio compare and write 2024-09-16T16:51:43.340 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:51:43.341 INFO:tasks.workunit.client.0.smithi122.stdout:started aio compare and write 2024-09-16T16:51:43.341 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:51:43.341 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:51:43.341 INFO:tasks.workunit.client.0.smithi122.stdout:finished aio compare and write 2024-09-16T16:51:43.341 INFO:tasks.workunit.client.0.smithi122.stdout:read: 512 2024-09-16T16:51:43.341 INFO:tasks.workunit.client.0.smithi122.stdout:read: 512 2024-09-16T16:51:43.341 INFO:tasks.workunit.client.0.smithi122.stdout:read: 512 2024-09-16T16:51:43.341 INFO:tasks.workunit.client.0.smithi122.stdout:read: 512 2024-09-16T16:51:43.341 INFO:tasks.workunit.client.0.smithi122.stdout:read: 512 2024-09-16T16:51:43.341 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:51:43.341 INFO:tasks.workunit.client.0.smithi122.stdout:started read 2024-09-16T16:51:43.341 INFO:tasks.workunit.client.0.smithi122.stdout:read completion cb called! 2024-09-16T16:51:43.341 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 512 2024-09-16T16:51:43.341 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:51:43.341 INFO:tasks.workunit.client.0.smithi122.stdout:started read 2024-09-16T16:51:43.342 INFO:tasks.workunit.client.0.smithi122.stdout:read completion cb called! 2024-09-16T16:51:43.342 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 512 2024-09-16T16:51:43.342 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:51:43.342 INFO:tasks.workunit.client.0.smithi122.stdout:started read 2024-09-16T16:51:43.342 INFO:tasks.workunit.client.0.smithi122.stdout:read completion cb called! 2024-09-16T16:51:43.342 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 512 2024-09-16T16:51:43.342 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:51:43.342 INFO:tasks.workunit.client.0.smithi122.stdout:started read 2024-09-16T16:51:43.342 INFO:tasks.workunit.client.0.smithi122.stdout:read completion cb called! 2024-09-16T16:51:43.342 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 512 2024-09-16T16:51:43.342 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:51:43.342 INFO:tasks.workunit.client.0.smithi122.stdout:started read 2024-09-16T16:51:43.342 INFO:tasks.workunit.client.0.smithi122.stdout:read completion cb called! 2024-09-16T16:51:43.343 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 512 2024-09-16T16:51:43.343 INFO:tasks.workunit.client.0.smithi122.stdout:discard: 512~512 = 512 2024-09-16T16:51:43.343 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:51:43.343 INFO:tasks.workunit.client.0.smithi122.stdout:aio discard: 1536~512 = 0 2024-09-16T16:51:43.343 INFO:tasks.workunit.client.0.smithi122.stdout:read: 512 2024-09-16T16:51:43.343 INFO:tasks.workunit.client.0.smithi122.stdout:read: 512 2024-09-16T16:51:43.343 INFO:tasks.workunit.client.0.smithi122.stdout:read: 512 2024-09-16T16:51:43.343 INFO:tasks.workunit.client.0.smithi122.stdout:read: 512 2024-09-16T16:51:43.343 INFO:tasks.workunit.client.0.smithi122.stdout:read: 512 2024-09-16T16:51:43.343 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 0 2024-09-16T16:51:43.343 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:51:43.343 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:51:43.343 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 0 2024-09-16T16:51:43.343 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:51:43.343 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:51:43.343 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 16384 2024-09-16T16:51:43.344 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:51:43.344 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:51:43.344 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 16384 2024-09-16T16:51:43.344 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:51:43.344 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:51:43.344 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:51:43.344 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:51:43.344 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 49152 2024-09-16T16:51:43.344 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:51:43.344 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:51:43.344 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 49152 2024-09-16T16:51:43.344 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:51:43.344 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:51:43.344 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 65536 2024-09-16T16:51:43.344 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:51:43.344 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:51:43.345 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 65536 2024-09-16T16:51:43.345 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:51:43.345 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:51:43.345 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:51:43.345 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:51:43.345 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 98304 2024-09-16T16:51:43.345 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:51:43.345 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:51:43.345 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 98304 2024-09-16T16:51:43.345 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:51:43.345 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:51:43.345 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 114688 2024-09-16T16:51:43.345 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:51:43.345 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:51:43.345 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 114688 2024-09-16T16:51:43.346 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:51:43.346 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:51:43.346 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:51:43.346 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:51:43.346 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 147456 2024-09-16T16:51:43.346 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:51:43.346 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:51:43.346 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 147456 2024-09-16T16:51:43.346 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:51:43.346 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:51:43.347 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 163840 2024-09-16T16:51:43.347 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:51:43.347 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:51:43.347 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 163840 2024-09-16T16:51:43.347 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:51:43.347 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:51:43.347 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:51:43.347 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:51:43.347 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 196608 2024-09-16T16:51:43.347 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:51:43.347 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:51:43.347 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 196608 2024-09-16T16:51:43.347 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:51:43.347 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:51:43.347 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 212992 2024-09-16T16:51:43.347 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:51:43.348 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:51:43.348 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 212992 2024-09-16T16:51:43.348 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:51:43.348 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:51:43.348 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:51:43.348 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:51:43.348 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:51:43.348 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:51:43.348 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:51:43.348 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:51:43.348 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:51:43.348 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:51:43.348 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:51:43.348 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:51:43.349 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:51:43.349 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:51:43.349 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:51:43.349 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:51:43.349 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:51:43.349 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:51:43.349 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:51:43.349 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:51:43.349 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:51:43.349 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:51:43.349 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:51:43.349 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:51:43.349 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:51:43.349 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:51:43.349 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:51:43.350 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:51:43.350 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:51:43.350 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:51:43.350 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:51:43.350 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:51:43.350 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:51:43.350 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:51:43.350 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:51:43.350 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:51:43.350 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:51:43.351 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:51:43.351 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:51:43.351 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:51:43.351 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:51:43.351 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:51:43.351 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:51:43.351 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:51:43.351 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:51:43.351 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:51:43.351 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:51:43.351 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:51:43.351 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:51:43.351 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:51:43.351 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:51:43.351 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:51:43.352 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:52:14.068 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:52:14.068 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:52:14.068 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:52:14.068 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:52:14.068 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:52:14.068 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:52:14.068 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:52:14.068 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:52:14.068 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:52:14.068 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:52:14.069 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:52:14.069 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:52:14.069 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:52:14.069 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:52:14.069 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:52:14.069 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:52:14.069 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:52:14.069 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:52:14.069 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:52:14.069 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:52:14.069 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:52:14.069 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:52:14.069 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:52:14.069 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:52:14.069 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:52:14.070 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:52:14.070 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:52:14.070 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:52:14.070 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:52:14.070 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:52:14.070 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:52:14.070 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:52:14.070 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:52:14.070 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:52:14.070 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:52:14.070 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:52:14.070 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:52:14.070 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:52:14.070 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:52:14.070 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:52:14.071 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:52:14.071 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:52:14.071 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:52:14.071 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:52:14.071 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:52:14.071 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:52:14.071 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:52:14.071 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:52:14.071 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:52:14.071 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:52:14.071 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:52:14.071 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:52:14.071 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:52:14.071 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:52:14.072 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:52:14.072 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:52:14.072 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:52:14.072 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:52:14.072 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:52:14.072 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:52:14.072 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:52:14.072 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:52:14.072 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:52:14.072 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:52:14.072 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:52:14.072 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:52:14.072 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:52:14.072 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:52:14.072 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:52:14.073 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:52:14.073 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:52:14.073 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:52:14.073 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:52:14.073 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:52:14.073 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:52:14.073 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:52:14.073 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:52:14.073 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:52:14.073 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:52:14.073 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:52:14.073 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:52:14.073 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:52:14.073 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:52:14.073 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:52:14.074 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:52:14.074 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:52:14.074 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:52:14.074 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:52:14.074 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:52:14.074 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:52:14.074 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:52:14.074 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:52:14.074 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:52:14.074 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:52:14.074 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:52:14.074 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:52:14.074 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:52:14.074 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:52:14.074 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:52:14.074 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:52:14.075 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:52:14.075 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:52:14.075 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:52:14.075 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:52:14.075 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:52:14.075 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:52:14.075 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:52:14.075 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:52:14.075 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:52:14.075 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:52:14.075 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:52:14.075 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:52:14.075 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:52:14.075 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:52:14.075 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:52:14.076 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:52:14.076 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:52:14.076 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:52:14.076 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:52:14.076 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:52:14.076 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:52:14.076 INFO:tasks.workunit.client.0.smithi122.stdout:read completion cb called! 2024-09-16T16:52:14.076 INFO:tasks.workunit.client.0.smithi122.stdout:read completion cb called! 2024-09-16T16:52:14.076 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 512 2024-09-16T16:52:14.076 INFO:tasks.workunit.client.0.smithi122.stdout:read completion cb called! 2024-09-16T16:52:14.076 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 4 2024-09-16T16:52:14.076 INFO:tasks.workunit.client.0.smithi122.stdout:read: 4 2024-09-16T16:52:14.076 INFO:tasks.workunit.client.0.smithi122.stdout:read: 4 2024-09-16T16:52:14.076 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.TestEncryptionLUKS1 (64795 ms) 2024-09-16T16:52:14.077 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.TestEncryptionLUKS2 2024-09-16T16:52:14.077 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:52:49.856 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 512 2024-09-16T16:52:49.857 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 512 2024-09-16T16:52:49.857 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 512 2024-09-16T16:52:49.857 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 512 2024-09-16T16:52:49.857 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 512 2024-09-16T16:52:49.857 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:52:49.857 INFO:tasks.workunit.client.0.smithi122.stdout:started write 2024-09-16T16:52:49.857 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:52:49.857 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:52:49.857 INFO:tasks.workunit.client.0.smithi122.stdout:finished write 2024-09-16T16:52:49.857 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:52:49.857 INFO:tasks.workunit.client.0.smithi122.stdout:started write 2024-09-16T16:52:49.857 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:52:49.858 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:52:49.858 INFO:tasks.workunit.client.0.smithi122.stdout:finished write 2024-09-16T16:52:49.858 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:52:49.858 INFO:tasks.workunit.client.0.smithi122.stdout:started write 2024-09-16T16:52:49.858 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:52:49.858 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:52:49.858 INFO:tasks.workunit.client.0.smithi122.stdout:finished write 2024-09-16T16:52:49.858 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:52:49.858 INFO:tasks.workunit.client.0.smithi122.stdout:started write 2024-09-16T16:52:49.858 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:52:49.858 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:52:49.858 INFO:tasks.workunit.client.0.smithi122.stdout:finished write 2024-09-16T16:52:49.858 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:52:49.859 INFO:tasks.workunit.client.0.smithi122.stdout:started write 2024-09-16T16:52:49.859 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:52:49.859 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:52:49.859 INFO:tasks.workunit.client.0.smithi122.stdout:finished write 2024-09-16T16:52:49.859 INFO:tasks.workunit.client.0.smithi122.stdout:start compare and write 2024-09-16T16:52:49.859 INFO:tasks.workunit.client.0.smithi122.stdout:compare and wrote: 512 2024-09-16T16:52:49.859 INFO:tasks.workunit.client.0.smithi122.stdout:start compare and write 2024-09-16T16:52:49.859 INFO:tasks.workunit.client.0.smithi122.stdout:compare and wrote: 512 2024-09-16T16:52:49.859 INFO:tasks.workunit.client.0.smithi122.stdout:start compare and write 2024-09-16T16:52:49.859 INFO:tasks.workunit.client.0.smithi122.stdout:compare and wrote: 512 2024-09-16T16:52:49.859 INFO:tasks.workunit.client.0.smithi122.stdout:start compare and write 2024-09-16T16:52:49.859 INFO:tasks.workunit.client.0.smithi122.stdout:compare and wrote: 512 2024-09-16T16:52:49.859 INFO:tasks.workunit.client.0.smithi122.stdout:start compare and write 2024-09-16T16:52:49.859 INFO:tasks.workunit.client.0.smithi122.stdout:compare and wrote: 512 2024-09-16T16:52:49.860 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:52:49.860 INFO:tasks.workunit.client.0.smithi122.stdout:started aio compare and write 2024-09-16T16:52:49.860 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:52:49.860 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:52:49.860 INFO:tasks.workunit.client.0.smithi122.stdout:finished aio compare and write 2024-09-16T16:52:49.860 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:52:49.860 INFO:tasks.workunit.client.0.smithi122.stdout:started aio compare and write 2024-09-16T16:52:49.860 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:52:49.860 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:52:49.860 INFO:tasks.workunit.client.0.smithi122.stdout:finished aio compare and write 2024-09-16T16:52:49.860 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:52:49.861 INFO:tasks.workunit.client.0.smithi122.stdout:started aio compare and write 2024-09-16T16:52:49.861 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:52:49.861 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:52:49.861 INFO:tasks.workunit.client.0.smithi122.stdout:finished aio compare and write 2024-09-16T16:52:49.861 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:52:49.861 INFO:tasks.workunit.client.0.smithi122.stdout:started aio compare and write 2024-09-16T16:52:49.861 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:52:49.861 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:52:49.861 INFO:tasks.workunit.client.0.smithi122.stdout:finished aio compare and write 2024-09-16T16:52:49.861 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:52:49.861 INFO:tasks.workunit.client.0.smithi122.stdout:started aio compare and write 2024-09-16T16:52:49.861 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:52:49.862 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:52:49.862 INFO:tasks.workunit.client.0.smithi122.stdout:finished aio compare and write 2024-09-16T16:52:49.862 INFO:tasks.workunit.client.0.smithi122.stdout:read: 512 2024-09-16T16:52:49.862 INFO:tasks.workunit.client.0.smithi122.stdout:read: 512 2024-09-16T16:52:49.862 INFO:tasks.workunit.client.0.smithi122.stdout:read: 512 2024-09-16T16:52:49.862 INFO:tasks.workunit.client.0.smithi122.stdout:read: 512 2024-09-16T16:52:49.862 INFO:tasks.workunit.client.0.smithi122.stdout:read: 512 2024-09-16T16:52:49.862 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:52:49.862 INFO:tasks.workunit.client.0.smithi122.stdout:started read 2024-09-16T16:52:49.862 INFO:tasks.workunit.client.0.smithi122.stdout:read completion cb called! 2024-09-16T16:52:49.862 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 512 2024-09-16T16:52:49.863 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:52:49.863 INFO:tasks.workunit.client.0.smithi122.stdout:started read 2024-09-16T16:52:49.863 INFO:tasks.workunit.client.0.smithi122.stdout:read completion cb called! 2024-09-16T16:52:49.863 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 512 2024-09-16T16:52:49.863 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:52:49.863 INFO:tasks.workunit.client.0.smithi122.stdout:started read 2024-09-16T16:52:49.863 INFO:tasks.workunit.client.0.smithi122.stdout:read completion cb called! 2024-09-16T16:52:49.863 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 512 2024-09-16T16:52:49.863 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:52:49.863 INFO:tasks.workunit.client.0.smithi122.stdout:started read 2024-09-16T16:52:49.863 INFO:tasks.workunit.client.0.smithi122.stdout:read completion cb called! 2024-09-16T16:52:49.864 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 512 2024-09-16T16:52:49.864 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:52:49.864 INFO:tasks.workunit.client.0.smithi122.stdout:started read 2024-09-16T16:52:49.864 INFO:tasks.workunit.client.0.smithi122.stdout:read completion cb called! 2024-09-16T16:52:49.864 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 512 2024-09-16T16:52:49.864 INFO:tasks.workunit.client.0.smithi122.stdout:discard: 512~512 = 512 2024-09-16T16:52:49.864 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:52:49.864 INFO:tasks.workunit.client.0.smithi122.stdout:aio discard: 1536~512 = 0 2024-09-16T16:52:49.864 INFO:tasks.workunit.client.0.smithi122.stdout:read: 512 2024-09-16T16:52:49.864 INFO:tasks.workunit.client.0.smithi122.stdout:read: 512 2024-09-16T16:52:49.864 INFO:tasks.workunit.client.0.smithi122.stdout:read: 512 2024-09-16T16:52:49.864 INFO:tasks.workunit.client.0.smithi122.stdout:read: 512 2024-09-16T16:52:49.864 INFO:tasks.workunit.client.0.smithi122.stdout:read: 512 2024-09-16T16:52:49.865 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 0 2024-09-16T16:52:49.865 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:52:49.865 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:52:49.865 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 0 2024-09-16T16:52:49.865 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:52:49.865 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:52:49.865 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 16384 2024-09-16T16:52:49.865 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:52:49.865 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:52:49.865 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 16384 2024-09-16T16:52:49.865 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:52:49.865 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:52:49.865 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:52:49.866 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:52:49.866 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 49152 2024-09-16T16:52:49.866 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:52:49.866 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:52:49.866 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 49152 2024-09-16T16:52:49.866 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:52:49.866 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:52:49.866 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 65536 2024-09-16T16:52:49.866 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:52:49.866 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:52:49.866 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 65536 2024-09-16T16:52:49.866 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:52:49.866 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:52:49.866 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:52:49.867 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:52:49.867 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 98304 2024-09-16T16:52:49.867 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:52:49.867 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:52:49.867 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 98304 2024-09-16T16:52:49.867 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:52:49.867 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:52:49.867 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 114688 2024-09-16T16:52:49.867 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:52:49.867 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:52:49.867 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 114688 2024-09-16T16:52:49.867 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:52:49.867 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:52:49.868 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:52:49.868 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:52:49.868 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 147456 2024-09-16T16:52:49.868 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:52:49.868 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:52:49.868 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 147456 2024-09-16T16:52:49.868 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:52:49.868 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:52:49.868 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 163840 2024-09-16T16:52:49.868 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:52:49.868 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:52:49.868 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 163840 2024-09-16T16:52:49.868 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:52:49.868 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:52:49.869 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:52:49.869 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:52:49.869 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 196608 2024-09-16T16:52:49.869 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:52:49.869 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:52:49.869 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 196608 2024-09-16T16:52:49.870 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:52:49.870 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:52:49.870 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 212992 2024-09-16T16:52:49.870 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:52:49.870 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:52:49.870 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 212992 2024-09-16T16:52:49.870 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:52:49.870 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:52:49.870 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:52:49.870 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:52:49.870 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:52:49.870 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:52:49.870 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:52:49.871 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:52:49.871 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:52:49.871 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:52:49.871 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:52:49.871 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:52:49.871 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:52:49.871 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:52:49.871 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:52:49.871 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:52:49.871 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:52:49.871 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:52:49.871 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:52:49.871 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:52:49.871 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:52:49.872 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:52:49.872 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:52:49.872 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:52:49.872 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:52:49.872 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:52:49.872 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:52:49.872 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:52:49.872 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:52:49.872 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:52:49.872 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:52:49.872 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:52:49.872 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:52:49.872 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:52:49.873 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:52:49.873 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:52:49.873 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:52:49.873 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:52:49.873 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:52:49.873 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:52:49.873 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:52:49.873 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:52:49.873 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:52:49.873 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:52:49.873 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:52:49.873 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:52:49.873 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:52:49.873 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:52:49.874 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:52:49.874 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:52:49.874 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:52:49.874 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:52:49.874 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:53:19.499 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:53:19.500 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:53:19.500 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:53:19.500 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:53:19.500 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:53:19.500 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:53:19.500 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:53:19.500 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:53:19.500 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:53:19.500 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:53:19.500 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:53:19.500 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:53:19.500 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:53:19.500 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:53:19.500 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:53:19.501 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:53:19.501 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:53:19.501 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:53:19.501 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:53:19.501 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:53:19.501 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:53:19.501 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:53:19.501 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:53:19.501 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:53:19.501 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:53:19.501 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:53:19.501 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:53:19.501 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:53:19.501 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:53:19.501 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:53:19.502 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:53:19.502 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:53:19.502 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:53:19.502 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:53:19.502 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:53:19.502 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:53:19.502 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:53:19.502 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:53:19.502 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:53:19.502 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:53:19.502 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:53:19.502 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:53:19.502 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:53:19.502 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:53:19.503 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:53:19.503 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:53:19.503 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:53:19.503 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:53:19.503 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:53:19.503 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:53:19.503 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:53:19.503 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:53:19.503 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:53:19.503 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:53:19.503 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:53:19.503 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:53:19.503 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:53:19.503 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:53:19.503 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:53:19.504 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:53:19.504 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:53:19.504 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:53:19.504 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:53:19.504 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:53:19.504 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:53:19.504 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:53:19.504 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:53:19.504 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:53:19.504 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:53:19.504 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:53:19.504 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:53:19.504 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:53:19.505 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:53:19.505 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:53:19.505 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:53:19.505 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:53:19.505 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:53:19.505 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:53:19.505 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:53:19.505 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:53:19.505 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:53:19.505 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:53:19.505 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:53:19.505 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:53:19.505 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:53:19.505 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:53:19.506 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:53:19.506 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:53:19.506 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:53:19.506 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:53:19.506 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:53:19.506 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:53:19.506 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:53:19.506 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:53:19.506 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:53:19.506 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:53:19.506 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:53:19.506 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:53:19.506 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:53:19.506 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:53:19.507 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:53:19.507 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:53:19.507 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:53:19.507 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:53:19.507 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:53:19.507 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:53:19.507 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:53:19.507 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:53:19.507 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:53:19.507 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:53:19.507 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:53:19.507 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:53:19.507 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:53:19.508 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:53:19.508 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:53:19.508 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:53:19.508 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:53:19.508 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:53:19.508 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:53:19.508 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:53:19.508 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:53:19.508 INFO:tasks.workunit.client.0.smithi122.stdout:read completion cb called! 2024-09-16T16:53:19.508 INFO:tasks.workunit.client.0.smithi122.stdout:read completion cb called! 2024-09-16T16:53:19.508 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 512 2024-09-16T16:53:19.508 INFO:tasks.workunit.client.0.smithi122.stdout:read completion cb called! 2024-09-16T16:53:19.508 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 4 2024-09-16T16:53:19.509 INFO:tasks.workunit.client.0.smithi122.stdout:read: 4 2024-09-16T16:53:19.509 INFO:tasks.workunit.client.0.smithi122.stdout:read: 4 2024-09-16T16:53:19.509 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.TestEncryptionLUKS2 (65432 ms) 2024-09-16T16:53:19.509 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.TestCloneEncryption 2024-09-16T16:53:19.509 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:54:24.436 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 4 2024-09-16T16:54:24.436 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 4 2024-09-16T16:54:24.437 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 4 2024-09-16T16:54:24.437 INFO:tasks.workunit.client.0.smithi122.stdout:read: 4 2024-09-16T16:54:24.437 INFO:tasks.workunit.client.0.smithi122.stdout:read: 4 2024-09-16T16:54:24.437 INFO:tasks.workunit.client.0.smithi122.stdout:read: 4 2024-09-16T16:54:24.437 INFO:tasks.workunit.client.0.smithi122.stdout:read: 4 2024-09-16T16:54:24.437 INFO:tasks.workunit.client.0.smithi122.stdout:read: 4 2024-09-16T16:54:24.437 INFO:tasks.workunit.client.0.smithi122.stdout:read: 4 2024-09-16T16:54:24.437 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.TestCloneEncryption (64936 ms) 2024-09-16T16:54:24.437 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.LUKS1UnderLUKS2WithoutResize 2024-09-16T16:54:24.437 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:54:41.117 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.LUKS1UnderLUKS2WithoutResize (16682 ms) 2024-09-16T16:54:41.117 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.LUKS2UnderLUKS1WithoutResize 2024-09-16T16:54:41.117 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:54:56.803 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.LUKS2UnderLUKS1WithoutResize (15686 ms) 2024-09-16T16:54:56.803 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.EncryptionFormatNoData 2024-09-16T16:54:56.803 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:55:01.725 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.EncryptionFormatNoData (4922 ms) 2024-09-16T16:55:01.725 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.EncryptionLoadBadSize 2024-09-16T16:55:01.725 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:55:08.229 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.EncryptionLoadBadSize (6504 ms) 2024-09-16T16:55:08.229 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.EncryptionLoadBadStripePattern 2024-09-16T16:55:08.229 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:2905: Skipped 2024-09-16T16:55:08.229 INFO:tasks.workunit.client.0.smithi122.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:55:08.229 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestLibRBD.EncryptionLoadBadStripePattern (0 ms) 2024-09-16T16:55:08.229 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.EncryptionLoadFormatMismatch 2024-09-16T16:55:08.229 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:57:21.901 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.EncryptionLoadFormatMismatch (133671 ms) 2024-09-16T16:57:21.902 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.EncryptedResize 2024-09-16T16:57:21.902 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:57:34.930 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.EncryptedResize (13030 ms) 2024-09-16T16:57:34.930 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.EncryptedFlattenSmallData 2024-09-16T16:57:34.930 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:57:48.929 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.EncryptedFlattenSmallData (13999 ms) 2024-09-16T16:57:48.930 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.TestIOWithIOHint 2024-09-16T16:57:48.930 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:58:18.521 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 512 2024-09-16T16:58:18.522 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 512 2024-09-16T16:58:18.522 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 512 2024-09-16T16:58:18.522 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 512 2024-09-16T16:58:18.522 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 512 2024-09-16T16:58:18.522 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:18.522 INFO:tasks.workunit.client.0.smithi122.stdout:started write 2024-09-16T16:58:18.522 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:58:18.522 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:58:18.522 INFO:tasks.workunit.client.0.smithi122.stdout:finished write 2024-09-16T16:58:18.522 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:18.522 INFO:tasks.workunit.client.0.smithi122.stdout:started write 2024-09-16T16:58:18.522 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:58:18.522 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:58:18.522 INFO:tasks.workunit.client.0.smithi122.stdout:finished write 2024-09-16T16:58:18.523 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:18.523 INFO:tasks.workunit.client.0.smithi122.stdout:started write 2024-09-16T16:58:18.523 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:58:18.523 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:58:18.523 INFO:tasks.workunit.client.0.smithi122.stdout:finished write 2024-09-16T16:58:18.523 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:18.523 INFO:tasks.workunit.client.0.smithi122.stdout:started write 2024-09-16T16:58:18.523 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:58:18.523 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:58:18.523 INFO:tasks.workunit.client.0.smithi122.stdout:finished write 2024-09-16T16:58:18.523 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:18.523 INFO:tasks.workunit.client.0.smithi122.stdout:started write 2024-09-16T16:58:18.523 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:58:18.523 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:58:18.524 INFO:tasks.workunit.client.0.smithi122.stdout:finished write 2024-09-16T16:58:18.524 INFO:tasks.workunit.client.0.smithi122.stdout:start compare and write 2024-09-16T16:58:18.524 INFO:tasks.workunit.client.0.smithi122.stdout:compare and wrote: 512 2024-09-16T16:58:18.524 INFO:tasks.workunit.client.0.smithi122.stdout:start compare and write 2024-09-16T16:58:18.524 INFO:tasks.workunit.client.0.smithi122.stdout:compare and wrote: 512 2024-09-16T16:58:18.524 INFO:tasks.workunit.client.0.smithi122.stdout:start compare and write 2024-09-16T16:58:18.524 INFO:tasks.workunit.client.0.smithi122.stdout:compare and wrote: 512 2024-09-16T16:58:18.524 INFO:tasks.workunit.client.0.smithi122.stdout:start compare and write 2024-09-16T16:58:18.524 INFO:tasks.workunit.client.0.smithi122.stdout:compare and wrote: 512 2024-09-16T16:58:18.524 INFO:tasks.workunit.client.0.smithi122.stdout:start compare and write 2024-09-16T16:58:18.524 INFO:tasks.workunit.client.0.smithi122.stdout:compare and wrote: 512 2024-09-16T16:58:18.524 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:18.524 INFO:tasks.workunit.client.0.smithi122.stdout:started aio compare and write 2024-09-16T16:58:18.525 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:58:18.525 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:58:18.525 INFO:tasks.workunit.client.0.smithi122.stdout:finished aio compare and write 2024-09-16T16:58:18.525 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:18.525 INFO:tasks.workunit.client.0.smithi122.stdout:started aio compare and write 2024-09-16T16:58:18.525 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:58:18.525 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:58:18.525 INFO:tasks.workunit.client.0.smithi122.stdout:finished aio compare and write 2024-09-16T16:58:18.525 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:18.525 INFO:tasks.workunit.client.0.smithi122.stdout:started aio compare and write 2024-09-16T16:58:18.525 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:58:18.525 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:58:18.525 INFO:tasks.workunit.client.0.smithi122.stdout:finished aio compare and write 2024-09-16T16:58:18.525 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:18.526 INFO:tasks.workunit.client.0.smithi122.stdout:started aio compare and write 2024-09-16T16:58:18.526 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:58:18.526 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:58:18.526 INFO:tasks.workunit.client.0.smithi122.stdout:finished aio compare and write 2024-09-16T16:58:18.526 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:18.526 INFO:tasks.workunit.client.0.smithi122.stdout:started aio compare and write 2024-09-16T16:58:18.526 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:58:18.526 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:58:18.526 INFO:tasks.workunit.client.0.smithi122.stdout:finished aio compare and write 2024-09-16T16:58:18.526 INFO:tasks.workunit.client.0.smithi122.stdout:read: 512 2024-09-16T16:58:18.526 INFO:tasks.workunit.client.0.smithi122.stdout:read: 512 2024-09-16T16:58:18.526 INFO:tasks.workunit.client.0.smithi122.stdout:read: 512 2024-09-16T16:58:18.526 INFO:tasks.workunit.client.0.smithi122.stdout:read: 512 2024-09-16T16:58:18.526 INFO:tasks.workunit.client.0.smithi122.stdout:read: 512 2024-09-16T16:58:18.526 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:18.527 INFO:tasks.workunit.client.0.smithi122.stdout:started read 2024-09-16T16:58:18.527 INFO:tasks.workunit.client.0.smithi122.stdout:read completion cb called! 2024-09-16T16:58:18.527 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 512 2024-09-16T16:58:18.527 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:18.527 INFO:tasks.workunit.client.0.smithi122.stdout:started read 2024-09-16T16:58:18.527 INFO:tasks.workunit.client.0.smithi122.stdout:read completion cb called! 2024-09-16T16:58:18.527 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 512 2024-09-16T16:58:18.527 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:18.527 INFO:tasks.workunit.client.0.smithi122.stdout:started read 2024-09-16T16:58:18.527 INFO:tasks.workunit.client.0.smithi122.stdout:read completion cb called! 2024-09-16T16:58:18.527 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 512 2024-09-16T16:58:18.527 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:18.527 INFO:tasks.workunit.client.0.smithi122.stdout:started read 2024-09-16T16:58:18.527 INFO:tasks.workunit.client.0.smithi122.stdout:read completion cb called! 2024-09-16T16:58:18.527 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 512 2024-09-16T16:58:18.528 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:18.528 INFO:tasks.workunit.client.0.smithi122.stdout:started read 2024-09-16T16:58:18.528 INFO:tasks.workunit.client.0.smithi122.stdout:read completion cb called! 2024-09-16T16:58:18.528 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 512 2024-09-16T16:58:18.528 INFO:tasks.workunit.client.0.smithi122.stdout:discard: 512~512 = 512 2024-09-16T16:58:18.528 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:58:18.528 INFO:tasks.workunit.client.0.smithi122.stdout:aio discard: 1536~512 = 0 2024-09-16T16:58:18.528 INFO:tasks.workunit.client.0.smithi122.stdout:read: 512 2024-09-16T16:58:18.528 INFO:tasks.workunit.client.0.smithi122.stdout:read: 512 2024-09-16T16:58:18.528 INFO:tasks.workunit.client.0.smithi122.stdout:read: 512 2024-09-16T16:58:18.528 INFO:tasks.workunit.client.0.smithi122.stdout:read: 512 2024-09-16T16:58:18.528 INFO:tasks.workunit.client.0.smithi122.stdout:read: 512 2024-09-16T16:58:18.528 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 0 2024-09-16T16:58:18.528 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:58:18.528 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:58:18.528 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 0 2024-09-16T16:58:18.529 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:58:18.529 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:58:18.529 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 16384 2024-09-16T16:58:18.529 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:58:18.529 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:58:18.529 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 16384 2024-09-16T16:58:18.529 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:58:18.529 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:58:18.529 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:58:18.529 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:58:18.529 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 49152 2024-09-16T16:58:18.529 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:58:18.529 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:58:18.530 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 49152 2024-09-16T16:58:18.530 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:58:18.530 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:58:18.530 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 65536 2024-09-16T16:58:18.530 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:58:18.530 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:58:18.530 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 65536 2024-09-16T16:58:18.530 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:58:18.530 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:58:18.530 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:58:18.530 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:58:18.530 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 98304 2024-09-16T16:58:18.530 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:58:18.530 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:58:18.530 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 98304 2024-09-16T16:58:18.530 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:58:18.531 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:58:18.531 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 114688 2024-09-16T16:58:18.531 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:58:18.531 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:58:18.531 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 114688 2024-09-16T16:58:18.531 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:58:18.531 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:58:18.531 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:58:18.531 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:58:18.531 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 147456 2024-09-16T16:58:18.531 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:58:18.531 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:58:18.531 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 147456 2024-09-16T16:58:18.531 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:58:18.531 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:58:18.531 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 163840 2024-09-16T16:58:18.532 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:58:18.532 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:58:18.532 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 163840 2024-09-16T16:58:18.532 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:58:18.532 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:58:18.532 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:58:18.532 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:58:18.532 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 196608 2024-09-16T16:58:18.532 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:58:18.532 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:58:18.532 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 196608 2024-09-16T16:58:18.532 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:58:18.532 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:58:18.532 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 212992 2024-09-16T16:58:18.533 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:58:18.533 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:58:18.533 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 212992 2024-09-16T16:58:18.533 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:58:18.533 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:58:18.533 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:58:18.533 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:58:18.533 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:18.533 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:58:18.533 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:58:18.533 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:58:18.533 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:58:18.533 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:58:18.533 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:58:18.533 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:18.534 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:58:18.534 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:58:18.534 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:58:18.534 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:58:18.534 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:58:18.534 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:58:18.534 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:18.534 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:58:18.534 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:58:18.534 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:58:18.534 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:58:18.534 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:58:18.534 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:58:18.534 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:18.534 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:58:18.534 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:58:18.535 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:58:18.535 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:58:18.535 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:58:18.535 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:58:18.535 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:18.535 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:58:18.535 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:58:18.535 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:18.535 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:58:18.535 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:58:18.535 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:18.535 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:58:18.535 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:58:18.536 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:58:18.536 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:58:18.536 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:58:18.536 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:58:18.536 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:18.536 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:58:18.536 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:58:18.536 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:58:18.536 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:58:18.536 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:58:18.536 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:58:18.536 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:44.098 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:58:44.098 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:58:44.098 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:58:44.098 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:58:44.098 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:58:44.098 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:58:44.098 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:44.098 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:58:44.099 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:58:44.099 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:58:44.099 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:58:44.099 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:58:44.099 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:58:44.099 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:44.099 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:58:44.099 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:58:44.099 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:44.099 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:58:44.099 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:58:44.099 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:44.099 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:58:44.099 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:58:44.100 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:58:44.100 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:58:44.100 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:58:44.100 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:58:44.100 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:44.100 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:58:44.100 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:58:44.100 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:58:44.100 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:58:44.100 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:58:44.100 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:58:44.100 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:44.100 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:58:44.100 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:58:44.100 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:58:44.101 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:58:44.101 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:58:44.101 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:58:44.101 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:44.101 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:58:44.101 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:58:44.101 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:58:44.101 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:58:44.101 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:58:44.101 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:58:44.101 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:44.101 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:58:44.101 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:58:44.101 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:44.101 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:58:44.102 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:58:44.102 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:44.102 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:58:44.102 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:58:44.102 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:58:44.102 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:58:44.102 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:58:44.102 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:58:44.102 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:44.102 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:58:44.102 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:58:44.102 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:58:44.102 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:58:44.102 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:58:44.102 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:58:44.102 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:44.103 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:58:44.103 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:58:44.103 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:58:44.103 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:58:44.103 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:58:44.103 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:58:44.103 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:44.103 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:58:44.103 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:58:44.103 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:58:44.103 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:58:44.103 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:58:44.103 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:58:44.103 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:44.103 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:58:44.104 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:58:44.104 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:44.104 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:58:44.104 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:58:44.104 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:44.104 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:58:44.104 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:58:44.104 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:58:44.104 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:58:44.104 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:58:44.104 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:58:44.104 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:44.104 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:58:44.104 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:58:44.104 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:58:44.105 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:58:44.105 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:58:44.105 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:58:44.105 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:44.105 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:58:44.105 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:58:44.105 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:58:44.105 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:58:44.105 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:58:44.105 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:58:44.105 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:44.105 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:58:44.105 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:58:44.105 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:58:44.106 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:58:44.106 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:58:44.106 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:58:44.106 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:44.106 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:58:44.106 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:58:44.106 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:44.106 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:58:44.106 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:58:44.106 INFO:tasks.workunit.client.0.smithi122.stdout:read completion cb called! 2024-09-16T16:58:44.106 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 512 2024-09-16T16:58:44.106 INFO:tasks.workunit.client.0.smithi122.stdout:read completion cb called! 2024-09-16T16:58:44.106 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.TestIOWithIOHint (55169 ms) 2024-09-16T16:58:44.106 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.TestDataPoolIO 2024-09-16T16:58:45.262 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:58:48.077 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 512 2024-09-16T16:58:48.077 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 512 2024-09-16T16:58:48.077 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 512 2024-09-16T16:58:48.077 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 512 2024-09-16T16:58:48.077 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 512 2024-09-16T16:58:48.077 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:48.077 INFO:tasks.workunit.client.0.smithi122.stdout:started write 2024-09-16T16:58:48.078 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:58:48.078 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:58:48.078 INFO:tasks.workunit.client.0.smithi122.stdout:finished write 2024-09-16T16:58:48.078 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:48.078 INFO:tasks.workunit.client.0.smithi122.stdout:started write 2024-09-16T16:58:48.078 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:58:48.078 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:58:48.078 INFO:tasks.workunit.client.0.smithi122.stdout:finished write 2024-09-16T16:58:48.078 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:48.078 INFO:tasks.workunit.client.0.smithi122.stdout:started write 2024-09-16T16:58:48.078 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:58:48.078 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:58:48.078 INFO:tasks.workunit.client.0.smithi122.stdout:finished write 2024-09-16T16:58:48.078 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:48.078 INFO:tasks.workunit.client.0.smithi122.stdout:started write 2024-09-16T16:58:48.079 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:58:48.079 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:58:48.079 INFO:tasks.workunit.client.0.smithi122.stdout:finished write 2024-09-16T16:58:48.079 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:48.079 INFO:tasks.workunit.client.0.smithi122.stdout:started write 2024-09-16T16:58:48.079 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:58:48.079 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:58:48.079 INFO:tasks.workunit.client.0.smithi122.stdout:finished write 2024-09-16T16:58:48.079 INFO:tasks.workunit.client.0.smithi122.stdout:read: 512 2024-09-16T16:58:48.079 INFO:tasks.workunit.client.0.smithi122.stdout:read: 512 2024-09-16T16:58:48.079 INFO:tasks.workunit.client.0.smithi122.stdout:read: 512 2024-09-16T16:58:48.079 INFO:tasks.workunit.client.0.smithi122.stdout:read: 512 2024-09-16T16:58:48.079 INFO:tasks.workunit.client.0.smithi122.stdout:read: 512 2024-09-16T16:58:48.079 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:48.079 INFO:tasks.workunit.client.0.smithi122.stdout:started read 2024-09-16T16:58:48.080 INFO:tasks.workunit.client.0.smithi122.stdout:read completion cb called! 2024-09-16T16:58:48.080 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 512 2024-09-16T16:58:48.080 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:48.080 INFO:tasks.workunit.client.0.smithi122.stdout:started read 2024-09-16T16:58:48.080 INFO:tasks.workunit.client.0.smithi122.stdout:read completion cb called! 2024-09-16T16:58:48.080 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 512 2024-09-16T16:58:48.080 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:48.080 INFO:tasks.workunit.client.0.smithi122.stdout:started read 2024-09-16T16:58:48.080 INFO:tasks.workunit.client.0.smithi122.stdout:read completion cb called! 2024-09-16T16:58:48.080 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 512 2024-09-16T16:58:48.080 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:48.080 INFO:tasks.workunit.client.0.smithi122.stdout:started read 2024-09-16T16:58:48.080 INFO:tasks.workunit.client.0.smithi122.stdout:read completion cb called! 2024-09-16T16:58:48.080 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 512 2024-09-16T16:58:48.081 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:48.081 INFO:tasks.workunit.client.0.smithi122.stdout:started read 2024-09-16T16:58:48.081 INFO:tasks.workunit.client.0.smithi122.stdout:read completion cb called! 2024-09-16T16:58:48.081 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 512 2024-09-16T16:58:48.081 INFO:tasks.workunit.client.0.smithi122.stdout:discard: 512~512 = 512 2024-09-16T16:58:48.081 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:58:48.081 INFO:tasks.workunit.client.0.smithi122.stdout:aio discard: 1536~512 = 0 2024-09-16T16:58:48.081 INFO:tasks.workunit.client.0.smithi122.stdout:read: 512 2024-09-16T16:58:48.081 INFO:tasks.workunit.client.0.smithi122.stdout:read: 512 2024-09-16T16:58:48.081 INFO:tasks.workunit.client.0.smithi122.stdout:read: 512 2024-09-16T16:58:48.081 INFO:tasks.workunit.client.0.smithi122.stdout:read: 512 2024-09-16T16:58:48.081 INFO:tasks.workunit.client.0.smithi122.stdout:read: 512 2024-09-16T16:58:48.081 INFO:tasks.workunit.client.0.smithi122.stdout:read completion cb called! 2024-09-16T16:58:48.081 INFO:tasks.workunit.client.0.smithi122.stdout:read completion cb called! 2024-09-16T16:58:48.081 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.TestDataPoolIO (3979 ms) 2024-09-16T16:58:48.082 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteMismatch 2024-09-16T16:58:48.082 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:58:48.360 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.TestCompareAndWriteMismatch (283 ms) 2024-09-16T16:58:48.360 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteMismatch 2024-09-16T16:58:48.360 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:58:48.672 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteMismatch (312 ms) 2024-09-16T16:58:48.672 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteSuccess 2024-09-16T16:58:48.672 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:58:49.009 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.TestCompareAndWriteSuccess (337 ms) 2024-09-16T16:58:49.009 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteSuccess 2024-09-16T16:58:49.009 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:58:49.300 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteSuccess (291 ms) 2024-09-16T16:58:49.300 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteStripeUnitUnaligned 2024-09-16T16:58:49.300 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:58:49.888 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.TestCompareAndWriteStripeUnitUnaligned (588 ms) 2024-09-16T16:58:49.888 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteStripeUnitUnaligned 2024-09-16T16:58:49.888 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:58:50.263 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteStripeUnitUnaligned (375 ms) 2024-09-16T16:58:50.263 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteTooLarge 2024-09-16T16:58:50.263 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:58:50.762 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.TestCompareAndWriteTooLarge (499 ms) 2024-09-16T16:58:50.762 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteTooLarge 2024-09-16T16:58:50.762 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:58:51.170 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteTooLarge (408 ms) 2024-09-16T16:58:51.170 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteStripeUnitSuccess 2024-09-16T16:58:51.170 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:58:53.820 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.TestCompareAndWriteStripeUnitSuccess (2650 ms) 2024-09-16T16:58:53.820 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteStripeUnitSuccess 2024-09-16T16:58:53.820 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:58:56.311 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteStripeUnitSuccess (2491 ms) 2024-09-16T16:58:56.311 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteVIovecLenDiffers 2024-09-16T16:58:56.311 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:58:56.594 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteVIovecLenDiffers (283 ms) 2024-09-16T16:58:56.595 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteVMismatch 2024-09-16T16:58:56.595 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:58:56.942 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteVMismatch (347 ms) 2024-09-16T16:58:56.942 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteVSuccess 2024-09-16T16:58:56.942 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:58:57.254 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteVSuccess (313 ms) 2024-09-16T16:58:57.254 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.TestScatterGatherIO 2024-09-16T16:58:57.254 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:58:57.658 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.TestScatterGatherIO (404 ms) 2024-09-16T16:58:57.658 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.TestEmptyDiscard 2024-09-16T16:58:57.659 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:58:57.971 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:58:57.971 INFO:tasks.workunit.client.0.smithi122.stdout:aio discard: 0~1048576 = 0 2024-09-16T16:58:57.971 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:58:57.971 INFO:tasks.workunit.client.0.smithi122.stdout:aio discard: 0~4194304 = 0 2024-09-16T16:58:57.971 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:58:57.971 INFO:tasks.workunit.client.0.smithi122.stdout:aio discard: 3145728~1048576 = 0 2024-09-16T16:58:57.971 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.TestEmptyDiscard (313 ms) 2024-09-16T16:58:57.971 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.TestFUA 2024-09-16T16:58:57.971 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:58:59.385 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 512 2024-09-16T16:58:59.385 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 512 2024-09-16T16:58:59.385 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 512 2024-09-16T16:58:59.385 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 512 2024-09-16T16:58:59.385 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 512 2024-09-16T16:58:59.385 INFO:tasks.workunit.client.0.smithi122.stdout:read: 512 2024-09-16T16:58:59.385 INFO:tasks.workunit.client.0.smithi122.stdout:read: 512 2024-09-16T16:58:59.385 INFO:tasks.workunit.client.0.smithi122.stdout:read: 512 2024-09-16T16:58:59.386 INFO:tasks.workunit.client.0.smithi122.stdout:read: 512 2024-09-16T16:58:59.386 INFO:tasks.workunit.client.0.smithi122.stdout:read: 512 2024-09-16T16:58:59.386 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:59.386 INFO:tasks.workunit.client.0.smithi122.stdout:started write 2024-09-16T16:58:59.386 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:58:59.386 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:58:59.386 INFO:tasks.workunit.client.0.smithi122.stdout:finished write 2024-09-16T16:58:59.386 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:59.386 INFO:tasks.workunit.client.0.smithi122.stdout:started write 2024-09-16T16:58:59.386 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:58:59.386 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:58:59.386 INFO:tasks.workunit.client.0.smithi122.stdout:finished write 2024-09-16T16:58:59.386 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:59.386 INFO:tasks.workunit.client.0.smithi122.stdout:started write 2024-09-16T16:58:59.386 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:58:59.387 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:58:59.387 INFO:tasks.workunit.client.0.smithi122.stdout:finished write 2024-09-16T16:58:59.387 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:59.387 INFO:tasks.workunit.client.0.smithi122.stdout:started write 2024-09-16T16:58:59.387 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:58:59.387 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:58:59.387 INFO:tasks.workunit.client.0.smithi122.stdout:finished write 2024-09-16T16:58:59.387 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:59.387 INFO:tasks.workunit.client.0.smithi122.stdout:started write 2024-09-16T16:58:59.387 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:58:59.387 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:58:59.387 INFO:tasks.workunit.client.0.smithi122.stdout:finished write 2024-09-16T16:58:59.387 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:59.387 INFO:tasks.workunit.client.0.smithi122.stdout:started read 2024-09-16T16:58:59.388 INFO:tasks.workunit.client.0.smithi122.stdout:read completion cb called! 2024-09-16T16:58:59.388 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 512 2024-09-16T16:58:59.388 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:59.388 INFO:tasks.workunit.client.0.smithi122.stdout:started read 2024-09-16T16:58:59.388 INFO:tasks.workunit.client.0.smithi122.stdout:read completion cb called! 2024-09-16T16:58:59.388 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 512 2024-09-16T16:58:59.388 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:59.388 INFO:tasks.workunit.client.0.smithi122.stdout:started read 2024-09-16T16:58:59.388 INFO:tasks.workunit.client.0.smithi122.stdout:read completion cb called! 2024-09-16T16:58:59.388 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 512 2024-09-16T16:58:59.388 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:59.388 INFO:tasks.workunit.client.0.smithi122.stdout:started read 2024-09-16T16:58:59.388 INFO:tasks.workunit.client.0.smithi122.stdout:read completion cb called! 2024-09-16T16:58:59.388 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 512 2024-09-16T16:58:59.389 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:59.389 INFO:tasks.workunit.client.0.smithi122.stdout:started read 2024-09-16T16:58:59.389 INFO:tasks.workunit.client.0.smithi122.stdout:read completion cb called! 2024-09-16T16:58:59.389 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 512 2024-09-16T16:58:59.389 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.TestFUA (1414 ms) 2024-09-16T16:58:59.389 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.TestIOPP 2024-09-16T16:58:59.389 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:58:59.728 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 512 2024-09-16T16:58:59.729 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 512 2024-09-16T16:58:59.729 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 512 2024-09-16T16:58:59.729 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 512 2024-09-16T16:58:59.729 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 512 2024-09-16T16:58:59.729 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:59.729 INFO:tasks.workunit.client.0.smithi122.stdout:started write 2024-09-16T16:58:59.729 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:58:59.729 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:58:59.729 INFO:tasks.workunit.client.0.smithi122.stdout:finished write 2024-09-16T16:58:59.729 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:59.729 INFO:tasks.workunit.client.0.smithi122.stdout:started write 2024-09-16T16:58:59.729 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:58:59.729 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:58:59.729 INFO:tasks.workunit.client.0.smithi122.stdout:finished write 2024-09-16T16:58:59.730 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:59.730 INFO:tasks.workunit.client.0.smithi122.stdout:started write 2024-09-16T16:58:59.730 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:58:59.730 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:58:59.730 INFO:tasks.workunit.client.0.smithi122.stdout:finished write 2024-09-16T16:58:59.730 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:59.730 INFO:tasks.workunit.client.0.smithi122.stdout:started write 2024-09-16T16:58:59.730 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:58:59.730 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:58:59.730 INFO:tasks.workunit.client.0.smithi122.stdout:finished write 2024-09-16T16:58:59.730 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:59.730 INFO:tasks.workunit.client.0.smithi122.stdout:started write 2024-09-16T16:58:59.730 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:58:59.917 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:58:59.917 INFO:tasks.workunit.client.0.smithi122.stdout:finished write 2024-09-16T16:58:59.917 INFO:tasks.workunit.client.0.smithi122.stdout:start compare and write 2024-09-16T16:58:59.917 INFO:tasks.workunit.client.0.smithi122.stdout:compare and wrote: 512 2024-09-16T16:58:59.917 INFO:tasks.workunit.client.0.smithi122.stdout:start compare and write 2024-09-16T16:58:59.917 INFO:tasks.workunit.client.0.smithi122.stdout:compare and wrote: 512 2024-09-16T16:58:59.917 INFO:tasks.workunit.client.0.smithi122.stdout:start compare and write 2024-09-16T16:58:59.917 INFO:tasks.workunit.client.0.smithi122.stdout:compare and wrote: 512 2024-09-16T16:58:59.918 INFO:tasks.workunit.client.0.smithi122.stdout:start compare and write 2024-09-16T16:58:59.918 INFO:tasks.workunit.client.0.smithi122.stdout:compare and wrote: 512 2024-09-16T16:58:59.918 INFO:tasks.workunit.client.0.smithi122.stdout:start compare and write 2024-09-16T16:58:59.918 INFO:tasks.workunit.client.0.smithi122.stdout:compare and wrote: 512 2024-09-16T16:58:59.918 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:59.918 INFO:tasks.workunit.client.0.smithi122.stdout:started aio compare and write 2024-09-16T16:58:59.918 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:58:59.930 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:58:59.930 INFO:tasks.workunit.client.0.smithi122.stdout:finished aio compare and write 2024-09-16T16:58:59.930 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:59.931 INFO:tasks.workunit.client.0.smithi122.stdout:started aio compare and write 2024-09-16T16:58:59.931 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:58:59.943 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:58:59.943 INFO:tasks.workunit.client.0.smithi122.stdout:finished aio compare and write 2024-09-16T16:58:59.943 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:59.943 INFO:tasks.workunit.client.0.smithi122.stdout:started aio compare and write 2024-09-16T16:58:59.943 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:58:59.959 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:58:59.960 INFO:tasks.workunit.client.0.smithi122.stdout:finished aio compare and write 2024-09-16T16:58:59.960 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:59.960 INFO:tasks.workunit.client.0.smithi122.stdout:started aio compare and write 2024-09-16T16:58:59.960 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:58:59.972 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:58:59.972 INFO:tasks.workunit.client.0.smithi122.stdout:finished aio compare and write 2024-09-16T16:58:59.972 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:58:59.973 INFO:tasks.workunit.client.0.smithi122.stdout:started aio compare and write 2024-09-16T16:58:59.973 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:58:59.999 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:58:59.999 INFO:tasks.workunit.client.0.smithi122.stdout:finished aio compare and write 2024-09-16T16:58:59.999 INFO:tasks.workunit.client.0.smithi122.stdout:read: 512 2024-09-16T16:59:00.000 INFO:tasks.workunit.client.0.smithi122.stdout:read: 512 2024-09-16T16:59:00.000 INFO:tasks.workunit.client.0.smithi122.stdout:read: 512 2024-09-16T16:59:00.000 INFO:tasks.workunit.client.0.smithi122.stdout:read: 512 2024-09-16T16:59:00.000 INFO:tasks.workunit.client.0.smithi122.stdout:read: 512 2024-09-16T16:59:00.000 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:59:00.000 INFO:tasks.workunit.client.0.smithi122.stdout:started read 2024-09-16T16:59:00.000 INFO:tasks.workunit.client.0.smithi122.stdout:read completion cb called! 2024-09-16T16:59:00.004 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 512 2024-09-16T16:59:00.004 INFO:tasks.workunit.client.0.smithi122.stdout:finished read 2024-09-16T16:59:00.004 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:59:00.004 INFO:tasks.workunit.client.0.smithi122.stdout:started read 2024-09-16T16:59:00.004 INFO:tasks.workunit.client.0.smithi122.stdout:read completion cb called! 2024-09-16T16:59:00.008 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 512 2024-09-16T16:59:00.008 INFO:tasks.workunit.client.0.smithi122.stdout:finished read 2024-09-16T16:59:00.008 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:59:00.008 INFO:tasks.workunit.client.0.smithi122.stdout:started read 2024-09-16T16:59:00.008 INFO:tasks.workunit.client.0.smithi122.stdout:read completion cb called! 2024-09-16T16:59:00.012 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 512 2024-09-16T16:59:00.012 INFO:tasks.workunit.client.0.smithi122.stdout:finished read 2024-09-16T16:59:00.012 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:59:00.012 INFO:tasks.workunit.client.0.smithi122.stdout:started read 2024-09-16T16:59:00.012 INFO:tasks.workunit.client.0.smithi122.stdout:read completion cb called! 2024-09-16T16:59:00.016 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 512 2024-09-16T16:59:00.016 INFO:tasks.workunit.client.0.smithi122.stdout:finished read 2024-09-16T16:59:00.016 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:59:00.016 INFO:tasks.workunit.client.0.smithi122.stdout:started read 2024-09-16T16:59:00.016 INFO:tasks.workunit.client.0.smithi122.stdout:read completion cb called! 2024-09-16T16:59:00.017 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 512 2024-09-16T16:59:00.017 INFO:tasks.workunit.client.0.smithi122.stdout:finished read 2024-09-16T16:59:00.017 INFO:tasks.workunit.client.0.smithi122.stdout:discard: 512~512 2024-09-16T16:59:00.017 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:59:20.543 INFO:tasks.workunit.client.0.smithi122.stdout:read: 512 2024-09-16T16:59:20.544 INFO:tasks.workunit.client.0.smithi122.stdout:read: 512 2024-09-16T16:59:20.544 INFO:tasks.workunit.client.0.smithi122.stdout:read: 512 2024-09-16T16:59:20.544 INFO:tasks.workunit.client.0.smithi122.stdout:read: 512 2024-09-16T16:59:20.544 INFO:tasks.workunit.client.0.smithi122.stdout:read: 512 2024-09-16T16:59:20.544 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 0 2024-09-16T16:59:20.544 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:59:20.544 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:59:20.544 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 0 2024-09-16T16:59:20.544 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:59:20.544 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:59:20.545 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 16384 2024-09-16T16:59:20.545 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:59:20.545 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:59:20.545 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 16384 2024-09-16T16:59:20.545 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:59:20.545 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:59:20.545 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:59:20.545 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:59:20.545 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 49152 2024-09-16T16:59:20.545 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:59:20.545 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:59:20.545 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 49152 2024-09-16T16:59:20.545 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:59:20.545 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:59:20.546 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 65536 2024-09-16T16:59:20.546 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:59:20.546 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:59:20.546 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 65536 2024-09-16T16:59:20.546 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:59:20.546 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:59:20.546 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:59:20.546 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:59:20.546 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 98304 2024-09-16T16:59:20.546 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:59:20.546 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:59:20.546 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 98304 2024-09-16T16:59:20.546 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:59:20.546 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:59:20.547 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 114688 2024-09-16T16:59:20.547 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:59:20.547 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:59:20.547 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 114688 2024-09-16T16:59:20.547 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:59:20.547 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:59:20.547 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:59:20.547 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:59:20.547 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 147456 2024-09-16T16:59:20.547 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:59:20.547 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:59:20.547 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 147456 2024-09-16T16:59:20.547 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:59:20.547 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:59:20.548 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 163840 2024-09-16T16:59:20.548 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:59:20.548 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:59:20.548 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 163840 2024-09-16T16:59:20.548 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:59:20.548 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:59:20.548 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:59:20.548 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:59:20.548 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 196608 2024-09-16T16:59:20.548 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:59:20.548 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:59:20.548 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 196608 2024-09-16T16:59:20.548 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:59:20.548 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:59:20.549 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 212992 2024-09-16T16:59:20.549 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:59:20.549 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:59:20.549 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 212992 2024-09-16T16:59:20.549 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:59:20.549 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:59:20.549 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:59:20.549 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:59:20.549 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:59:20.549 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:59:20.549 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:59:20.549 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:59:20.549 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:59:20.550 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:59:20.550 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:59:20.550 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:59:20.550 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:59:20.550 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:59:20.550 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:59:20.550 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:59:20.550 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:59:20.550 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:59:20.550 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:59:20.550 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:59:20.550 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:59:20.766 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:59:20.766 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:59:20.766 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:59:20.766 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:59:20.766 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:59:20.766 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:59:20.766 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:59:20.911 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:59:20.911 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:59:20.911 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:59:20.911 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:59:20.912 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:59:20.912 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:59:20.912 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:59:20.912 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:59:20.912 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:59:20.912 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:59:20.912 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:59:20.912 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:59:20.912 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:59:21.351 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:59:21.351 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:59:21.351 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:59:21.351 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:59:21.351 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:59:21.351 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:59:21.351 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:59:22.006 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:59:22.006 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:59:22.006 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:59:22.007 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:59:22.007 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:59:22.007 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:59:22.007 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:59:22.696 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:59:22.696 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:59:22.696 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:59:22.696 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:59:22.697 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:59:22.697 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:59:22.697 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:59:23.231 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:59:23.231 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:59:23.231 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:59:23.231 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:59:23.231 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:59:23.231 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:59:23.231 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:59:23.231 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:59:23.231 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:59:23.231 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:59:23.232 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:59:23.232 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:59:23.232 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:59:24.299 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:59:24.299 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:59:24.299 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:59:24.299 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:59:24.299 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:59:24.299 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:59:24.300 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:59:25.132 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:59:25.132 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:59:25.132 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:59:25.132 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:59:25.132 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:59:25.132 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:59:25.132 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:59:26.388 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:59:26.389 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:59:26.389 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:59:26.389 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:59:26.389 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:59:26.389 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:59:26.389 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:59:27.278 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:59:27.279 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:59:27.279 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:59:27.279 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:59:27.279 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:59:27.279 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:59:27.279 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:59:27.279 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:59:27.280 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:59:27.280 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:59:27.280 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:59:27.280 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:59:27.280 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:59:28.851 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:59:28.851 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:59:28.851 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:59:28.851 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:59:28.851 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:59:28.852 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:59:28.852 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:59:30.252 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:59:30.253 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:59:30.253 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:59:30.253 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:59:30.253 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:59:30.253 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:59:30.253 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:59:32.031 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:59:32.032 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:59:32.032 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:59:32.032 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:59:32.032 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:59:32.032 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:59:32.032 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:59:33.360 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:59:33.360 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:59:33.361 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:59:33.361 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:59:33.361 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:59:33.361 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:59:33.361 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:59:33.361 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:59:33.361 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:59:33.361 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:59:33.361 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:59:33.361 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:59:33.361 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:59:35.477 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:59:35.477 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:59:35.477 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:59:35.477 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:59:35.477 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:59:35.478 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:59:35.478 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:59:37.137 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:59:37.137 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:59:37.137 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:59:37.137 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:59:37.137 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:59:37.137 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:59:37.137 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:59:39.410 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:59:39.410 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:59:39.411 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:59:39.411 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:59:39.411 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:59:39.411 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:59:39.411 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:59:41.344 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:59:41.344 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T16:59:41.344 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T16:59:41.344 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T16:59:41.344 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:59:41.344 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:59:41.344 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:59:41.344 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:59:41.344 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T16:59:41.345 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T16:59:41.345 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.TestIOPP (41958 ms) 2024-09-16T16:59:41.345 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteCompareTooSmallPP 2024-09-16T16:59:41.345 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:59:41.692 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.TestCompareAndWriteCompareTooSmallPP (348 ms) 2024-09-16T16:59:41.692 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteCompareTooSmallPP 2024-09-16T16:59:41.692 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:59:42.022 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteCompareTooSmallPP (330 ms) 2024-09-16T16:59:42.022 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteWriteTooSmallPP 2024-09-16T16:59:42.022 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:59:42.313 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.TestCompareAndWriteWriteTooSmallPP (291 ms) 2024-09-16T16:59:42.313 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteWriteTooSmallPP 2024-09-16T16:59:42.313 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:59:42.588 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteWriteTooSmallPP (275 ms) 2024-09-16T16:59:42.588 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteMismatchPP 2024-09-16T16:59:42.588 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:59:42.897 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.TestCompareAndWriteMismatchPP (309 ms) 2024-09-16T16:59:42.897 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteMismatchPP 2024-09-16T16:59:42.897 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:59:43.136 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:59:43.195 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteMismatchPP (298 ms) 2024-09-16T16:59:43.195 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteMismatchBufferlistGreaterLenPP 2024-09-16T16:59:43.195 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:59:43.490 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.TestCompareAndWriteMismatchBufferlistGreaterLenPP (295 ms) 2024-09-16T16:59:43.491 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteMismatchBufferlistGreaterLenPP 2024-09-16T16:59:43.491 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:59:43.744 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:59:43.800 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteMismatchBufferlistGreaterLenPP (310 ms) 2024-09-16T16:59:43.800 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteSuccessPP 2024-09-16T16:59:43.800 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:59:44.105 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.TestCompareAndWriteSuccessPP (305 ms) 2024-09-16T16:59:44.105 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteSuccessPP 2024-09-16T16:59:44.105 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:59:44.343 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:59:44.398 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteSuccessPP (293 ms) 2024-09-16T16:59:44.398 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteSuccessBufferlistGreaterLenPP 2024-09-16T16:59:44.398 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:59:44.744 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.TestCompareAndWriteSuccessBufferlistGreaterLenPP (346 ms) 2024-09-16T16:59:44.744 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteSuccessBufferlistGreaterLenPP 2024-09-16T16:59:44.744 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:59:45.005 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:59:45.064 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteSuccessBufferlistGreaterLenPP (321 ms) 2024-09-16T16:59:45.065 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteStripeUnitUnalignedPP 2024-09-16T16:59:45.065 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:59:45.461 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.TestCompareAndWriteStripeUnitUnalignedPP (396 ms) 2024-09-16T16:59:45.461 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteStripeUnitUnalignedPP 2024-09-16T16:59:45.461 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:59:45.990 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:59:46.065 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteStripeUnitUnalignedPP (604 ms) 2024-09-16T16:59:46.065 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteTooLargePP 2024-09-16T16:59:46.065 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:59:46.449 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.TestCompareAndWriteTooLargePP (384 ms) 2024-09-16T16:59:46.449 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteTooLargePP 2024-09-16T16:59:46.449 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:59:46.868 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:59:46.944 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteTooLargePP (495 ms) 2024-09-16T16:59:46.944 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteStripeUnitSuccessPP 2024-09-16T16:59:46.944 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:59:49.664 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.TestCompareAndWriteStripeUnitSuccessPP (2720 ms) 2024-09-16T16:59:49.664 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteStripeUnitSuccessPP 2024-09-16T16:59:49.664 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:59:52.100 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:59:52.194 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteStripeUnitSuccessPP (2530 ms) 2024-09-16T16:59:52.195 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.TestIOPPWithIOHint 2024-09-16T16:59:52.195 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T16:59:52.493 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 512 2024-09-16T16:59:52.493 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 512 2024-09-16T16:59:52.493 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 512 2024-09-16T16:59:52.493 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 512 2024-09-16T16:59:52.493 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 512 2024-09-16T16:59:52.493 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:59:52.493 INFO:tasks.workunit.client.0.smithi122.stdout:started write 2024-09-16T16:59:52.493 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:59:52.505 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:59:52.505 INFO:tasks.workunit.client.0.smithi122.stdout:finished write 2024-09-16T16:59:52.505 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:59:52.505 INFO:tasks.workunit.client.0.smithi122.stdout:started write 2024-09-16T16:59:52.505 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:59:52.517 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:59:52.517 INFO:tasks.workunit.client.0.smithi122.stdout:finished write 2024-09-16T16:59:52.517 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:59:52.517 INFO:tasks.workunit.client.0.smithi122.stdout:started write 2024-09-16T16:59:52.517 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:59:52.530 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:59:52.530 INFO:tasks.workunit.client.0.smithi122.stdout:finished write 2024-09-16T16:59:52.530 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:59:52.530 INFO:tasks.workunit.client.0.smithi122.stdout:started write 2024-09-16T16:59:52.530 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:59:52.546 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:59:52.546 INFO:tasks.workunit.client.0.smithi122.stdout:finished write 2024-09-16T16:59:52.546 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:59:52.546 INFO:tasks.workunit.client.0.smithi122.stdout:started write 2024-09-16T16:59:52.546 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T16:59:52.555 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T16:59:52.555 INFO:tasks.workunit.client.0.smithi122.stdout:finished write 2024-09-16T16:59:52.555 INFO:tasks.workunit.client.0.smithi122.stdout:read: 512 2024-09-16T16:59:52.555 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:59:52.555 INFO:tasks.workunit.client.0.smithi122.stdout:started read 2024-09-16T16:59:52.555 INFO:tasks.workunit.client.0.smithi122.stdout:read completion cb called! 2024-09-16T16:59:52.559 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 512 2024-09-16T16:59:52.559 INFO:tasks.workunit.client.0.smithi122.stdout:finished read 2024-09-16T16:59:52.559 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:59:52.559 INFO:tasks.workunit.client.0.smithi122.stdout:started read 2024-09-16T16:59:52.559 INFO:tasks.workunit.client.0.smithi122.stdout:read completion cb called! 2024-09-16T16:59:52.563 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 512 2024-09-16T16:59:52.563 INFO:tasks.workunit.client.0.smithi122.stdout:finished read 2024-09-16T16:59:52.563 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:59:52.563 INFO:tasks.workunit.client.0.smithi122.stdout:started read 2024-09-16T16:59:52.563 INFO:tasks.workunit.client.0.smithi122.stdout:read completion cb called! 2024-09-16T16:59:52.567 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 512 2024-09-16T16:59:52.567 INFO:tasks.workunit.client.0.smithi122.stdout:finished read 2024-09-16T16:59:52.567 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:59:52.567 INFO:tasks.workunit.client.0.smithi122.stdout:started read 2024-09-16T16:59:52.567 INFO:tasks.workunit.client.0.smithi122.stdout:read completion cb called! 2024-09-16T16:59:52.571 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 512 2024-09-16T16:59:52.571 INFO:tasks.workunit.client.0.smithi122.stdout:finished read 2024-09-16T16:59:52.571 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T16:59:52.571 INFO:tasks.workunit.client.0.smithi122.stdout:started read 2024-09-16T16:59:52.571 INFO:tasks.workunit.client.0.smithi122.stdout:read completion cb called! 2024-09-16T17:00:13.449 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 512 2024-09-16T17:00:13.449 INFO:tasks.workunit.client.0.smithi122.stdout:finished read 2024-09-16T17:00:13.449 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 0 2024-09-16T17:00:13.450 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T17:00:13.450 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T17:00:13.450 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 0 2024-09-16T17:00:13.450 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T17:00:13.450 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T17:00:13.450 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 16384 2024-09-16T17:00:13.450 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T17:00:13.450 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T17:00:13.450 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 16384 2024-09-16T17:00:13.450 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T17:00:13.450 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T17:00:13.450 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T17:00:13.450 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T17:00:13.450 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 49152 2024-09-16T17:00:13.451 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T17:00:13.451 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T17:00:13.451 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 49152 2024-09-16T17:00:13.451 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T17:00:13.451 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T17:00:13.451 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 65536 2024-09-16T17:00:13.451 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T17:00:13.451 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T17:00:13.451 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 65536 2024-09-16T17:00:13.451 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T17:00:13.451 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T17:00:13.451 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T17:00:13.451 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T17:00:13.451 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 98304 2024-09-16T17:00:13.451 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T17:00:13.452 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T17:00:13.452 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 98304 2024-09-16T17:00:13.452 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T17:00:13.452 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T17:00:13.452 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 114688 2024-09-16T17:00:13.452 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T17:00:13.452 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T17:00:13.452 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 114688 2024-09-16T17:00:13.452 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T17:00:13.452 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T17:00:13.452 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T17:00:13.452 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T17:00:13.452 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 147456 2024-09-16T17:00:13.452 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T17:00:13.452 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T17:00:13.453 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 147456 2024-09-16T17:00:13.453 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T17:00:13.453 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T17:00:13.453 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 163840 2024-09-16T17:00:13.453 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T17:00:13.453 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T17:00:13.453 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 163840 2024-09-16T17:00:13.453 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T17:00:13.453 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T17:00:13.453 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T17:00:13.453 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T17:00:13.453 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 196608 2024-09-16T17:00:13.453 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T17:00:13.453 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T17:00:13.454 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 196608 2024-09-16T17:00:13.454 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T17:00:13.454 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T17:00:13.454 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 212992 2024-09-16T17:00:13.454 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T17:00:13.454 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T17:00:13.454 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 212992 2024-09-16T17:00:13.454 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T17:00:13.454 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T17:00:13.454 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T17:00:13.454 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T17:00:13.454 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T17:00:13.454 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T17:00:13.454 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T17:00:13.455 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T17:00:13.455 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T17:00:13.455 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T17:00:13.455 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T17:00:13.455 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T17:00:13.455 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T17:00:13.455 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T17:00:13.462 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T17:00:13.463 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T17:00:13.463 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T17:00:13.463 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T17:00:13.463 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T17:00:13.463 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T17:00:13.463 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T17:00:13.772 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T17:00:13.772 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T17:00:13.772 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T17:00:13.772 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T17:00:13.772 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T17:00:13.772 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T17:00:13.773 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T17:00:13.974 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T17:00:13.974 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T17:00:13.974 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T17:00:13.974 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T17:00:13.974 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T17:00:13.974 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T17:00:13.975 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T17:00:13.975 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T17:00:13.975 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T17:00:13.975 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T17:00:13.975 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T17:00:13.975 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T17:00:13.975 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T17:00:14.429 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T17:00:14.429 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T17:00:14.429 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T17:00:14.429 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T17:00:14.429 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T17:00:14.429 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T17:00:14.429 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T17:00:14.843 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T17:00:14.843 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T17:00:14.843 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T17:00:14.843 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T17:00:14.843 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T17:00:14.843 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T17:00:14.843 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T17:00:15.422 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T17:00:15.422 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T17:00:15.423 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T17:00:15.423 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T17:00:15.423 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T17:00:15.423 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T17:00:15.423 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T17:00:15.991 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T17:00:15.991 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T17:00:15.991 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T17:00:15.991 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T17:00:15.991 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T17:00:15.991 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T17:00:15.992 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T17:00:15.992 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T17:00:15.992 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T17:00:15.992 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T17:00:15.992 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T17:00:15.992 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T17:00:15.992 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T17:00:16.952 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T17:00:16.952 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T17:00:16.952 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T17:00:16.953 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T17:00:16.953 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T17:00:16.953 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T17:00:16.953 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T17:00:17.997 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T17:00:17.997 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T17:00:17.997 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T17:00:17.998 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T17:00:17.998 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T17:00:17.998 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T17:00:17.998 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T17:00:19.138 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T17:00:19.138 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T17:00:19.138 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T17:00:19.138 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T17:00:19.139 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T17:00:19.139 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T17:00:19.139 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T17:00:20.190 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T17:00:20.190 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T17:00:20.190 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T17:00:20.190 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T17:00:20.191 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T17:00:20.191 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T17:00:20.191 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T17:00:20.191 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T17:00:20.191 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T17:00:20.191 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T17:00:20.191 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T17:00:20.191 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T17:00:20.191 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T17:00:21.878 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T17:00:21.878 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T17:00:21.878 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T17:00:21.878 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T17:00:21.879 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T17:00:21.879 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T17:00:21.879 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T17:00:23.073 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T17:00:23.073 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T17:00:23.073 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T17:00:23.073 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T17:00:23.074 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T17:00:23.074 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T17:00:23.074 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T17:00:24.586 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T17:00:24.586 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T17:00:24.586 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T17:00:24.586 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T17:00:24.586 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T17:00:24.586 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T17:00:24.587 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T17:00:26.184 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T17:00:26.184 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T17:00:26.184 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T17:00:26.184 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T17:00:26.184 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T17:00:26.185 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T17:00:26.185 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T17:00:26.185 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T17:00:26.185 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T17:00:26.185 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T17:00:26.185 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T17:00:26.185 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T17:00:26.185 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T17:00:28.360 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T17:00:28.360 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T17:00:28.360 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T17:00:28.361 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T17:00:28.361 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T17:00:28.361 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T17:00:28.361 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T17:00:30.200 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T17:00:30.200 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T17:00:30.201 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T17:00:30.201 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T17:00:30.201 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T17:00:30.201 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T17:00:30.201 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T17:00:32.154 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T17:00:32.154 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T17:00:32.154 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T17:00:32.155 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T17:00:32.155 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T17:00:32.155 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T17:00:32.155 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T17:00:34.198 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T17:00:34.198 INFO:tasks.workunit.client.0.smithi122.stdout:finished writesame 2024-09-16T17:00:34.198 INFO:tasks.workunit.client.0.smithi122.stdout:to verify the data 2024-09-16T17:00:34.198 INFO:tasks.workunit.client.0.smithi122.stdout:verified 2024-09-16T17:00:34.198 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T17:00:34.199 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T17:00:34.199 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T17:00:34.199 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T17:00:34.199 INFO:tasks.workunit.client.0.smithi122.stdout:started writesame 2024-09-16T17:00:34.199 INFO:tasks.workunit.client.0.smithi122.stdout:expected fail, finished writesame 2024-09-16T17:00:34.199 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.TestIOPPWithIOHint (42003 ms) 2024-09-16T17:00:34.199 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.TestIOToSnapshot 2024-09-16T17:00:34.200 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:00:36.854 INFO:tasks.workunit.client.0.smithi122.stdout:num snaps is: 0 2024-09-16T17:00:36.854 INFO:tasks.workunit.client.0.smithi122.stdout:expected: 0 2024-09-16T17:00:36.854 INFO:tasks.workunit.client.0.smithi122.stdout:num snaps is: 1 2024-09-16T17:00:36.854 INFO:tasks.workunit.client.0.smithi122.stdout:expected: 1 2024-09-16T17:00:36.855 INFO:tasks.workunit.client.0.smithi122.stdout:snap: orig 2024-09-16T17:00:36.855 INFO:tasks.workunit.client.0.smithi122.stdout:found orig with size 2097152 2024-09-16T17:00:36.855 INFO:tasks.workunit.client.0.smithi122.stdout:read: 80 2024-09-16T17:00:36.855 INFO:tasks.workunit.client.0.smithi122.stdout:write test data! 2024-09-16T17:00:36.855 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 80 2024-09-16T17:00:36.855 INFO:tasks.workunit.client.0.smithi122.stdout:num snaps is: 2 2024-09-16T17:00:36.855 INFO:tasks.workunit.client.0.smithi122.stdout:expected: 2 2024-09-16T17:00:36.855 INFO:tasks.workunit.client.0.smithi122.stdout:snap: orig 2024-09-16T17:00:36.855 INFO:tasks.workunit.client.0.smithi122.stdout:snap: written 2024-09-16T17:00:36.855 INFO:tasks.workunit.client.0.smithi122.stdout:found orig with size 2097152 2024-09-16T17:00:36.855 INFO:tasks.workunit.client.0.smithi122.stdout:found written with size 2097152 2024-09-16T17:00:36.855 INFO:tasks.workunit.client.0.smithi122.stdout:read: 80 2024-09-16T17:00:36.855 INFO:tasks.workunit.client.0.smithi122.stdout:read: 80 2024-09-16T17:00:36.856 INFO:tasks.workunit.client.0.smithi122.stdout:read: 80 2024-09-16T17:00:36.856 INFO:tasks.workunit.client.0.smithi122.stdout:write to snapshot returned -30 2024-09-16T17:00:36.856 INFO:tasks.workunit.client.0.smithi122.stdout:Read-only file system 2024-09-16T17:00:37.159 INFO:tasks.workunit.client.0.smithi122.stdout:read: 80 2024-09-16T17:00:37.159 INFO:tasks.workunit.client.0.smithi122.stdout:read: 80 2024-09-16T17:00:37.160 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 80 2024-09-16T17:00:37.160 INFO:tasks.workunit.client.0.smithi122.stdout:opening testimg@orig 2024-09-16T17:00:37.160 INFO:tasks.workunit.client.0.smithi122.stdout:read: 80 2024-09-16T17:00:37.160 INFO:tasks.workunit.client.0.smithi122.stdout:write to snapshot returned -30 2024-09-16T17:00:37.160 INFO:tasks.workunit.client.0.smithi122.stdout:Read-only file system 2024-09-16T17:00:38.780 INFO:tasks.workunit.client.0.smithi122.stdout:num snaps is: 2 2024-09-16T17:00:38.780 INFO:tasks.workunit.client.0.smithi122.stdout:expected: 2 2024-09-16T17:00:38.780 INFO:tasks.workunit.client.0.smithi122.stdout:snap: orig 2024-09-16T17:00:38.780 INFO:tasks.workunit.client.0.smithi122.stdout:snap: written 2024-09-16T17:00:38.780 INFO:tasks.workunit.client.0.smithi122.stdout:found orig with size 2097152 2024-09-16T17:00:38.780 INFO:tasks.workunit.client.0.smithi122.stdout:found written with size 2097152 2024-09-16T17:00:38.780 INFO:tasks.workunit.client.0.smithi122.stdout:num snaps is: 1 2024-09-16T17:00:38.780 INFO:tasks.workunit.client.0.smithi122.stdout:expected: 1 2024-09-16T17:00:38.780 INFO:tasks.workunit.client.0.smithi122.stdout:snap: orig 2024-09-16T17:00:38.780 INFO:tasks.workunit.client.0.smithi122.stdout:found orig with size 2097152 2024-09-16T17:00:38.780 INFO:tasks.workunit.client.0.smithi122.stdout:num snaps is: 0 2024-09-16T17:00:38.780 INFO:tasks.workunit.client.0.smithi122.stdout:expected: 0 2024-09-16T17:00:38.781 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.TestIOToSnapshot (4582 ms) 2024-09-16T17:00:38.781 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.TestSnapshotDeletedIo 2024-09-16T17:00:38.781 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:00:40.772 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.TestSnapshotDeletedIo (1992 ms) 2024-09-16T17:00:40.772 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.TestClone 2024-09-16T17:00:40.772 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:00:50.265 INFO:tasks.workunit.client.0.smithi122.stdout:made parent image "parent" 2024-09-16T17:00:50.266 INFO:tasks.workunit.client.0.smithi122.stdout:parent has no parent info 2024-09-16T17:00:50.266 INFO:tasks.workunit.client.0.smithi122.stdout:made snapshot "parent@parent_snap" 2024-09-16T17:00:50.266 INFO:tasks.workunit.client.0.smithi122.stdout:can't unprotect an unprotected snap 2024-09-16T17:00:50.266 INFO:tasks.workunit.client.0.smithi122.stdout:can't protect a protected snap 2024-09-16T17:00:50.266 INFO:tasks.workunit.client.0.smithi122.stdout:made and opened clone "child" 2024-09-16T17:00:50.266 INFO:tasks.workunit.client.0.smithi122.stdout:read: 8 2024-09-16T17:00:50.266 INFO:tasks.workunit.client.0.smithi122.stdout:read: 8 2024-09-16T17:00:50.266 INFO:tasks.workunit.client.0.smithi122.stdout:read: 8 2024-09-16T17:00:50.266 INFO:tasks.workunit.client.0.smithi122.stdout:sizes and overlaps are good between parent and child 2024-09-16T17:00:50.266 INFO:tasks.workunit.client.0.smithi122.stdout:child image successfully cloned all image-meta pairs 2024-09-16T17:00:50.266 INFO:tasks.workunit.client.0.smithi122.stdout:sized down clone, changed overlap 2024-09-16T17:00:50.266 INFO:tasks.workunit.client.0.smithi122.stdout:parent info: size 4194304 obj_size 4194304 parent_pool 18446744073709551615 2024-09-16T17:00:50.266 INFO:tasks.workunit.client.0.smithi122.stdout:sized up clone, changed size but not overlap or parent's size 2024-09-16T17:00:50.267 INFO:tasks.workunit.client.0.smithi122.stdout:can't remove parent while child still exists 2024-09-16T17:00:50.267 INFO:tasks.workunit.client.0.smithi122.stdout:can't remove parent while still protected 2024-09-16T17:00:50.267 INFO:tasks.workunit.client.0.smithi122.stdout:removed parent snap after unprotecting 2024-09-16T17:00:50.267 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.TestClone (9494 ms) 2024-09-16T17:00:50.267 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.TestClone2 2024-09-16T17:00:50.267 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:00:57.004 INFO:tasks.workunit.client.0.smithi122.stdout:made parent image "parent" 2024-09-16T17:00:57.004 INFO:tasks.workunit.client.0.smithi122.stdout:parent has no parent info 2024-09-16T17:00:57.004 INFO:tasks.workunit.client.0.smithi122.stdout:made snapshot "parent@parent_snap" 2024-09-16T17:00:57.004 INFO:tasks.workunit.client.0.smithi122.stdout:made and opened clone "child" 2024-09-16T17:00:57.004 INFO:tasks.workunit.client.0.smithi122.stdout:child image successfully cloned all image-meta pairs 2024-09-16T17:00:57.005 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.TestClone2 (6736 ms) 2024-09-16T17:00:57.005 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.ListChildren 2024-09-16T17:01:00.197 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:01:12.291 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:01:12.291 INFO:tasks.workunit.client.0.smithi122.stdout:trying to find test-librbd-smithi122-30518-17/image124 2024-09-16T17:01:12.291 INFO:tasks.workunit.client.0.smithi122.stdout:checking test-librbd-smithi122-30518-17/image124 2024-09-16T17:01:12.291 INFO:tasks.workunit.client.0.smithi122.stdout:found child test-librbd-smithi122-30518-17/image124 2024-09-16T17:01:12.291 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:01:12.291 INFO:tasks.workunit.client.0.smithi122.stdout:num children is: 1 2024-09-16T17:01:12.291 INFO:tasks.workunit.client.0.smithi122.stdout:expected: 1 2024-09-16T17:01:12.291 INFO:tasks.workunit.client.0.smithi122.stdout:child: image124 2024-09-16T17:01:12.292 INFO:tasks.workunit.client.0.smithi122.stdout:found child test-librbd-smithi122-30518-17/image124/105fda27f176 2024-09-16T17:01:12.292 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:01:12.292 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:01:12.292 INFO:tasks.workunit.client.0.smithi122.stdout:trying to find test-librbd-smithi122-30518-17/image124 2024-09-16T17:01:12.292 INFO:tasks.workunit.client.0.smithi122.stdout:checking test-librbd-smithi122-30518-16/image125 2024-09-16T17:01:12.292 INFO:tasks.workunit.client.0.smithi122.stdout:checking test-librbd-smithi122-30518-17/image124 2024-09-16T17:01:12.292 INFO:tasks.workunit.client.0.smithi122.stdout:found child test-librbd-smithi122-30518-17/image124 2024-09-16T17:01:12.292 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:01:12.292 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:01:12.292 INFO:tasks.workunit.client.0.smithi122.stdout:trying to find test-librbd-smithi122-30518-16/image125 2024-09-16T17:01:12.292 INFO:tasks.workunit.client.0.smithi122.stdout:checking test-librbd-smithi122-30518-16/image125 2024-09-16T17:01:12.292 INFO:tasks.workunit.client.0.smithi122.stdout:found child test-librbd-smithi122-30518-16/image125 2024-09-16T17:01:12.292 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:01:12.293 INFO:tasks.workunit.client.0.smithi122.stdout:num children is: 2 2024-09-16T17:01:12.293 INFO:tasks.workunit.client.0.smithi122.stdout:expected: 2 2024-09-16T17:01:12.293 INFO:tasks.workunit.client.0.smithi122.stdout:child: image125 2024-09-16T17:01:12.293 INFO:tasks.workunit.client.0.smithi122.stdout:child: image124 2024-09-16T17:01:12.293 INFO:tasks.workunit.client.0.smithi122.stdout:found child test-librbd-smithi122-30518-17/image124/105fda27f176 2024-09-16T17:01:12.293 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:01:12.293 INFO:tasks.workunit.client.0.smithi122.stdout:found child test-librbd-smithi122-30518-16/image125/105f8413771d 2024-09-16T17:01:12.293 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:01:12.293 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:01:12.293 INFO:tasks.workunit.client.0.smithi122.stdout:trying to find test-librbd-smithi122-30518-17/image124 2024-09-16T17:01:12.293 INFO:tasks.workunit.client.0.smithi122.stdout:checking test-librbd-smithi122-30518-16/image125 2024-09-16T17:01:12.293 INFO:tasks.workunit.client.0.smithi122.stdout:checking test-librbd-smithi122-30518-17/image124 2024-09-16T17:01:12.293 INFO:tasks.workunit.client.0.smithi122.stdout:found child test-librbd-smithi122-30518-17/image124 2024-09-16T17:01:12.293 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:01:12.294 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:01:12.294 INFO:tasks.workunit.client.0.smithi122.stdout:trying to find test-librbd-smithi122-30518-16/image125 2024-09-16T17:01:12.294 INFO:tasks.workunit.client.0.smithi122.stdout:checking test-librbd-smithi122-30518-16/image125 2024-09-16T17:01:12.294 INFO:tasks.workunit.client.0.smithi122.stdout:found child test-librbd-smithi122-30518-16/image125 2024-09-16T17:01:12.294 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:01:12.294 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:01:12.294 INFO:tasks.workunit.client.0.smithi122.stdout:trying to find test-librbd-smithi122-30518-17/image126 2024-09-16T17:01:12.294 INFO:tasks.workunit.client.0.smithi122.stdout:checking test-librbd-smithi122-30518-16/image125 2024-09-16T17:01:12.294 INFO:tasks.workunit.client.0.smithi122.stdout:checking test-librbd-smithi122-30518-17/image124 2024-09-16T17:01:12.294 INFO:tasks.workunit.client.0.smithi122.stdout:checking test-librbd-smithi122-30518-17/image126 2024-09-16T17:01:12.294 INFO:tasks.workunit.client.0.smithi122.stdout:found child test-librbd-smithi122-30518-17/image126 2024-09-16T17:01:12.294 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:01:12.294 INFO:tasks.workunit.client.0.smithi122.stdout:num children is: 3 2024-09-16T17:01:12.295 INFO:tasks.workunit.client.0.smithi122.stdout:expected: 3 2024-09-16T17:01:12.295 INFO:tasks.workunit.client.0.smithi122.stdout:child: image125 2024-09-16T17:01:12.295 INFO:tasks.workunit.client.0.smithi122.stdout:child: image124 2024-09-16T17:01:12.295 INFO:tasks.workunit.client.0.smithi122.stdout:child: image126 2024-09-16T17:01:12.295 INFO:tasks.workunit.client.0.smithi122.stdout:found child test-librbd-smithi122-30518-17/image124/105fda27f176 2024-09-16T17:01:12.295 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:01:12.295 INFO:tasks.workunit.client.0.smithi122.stdout:found child test-librbd-smithi122-30518-16/image125/105f8413771d 2024-09-16T17:01:12.295 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:01:12.295 INFO:tasks.workunit.client.0.smithi122.stdout:found child test-librbd-smithi122-30518-17/image126/105f6a1822f4 2024-09-16T17:01:12.295 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:01:12.295 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:01:12.295 INFO:tasks.workunit.client.0.smithi122.stdout:trying to find test-librbd-smithi122-30518-17/image124 2024-09-16T17:01:12.295 INFO:tasks.workunit.client.0.smithi122.stdout:checking test-librbd-smithi122-30518-16/image125 2024-09-16T17:01:12.296 INFO:tasks.workunit.client.0.smithi122.stdout:checking test-librbd-smithi122-30518-17/image124 2024-09-16T17:01:12.296 INFO:tasks.workunit.client.0.smithi122.stdout:found child test-librbd-smithi122-30518-17/image124 2024-09-16T17:01:12.296 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:01:12.296 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:01:12.296 INFO:tasks.workunit.client.0.smithi122.stdout:trying to find test-librbd-smithi122-30518-16/image125 2024-09-16T17:01:12.296 INFO:tasks.workunit.client.0.smithi122.stdout:checking test-librbd-smithi122-30518-16/image125 2024-09-16T17:01:12.296 INFO:tasks.workunit.client.0.smithi122.stdout:found child test-librbd-smithi122-30518-16/image125 2024-09-16T17:01:12.296 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:01:12.296 INFO:tasks.workunit.client.0.smithi122.stdout:num children is: 3 2024-09-16T17:01:12.296 INFO:tasks.workunit.client.0.smithi122.stdout:expected: 3 2024-09-16T17:01:12.296 INFO:tasks.workunit.client.0.smithi122.stdout:child: image125 2024-09-16T17:01:12.296 INFO:tasks.workunit.client.0.smithi122.stdout:child: image124 2024-09-16T17:01:12.296 INFO:tasks.workunit.client.0.smithi122.stdout:child: image126 2024-09-16T17:01:12.296 INFO:tasks.workunit.client.0.smithi122.stdout:found child test-librbd-smithi122-30518-17/image124/105fda27f176 2024-09-16T17:01:12.297 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:01:12.297 INFO:tasks.workunit.client.0.smithi122.stdout:found child test-librbd-smithi122-30518-16/image125/105f8413771d 2024-09-16T17:01:12.297 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:01:12.297 INFO:tasks.workunit.client.0.smithi122.stdout:found child test-librbd-smithi122-30518-17/image126/105f6a1822f4 2024-09-16T17:01:12.297 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:01:12.297 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:01:12.297 INFO:tasks.workunit.client.0.smithi122.stdout:trying to find test-librbd-smithi122-30518-17/image124 2024-09-16T17:01:12.297 INFO:tasks.workunit.client.0.smithi122.stdout:checking test-librbd-smithi122-30518-16/image125 2024-09-16T17:01:12.297 INFO:tasks.workunit.client.0.smithi122.stdout:checking test-librbd-smithi122-30518-17/image124 2024-09-16T17:01:12.297 INFO:tasks.workunit.client.0.smithi122.stdout:found child test-librbd-smithi122-30518-17/image124 2024-09-16T17:01:12.297 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:01:12.297 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:01:12.297 INFO:tasks.workunit.client.0.smithi122.stdout:trying to find test-librbd-smithi122-30518-16/image125 2024-09-16T17:01:12.297 INFO:tasks.workunit.client.0.smithi122.stdout:checking test-librbd-smithi122-30518-16/image125 2024-09-16T17:01:12.298 INFO:tasks.workunit.client.0.smithi122.stdout:found child test-librbd-smithi122-30518-16/image125 2024-09-16T17:01:12.298 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:01:12.298 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:01:12.298 INFO:tasks.workunit.client.0.smithi122.stdout:trying to find test-librbd-smithi122-30518-17/image127 2024-09-16T17:01:12.298 INFO:tasks.workunit.client.0.smithi122.stdout:checking test-librbd-smithi122-30518-16/image125 2024-09-16T17:01:12.298 INFO:tasks.workunit.client.0.smithi122.stdout:checking test-librbd-smithi122-30518-17/image124 2024-09-16T17:01:12.298 INFO:tasks.workunit.client.0.smithi122.stdout:checking test-librbd-smithi122-30518-17/image127 2024-09-16T17:01:12.298 INFO:tasks.workunit.client.0.smithi122.stdout:found child test-librbd-smithi122-30518-17/image127 2024-09-16T17:01:12.298 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:01:12.298 INFO:tasks.workunit.client.0.smithi122.stdout:num children is: 4 2024-09-16T17:01:12.298 INFO:tasks.workunit.client.0.smithi122.stdout:expected: 4 2024-09-16T17:01:12.298 INFO:tasks.workunit.client.0.smithi122.stdout:child: image125 2024-09-16T17:01:12.298 INFO:tasks.workunit.client.0.smithi122.stdout:child: image124 2024-09-16T17:01:12.298 INFO:tasks.workunit.client.0.smithi122.stdout:child: image126 2024-09-16T17:01:12.299 INFO:tasks.workunit.client.0.smithi122.stdout:child: image127 2024-09-16T17:01:12.299 INFO:tasks.workunit.client.0.smithi122.stdout:found child test-librbd-smithi122-30518-17/image124/105fda27f176 2024-09-16T17:01:12.299 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:01:12.299 INFO:tasks.workunit.client.0.smithi122.stdout:found child test-librbd-smithi122-30518-16/image125/105f8413771d 2024-09-16T17:01:12.299 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:01:12.299 INFO:tasks.workunit.client.0.smithi122.stdout:found child test-librbd-smithi122-30518-17/image126/105f6a1822f4 2024-09-16T17:01:12.299 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:01:12.299 INFO:tasks.workunit.client.0.smithi122.stdout:found child test-librbd-smithi122-30518-17/image127/105fc92faa30 2024-09-16T17:01:12.299 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:01:12.299 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:01:12.299 INFO:tasks.workunit.client.0.smithi122.stdout:trying to find test-librbd-smithi122-30518-17/image124 2024-09-16T17:01:12.299 INFO:tasks.workunit.client.0.smithi122.stdout:checking test-librbd-smithi122-30518-16/image125 2024-09-16T17:01:12.299 INFO:tasks.workunit.client.0.smithi122.stdout:checking test-librbd-smithi122-30518-17/image124 2024-09-16T17:01:12.300 INFO:tasks.workunit.client.0.smithi122.stdout:found child test-librbd-smithi122-30518-17/image124 2024-09-16T17:01:12.300 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:01:12.300 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:01:12.300 INFO:tasks.workunit.client.0.smithi122.stdout:trying to find test-librbd-smithi122-30518-16/image125 2024-09-16T17:01:12.300 INFO:tasks.workunit.client.0.smithi122.stdout:checking test-librbd-smithi122-30518-16/image125 2024-09-16T17:01:12.300 INFO:tasks.workunit.client.0.smithi122.stdout:found child test-librbd-smithi122-30518-16/image125 2024-09-16T17:01:12.300 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:01:12.300 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:01:12.300 INFO:tasks.workunit.client.0.smithi122.stdout:trying to find test-librbd-smithi122-30518-17/image126 2024-09-16T17:01:12.300 INFO:tasks.workunit.client.0.smithi122.stdout:checking test-librbd-smithi122-30518-16/image125 2024-09-16T17:01:12.300 INFO:tasks.workunit.client.0.smithi122.stdout:checking test-librbd-smithi122-30518-17/image124 2024-09-16T17:01:12.300 INFO:tasks.workunit.client.0.smithi122.stdout:checking test-librbd-smithi122-30518-17/image126 2024-09-16T17:01:12.300 INFO:tasks.workunit.client.0.smithi122.stdout:found child test-librbd-smithi122-30518-17/image126 2024-09-16T17:01:12.301 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:01:12.301 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:01:12.301 INFO:tasks.workunit.client.0.smithi122.stdout:trying to find test-librbd-smithi122-30518-17/image127 2024-09-16T17:01:12.301 INFO:tasks.workunit.client.0.smithi122.stdout:checking test-librbd-smithi122-30518-16/image125 2024-09-16T17:01:20.308 INFO:tasks.workunit.client.0.smithi122.stdout:checking test-librbd-smithi122-30518-17/image124 2024-09-16T17:01:20.308 INFO:tasks.workunit.client.0.smithi122.stdout:checking test-librbd-smithi122-30518-17/image126 2024-09-16T17:01:20.309 INFO:tasks.workunit.client.0.smithi122.stdout:checking test-librbd-smithi122-30518-17/image127 2024-09-16T17:01:20.309 INFO:tasks.workunit.client.0.smithi122.stdout:found child test-librbd-smithi122-30518-17/image127 2024-09-16T17:01:20.309 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:01:20.309 INFO:tasks.workunit.client.0.smithi122.stdout:num children is: 4 2024-09-16T17:01:20.309 INFO:tasks.workunit.client.0.smithi122.stdout:expected: 4 2024-09-16T17:01:20.309 INFO:tasks.workunit.client.0.smithi122.stdout:child: image125 2024-09-16T17:01:20.309 INFO:tasks.workunit.client.0.smithi122.stdout:child: image124 2024-09-16T17:01:20.309 INFO:tasks.workunit.client.0.smithi122.stdout:child: image126 2024-09-16T17:01:20.309 INFO:tasks.workunit.client.0.smithi122.stdout:child: image127 2024-09-16T17:01:20.309 INFO:tasks.workunit.client.0.smithi122.stdout:found child test-librbd-smithi122-30518-17/image124/105fda27f176 2024-09-16T17:01:20.309 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:01:20.309 INFO:tasks.workunit.client.0.smithi122.stdout:found child test-librbd-smithi122-30518-16/image125/105f8413771d 2024-09-16T17:01:20.309 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:01:20.310 INFO:tasks.workunit.client.0.smithi122.stdout:found child test-librbd-smithi122-30518-17/image126/105f6a1822f4 2024-09-16T17:01:20.310 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:01:20.310 INFO:tasks.workunit.client.0.smithi122.stdout:found child test-librbd-smithi122-30518-17/image127/105fc92faa30 2024-09-16T17:01:20.310 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:01:20.310 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:01:20.310 INFO:tasks.workunit.client.0.smithi122.stdout:trying to find test-librbd-smithi122-30518-16/image125 2024-09-16T17:01:20.310 INFO:tasks.workunit.client.0.smithi122.stdout:checking test-librbd-smithi122-30518-16/image125 2024-09-16T17:01:20.310 INFO:tasks.workunit.client.0.smithi122.stdout:found child test-librbd-smithi122-30518-16/image125 2024-09-16T17:01:20.310 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:01:20.310 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:01:20.310 INFO:tasks.workunit.client.0.smithi122.stdout:trying to find test-librbd-smithi122-30518-17/image126 2024-09-16T17:01:20.310 INFO:tasks.workunit.client.0.smithi122.stdout:checking test-librbd-smithi122-30518-16/image125 2024-09-16T17:01:20.310 INFO:tasks.workunit.client.0.smithi122.stdout:checking test-librbd-smithi122-30518-17/image126 2024-09-16T17:01:20.310 INFO:tasks.workunit.client.0.smithi122.stdout:found child test-librbd-smithi122-30518-17/image126 2024-09-16T17:01:20.310 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:01:20.311 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:01:20.311 INFO:tasks.workunit.client.0.smithi122.stdout:trying to find test-librbd-smithi122-30518-17/image127 2024-09-16T17:01:20.311 INFO:tasks.workunit.client.0.smithi122.stdout:checking test-librbd-smithi122-30518-16/image125 2024-09-16T17:01:20.311 INFO:tasks.workunit.client.0.smithi122.stdout:checking test-librbd-smithi122-30518-17/image126 2024-09-16T17:01:20.311 INFO:tasks.workunit.client.0.smithi122.stdout:checking test-librbd-smithi122-30518-17/image127 2024-09-16T17:01:20.311 INFO:tasks.workunit.client.0.smithi122.stdout:found child test-librbd-smithi122-30518-17/image127 2024-09-16T17:01:20.311 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:01:20.311 INFO:tasks.workunit.client.0.smithi122.stdout:num children is: 3 2024-09-16T17:01:20.311 INFO:tasks.workunit.client.0.smithi122.stdout:expected: 3 2024-09-16T17:01:20.311 INFO:tasks.workunit.client.0.smithi122.stdout:child: image125 2024-09-16T17:01:20.311 INFO:tasks.workunit.client.0.smithi122.stdout:child: image126 2024-09-16T17:01:20.311 INFO:tasks.workunit.client.0.smithi122.stdout:child: image127 2024-09-16T17:01:20.311 INFO:tasks.workunit.client.0.smithi122.stdout:found child test-librbd-smithi122-30518-16/image125/105f8413771d 2024-09-16T17:01:20.311 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:01:20.311 INFO:tasks.workunit.client.0.smithi122.stdout:found child test-librbd-smithi122-30518-17/image126/105f6a1822f4 2024-09-16T17:01:20.311 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:01:20.312 INFO:tasks.workunit.client.0.smithi122.stdout:found child test-librbd-smithi122-30518-17/image127/105fc92faa30 2024-09-16T17:01:20.312 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:01:20.312 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:01:20.312 INFO:tasks.workunit.client.0.smithi122.stdout:trying to find test-librbd-smithi122-30518-16/image125 2024-09-16T17:01:20.312 INFO:tasks.workunit.client.0.smithi122.stdout:checking test-librbd-smithi122-30518-16/image125 2024-09-16T17:01:20.312 INFO:tasks.workunit.client.0.smithi122.stdout:found child test-librbd-smithi122-30518-16/image125 2024-09-16T17:01:20.312 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:01:20.312 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:01:20.312 INFO:tasks.workunit.client.0.smithi122.stdout:trying to find test-librbd-smithi122-30518-17/image127 2024-09-16T17:01:20.312 INFO:tasks.workunit.client.0.smithi122.stdout:checking test-librbd-smithi122-30518-16/image125 2024-09-16T17:01:20.312 INFO:tasks.workunit.client.0.smithi122.stdout:checking test-librbd-smithi122-30518-17/image127 2024-09-16T17:01:20.312 INFO:tasks.workunit.client.0.smithi122.stdout:found child test-librbd-smithi122-30518-17/image127 2024-09-16T17:01:20.312 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:01:20.312 INFO:tasks.workunit.client.0.smithi122.stdout:num children is: 2 2024-09-16T17:01:20.313 INFO:tasks.workunit.client.0.smithi122.stdout:expected: 2 2024-09-16T17:01:20.313 INFO:tasks.workunit.client.0.smithi122.stdout:child: image125 2024-09-16T17:01:20.313 INFO:tasks.workunit.client.0.smithi122.stdout:child: image127 2024-09-16T17:01:20.313 INFO:tasks.workunit.client.0.smithi122.stdout:found child test-librbd-smithi122-30518-16/image125/105f8413771d 2024-09-16T17:01:20.313 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:01:20.313 INFO:tasks.workunit.client.0.smithi122.stdout:found child test-librbd-smithi122-30518-17/image127/105fc92faa30 2024-09-16T17:01:20.313 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:01:20.313 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:01:20.313 INFO:tasks.workunit.client.0.smithi122.stdout:trying to find test-librbd-smithi122-30518-16/image125 2024-09-16T17:01:20.313 INFO:tasks.workunit.client.0.smithi122.stdout:checking test-librbd-smithi122-30518-16/image125 2024-09-16T17:01:20.313 INFO:tasks.workunit.client.0.smithi122.stdout:found child test-librbd-smithi122-30518-16/image125 2024-09-16T17:01:20.313 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:01:20.313 INFO:tasks.workunit.client.0.smithi122.stdout:num children is: 1 2024-09-16T17:01:20.313 INFO:tasks.workunit.client.0.smithi122.stdout:expected: 1 2024-09-16T17:01:20.314 INFO:tasks.workunit.client.0.smithi122.stdout:child: image125 2024-09-16T17:01:20.314 INFO:tasks.workunit.client.0.smithi122.stdout:found child test-librbd-smithi122-30518-16/image125/105f8413771d 2024-09-16T17:01:20.314 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:01:20.314 INFO:tasks.workunit.client.0.smithi122.stdout:num children is: 0 2024-09-16T17:01:20.314 INFO:tasks.workunit.client.0.smithi122.stdout:expected: 0 2024-09-16T17:01:20.314 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.ListChildren (23307 ms) 2024-09-16T17:01:20.314 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.ListChildrenTiered 2024-09-16T17:01:20.314 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:6995: Skipped 2024-09-16T17:01:20.314 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-16T17:01:20.314 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestLibRBD.ListChildrenTiered (0 ms) 2024-09-16T17:01:20.314 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.LockingPP 2024-09-16T17:01:20.314 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:01:20.849 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.LockingPP (541 ms) 2024-09-16T17:01:20.849 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.FlushAio 2024-09-16T17:01:20.849 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:01:25.236 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.FlushAio (4387 ms) 2024-09-16T17:01:25.237 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.FlushAioPP 2024-09-16T17:01:25.237 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:01:27.718 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.FlushAioPP (2481 ms) 2024-09-16T17:01:27.718 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.ZeroLengthWrite 2024-09-16T17:01:27.718 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:01:27.983 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.ZeroLengthWrite (266 ms) 2024-09-16T17:01:27.983 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.ZeroLengthDiscard 2024-09-16T17:01:27.984 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:01:28.572 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.ZeroLengthDiscard (589 ms) 2024-09-16T17:01:28.572 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.ZeroLengthRead 2024-09-16T17:01:28.572 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:01:28.772 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.ZeroLengthRead (200 ms) 2024-09-16T17:01:28.773 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.LargeCacheRead 2024-09-16T17:01:28.773 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:01:29.078 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.LargeCacheRead (306 ms) 2024-09-16T17:01:29.078 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.TestPendingAio 2024-09-16T17:01:29.078 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:01:32.659 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.TestPendingAio (3581 ms) 2024-09-16T17:01:32.660 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.CompareAndWriteCopyup 2024-09-16T17:01:32.660 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:01:34.461 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:01:37.958 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.CompareAndWriteCopyup (5299 ms) 2024-09-16T17:01:37.958 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.CompareAndWriteCopyupMismatch 2024-09-16T17:01:37.958 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:01:40.474 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:01:43.849 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.CompareAndWriteCopyupMismatch (5891 ms) 2024-09-16T17:01:43.849 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.Flatten 2024-09-16T17:01:43.849 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:01:45.535 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.Flatten (1686 ms) 2024-09-16T17:01:45.535 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.Sparsify 2024-09-16T17:01:45.535 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:01:46.105 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 32768 2024-09-16T17:01:46.105 INFO:tasks.workunit.client.0.smithi122.stdout:read: 32768 2024-09-16T17:01:46.105 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.Sparsify (570 ms) 2024-09-16T17:01:46.105 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.SparsifyPP 2024-09-16T17:01:46.105 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:01:46.475 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.SparsifyPP (370 ms) 2024-09-16T17:01:46.475 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.SnapshotLimit 2024-09-16T17:01:46.475 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:01:51.731 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.SnapshotLimit (5256 ms) 2024-09-16T17:01:51.731 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.SnapshotLimitPP 2024-09-16T17:01:51.731 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:01:56.767 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.SnapshotLimitPP (5036 ms) 2024-09-16T17:01:56.767 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.RebuildObjectMapViaLockOwner 2024-09-16T17:01:56.767 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:01:57.449 INFO:tasks.workunit.client.0.smithi122.stdout:0.00% done 2024-09-16T17:01:57.449 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.RebuildObjectMapViaLockOwner (682 ms) 2024-09-16T17:01:57.449 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.RenameViaLockOwner 2024-09-16T17:01:57.449 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:01:58.463 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.RenameViaLockOwner (1014 ms) 2024-09-16T17:01:58.463 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.SnapCreateViaLockOwner 2024-09-16T17:01:58.463 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:01:59.876 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.SnapCreateViaLockOwner (1413 ms) 2024-09-16T17:01:59.876 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.SnapRemoveViaLockOwner 2024-09-16T17:01:59.876 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:02:02.064 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.SnapRemoveViaLockOwner (2188 ms) 2024-09-16T17:02:02.065 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.UpdateFeaturesViaLockOwner 2024-09-16T17:02:02.065 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:02:02.727 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.UpdateFeaturesViaLockOwner (663 ms) 2024-09-16T17:02:02.728 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.EnableJournalingViaLockOwner 2024-09-16T17:02:02.728 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:9736: Skipped 2024-09-16T17:02:02.728 INFO:tasks.workunit.client.0.smithi122.stdout:Skipping due to unmet REQUIRE 2024-09-16T17:02:02.728 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestLibRBD.EnableJournalingViaLockOwner (0 ms) 2024-09-16T17:02:02.728 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.SnapRemove2 2024-09-16T17:02:02.728 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:02:05.838 INFO:tasks.workunit.client.0.smithi122.stdout:100.00% done 2024-09-16T17:02:05.838 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.SnapRemove2 (3110 ms) 2024-09-16T17:02:05.838 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.SnapRenameViaLockOwner 2024-09-16T17:02:05.838 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:02:06.983 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.SnapRenameViaLockOwner (1145 ms) 2024-09-16T17:02:06.983 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.SnapProtectViaLockOwner 2024-09-16T17:02:06.983 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:02:07.991 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.SnapProtectViaLockOwner (1008 ms) 2024-09-16T17:02:07.992 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.SnapUnprotectViaLockOwner 2024-09-16T17:02:07.992 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:02:10.346 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.SnapUnprotectViaLockOwner (2355 ms) 2024-09-16T17:02:10.347 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.FlattenViaLockOwner 2024-09-16T17:02:10.347 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:02:13.017 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.FlattenViaLockOwner (2671 ms) 2024-09-16T17:02:13.017 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.ResizeViaLockOwner 2024-09-16T17:02:13.017 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:02:13.509 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.ResizeViaLockOwner (492 ms) 2024-09-16T17:02:13.509 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.SparsifyViaLockOwner 2024-09-16T17:02:13.509 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:02:14.115 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.SparsifyViaLockOwner (606 ms) 2024-09-16T17:02:14.115 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.ObjectMapConsistentSnap 2024-09-16T17:02:14.115 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:02:33.200 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.ObjectMapConsistentSnap (19085 ms) 2024-09-16T17:02:33.200 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.Metadata 2024-09-16T17:02:33.200 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:02:36.076 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.Metadata (2876 ms) 2024-09-16T17:02:36.077 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.MetadataPP 2024-09-16T17:02:36.077 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:02:38.912 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.MetadataPP (2836 ms) 2024-09-16T17:02:38.912 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.UpdateFeatures 2024-09-16T17:02:38.912 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:02:40.418 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.UpdateFeatures (1506 ms) 2024-09-16T17:02:40.418 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.FeaturesBitmaskString 2024-09-16T17:02:40.418 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.FeaturesBitmaskString (0 ms) 2024-09-16T17:02:40.418 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.RebuildObjectMap 2024-09-16T17:02:40.418 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:02:42.310 INFO:tasks.workunit.client.0.smithi122.stdout:0.00% done 2024-09-16T17:02:42.310 INFO:tasks.workunit.client.0.smithi122.stdout:25.00% done 2024-09-16T17:02:42.310 INFO:tasks.workunit.client.0.smithi122.stdout:50.00% done 2024-09-16T17:02:42.311 INFO:tasks.workunit.client.0.smithi122.stdout:75.00% done 2024-09-16T17:02:42.311 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.RebuildObjectMap (1892 ms) 2024-09-16T17:02:42.311 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.RebuildNewObjectMap 2024-09-16T17:02:42.819 INFO:tasks.workunit.client.0.smithi122.stdout:0.00% done 2024-09-16T17:02:42.819 INFO:tasks.workunit.client.0.smithi122.stdout:25.00% done 2024-09-16T17:02:42.819 INFO:tasks.workunit.client.0.smithi122.stdout:50.00% done 2024-09-16T17:02:42.819 INFO:tasks.workunit.client.0.smithi122.stdout:75.00% done 2024-09-16T17:02:42.819 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.RebuildNewObjectMap (508 ms) 2024-09-16T17:02:42.819 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.CheckObjectMap 2024-09-16T17:02:42.819 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:02:44.278 INFO:tasks.workunit.client.0.smithi122.stdout:0.00% done 2024-09-16T17:02:44.278 INFO:tasks.workunit.client.0.smithi122.stdout:25.00% done 2024-09-16T17:02:44.278 INFO:tasks.workunit.client.0.smithi122.stdout:50.00% done 2024-09-16T17:02:44.278 INFO:tasks.workunit.client.0.smithi122.stdout:75.00% done 2024-09-16T17:02:44.278 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.CheckObjectMap (1459 ms) 2024-09-16T17:02:44.278 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.BlockingAIO 2024-09-16T17:02:44.278 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:02:44.568 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.BlockingAIO (290 ms) 2024-09-16T17:02:44.568 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.ExclusiveLockTransition 2024-09-16T17:02:44.568 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:02:47.144 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.ExclusiveLockTransition (2575 ms) 2024-09-16T17:02:47.144 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.ExclusiveLockReadTransition 2024-09-16T17:02:47.144 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:10793: Skipped 2024-09-16T17:02:47.144 INFO:tasks.workunit.client.0.smithi122.stdout:Skipping due to unmet REQUIRE 2024-09-16T17:02:47.144 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestLibRBD.ExclusiveLockReadTransition (0 ms) 2024-09-16T17:02:47.144 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.CacheMayCopyOnWrite 2024-09-16T17:02:47.144 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:02:49.306 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.CacheMayCopyOnWrite (2162 ms) 2024-09-16T17:02:49.306 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.FlushEmptyOpsOnExternalSnapshot 2024-09-16T17:02:49.306 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:02:50.862 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.FlushEmptyOpsOnExternalSnapshot (1557 ms) 2024-09-16T17:02:50.862 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.TestImageOptions 2024-09-16T17:02:53.030 INFO:tasks.workunit.client.0.smithi122.stdout:0.00% done 2024-09-16T17:02:53.030 INFO:tasks.workunit.client.0.smithi122.stdout:100.00% done 2024-09-16T17:02:53.030 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.TestImageOptions (2168 ms) 2024-09-16T17:02:53.030 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.TestImageOptionsPP 2024-09-16T17:02:55.546 INFO:tasks.workunit.client.0.smithi122.stdout:0.00% done 2024-09-16T17:02:55.546 INFO:tasks.workunit.client.0.smithi122.stdout:100.00% done 2024-09-16T17:02:55.546 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.TestImageOptionsPP (2516 ms) 2024-09-16T17:02:55.546 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.EventSocketPipe 2024-09-16T17:02:55.546 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.EventSocketPipe (0 ms) 2024-09-16T17:02:55.547 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.EventSocketEventfd 2024-09-16T17:02:55.547 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.EventSocketEventfd (0 ms) 2024-09-16T17:02:55.547 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.ImagePollIO 2024-09-16T17:02:55.547 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:02:56.030 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 512 2024-09-16T17:02:56.030 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 512 2024-09-16T17:02:56.030 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 512 2024-09-16T17:02:56.030 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 512 2024-09-16T17:02:56.030 INFO:tasks.workunit.client.0.smithi122.stdout:wrote: 512 2024-09-16T17:02:56.030 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T17:02:56.030 INFO:tasks.workunit.client.0.smithi122.stdout:started write 2024-09-16T17:02:56.030 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T17:02:56.030 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T17:02:56.030 INFO:tasks.workunit.client.0.smithi122.stdout:finished write 2024-09-16T17:02:56.031 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T17:02:56.031 INFO:tasks.workunit.client.0.smithi122.stdout:started write 2024-09-16T17:02:56.031 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T17:02:56.031 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T17:02:56.031 INFO:tasks.workunit.client.0.smithi122.stdout:finished write 2024-09-16T17:02:56.031 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T17:02:56.031 INFO:tasks.workunit.client.0.smithi122.stdout:started write 2024-09-16T17:02:56.031 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T17:02:56.031 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T17:02:56.031 INFO:tasks.workunit.client.0.smithi122.stdout:finished write 2024-09-16T17:02:56.031 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T17:02:56.031 INFO:tasks.workunit.client.0.smithi122.stdout:started write 2024-09-16T17:02:56.031 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T17:02:56.031 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T17:02:56.032 INFO:tasks.workunit.client.0.smithi122.stdout:finished write 2024-09-16T17:02:56.032 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T17:02:56.032 INFO:tasks.workunit.client.0.smithi122.stdout:started write 2024-09-16T17:02:56.032 INFO:tasks.workunit.client.0.smithi122.stdout:write completion cb called! 2024-09-16T17:02:56.032 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 0 2024-09-16T17:02:56.032 INFO:tasks.workunit.client.0.smithi122.stdout:finished write 2024-09-16T17:02:56.032 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T17:02:56.032 INFO:tasks.workunit.client.0.smithi122.stdout:started read 2024-09-16T17:02:56.032 INFO:tasks.workunit.client.0.smithi122.stdout:read completion cb called! 2024-09-16T17:02:56.032 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 512 2024-09-16T17:02:56.032 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T17:02:56.032 INFO:tasks.workunit.client.0.smithi122.stdout:started read 2024-09-16T17:02:56.032 INFO:tasks.workunit.client.0.smithi122.stdout:read completion cb called! 2024-09-16T17:02:56.032 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 512 2024-09-16T17:02:56.033 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T17:02:56.033 INFO:tasks.workunit.client.0.smithi122.stdout:started read 2024-09-16T17:02:56.033 INFO:tasks.workunit.client.0.smithi122.stdout:read completion cb called! 2024-09-16T17:02:56.033 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 512 2024-09-16T17:02:56.033 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T17:02:56.033 INFO:tasks.workunit.client.0.smithi122.stdout:started read 2024-09-16T17:02:56.033 INFO:tasks.workunit.client.0.smithi122.stdout:read completion cb called! 2024-09-16T17:02:56.033 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 512 2024-09-16T17:02:56.033 INFO:tasks.workunit.client.0.smithi122.stdout:created completion 2024-09-16T17:02:56.033 INFO:tasks.workunit.client.0.smithi122.stdout:started read 2024-09-16T17:02:56.033 INFO:tasks.workunit.client.0.smithi122.stdout:read completion cb called! 2024-09-16T17:02:56.033 INFO:tasks.workunit.client.0.smithi122.stdout:return value is: 512 2024-09-16T17:02:56.033 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.ImagePollIO (483 ms) 2024-09-16T17:02:56.033 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.Mirror 2024-09-16T17:02:56.085 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:02:56.165 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:02:59.826 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.Mirror (3797 ms) 2024-09-16T17:02:59.826 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.MirrorPeerAttributes 2024-09-16T17:02:59.958 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.MirrorPeerAttributes (133 ms) 2024-09-16T17:02:59.959 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.CreateWithMirrorEnabled 2024-09-16T17:03:07.888 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.CreateWithMirrorEnabled (7929 ms) 2024-09-16T17:03:07.888 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.FlushCacheWithCopyupOnExternalSnapshot 2024-09-16T17:03:07.888 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:03:10.720 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.FlushCacheWithCopyupOnExternalSnapshot (2832 ms) 2024-09-16T17:03:10.720 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.ExclusiveLock 2024-09-16T17:03:10.720 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:03:11.311 INFO:tasks.workunit.client.0.smithi122.stdout:1: acquiring exclusive lock 2024-09-16T17:03:11.311 INFO:tasks.workunit.client.0.smithi122.stdout:2: acquiring exclusive lock 2024-09-16T17:03:11.378 INFO:tasks.workunit.client.0.smithi122.stdout:2: exclusive lock acquired 2024-09-16T17:03:11.400 INFO:tasks.workunit.client.0.smithi122.stdout:2: releasing exclusive lock 2024-09-16T17:03:11.456 INFO:tasks.workunit.client.0.smithi122.stdout:2: exclusive lock released 2024-09-16T17:03:11.456 INFO:tasks.workunit.client.0.smithi122.stdout:2: acquiring exclusive lock 2024-09-16T17:03:11.526 INFO:tasks.workunit.client.0.smithi122.stdout:1: exclusive lock acquired 2024-09-16T17:03:11.538 INFO:tasks.workunit.client.0.smithi122.stdout:1: releasing exclusive lock 2024-09-16T17:03:11.600 INFO:tasks.workunit.client.0.smithi122.stdout:1: exclusive lock released 2024-09-16T17:03:11.600 INFO:tasks.workunit.client.0.smithi122.stdout:1: acquiring exclusive lock 2024-09-16T17:03:11.632 INFO:tasks.workunit.client.0.smithi122.stdout:2: exclusive lock acquired 2024-09-16T17:03:11.671 INFO:tasks.workunit.client.0.smithi122.stdout:2: releasing exclusive lock 2024-09-16T17:03:11.752 INFO:tasks.workunit.client.0.smithi122.stdout:2: exclusive lock released 2024-09-16T17:03:11.752 INFO:tasks.workunit.client.0.smithi122.stdout:2: acquiring exclusive lock 2024-09-16T17:03:11.786 INFO:tasks.workunit.client.0.smithi122.stdout:1: exclusive lock acquired 2024-09-16T17:03:11.792 INFO:tasks.workunit.client.0.smithi122.stdout:1: releasing exclusive lock 2024-09-16T17:03:11.842 INFO:tasks.workunit.client.0.smithi122.stdout:1: exclusive lock released 2024-09-16T17:03:11.842 INFO:tasks.workunit.client.0.smithi122.stdout:1: acquiring exclusive lock 2024-09-16T17:03:11.925 INFO:tasks.workunit.client.0.smithi122.stdout:2: exclusive lock acquired 2024-09-16T17:03:11.951 INFO:tasks.workunit.client.0.smithi122.stdout:2: releasing exclusive lock 2024-09-16T17:03:11.994 INFO:tasks.workunit.client.0.smithi122.stdout:2: exclusive lock released 2024-09-16T17:03:11.994 INFO:tasks.workunit.client.0.smithi122.stdout:2: acquiring exclusive lock 2024-09-16T17:03:12.067 INFO:tasks.workunit.client.0.smithi122.stdout:1: exclusive lock acquired 2024-09-16T17:03:12.116 INFO:tasks.workunit.client.0.smithi122.stdout:1: releasing exclusive lock 2024-09-16T17:03:12.159 INFO:tasks.workunit.client.0.smithi122.stdout:1: exclusive lock released 2024-09-16T17:03:12.160 INFO:tasks.workunit.client.0.smithi122.stdout:1: acquiring exclusive lock 2024-09-16T17:03:12.241 INFO:tasks.workunit.client.0.smithi122.stdout:2: exclusive lock acquired 2024-09-16T17:03:12.276 INFO:tasks.workunit.client.0.smithi122.stdout:2: releasing exclusive lock 2024-09-16T17:03:12.320 INFO:tasks.workunit.client.0.smithi122.stdout:2: exclusive lock released 2024-09-16T17:03:12.320 INFO:tasks.workunit.client.0.smithi122.stdout:2: acquiring exclusive lock 2024-09-16T17:03:12.392 INFO:tasks.workunit.client.0.smithi122.stdout:1: exclusive lock acquired 2024-09-16T17:03:12.417 INFO:tasks.workunit.client.0.smithi122.stdout:1: releasing exclusive lock 2024-09-16T17:03:12.471 INFO:tasks.workunit.client.0.smithi122.stdout:1: exclusive lock released 2024-09-16T17:03:12.471 INFO:tasks.workunit.client.0.smithi122.stdout:1: acquiring exclusive lock 2024-09-16T17:03:12.505 INFO:tasks.workunit.client.0.smithi122.stdout:2: exclusive lock acquired 2024-09-16T17:03:12.555 INFO:tasks.workunit.client.0.smithi122.stdout:2: releasing exclusive lock 2024-09-16T17:03:12.616 INFO:tasks.workunit.client.0.smithi122.stdout:2: exclusive lock released 2024-09-16T17:03:12.682 INFO:tasks.workunit.client.0.smithi122.stdout:1: exclusive lock acquired 2024-09-16T17:03:12.726 INFO:tasks.workunit.client.0.smithi122.stdout:1: releasing exclusive lock 2024-09-16T17:03:12.765 INFO:tasks.workunit.client.0.smithi122.stdout:1: exclusive lock released 2024-09-16T17:03:13.005 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.ExclusiveLock (2285 ms) 2024-09-16T17:03:13.005 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.BreakLock 2024-09-16T17:03:13.005 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:11553: Skipped 2024-09-16T17:03:13.005 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-16T17:03:13.005 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestLibRBD.BreakLock (0 ms) 2024-09-16T17:03:13.005 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.DiscardAfterWrite 2024-09-16T17:03:13.005 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:03:13.651 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.DiscardAfterWrite (646 ms) 2024-09-16T17:03:13.651 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.DefaultFeatures 2024-09-16T17:03:13.652 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.DefaultFeatures (0 ms) 2024-09-16T17:03:13.652 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.TestTrashMoveAndPurge 2024-09-16T17:03:13.652 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:03:14.553 INFO:tasks.workunit.client.0.smithi122.stdout:0.00% done 2024-09-16T17:03:14.554 INFO:tasks.workunit.client.0.smithi122.stdout:1.56% done 2024-09-16T17:03:14.554 INFO:tasks.workunit.client.0.smithi122.stdout:3.12% done 2024-09-16T17:03:14.554 INFO:tasks.workunit.client.0.smithi122.stdout:4.69% done 2024-09-16T17:03:14.554 INFO:tasks.workunit.client.0.smithi122.stdout:6.25% done 2024-09-16T17:03:14.554 INFO:tasks.workunit.client.0.smithi122.stdout:7.81% done 2024-09-16T17:03:14.554 INFO:tasks.workunit.client.0.smithi122.stdout:9.38% done 2024-09-16T17:03:14.554 INFO:tasks.workunit.client.0.smithi122.stdout:10.94% done 2024-09-16T17:03:14.554 INFO:tasks.workunit.client.0.smithi122.stdout:12.50% done 2024-09-16T17:03:14.554 INFO:tasks.workunit.client.0.smithi122.stdout:14.06% done 2024-09-16T17:03:14.554 INFO:tasks.workunit.client.0.smithi122.stdout:15.62% done 2024-09-16T17:03:14.554 INFO:tasks.workunit.client.0.smithi122.stdout:17.19% done 2024-09-16T17:03:14.554 INFO:tasks.workunit.client.0.smithi122.stdout:18.75% done 2024-09-16T17:03:14.554 INFO:tasks.workunit.client.0.smithi122.stdout:20.31% done 2024-09-16T17:03:14.554 INFO:tasks.workunit.client.0.smithi122.stdout:21.88% done 2024-09-16T17:03:14.555 INFO:tasks.workunit.client.0.smithi122.stdout:23.44% done 2024-09-16T17:03:14.555 INFO:tasks.workunit.client.0.smithi122.stdout:25.00% done 2024-09-16T17:03:14.555 INFO:tasks.workunit.client.0.smithi122.stdout:26.56% done 2024-09-16T17:03:14.555 INFO:tasks.workunit.client.0.smithi122.stdout:28.12% done 2024-09-16T17:03:14.555 INFO:tasks.workunit.client.0.smithi122.stdout:29.69% done 2024-09-16T17:03:14.555 INFO:tasks.workunit.client.0.smithi122.stdout:31.25% done 2024-09-16T17:03:14.555 INFO:tasks.workunit.client.0.smithi122.stdout:32.81% done 2024-09-16T17:03:14.555 INFO:tasks.workunit.client.0.smithi122.stdout:34.38% done 2024-09-16T17:03:14.555 INFO:tasks.workunit.client.0.smithi122.stdout:35.94% done 2024-09-16T17:03:14.555 INFO:tasks.workunit.client.0.smithi122.stdout:37.50% done 2024-09-16T17:03:14.555 INFO:tasks.workunit.client.0.smithi122.stdout:39.06% done 2024-09-16T17:03:14.555 INFO:tasks.workunit.client.0.smithi122.stdout:40.62% done 2024-09-16T17:03:14.555 INFO:tasks.workunit.client.0.smithi122.stdout:42.19% done 2024-09-16T17:03:14.555 INFO:tasks.workunit.client.0.smithi122.stdout:43.75% done 2024-09-16T17:03:14.555 INFO:tasks.workunit.client.0.smithi122.stdout:45.31% done 2024-09-16T17:03:14.556 INFO:tasks.workunit.client.0.smithi122.stdout:46.88% done 2024-09-16T17:03:14.556 INFO:tasks.workunit.client.0.smithi122.stdout:48.44% done 2024-09-16T17:03:14.556 INFO:tasks.workunit.client.0.smithi122.stdout:50.00% done 2024-09-16T17:03:14.556 INFO:tasks.workunit.client.0.smithi122.stdout:51.56% done 2024-09-16T17:03:14.556 INFO:tasks.workunit.client.0.smithi122.stdout:53.12% done 2024-09-16T17:03:14.556 INFO:tasks.workunit.client.0.smithi122.stdout:54.69% done 2024-09-16T17:03:14.556 INFO:tasks.workunit.client.0.smithi122.stdout:56.25% done 2024-09-16T17:03:14.556 INFO:tasks.workunit.client.0.smithi122.stdout:57.81% done 2024-09-16T17:03:14.556 INFO:tasks.workunit.client.0.smithi122.stdout:59.38% done 2024-09-16T17:03:14.556 INFO:tasks.workunit.client.0.smithi122.stdout:60.94% done 2024-09-16T17:03:14.556 INFO:tasks.workunit.client.0.smithi122.stdout:62.50% done 2024-09-16T17:03:14.556 INFO:tasks.workunit.client.0.smithi122.stdout:64.06% done 2024-09-16T17:03:14.556 INFO:tasks.workunit.client.0.smithi122.stdout:65.62% done 2024-09-16T17:03:14.556 INFO:tasks.workunit.client.0.smithi122.stdout:67.19% done 2024-09-16T17:03:14.557 INFO:tasks.workunit.client.0.smithi122.stdout:68.75% done 2024-09-16T17:03:14.557 INFO:tasks.workunit.client.0.smithi122.stdout:70.31% done 2024-09-16T17:03:14.557 INFO:tasks.workunit.client.0.smithi122.stdout:71.88% done 2024-09-16T17:03:14.557 INFO:tasks.workunit.client.0.smithi122.stdout:73.44% done 2024-09-16T17:03:14.557 INFO:tasks.workunit.client.0.smithi122.stdout:75.00% done 2024-09-16T17:03:14.557 INFO:tasks.workunit.client.0.smithi122.stdout:76.56% done 2024-09-16T17:03:14.557 INFO:tasks.workunit.client.0.smithi122.stdout:78.12% done 2024-09-16T17:03:14.557 INFO:tasks.workunit.client.0.smithi122.stdout:79.69% done 2024-09-16T17:03:14.557 INFO:tasks.workunit.client.0.smithi122.stdout:81.25% done 2024-09-16T17:03:14.557 INFO:tasks.workunit.client.0.smithi122.stdout:82.81% done 2024-09-16T17:03:14.557 INFO:tasks.workunit.client.0.smithi122.stdout:84.38% done 2024-09-16T17:03:14.557 INFO:tasks.workunit.client.0.smithi122.stdout:85.94% done 2024-09-16T17:03:14.557 INFO:tasks.workunit.client.0.smithi122.stdout:87.50% done 2024-09-16T17:03:14.557 INFO:tasks.workunit.client.0.smithi122.stdout:89.06% done 2024-09-16T17:03:14.557 INFO:tasks.workunit.client.0.smithi122.stdout:90.62% done 2024-09-16T17:03:14.558 INFO:tasks.workunit.client.0.smithi122.stdout:92.19% done 2024-09-16T17:03:14.558 INFO:tasks.workunit.client.0.smithi122.stdout:93.75% done 2024-09-16T17:03:14.558 INFO:tasks.workunit.client.0.smithi122.stdout:95.31% done 2024-09-16T17:03:14.558 INFO:tasks.workunit.client.0.smithi122.stdout:96.88% done 2024-09-16T17:03:14.558 INFO:tasks.workunit.client.0.smithi122.stdout:98.44% done 2024-09-16T17:03:14.558 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.TestTrashMoveAndPurge (902 ms) 2024-09-16T17:03:14.558 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.TestTrashMoveAndPurgeNonExpiredDelay 2024-09-16T17:03:14.558 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:03:15.372 INFO:tasks.workunit.client.0.smithi122.stdout:0.00% done 2024-09-16T17:03:15.372 INFO:tasks.workunit.client.0.smithi122.stdout:1.56% done 2024-09-16T17:03:15.372 INFO:tasks.workunit.client.0.smithi122.stdout:3.12% done 2024-09-16T17:03:15.372 INFO:tasks.workunit.client.0.smithi122.stdout:4.69% done 2024-09-16T17:03:15.372 INFO:tasks.workunit.client.0.smithi122.stdout:6.25% done 2024-09-16T17:03:15.372 INFO:tasks.workunit.client.0.smithi122.stdout:7.81% done 2024-09-16T17:03:15.372 INFO:tasks.workunit.client.0.smithi122.stdout:9.38% done 2024-09-16T17:03:15.372 INFO:tasks.workunit.client.0.smithi122.stdout:10.94% done 2024-09-16T17:03:15.373 INFO:tasks.workunit.client.0.smithi122.stdout:12.50% done 2024-09-16T17:03:15.373 INFO:tasks.workunit.client.0.smithi122.stdout:14.06% done 2024-09-16T17:03:15.373 INFO:tasks.workunit.client.0.smithi122.stdout:15.62% done 2024-09-16T17:03:15.373 INFO:tasks.workunit.client.0.smithi122.stdout:17.19% done 2024-09-16T17:03:15.373 INFO:tasks.workunit.client.0.smithi122.stdout:18.75% done 2024-09-16T17:03:15.373 INFO:tasks.workunit.client.0.smithi122.stdout:20.31% done 2024-09-16T17:03:15.373 INFO:tasks.workunit.client.0.smithi122.stdout:21.88% done 2024-09-16T17:03:15.373 INFO:tasks.workunit.client.0.smithi122.stdout:23.44% done 2024-09-16T17:03:15.373 INFO:tasks.workunit.client.0.smithi122.stdout:25.00% done 2024-09-16T17:03:15.373 INFO:tasks.workunit.client.0.smithi122.stdout:26.56% done 2024-09-16T17:03:15.373 INFO:tasks.workunit.client.0.smithi122.stdout:28.12% done 2024-09-16T17:03:15.373 INFO:tasks.workunit.client.0.smithi122.stdout:29.69% done 2024-09-16T17:03:15.373 INFO:tasks.workunit.client.0.smithi122.stdout:31.25% done 2024-09-16T17:03:15.373 INFO:tasks.workunit.client.0.smithi122.stdout:32.81% done 2024-09-16T17:03:15.373 INFO:tasks.workunit.client.0.smithi122.stdout:34.38% done 2024-09-16T17:03:15.374 INFO:tasks.workunit.client.0.smithi122.stdout:35.94% done 2024-09-16T17:03:15.374 INFO:tasks.workunit.client.0.smithi122.stdout:37.50% done 2024-09-16T17:03:15.374 INFO:tasks.workunit.client.0.smithi122.stdout:39.06% done 2024-09-16T17:03:15.374 INFO:tasks.workunit.client.0.smithi122.stdout:40.62% done 2024-09-16T17:03:15.374 INFO:tasks.workunit.client.0.smithi122.stdout:42.19% done 2024-09-16T17:03:15.374 INFO:tasks.workunit.client.0.smithi122.stdout:43.75% done 2024-09-16T17:03:15.374 INFO:tasks.workunit.client.0.smithi122.stdout:45.31% done 2024-09-16T17:03:15.374 INFO:tasks.workunit.client.0.smithi122.stdout:46.88% done 2024-09-16T17:03:15.374 INFO:tasks.workunit.client.0.smithi122.stdout:48.44% done 2024-09-16T17:03:15.374 INFO:tasks.workunit.client.0.smithi122.stdout:50.00% done 2024-09-16T17:03:15.374 INFO:tasks.workunit.client.0.smithi122.stdout:51.56% done 2024-09-16T17:03:15.374 INFO:tasks.workunit.client.0.smithi122.stdout:53.12% done 2024-09-16T17:03:15.374 INFO:tasks.workunit.client.0.smithi122.stdout:54.69% done 2024-09-16T17:03:15.374 INFO:tasks.workunit.client.0.smithi122.stdout:56.25% done 2024-09-16T17:03:15.374 INFO:tasks.workunit.client.0.smithi122.stdout:57.81% done 2024-09-16T17:03:15.374 INFO:tasks.workunit.client.0.smithi122.stdout:59.38% done 2024-09-16T17:03:15.375 INFO:tasks.workunit.client.0.smithi122.stdout:60.94% done 2024-09-16T17:03:15.375 INFO:tasks.workunit.client.0.smithi122.stdout:62.50% done 2024-09-16T17:03:15.375 INFO:tasks.workunit.client.0.smithi122.stdout:64.06% done 2024-09-16T17:03:15.375 INFO:tasks.workunit.client.0.smithi122.stdout:65.62% done 2024-09-16T17:03:15.375 INFO:tasks.workunit.client.0.smithi122.stdout:67.19% done 2024-09-16T17:03:15.375 INFO:tasks.workunit.client.0.smithi122.stdout:68.75% done 2024-09-16T17:03:15.375 INFO:tasks.workunit.client.0.smithi122.stdout:70.31% done 2024-09-16T17:03:15.375 INFO:tasks.workunit.client.0.smithi122.stdout:71.88% done 2024-09-16T17:03:15.375 INFO:tasks.workunit.client.0.smithi122.stdout:73.44% done 2024-09-16T17:03:15.375 INFO:tasks.workunit.client.0.smithi122.stdout:75.00% done 2024-09-16T17:03:15.375 INFO:tasks.workunit.client.0.smithi122.stdout:76.56% done 2024-09-16T17:03:15.375 INFO:tasks.workunit.client.0.smithi122.stdout:78.12% done 2024-09-16T17:03:15.375 INFO:tasks.workunit.client.0.smithi122.stdout:79.69% done 2024-09-16T17:03:15.375 INFO:tasks.workunit.client.0.smithi122.stdout:81.25% done 2024-09-16T17:03:15.376 INFO:tasks.workunit.client.0.smithi122.stdout:82.81% done 2024-09-16T17:03:15.376 INFO:tasks.workunit.client.0.smithi122.stdout:84.38% done 2024-09-16T17:03:15.376 INFO:tasks.workunit.client.0.smithi122.stdout:85.94% done 2024-09-16T17:03:15.376 INFO:tasks.workunit.client.0.smithi122.stdout:87.50% done 2024-09-16T17:03:15.376 INFO:tasks.workunit.client.0.smithi122.stdout:89.06% done 2024-09-16T17:03:15.376 INFO:tasks.workunit.client.0.smithi122.stdout:90.62% done 2024-09-16T17:03:15.376 INFO:tasks.workunit.client.0.smithi122.stdout:92.19% done 2024-09-16T17:03:15.376 INFO:tasks.workunit.client.0.smithi122.stdout:93.75% done 2024-09-16T17:03:15.376 INFO:tasks.workunit.client.0.smithi122.stdout:95.31% done 2024-09-16T17:03:15.376 INFO:tasks.workunit.client.0.smithi122.stdout:96.88% done 2024-09-16T17:03:15.376 INFO:tasks.workunit.client.0.smithi122.stdout:98.44% done 2024-09-16T17:03:15.376 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.TestTrashMoveAndPurgeNonExpiredDelay (819 ms) 2024-09-16T17:03:15.376 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.TestTrashPurge 2024-09-16T17:03:15.376 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:03:15.451 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:03:17.114 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.TestTrashPurge (1742 ms) 2024-09-16T17:03:17.114 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.TestTrashMoveAndRestore 2024-09-16T17:03:17.114 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:03:17.694 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.TestTrashMoveAndRestore (580 ms) 2024-09-16T17:03:17.694 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.TestListWatchers 2024-09-16T17:03:17.695 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:03:18.190 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.TestListWatchers (496 ms) 2024-09-16T17:03:18.190 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.TestSetSnapById 2024-09-16T17:03:18.190 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:03:19.793 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.TestSetSnapById (1599 ms) 2024-09-16T17:03:19.793 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.Namespaces 2024-09-16T17:03:20.045 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.Namespaces (256 ms) 2024-09-16T17:03:20.045 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.NamespacesPP 2024-09-16T17:03:20.383 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:03:20.412 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:03:21.374 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.NamespacesPP (1328 ms) 2024-09-16T17:03:21.374 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.Migration 2024-09-16T17:03:21.374 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:03:21.374 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:03:27.536 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.Migration (6163 ms) 2024-09-16T17:03:27.536 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.MigrationPP 2024-09-16T17:03:27.536 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:03:27.536 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:03:33.212 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.MigrationPP (5676 ms) 2024-09-16T17:03:33.212 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.TestGetAccessTimestamp 2024-09-16T17:03:33.212 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:03:33.390 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.TestGetAccessTimestamp (178 ms) 2024-09-16T17:03:33.390 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.TestGetModifyTimestamp 2024-09-16T17:03:33.390 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:03:33.579 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.TestGetModifyTimestamp (189 ms) 2024-09-16T17:03:33.579 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.ZeroOverlapFlatten 2024-09-16T17:03:33.580 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:03:35.502 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.ZeroOverlapFlatten (1923 ms) 2024-09-16T17:03:35.503 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.PoolMetadata 2024-09-16T17:03:35.822 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.PoolMetadata (320 ms) 2024-09-16T17:03:35.823 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.PoolMetadataPP 2024-09-16T17:03:36.025 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.PoolMetadataPP (203 ms) 2024-09-16T17:03:36.025 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.Config 2024-09-16T17:03:36.066 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:03:36.510 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.Config (485 ms) 2024-09-16T17:03:36.510 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.ConfigPP 2024-09-16T17:03:36.532 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:03:37.028 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.ConfigPP (518 ms) 2024-09-16T17:03:37.029 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.PoolStatsPP 2024-09-16T17:03:38.636 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:03:41.102 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:03:41.175 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:03:41.250 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:03:42.695 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.PoolStatsPP (5667 ms) 2024-09-16T17:03:42.695 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.ImageSpec 2024-09-16T17:03:44.660 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:03:51.658 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.ImageSpec (8963 ms) 2024-09-16T17:03:51.658 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.SnapRemoveWithChildMissing 2024-09-16T17:03:52.762 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:04:05.775 INFO:tasks.workunit.client.0.smithi122.stdout:num children is: 3 2024-09-16T17:04:05.775 INFO:tasks.workunit.client.0.smithi122.stdout:expected: 3 2024-09-16T17:04:05.775 INFO:tasks.workunit.client.0.smithi122.stdout:child: image223 2024-09-16T17:04:05.776 INFO:tasks.workunit.client.0.smithi122.stdout:child: image225 2024-09-16T17:04:05.776 INFO:tasks.workunit.client.0.smithi122.stdout:child: image224 2024-09-16T17:04:05.776 INFO:tasks.workunit.client.0.smithi122.stdout:found child test-librbd-smithi122-30518-1/image223/105fad100e57 2024-09-16T17:04:05.776 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:04:05.776 INFO:tasks.workunit.client.0.smithi122.stdout:found child test-librbd-smithi122-30518-20/image224/105fa43a1078 2024-09-16T17:04:05.776 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:04:05.776 INFO:tasks.workunit.client.0.smithi122.stdout:found child test-librbd-smithi122-30518-1/image225/105fd8cb1f7 2024-09-16T17:04:05.776 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:04:05.776 INFO:tasks.workunit.client.0.smithi122.stdout:num children is: 0 2024-09-16T17:04:05.776 INFO:tasks.workunit.client.0.smithi122.stdout:expected: 0 2024-09-16T17:04:05.776 INFO:tasks.workunit.client.0.smithi122.stdout:num snaps is: 0 2024-09-16T17:04:05.776 INFO:tasks.workunit.client.0.smithi122.stdout:expected: 0 2024-09-16T17:04:05.776 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.SnapRemoveWithChildMissing (14117 ms) 2024-09-16T17:04:05.776 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.QuiesceWatch 2024-09-16T17:04:07.242 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:04:17.486 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.QuiesceWatch (11711 ms) 2024-09-16T17:04:17.486 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.QuiesceWatchPP 2024-09-16T17:04:17.486 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:04:24.604 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.QuiesceWatchPP (7118 ms) 2024-09-16T17:04:24.604 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.QuiesceWatchError 2024-09-16T17:04:24.604 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:13115: Skipped 2024-09-16T17:04:24.605 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-16T17:04:24.605 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestLibRBD.QuiesceWatchError (0 ms) 2024-09-16T17:04:24.605 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.QuiesceWatchTimeout 2024-09-16T17:04:24.605 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:04:24.767 INFO:tasks.workunit.client.0.smithi122.stderr:test quiesce is not long enough to time out 2024-09-16T17:04:33.778 INFO:tasks.workunit.client.0.smithi122.stderr:test quiesce is timed out 2024-09-16T17:04:33.830 INFO:tasks.workunit.client.0.smithi122.stderr:waiting for timed out ... 0 2024-09-16T17:04:34.831 INFO:tasks.workunit.client.0.smithi122.stderr:waiting for timed out ... 1 2024-09-16T17:04:35.831 INFO:tasks.workunit.client.0.smithi122.stderr:waiting for timed out ... 2 2024-09-16T17:04:36.831 INFO:tasks.workunit.client.0.smithi122.stderr:waiting for timed out ... 3 2024-09-16T17:04:37.831 INFO:tasks.workunit.client.0.smithi122.stderr:waiting for timed out ... 4 2024-09-16T17:04:38.831 INFO:tasks.workunit.client.0.smithi122.stderr:waiting for timed out ... 5 2024-09-16T17:04:39.831 INFO:tasks.workunit.client.0.smithi122.stderr:waiting for timed out ... 6 2024-09-16T17:04:40.831 INFO:tasks.workunit.client.0.smithi122.stderr:waiting for timed out ... 7 2024-09-16T17:04:41.831 INFO:tasks.workunit.client.0.smithi122.stderr:waiting for timed out ... 8 2024-09-16T17:04:42.832 INFO:tasks.workunit.client.0.smithi122.stderr:waiting for timed out ... 9 2024-09-16T17:04:43.832 INFO:tasks.workunit.client.0.smithi122.stderr:waiting for timed out ... 10 2024-09-16T17:04:54.832 INFO:tasks.workunit.client.0.smithi122.stderr:test retry succeeds 2024-09-16T17:04:59.255 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.QuiesceWatchTimeout (34651 ms) 2024-09-16T17:04:59.256 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.WriteZeroes 2024-09-16T17:04:59.256 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:04:59.645 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.WriteZeroes (390 ms) 2024-09-16T17:04:59.645 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.WriteZeroesThickProvision 2024-09-16T17:04:59.645 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:05:00.177 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.WriteZeroesThickProvision (532 ms) 2024-09-16T17:05:00.178 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.ConcurrentOperations 2024-09-16T17:05:00.178 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:13474: Skipped 2024-09-16T17:05:00.178 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-16T17:05:00.178 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestLibRBD.ConcurrentOperations (0 ms) 2024-09-16T17:05:00.178 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestLibRBD.FormatAndCloneFormatOptions 2024-09-16T17:05:09.076 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestLibRBD.FormatAndCloneFormatOptions (8899 ms) 2024-09-16T17:05:28.244 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 171 tests from TestLibRBD (1116398 ms total) 2024-09-16T17:05:28.245 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:05:28.245 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment tear-down 2024-09-16T17:05:28.245 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] 171 tests from 1 test suite ran. (1135614 ms total) 2024-09-16T17:05:28.245 INFO:tasks.workunit.client.0.smithi122.stdout:[ PASSED ] 164 tests. 2024-09-16T17:05:28.245 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] 7 tests, listed below: 2024-09-16T17:05:28.245 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestLibRBD.EncryptionLoadBadStripePattern 2024-09-16T17:05:28.245 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestLibRBD.ListChildrenTiered 2024-09-16T17:05:28.245 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestLibRBD.EnableJournalingViaLockOwner 2024-09-16T17:05:28.245 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestLibRBD.ExclusiveLockReadTransition 2024-09-16T17:05:28.245 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestLibRBD.BreakLock 2024-09-16T17:05:28.245 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestLibRBD.QuiesceWatchError 2024-09-16T17:05:28.245 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestLibRBD.ConcurrentOperations 2024-09-16T17:05:28.246 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:05:28.246 INFO:tasks.workunit.client.0.smithi122.stdout: YOU HAVE 1 DISABLED TEST 2024-09-16T17:05:28.246 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:05:28.376 INFO:tasks.workunit.client.0.smithi122.stdout:seed 39937 2024-09-16T17:05:28.377 INFO:tasks.workunit.client.0.smithi122.stdout:Note: Google Test filter = EncryptedFlattenTest/0.* 2024-09-16T17:05:28.377 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-16T17:05:28.377 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment set-up. 2024-09-16T17:05:28.377 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 7 tests from EncryptedFlattenTest/0, where TypeParam = PlaintextUnderLUKS1 2024-09-16T17:05:28.448 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] EncryptedFlattenTest/0.Simple 2024-09-16T17:05:30.249 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:05:42.716 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] EncryptedFlattenTest/0.Simple (14267 ms) 2024-09-16T17:05:42.716 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] EncryptedFlattenTest/0.Grow 2024-09-16T17:05:42.716 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:05:53.877 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] EncryptedFlattenTest/0.Grow (11162 ms) 2024-09-16T17:05:53.878 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] EncryptedFlattenTest/0.Shrink 2024-09-16T17:05:53.878 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:06:04.820 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] EncryptedFlattenTest/0.Shrink (10942 ms) 2024-09-16T17:06:04.820 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] EncryptedFlattenTest/0.ShrinkToOne 2024-09-16T17:06:04.820 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:06:15.420 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] EncryptedFlattenTest/0.ShrinkToOne (10601 ms) 2024-09-16T17:06:15.420 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] EncryptedFlattenTest/0.ShrinkToOneAfterSnapshot 2024-09-16T17:06:15.420 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:06:26.746 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] EncryptedFlattenTest/0.ShrinkToOneAfterSnapshot (11326 ms) 2024-09-16T17:06:26.747 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] EncryptedFlattenTest/0.MinOverlap 2024-09-16T17:06:26.747 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:06:37.590 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] EncryptedFlattenTest/0.MinOverlap (10844 ms) 2024-09-16T17:06:37.591 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] EncryptedFlattenTest/0.ZeroOverlap 2024-09-16T17:06:37.591 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:06:47.421 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] EncryptedFlattenTest/0.ZeroOverlap (9831 ms) 2024-09-16T17:06:48.246 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 7 tests from EncryptedFlattenTest/0 (78973 ms total) 2024-09-16T17:06:48.247 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:06:48.247 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment tear-down 2024-09-16T17:06:48.247 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] 7 tests from 1 test suite ran. (79869 ms total) 2024-09-16T17:06:48.247 INFO:tasks.workunit.client.0.smithi122.stdout:[ PASSED ] 7 tests. 2024-09-16T17:06:48.341 INFO:tasks.workunit.client.0.smithi122.stdout:seed 40024 2024-09-16T17:06:48.342 INFO:tasks.workunit.client.0.smithi122.stdout:Note: Google Test filter = EncryptedFlattenTest/1.* 2024-09-16T17:06:48.342 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-16T17:06:48.342 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment set-up. 2024-09-16T17:06:48.343 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 7 tests from EncryptedFlattenTest/1, where TypeParam = PlaintextUnderLUKS2 2024-09-16T17:06:48.441 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] EncryptedFlattenTest/1.Simple 2024-09-16T17:06:50.265 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:07:05.507 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] EncryptedFlattenTest/1.Simple (17066 ms) 2024-09-16T17:07:05.507 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] EncryptedFlattenTest/1.Grow 2024-09-16T17:07:05.507 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:07:18.505 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] EncryptedFlattenTest/1.Grow (12997 ms) 2024-09-16T17:07:18.505 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] EncryptedFlattenTest/1.Shrink 2024-09-16T17:07:18.505 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:07:30.525 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] EncryptedFlattenTest/1.Shrink (12021 ms) 2024-09-16T17:07:30.526 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] EncryptedFlattenTest/1.ShrinkToOne 2024-09-16T17:07:30.526 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:07:42.162 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] EncryptedFlattenTest/1.ShrinkToOne (11637 ms) 2024-09-16T17:07:42.162 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] EncryptedFlattenTest/1.ShrinkToOneAfterSnapshot 2024-09-16T17:07:42.162 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:07:56.776 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] EncryptedFlattenTest/1.ShrinkToOneAfterSnapshot (14613 ms) 2024-09-16T17:07:56.776 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] EncryptedFlattenTest/1.MinOverlap 2024-09-16T17:07:56.776 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:08:09.633 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] EncryptedFlattenTest/1.MinOverlap (12858 ms) 2024-09-16T17:08:09.634 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] EncryptedFlattenTest/1.ZeroOverlap 2024-09-16T17:08:09.634 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:08:21.110 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] EncryptedFlattenTest/1.ZeroOverlap (11477 ms) 2024-09-16T17:08:21.316 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 7 tests from EncryptedFlattenTest/1 (92669 ms total) 2024-09-16T17:08:21.316 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:08:21.316 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment tear-down 2024-09-16T17:08:21.316 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] 7 tests from 1 test suite ran. (92974 ms total) 2024-09-16T17:08:21.317 INFO:tasks.workunit.client.0.smithi122.stdout:[ PASSED ] 7 tests. 2024-09-16T17:08:21.428 INFO:tasks.workunit.client.0.smithi122.stdout:seed 45587 2024-09-16T17:08:21.428 INFO:tasks.workunit.client.0.smithi122.stdout:Note: Google Test filter = EncryptedFlattenTest/2.* 2024-09-16T17:08:21.428 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-16T17:08:21.428 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment set-up. 2024-09-16T17:08:21.429 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 7 tests from EncryptedFlattenTest/2, where TypeParam = UnformattedLUKS1 2024-09-16T17:08:21.501 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] EncryptedFlattenTest/2.Simple 2024-09-16T17:08:23.328 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:08:38.382 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] EncryptedFlattenTest/2.Simple (16881 ms) 2024-09-16T17:08:38.382 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] EncryptedFlattenTest/2.Grow 2024-09-16T17:08:38.382 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:08:51.180 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] EncryptedFlattenTest/2.Grow (12797 ms) 2024-09-16T17:08:51.180 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] EncryptedFlattenTest/2.Shrink 2024-09-16T17:08:51.180 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:09:04.513 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] EncryptedFlattenTest/2.Shrink (13333 ms) 2024-09-16T17:09:04.513 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] EncryptedFlattenTest/2.ShrinkToOne 2024-09-16T17:09:04.513 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:09:17.149 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] EncryptedFlattenTest/2.ShrinkToOne (12636 ms) 2024-09-16T17:09:17.149 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] EncryptedFlattenTest/2.ShrinkToOneAfterSnapshot 2024-09-16T17:09:17.149 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:09:31.070 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] EncryptedFlattenTest/2.ShrinkToOneAfterSnapshot (13921 ms) 2024-09-16T17:09:31.070 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] EncryptedFlattenTest/2.MinOverlap 2024-09-16T17:09:31.070 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:09:43.227 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] EncryptedFlattenTest/2.MinOverlap (12157 ms) 2024-09-16T17:09:43.227 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] EncryptedFlattenTest/2.ZeroOverlap 2024-09-16T17:09:43.227 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:09:56.053 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] EncryptedFlattenTest/2.ZeroOverlap (12827 ms) 2024-09-16T17:09:56.287 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 7 tests from EncryptedFlattenTest/2 (94552 ms total) 2024-09-16T17:09:56.287 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:09:56.287 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment tear-down 2024-09-16T17:09:56.287 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] 7 tests from 1 test suite ran. (94859 ms total) 2024-09-16T17:09:56.287 INFO:tasks.workunit.client.0.smithi122.stdout:[ PASSED ] 7 tests. 2024-09-16T17:09:56.393 INFO:tasks.workunit.client.0.smithi122.stdout:seed 45654 2024-09-16T17:09:56.396 INFO:tasks.workunit.client.0.smithi122.stdout:Note: Google Test filter = EncryptedFlattenTest/3.* 2024-09-16T17:09:56.396 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-16T17:09:56.396 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment set-up. 2024-09-16T17:09:56.396 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 7 tests from EncryptedFlattenTest/3, where TypeParam = LUKS1UnderLUKS1 2024-09-16T17:09:56.485 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] EncryptedFlattenTest/3.Simple 2024-09-16T17:09:58.296 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:10:16.919 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] EncryptedFlattenTest/3.Simple (20433 ms) 2024-09-16T17:10:16.919 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] EncryptedFlattenTest/3.Grow 2024-09-16T17:10:16.919 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:10:32.830 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] EncryptedFlattenTest/3.Grow (15912 ms) 2024-09-16T17:10:32.830 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] EncryptedFlattenTest/3.Shrink 2024-09-16T17:10:32.830 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:10:49.101 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] EncryptedFlattenTest/3.Shrink (16270 ms) 2024-09-16T17:10:49.101 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] EncryptedFlattenTest/3.ShrinkToOne 2024-09-16T17:10:49.101 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:11:04.538 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] EncryptedFlattenTest/3.ShrinkToOne (15438 ms) 2024-09-16T17:11:04.539 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] EncryptedFlattenTest/3.ShrinkToOneAfterSnapshot 2024-09-16T17:11:04.539 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:11:21.994 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] EncryptedFlattenTest/3.ShrinkToOneAfterSnapshot (17456 ms) 2024-09-16T17:11:21.995 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] EncryptedFlattenTest/3.MinOverlap 2024-09-16T17:11:21.995 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:11:37.833 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] EncryptedFlattenTest/3.MinOverlap (15839 ms) 2024-09-16T17:11:37.833 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] EncryptedFlattenTest/3.ZeroOverlap 2024-09-16T17:11:37.834 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:11:53.663 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] EncryptedFlattenTest/3.ZeroOverlap (15829 ms) 2024-09-16T17:11:54.362 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 7 tests from EncryptedFlattenTest/3 (117177 ms total) 2024-09-16T17:11:54.362 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:11:54.362 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment tear-down 2024-09-16T17:11:54.363 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] 7 tests from 1 test suite ran. (117966 ms total) 2024-09-16T17:11:54.363 INFO:tasks.workunit.client.0.smithi122.stdout:[ PASSED ] 7 tests. 2024-09-16T17:11:54.448 INFO:tasks.workunit.client.0.smithi122.stdout:seed 45722 2024-09-16T17:11:54.448 INFO:tasks.workunit.client.0.smithi122.stdout:Note: Google Test filter = EncryptedFlattenTest/4.* 2024-09-16T17:11:54.448 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-16T17:11:54.449 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment set-up. 2024-09-16T17:11:54.449 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 7 tests from EncryptedFlattenTest/4, where TypeParam = LUKS1UnderLUKS2 2024-09-16T17:11:54.540 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] EncryptedFlattenTest/4.Simple 2024-09-16T17:11:56.371 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:12:16.546 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] EncryptedFlattenTest/4.Simple (22006 ms) 2024-09-16T17:12:16.547 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] EncryptedFlattenTest/4.Grow 2024-09-16T17:12:16.547 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:12:35.387 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] EncryptedFlattenTest/4.Grow (18841 ms) 2024-09-16T17:12:35.387 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] EncryptedFlattenTest/4.Shrink 2024-09-16T17:12:35.387 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:12:53.962 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] EncryptedFlattenTest/4.Shrink (18574 ms) 2024-09-16T17:12:53.962 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] EncryptedFlattenTest/4.ShrinkToOne 2024-09-16T17:12:53.962 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:13:11.697 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] EncryptedFlattenTest/4.ShrinkToOne (17736 ms) 2024-09-16T17:13:11.697 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] EncryptedFlattenTest/4.ShrinkToOneAfterSnapshot 2024-09-16T17:13:11.697 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:13:31.805 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] EncryptedFlattenTest/4.ShrinkToOneAfterSnapshot (20107 ms) 2024-09-16T17:13:31.805 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] EncryptedFlattenTest/4.MinOverlap 2024-09-16T17:13:31.805 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:13:49.534 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] EncryptedFlattenTest/4.MinOverlap (17730 ms) 2024-09-16T17:13:49.534 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] EncryptedFlattenTest/4.ZeroOverlap 2024-09-16T17:13:49.534 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:14:07.099 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] EncryptedFlattenTest/4.ZeroOverlap (17565 ms) 2024-09-16T17:14:07.319 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 7 tests from EncryptedFlattenTest/4 (132559 ms total) 2024-09-16T17:14:07.319 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:14:07.319 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment tear-down 2024-09-16T17:14:07.319 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] 7 tests from 1 test suite ran. (132871 ms total) 2024-09-16T17:14:07.319 INFO:tasks.workunit.client.0.smithi122.stdout:[ PASSED ] 7 tests. 2024-09-16T17:14:07.434 INFO:tasks.workunit.client.0.smithi122.stdout:seed 50856 2024-09-16T17:14:07.434 INFO:tasks.workunit.client.0.smithi122.stdout:Note: Google Test filter = EncryptedFlattenTest/5.* 2024-09-16T17:14:07.435 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-16T17:14:07.435 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment set-up. 2024-09-16T17:14:07.435 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 7 tests from EncryptedFlattenTest/5, where TypeParam = UnformattedLUKS2 2024-09-16T17:14:07.521 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] EncryptedFlattenTest/5.Simple 2024-09-16T17:14:09.313 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:14:25.845 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] EncryptedFlattenTest/5.Simple (18323 ms) 2024-09-16T17:14:25.845 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] EncryptedFlattenTest/5.Grow 2024-09-16T17:14:25.845 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:14:39.880 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] EncryptedFlattenTest/5.Grow (14036 ms) 2024-09-16T17:14:39.880 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] EncryptedFlattenTest/5.Shrink 2024-09-16T17:14:39.880 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:14:53.985 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] EncryptedFlattenTest/5.Shrink (14105 ms) 2024-09-16T17:14:53.986 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] EncryptedFlattenTest/5.ShrinkToOne 2024-09-16T17:14:53.986 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:15:07.456 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] EncryptedFlattenTest/5.ShrinkToOne (13470 ms) 2024-09-16T17:15:07.456 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] EncryptedFlattenTest/5.ShrinkToOneAfterSnapshot 2024-09-16T17:15:07.456 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:15:23.047 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] EncryptedFlattenTest/5.ShrinkToOneAfterSnapshot (15592 ms) 2024-09-16T17:15:23.048 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] EncryptedFlattenTest/5.MinOverlap 2024-09-16T17:15:23.048 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:15:36.601 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] EncryptedFlattenTest/5.MinOverlap (13553 ms) 2024-09-16T17:15:36.601 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] EncryptedFlattenTest/5.ZeroOverlap 2024-09-16T17:15:36.601 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:15:55.192 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] EncryptedFlattenTest/5.ZeroOverlap (18591 ms) 2024-09-16T17:15:55.397 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 7 tests from EncryptedFlattenTest/5 (107670 ms total) 2024-09-16T17:15:55.397 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:15:55.397 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment tear-down 2024-09-16T17:15:55.397 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] 7 tests from 1 test suite ran. (107962 ms total) 2024-09-16T17:15:55.397 INFO:tasks.workunit.client.0.smithi122.stdout:[ PASSED ] 7 tests. 2024-09-16T17:15:55.469 INFO:tasks.workunit.client.0.smithi122.stdout:seed 57045 2024-09-16T17:15:55.470 INFO:tasks.workunit.client.0.smithi122.stdout:Note: Google Test filter = EncryptedFlattenTest/6.* 2024-09-16T17:15:55.470 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-16T17:15:55.470 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment set-up. 2024-09-16T17:15:55.470 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 7 tests from EncryptedFlattenTest/6, where TypeParam = LUKS2UnderLUKS2 2024-09-16T17:15:55.576 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] EncryptedFlattenTest/6.Simple 2024-09-16T17:15:57.409 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:16:23.279 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] EncryptedFlattenTest/6.Simple (27703 ms) 2024-09-16T17:16:23.280 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] EncryptedFlattenTest/6.Grow 2024-09-16T17:16:23.280 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:16:46.568 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] EncryptedFlattenTest/6.Grow (23289 ms) 2024-09-16T17:16:46.569 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] EncryptedFlattenTest/6.Shrink 2024-09-16T17:16:46.569 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:17:11.443 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] EncryptedFlattenTest/6.Shrink (24874 ms) 2024-09-16T17:17:11.443 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] EncryptedFlattenTest/6.ShrinkToOne 2024-09-16T17:17:11.443 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:17:35.042 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] EncryptedFlattenTest/6.ShrinkToOne (23599 ms) 2024-09-16T17:17:35.042 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] EncryptedFlattenTest/6.ShrinkToOneAfterSnapshot 2024-09-16T17:17:35.042 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:18:01.210 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] EncryptedFlattenTest/6.ShrinkToOneAfterSnapshot (26168 ms) 2024-09-16T17:18:01.210 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] EncryptedFlattenTest/6.MinOverlap 2024-09-16T17:18:01.210 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:18:24.422 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] EncryptedFlattenTest/6.MinOverlap (23212 ms) 2024-09-16T17:18:24.422 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] EncryptedFlattenTest/6.ZeroOverlap 2024-09-16T17:18:24.422 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:18:44.960 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] EncryptedFlattenTest/6.ZeroOverlap (20538 ms) 2024-09-16T17:18:45.410 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 7 tests from EncryptedFlattenTest/6 (169383 ms total) 2024-09-16T17:18:45.410 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:18:45.410 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment tear-down 2024-09-16T17:18:45.410 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] 7 tests from 1 test suite ran. (169939 ms total) 2024-09-16T17:18:45.410 INFO:tasks.workunit.client.0.smithi122.stdout:[ PASSED ] 7 tests. 2024-09-16T17:18:45.512 INFO:tasks.workunit.client.0.smithi122.stdout:seed 68442 2024-09-16T17:18:45.512 INFO:tasks.workunit.client.0.smithi122.stdout:Note: Google Test filter = EncryptedFlattenTest/7.* 2024-09-16T17:18:45.512 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-16T17:18:45.512 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment set-up. 2024-09-16T17:18:45.513 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 7 tests from EncryptedFlattenTest/7, where TypeParam = LUKS2UnderLUKS1 2024-09-16T17:18:45.600 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] EncryptedFlattenTest/7.Simple 2024-09-16T17:18:47.425 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:19:11.779 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] EncryptedFlattenTest/7.Simple (26180 ms) 2024-09-16T17:19:11.779 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] EncryptedFlattenTest/7.Grow 2024-09-16T17:19:11.779 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:19:33.897 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] EncryptedFlattenTest/7.Grow (22118 ms) 2024-09-16T17:19:33.897 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] EncryptedFlattenTest/7.Shrink 2024-09-16T17:19:33.897 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:19:55.952 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] EncryptedFlattenTest/7.Shrink (22056 ms) 2024-09-16T17:19:55.953 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] EncryptedFlattenTest/7.ShrinkToOne 2024-09-16T17:19:55.953 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:20:17.626 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] EncryptedFlattenTest/7.ShrinkToOne (21674 ms) 2024-09-16T17:20:17.627 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] EncryptedFlattenTest/7.ShrinkToOneAfterSnapshot 2024-09-16T17:20:17.627 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:20:42.013 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] EncryptedFlattenTest/7.ShrinkToOneAfterSnapshot (24386 ms) 2024-09-16T17:20:42.013 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] EncryptedFlattenTest/7.MinOverlap 2024-09-16T17:20:42.013 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:21:07.212 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] EncryptedFlattenTest/7.MinOverlap (25199 ms) 2024-09-16T17:21:07.212 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] EncryptedFlattenTest/7.ZeroOverlap 2024-09-16T17:21:07.212 INFO:tasks.workunit.client.0.smithi122.stdout:using new format! 2024-09-16T17:21:29.506 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] EncryptedFlattenTest/7.ZeroOverlap (22295 ms) 2024-09-16T17:21:30.440 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 7 tests from EncryptedFlattenTest/7 (163908 ms total) 2024-09-16T17:21:30.440 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:21:30.440 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment tear-down 2024-09-16T17:21:30.440 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] 7 tests from 1 test suite ran. (164928 ms total) 2024-09-16T17:21:30.440 INFO:tasks.workunit.client.0.smithi122.stdout:[ PASSED ] 7 tests. 2024-09-16T17:21:30.543 INFO:tasks.workunit.client.0.smithi122.stdout:seed 74202 2024-09-16T17:21:30.544 INFO:tasks.workunit.client.0.smithi122.stdout:Note: Google Test filter = TestImageWatcher.* 2024-09-16T17:21:30.544 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] Running 17 tests from 1 test suite. 2024-09-16T17:21:30.544 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment set-up. 2024-09-16T17:21:30.544 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 17 tests from TestImageWatcher 2024-09-16T17:21:32.446 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestImageWatcher.NotifyHeaderUpdate 2024-09-16T17:21:34.730 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestImageWatcher.NotifyHeaderUpdate (2284 ms) 2024-09-16T17:21:34.731 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestImageWatcher.NotifyFlatten 2024-09-16T17:21:34.990 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestImageWatcher.NotifyFlatten (260 ms) 2024-09-16T17:21:34.990 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestImageWatcher.NotifyResize 2024-09-16T17:21:35.241 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestImageWatcher.NotifyResize (251 ms) 2024-09-16T17:21:35.241 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestImageWatcher.NotifyRebuildObjectMap 2024-09-16T17:21:35.489 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestImageWatcher.NotifyRebuildObjectMap (248 ms) 2024-09-16T17:21:35.489 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestImageWatcher.NotifyUpdateFeatures 2024-09-16T17:21:35.730 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestImageWatcher.NotifyUpdateFeatures (241 ms) 2024-09-16T17:21:35.730 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestImageWatcher.NotifySnapCreate 2024-09-16T17:21:35.980 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestImageWatcher.NotifySnapCreate (250 ms) 2024-09-16T17:21:35.980 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestImageWatcher.NotifySnapCreateError 2024-09-16T17:21:36.209 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestImageWatcher.NotifySnapCreateError (229 ms) 2024-09-16T17:21:36.209 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestImageWatcher.NotifySnapRename 2024-09-16T17:21:36.455 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestImageWatcher.NotifySnapRename (246 ms) 2024-09-16T17:21:36.455 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestImageWatcher.NotifySnapRenameError 2024-09-16T17:21:36.688 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestImageWatcher.NotifySnapRenameError (232 ms) 2024-09-16T17:21:36.688 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestImageWatcher.NotifySnapRemove 2024-09-16T17:21:36.930 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestImageWatcher.NotifySnapRemove (243 ms) 2024-09-16T17:21:36.930 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestImageWatcher.NotifySnapProtect 2024-09-16T17:21:37.162 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestImageWatcher.NotifySnapProtect (232 ms) 2024-09-16T17:21:37.162 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestImageWatcher.NotifySnapUnprotect 2024-09-16T17:21:37.393 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestImageWatcher.NotifySnapUnprotect (231 ms) 2024-09-16T17:21:37.393 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestImageWatcher.NotifyRename 2024-09-16T17:21:37.624 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestImageWatcher.NotifyRename (231 ms) 2024-09-16T17:21:37.624 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestImageWatcher.NotifyAsyncTimedOut 2024-09-16T17:21:37.859 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestImageWatcher.NotifyAsyncTimedOut (234 ms) 2024-09-16T17:21:37.859 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestImageWatcher.NotifyAsyncError 2024-09-16T17:21:38.083 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestImageWatcher.NotifyAsyncError (225 ms) 2024-09-16T17:21:38.083 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestImageWatcher.NotifyAsyncCompleteError 2024-09-16T17:21:38.325 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestImageWatcher.NotifyAsyncCompleteError (242 ms) 2024-09-16T17:21:38.326 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestImageWatcher.NotifyAsyncRequestTimedOut 2024-09-16T17:21:38.555 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestImageWatcher.NotifyAsyncRequestTimedOut (230 ms) 2024-09-16T17:21:39.466 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 17 tests from TestImageWatcher (6109 ms total) 2024-09-16T17:21:39.467 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:21:39.467 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment tear-down 2024-09-16T17:21:39.467 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] 17 tests from 1 test suite ran. (8922 ms total) 2024-09-16T17:21:39.467 INFO:tasks.workunit.client.0.smithi122.stdout:[ PASSED ] 17 tests. 2024-09-16T17:21:39.579 INFO:tasks.workunit.client.0.smithi122.stdout:seed 74268 2024-09-16T17:21:39.579 INFO:tasks.workunit.client.0.smithi122.stdout:Note: Google Test filter = TestInternal.* 2024-09-16T17:21:39.579 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] Running 34 tests from 1 test suite. 2024-09-16T17:21:39.579 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment set-up. 2024-09-16T17:21:39.580 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 34 tests from TestInternal 2024-09-16T17:21:41.471 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestInternal.OpenByID 2024-09-16T17:21:43.762 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestInternal.OpenByID (2290 ms) 2024-09-16T17:21:43.762 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestInternal.OpenSnapDNE 2024-09-16T17:21:44.006 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestInternal.OpenSnapDNE (244 ms) 2024-09-16T17:21:44.006 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestInternal.IsExclusiveLockOwner 2024-09-16T17:21:44.264 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestInternal.IsExclusiveLockOwner (259 ms) 2024-09-16T17:21:44.264 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestInternal.ResizeLocksImage 2024-09-16T17:21:44.543 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestInternal.ResizeLocksImage (278 ms) 2024-09-16T17:21:44.543 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestInternal.ResizeFailsToLockImage 2024-09-16T17:21:44.739 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestInternal.ResizeFailsToLockImage (197 ms) 2024-09-16T17:21:44.739 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestInternal.SnapCreateLocksImage 2024-09-16T17:21:46.624 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestInternal.SnapCreateLocksImage (1885 ms) 2024-09-16T17:21:46.624 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestInternal.SnapCreateFailsToLockImage 2024-09-16T17:21:46.822 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestInternal.SnapCreateFailsToLockImage (198 ms) 2024-09-16T17:21:46.822 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestInternal.SnapRollbackLocksImage 2024-09-16T17:21:48.541 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestInternal.SnapRollbackLocksImage (1719 ms) 2024-09-16T17:21:48.541 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestInternal.SnapRollbackFailsToLockImage 2024-09-16T17:21:50.652 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestInternal.SnapRollbackFailsToLockImage (2110 ms) 2024-09-16T17:21:50.652 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestInternal.SnapSetReleasesLock 2024-09-16T17:21:52.677 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestInternal.SnapSetReleasesLock (2026 ms) 2024-09-16T17:21:52.677 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestInternal.FlattenLocksImage 2024-09-16T17:21:55.735 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestInternal.FlattenLocksImage (3058 ms) 2024-09-16T17:21:55.735 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestInternal.FlattenFailsToLockImage 2024-09-16T17:21:59.536 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestInternal.FlattenFailsToLockImage (3800 ms) 2024-09-16T17:21:59.536 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestInternal.WriteFailsToLockImageBlocklisted 2024-09-16T17:21:59.609 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:382: Skipped 2024-09-16T17:21:59.609 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-16T17:21:59.610 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestInternal.WriteFailsToLockImageBlocklisted (74 ms) 2024-09-16T17:21:59.610 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestInternal.WriteFailsToLockImageBlocklistedWatch 2024-09-16T17:21:59.681 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:416: Skipped 2024-09-16T17:21:59.682 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-16T17:21:59.682 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestInternal.WriteFailsToLockImageBlocklistedWatch (72 ms) 2024-09-16T17:21:59.682 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestInternal.AioWriteRequestsLock 2024-09-16T17:21:59.985 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestInternal.AioWriteRequestsLock (304 ms) 2024-09-16T17:21:59.985 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestInternal.AioDiscardRequestsLock 2024-09-16T17:22:00.279 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestInternal.AioDiscardRequestsLock (293 ms) 2024-09-16T17:22:00.279 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestInternal.CancelAsyncResize 2024-09-16T17:22:00.802 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestInternal.CancelAsyncResize (524 ms) 2024-09-16T17:22:00.803 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestInternal.MultipleResize 2024-09-16T17:22:01.532 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestInternal.MultipleResize (729 ms) 2024-09-16T17:22:01.532 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestInternal.Metadata 2024-09-16T17:22:02.171 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestInternal.Metadata (639 ms) 2024-09-16T17:22:02.171 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestInternal.MetadataConfApply 2024-09-16T17:22:02.529 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestInternal.MetadataConfApply (359 ms) 2024-09-16T17:22:02.529 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestInternal.SnapshotCopyup 2024-09-16T17:22:02.602 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:662: Skipped 2024-09-16T17:22:02.602 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-16T17:22:02.602 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestInternal.SnapshotCopyup (73 ms) 2024-09-16T17:22:02.602 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestInternal.SnapshotCopyupZeros 2024-09-16T17:22:04.713 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestInternal.SnapshotCopyupZeros (2111 ms) 2024-09-16T17:22:04.713 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestInternal.SnapshotCopyupZerosMigration 2024-09-16T17:22:06.700 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestInternal.SnapshotCopyupZerosMigration (1987 ms) 2024-09-16T17:22:06.700 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestInternal.ResizeCopyup 2024-09-16T17:22:09.016 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestInternal.ResizeCopyup (2316 ms) 2024-09-16T17:22:09.016 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestInternal.DiscardCopyup 2024-09-16T17:22:09.095 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:1055: Skipped 2024-09-16T17:22:09.095 INFO:tasks.workunit.client.0.smithi122.stdout:Skipping due to unmet REQUIRE 2024-09-16T17:22:09.095 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestInternal.DiscardCopyup (79 ms) 2024-09-16T17:22:09.096 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestInternal.ImageOptions 2024-09-16T17:22:09.170 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestInternal.ImageOptions (75 ms) 2024-09-16T17:22:09.170 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestInternal.WriteFullCopyup 2024-09-16T17:22:14.587 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestInternal.WriteFullCopyup (5416 ms) 2024-09-16T17:22:14.587 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestInternal.DiffIterateCloneOverwrite 2024-09-16T17:22:16.704 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestInternal.DiffIterateCloneOverwrite (2117 ms) 2024-09-16T17:22:16.704 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestInternal.TestCoR 2024-09-16T17:22:16.778 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:1312: Skipped 2024-09-16T17:22:16.778 INFO:tasks.workunit.client.0.smithi122.stdout:Skipping due to disabled copy-on-read 2024-09-16T17:22:16.779 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestInternal.TestCoR (75 ms) 2024-09-16T17:22:16.779 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestInternal.FlattenNoEmptyObjects 2024-09-16T17:22:19.829 INFO:tasks.workunit.client.0.smithi122.stdout:made parent image "image39": 4194304K (1024 * 4K) 2024-09-16T17:22:19.830 INFO:tasks.workunit.client.0.smithi122.stdout:generated random write map: 2024-09-16T17:22:19.830 INFO:tasks.workunit.client.0.smithi122.stdout: [4 , 18890 ] 2024-09-16T17:22:19.830 INFO:tasks.workunit.client.0.smithi122.stdout: [5 , 22235 ] 2024-09-16T17:22:19.830 INFO:tasks.workunit.client.0.smithi122.stdout: [12 , 50367 ] 2024-09-16T17:22:19.830 INFO:tasks.workunit.client.0.smithi122.stdout: [47 , 193604 ] 2024-09-16T17:22:19.830 INFO:tasks.workunit.client.0.smithi122.stdout: [70 , 288469 ] 2024-09-16T17:22:19.830 INFO:tasks.workunit.client.0.smithi122.stdout: [81 , 334060 ] 2024-09-16T17:22:19.830 INFO:tasks.workunit.client.0.smithi122.stdout: [84 , 345705 ] 2024-09-16T17:22:19.830 INFO:tasks.workunit.client.0.smithi122.stdout: [103 , 422007 ] 2024-09-16T17:22:19.830 INFO:tasks.workunit.client.0.smithi122.stdout: [116 , 476695 ] 2024-09-16T17:22:19.831 INFO:tasks.workunit.client.0.smithi122.stdout: [133 , 546992 ] 2024-09-16T17:22:19.831 INFO:tasks.workunit.client.0.smithi122.stdout: [164 , 673083 ] 2024-09-16T17:22:19.831 INFO:tasks.workunit.client.0.smithi122.stdout: [199 , 817997 ] 2024-09-16T17:22:19.831 INFO:tasks.workunit.client.0.smithi122.stdout: [210 , 862468 ] 2024-09-16T17:22:19.831 INFO:tasks.workunit.client.0.smithi122.stdout: [238 , 975288 ] 2024-09-16T17:22:19.831 INFO:tasks.workunit.client.0.smithi122.stdout: [242 , 993478 ] 2024-09-16T17:22:19.831 INFO:tasks.workunit.client.0.smithi122.stdout: [245 , 1005553 ] 2024-09-16T17:22:19.831 INFO:tasks.workunit.client.0.smithi122.stdout: [247 , 1013165 ] 2024-09-16T17:22:19.831 INFO:tasks.workunit.client.0.smithi122.stdout: [255 , 1045502 ] 2024-09-16T17:22:19.831 INFO:tasks.workunit.client.0.smithi122.stdout: [268 , 1098270 ] 2024-09-16T17:22:19.831 INFO:tasks.workunit.client.0.smithi122.stdout: [270 , 1107912 ] 2024-09-16T17:22:19.832 INFO:tasks.workunit.client.0.smithi122.stdout: [281 , 1153422 ] 2024-09-16T17:22:19.832 INFO:tasks.workunit.client.0.smithi122.stdout: [288 , 1182115 ] 2024-09-16T17:22:19.832 INFO:tasks.workunit.client.0.smithi122.stdout: [300 , 1229087 ] 2024-09-16T17:22:19.832 INFO:tasks.workunit.client.0.smithi122.stdout: [302 , 1238450 ] 2024-09-16T17:22:19.832 INFO:tasks.workunit.client.0.smithi122.stdout: [328 , 1345113 ] 2024-09-16T17:22:19.832 INFO:tasks.workunit.client.0.smithi122.stdout: [331 , 1355985 ] 2024-09-16T17:22:19.832 INFO:tasks.workunit.client.0.smithi122.stdout: [333 , 1367098 ] 2024-09-16T17:22:19.832 INFO:tasks.workunit.client.0.smithi122.stdout: [359 , 1473121 ] 2024-09-16T17:22:19.832 INFO:tasks.workunit.client.0.smithi122.stdout: [366 , 1500156 ] 2024-09-16T17:22:19.832 INFO:tasks.workunit.client.0.smithi122.stdout: [387 , 1585882 ] 2024-09-16T17:22:19.832 INFO:tasks.workunit.client.0.smithi122.stdout: [391 , 1604246 ] 2024-09-16T17:22:19.832 INFO:tasks.workunit.client.0.smithi122.stdout: [394 , 1616412 ] 2024-09-16T17:22:19.833 INFO:tasks.workunit.client.0.smithi122.stdout: [436 , 1786995 ] 2024-09-16T17:22:19.833 INFO:tasks.workunit.client.0.smithi122.stdout: [446 , 1828391 ] 2024-09-16T17:22:19.833 INFO:tasks.workunit.client.0.smithi122.stdout: [469 , 1922493 ] 2024-09-16T17:22:19.833 INFO:tasks.workunit.client.0.smithi122.stdout: [489 , 2005992 ] 2024-09-16T17:22:19.833 INFO:tasks.workunit.client.0.smithi122.stdout: [507 , 2079383 ] 2024-09-16T17:22:19.833 INFO:tasks.workunit.client.0.smithi122.stdout: [508 , 2082877 ] 2024-09-16T17:22:19.833 INFO:tasks.workunit.client.0.smithi122.stdout: [523 , 2143955 ] 2024-09-16T17:22:19.833 INFO:tasks.workunit.client.0.smithi122.stdout: [528 , 2165591 ] 2024-09-16T17:22:19.833 INFO:tasks.workunit.client.0.smithi122.stdout: [529 , 2169613 ] 2024-09-16T17:22:19.833 INFO:tasks.workunit.client.0.smithi122.stdout: [540 , 2213116 ] 2024-09-16T17:22:19.833 INFO:tasks.workunit.client.0.smithi122.stdout: [542 , 2223380 ] 2024-09-16T17:22:19.834 INFO:tasks.workunit.client.0.smithi122.stdout: [547 , 2243137 ] 2024-09-16T17:22:19.834 INFO:tasks.workunit.client.0.smithi122.stdout: [568 , 2326854 ] 2024-09-16T17:22:19.834 INFO:tasks.workunit.client.0.smithi122.stdout: [571 , 2341033 ] 2024-09-16T17:22:19.834 INFO:tasks.workunit.client.0.smithi122.stdout: [576 , 2360651 ] 2024-09-16T17:22:19.834 INFO:tasks.workunit.client.0.smithi122.stdout: [579 , 2372143 ] 2024-09-16T17:22:19.834 INFO:tasks.workunit.client.0.smithi122.stdout: [582 , 2384820 ] 2024-09-16T17:22:19.834 INFO:tasks.workunit.client.0.smithi122.stdout: [587 , 2405690 ] 2024-09-16T17:22:19.834 INFO:tasks.workunit.client.0.smithi122.stdout: [592 , 2425210 ] 2024-09-16T17:22:19.834 INFO:tasks.workunit.client.0.smithi122.stdout: [605 , 2480940 ] 2024-09-16T17:22:19.834 INFO:tasks.workunit.client.0.smithi122.stdout: [615 , 2520111 ] 2024-09-16T17:22:19.834 INFO:tasks.workunit.client.0.smithi122.stdout: [624 , 2557818 ] 2024-09-16T17:22:19.834 INFO:tasks.workunit.client.0.smithi122.stdout: [632 , 2590023 ] 2024-09-16T17:22:19.834 INFO:tasks.workunit.client.0.smithi122.stdout: [634 , 2597199 ] 2024-09-16T17:22:19.835 INFO:tasks.workunit.client.0.smithi122.stdout: [648 , 2655571 ] 2024-09-16T17:22:19.835 INFO:tasks.workunit.client.0.smithi122.stdout: [663 , 2717510 ] 2024-09-16T17:22:19.835 INFO:tasks.workunit.client.0.smithi122.stdout: [665 , 2727092 ] 2024-09-16T17:22:19.835 INFO:tasks.workunit.client.0.smithi122.stdout: [666 , 2729172 ] 2024-09-16T17:22:19.835 INFO:tasks.workunit.client.0.smithi122.stdout: [669 , 2743272 ] 2024-09-16T17:22:19.835 INFO:tasks.workunit.client.0.smithi122.stdout: [680 , 2786116 ] 2024-09-16T17:22:19.835 INFO:tasks.workunit.client.0.smithi122.stdout: [685 , 2805951 ] 2024-09-16T17:22:19.835 INFO:tasks.workunit.client.0.smithi122.stdout: [688 , 2821464 ] 2024-09-16T17:22:19.835 INFO:tasks.workunit.client.0.smithi122.stdout: [693 , 2840052 ] 2024-09-16T17:22:19.835 INFO:tasks.workunit.client.0.smithi122.stdout: [695 , 2849219 ] 2024-09-16T17:22:19.835 INFO:tasks.workunit.client.0.smithi122.stdout: [699 , 2864394 ] 2024-09-16T17:22:19.835 INFO:tasks.workunit.client.0.smithi122.stdout: [707 , 2895890 ] 2024-09-16T17:22:19.835 INFO:tasks.workunit.client.0.smithi122.stdout: [722 , 2959977 ] 2024-09-16T17:22:19.836 INFO:tasks.workunit.client.0.smithi122.stdout: [725 , 2971338 ] 2024-09-16T17:22:19.836 INFO:tasks.workunit.client.0.smithi122.stdout: [733 , 3004007 ] 2024-09-16T17:22:19.836 INFO:tasks.workunit.client.0.smithi122.stdout: [735 , 3013976 ] 2024-09-16T17:22:19.836 INFO:tasks.workunit.client.0.smithi122.stdout: [742 , 3040998 ] 2024-09-16T17:22:19.836 INFO:tasks.workunit.client.0.smithi122.stdout: [748 , 3064571 ] 2024-09-16T17:22:19.836 INFO:tasks.workunit.client.0.smithi122.stdout: [752 , 3082746 ] 2024-09-16T17:22:19.836 INFO:tasks.workunit.client.0.smithi122.stdout: [769 , 3152436 ] 2024-09-16T17:22:19.836 INFO:tasks.workunit.client.0.smithi122.stdout: [771 , 3161014 ] 2024-09-16T17:22:19.836 INFO:tasks.workunit.client.0.smithi122.stdout: [791 , 3241068 ] 2024-09-16T17:22:19.836 INFO:tasks.workunit.client.0.smithi122.stdout: [795 , 3256607 ] 2024-09-16T17:22:19.836 INFO:tasks.workunit.client.0.smithi122.stdout: [800 , 3279785 ] 2024-09-16T17:22:19.836 INFO:tasks.workunit.client.0.smithi122.stdout: [810 , 3320603 ] 2024-09-16T17:22:19.837 INFO:tasks.workunit.client.0.smithi122.stdout: [811 , 3322018 ] 2024-09-16T17:22:19.837 INFO:tasks.workunit.client.0.smithi122.stdout: [822 , 3366960 ] 2024-09-16T17:22:19.837 INFO:tasks.workunit.client.0.smithi122.stdout: [825 , 3380458 ] 2024-09-16T17:22:19.837 INFO:tasks.workunit.client.0.smithi122.stdout: [830 , 3400605 ] 2024-09-16T17:22:19.837 INFO:tasks.workunit.client.0.smithi122.stdout: [845 , 3463425 ] 2024-09-16T17:22:19.837 INFO:tasks.workunit.client.0.smithi122.stdout: [846 , 3467085 ] 2024-09-16T17:22:19.837 INFO:tasks.workunit.client.0.smithi122.stdout: [849 , 3479280 ] 2024-09-16T17:22:19.837 INFO:tasks.workunit.client.0.smithi122.stdout: [884 , 3624379 ] 2024-09-16T17:22:19.837 INFO:tasks.workunit.client.0.smithi122.stdout: [914 , 3746522 ] 2024-09-16T17:22:19.837 INFO:tasks.workunit.client.0.smithi122.stdout: [933 , 3822786 ] 2024-09-16T17:22:19.837 INFO:tasks.workunit.client.0.smithi122.stdout: [950 , 3893819 ] 2024-09-16T17:22:19.837 INFO:tasks.workunit.client.0.smithi122.stdout: [973 , 3987825 ] 2024-09-16T17:22:19.837 INFO:tasks.workunit.client.0.smithi122.stdout: [990 , 4057612 ] 2024-09-16T17:22:19.838 INFO:tasks.workunit.client.0.smithi122.stdout: [1023 , 4190917 ] 2024-09-16T17:22:19.838 INFO:tasks.workunit.client.0.smithi122.stdout:write data based on random map 2024-09-16T17:22:19.838 INFO:tasks.workunit.client.0.smithi122.stdout: write object-4 2024-09-16T17:22:19.838 INFO:tasks.workunit.client.0.smithi122.stdout: write object-5 2024-09-16T17:22:19.838 INFO:tasks.workunit.client.0.smithi122.stdout: write object-12 2024-09-16T17:22:19.838 INFO:tasks.workunit.client.0.smithi122.stdout: write object-47 2024-09-16T17:22:19.838 INFO:tasks.workunit.client.0.smithi122.stdout: write object-70 2024-09-16T17:22:19.838 INFO:tasks.workunit.client.0.smithi122.stdout: write object-81 2024-09-16T17:22:19.838 INFO:tasks.workunit.client.0.smithi122.stdout: write object-84 2024-09-16T17:22:19.838 INFO:tasks.workunit.client.0.smithi122.stdout: write object-103 2024-09-16T17:22:19.838 INFO:tasks.workunit.client.0.smithi122.stdout: write object-116 2024-09-16T17:22:19.838 INFO:tasks.workunit.client.0.smithi122.stdout: write object-133 2024-09-16T17:22:19.839 INFO:tasks.workunit.client.0.smithi122.stdout: write object-164 2024-09-16T17:22:19.839 INFO:tasks.workunit.client.0.smithi122.stdout: write object-199 2024-09-16T17:22:19.839 INFO:tasks.workunit.client.0.smithi122.stdout: write object-210 2024-09-16T17:22:19.839 INFO:tasks.workunit.client.0.smithi122.stdout: write object-238 2024-09-16T17:22:19.839 INFO:tasks.workunit.client.0.smithi122.stdout: write object-242 2024-09-16T17:22:19.839 INFO:tasks.workunit.client.0.smithi122.stdout: write object-245 2024-09-16T17:22:19.839 INFO:tasks.workunit.client.0.smithi122.stdout: write object-247 2024-09-16T17:22:19.839 INFO:tasks.workunit.client.0.smithi122.stdout: write object-255 2024-09-16T17:22:19.839 INFO:tasks.workunit.client.0.smithi122.stdout: write object-268 2024-09-16T17:22:19.839 INFO:tasks.workunit.client.0.smithi122.stdout: write object-270 2024-09-16T17:22:19.839 INFO:tasks.workunit.client.0.smithi122.stdout: write object-281 2024-09-16T17:22:19.839 INFO:tasks.workunit.client.0.smithi122.stdout: write object-288 2024-09-16T17:22:19.840 INFO:tasks.workunit.client.0.smithi122.stdout: write object-300 2024-09-16T17:22:19.840 INFO:tasks.workunit.client.0.smithi122.stdout: write object-302 2024-09-16T17:22:19.840 INFO:tasks.workunit.client.0.smithi122.stdout: write object-328 2024-09-16T17:22:19.840 INFO:tasks.workunit.client.0.smithi122.stdout: write object-331 2024-09-16T17:22:19.840 INFO:tasks.workunit.client.0.smithi122.stdout: write object-333 2024-09-16T17:22:19.840 INFO:tasks.workunit.client.0.smithi122.stdout: write object-359 2024-09-16T17:22:19.840 INFO:tasks.workunit.client.0.smithi122.stdout: write object-366 2024-09-16T17:22:19.840 INFO:tasks.workunit.client.0.smithi122.stdout: write object-387 2024-09-16T17:22:19.840 INFO:tasks.workunit.client.0.smithi122.stdout: write object-391 2024-09-16T17:22:19.840 INFO:tasks.workunit.client.0.smithi122.stdout: write object-394 2024-09-16T17:22:19.840 INFO:tasks.workunit.client.0.smithi122.stdout: write object-436 2024-09-16T17:22:19.840 INFO:tasks.workunit.client.0.smithi122.stdout: write object-446 2024-09-16T17:22:19.840 INFO:tasks.workunit.client.0.smithi122.stdout: write object-469 2024-09-16T17:22:19.841 INFO:tasks.workunit.client.0.smithi122.stdout: write object-489 2024-09-16T17:22:19.841 INFO:tasks.workunit.client.0.smithi122.stdout: write object-507 2024-09-16T17:22:19.841 INFO:tasks.workunit.client.0.smithi122.stdout: write object-508 2024-09-16T17:22:19.841 INFO:tasks.workunit.client.0.smithi122.stdout: write object-523 2024-09-16T17:22:19.841 INFO:tasks.workunit.client.0.smithi122.stdout: write object-528 2024-09-16T17:22:19.841 INFO:tasks.workunit.client.0.smithi122.stdout: write object-529 2024-09-16T17:22:19.841 INFO:tasks.workunit.client.0.smithi122.stdout: write object-540 2024-09-16T17:22:19.841 INFO:tasks.workunit.client.0.smithi122.stdout: write object-542 2024-09-16T17:22:19.841 INFO:tasks.workunit.client.0.smithi122.stdout: write object-547 2024-09-16T17:22:19.841 INFO:tasks.workunit.client.0.smithi122.stdout: write object-568 2024-09-16T17:22:19.841 INFO:tasks.workunit.client.0.smithi122.stdout: write object-571 2024-09-16T17:22:19.841 INFO:tasks.workunit.client.0.smithi122.stdout: write object-576 2024-09-16T17:22:19.842 INFO:tasks.workunit.client.0.smithi122.stdout: write object-579 2024-09-16T17:22:19.842 INFO:tasks.workunit.client.0.smithi122.stdout: write object-582 2024-09-16T17:22:19.842 INFO:tasks.workunit.client.0.smithi122.stdout: write object-587 2024-09-16T17:22:19.842 INFO:tasks.workunit.client.0.smithi122.stdout: write object-592 2024-09-16T17:22:19.842 INFO:tasks.workunit.client.0.smithi122.stdout: write object-605 2024-09-16T17:22:19.842 INFO:tasks.workunit.client.0.smithi122.stdout: write object-615 2024-09-16T17:22:19.842 INFO:tasks.workunit.client.0.smithi122.stdout: write object-624 2024-09-16T17:22:19.842 INFO:tasks.workunit.client.0.smithi122.stdout: write object-632 2024-09-16T17:22:19.842 INFO:tasks.workunit.client.0.smithi122.stdout: write object-634 2024-09-16T17:22:19.842 INFO:tasks.workunit.client.0.smithi122.stdout: write object-648 2024-09-16T17:22:19.842 INFO:tasks.workunit.client.0.smithi122.stdout: write object-663 2024-09-16T17:22:19.842 INFO:tasks.workunit.client.0.smithi122.stdout: write object-665 2024-09-16T17:22:19.843 INFO:tasks.workunit.client.0.smithi122.stdout: write object-666 2024-09-16T17:22:19.843 INFO:tasks.workunit.client.0.smithi122.stdout: write object-669 2024-09-16T17:22:19.843 INFO:tasks.workunit.client.0.smithi122.stdout: write object-680 2024-09-16T17:22:19.843 INFO:tasks.workunit.client.0.smithi122.stdout: write object-685 2024-09-16T17:22:19.843 INFO:tasks.workunit.client.0.smithi122.stdout: write object-688 2024-09-16T17:22:19.843 INFO:tasks.workunit.client.0.smithi122.stdout: write object-693 2024-09-16T17:22:19.843 INFO:tasks.workunit.client.0.smithi122.stdout: write object-695 2024-09-16T17:22:19.843 INFO:tasks.workunit.client.0.smithi122.stdout: write object-699 2024-09-16T17:22:19.843 INFO:tasks.workunit.client.0.smithi122.stdout: write object-707 2024-09-16T17:22:19.843 INFO:tasks.workunit.client.0.smithi122.stdout: write object-722 2024-09-16T17:22:19.843 INFO:tasks.workunit.client.0.smithi122.stdout: write object-725 2024-09-16T17:22:19.843 INFO:tasks.workunit.client.0.smithi122.stdout: write object-733 2024-09-16T17:22:19.844 INFO:tasks.workunit.client.0.smithi122.stdout: write object-735 2024-09-16T17:22:19.844 INFO:tasks.workunit.client.0.smithi122.stdout: write object-742 2024-09-16T17:22:19.844 INFO:tasks.workunit.client.0.smithi122.stdout: write object-748 2024-09-16T17:22:19.844 INFO:tasks.workunit.client.0.smithi122.stdout: write object-752 2024-09-16T17:22:19.844 INFO:tasks.workunit.client.0.smithi122.stdout: write object-769 2024-09-16T17:22:19.844 INFO:tasks.workunit.client.0.smithi122.stdout: write object-771 2024-09-16T17:22:19.844 INFO:tasks.workunit.client.0.smithi122.stdout: write object-791 2024-09-16T17:22:19.844 INFO:tasks.workunit.client.0.smithi122.stdout: write object-795 2024-09-16T17:22:19.844 INFO:tasks.workunit.client.0.smithi122.stdout: write object-800 2024-09-16T17:22:19.844 INFO:tasks.workunit.client.0.smithi122.stdout: write object-810 2024-09-16T17:22:19.844 INFO:tasks.workunit.client.0.smithi122.stdout: write object-811 2024-09-16T17:22:19.844 INFO:tasks.workunit.client.0.smithi122.stdout: write object-822 2024-09-16T17:22:19.845 INFO:tasks.workunit.client.0.smithi122.stdout: write object-825 2024-09-16T17:22:19.845 INFO:tasks.workunit.client.0.smithi122.stdout: write object-830 2024-09-16T17:22:19.845 INFO:tasks.workunit.client.0.smithi122.stdout: write object-845 2024-09-16T17:22:19.845 INFO:tasks.workunit.client.0.smithi122.stdout: write object-846 2024-09-16T17:22:19.845 INFO:tasks.workunit.client.0.smithi122.stdout: write object-849 2024-09-16T17:22:19.845 INFO:tasks.workunit.client.0.smithi122.stdout: write object-884 2024-09-16T17:22:19.845 INFO:tasks.workunit.client.0.smithi122.stdout: write object-914 2024-09-16T17:22:23.510 INFO:tasks.workunit.client.0.smithi122.stdout: write object-933 2024-09-16T17:22:23.510 INFO:tasks.workunit.client.0.smithi122.stdout: write object-950 2024-09-16T17:22:23.510 INFO:tasks.workunit.client.0.smithi122.stdout: write object-973 2024-09-16T17:22:23.510 INFO:tasks.workunit.client.0.smithi122.stdout: write object-990 2024-09-16T17:22:23.510 INFO:tasks.workunit.client.0.smithi122.stdout: write object-1023 2024-09-16T17:22:23.510 INFO:tasks.workunit.client.0.smithi122.stdout:verify written data by reading 2024-09-16T17:22:23.510 INFO:tasks.workunit.client.0.smithi122.stdout: read object-4 2024-09-16T17:22:23.511 INFO:tasks.workunit.client.0.smithi122.stdout:made snapshot "image39@parent_snap" and protect it 2024-09-16T17:22:23.511 INFO:tasks.workunit.client.0.smithi122.stdout:made and opened clone "image40" 2024-09-16T17:22:23.511 INFO:tasks.workunit.client.0.smithi122.stdout:flattening clone: "image40" 2024-09-16T17:22:23.511 INFO:tasks.workunit.client.0.smithi122.stdout:check whether child image has the same set of objects as parent 2024-09-16T17:22:23.511 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestInternal.FlattenNoEmptyObjects (6732 ms) 2024-09-16T17:22:23.511 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestInternal.PoolMetadataConfApply 2024-09-16T17:22:24.267 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestInternal.PoolMetadataConfApply (757 ms) 2024-09-16T17:22:24.268 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestInternal.Sparsify 2024-09-16T17:22:24.513 INFO:tasks.workunit.client.0.smithi122.stdout:sparsify_supported=1 2024-09-16T17:22:24.513 INFO:tasks.workunit.client.0.smithi122.stdout:sparse_read_supported=1 2024-09-16T17:22:24.956 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestInternal.Sparsify (689 ms) 2024-09-16T17:22:24.956 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestInternal.SparsifyClone 2024-09-16T17:22:25.142 INFO:tasks.workunit.client.0.smithi122.stdout:sparsify_supported=1 2024-09-16T17:22:28.218 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestInternal.SparsifyClone (3262 ms) 2024-09-16T17:22:28.218 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestInternal.MissingDataPool 2024-09-16T17:22:30.316 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestInternal.MissingDataPool (2098 ms) 2024-09-16T17:22:31.116 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 34 tests from TestInternal (48845 ms total) 2024-09-16T17:22:31.116 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:22:31.116 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment tear-down 2024-09-16T17:22:31.116 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] 34 tests from 1 test suite ran. (51536 ms total) 2024-09-16T17:22:31.116 INFO:tasks.workunit.client.0.smithi122.stdout:[ PASSED ] 29 tests. 2024-09-16T17:22:31.116 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] 5 tests, listed below: 2024-09-16T17:22:31.116 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestInternal.WriteFailsToLockImageBlocklisted 2024-09-16T17:22:31.116 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestInternal.WriteFailsToLockImageBlocklistedWatch 2024-09-16T17:22:31.117 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestInternal.SnapshotCopyup 2024-09-16T17:22:31.117 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestInternal.DiscardCopyup 2024-09-16T17:22:31.117 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestInternal.TestCoR 2024-09-16T17:22:31.212 INFO:tasks.workunit.client.0.smithi122.stdout:seed 74322 2024-09-16T17:22:31.212 INFO:tasks.workunit.client.0.smithi122.stdout:Note: Google Test filter = TestMirroring.* 2024-09-16T17:22:31.212 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] Running 51 tests from 1 test suite. 2024-09-16T17:22:31.212 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment set-up. 2024-09-16T17:22:31.212 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 51 tests from TestMirroring 2024-09-16T17:22:33.121 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModeImage 2024-09-16T17:22:36.418 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModeImage (3297 ms) 2024-09-16T17:22:36.418 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModePool 2024-09-16T17:22:37.746 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModePool (1328 ms) 2024-09-16T17:22:37.746 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModeDisabled 2024-09-16T17:22:38.954 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModeDisabled (1208 ms) 2024-09-16T17:22:38.954 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestMirroring.DisableImageMirror_In_MirrorModeImage 2024-09-16T17:22:40.280 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestMirroring.DisableImageMirror_In_MirrorModeImage (1326 ms) 2024-09-16T17:22:40.281 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestMirroring.DisableImageMirror_In_MirrorModeImage_NoObjectMap 2024-09-16T17:22:41.558 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestMirroring.DisableImageMirror_In_MirrorModeImage_NoObjectMap (1277 ms) 2024-09-16T17:22:41.558 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestMirroring.DisableImageMirror_In_MirrorModePool 2024-09-16T17:22:42.783 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestMirroring.DisableImageMirror_In_MirrorModePool (1226 ms) 2024-09-16T17:22:42.783 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestMirroring.DisableImageMirror_In_MirrorModeDisabled 2024-09-16T17:22:44.265 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestMirroring.DisableImageMirror_In_MirrorModeDisabled (1481 ms) 2024-09-16T17:22:44.265 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestMirroring.DisableImageMirrorWithPeer 2024-09-16T17:22:44.265 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_mirroring.cc:482: Skipped 2024-09-16T17:22:44.265 INFO:tasks.workunit.client.0.smithi122.stdout:Skipping due to unmet REQUIRE 2024-09-16T17:22:44.265 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestMirroring.DisableImageMirrorWithPeer (0 ms) 2024-09-16T17:22:44.265 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestMirroring.DisableJournalingWithPeer 2024-09-16T17:22:44.265 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_mirroring.cc:520: Skipped 2024-09-16T17:22:44.265 INFO:tasks.workunit.client.0.smithi122.stdout:Skipping due to unmet REQUIRE 2024-09-16T17:22:44.265 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestMirroring.DisableJournalingWithPeer (0 ms) 2024-09-16T17:22:44.265 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModeDisabled_WithoutJournaling 2024-09-16T17:22:45.147 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModeDisabled_WithoutJournaling (883 ms) 2024-09-16T17:22:45.147 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModePool_WithoutJournaling 2024-09-16T17:22:46.152 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModePool_WithoutJournaling (1005 ms) 2024-09-16T17:22:46.152 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModeImage_WithoutJournaling 2024-09-16T17:22:48.883 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModeImage_WithoutJournaling (2731 ms) 2024-09-16T17:22:48.883 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModeImage_WithoutExclusiveLock 2024-09-16T17:22:50.815 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModeImage_WithoutExclusiveLock (1931 ms) 2024-09-16T17:22:50.815 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestMirroring.CreateImage_In_MirrorModeDisabled 2024-09-16T17:22:51.897 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestMirroring.CreateImage_In_MirrorModeDisabled (1083 ms) 2024-09-16T17:22:51.897 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestMirroring.CreateImage_In_MirrorModeImage 2024-09-16T17:22:53.029 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestMirroring.CreateImage_In_MirrorModeImage (1132 ms) 2024-09-16T17:22:53.029 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestMirroring.CreateImage_In_MirrorModePool 2024-09-16T17:22:54.367 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestMirroring.CreateImage_In_MirrorModePool (1338 ms) 2024-09-16T17:22:54.367 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestMirroring.CreateImage_In_MirrorModePool_WithoutJournaling 2024-09-16T17:22:55.415 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestMirroring.CreateImage_In_MirrorModePool_WithoutJournaling (1048 ms) 2024-09-16T17:22:55.415 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestMirroring.CreateImage_In_MirrorModeImage_WithoutJournaling 2024-09-16T17:22:56.408 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestMirroring.CreateImage_In_MirrorModeImage_WithoutJournaling (992 ms) 2024-09-16T17:22:56.408 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestMirroring.EnableJournaling_In_MirrorModeDisabled 2024-09-16T17:22:57.678 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestMirroring.EnableJournaling_In_MirrorModeDisabled (1271 ms) 2024-09-16T17:22:57.678 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestMirroring.EnableJournaling_In_MirrorModeImage 2024-09-16T17:22:58.958 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestMirroring.EnableJournaling_In_MirrorModeImage (1280 ms) 2024-09-16T17:22:58.959 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestMirroring.EnableJournaling_In_MirrorModeImage_SnapshotMirroringEnabled 2024-09-16T17:23:01.068 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestMirroring.EnableJournaling_In_MirrorModeImage_SnapshotMirroringEnabled (2109 ms) 2024-09-16T17:23:01.068 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestMirroring.EnableJournaling_In_MirrorModePool 2024-09-16T17:23:02.532 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestMirroring.EnableJournaling_In_MirrorModePool (1464 ms) 2024-09-16T17:23:02.532 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestMirroring.DisableJournaling_In_MirrorModePool 2024-09-16T17:23:03.847 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestMirroring.DisableJournaling_In_MirrorModePool (1316 ms) 2024-09-16T17:23:03.847 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestMirroring.DisableJournaling_In_MirrorModeImage 2024-09-16T17:23:05.112 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestMirroring.DisableJournaling_In_MirrorModeImage (1265 ms) 2024-09-16T17:23:05.112 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestMirroring.MirrorModeSet_DisabledMode_To_PoolMode 2024-09-16T17:23:07.116 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestMirroring.MirrorModeSet_DisabledMode_To_PoolMode (2004 ms) 2024-09-16T17:23:07.116 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestMirroring.MirrorModeSet_PoolMode_To_DisabledMode 2024-09-16T17:23:09.115 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestMirroring.MirrorModeSet_PoolMode_To_DisabledMode (1998 ms) 2024-09-16T17:23:09.115 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestMirroring.MirrorModeSet_DisabledMode_To_ImageMode 2024-09-16T17:23:10.835 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestMirroring.MirrorModeSet_DisabledMode_To_ImageMode (1721 ms) 2024-09-16T17:23:10.835 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestMirroring.MirrorModeSet_PoolMode_To_ImageMode 2024-09-16T17:23:12.694 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestMirroring.MirrorModeSet_PoolMode_To_ImageMode (1859 ms) 2024-09-16T17:23:12.695 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestMirroring.MirrorModeSet_ImageMode_To_PoolMode 2024-09-16T17:23:14.666 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestMirroring.MirrorModeSet_ImageMode_To_PoolMode (1971 ms) 2024-09-16T17:23:14.666 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestMirroring.MirrorModeSet_ImageMode_To_DisabledMode 2024-09-16T17:23:16.838 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestMirroring.MirrorModeSet_ImageMode_To_DisabledMode (2173 ms) 2024-09-16T17:23:16.839 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestMirroring.RemoveImage_With_MirrorImageEnabled 2024-09-16T17:23:17.895 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestMirroring.RemoveImage_With_MirrorImageEnabled (1057 ms) 2024-09-16T17:23:17.895 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestMirroring.RemoveImage_With_MirrorImageDisabled 2024-09-16T17:23:18.885 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestMirroring.RemoveImage_With_MirrorImageDisabled (990 ms) 2024-09-16T17:23:18.885 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestMirroring.RemoveImage_With_ImageWithoutJournal 2024-09-16T17:23:19.693 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestMirroring.RemoveImage_With_ImageWithoutJournal (808 ms) 2024-09-16T17:23:19.694 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestMirroring.RemoveImage_With_MirrorImageDemoted 2024-09-16T17:23:21.398 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestMirroring.RemoveImage_With_MirrorImageDemoted (1705 ms) 2024-09-16T17:23:21.399 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestMirroring.TrashMoveRestore_PoolMode 2024-09-16T17:23:22.993 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestMirroring.TrashMoveRestore_PoolMode (1594 ms) 2024-09-16T17:23:22.993 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestMirroring.TrashMoveRestore_ImageMode_MirroringDisabled 2024-09-16T17:23:24.365 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestMirroring.TrashMoveRestore_ImageMode_MirroringDisabled (1372 ms) 2024-09-16T17:23:24.365 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestMirroring.TrashMoveRestore_ImageMode_MirroringEnabled 2024-09-16T17:23:25.821 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestMirroring.TrashMoveRestore_ImageMode_MirroringEnabled (1457 ms) 2024-09-16T17:23:25.821 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestMirroring.MirrorStatusList 2024-09-16T17:23:26.761 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestMirroring.MirrorStatusList (940 ms) 2024-09-16T17:23:26.761 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestMirroring.RemoveBootstrapped 2024-09-16T17:23:27.997 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestMirroring.RemoveBootstrapped (1236 ms) 2024-09-16T17:23:27.998 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestMirroring.AioPromoteDemote 2024-09-16T17:23:33.986 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestMirroring.AioPromoteDemote (5988 ms) 2024-09-16T17:23:33.986 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestMirroring.AioGetInfo 2024-09-16T17:23:38.447 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestMirroring.AioGetInfo (4462 ms) 2024-09-16T17:23:38.447 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestMirroring.AioGetStatus 2024-09-16T17:23:41.217 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestMirroring.AioGetStatus (2770 ms) 2024-09-16T17:23:41.218 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestMirroring.SiteName 2024-09-16T17:23:41.224 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestMirroring.SiteName (6 ms) 2024-09-16T17:23:41.224 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestMirroring.Bootstrap 2024-09-16T17:23:53.171 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestMirroring.Bootstrap (11948 ms) 2024-09-16T17:23:53.171 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestMirroring.PeerDirection 2024-09-16T17:23:53.248 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestMirroring.PeerDirection (77 ms) 2024-09-16T17:23:53.248 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestMirroring.Snapshot 2024-09-16T17:24:10.537 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestMirroring.Snapshot (17289 ms) 2024-09-16T17:24:10.537 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestMirroring.SnapshotRemoveOnDisable 2024-09-16T17:24:15.578 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestMirroring.SnapshotRemoveOnDisable (5041 ms) 2024-09-16T17:24:15.578 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestMirroring.SnapshotUnlinkPeer 2024-09-16T17:24:28.349 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestMirroring.SnapshotUnlinkPeer (12770 ms) 2024-09-16T17:24:28.349 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestMirroring.SnapshotImageState 2024-09-16T17:24:34.923 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestMirroring.SnapshotImageState (6575 ms) 2024-09-16T17:24:34.924 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestMirroring.SnapshotPromoteDemote 2024-09-16T17:24:45.030 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestMirroring.SnapshotPromoteDemote (10106 ms) 2024-09-16T17:24:45.030 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestMirroring.AioSnapshotCreate 2024-09-16T17:25:21.114 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestMirroring.AioSnapshotCreate (36084 ms) 2024-09-16T17:25:22.059 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 51 tests from TestMirroring (167992 ms total) 2024-09-16T17:25:22.059 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:25:22.059 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment tear-down 2024-09-16T17:25:22.059 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] 51 tests from 1 test suite ran. (170847 ms total) 2024-09-16T17:25:22.059 INFO:tasks.workunit.client.0.smithi122.stdout:[ PASSED ] 49 tests. 2024-09-16T17:25:22.059 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] 2 tests, listed below: 2024-09-16T17:25:22.060 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestMirroring.DisableImageMirrorWithPeer 2024-09-16T17:25:22.060 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestMirroring.DisableJournalingWithPeer 2024-09-16T17:25:22.171 INFO:tasks.workunit.client.0.smithi122.stdout:seed 74827 2024-09-16T17:25:22.172 INFO:tasks.workunit.client.0.smithi122.stdout:Note: Google Test filter = TestGroup.* 2024-09-16T17:25:22.172 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-16T17:25:22.172 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment set-up. 2024-09-16T17:25:22.172 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 13 tests from TestGroup 2024-09-16T17:25:24.061 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestGroup.group_create 2024-09-16T17:25:26.274 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestGroup.group_create (2213 ms) 2024-09-16T17:25:26.274 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestGroup.group_createPP 2024-09-16T17:25:26.449 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestGroup.group_createPP (174 ms) 2024-09-16T17:25:26.449 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestGroup.group_get_id 2024-09-16T17:25:26.608 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestGroup.group_get_id (160 ms) 2024-09-16T17:25:26.608 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestGroup.group_get_idPP 2024-09-16T17:25:26.768 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestGroup.group_get_idPP (160 ms) 2024-09-16T17:25:26.769 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestGroup.add_image 2024-09-16T17:25:27.261 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestGroup.add_image (493 ms) 2024-09-16T17:25:27.261 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestGroup.add_imagePP 2024-09-16T17:25:27.723 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestGroup.add_imagePP (462 ms) 2024-09-16T17:25:27.724 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestGroup.add_snapshot 2024-09-16T17:25:34.688 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestGroup.add_snapshot (6964 ms) 2024-09-16T17:25:34.688 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestGroup.add_snapshotPP 2024-09-16T17:25:40.684 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestGroup.add_snapshotPP (5996 ms) 2024-09-16T17:25:40.685 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestGroup.snap_get_info 2024-09-16T17:25:45.493 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestGroup.snap_get_info (4808 ms) 2024-09-16T17:25:45.493 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestGroup.snap_get_infoPP 2024-09-16T17:25:50.517 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestGroup.snap_get_infoPP (5025 ms) 2024-09-16T17:25:50.517 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestGroup.snap_list2 2024-09-16T17:26:01.557 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestGroup.snap_list2 (11039 ms) 2024-09-16T17:26:01.558 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestGroup.snap_list2PP 2024-09-16T17:26:12.656 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestGroup.snap_list2PP (11098 ms) 2024-09-16T17:26:12.657 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestGroup.snap_list_internal 2024-09-16T17:26:14.489 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestGroup.snap_list_internal (1833 ms) 2024-09-16T17:26:14.658 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 13 tests from TestGroup (50427 ms total) 2024-09-16T17:26:14.658 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:26:14.659 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment tear-down 2024-09-16T17:26:14.659 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] 13 tests from 1 test suite ran. (52486 ms total) 2024-09-16T17:26:14.659 INFO:tasks.workunit.client.0.smithi122.stdout:[ PASSED ] 13 tests. 2024-09-16T17:26:14.756 INFO:tasks.workunit.client.0.smithi122.stdout:seed 74890 2024-09-16T17:26:14.757 INFO:tasks.workunit.client.0.smithi122.stdout:Note: Google Test filter = TestMirroringWatcher.* 2024-09-16T17:26:14.757 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] Running 2 tests from 1 test suite. 2024-09-16T17:26:14.757 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment set-up. 2024-09-16T17:26:14.757 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 2 tests from TestMirroringWatcher 2024-09-16T17:26:16.665 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestMirroringWatcher.ModeUpdated 2024-09-16T17:26:18.947 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestMirroringWatcher.ModeUpdated (2281 ms) 2024-09-16T17:26:18.947 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestMirroringWatcher.ImageStatusUpdated 2024-09-16T17:26:19.150 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestMirroringWatcher.ImageStatusUpdated (204 ms) 2024-09-16T17:26:19.684 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 2 tests from TestMirroringWatcher (2485 ms total) 2024-09-16T17:26:19.684 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:26:19.684 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment tear-down 2024-09-16T17:26:19.684 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] 2 tests from 1 test suite ran. (4927 ms total) 2024-09-16T17:26:19.684 INFO:tasks.workunit.client.0.smithi122.stdout:[ PASSED ] 2 tests. 2024-09-16T17:26:19.770 INFO:tasks.workunit.client.0.smithi122.stdout:seed 74943 2024-09-16T17:26:19.771 INFO:tasks.workunit.client.0.smithi122.stdout:Note: Google Test filter = TestObjectMap.* 2024-09-16T17:26:19.771 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-16T17:26:19.771 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment set-up. 2024-09-16T17:26:19.771 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 4 tests from TestObjectMap 2024-09-16T17:26:21.692 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestObjectMap.RefreshInvalidatesWhenCorrupt 2024-09-16T17:26:23.785 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestObjectMap.RefreshInvalidatesWhenCorrupt (2093 ms) 2024-09-16T17:26:23.786 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestObjectMap.RefreshInvalidatesWhenTooSmall 2024-09-16T17:26:24.074 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestObjectMap.RefreshInvalidatesWhenTooSmall (289 ms) 2024-09-16T17:26:24.074 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestObjectMap.InvalidateFlagOnDisk 2024-09-16T17:26:24.476 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestObjectMap.InvalidateFlagOnDisk (402 ms) 2024-09-16T17:26:24.476 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestObjectMap.AcquireLockInvalidatesWhenTooSmall 2024-09-16T17:26:24.797 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestObjectMap.AcquireLockInvalidatesWhenTooSmall (321 ms) 2024-09-16T17:26:25.705 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 4 tests from TestObjectMap (3105 ms total) 2024-09-16T17:26:25.705 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:26:25.705 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment tear-down 2024-09-16T17:26:25.706 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] 4 tests from 1 test suite ran. (5935 ms total) 2024-09-16T17:26:25.706 INFO:tasks.workunit.client.0.smithi122.stdout:[ PASSED ] 4 tests. 2024-09-16T17:26:25.706 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:26:25.706 INFO:tasks.workunit.client.0.smithi122.stdout: YOU HAVE 1 DISABLED TEST 2024-09-16T17:26:25.706 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:26:25.806 INFO:tasks.workunit.client.0.smithi122.stdout:seed 74995 2024-09-16T17:26:25.806 INFO:tasks.workunit.client.0.smithi122.stdout:Note: Google Test filter = TestOperations.* 2024-09-16T17:26:25.806 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] Running 1 test from 1 test suite. 2024-09-16T17:26:25.806 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment set-up. 2024-09-16T17:26:25.806 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 1 test from TestOperations 2024-09-16T17:26:27.710 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestOperations.DisableJournalingCorrupt 2024-09-16T17:26:29.568 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_Operations.cc:18: Skipped 2024-09-16T17:26:29.569 INFO:tasks.workunit.client.0.smithi122.stdout:Skipping due to unmet REQUIRE 2024-09-16T17:26:29.569 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestOperations.DisableJournalingCorrupt (1857 ms) 2024-09-16T17:26:30.455 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 1 test from TestOperations (1857 ms total) 2024-09-16T17:26:30.455 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:26:30.456 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment tear-down 2024-09-16T17:26:30.456 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] 1 test from 1 test suite ran. (4649 ms total) 2024-09-16T17:26:30.456 INFO:tasks.workunit.client.0.smithi122.stdout:[ PASSED ] 0 tests. 2024-09-16T17:26:30.456 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] 1 test, listed below: 2024-09-16T17:26:30.456 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestOperations.DisableJournalingCorrupt 2024-09-16T17:26:30.553 INFO:tasks.workunit.client.0.smithi122.stdout:seed 75044 2024-09-16T17:26:30.555 INFO:tasks.workunit.client.0.smithi122.stdout:Note: Google Test filter = TestTrash.* 2024-09-16T17:26:30.555 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] Running 2 tests from 1 test suite. 2024-09-16T17:26:30.555 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment set-up. 2024-09-16T17:26:30.555 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 2 tests from TestTrash 2024-09-16T17:26:32.454 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestTrash.UserRemovingSource 2024-09-16T17:26:35.293 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestTrash.UserRemovingSource (2839 ms) 2024-09-16T17:26:35.294 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestTrash.RestoreMirroringSource 2024-09-16T17:26:35.759 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] TestTrash.RestoreMirroringSource (467 ms) 2024-09-16T17:26:36.481 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 2 tests from TestTrash (3306 ms total) 2024-09-16T17:26:36.481 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:26:36.481 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment tear-down 2024-09-16T17:26:36.481 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] 2 tests from 1 test suite ran. (5925 ms total) 2024-09-16T17:26:36.481 INFO:tasks.workunit.client.0.smithi122.stdout:[ PASSED ] 2 tests. 2024-09-16T17:26:36.566 INFO:tasks.workunit.client.0.smithi122.stdout:seed 75096 2024-09-16T17:26:36.568 INFO:tasks.workunit.client.0.smithi122.stdout:Note: Google Test filter = TestJournalEntries.* 2024-09-16T17:26:36.569 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-16T17:26:36.569 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment set-up. 2024-09-16T17:26:36.570 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 4 tests from TestJournalEntries 2024-09-16T17:26:38.492 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestJournalEntries.AioWrite 2024-09-16T17:26:40.623 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Entries.cc:118: Skipped 2024-09-16T17:26:40.623 INFO:tasks.workunit.client.0.smithi122.stdout:Skipping due to unmet REQUIRE 2024-09-16T17:26:40.623 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestJournalEntries.AioWrite (2130 ms) 2024-09-16T17:26:40.623 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestJournalEntries.AioDiscard 2024-09-16T17:26:40.693 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Entries.cc:163: Skipped 2024-09-16T17:26:40.693 INFO:tasks.workunit.client.0.smithi122.stdout:Skipping due to unmet REQUIRE 2024-09-16T17:26:40.693 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestJournalEntries.AioDiscard (71 ms) 2024-09-16T17:26:40.693 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestJournalEntries.AioDiscardWithPrune 2024-09-16T17:26:40.766 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Entries.cc:200: Skipped 2024-09-16T17:26:40.766 INFO:tasks.workunit.client.0.smithi122.stdout:Skipping due to unmet REQUIRE 2024-09-16T17:26:40.767 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestJournalEntries.AioDiscardWithPrune (73 ms) 2024-09-16T17:26:40.767 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestJournalEntries.AioFlush 2024-09-16T17:26:40.840 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Entries.cc:263: Skipped 2024-09-16T17:26:40.840 INFO:tasks.workunit.client.0.smithi122.stdout:Skipping due to unmet REQUIRE 2024-09-16T17:26:40.841 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestJournalEntries.AioFlush (74 ms) 2024-09-16T17:26:41.509 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 4 tests from TestJournalEntries (2348 ms total) 2024-09-16T17:26:41.509 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:26:41.509 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment tear-down 2024-09-16T17:26:41.509 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] 4 tests from 1 test suite ran. (4940 ms total) 2024-09-16T17:26:41.509 INFO:tasks.workunit.client.0.smithi122.stdout:[ PASSED ] 0 tests. 2024-09-16T17:26:41.509 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] 4 tests, listed below: 2024-09-16T17:26:41.509 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestJournalEntries.AioWrite 2024-09-16T17:26:41.509 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestJournalEntries.AioDiscard 2024-09-16T17:26:41.509 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestJournalEntries.AioDiscardWithPrune 2024-09-16T17:26:41.509 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestJournalEntries.AioFlush 2024-09-16T17:26:41.612 INFO:tasks.workunit.client.0.smithi122.stdout:seed 75145 2024-09-16T17:26:41.615 INFO:tasks.workunit.client.0.smithi122.stdout:Note: Google Test filter = TestJournalReplay.* 2024-09-16T17:26:41.615 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] Running 16 tests from 1 test suite. 2024-09-16T17:26:41.615 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment set-up. 2024-09-16T17:26:41.615 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 16 tests from TestJournalReplay 2024-09-16T17:26:43.449 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestJournalReplay.AioDiscardEvent 2024-09-16T17:26:45.650 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:109: Skipped 2024-09-16T17:26:45.650 INFO:tasks.workunit.client.0.smithi122.stdout:Skipping due to unmet REQUIRE 2024-09-16T17:26:45.650 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestJournalReplay.AioDiscardEvent (2202 ms) 2024-09-16T17:26:45.650 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestJournalReplay.AioWriteEvent 2024-09-16T17:26:45.722 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:200: Skipped 2024-09-16T17:26:45.722 INFO:tasks.workunit.client.0.smithi122.stdout:Skipping due to unmet REQUIRE 2024-09-16T17:26:45.722 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestJournalReplay.AioWriteEvent (73 ms) 2024-09-16T17:26:45.722 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestJournalReplay.AioFlushEvent 2024-09-16T17:26:45.794 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:261: Skipped 2024-09-16T17:26:45.794 INFO:tasks.workunit.client.0.smithi122.stdout:Skipping due to unmet REQUIRE 2024-09-16T17:26:45.795 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestJournalReplay.AioFlushEvent (72 ms) 2024-09-16T17:26:45.795 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestJournalReplay.SnapCreate 2024-09-16T17:26:45.866 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:307: Skipped 2024-09-16T17:26:45.866 INFO:tasks.workunit.client.0.smithi122.stdout:Skipping due to unmet REQUIRE 2024-09-16T17:26:45.866 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestJournalReplay.SnapCreate (71 ms) 2024-09-16T17:26:45.866 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestJournalReplay.SnapProtect 2024-09-16T17:26:45.938 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:348: Skipped 2024-09-16T17:26:45.939 INFO:tasks.workunit.client.0.smithi122.stdout:Skipping due to unmet REQUIRE 2024-09-16T17:26:45.939 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestJournalReplay.SnapProtect (73 ms) 2024-09-16T17:26:45.939 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestJournalReplay.SnapUnprotect 2024-09-16T17:26:46.014 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:394: Skipped 2024-09-16T17:26:46.014 INFO:tasks.workunit.client.0.smithi122.stdout:Skipping due to unmet REQUIRE 2024-09-16T17:26:46.014 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestJournalReplay.SnapUnprotect (76 ms) 2024-09-16T17:26:46.014 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestJournalReplay.SnapRename 2024-09-16T17:26:46.095 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:450: Skipped 2024-09-16T17:26:46.095 INFO:tasks.workunit.client.0.smithi122.stdout:Skipping due to unmet REQUIRE 2024-09-16T17:26:46.095 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestJournalReplay.SnapRename (81 ms) 2024-09-16T17:26:46.096 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestJournalReplay.SnapRollback 2024-09-16T17:26:46.169 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:500: Skipped 2024-09-16T17:26:46.170 INFO:tasks.workunit.client.0.smithi122.stdout:Skipping due to unmet REQUIRE 2024-09-16T17:26:46.170 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestJournalReplay.SnapRollback (74 ms) 2024-09-16T17:26:46.170 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestJournalReplay.SnapRemove 2024-09-16T17:26:46.241 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:541: Skipped 2024-09-16T17:26:46.241 INFO:tasks.workunit.client.0.smithi122.stdout:Skipping due to unmet REQUIRE 2024-09-16T17:26:46.241 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestJournalReplay.SnapRemove (72 ms) 2024-09-16T17:26:46.242 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestJournalReplay.Rename 2024-09-16T17:26:46.315 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:590: Skipped 2024-09-16T17:26:46.315 INFO:tasks.workunit.client.0.smithi122.stdout:Skipping due to unmet REQUIRE 2024-09-16T17:26:46.315 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestJournalReplay.Rename (74 ms) 2024-09-16T17:26:46.315 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestJournalReplay.Resize 2024-09-16T17:26:46.388 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:624: Skipped 2024-09-16T17:26:46.388 INFO:tasks.workunit.client.0.smithi122.stdout:Skipping due to unmet REQUIRE 2024-09-16T17:26:46.388 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestJournalReplay.Resize (73 ms) 2024-09-16T17:26:46.388 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestJournalReplay.Flatten 2024-09-16T17:26:46.463 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:657: Skipped 2024-09-16T17:26:46.463 INFO:tasks.workunit.client.0.smithi122.stdout:Skipping due to unmet REQUIRE 2024-09-16T17:26:46.463 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestJournalReplay.Flatten (75 ms) 2024-09-16T17:26:46.463 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestJournalReplay.UpdateFeatures 2024-09-16T17:26:46.538 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:704: Skipped 2024-09-16T17:26:46.538 INFO:tasks.workunit.client.0.smithi122.stdout:Skipping due to unmet REQUIRE 2024-09-16T17:26:46.538 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestJournalReplay.UpdateFeatures (75 ms) 2024-09-16T17:26:46.538 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestJournalReplay.MetadataSet 2024-09-16T17:26:46.612 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:741: Skipped 2024-09-16T17:26:46.613 INFO:tasks.workunit.client.0.smithi122.stdout:Skipping due to unmet REQUIRE 2024-09-16T17:26:46.613 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestJournalReplay.MetadataSet (74 ms) 2024-09-16T17:26:46.613 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestJournalReplay.MetadataRemove 2024-09-16T17:26:46.687 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:781: Skipped 2024-09-16T17:26:46.687 INFO:tasks.workunit.client.0.smithi122.stdout:Skipping due to unmet REQUIRE 2024-09-16T17:26:46.687 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestJournalReplay.MetadataRemove (75 ms) 2024-09-16T17:26:46.687 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] TestJournalReplay.ObjectPosition 2024-09-16T17:26:46.760 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:824: Skipped 2024-09-16T17:26:46.760 INFO:tasks.workunit.client.0.smithi122.stdout:Skipping due to unmet REQUIRE 2024-09-16T17:26:46.760 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestJournalReplay.ObjectPosition (73 ms) 2024-09-16T17:26:47.540 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 16 tests from TestJournalReplay (3313 ms total) 2024-09-16T17:26:47.540 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-16T17:26:47.540 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment tear-down 2024-09-16T17:26:47.540 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] 16 tests from 1 test suite ran. (5926 ms total) 2024-09-16T17:26:47.540 INFO:tasks.workunit.client.0.smithi122.stdout:[ PASSED ] 0 tests. 2024-09-16T17:26:47.541 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] 16 tests, listed below: 2024-09-16T17:26:47.541 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestJournalReplay.AioDiscardEvent 2024-09-16T17:26:47.541 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestJournalReplay.AioWriteEvent 2024-09-16T17:26:47.541 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestJournalReplay.AioFlushEvent 2024-09-16T17:26:47.541 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestJournalReplay.SnapCreate 2024-09-16T17:26:47.541 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestJournalReplay.SnapProtect 2024-09-16T17:26:47.541 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestJournalReplay.SnapUnprotect 2024-09-16T17:26:47.541 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestJournalReplay.SnapRename 2024-09-16T17:26:47.541 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestJournalReplay.SnapRollback 2024-09-16T17:26:47.541 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestJournalReplay.SnapRemove 2024-09-16T17:26:47.542 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestJournalReplay.Rename 2024-09-16T17:26:47.542 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestJournalReplay.Resize 2024-09-16T17:26:47.542 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestJournalReplay.Flatten 2024-09-16T17:26:47.542 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestJournalReplay.UpdateFeatures 2024-09-16T17:26:47.542 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestJournalReplay.MetadataSet 2024-09-16T17:26:47.542 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestJournalReplay.MetadataRemove 2024-09-16T17:26:47.542 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] TestJournalReplay.ObjectPosition 2024-09-16T17:26:47.547 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-16T17:26:47.547 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-16T17:26:47.580 INFO:tasks.workunit:Stopping ['rbd/crimson/test_crimson_librbd.sh'] on client.0... 2024-09-16T17:26:47.581 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-16T17:26:48.020 DEBUG:teuthology.parallel:result is None 2024-09-16T17:26:48.021 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-16T17:26:48.046 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-16T17:26:48.046 DEBUG:teuthology.orchestra.run.smithi122:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-16T17:26:48.107 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-16T17:26:48.107 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-16T17:26:48.116 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T17:26:48.116 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:26:48.255 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T17:26:48.251+0000 7fc86c591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:26:48.259 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T17:26:48.258+0000 7fc86c591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:26:48.442 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T17:26:48.442 INFO:teuthology.orchestra.run.smithi122.stderr:dumped all 2024-09-16T17:26:48.460 INFO:teuthology.orchestra.run.smithi122.stdout:{"pg_ready":true,"pg_map":{"version":1871,"stamp":"2024-09-16T17:26:48.234514+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":283115520,"kb_used":199912,"kb_used_data":6964,"kb_used_omap":0,"kb_used_meta":192896,"kb_avail":282915608,"statfs":{"total":289910292480,"available":289705582592,"internally_reserved":0,"allocated":7131136,"data_stored":4447047,"data_compressed":60088,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":197525504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.790635"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":1851,"reported_epoch":625,"state":"active+clean","last_fresh":"2024-09-16T17:26:31.461404+0000","last_change":"2024-09-16T16:45:36.683962+0000","last_active":"2024-09-16T17:26:31.461404+0000","last_peered":"2024-09-16T17:26:31.461404+0000","last_clean":"2024-09-16T17:26:31.461404+0000","last_became_active":"2024-09-16T16:45:34.727276+0000","last_became_peered":"2024-09-16T16:45:34.727276+0000","last_unstale":"2024-09-16T17:26:31.461404+0000","last_undegraded":"2024-09-16T17:26:31.461404+0000","last_fullsized":"2024-09-16T17:26:31.461404+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_clean_scrub_stamp":"2024-09-16T16:45:33.640839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1851,"reported_epoch":625,"state":"active+clean","last_fresh":"2024-09-16T17:26:31.466480+0000","last_change":"2024-09-16T16:45:36.691655+0000","last_active":"2024-09-16T17:26:31.466480+0000","last_peered":"2024-09-16T17:26:31.466480+0000","last_clean":"2024-09-16T17:26:31.466480+0000","last_became_active":"2024-09-16T16:45:34.768510+0000","last_became_peered":"2024-09-16T16:45:34.768510+0000","last_unstale":"2024-09-16T17:26:31.466480+0000","last_undegraded":"2024-09-16T17:26:31.466480+0000","last_fullsized":"2024-09-16T17:26:31.466480+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_clean_scrub_stamp":"2024-09-16T16:45:33.640839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1851,"reported_epoch":625,"state":"active+clean","last_fresh":"2024-09-16T17:26:31.462156+0000","last_change":"2024-09-16T16:45:36.683615+0000","last_active":"2024-09-16T17:26:31.462156+0000","last_peered":"2024-09-16T17:26:31.462156+0000","last_clean":"2024-09-16T17:26:31.462156+0000","last_became_active":"2024-09-16T16:45:34.751996+0000","last_became_peered":"2024-09-16T16:45:34.751996+0000","last_unstale":"2024-09-16T17:26:31.462156+0000","last_undegraded":"2024-09-16T17:26:31.462156+0000","last_fullsized":"2024-09-16T17:26:31.462156+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_clean_scrub_stamp":"2024-09-16T16:45:33.640839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1851,"reported_epoch":625,"state":"active+clean","last_fresh":"2024-09-16T17:26:31.467149+0000","last_change":"2024-09-16T16:45:36.690821+0000","last_active":"2024-09-16T17:26:31.467149+0000","last_peered":"2024-09-16T17:26:31.467149+0000","last_clean":"2024-09-16T17:26:31.467149+0000","last_became_active":"2024-09-16T16:45:34.762441+0000","last_became_peered":"2024-09-16T16:45:34.762441+0000","last_unstale":"2024-09-16T17:26:31.467149+0000","last_undegraded":"2024-09-16T17:26:31.467149+0000","last_fullsized":"2024-09-16T17:26:31.467149+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_clean_scrub_stamp":"2024-09-16T16:45:33.640839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"13'2","reported_seq":1853,"reported_epoch":625,"state":"active+clean","last_fresh":"2024-09-16T17:26:31.465135+0000","last_change":"2024-09-16T16:45:36.681924+0000","last_active":"2024-09-16T17:26:31.465135+0000","last_peered":"2024-09-16T17:26:31.465135+0000","last_clean":"2024-09-16T17:26:31.465135+0000","last_became_active":"2024-09-16T16:45:34.742686+0000","last_became_peered":"2024-09-16T16:45:34.742686+0000","last_unstale":"2024-09-16T17:26:31.465135+0000","last_undegraded":"2024-09-16T17:26:31.465135+0000","last_fullsized":"2024-09-16T17:26:31.465135+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_clean_scrub_stamp":"2024-09-16T16:45:33.640839+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1851,"reported_epoch":625,"state":"active+clean","last_fresh":"2024-09-16T17:26:31.463421+0000","last_change":"2024-09-16T16:45:36.681720+0000","last_active":"2024-09-16T17:26:31.463421+0000","last_peered":"2024-09-16T17:26:31.463421+0000","last_clean":"2024-09-16T17:26:31.463421+0000","last_became_active":"2024-09-16T16:45:34.770776+0000","last_became_peered":"2024-09-16T16:45:34.770776+0000","last_unstale":"2024-09-16T17:26:31.463421+0000","last_undegraded":"2024-09-16T17:26:31.463421+0000","last_fullsized":"2024-09-16T17:26:31.463421+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_clean_scrub_stamp":"2024-09-16T16:45:33.640839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1851,"reported_epoch":625,"state":"active+clean","last_fresh":"2024-09-16T17:26:31.461425+0000","last_change":"2024-09-16T16:45:36.679871+0000","last_active":"2024-09-16T17:26:31.461425+0000","last_peered":"2024-09-16T17:26:31.461425+0000","last_clean":"2024-09-16T17:26:31.461425+0000","last_became_active":"2024-09-16T16:45:34.772861+0000","last_became_peered":"2024-09-16T16:45:34.772861+0000","last_unstale":"2024-09-16T17:26:31.461425+0000","last_undegraded":"2024-09-16T17:26:31.461425+0000","last_fullsized":"2024-09-16T17:26:31.461425+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_clean_scrub_stamp":"2024-09-16T16:45:33.640839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"11'1","reported_seq":1852,"reported_epoch":625,"state":"active+clean","last_fresh":"2024-09-16T17:26:31.468259+0000","last_change":"2024-09-16T16:45:36.691910+0000","last_active":"2024-09-16T17:26:31.468259+0000","last_peered":"2024-09-16T17:26:31.468259+0000","last_clean":"2024-09-16T17:26:31.468259+0000","last_became_active":"2024-09-16T16:45:34.740122+0000","last_became_peered":"2024-09-16T16:45:34.740122+0000","last_unstale":"2024-09-16T17:26:31.468259+0000","last_undegraded":"2024-09-16T17:26:31.468259+0000","last_fullsized":"2024-09-16T17:26:31.468259+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_clean_scrub_stamp":"2024-09-16T16:45:33.640839+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'52","reported_seq":1920,"reported_epoch":625,"state":"active+clean","last_fresh":"2024-09-16T17:26:31.463634+0000","last_change":"2024-09-16T16:45:33.709010+0000","last_active":"2024-09-16T17:26:31.463634+0000","last_peered":"2024-09-16T17:26:31.463634+0000","last_clean":"2024-09-16T17:26:31.463634+0000","last_became_active":"2024-09-16T16:45:33.697521+0000","last_became_peered":"2024-09-16T16:45:33.697521+0000","last_unstale":"2024-09-16T17:26:31.463634+0000","last_undegraded":"2024-09-16T17:26:31.463634+0000","last_fullsized":"2024-09-16T17:26:31.463634+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:45:32.637441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:45:32.637441+0000","last_clean_scrub_stamp":"2024-09-16T16:45:32.637441+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740819,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":65204,"kb_used_data":2276,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94306636,"statfs":{"total":96636764160,"available":96569995264,"internally_reserved":0,"allocated":2330624,"data_stored":1087258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359740821,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":69436,"kb_used_data":2348,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94302404,"statfs":{"total":96636764160,"available":96565661696,"internally_reserved":0,"allocated":2404352,"data_stored":1682144,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359740818,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":65272,"kb_used_data":2340,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94306568,"statfs":{"total":96636764160,"available":96569925632,"internally_reserved":0,"allocated":2396160,"data_stored":1677645,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:26:48.461 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:26:48.569 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T17:26:48.565+0000 7ffaa8191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:26:48.573 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T17:26:48.572+0000 7ffaa8191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:26:48.758 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T17:26:48.759 INFO:teuthology.orchestra.run.smithi122.stderr:dumped all 2024-09-16T17:26:48.772 INFO:teuthology.orchestra.run.smithi122.stdout:{"pg_ready":true,"pg_map":{"version":1872,"stamp":"2024-09-16T17:26:48.446832+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":283115520,"kb_used":199912,"kb_used_data":6964,"kb_used_omap":0,"kb_used_meta":192896,"kb_avail":282915608,"statfs":{"total":289910292480,"available":289705582592,"internally_reserved":0,"allocated":7131136,"data_stored":4447047,"data_compressed":60088,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":197525504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.213043"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":1851,"reported_epoch":625,"state":"active+clean","last_fresh":"2024-09-16T17:26:31.461404+0000","last_change":"2024-09-16T16:45:36.683962+0000","last_active":"2024-09-16T17:26:31.461404+0000","last_peered":"2024-09-16T17:26:31.461404+0000","last_clean":"2024-09-16T17:26:31.461404+0000","last_became_active":"2024-09-16T16:45:34.727276+0000","last_became_peered":"2024-09-16T16:45:34.727276+0000","last_unstale":"2024-09-16T17:26:31.461404+0000","last_undegraded":"2024-09-16T17:26:31.461404+0000","last_fullsized":"2024-09-16T17:26:31.461404+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_clean_scrub_stamp":"2024-09-16T16:45:33.640839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1851,"reported_epoch":625,"state":"active+clean","last_fresh":"2024-09-16T17:26:31.466480+0000","last_change":"2024-09-16T16:45:36.691655+0000","last_active":"2024-09-16T17:26:31.466480+0000","last_peered":"2024-09-16T17:26:31.466480+0000","last_clean":"2024-09-16T17:26:31.466480+0000","last_became_active":"2024-09-16T16:45:34.768510+0000","last_became_peered":"2024-09-16T16:45:34.768510+0000","last_unstale":"2024-09-16T17:26:31.466480+0000","last_undegraded":"2024-09-16T17:26:31.466480+0000","last_fullsized":"2024-09-16T17:26:31.466480+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_clean_scrub_stamp":"2024-09-16T16:45:33.640839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1851,"reported_epoch":625,"state":"active+clean","last_fresh":"2024-09-16T17:26:31.462156+0000","last_change":"2024-09-16T16:45:36.683615+0000","last_active":"2024-09-16T17:26:31.462156+0000","last_peered":"2024-09-16T17:26:31.462156+0000","last_clean":"2024-09-16T17:26:31.462156+0000","last_became_active":"2024-09-16T16:45:34.751996+0000","last_became_peered":"2024-09-16T16:45:34.751996+0000","last_unstale":"2024-09-16T17:26:31.462156+0000","last_undegraded":"2024-09-16T17:26:31.462156+0000","last_fullsized":"2024-09-16T17:26:31.462156+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_clean_scrub_stamp":"2024-09-16T16:45:33.640839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1851,"reported_epoch":625,"state":"active+clean","last_fresh":"2024-09-16T17:26:31.467149+0000","last_change":"2024-09-16T16:45:36.690821+0000","last_active":"2024-09-16T17:26:31.467149+0000","last_peered":"2024-09-16T17:26:31.467149+0000","last_clean":"2024-09-16T17:26:31.467149+0000","last_became_active":"2024-09-16T16:45:34.762441+0000","last_became_peered":"2024-09-16T16:45:34.762441+0000","last_unstale":"2024-09-16T17:26:31.467149+0000","last_undegraded":"2024-09-16T17:26:31.467149+0000","last_fullsized":"2024-09-16T17:26:31.467149+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_clean_scrub_stamp":"2024-09-16T16:45:33.640839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"13'2","reported_seq":1853,"reported_epoch":625,"state":"active+clean","last_fresh":"2024-09-16T17:26:31.465135+0000","last_change":"2024-09-16T16:45:36.681924+0000","last_active":"2024-09-16T17:26:31.465135+0000","last_peered":"2024-09-16T17:26:31.465135+0000","last_clean":"2024-09-16T17:26:31.465135+0000","last_became_active":"2024-09-16T16:45:34.742686+0000","last_became_peered":"2024-09-16T16:45:34.742686+0000","last_unstale":"2024-09-16T17:26:31.465135+0000","last_undegraded":"2024-09-16T17:26:31.465135+0000","last_fullsized":"2024-09-16T17:26:31.465135+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_clean_scrub_stamp":"2024-09-16T16:45:33.640839+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1851,"reported_epoch":625,"state":"active+clean","last_fresh":"2024-09-16T17:26:31.463421+0000","last_change":"2024-09-16T16:45:36.681720+0000","last_active":"2024-09-16T17:26:31.463421+0000","last_peered":"2024-09-16T17:26:31.463421+0000","last_clean":"2024-09-16T17:26:31.463421+0000","last_became_active":"2024-09-16T16:45:34.770776+0000","last_became_peered":"2024-09-16T16:45:34.770776+0000","last_unstale":"2024-09-16T17:26:31.463421+0000","last_undegraded":"2024-09-16T17:26:31.463421+0000","last_fullsized":"2024-09-16T17:26:31.463421+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_clean_scrub_stamp":"2024-09-16T16:45:33.640839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1851,"reported_epoch":625,"state":"active+clean","last_fresh":"2024-09-16T17:26:31.461425+0000","last_change":"2024-09-16T16:45:36.679871+0000","last_active":"2024-09-16T17:26:31.461425+0000","last_peered":"2024-09-16T17:26:31.461425+0000","last_clean":"2024-09-16T17:26:31.461425+0000","last_became_active":"2024-09-16T16:45:34.772861+0000","last_became_peered":"2024-09-16T16:45:34.772861+0000","last_unstale":"2024-09-16T17:26:31.461425+0000","last_undegraded":"2024-09-16T17:26:31.461425+0000","last_fullsized":"2024-09-16T17:26:31.461425+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_clean_scrub_stamp":"2024-09-16T16:45:33.640839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"11'1","reported_seq":1852,"reported_epoch":625,"state":"active+clean","last_fresh":"2024-09-16T17:26:31.468259+0000","last_change":"2024-09-16T16:45:36.691910+0000","last_active":"2024-09-16T17:26:31.468259+0000","last_peered":"2024-09-16T17:26:31.468259+0000","last_clean":"2024-09-16T17:26:31.468259+0000","last_became_active":"2024-09-16T16:45:34.740122+0000","last_became_peered":"2024-09-16T16:45:34.740122+0000","last_unstale":"2024-09-16T17:26:31.468259+0000","last_undegraded":"2024-09-16T17:26:31.468259+0000","last_fullsized":"2024-09-16T17:26:31.468259+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_clean_scrub_stamp":"2024-09-16T16:45:33.640839+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'52","reported_seq":1920,"reported_epoch":625,"state":"active+clean","last_fresh":"2024-09-16T17:26:31.463634+0000","last_change":"2024-09-16T16:45:33.709010+0000","last_active":"2024-09-16T17:26:31.463634+0000","last_peered":"2024-09-16T17:26:31.463634+0000","last_clean":"2024-09-16T17:26:31.463634+0000","last_became_active":"2024-09-16T16:45:33.697521+0000","last_became_peered":"2024-09-16T16:45:33.697521+0000","last_unstale":"2024-09-16T17:26:31.463634+0000","last_undegraded":"2024-09-16T17:26:31.463634+0000","last_fullsized":"2024-09-16T17:26:31.463634+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:45:32.637441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:45:32.637441+0000","last_clean_scrub_stamp":"2024-09-16T16:45:32.637441+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740819,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":65204,"kb_used_data":2276,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94306636,"statfs":{"total":96636764160,"available":96569995264,"internally_reserved":0,"allocated":2330624,"data_stored":1087258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359740821,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":69436,"kb_used_data":2348,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94302404,"statfs":{"total":96636764160,"available":96565661696,"internally_reserved":0,"allocated":2404352,"data_stored":1682144,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359740818,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":65272,"kb_used_data":2340,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94306568,"statfs":{"total":96636764160,"available":96569925632,"internally_reserved":0,"allocated":2396160,"data_stored":1677645,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:26:48.773 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T17:26:48.773 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:26:48.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T17:26:48.875+0000 7fe4bb6d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:26:48.884 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T17:26:48.883+0000 7fe4bb6d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:26:49.068 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T17:26:49.068 INFO:teuthology.orchestra.run.smithi122.stderr:dumped all 2024-09-16T17:26:49.081 INFO:teuthology.orchestra.run.smithi122.stdout:{"pg_ready":true,"pg_map":{"version":1872,"stamp":"2024-09-16T17:26:48.446832+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":283115520,"kb_used":199912,"kb_used_data":6964,"kb_used_omap":0,"kb_used_meta":192896,"kb_avail":282915608,"statfs":{"total":289910292480,"available":289705582592,"internally_reserved":0,"allocated":7131136,"data_stored":4447047,"data_compressed":60088,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":197525504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.213043"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":1851,"reported_epoch":625,"state":"active+clean","last_fresh":"2024-09-16T17:26:31.461404+0000","last_change":"2024-09-16T16:45:36.683962+0000","last_active":"2024-09-16T17:26:31.461404+0000","last_peered":"2024-09-16T17:26:31.461404+0000","last_clean":"2024-09-16T17:26:31.461404+0000","last_became_active":"2024-09-16T16:45:34.727276+0000","last_became_peered":"2024-09-16T16:45:34.727276+0000","last_unstale":"2024-09-16T17:26:31.461404+0000","last_undegraded":"2024-09-16T17:26:31.461404+0000","last_fullsized":"2024-09-16T17:26:31.461404+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_clean_scrub_stamp":"2024-09-16T16:45:33.640839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1851,"reported_epoch":625,"state":"active+clean","last_fresh":"2024-09-16T17:26:31.466480+0000","last_change":"2024-09-16T16:45:36.691655+0000","last_active":"2024-09-16T17:26:31.466480+0000","last_peered":"2024-09-16T17:26:31.466480+0000","last_clean":"2024-09-16T17:26:31.466480+0000","last_became_active":"2024-09-16T16:45:34.768510+0000","last_became_peered":"2024-09-16T16:45:34.768510+0000","last_unstale":"2024-09-16T17:26:31.466480+0000","last_undegraded":"2024-09-16T17:26:31.466480+0000","last_fullsized":"2024-09-16T17:26:31.466480+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_clean_scrub_stamp":"2024-09-16T16:45:33.640839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1851,"reported_epoch":625,"state":"active+clean","last_fresh":"2024-09-16T17:26:31.462156+0000","last_change":"2024-09-16T16:45:36.683615+0000","last_active":"2024-09-16T17:26:31.462156+0000","last_peered":"2024-09-16T17:26:31.462156+0000","last_clean":"2024-09-16T17:26:31.462156+0000","last_became_active":"2024-09-16T16:45:34.751996+0000","last_became_peered":"2024-09-16T16:45:34.751996+0000","last_unstale":"2024-09-16T17:26:31.462156+0000","last_undegraded":"2024-09-16T17:26:31.462156+0000","last_fullsized":"2024-09-16T17:26:31.462156+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_clean_scrub_stamp":"2024-09-16T16:45:33.640839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1851,"reported_epoch":625,"state":"active+clean","last_fresh":"2024-09-16T17:26:31.467149+0000","last_change":"2024-09-16T16:45:36.690821+0000","last_active":"2024-09-16T17:26:31.467149+0000","last_peered":"2024-09-16T17:26:31.467149+0000","last_clean":"2024-09-16T17:26:31.467149+0000","last_became_active":"2024-09-16T16:45:34.762441+0000","last_became_peered":"2024-09-16T16:45:34.762441+0000","last_unstale":"2024-09-16T17:26:31.467149+0000","last_undegraded":"2024-09-16T17:26:31.467149+0000","last_fullsized":"2024-09-16T17:26:31.467149+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_clean_scrub_stamp":"2024-09-16T16:45:33.640839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"13'2","reported_seq":1853,"reported_epoch":625,"state":"active+clean","last_fresh":"2024-09-16T17:26:31.465135+0000","last_change":"2024-09-16T16:45:36.681924+0000","last_active":"2024-09-16T17:26:31.465135+0000","last_peered":"2024-09-16T17:26:31.465135+0000","last_clean":"2024-09-16T17:26:31.465135+0000","last_became_active":"2024-09-16T16:45:34.742686+0000","last_became_peered":"2024-09-16T16:45:34.742686+0000","last_unstale":"2024-09-16T17:26:31.465135+0000","last_undegraded":"2024-09-16T17:26:31.465135+0000","last_fullsized":"2024-09-16T17:26:31.465135+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_clean_scrub_stamp":"2024-09-16T16:45:33.640839+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1851,"reported_epoch":625,"state":"active+clean","last_fresh":"2024-09-16T17:26:31.463421+0000","last_change":"2024-09-16T16:45:36.681720+0000","last_active":"2024-09-16T17:26:31.463421+0000","last_peered":"2024-09-16T17:26:31.463421+0000","last_clean":"2024-09-16T17:26:31.463421+0000","last_became_active":"2024-09-16T16:45:34.770776+0000","last_became_peered":"2024-09-16T16:45:34.770776+0000","last_unstale":"2024-09-16T17:26:31.463421+0000","last_undegraded":"2024-09-16T17:26:31.463421+0000","last_fullsized":"2024-09-16T17:26:31.463421+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_clean_scrub_stamp":"2024-09-16T16:45:33.640839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1851,"reported_epoch":625,"state":"active+clean","last_fresh":"2024-09-16T17:26:31.461425+0000","last_change":"2024-09-16T16:45:36.679871+0000","last_active":"2024-09-16T17:26:31.461425+0000","last_peered":"2024-09-16T17:26:31.461425+0000","last_clean":"2024-09-16T17:26:31.461425+0000","last_became_active":"2024-09-16T16:45:34.772861+0000","last_became_peered":"2024-09-16T16:45:34.772861+0000","last_unstale":"2024-09-16T17:26:31.461425+0000","last_undegraded":"2024-09-16T17:26:31.461425+0000","last_fullsized":"2024-09-16T17:26:31.461425+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_clean_scrub_stamp":"2024-09-16T16:45:33.640839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"11'1","reported_seq":1852,"reported_epoch":625,"state":"active+clean","last_fresh":"2024-09-16T17:26:31.468259+0000","last_change":"2024-09-16T16:45:36.691910+0000","last_active":"2024-09-16T17:26:31.468259+0000","last_peered":"2024-09-16T17:26:31.468259+0000","last_clean":"2024-09-16T17:26:31.468259+0000","last_became_active":"2024-09-16T16:45:34.740122+0000","last_became_peered":"2024-09-16T16:45:34.740122+0000","last_unstale":"2024-09-16T17:26:31.468259+0000","last_undegraded":"2024-09-16T17:26:31.468259+0000","last_fullsized":"2024-09-16T17:26:31.468259+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_clean_scrub_stamp":"2024-09-16T16:45:33.640839+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'52","reported_seq":1920,"reported_epoch":625,"state":"active+clean","last_fresh":"2024-09-16T17:26:31.463634+0000","last_change":"2024-09-16T16:45:33.709010+0000","last_active":"2024-09-16T17:26:31.463634+0000","last_peered":"2024-09-16T17:26:31.463634+0000","last_clean":"2024-09-16T17:26:31.463634+0000","last_became_active":"2024-09-16T16:45:33.697521+0000","last_became_peered":"2024-09-16T16:45:33.697521+0000","last_unstale":"2024-09-16T17:26:31.463634+0000","last_undegraded":"2024-09-16T17:26:31.463634+0000","last_fullsized":"2024-09-16T17:26:31.463634+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:45:32.637441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:45:32.637441+0000","last_clean_scrub_stamp":"2024-09-16T16:45:32.637441+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740819,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":65204,"kb_used_data":2276,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94306636,"statfs":{"total":96636764160,"available":96569995264,"internally_reserved":0,"allocated":2330624,"data_stored":1087258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359740821,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":69436,"kb_used_data":2348,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94302404,"statfs":{"total":96636764160,"available":96565661696,"internally_reserved":0,"allocated":2404352,"data_stored":1682144,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359740818,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":65272,"kb_used_data":2340,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94306568,"statfs":{"total":96636764160,"available":96569925632,"internally_reserved":0,"allocated":2396160,"data_stored":1677645,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:26:49.081 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T17:26:49.191 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T17:26:49.186+0000 7f8be76a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:26:49.194 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T17:26:49.193+0000 7f8be76a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:26:49.379 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T17:26:49.380 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":640,"fsid":"fd01cf2a-db9f-495a-a112-c9787c9c6bf1","created":"2024-09-16T16:45:23.033556+0000","modified":"2024-09-16T17:26:48.443554+0000","last_up_change":"2024-09-16T16:45:31.631344+0000","last_in_change":"2024-09-16T16:45:24.930266+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":45,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T16:45:31.645635+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-16T16:45:32.853094+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":13,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"03d0aba2-c284-4cb3-8fd6-4b91155c8fd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":635,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6807","nonce":2116540039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":2116540039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6813","nonce":2116540039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":2116540039}]},"public_addr":"172.21.15.122:6807/2116540039","cluster_addr":"172.21.15.122:6804/2116540039","heartbeat_back_addr":"172.21.15.122:6813/2116540039","heartbeat_front_addr":"172.21.15.122:6814/2116540039","state":["exists","up"]},{"osd":1,"uuid":"6ae551e1-7b06-4bcc-a978-6c6ca56a263b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":635,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6805","nonce":322370007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":322370007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":322370007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6803","nonce":322370007}]},"public_addr":"172.21.15.122:6805/322370007","cluster_addr":"172.21.15.122:6806/322370007","heartbeat_back_addr":"172.21.15.122:6802/322370007","heartbeat_front_addr":"172.21.15.122:6803/322370007","state":["exists","up"]},{"osd":2,"uuid":"a07a1f7f-1ce5-4ecd-b0be-8ee4de2f94e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":635,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6809","nonce":82673049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":82673049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":82673049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6811","nonce":82673049}]},"public_addr":"172.21.15.122:6809/82673049","cluster_addr":"172.21.15.122:6808/82673049","heartbeat_back_addr":"172.21.15.122:6810/82673049","heartbeat_front_addr":"172.21.15.122:6811/82673049","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]},{"pool":3,"snaps":[{"begin":2,"length":3},{"begin":7,"length":11},{"begin":23,"length":4},{"begin":37,"length":1},{"begin":41,"length":1},{"begin":44,"length":2},{"begin":69,"length":1},{"begin":71,"length":1}]},{"pool":4,"snaps":[{"begin":2,"length":1}]},{"pool":5,"snaps":[{"begin":2,"length":1}]},{"pool":6,"snaps":[{"begin":2,"length":1}]},{"pool":7,"snaps":[{"begin":2,"length":1}]},{"pool":8,"snaps":[{"begin":2,"length":1}]},{"pool":9,"snaps":[{"begin":2,"length":1}]},{"pool":10,"snaps":[{"begin":2,"length":4}]},{"pool":11,"snaps":[{"begin":2,"length":1}]},{"pool":12,"snaps":[{"begin":2,"length":1}]},{"pool":13,"snaps":[{"begin":2,"length":1}]},{"pool":14,"snaps":[{"begin":2,"length":1}]},{"pool":16,"snaps":[{"begin":2,"length":1}]},{"pool":17,"snaps":[{"begin":2,"length":1}]},{"pool":18,"snaps":[{"begin":2,"length":2}]},{"pool":19,"snaps":[{"begin":2,"length":1}]},{"pool":20,"snaps":[{"begin":2,"length":1}]},{"pool":21,"snaps":[{"begin":2,"length":1}]},{"pool":22,"snaps":[{"begin":2,"length":3}]},{"pool":23,"snaps":[{"begin":2,"length":9}]},{"pool":24,"snaps":[{"begin":2,"length":1}]},{"pool":25,"snaps":[{"begin":2,"length":1}]},{"pool":26,"snaps":[{"begin":2,"length":1}]},{"pool":27,"snaps":[{"begin":2,"length":1}]},{"pool":28,"snaps":[{"begin":2,"length":1}]},{"pool":29,"snaps":[{"begin":2,"length":1}]},{"pool":30,"snaps":[{"begin":2,"length":1}]},{"pool":31,"snaps":[{"begin":2,"length":1}]},{"pool":32,"snaps":[{"begin":2,"length":1}]},{"pool":33,"snaps":[{"begin":2,"length":7},{"begin":14,"length":2},{"begin":19,"length":1}]},{"pool":34,"snaps":[{"begin":2,"length":46}]},{"pool":35,"snaps":[{"begin":2,"length":13}]},{"pool":38,"snaps":[{"begin":2,"length":3}]},{"pool":39,"snaps":[{"begin":2,"length":3}]},{"pool":40,"snaps":[{"begin":2,"length":1}]},{"pool":41,"snaps":[{"begin":2,"length":1}]},{"pool":42,"snaps":[{"begin":2,"length":1}]},{"pool":43,"snaps":[{"begin":2,"length":1}]},{"pool":44,"snaps":[{"begin":2,"length":1}]},{"pool":45,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T17:26:50.394 INFO:tasks.ceph:Scrubbing osd.0 2024-09-16T17:26:50.394 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-16T17:26:50.513 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T17:26:50.504+0000 7f5dedcd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:26:50.517 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T17:26:50.516+0000 7f5dedcd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:26:50.532 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-16T17:26:50.532 INFO:teuthology.orchestra.run.smithi122.stdout: "success": "" 2024-09-16T17:26:50.532 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-16T17:26:50.544 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-16T17:26:50.652 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T17:26:50.646+0000 7f2098ed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:26:50.656 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T17:26:50.655+0000 7f2098ed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:26:50.843 INFO:teuthology.orchestra.run.smithi122.stderr:instructed osd(s) 0 to deep-scrub 2024-09-16T17:26:50.861 INFO:tasks.ceph:Scrubbing osd.1 2024-09-16T17:26:50.861 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-16T17:26:50.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T17:26:50.963+0000 7f0243cfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:26:50.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T17:26:50.976+0000 7f0243cfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:26:50.991 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-16T17:26:50.991 INFO:teuthology.orchestra.run.smithi122.stdout: "success": "" 2024-09-16T17:26:50.991 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-16T17:26:51.002 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-16T17:26:51.111 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T17:26:51.105+0000 7f3db5b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:26:51.115 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T17:26:51.114+0000 7f3db5b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:26:51.301 INFO:teuthology.orchestra.run.smithi122.stderr:instructed osd(s) 1 to deep-scrub 2024-09-16T17:26:51.329 INFO:tasks.ceph:Scrubbing osd.2 2024-09-16T17:26:51.330 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-16T17:26:51.448 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T17:26:51.438+0000 7f86e5e7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:26:51.452 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T17:26:51.451+0000 7f86e5e7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:26:51.467 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-16T17:26:51.467 INFO:teuthology.orchestra.run.smithi122.stdout: "success": "" 2024-09-16T17:26:51.467 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-16T17:26:51.478 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-16T17:26:51.588 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T17:26:51.582+0000 7f24202a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:26:51.592 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T17:26:51.591+0000 7f24202a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:26:51.777 INFO:teuthology.orchestra.run.smithi122.stderr:instructed osd(s) 2 to deep-scrub 2024-09-16T17:26:51.794 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:26:51.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T17:26:51.898+0000 7fca02948640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:26:51.906 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T17:26:51.905+0000 7fca02948640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:26:52.090 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T17:26:52.090 INFO:teuthology.orchestra.run.smithi122.stderr:dumped all 2024-09-16T17:26:52.103 INFO:teuthology.orchestra.run.smithi122.stdout:{"pg_ready":true,"pg_map":{"version":1873,"stamp":"2024-09-16T17:26:50.234900+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":283115520,"kb_used":199912,"kb_used_data":6964,"kb_used_omap":0,"kb_used_meta":192896,"kb_avail":282915608,"statfs":{"total":289910292480,"available":289705582592,"internally_reserved":0,"allocated":7131136,"data_stored":4447047,"data_compressed":60088,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":197525504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.715416"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":1851,"reported_epoch":625,"state":"active+clean","last_fresh":"2024-09-16T17:26:31.461404+0000","last_change":"2024-09-16T16:45:36.683962+0000","last_active":"2024-09-16T17:26:31.461404+0000","last_peered":"2024-09-16T17:26:31.461404+0000","last_clean":"2024-09-16T17:26:31.461404+0000","last_became_active":"2024-09-16T16:45:34.727276+0000","last_became_peered":"2024-09-16T16:45:34.727276+0000","last_unstale":"2024-09-16T17:26:31.461404+0000","last_undegraded":"2024-09-16T17:26:31.461404+0000","last_fullsized":"2024-09-16T17:26:31.461404+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_clean_scrub_stamp":"2024-09-16T16:45:33.640839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1851,"reported_epoch":625,"state":"active+clean","last_fresh":"2024-09-16T17:26:31.466480+0000","last_change":"2024-09-16T16:45:36.691655+0000","last_active":"2024-09-16T17:26:31.466480+0000","last_peered":"2024-09-16T17:26:31.466480+0000","last_clean":"2024-09-16T17:26:31.466480+0000","last_became_active":"2024-09-16T16:45:34.768510+0000","last_became_peered":"2024-09-16T16:45:34.768510+0000","last_unstale":"2024-09-16T17:26:31.466480+0000","last_undegraded":"2024-09-16T17:26:31.466480+0000","last_fullsized":"2024-09-16T17:26:31.466480+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_clean_scrub_stamp":"2024-09-16T16:45:33.640839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1851,"reported_epoch":625,"state":"active+clean","last_fresh":"2024-09-16T17:26:31.462156+0000","last_change":"2024-09-16T16:45:36.683615+0000","last_active":"2024-09-16T17:26:31.462156+0000","last_peered":"2024-09-16T17:26:31.462156+0000","last_clean":"2024-09-16T17:26:31.462156+0000","last_became_active":"2024-09-16T16:45:34.751996+0000","last_became_peered":"2024-09-16T16:45:34.751996+0000","last_unstale":"2024-09-16T17:26:31.462156+0000","last_undegraded":"2024-09-16T17:26:31.462156+0000","last_fullsized":"2024-09-16T17:26:31.462156+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_clean_scrub_stamp":"2024-09-16T16:45:33.640839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1851,"reported_epoch":625,"state":"active+clean","last_fresh":"2024-09-16T17:26:31.467149+0000","last_change":"2024-09-16T16:45:36.690821+0000","last_active":"2024-09-16T17:26:31.467149+0000","last_peered":"2024-09-16T17:26:31.467149+0000","last_clean":"2024-09-16T17:26:31.467149+0000","last_became_active":"2024-09-16T16:45:34.762441+0000","last_became_peered":"2024-09-16T16:45:34.762441+0000","last_unstale":"2024-09-16T17:26:31.467149+0000","last_undegraded":"2024-09-16T17:26:31.467149+0000","last_fullsized":"2024-09-16T17:26:31.467149+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_clean_scrub_stamp":"2024-09-16T16:45:33.640839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"13'2","reported_seq":1853,"reported_epoch":625,"state":"active+clean","last_fresh":"2024-09-16T17:26:31.465135+0000","last_change":"2024-09-16T16:45:36.681924+0000","last_active":"2024-09-16T17:26:31.465135+0000","last_peered":"2024-09-16T17:26:31.465135+0000","last_clean":"2024-09-16T17:26:31.465135+0000","last_became_active":"2024-09-16T16:45:34.742686+0000","last_became_peered":"2024-09-16T16:45:34.742686+0000","last_unstale":"2024-09-16T17:26:31.465135+0000","last_undegraded":"2024-09-16T17:26:31.465135+0000","last_fullsized":"2024-09-16T17:26:31.465135+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_clean_scrub_stamp":"2024-09-16T16:45:33.640839+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1851,"reported_epoch":625,"state":"active+clean","last_fresh":"2024-09-16T17:26:31.463421+0000","last_change":"2024-09-16T16:45:36.681720+0000","last_active":"2024-09-16T17:26:31.463421+0000","last_peered":"2024-09-16T17:26:31.463421+0000","last_clean":"2024-09-16T17:26:31.463421+0000","last_became_active":"2024-09-16T16:45:34.770776+0000","last_became_peered":"2024-09-16T16:45:34.770776+0000","last_unstale":"2024-09-16T17:26:31.463421+0000","last_undegraded":"2024-09-16T17:26:31.463421+0000","last_fullsized":"2024-09-16T17:26:31.463421+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_clean_scrub_stamp":"2024-09-16T16:45:33.640839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1851,"reported_epoch":625,"state":"active+clean","last_fresh":"2024-09-16T17:26:31.461425+0000","last_change":"2024-09-16T16:45:36.679871+0000","last_active":"2024-09-16T17:26:31.461425+0000","last_peered":"2024-09-16T17:26:31.461425+0000","last_clean":"2024-09-16T17:26:31.461425+0000","last_became_active":"2024-09-16T16:45:34.772861+0000","last_became_peered":"2024-09-16T16:45:34.772861+0000","last_unstale":"2024-09-16T17:26:31.461425+0000","last_undegraded":"2024-09-16T17:26:31.461425+0000","last_fullsized":"2024-09-16T17:26:31.461425+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_clean_scrub_stamp":"2024-09-16T16:45:33.640839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"11'1","reported_seq":1852,"reported_epoch":625,"state":"active+clean","last_fresh":"2024-09-16T17:26:31.468259+0000","last_change":"2024-09-16T16:45:36.691910+0000","last_active":"2024-09-16T17:26:31.468259+0000","last_peered":"2024-09-16T17:26:31.468259+0000","last_clean":"2024-09-16T17:26:31.468259+0000","last_became_active":"2024-09-16T16:45:34.740122+0000","last_became_peered":"2024-09-16T16:45:34.740122+0000","last_unstale":"2024-09-16T17:26:31.468259+0000","last_undegraded":"2024-09-16T17:26:31.468259+0000","last_fullsized":"2024-09-16T17:26:31.468259+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:45:33.640839+0000","last_clean_scrub_stamp":"2024-09-16T16:45:33.640839+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'52","reported_seq":1920,"reported_epoch":625,"state":"active+clean","last_fresh":"2024-09-16T17:26:31.463634+0000","last_change":"2024-09-16T16:45:33.709010+0000","last_active":"2024-09-16T17:26:31.463634+0000","last_peered":"2024-09-16T17:26:31.463634+0000","last_clean":"2024-09-16T17:26:31.463634+0000","last_became_active":"2024-09-16T16:45:33.697521+0000","last_became_peered":"2024-09-16T16:45:33.697521+0000","last_unstale":"2024-09-16T17:26:31.463634+0000","last_undegraded":"2024-09-16T17:26:31.463634+0000","last_fullsized":"2024-09-16T17:26:31.463634+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:45:32.637441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:45:32.637441+0000","last_clean_scrub_stamp":"2024-09-16T16:45:32.637441+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740819,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":65204,"kb_used_data":2276,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94306636,"statfs":{"total":96636764160,"available":96569995264,"internally_reserved":0,"allocated":2330624,"data_stored":1087258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359740821,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":69436,"kb_used_data":2348,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94302404,"statfs":{"total":96636764160,"available":96565661696,"internally_reserved":0,"allocated":2404352,"data_stored":1682144,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359740818,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":65272,"kb_used_data":2340,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94306568,"statfs":{"total":96636764160,"available":96569925632,"internally_reserved":0,"allocated":2396160,"data_stored":1677645,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:26:52.106 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-16T16:45:33.640839+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=45, tm_sec=33, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=26, tm_sec=49, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:26:52.106 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-16T16:45:33.640839+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=45, tm_sec=33, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=26, tm_sec=49, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:26:52.106 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-16T16:45:33.640839+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=45, tm_sec=33, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=26, tm_sec=49, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:26:52.106 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-16T16:45:33.640839+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=45, tm_sec=33, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=26, tm_sec=49, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:26:52.106 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-16T16:45:33.640839+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=45, tm_sec=33, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=26, tm_sec=49, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:26:52.106 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-16T16:45:33.640839+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=45, tm_sec=33, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=26, tm_sec=49, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:26:52.107 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-16T16:45:33.640839+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=45, tm_sec=33, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=26, tm_sec=49, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:26:52.107 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-16T16:45:33.640839+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=45, tm_sec=33, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=26, tm_sec=49, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:26:52.107 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-16T16:45:32.637441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=45, tm_sec=32, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=26, tm_sec=49, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:26:52.107 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T17:27:12.108 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:27:12.233 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T17:27:12.228+0000 7f386d991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:27:12.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T17:27:12.236+0000 7f386d991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:27:12.420 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-16T17:27:12.421 INFO:teuthology.orchestra.run.smithi122.stderr:dumped all 2024-09-16T17:27:12.433 INFO:teuthology.orchestra.run.smithi122.stdout:{"pg_ready":true,"pg_map":{"version":1884,"stamp":"2024-09-16T17:27:12.240631+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":283115520,"kb_used":230848,"kb_used_data":7376,"kb_used_omap":0,"kb_used_meta":223424,"kb_avail":282884672,"statfs":{"total":289910292480,"available":289673904128,"internally_reserved":0,"allocated":7553024,"data_stored":4655392,"data_compressed":60088,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":228786176},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003199"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":1898,"reported_epoch":640,"state":"active+clean","last_fresh":"2024-09-16T17:26:51.308662+0000","last_change":"2024-09-16T17:26:51.379281+0000","last_active":"2024-09-16T17:26:51.308662+0000","last_peered":"2024-09-16T17:26:51.308662+0000","last_clean":"2024-09-16T17:26:51.308662+0000","last_became_active":"2024-09-16T16:45:34.727276+0000","last_became_peered":"2024-09-16T16:45:34.727276+0000","last_unstale":"2024-09-16T17:26:51.308662+0000","last_undegraded":"2024-09-16T17:26:51.308662+0000","last_fullsized":"2024-09-16T17:26:51.308662+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:26:51.379102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:26:51.379102+0000","last_clean_scrub_stamp":"2024-09-16T16:45:33.640839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1898,"reported_epoch":640,"state":"active+clean","last_fresh":"2024-09-16T17:26:51.309680+0000","last_change":"2024-09-16T17:26:51.329459+0000","last_active":"2024-09-16T17:26:51.309680+0000","last_peered":"2024-09-16T17:26:51.309680+0000","last_clean":"2024-09-16T17:26:51.309680+0000","last_became_active":"2024-09-16T16:45:34.768510+0000","last_became_peered":"2024-09-16T16:45:34.768510+0000","last_unstale":"2024-09-16T17:26:51.309680+0000","last_undegraded":"2024-09-16T17:26:51.309680+0000","last_fullsized":"2024-09-16T17:26:51.309680+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:26:51.329188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:26:51.329188+0000","last_clean_scrub_stamp":"2024-09-16T16:45:33.640839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1898,"reported_epoch":640,"state":"active+clean","last_fresh":"2024-09-16T17:26:51.306920+0000","last_change":"2024-09-16T17:26:51.343106+0000","last_active":"2024-09-16T17:26:51.306920+0000","last_peered":"2024-09-16T17:26:51.306920+0000","last_clean":"2024-09-16T17:26:51.306920+0000","last_became_active":"2024-09-16T16:45:34.751996+0000","last_became_peered":"2024-09-16T16:45:34.751996+0000","last_unstale":"2024-09-16T17:26:51.306920+0000","last_undegraded":"2024-09-16T17:26:51.306920+0000","last_fullsized":"2024-09-16T17:26:51.306920+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:26:51.342820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:26:51.342820+0000","last_clean_scrub_stamp":"2024-09-16T16:45:33.640839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1898,"reported_epoch":640,"state":"active+clean","last_fresh":"2024-09-16T17:26:51.308484+0000","last_change":"2024-09-16T17:26:51.330773+0000","last_active":"2024-09-16T17:26:51.308484+0000","last_peered":"2024-09-16T17:26:51.308484+0000","last_clean":"2024-09-16T17:26:51.308484+0000","last_became_active":"2024-09-16T16:45:34.762441+0000","last_became_peered":"2024-09-16T16:45:34.762441+0000","last_unstale":"2024-09-16T17:26:51.308484+0000","last_undegraded":"2024-09-16T17:26:51.308484+0000","last_fullsized":"2024-09-16T17:26:51.308484+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:26:51.330514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:26:51.330514+0000","last_clean_scrub_stamp":"2024-09-16T16:45:33.640839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"13'2","reported_seq":1900,"reported_epoch":640,"state":"active+clean","last_fresh":"2024-09-16T17:26:50.845293+0000","last_change":"2024-09-16T17:26:50.856118+0000","last_active":"2024-09-16T17:26:50.845293+0000","last_peered":"2024-09-16T17:26:50.845293+0000","last_clean":"2024-09-16T17:26:50.845293+0000","last_became_active":"2024-09-16T16:45:34.742686+0000","last_became_peered":"2024-09-16T16:45:34.742686+0000","last_unstale":"2024-09-16T17:26:50.845293+0000","last_undegraded":"2024-09-16T17:26:50.845293+0000","last_fullsized":"2024-09-16T17:26:50.845293+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"13'2","last_scrub_stamp":"2024-09-16T17:26:50.855790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:26:50.855790+0000","last_clean_scrub_stamp":"2024-09-16T16:45:33.640839+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1898,"reported_epoch":640,"state":"active+clean","last_fresh":"2024-09-16T17:26:51.780856+0000","last_change":"2024-09-16T17:26:51.789890+0000","last_active":"2024-09-16T17:26:51.780856+0000","last_peered":"2024-09-16T17:26:51.780856+0000","last_clean":"2024-09-16T17:26:51.780856+0000","last_became_active":"2024-09-16T16:45:34.770776+0000","last_became_peered":"2024-09-16T16:45:34.770776+0000","last_unstale":"2024-09-16T17:26:51.780856+0000","last_undegraded":"2024-09-16T17:26:51.780856+0000","last_fullsized":"2024-09-16T17:26:51.780856+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:26:51.789717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:26:51.789717+0000","last_clean_scrub_stamp":"2024-09-16T16:45:33.640839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1898,"reported_epoch":640,"state":"active+clean","last_fresh":"2024-09-16T17:26:51.779473+0000","last_change":"2024-09-16T17:26:51.787199+0000","last_active":"2024-09-16T17:26:51.779473+0000","last_peered":"2024-09-16T17:26:51.779473+0000","last_clean":"2024-09-16T17:26:51.779473+0000","last_became_active":"2024-09-16T16:45:34.772861+0000","last_became_peered":"2024-09-16T16:45:34.772861+0000","last_unstale":"2024-09-16T17:26:51.779473+0000","last_undegraded":"2024-09-16T17:26:51.779473+0000","last_fullsized":"2024-09-16T17:26:51.779473+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:26:51.787029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:26:51.787029+0000","last_clean_scrub_stamp":"2024-09-16T16:45:33.640839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"11'1","reported_seq":1899,"reported_epoch":640,"state":"active+clean","last_fresh":"2024-09-16T17:26:51.304825+0000","last_change":"2024-09-16T17:26:51.368040+0000","last_active":"2024-09-16T17:26:51.304825+0000","last_peered":"2024-09-16T17:26:51.304825+0000","last_clean":"2024-09-16T17:26:51.304825+0000","last_became_active":"2024-09-16T16:45:34.740122+0000","last_became_peered":"2024-09-16T16:45:34.740122+0000","last_unstale":"2024-09-16T17:26:51.304825+0000","last_undegraded":"2024-09-16T17:26:51.304825+0000","last_fullsized":"2024-09-16T17:26:51.304825+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"11'1","last_scrub_stamp":"2024-09-16T17:26:51.367738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:26:51.367738+0000","last_clean_scrub_stamp":"2024-09-16T16:45:33.640839+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'52","reported_seq":1967,"reported_epoch":640,"state":"active+clean","last_fresh":"2024-09-16T17:26:51.304868+0000","last_change":"2024-09-16T17:26:51.341064+0000","last_active":"2024-09-16T17:26:51.304868+0000","last_peered":"2024-09-16T17:26:51.304868+0000","last_clean":"2024-09-16T17:26:51.304868+0000","last_became_active":"2024-09-16T16:45:33.697521+0000","last_became_peered":"2024-09-16T16:45:33.697521+0000","last_unstale":"2024-09-16T17:26:51.304868+0000","last_undegraded":"2024-09-16T17:26:51.304868+0000","last_fullsized":"2024-09-16T17:26:51.304868+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"10'52","last_scrub_stamp":"2024-09-16T17:26:51.340851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:26:51.340851+0000","last_clean_scrub_stamp":"2024-09-16T16:45:32.637441+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740849,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":69504,"kb_used_data":2416,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94302336,"statfs":{"total":96636764160,"available":96565592064,"internally_reserved":0,"allocated":2473984,"data_stored":1158206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359740851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":91776,"kb_used_data":2480,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94280064,"statfs":{"total":96636764160,"available":96542785536,"internally_reserved":0,"allocated":2539520,"data_stored":1748593,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359740848,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":69568,"kb_used_data":2480,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94302272,"statfs":{"total":96636764160,"available":96565526528,"internally_reserved":0,"allocated":2539520,"data_stored":1748593,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:27:12.434 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-16T17:27:12.542 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T17:27:12.534+0000 7f2522b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:27:12.546 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-16T17:27:12.545+0000 7f2522b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:27:12.750 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-16T17:27:12.750 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-16T17:27:12.751 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-16T17:27:12.751 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T17:27:12.834 INFO:tasks.ceph.osd.0:Stopped 2024-09-16T17:27:12.834 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-16T17:27:12.834 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T17:27:12.921 INFO:tasks.ceph.osd.1:Stopped 2024-09-16T17:27:12.922 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-16T17:27:12.922 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T17:27:13.010 INFO:tasks.ceph.osd.2:Stopped 2024-09-16T17:27:13.010 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-16T17:27:13.010 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-16T17:27:13.011 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T17:27:13.039 INFO:tasks.ceph.mgr.x:Stopped 2024-09-16T17:27:13.039 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-16T17:27:13.039 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-16T17:27:13.039 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T17:27:13.097 INFO:tasks.ceph.mon.a:Stopped 2024-09-16T17:27:13.097 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-16T17:27:13.097 DEBUG:teuthology.orchestra.run.smithi122:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'is full \(reached quota' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(POOL_FULL\)' | head -n 1 2024-09-16T17:27:13.167 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi122.front.sepia.ceph.com 2024-09-16T17:27:13.167 DEBUG:teuthology.orchestra.run.smithi122:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-16T17:27:13.340 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi122.front.sepia.ceph.com 2024-09-16T17:27:13.340 DEBUG:teuthology.orchestra.run.smithi122:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-16T17:27:13.470 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi122.front.sepia.ceph.com 2024-09-16T17:27:13.470 DEBUG:teuthology.orchestra.run.smithi122:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-16T17:27:13.551 INFO:tasks.ceph:Archiving mon data... 2024-09-16T17:27:13.552 DEBUG:teuthology.misc:Transferring archived files from smithi122:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7907362/data/mon.a.tgz 2024-09-16T17:27:13.552 DEBUG:teuthology.orchestra.run.smithi122:> mktemp 2024-09-16T17:27:13.567 INFO:teuthology.orchestra.run.smithi122.stdout:/tmp/tmp.2LMOr0gA56 2024-09-16T17:27:13.567 DEBUG:teuthology.orchestra.run.smithi122:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.2LMOr0gA56 2024-09-16T17:27:13.689 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 0666 /tmp/tmp.2LMOr0gA56 2024-09-16T17:27:13.771 DEBUG:teuthology.orchestra.remote:smithi122:/tmp/tmp.2LMOr0gA56 is 275KB 2024-09-16T17:27:13.864 DEBUG:teuthology.orchestra.run.smithi122:> rm -fr /tmp/tmp.2LMOr0gA56 2024-09-16T17:27:13.879 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-16T17:27:13.879 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-16T17:27:13.998 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-16T17:27:13.998 INFO:tasks.ceph:Archiving crash dumps... 2024-09-16T17:27:13.999 DEBUG:teuthology.misc:Transferring archived files from smithi122:/var/lib/ceph/crash to /home/teuthworker/archive/matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7907362/remote/smithi122/crash 2024-09-16T17:27:14.000 DEBUG:teuthology.orchestra.run.smithi122:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-16T17:27:14.061 INFO:tasks.ceph:Compressing logs... 2024-09-16T17:27:14.061 DEBUG:teuthology.orchestra.run.smithi122:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-16T17:27:14.126 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-16T17:27:14.126 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75493.log 2024-09-16T17:27:14.148 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29726.log 2024-09-16T17:27:14.148 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.75493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74827.log 2024-09-16T17:27:14.148 INFO:teuthology.orchestra.run.smithi122.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.75493.log.gz 2024-09-16T17:27:14.148 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.29726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75451.log 2024-09-16T17:27:14.148 INFO:teuthology.orchestra.run.smithi122.stderr: 66.4% -- replaced with /var/log/ceph/ceph-client.admin.29726.log.gz 2024-09-16T17:27:14.148 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.74827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29880.log 2024-09-16T17:27:14.148 INFO:teuthology.orchestra.run.smithi122.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.74827.log.gz 2024-09-16T17:27:14.148 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.75451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68442.log 2024-09-16T17:27:14.148 INFO:teuthology.orchestra.run.smithi122.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.75451.log.gz 2024-09-16T17:27:14.148 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.29880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30004.log 2024-09-16T17:27:14.148 INFO:teuthology.orchestra.run.smithi122.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29880.log.gz 2024-09-16T17:27:14.149 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.68442.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-16T17:27:14.149 INFO:teuthology.orchestra.run.smithi122.stderr: 80.0% -- replaced with /var/log/ceph/ceph-client.admin.68442.log.gz 2024-09-16T17:27:14.149 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.30004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50856.log 2024-09-16T17:27:14.149 INFO:teuthology.orchestra.run.smithi122.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30004.log.gz 2024-09-16T17:27:14.149 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30002.log 2024-09-16T17:27:14.149 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.50856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28859.log 2024-09-16T17:27:14.149 INFO:teuthology.orchestra.run.smithi122.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.50856.log.gz 2024-09-16T17:27:14.149 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.30002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75619.log 2024-09-16T17:27:14.149 INFO:teuthology.orchestra.run.smithi122.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30002.log.gz 2024-09-16T17:27:14.149 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.28859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75746.log 2024-09-16T17:27:14.149 INFO:teuthology.orchestra.run.smithi122.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.28859.log.gz 2024-09-16T17:27:14.149 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.75619.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.75619.log.gz 2024-09-16T17:27:14.149 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29248.log 2024-09-16T17:27:14.149 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.75746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39937.log 2024-09-16T17:27:14.149 INFO:teuthology.orchestra.run.smithi122.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.75746.log.gz 2024-09-16T17:27:14.150 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.29248.log: 49.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.29248.log.gz 2024-09-16T17:27:14.150 INFO:teuthology.orchestra.run.smithi122.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.29060.log 2024-09-16T17:27:14.150 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.39937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30216.log 2024-09-16T17:27:14.150 INFO:teuthology.orchestra.run.smithi122.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.39937.log.gz 2024-09-16T17:27:14.150 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.29060.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29060.log.gz 2024-09-16T17:27:14.150 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74268.log 2024-09-16T17:27:14.150 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.30216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75661.log 2024-09-16T17:27:14.150 INFO:teuthology.orchestra.run.smithi122.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30216.log.gz 2024-09-16T17:27:14.150 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.74268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30518.log 2024-09-16T17:27:14.150 INFO:teuthology.orchestra.run.smithi122.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.74268.log.gz 2024-09-16T17:27:14.150 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.75661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29701.log 2024-09-16T17:27:14.151 INFO:teuthology.orchestra.run.smithi122.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.75661.log.gz 2024-09-16T17:27:14.151 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.30518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75325.log 2024-09-16T17:27:14.151 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.29701.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29701.log.gz 2024-09-16T17:27:14.151 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-16T17:27:14.151 INFO:teuthology.orchestra.run.smithi122.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.30518.log.gz 2024-09-16T17:27:14.151 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45587.log 2024-09-16T17:27:14.151 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.75325.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.75325.log.gz 2024-09-16T17:27:14.151 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40024.log 2024-09-16T17:27:14.151 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.45587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75535.log 2024-09-16T17:27:14.151 INFO:teuthology.orchestra.run.smithi122.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.45587.log.gz 2024-09-16T17:27:14.151 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.40024.log: 88.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-16T17:27:14.151 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74995.log 2024-09-16T17:27:14.151 INFO:teuthology.orchestra.run.smithi122.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.40024.log.gz 2024-09-16T17:27:14.151 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74890.log 2024-09-16T17:27:14.151 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.75535.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.75535.log.gz 2024-09-16T17:27:14.152 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5/var/log/ceph/ceph-client.admin.74995.log: --verbose -- /var/log/ceph/ceph-client.admin.75096.log 2024-09-16T17:27:14.152 INFO:teuthology.orchestra.run.smithi122.stderr: 76.9% -- replaced with /var/log/ceph/ceph-client.admin.74995.log.gz 2024-09-16T17:27:14.152 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.74890.log: 76.6% -- replaced with /var/log/ceph/ceph-client.admin.74890.log.gz 2024-09-16T17:27:14.152 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29796.log 2024-09-16T17:27:14.152 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74202.log 2024-09-16T17:27:14.152 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.75096.log: /var/log/ceph/ceph-client.admin.29796.log: 76.7% -- replaced with /var/log/ceph/ceph-client.admin.75096.log.gz 2024-09-16T17:27:14.152 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74943.log 2024-09-16T17:27:14.152 INFO:teuthology.orchestra.run.smithi122.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29796.log.gz 2024-09-16T17:27:14.152 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.74202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45654.log 2024-09-16T17:27:14.152 INFO:teuthology.orchestra.run.smithi122.stderr: 76.7% -- replaced with /var/log/ceph/ceph-client.admin.74202.log.gz 2024-09-16T17:27:14.152 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.74943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45722.log 2024-09-16T17:27:14.152 INFO:teuthology.orchestra.run.smithi122.stderr: 83.4% -- replaced with /var/log/ceph/ceph-client.admin.74943.log.gz 2024-09-16T17:27:14.152 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.45654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75577.log 2024-09-16T17:27:14.152 INFO:teuthology.orchestra.run.smithi122.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.45654.log.gz 2024-09-16T17:27:14.152 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.45722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75703.log 2024-09-16T17:27:14.153 INFO:teuthology.orchestra.run.smithi122.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.45722.log.gz 2024-09-16T17:27:14.153 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.75577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57045.log 2024-09-16T17:27:14.153 INFO:teuthology.orchestra.run.smithi122.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.75577.log.gz 2024-09-16T17:27:14.153 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.75703.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.75703.log.gz 2024-09-16T17:27:14.153 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30300.log 2024-09-16T17:27:14.153 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-16T17:27:14.153 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.57045.log: /var/log/ceph/ceph-client.admin.30300.log: gzip -5 80.4% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.57045.log.gz /var/log/ceph/ceph-client.admin.29009.log 2024-09-16T17:27:14.153 INFO:teuthology.orchestra.run.smithi122.stderr: 2024-09-16T17:27:14.153 INFO:teuthology.orchestra.run.smithi122.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.30300.log.gz 2024-09-16T17:27:14.153 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29218.log 2024-09-16T17:27:14.153 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.29009.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-16T17:27:14.153 INFO:teuthology.orchestra.run.smithi122.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29009.log.gz 2024-09-16T17:27:14.153 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.29218.log: gzip -5 50.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.29218.log.gz /var/log/ceph/ceph-client.admin.28771.log 2024-09-16T17:27:14.153 INFO:teuthology.orchestra.run.smithi122.stderr: 2024-09-16T17:27:14.153 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75145.log 2024-09-16T17:27:14.154 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-client.admin.28771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30129.log 2024-09-16T17:27:14.154 INFO:teuthology.orchestra.run.smithi122.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.28771.log.gz 2024-09-16T17:27:14.154 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.75145.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27394.log 2024-09-16T17:27:14.154 INFO:teuthology.orchestra.run.smithi122.stderr: 77.0% -- replaced with /var/log/ceph/ceph-client.admin.75145.log.gz 2024-09-16T17:27:14.154 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.30129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29922.log 2024-09-16T17:27:14.154 INFO:teuthology.orchestra.run.smithi122.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30129.log.gz 2024-09-16T17:27:14.154 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph.tmp-client.admin.27394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74322.log 2024-09-16T17:27:14.154 INFO:teuthology.orchestra.run.smithi122.stderr: 67.7% -- replaced with /var/log/ceph/ceph.tmp-client.admin.27394.log.gz 2024-09-16T17:27:14.154 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.29922.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29922.log.gz 2024-09-16T17:27:14.154 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30258.log 2024-09-16T17:27:14.154 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-16T17:27:14.154 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.74322.log: /var/log/ceph/ceph-client.admin.30258.log: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.74322.log.gz 2024-09-16T17:27:14.154 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75409.log 2024-09-16T17:27:14.154 INFO:teuthology.orchestra.run.smithi122.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30258.log.gz 2024-09-16T17:27:14.154 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-16T17:27:14.155 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.75409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75786.log 2024-09-16T17:27:14.155 INFO:teuthology.orchestra.run.smithi122.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.75409.log.gz 2024-09-16T17:27:14.155 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28969.log 2024-09-16T17:27:14.155 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.75786.log: gzip 50.0% -- replaced with /var/log/ceph/ceph-client.admin.75786.log.gz 2024-09-16T17:27:14.155 INFO:teuthology.orchestra.run.smithi122.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.30003.log 2024-09-16T17:27:14.155 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30090.log 2024-09-16T17:27:14.155 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.30003.log: /var/log/ceph/ceph-client.admin.28969.log: 50.0% 50.4% -- replaced with /var/log/ceph/ceph-client.admin.28969.log.gz 2024-09-16T17:27:14.155 INFO:teuthology.orchestra.run.smithi122.stderr: -- replaced with /var/log/ceph/ceph-client.admin.30003.log.gz 2024-09-16T17:27:14.155 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75367.log 2024-09-16T17:27:14.155 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75044.log 2024-09-16T17:27:14.155 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.75367.log: /var/log/ceph/ceph-client.admin.30090.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.75367.log.gz 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30090.log.gz 2024-09-16T17:27:14.155 INFO:teuthology.orchestra.run.smithi122.stderr: 2024-09-16T17:27:14.155 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29645.log 2024-09-16T17:27:14.155 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30130.log 2024-09-16T17:27:14.155 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.29645.log: /var/log/ceph/ceph-client.admin.75044.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29645.log.gz 2024-09-16T17:27:14.156 INFO:teuthology.orchestra.run.smithi122.stderr: 76.7% -- replaced with /var/log/ceph/ceph-client.admin.75044.log.gz 2024-09-16T17:27:14.156 INFO:teuthology.orchestra.run.smithi122.stderr: 88.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-16T17:27:14.156 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75283.log 2024-09-16T17:27:14.156 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.30130.log: gzip -5 --verbose -- 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30130.log.gz 2024-09-16T17:27:14.156 INFO:teuthology.orchestra.run.smithi122.stderr: /var/log/ceph/ceph-client.admin.29838.log 2024-09-16T17:27:14.156 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.75283.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.75283.log.gz 2024-09-16T17:27:14.156 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.29838.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29838.log.gz 2024-09-16T17:27:14.290 INFO:teuthology.orchestra.run.smithi122.stderr: 93.3% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-16T17:27:15.063 INFO:teuthology.orchestra.run.smithi122.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-16T17:27:28.451 INFO:teuthology.orchestra.run.smithi122.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-16T17:27:31.706 INFO:teuthology.orchestra.run.smithi122.stderr: 94.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-16T17:27:31.722 INFO:teuthology.orchestra.run.smithi122.stderr: 94.6% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-16T17:27:31.724 INFO:teuthology.orchestra.run.smithi122.stderr: 2024-09-16T17:27:31.724 INFO:teuthology.orchestra.run.smithi122.stderr:real 0m17.607s 2024-09-16T17:27:31.724 INFO:teuthology.orchestra.run.smithi122.stderr:user 0m48.404s 2024-09-16T17:27:31.724 INFO:teuthology.orchestra.run.smithi122.stderr:sys 0m2.109s 2024-09-16T17:27:31.724 INFO:tasks.ceph:Archiving logs... 2024-09-16T17:27:31.725 DEBUG:teuthology.misc:Transferring archived files from smithi122:/var/log/ceph to /home/teuthworker/archive/matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7907362/remote/smithi122/log 2024-09-16T17:27:31.726 DEBUG:teuthology.orchestra.run.smithi122:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-16T17:27:38.067 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-16T17:27:38.077 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-16T17:27:38.077 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-16T17:27:38.141 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-16T17:27:38.150 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-16T17:27:38.150 DEBUG:teuthology.orchestra.run.smithi122:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T17:27:38.171 INFO:teuthology.orchestra.run.smithi122.stderr:bash: line 1: ntpq: command not found 2024-09-16T17:27:38.177 INFO:teuthology.orchestra.run.smithi122.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T17:27:38.177 INFO:teuthology.orchestra.run.smithi122.stdout:=============================================================================== 2024-09-16T17:27:38.178 INFO:teuthology.orchestra.run.smithi122.stdout:^* hv01.front.sepia.ceph.com 3 6 377 35 -351us[ -354us] +/- 60ms 2024-09-16T17:27:38.178 INFO:teuthology.orchestra.run.smithi122.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 39 +114us[ +112us] +/- 64ms 2024-09-16T17:27:38.178 INFO:teuthology.orchestra.run.smithi122.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 37 +340us[ +337us] +/- 82ms 2024-09-16T17:27:38.178 INFO:teuthology.orchestra.run.smithi122.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T17:27:38.178 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-16T17:27:38.186 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-16T17:27:38.186 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-16T17:27:38.193 DEBUG:teuthology.orchestra.run.smithi122:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-16T17:27:38.285 DEBUG:teuthology.orchestra.run.smithi122:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T17:27:38.313 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T17:27:38.313 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-16T17:27:38.321 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-16T17:27:38.329 INFO:teuthology.task.internal:Duration was 3151.742975 seconds 2024-09-16T17:27:38.329 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-16T17:27:38.337 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-16T17:27:38.338 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-16T17:27:38.392 INFO:teuthology.orchestra.run.smithi122.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T17:27:38.689 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-16T17:27:38.689 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi122.front.sepia.ceph.com 2024-09-16T17:27:38.689 DEBUG:teuthology.orchestra.run.smithi122:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-16T17:27:38.749 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-16T17:27:38.750 DEBUG:teuthology.orchestra.run.smithi122:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-16T17:27:38.817 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-16T17:27:38.817 DEBUG:teuthology.orchestra.run.smithi122:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-16T17:27:38.960 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-16T17:27:38.968 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-16T17:27:38.969 DEBUG:teuthology.orchestra.run.smithi122:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-16T17:27:38.993 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-16T17:27:39.002 DEBUG:teuthology.orchestra.run.smithi122:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-16T17:27:39.057 INFO:teuthology.orchestra.run.smithi122.stdout:kernel.core_pattern = core 2024-09-16T17:27:39.070 DEBUG:teuthology.orchestra.run.smithi122:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-16T17:27:39.124 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T17:27:39.124 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-16T17:27:39.133 INFO:teuthology.task.internal:Transferring archived files... 2024-09-16T17:27:39.133 DEBUG:teuthology.misc:Transferring archived files from smithi122:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7907362/remote/smithi122 2024-09-16T17:27:39.134 DEBUG:teuthology.orchestra.run.smithi122:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-16T17:27:39.196 INFO:teuthology.task.internal:Removing archive directory... 2024-09-16T17:27:39.197 DEBUG:teuthology.orchestra.run.smithi122:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-16T17:27:39.246 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-16T17:27:39.256 INFO:teuthology.task.internal:Not uploading archives. 2024-09-16T17:27:39.256 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-16T17:27:39.264 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-16T17:27:39.265 DEBUG:teuthology.orchestra.run.smithi122:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-16T17:27:39.301 INFO:teuthology.orchestra.run.smithi122.stdout: 266063 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 16 17:27 /home/ubuntu/cephtest 2024-09-16T17:27:39.302 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-16T17:27:39.311 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-16T17:27:39.331 INFO:teuthology.run:Summary data: description: crimson-rados/rbd/{clusters/fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore tasks/rbd_api_tests} duration: 3151.742974758148 flavor: crimson owner: scheduled_matan@teuthology success: true 2024-09-16T17:27:39.331 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-16T17:27:39.410 INFO:teuthology.run:pass