2024-09-16T07:23:05.550 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-16T07:23:05.567 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-16T07:23:05.684 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/matan-2024-09-16_07:15:55-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7906860 branch: wip-matanb-crimson-testing-59543 description: crimson-rados/rbd/{clusters/fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore tasks/rbd_api_tests} email: null first_in_suite: false job_id: '7906860' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: matan-2024-09-16_07:15:55-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-matanb-crimson-testing-59543 ceph: conf: global: enable experimental unrecoverable data corrupting features: crimson ms client mode: crc ms cluster mode: crc ms mon client mode: crc ms mon cluster mode: crc ms mon service mode: crc ms service mode: crc mgr: debug mgr: 20 debug ms: 1 mgr stats period: 30 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd pool default crimson: true osd: bluestore block size: 96636764160 bluestore compression algorithm: snappy bluestore compression mode: aggressive bluestore fsck on mount: true bluestore rocksdb cf: false crimson alien thread cpu cores: 6-7 crimson osd obc lru size: 10 debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 err to stderr: true log flush on exit: true log to file: false log to stderr: true mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd.0: crimson seastar cpu cores: 0-1 osd.1: crimson seastar cpu cores: 2-3 osd.2: crimson seastar cpu cores: 4-5 flavor: crimson fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(CACHE_POOL_NO_HIT_SET\) - \(POOL_APP_NOT_ENABLED\) - is full \(reached quota - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(POOL_FULL\) sha1: 81fedcb3b484c843d22ffbc8d179cb567b7083b5 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log global: osd crush chooseleaf type: 0 osd pool default pg num: 128 osd pool default pgp num: 128 osd pool default size: 2 mon: {} install: ceph: flavor: crimson sha1: 81fedcb3b484c843d22ffbc8d179cb567b7083b5 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 workunit: branch: main env: CRIMSON_COMPAT: '1' sha1: 0325fd3c11a225c0fd9eb38fab88aad1370ad779 owner: scheduled_matan@teuthology priority: 60 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 seed: 6651 sha1: 81fedcb3b484c843d22ffbc8d179cb567b7083b5 sleep_before_teardown: 0 suite: crimson-rados suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 0325fd3c11a225c0fd9eb38fab88aad1370ad779 targets: smithi115.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPBXCvf4DHyewQs/qbPhnewSLr8leF6Rl2oZj/yTw1xlZjSzmdT5mK/HqfpW42MRuRq0dZH11iHltZH2oM5oJso= tasks: - install: null - ceph: conf: mon: mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 paxos service trim min: 10 osd: debug monc: 20 flavor: crimson - workunit: clients: client.0: - rbd/crimson/test_crimson_librbd.sh env: RBD_FEATURES: '61' teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-16_07:15:55 tube: smithi user: matan verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-16T07:23:05.684 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa; will attempt to use it 2024-09-16T07:23:05.779 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa/tasks 2024-09-16T07:23:05.780 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-16T07:23:05.781 INFO:teuthology.task.internal:Checking packages... 2024-09-16T07:23:05.803 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'crimson' and ceph hash '81fedcb3b484c843d22ffbc8d179cb567b7083b5' 2024-09-16T07:23:05.803 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-16T07:23:05.803 INFO:teuthology.packaging:ref: None 2024-09-16T07:23:05.803 INFO:teuthology.packaging:tag: None 2024-09-16T07:23:05.803 INFO:teuthology.packaging:branch: wip-matanb-crimson-testing-59543 2024-09-16T07:23:05.803 INFO:teuthology.packaging:sha1: 81fedcb3b484c843d22ffbc8d179cb567b7083b5 2024-09-16T07:23:05.803 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&ref=wip-matanb-crimson-testing-59543 2024-09-16T07:23:05.951 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4879.g81fedcb3 2024-09-16T07:23:05.953 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-16T07:23:05.958 INFO:teuthology.task.internal:no buildpackages task found 2024-09-16T07:23:05.958 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-16T07:23:05.974 INFO:teuthology.task.internal:Saving configuration 2024-09-16T07:23:05.987 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-16T07:23:05.993 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-16T07:23:06.017 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi115.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2024-09-16_07:15:55-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7906860', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-16 07:18:08.355862', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPBXCvf4DHyewQs/qbPhnewSLr8leF6Rl2oZj/yTw1xlZjSzmdT5mK/HqfpW42MRuRq0dZH11iHltZH2oM5oJso='} 2024-09-16T07:23:06.017 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-16T07:23:06.023 INFO:teuthology.task.internal:roles: ubuntu@smithi115.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2024-09-16T07:23:06.023 INFO:teuthology.run_tasks:Running task console_log... 2024-09-16T07:23:06.057 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f30b17b3be0>, signals=[15]) 2024-09-16T07:23:06.057 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-16T07:23:06.063 INFO:teuthology.task.internal:Opening connections... 2024-09-16T07:23:06.063 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi115.front.sepia.ceph.com 2024-09-16T07:23:06.064 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T07:23:06.139 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-16T07:23:06.145 DEBUG:teuthology.orchestra.run.smithi115:> uname -m 2024-09-16T07:23:06.227 INFO:teuthology.orchestra.run.smithi115.stdout:x86_64 2024-09-16T07:23:06.227 DEBUG:teuthology.orchestra.run.smithi115:> cat /etc/os-release 2024-09-16T07:23:06.285 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="CentOS Stream" 2024-09-16T07:23:06.286 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="9" 2024-09-16T07:23:06.286 INFO:teuthology.orchestra.run.smithi115.stdout:ID="centos" 2024-09-16T07:23:06.286 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="rhel fedora" 2024-09-16T07:23:06.286 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="9" 2024-09-16T07:23:06.286 INFO:teuthology.orchestra.run.smithi115.stdout:PLATFORM_ID="platform:el9" 2024-09-16T07:23:06.286 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-16T07:23:06.286 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31" 2024-09-16T07:23:06.286 INFO:teuthology.orchestra.run.smithi115.stdout:LOGO="fedora-logo-icon" 2024-09-16T07:23:06.286 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-16T07:23:06.286 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://centos.org/" 2024-09-16T07:23:06.286 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-16T07:23:06.286 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-16T07:23:06.286 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-16T07:23:06.287 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server 2024-09-16T07:23:06.310 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-16T07:23:06.318 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-16T07:23:06.322 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-16T07:23:06.323 DEBUG:teuthology.orchestra.run.smithi115:> test '!' -e /home/ubuntu/cephtest 2024-09-16T07:23:06.343 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-16T07:23:06.349 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-16T07:23:06.349 DEBUG:teuthology.orchestra.run.smithi115:> test -z $(ls -A /var/lib/ceph) 2024-09-16T07:23:06.468 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-16T07:23:06.499 INFO:teuthology.run_tasks:Running task kernel... 2024-09-16T07:23:06.514 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-09-16T07:23:06.514 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-09-16T07:23:06.514 DEBUG:teuthology.orchestra.run.smithi115:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-16T07:23:06.531 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T07:23:06.532 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-09-16T07:23:06.590 INFO:teuthology.orchestra.run.smithi115.stdout:5.14.0-503.el9.x86_64 2024-09-16T07:23:06.591 INFO:teuthology.task.kernel:Running kernel on smithi115: 5.14.0-503.el9.x86_64 2024-09-16T07:23:06.591 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum install -y kernel 2024-09-16T07:23:10.410 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 9 - BaseOS 4.0 MB/s | 8.2 MB 00:02 2024-09-16T07:23:12.411 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 9 - AppStream 22 MB/s | 20 MB 00:00 2024-09-16T07:23:17.095 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 9 - CRB 7.3 MB/s | 6.5 MB 00:00 2024-09-16T07:23:18.895 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 9 - Extras packages 32 kB/s | 19 kB 00:00 2024-09-16T07:23:19.783 INFO:teuthology.orchestra.run.smithi115.stdout:Extra Packages for Enterprise Linux 30 MB/s | 23 MB 00:00 2024-09-16T07:23:25.122 INFO:teuthology.orchestra.run.smithi115.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-16T07:23:27.144 INFO:teuthology.orchestra.run.smithi115.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-16T07:23:27.144 INFO:teuthology.orchestra.run.smithi115.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-16T07:23:27.235 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-16T07:23:27.238 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-16T07:23:27.239 INFO:teuthology.orchestra.run.smithi115.stdout: Package Architecture Version Repository Size 2024-09-16T07:23:27.239 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-16T07:23:27.239 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-09-16T07:23:27.239 INFO:teuthology.orchestra.run.smithi115.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-16T07:23:27.239 INFO:teuthology.orchestra.run.smithi115.stdout:Installing dependencies: 2024-09-16T07:23:27.239 INFO:teuthology.orchestra.run.smithi115.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-16T07:23:27.239 INFO:teuthology.orchestra.run.smithi115.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-16T07:23:27.239 INFO:teuthology.orchestra.run.smithi115.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-16T07:23:27.239 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:23:27.239 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-09-16T07:23:27.239 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-16T07:23:27.239 INFO:teuthology.orchestra.run.smithi115.stdout:Install 4 Packages 2024-09-16T07:23:27.239 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:23:27.240 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 79 M 2024-09-16T07:23:27.240 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 126 M 2024-09-16T07:23:27.240 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-09-16T07:23:27.631 INFO:teuthology.orchestra.run.smithi115.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 78 kB/s | 23 kB 00:00 2024-09-16T07:23:35.155 INFO:teuthology.orchestra.run.smithi115.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 2.0 MB/s | 16 MB 00:07 2024-09-16T07:23:42.229 INFO:teuthology.orchestra.run.smithi115.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 2.0 MB/s | 29 MB 00:14 2024-09-16T07:23:44.229 INFO:teuthology.orchestra.run.smithi115.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 2.0 MB/s | 35 MB 00:16 2024-09-16T07:23:44.229 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:23:44.229 INFO:teuthology.orchestra.run.smithi115.stdout:Total 4.6 MB/s | 79 MB 00:16 2024-09-16T07:23:44.905 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-09-16T07:23:45.249 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-09-16T07:23:45.249 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-09-16T07:23:46.214 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-09-16T07:23:46.215 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-09-16T07:23:48.640 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-09-16T07:23:49.287 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-16T07:23:49.371 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T07:23:52.161 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T07:23:52.299 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T07:23:57.122 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T07:23:57.233 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T07:24:02.067 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T07:24:40.310 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T07:24:40.356 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-16T07:24:40.729 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T07:24:40.729 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-16T07:24:40.729 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T07:24:40.729 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T07:24:41.589 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T07:24:41.589 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:24:41.589 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-09-16T07:24:41.590 INFO:teuthology.orchestra.run.smithi115.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-16T07:24:41.590 INFO:teuthology.orchestra.run.smithi115.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-16T07:24:41.590 INFO:teuthology.orchestra.run.smithi115.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-16T07:24:41.590 INFO:teuthology.orchestra.run.smithi115.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-16T07:24:41.590 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:24:41.590 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-16T07:24:41.931 DEBUG:teuthology.orchestra.run.smithi115:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T07:24:42.051 INFO:teuthology.orchestra.run.smithi115.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T07:24:42.052 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T07:24:42.052 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-16T07:24:42.052 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-16T07:24:42.052 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-16T07:24:42.052 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-16T07:24:42.052 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi115.front.sepia.ceph.com, path=None, version=distro) 2024-09-16T07:24:42.053 DEBUG:teuthology.orchestra.run.smithi115:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T07:24:42.111 INFO:teuthology.orchestra.run.smithi115.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T07:24:42.112 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T07:24:42.113 DEBUG:teuthology.orchestra.run.smithi115:> sudo rpm -qi grub2-tools 2024-09-16T07:24:42.147 INFO:teuthology.orchestra.run.smithi115.stdout:Name : grub2-tools 2024-09-16T07:24:42.148 INFO:teuthology.orchestra.run.smithi115.stdout:Epoch : 1 2024-09-16T07:24:42.148 INFO:teuthology.orchestra.run.smithi115.stdout:Version : 2.06 2024-09-16T07:24:42.148 INFO:teuthology.orchestra.run.smithi115.stdout:Release : 82.el9 2024-09-16T07:24:42.148 INFO:teuthology.orchestra.run.smithi115.stdout:Architecture: x86_64 2024-09-16T07:24:42.148 INFO:teuthology.orchestra.run.smithi115.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-16T07:24:42.148 INFO:teuthology.orchestra.run.smithi115.stdout:Group : Unspecified 2024-09-16T07:24:42.148 INFO:teuthology.orchestra.run.smithi115.stdout:Size : 8274670 2024-09-16T07:24:42.148 INFO:teuthology.orchestra.run.smithi115.stdout:License : GPLv3+ 2024-09-16T07:24:42.148 INFO:teuthology.orchestra.run.smithi115.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-16T07:24:42.148 INFO:teuthology.orchestra.run.smithi115.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-16T07:24:42.148 INFO:teuthology.orchestra.run.smithi115.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-16T07:24:42.148 INFO:teuthology.orchestra.run.smithi115.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-16T07:24:42.149 INFO:teuthology.orchestra.run.smithi115.stdout:Packager : builder@centos.org 2024-09-16T07:24:42.149 INFO:teuthology.orchestra.run.smithi115.stdout:Vendor : CentOS 2024-09-16T07:24:42.149 INFO:teuthology.orchestra.run.smithi115.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-16T07:24:42.149 INFO:teuthology.orchestra.run.smithi115.stdout:Summary : Support tools for GRUB. 2024-09-16T07:24:42.149 INFO:teuthology.orchestra.run.smithi115.stdout:Description : 2024-09-16T07:24:42.149 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:24:42.149 INFO:teuthology.orchestra.run.smithi115.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-16T07:24:42.149 INFO:teuthology.orchestra.run.smithi115.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-16T07:24:42.149 INFO:teuthology.orchestra.run.smithi115.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-16T07:24:42.149 INFO:teuthology.orchestra.run.smithi115.stdout:hardware devices. 2024-09-16T07:24:42.149 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:24:42.149 INFO:teuthology.orchestra.run.smithi115.stdout:This subpackage provides tools for support of all platforms. 2024-09-16T07:24:42.150 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-16T07:24:42.150 INFO:teuthology.task.kernel:Updating grub on smithi115 to boot 5.14.0-505.el9.x86_64 2024-09-16T07:24:42.150 DEBUG:teuthology.orchestra.run.smithi115:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-16T07:24:42.810 INFO:teuthology.orchestra.run.smithi115.stderr:Generating grub configuration file ... 2024-09-16T07:24:44.091 INFO:teuthology.orchestra.run.smithi115.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-16T07:24:44.111 INFO:teuthology.orchestra.run.smithi115.stderr:done 2024-09-16T07:24:44.113 DEBUG:teuthology.orchestra.run.smithi115:> mktemp 2024-09-16T07:24:44.129 INFO:teuthology.orchestra.run.smithi115.stdout:/tmp/tmp.BLfqDsUKle 2024-09-16T07:24:44.130 DEBUG:teuthology.orchestra.run.smithi115:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.BLfqDsUKle 2024-09-16T07:24:44.197 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 0666 /tmp/tmp.BLfqDsUKle 2024-09-16T07:24:44.334 DEBUG:teuthology.orchestra.remote:smithi115:/tmp/tmp.BLfqDsUKle is 6KB 2024-09-16T07:24:44.383 DEBUG:teuthology.orchestra.run.smithi115:> rm -fr /tmp/tmp.BLfqDsUKle 2024-09-16T07:24:44.399 DEBUG:teuthology.orchestra.run.smithi115:> sudo /bin/ls /boot/loader/entries || true 2024-09-16T07:24:44.461 INFO:teuthology.orchestra.run.smithi115.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-16T07:24:44.461 INFO:teuthology.orchestra.run.smithi115.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-16T07:24:44.462 INFO:teuthology.orchestra.run.smithi115.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-16T07:24:44.462 INFO:teuthology.orchestra.run.smithi115.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-16T07:24:44.463 DEBUG:teuthology.orchestra.run.smithi115:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-16T07:24:44.628 DEBUG:teuthology.orchestra.run.smithi115:> sudo shutdown -r now 2024-09-16T07:25:14.661 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-16T07:25:14.661 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-09-16T07:25:14.662 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T07:25:33.121 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-09-16T07:25:42.129 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-09-16T07:25:42.130 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T07:25:45.181 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-09-16T07:25:57.193 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-09-16T07:25:57.193 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T07:26:15.613 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-09-16T07:26:30.629 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-09-16T07:26:30.631 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T07:26:30.997 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-09-16T07:26:31.385 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-09-16T07:26:31.388 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-16T07:26:31.388 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-09-16T07:26:31.403 INFO:teuthology.orchestra.run.smithi115.stdout:5.14.0-505.el9.x86_64 2024-09-16T07:26:31.403 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-16T07:26:31.403 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-16T07:26:31.403 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-16T07:26:32.404 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-16T07:26:32.405 DEBUG:teuthology.orchestra.run.smithi115:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-16T07:26:32.496 INFO:teuthology.orchestra.run.smithi115.stdout:ttyS1 2024-09-16T07:26:32.520 DEBUG:teuthology.parallel:result is None 2024-09-16T07:26:32.520 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-16T07:26:32.527 INFO:teuthology.task.internal:Creating test directory... 2024-09-16T07:26:32.528 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-16T07:26:32.542 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-16T07:26:32.550 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-16T07:26:32.559 INFO:teuthology.task.internal:Creating archive directory... 2024-09-16T07:26:32.560 DEBUG:teuthology.orchestra.run.smithi115:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-16T07:26:32.611 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-16T07:26:32.620 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-16T07:26:32.621 DEBUG:teuthology.orchestra.run.smithi115:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-16T07:26:32.673 INFO:teuthology.orchestra.run.smithi115.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T07:26:32.683 INFO:teuthology.orchestra.run.smithi115.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T07:26:32.684 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-16T07:26:32.696 INFO:teuthology.task.internal:Configuring sudo... 2024-09-16T07:26:32.697 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-16T07:26:32.750 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-16T07:26:32.767 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-16T07:26:32.767 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-16T07:26:32.804 DEBUG:teuthology.orchestra.run.smithi115:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T07:26:32.889 DEBUG:teuthology.orchestra.run.smithi115:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T07:26:32.957 DEBUG:teuthology.orchestra.run.smithi115:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T07:26:32.997 DEBUG:teuthology.orchestra.run.smithi115:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T07:26:33.037 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-16T07:26:33.037 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-16T07:26:33.102 DEBUG:teuthology.orchestra.run.smithi115:> sudo service rsyslog restart 2024-09-16T07:26:33.187 INFO:teuthology.orchestra.run.smithi115.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T07:26:33.526 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-16T07:26:33.536 INFO:teuthology.task.internal:Starting timer... 2024-09-16T07:26:33.536 INFO:teuthology.run_tasks:Running task pcp... 2024-09-16T07:26:33.554 INFO:teuthology.run_tasks:Running task selinux... 2024-09-16T07:26:33.571 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-09-16T07:26:33.571 DEBUG:teuthology.orchestra.run.smithi115:> sudo service auditd rotate 2024-09-16T07:26:33.672 INFO:teuthology.orchestra.run.smithi115.stdout:Rotating logs: 2024-09-16T07:26:33.680 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-16T07:26:33.680 DEBUG:teuthology.orchestra.run.smithi115:> /usr/sbin/getenforce 2024-09-16T07:26:33.729 INFO:teuthology.orchestra.run.smithi115.stdout:Permissive 2024-09-16T07:26:33.730 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi115.front.sepia.ceph.com': 'permissive'} 2024-09-16T07:26:33.730 DEBUG:teuthology.orchestra.run.smithi115:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T07:26:33.816 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T07:26:33.816 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-16T07:26:33.816 DEBUG:teuthology.orchestra.run.smithi115:> sudo /usr/sbin/setenforce permissive 2024-09-16T07:26:34.039 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-16T07:26:34.051 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-16T07:26:34.062 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-16T07:26:34.063 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi115.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-16T07:30:14.601 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi115.front.sepia.ceph.com')] 2024-09-16T07:30:14.603 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-09-16T07:30:14.605 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T07:30:14.681 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-09-16T07:30:14.760 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-09-16T07:30:14.760 INFO:teuthology.run_tasks:Running task clock... 2024-09-16T07:30:14.770 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-16T07:30:14.770 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-16T07:30:14.771 DEBUG:teuthology.orchestra.run.smithi115:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T07:30:14.829 INFO:teuthology.orchestra.run.smithi115.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-16T07:30:14.843 INFO:teuthology.orchestra.run.smithi115.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-16T07:30:14.867 INFO:teuthology.orchestra.run.smithi115.stderr:sudo: ntpd: command not found 2024-09-16T07:30:14.878 INFO:teuthology.orchestra.run.smithi115.stdout:506 Cannot talk to daemon 2024-09-16T07:30:14.892 INFO:teuthology.orchestra.run.smithi115.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-16T07:30:14.906 INFO:teuthology.orchestra.run.smithi115.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-16T07:30:14.964 INFO:teuthology.orchestra.run.smithi115.stderr:bash: line 1: ntpq: command not found 2024-09-16T07:30:14.968 INFO:teuthology.orchestra.run.smithi115.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T07:30:14.968 INFO:teuthology.orchestra.run.smithi115.stdout:=============================================================================== 2024-09-16T07:30:14.968 INFO:teuthology.orchestra.run.smithi115.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T07:30:14.968 INFO:teuthology.orchestra.run.smithi115.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T07:30:14.968 INFO:teuthology.orchestra.run.smithi115.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T07:30:14.968 INFO:teuthology.orchestra.run.smithi115.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T07:30:14.969 INFO:teuthology.run_tasks:Running task install... 2024-09-16T07:30:14.977 DEBUG:teuthology.task.install:project ceph 2024-09-16T07:30:14.977 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'crimson', 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'}} 2024-09-16T07:30:14.977 DEBUG:teuthology.task.install:config {'flavor': 'crimson', 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'} 2024-09-16T07:30:14.977 INFO:teuthology.task.install:Using flavor: crimson 2024-09-16T07:30:15.012 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-16T07:30:15.012 INFO:teuthology.task.install:extra packages: [] 2024-09-16T07:30:15.013 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'crimson', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5', 'tag': None, 'wait_for_package': False} 2024-09-16T07:30:15.013 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=81fedcb3b484c843d22ffbc8d179cb567b7083b5 2024-09-16T07:30:15.161 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/ 2024-09-16T07:30:15.161 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4879.g81fedcb3 2024-09-16T07:30:15.272 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-16T07:30:15.272 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-16T07:30:15.272 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-16T07:30:15.298 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-16T07:30:15.299 DEBUG:teuthology.orchestra.run.smithi115:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/81fedcb3b484c843d22ffbc8d179cb567b7083b5/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-16T07:30:15.364 DEBUG:teuthology.orchestra.run.smithi115:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-16T07:30:15.439 DEBUG:teuthology.orchestra.run.smithi115:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-16T07:30:15.503 INFO:teuthology.orchestra.run.smithi115.stdout:check_obsoletes = 1 2024-09-16T07:30:15.504 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum clean all 2024-09-16T07:30:15.728 INFO:teuthology.orchestra.run.smithi115.stdout:45 files removed 2024-09-16T07:30:15.756 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install ceph-radosgw 2024-09-16T07:30:16.325 INFO:teuthology.orchestra.run.smithi115.stdout:ceph packages for x86_64 308 kB/s | 88 kB 00:00 2024-09-16T07:30:16.634 INFO:teuthology.orchestra.run.smithi115.stdout:ceph noarch packages 91 kB/s | 24 kB 00:00 2024-09-16T07:30:16.909 INFO:teuthology.orchestra.run.smithi115.stdout:ceph source packages 8.7 kB/s | 2.1 kB 00:00 2024-09-16T07:30:19.784 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 9 - BaseOS 2.9 MB/s | 8.2 MB 00:02 2024-09-16T07:30:21.527 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 9 - AppStream 32 MB/s | 20 MB 00:00 2024-09-16T07:30:25.753 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 9 - CRB 17 MB/s | 6.5 MB 00:00 2024-09-16T07:30:27.195 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 9 - Extras packages 88 kB/s | 19 kB 00:00 2024-09-16T07:30:28.076 INFO:teuthology.orchestra.run.smithi115.stdout:Extra Packages for Enterprise Linux 30 MB/s | 23 MB 00:00 2024-09-16T07:30:33.549 INFO:teuthology.orchestra.run.smithi115.stdout:lab-extras 47 kB/s | 1.7 kB 00:00 2024-09-16T07:30:35.942 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-16T07:30:35.960 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-16T07:30:35.960 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repository Size 2024-09-16T07:30:35.960 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-16T07:30:35.960 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-09-16T07:30:35.960 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-radosgw x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 10 M 2024-09-16T07:30:35.960 INFO:teuthology.orchestra.run.smithi115.stdout:Upgrading: 2024-09-16T07:30:35.960 INFO:teuthology.orchestra.run.smithi115.stdout: librados2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.5 M 2024-09-16T07:30:35.960 INFO:teuthology.orchestra.run.smithi115.stdout: librbd1 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.8 M 2024-09-16T07:30:35.960 INFO:teuthology.orchestra.run.smithi115.stdout:Installing dependencies: 2024-09-16T07:30:35.960 INFO:teuthology.orchestra.run.smithi115.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-16T07:30:35.960 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-base x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 6.1 M 2024-09-16T07:30:35.961 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-common x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 20 M 2024-09-16T07:30:35.961 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-selinux x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 25 k 2024-09-16T07:30:35.961 INFO:teuthology.orchestra.run.smithi115.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-16T07:30:35.961 INFO:teuthology.orchestra.run.smithi115.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-16T07:30:35.961 INFO:teuthology.orchestra.run.smithi115.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-16T07:30:35.961 INFO:teuthology.orchestra.run.smithi115.stdout: libcephfs2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 809 k 2024-09-16T07:30:35.961 INFO:teuthology.orchestra.run.smithi115.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-16T07:30:35.961 INFO:teuthology.orchestra.run.smithi115.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-16T07:30:35.961 INFO:teuthology.orchestra.run.smithi115.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-16T07:30:35.961 INFO:teuthology.orchestra.run.smithi115.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-16T07:30:35.961 INFO:teuthology.orchestra.run.smithi115.stdout: libradosstriper1 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 558 k 2024-09-16T07:30:35.961 INFO:teuthology.orchestra.run.smithi115.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-16T07:30:35.961 INFO:teuthology.orchestra.run.smithi115.stdout: librgw2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 5.4 M 2024-09-16T07:30:35.962 INFO:teuthology.orchestra.run.smithi115.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-16T07:30:35.962 INFO:teuthology.orchestra.run.smithi115.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-16T07:30:35.962 INFO:teuthology.orchestra.run.smithi115.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-16T07:30:35.962 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ceph-argparse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 45 k 2024-09-16T07:30:35.962 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ceph-common x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 143 k 2024-09-16T07:30:35.962 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cephfs x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 160 k 2024-09-16T07:30:35.962 INFO:teuthology.orchestra.run.smithi115.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-16T07:30:35.962 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rados x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 315 k 2024-09-16T07:30:35.962 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rbd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 302 k 2024-09-16T07:30:35.962 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rgw x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 99 k 2024-09-16T07:30:35.962 INFO:teuthology.orchestra.run.smithi115.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-16T07:30:35.962 INFO:teuthology.orchestra.run.smithi115.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-16T07:30:35.962 INFO:teuthology.orchestra.run.smithi115.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-16T07:30:35.962 INFO:teuthology.orchestra.run.smithi115.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-16T07:30:35.963 INFO:teuthology.orchestra.run.smithi115.stdout:Installing weak dependencies: 2024-09-16T07:30:35.963 INFO:teuthology.orchestra.run.smithi115.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-16T07:30:35.963 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:30:35.963 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-09-16T07:30:35.963 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-16T07:30:35.963 INFO:teuthology.orchestra.run.smithi115.stdout:Install 31 Packages 2024-09-16T07:30:35.963 INFO:teuthology.orchestra.run.smithi115.stdout:Upgrade 2 Packages 2024-09-16T07:30:35.963 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:30:35.963 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 60 M 2024-09-16T07:30:35.964 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-09-16T07:30:36.733 INFO:teuthology.orchestra.run.smithi115.stdout:(1/33): ceph-base-19.3.0-4879.g81fedcb3.el9.x86 10 MB/s | 6.1 MB 00:00 2024-09-16T07:30:36.783 INFO:teuthology.orchestra.run.smithi115.stdout:(2/33): ceph-selinux-19.3.0-4879.g81fedcb3.el9. 503 kB/s | 25 kB 00:00 2024-09-16T07:30:36.875 INFO:teuthology.orchestra.run.smithi115.stdout:(3/33): libcephfs2-19.3.0-4879.g81fedcb3.el9.x8 8.6 MB/s | 809 kB 00:00 2024-09-16T07:30:37.025 INFO:teuthology.orchestra.run.smithi115.stdout:(4/33): ceph-radosgw-19.3.0-4879.g81fedcb3.el9. 12 MB/s | 10 MB 00:00 2024-09-16T07:30:37.059 INFO:teuthology.orchestra.run.smithi115.stdout:(5/33): libradosstriper1-19.3.0-4879.g81fedcb3. 3.0 MB/s | 558 kB 00:00 2024-09-16T07:30:37.267 INFO:teuthology.orchestra.run.smithi115.stdout:(6/33): ceph-common-19.3.0-4879.g81fedcb3.el9.x 18 MB/s | 20 MB 00:01 2024-09-16T07:30:37.292 INFO:teuthology.orchestra.run.smithi115.stdout:(7/33): python3-ceph-argparse-19.3.0-4879.g81fe 193 kB/s | 45 kB 00:00 2024-09-16T07:30:37.335 INFO:teuthology.orchestra.run.smithi115.stdout:(8/33): python3-ceph-common-19.3.0-4879.g81fedc 2.1 MB/s | 143 kB 00:00 2024-09-16T07:30:37.410 INFO:teuthology.orchestra.run.smithi115.stdout:(9/33): librgw2-19.3.0-4879.g81fedcb3.el9.x86_6 14 MB/s | 5.4 MB 00:00 2024-09-16T07:30:37.435 INFO:teuthology.orchestra.run.smithi115.stdout:(10/33): python3-cephfs-19.3.0-4879.g81fedcb3.e 1.1 MB/s | 160 kB 00:00 2024-09-16T07:30:37.469 INFO:teuthology.orchestra.run.smithi115.stdout:(11/33): python3-rados-19.3.0-4879.g81fedcb3.el 2.3 MB/s | 315 kB 00:00 2024-09-16T07:30:37.494 INFO:teuthology.orchestra.run.smithi115.stdout:(12/33): python3-rgw-19.3.0-4879.g81fedcb3.el9. 1.7 MB/s | 99 kB 00:00 2024-09-16T07:30:37.519 INFO:teuthology.orchestra.run.smithi115.stdout:(13/33): python3-rbd-19.3.0-4879.g81fedcb3.el9. 2.7 MB/s | 302 kB 00:00 2024-09-16T07:30:37.586 INFO:teuthology.orchestra.run.smithi115.stdout:(14/33): boost-program-options-1.75.0-8.el9.x86 912 kB/s | 107 kB 00:00 2024-09-16T07:30:37.628 INFO:teuthology.orchestra.run.smithi115.stdout:(15/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-09-16T07:30:37.653 INFO:teuthology.orchestra.run.smithi115.stdout:(16/33): libnbd-1.20.2-2.el9.x86_64.rpm 1.0 MB/s | 171 kB 00:00 2024-09-16T07:30:37.679 INFO:teuthology.orchestra.run.smithi115.stdout:(17/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 490 kB/s | 45 kB 00:00 2024-09-16T07:30:37.712 INFO:teuthology.orchestra.run.smithi115.stdout:(18/33): librdkafka-1.6.1-102.el9.x86_64.rpm 7.7 MB/s | 662 kB 00:00 2024-09-16T07:30:37.737 INFO:teuthology.orchestra.run.smithi115.stdout:(19/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-09-16T07:30:37.763 INFO:teuthology.orchestra.run.smithi115.stdout:(20/33): python3-prettytable-0.7.2-27.el9.noarc 502 kB/s | 42 kB 00:00 2024-09-16T07:30:37.788 INFO:teuthology.orchestra.run.smithi115.stdout:(21/33): qatlib-24.02.0-1.el9.x86_64.rpm 2.8 MB/s | 221 kB 00:00 2024-09-16T07:30:37.814 INFO:teuthology.orchestra.run.smithi115.stdout:(22/33): qatlib-service-24.02.0-1.el9.x86_64.rp 472 kB/s | 36 kB 00:00 2024-09-16T07:30:37.839 INFO:teuthology.orchestra.run.smithi115.stdout:(23/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 625 kB/s | 47 kB 00:00 2024-09-16T07:30:37.889 INFO:teuthology.orchestra.run.smithi115.stdout:(24/33): gperftools-libs-2.9.1-3.el9.x86_64.rpm 3.0 MB/s | 308 kB 00:00 2024-09-16T07:30:37.914 INFO:teuthology.orchestra.run.smithi115.stdout:(25/33): liboath-2.6.7-2.el9.x86_64.rpm 2.0 MB/s | 49 kB 00:00 2024-09-16T07:30:37.940 INFO:teuthology.orchestra.run.smithi115.stdout:(26/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 303 kB/s | 26 kB 00:00 2024-09-16T07:30:37.965 INFO:teuthology.orchestra.run.smithi115.stdout:(27/33): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-16T07:30:37.999 INFO:teuthology.orchestra.run.smithi115.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-16T07:30:38.032 INFO:teuthology.orchestra.run.smithi115.stdout:(29/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.9 MB/s | 839 kB 00:00 2024-09-16T07:30:38.091 INFO:teuthology.orchestra.run.smithi115.stdout:(30/33): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-09-16T07:30:38.166 INFO:teuthology.orchestra.run.smithi115.stdout:(31/33): libarrow-9.0.0-11.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-09-16T07:30:38.258 INFO:teuthology.orchestra.run.smithi115.stdout:(32/33): librados2-19.3.0-4879.g81fedcb3.el9.x8 15 MB/s | 3.5 MB 00:00 2024-09-16T07:30:38.367 INFO:teuthology.orchestra.run.smithi115.stdout:(33/33): librbd1-19.3.0-4879.g81fedcb3.el9.x86_ 14 MB/s | 3.8 MB 00:00 2024-09-16T07:30:38.372 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:30:38.372 INFO:teuthology.orchestra.run.smithi115.stdout:Total 25 MB/s | 60 MB 00:02 2024-09-16T07:30:38.483 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-09-16T07:30:38.519 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-09-16T07:30:38.519 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-09-16T07:30:39.194 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-09-16T07:30:39.194 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-09-16T07:30:40.674 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-09-16T07:30:41.192 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-16T07:30:41.244 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-16T07:30:41.319 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-16T07:30:41.411 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/35 2024-09-16T07:30:41.437 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-16T07:30:41.500 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-16T07:30:41.546 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : liboath-2.6.7-2.el9.x86_64 5/35 2024-09-16T07:30:41.584 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/35 2024-09-16T07:30:41.608 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/35 2024-09-16T07:30:41.631 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-16T07:30:41.655 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-16T07:30:41.817 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-16T07:30:41.848 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-16T07:30:41.892 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/35 2024-09-16T07:30:41.935 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9. 11/35 2024-09-16T07:30:41.964 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 12/35 2024-09-16T07:30:42.054 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 13/35 2024-09-16T07:30:42.078 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 14/35 2024-09-16T07:30:42.166 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 14/35 2024-09-16T07:30:42.210 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : thrift-0.15.0-2.el9.x86_64 15/35 2024-09-16T07:30:42.322 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : re2-1:20211101-20.el9.x86_64 16/35 2024-09-16T07:30:42.378 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/35 2024-09-16T07:30:42.428 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 18/35 2024-09-16T07:30:42.468 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 19/35 2024-09-16T07:30:42.497 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 20/35 2024-09-16T07:30:42.537 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 21/35 2024-09-16T07:30:42.903 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-16T07:30:42.951 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 23/35 2024-09-16T07:30:43.034 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 23/35 2024-09-16T07:30:43.064 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 24/35 2024-09-16T07:30:43.100 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-16T07:30:43.679 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-16T07:30:43.712 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 27/35 2024-09-16T07:30:43.792 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 27/35 2024-09-16T07:30:43.870 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 28/35 2024-09-16T07:30:43.898 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x8 29/35 2024-09-16T07:30:46.359 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-16T07:30:46.394 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-16T07:30:47.084 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-16T07:30:47.139 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 31/35 2024-09-16T07:30:47.230 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 31/35 2024-09-16T07:30:47.231 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-16T07:30:47.231 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-16T07:30:47.231 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:30:47.265 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-16T07:30:57.898 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-16T07:30:57.898 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /sys 2024-09-16T07:30:57.898 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /proc 2024-09-16T07:30:57.898 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /mnt 2024-09-16T07:30:57.898 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /var/tmp 2024-09-16T07:30:57.898 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /home 2024-09-16T07:30:57.898 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /root 2024-09-16T07:30:57.898 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /tmp 2024-09-16T07:30:57.898 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:30:58.965 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/35 2024-09-16T07:30:58.993 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/35 2024-09-16T07:30:58.993 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T07:30:58.993 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-16T07:30:58.993 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T07:30:58.993 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T07:30:58.993 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:30:58.995 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-16T07:30:59.076 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-16T07:30:59.076 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-16T07:31:00.416 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-16T07:31:00.416 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/35 2024-09-16T07:31:00.416 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-16T07:31:00.416 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/35 2024-09-16T07:31:00.416 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-16T07:31:00.416 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 5/35 2024-09-16T07:31:00.416 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 6/35 2024-09-16T07:31:00.416 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 7/35 2024-09-16T07:31:00.416 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9. 8/35 2024-09-16T07:31:00.416 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x8 9/35 2024-09-16T07:31:00.416 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 10/35 2024-09-16T07:31:00.417 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 11/35 2024-09-16T07:31:00.417 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 12/35 2024-09-16T07:31:00.417 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 13/35 2024-09-16T07:31:00.417 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-16T07:31:00.417 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-16T07:31:00.417 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-16T07:31:00.417 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-16T07:31:00.417 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-16T07:31:00.417 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-16T07:31:00.417 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-16T07:31:00.417 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-16T07:31:00.417 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-16T07:31:00.417 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-16T07:31:00.418 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 24/35 2024-09-16T07:31:00.418 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-16T07:31:00.418 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-16T07:31:00.418 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-16T07:31:00.418 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-16T07:31:00.418 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-16T07:31:00.419 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-16T07:31:00.419 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-16T07:31:00.419 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-16T07:31:00.419 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-16T07:31:00.419 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/35 2024-09-16T07:31:01.317 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-16T07:31:01.317 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:31:01.317 INFO:teuthology.orchestra.run.smithi115.stdout:Upgraded: 2024-09-16T07:31:01.317 INFO:teuthology.orchestra.run.smithi115.stdout: librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:31:01.317 INFO:teuthology.orchestra.run.smithi115.stdout: librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:31:01.317 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-09-16T07:31:01.317 INFO:teuthology.orchestra.run.smithi115.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-16T07:31:01.317 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:31:01.318 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:31:01.318 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:31:01.318 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:31:01.318 INFO:teuthology.orchestra.run.smithi115.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-16T07:31:01.318 INFO:teuthology.orchestra.run.smithi115.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-16T07:31:01.318 INFO:teuthology.orchestra.run.smithi115.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-16T07:31:01.318 INFO:teuthology.orchestra.run.smithi115.stdout: libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:31:01.318 INFO:teuthology.orchestra.run.smithi115.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-16T07:31:01.318 INFO:teuthology.orchestra.run.smithi115.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-16T07:31:01.318 INFO:teuthology.orchestra.run.smithi115.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-16T07:31:01.318 INFO:teuthology.orchestra.run.smithi115.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-16T07:31:01.318 INFO:teuthology.orchestra.run.smithi115.stdout: libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:31:01.318 INFO:teuthology.orchestra.run.smithi115.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-16T07:31:01.319 INFO:teuthology.orchestra.run.smithi115.stdout: librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:31:01.319 INFO:teuthology.orchestra.run.smithi115.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-16T07:31:01.319 INFO:teuthology.orchestra.run.smithi115.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-16T07:31:01.319 INFO:teuthology.orchestra.run.smithi115.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-16T07:31:01.319 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:31:01.319 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:31:01.319 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:31:01.319 INFO:teuthology.orchestra.run.smithi115.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-16T07:31:01.319 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:31:01.319 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:31:01.319 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:31:01.319 INFO:teuthology.orchestra.run.smithi115.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-16T07:31:01.319 INFO:teuthology.orchestra.run.smithi115.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-16T07:31:01.319 INFO:teuthology.orchestra.run.smithi115.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-16T07:31:01.320 INFO:teuthology.orchestra.run.smithi115.stdout: re2-1:20211101-20.el9.x86_64 2024-09-16T07:31:01.320 INFO:teuthology.orchestra.run.smithi115.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-16T07:31:01.320 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:31:01.320 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-16T07:31:01.731 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install ceph-test 2024-09-16T07:31:02.301 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:00:29 ago on Mon 16 Sep 2024 07:30:33 AM UTC. 2024-09-16T07:31:02.437 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-16T07:31:02.437 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-16T07:31:02.438 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repository Size 2024-09-16T07:31:02.438 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-16T07:31:02.438 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-09-16T07:31:02.438 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-test x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 85 M 2024-09-16T07:31:02.438 INFO:teuthology.orchestra.run.smithi115.stdout:Installing dependencies: 2024-09-16T07:31:02.438 INFO:teuthology.orchestra.run.smithi115.stdout: libasan8 x86_64 14.2.1-1.2.el9 appstream 513 k 2024-09-16T07:31:02.438 INFO:teuthology.orchestra.run.smithi115.stdout: libcephsqlite x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 175 k 2024-09-16T07:31:02.438 INFO:teuthology.orchestra.run.smithi115.stdout: libubsan x86_64 11.5.0-2.el9 appstream 183 k 2024-09-16T07:31:02.438 INFO:teuthology.orchestra.run.smithi115.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-16T07:31:02.438 INFO:teuthology.orchestra.run.smithi115.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-16T07:31:02.438 INFO:teuthology.orchestra.run.smithi115.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-16T07:31:02.438 INFO:teuthology.orchestra.run.smithi115.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-16T07:31:02.438 INFO:teuthology.orchestra.run.smithi115.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2024-09-16T07:31:02.438 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:31:02.439 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-09-16T07:31:02.439 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-16T07:31:02.439 INFO:teuthology.orchestra.run.smithi115.stdout:Install 9 Packages 2024-09-16T07:31:02.439 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:31:02.439 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 87 M 2024-09-16T07:31:02.439 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 797 M 2024-09-16T07:31:02.439 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-09-16T07:31:03.108 INFO:teuthology.orchestra.run.smithi115.stdout:(1/9): lksctp-tools-1.0.19-2.el9.x86_64.rpm 929 kB/s | 94 kB 00:00 2024-09-16T07:31:03.209 INFO:teuthology.orchestra.run.smithi115.stdout:(2/9): libasan8-14.2.1-1.2.el9.x86_64.rpm 5.0 MB/s | 513 kB 00:00 2024-09-16T07:31:03.301 INFO:teuthology.orchestra.run.smithi115.stdout:(3/9): libubsan-11.5.0-2.el9.x86_64.rpm 2.0 MB/s | 183 kB 00:00 2024-09-16T07:31:03.326 INFO:teuthology.orchestra.run.smithi115.stdout:(4/9): libcephsqlite-19.3.0-4879.g81fedcb3.el9. 549 kB/s | 175 kB 00:00 2024-09-16T07:31:03.468 INFO:teuthology.orchestra.run.smithi115.stdout:(5/9): socat-1.7.4.1-6.el9.x86_64.rpm 2.1 MB/s | 304 kB 00:00 2024-09-16T07:31:03.518 INFO:teuthology.orchestra.run.smithi115.stdout:(6/9): protobuf-3.14.0-13.el9.x86_64.rpm 4.6 MB/s | 1.0 MB 00:00 2024-09-16T07:31:03.543 INFO:teuthology.orchestra.run.smithi115.stdout:(7/9): xmlstarlet-1.6.1-20.el9.x86_64.rpm 849 kB/s | 64 kB 00:00 2024-09-16T07:31:03.602 INFO:teuthology.orchestra.run.smithi115.stdout:(8/9): yaml-cpp-0.6.3-5.el9.x86_64.rpm 1.4 MB/s | 122 kB 00:00 2024-09-16T07:31:06.610 INFO:teuthology.orchestra.run.smithi115.stdout:(9/9): ceph-test-19.3.0-4879.g81fedcb3.el9.x86_ 23 MB/s | 85 MB 00:03 2024-09-16T07:31:06.613 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:31:06.613 INFO:teuthology.orchestra.run.smithi115.stdout:Total 21 MB/s | 87 MB 00:04 2024-09-16T07:31:06.697 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-09-16T07:31:06.720 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-09-16T07:31:06.720 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-09-16T07:31:07.339 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-09-16T07:31:07.339 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-09-16T07:31:08.254 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-09-16T07:31:08.315 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/9 2024-09-16T07:31:08.371 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 2/9 2024-09-16T07:31:08.415 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 3/9 2024-09-16T07:31:08.450 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 4/9 2024-09-16T07:31:08.481 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-16T07:31:08.505 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-16T07:31:08.590 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-16T07:31:08.632 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 7/9 2024-09-16T07:31:08.657 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 8/9 2024-09-16T07:31:20.151 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 8/9 2024-09-16T07:31:20.238 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 9/9 2024-09-16T07:31:26.391 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 9/9 2024-09-16T07:31:26.392 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/9 2024-09-16T07:31:26.392 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/9 2024-09-16T07:31:26.392 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 3/9 2024-09-16T07:31:26.392 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libasan8-14.2.1-1.2.el9.x86_64 4/9 2024-09-16T07:31:26.392 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-16T07:31:26.392 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 6/9 2024-09-16T07:31:26.392 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 7/9 2024-09-16T07:31:26.392 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 8/9 2024-09-16T07:31:26.825 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 9/9 2024-09-16T07:31:26.825 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:31:26.825 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-09-16T07:31:26.825 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:31:26.825 INFO:teuthology.orchestra.run.smithi115.stdout: libasan8-14.2.1-1.2.el9.x86_64 2024-09-16T07:31:26.825 INFO:teuthology.orchestra.run.smithi115.stdout: libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:31:26.825 INFO:teuthology.orchestra.run.smithi115.stdout: libubsan-11.5.0-2.el9.x86_64 2024-09-16T07:31:26.825 INFO:teuthology.orchestra.run.smithi115.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-16T07:31:26.825 INFO:teuthology.orchestra.run.smithi115.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-16T07:31:26.825 INFO:teuthology.orchestra.run.smithi115.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-16T07:31:26.826 INFO:teuthology.orchestra.run.smithi115.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-16T07:31:26.826 INFO:teuthology.orchestra.run.smithi115.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2024-09-16T07:31:26.826 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:31:26.826 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-16T07:31:27.214 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install ceph 2024-09-16T07:31:27.780 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:00:54 ago on Mon 16 Sep 2024 07:30:33 AM UTC. 2024-09-16T07:31:27.919 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-16T07:31:27.921 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-16T07:31:27.921 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repository Size 2024-09-16T07:31:27.921 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-16T07:31:27.921 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-09-16T07:31:27.921 INFO:teuthology.orchestra.run.smithi115.stdout: ceph x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 6.5 k 2024-09-16T07:31:27.921 INFO:teuthology.orchestra.run.smithi115.stdout:Installing dependencies: 2024-09-16T07:31:27.922 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mds x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 2.2 M 2024-09-16T07:31:27.922 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 1.6 M 2024-09-16T07:31:27.922 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 291 k 2024-09-16T07:31:27.922 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mon x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 5.1 M 2024-09-16T07:31:27.922 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-osd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 70 M 2024-09-16T07:31:27.922 INFO:teuthology.orchestra.run.smithi115.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-16T07:31:27.922 INFO:teuthology.orchestra.run.smithi115.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-16T07:31:27.922 INFO:teuthology.orchestra.run.smithi115.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-16T07:31:27.922 INFO:teuthology.orchestra.run.smithi115.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-16T07:31:27.922 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-16T07:31:27.922 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-16T07:31:27.922 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-16T07:31:27.922 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-16T07:31:27.922 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-16T07:31:27.923 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-16T07:31:27.923 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-collections 2024-09-16T07:31:27.923 INFO:teuthology.orchestra.run.smithi115.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-16T07:31:27.923 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-16T07:31:27.923 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-16T07:31:27.923 INFO:teuthology.orchestra.run.smithi115.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-16T07:31:27.923 INFO:teuthology.orchestra.run.smithi115.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-16T07:31:27.923 INFO:teuthology.orchestra.run.smithi115.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-16T07:31:27.923 INFO:teuthology.orchestra.run.smithi115.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-16T07:31:27.923 INFO:teuthology.orchestra.run.smithi115.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-16T07:31:27.923 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-16T07:31:27.923 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-16T07:31:27.923 INFO:teuthology.orchestra.run.smithi115.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-16T07:31:27.924 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-16T07:31:27.924 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-16T07:31:27.924 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-16T07:31:27.924 INFO:teuthology.orchestra.run.smithi115.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-16T07:31:27.924 INFO:teuthology.orchestra.run.smithi115.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-16T07:31:27.924 INFO:teuthology.orchestra.run.smithi115.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-16T07:31:27.924 INFO:teuthology.orchestra.run.smithi115.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-16T07:31:27.924 INFO:teuthology.orchestra.run.smithi115.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-16T07:31:27.924 INFO:teuthology.orchestra.run.smithi115.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-16T07:31:27.924 INFO:teuthology.orchestra.run.smithi115.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-16T07:31:27.924 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:31:27.924 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-09-16T07:31:27.924 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-16T07:31:27.924 INFO:teuthology.orchestra.run.smithi115.stdout:Install 37 Packages 2024-09-16T07:31:27.924 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:31:27.925 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 84 M 2024-09-16T07:31:27.925 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 897 M 2024-09-16T07:31:27.925 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-09-16T07:31:28.876 INFO:teuthology.orchestra.run.smithi115.stdout:(1/37): ceph-19.3.0-4879.g81fedcb3.el9.x86_64.r 24 kB/s | 6.5 kB 00:00 2024-09-16T07:31:28.934 INFO:teuthology.orchestra.run.smithi115.stdout:(2/37): ceph-mds-19.3.0-4879.g81fedcb3.el9.x86_ 6.6 MB/s | 2.2 MB 00:00 2024-09-16T07:31:28.993 INFO:teuthology.orchestra.run.smithi115.stdout:(3/37): ceph-mgr-19.3.0-4879.g81fedcb3.el9.x86_ 4.1 MB/s | 1.6 MB 00:00 2024-09-16T07:31:31.768 INFO:teuthology.orchestra.run.smithi115.stdout:(4/37): ceph-osd-19.3.0-4879.g81fedcb3.el9.x86_ 25 MB/s | 70 MB 00:02 2024-09-16T07:31:31.793 INFO:teuthology.orchestra.run.smithi115.stdout:(5/37): ceph-mgr-modules-core-19.3.0-4879.g81fe 104 kB/s | 291 kB 00:02 2024-09-16T07:31:31.894 INFO:teuthology.orchestra.run.smithi115.stdout:(6/37): ceph-mon-19.3.0-4879.g81fedcb3.el9.x86_ 1.7 MB/s | 5.1 MB 00:03 2024-09-16T07:31:32.002 INFO:teuthology.orchestra.run.smithi115.stdout:(7/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.1 MB/s | 253 kB 00:00 2024-09-16T07:31:32.052 INFO:teuthology.orchestra.run.smithi115.stdout:(8/37): python3-pycparser-2.20-6.el9.noarch.rpm 2.6 MB/s | 135 kB 00:00 2024-09-16T07:31:32.078 INFO:teuthology.orchestra.run.smithi115.stdout:(9/37): python3-ply-3.11-14.el9.noarch.rpm 580 kB/s | 106 kB 00:00 2024-09-16T07:31:32.103 INFO:teuthology.orchestra.run.smithi115.stdout:(10/37): python3-requests-2.25.1-8.el9.noarch.r 2.4 MB/s | 125 kB 00:00 2024-09-16T07:31:32.161 INFO:teuthology.orchestra.run.smithi115.stdout:(11/37): python3-urllib3-1.26.5-6.el9.noarch.rp 2.5 MB/s | 215 kB 00:00 2024-09-16T07:31:32.195 INFO:teuthology.orchestra.run.smithi115.stdout:(12/37): python3-cryptography-36.0.1-4.el9.x86_ 3.1 MB/s | 1.2 MB 00:00 2024-09-16T07:31:32.221 INFO:teuthology.orchestra.run.smithi115.stdout:(13/37): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-09-16T07:31:32.262 INFO:teuthology.orchestra.run.smithi115.stdout:(14/37): python3-packaging-20.9-5.el9.noarch.rp 1.8 MB/s | 77 kB 00:00 2024-09-16T07:31:32.288 INFO:teuthology.orchestra.run.smithi115.stdout:(15/37): python3-markupsafe-1.1.1-12.el9.x86_64 377 kB/s | 35 kB 00:00 2024-09-16T07:31:32.313 INFO:teuthology.orchestra.run.smithi115.stdout:(16/37): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-16T07:31:32.338 INFO:teuthology.orchestra.run.smithi115.stdout:(17/37): python3-mako-1.1.4-6.el9.noarch.rpm 976 kB/s | 172 kB 00:00 2024-09-16T07:31:32.363 INFO:teuthology.orchestra.run.smithi115.stdout:(18/37): python3-toml-0.10.2-6.el9.noarch.rpm 553 kB/s | 42 kB 00:00 2024-09-16T07:31:32.414 INFO:teuthology.orchestra.run.smithi115.stdout:(19/37): luarocks-3.9.2-5.el9.noarch.rpm 2.0 MB/s | 151 kB 00:00 2024-09-16T07:31:32.439 INFO:teuthology.orchestra.run.smithi115.stdout:(20/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 575 kB/s | 43 kB 00:00 2024-09-16T07:31:32.465 INFO:teuthology.orchestra.run.smithi115.stdout:(21/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 3.5 MB/s | 172 kB 00:00 2024-09-16T07:31:32.490 INFO:teuthology.orchestra.run.smithi115.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 428 kB/s | 11 kB 00:00 2024-09-16T07:31:32.515 INFO:teuthology.orchestra.run.smithi115.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 709 kB/s | 18 kB 00:00 2024-09-16T07:31:32.540 INFO:teuthology.orchestra.run.smithi115.stdout:(24/37): python3-cherrypy-18.6.1-2.el9.noarch.r 3.5 MB/s | 358 kB 00:00 2024-09-16T07:31:32.566 INFO:teuthology.orchestra.run.smithi115.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 461 kB/s | 23 kB 00:00 2024-09-16T07:31:32.591 INFO:teuthology.orchestra.run.smithi115.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 387 kB/s | 19 kB 00:00 2024-09-16T07:31:32.616 INFO:teuthology.orchestra.run.smithi115.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 392 kB/s | 20 kB 00:00 2024-09-16T07:31:32.650 INFO:teuthology.orchestra.run.smithi115.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 790 kB/s | 46 kB 00:00 2024-09-16T07:31:32.675 INFO:teuthology.orchestra.run.smithi115.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-16T07:31:32.700 INFO:teuthology.orchestra.run.smithi115.stdout:(30/37): python3-portend-3.1.0-2.el9.noarch.rpm 663 kB/s | 16 kB 00:00 2024-09-16T07:31:32.734 INFO:teuthology.orchestra.run.smithi115.stdout:(31/37): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-09-16T07:31:32.759 INFO:teuthology.orchestra.run.smithi115.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.5 MB/s | 90 kB 00:00 2024-09-16T07:31:32.801 INFO:teuthology.orchestra.run.smithi115.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 534 kB/s | 36 kB 00:00 2024-09-16T07:31:32.835 INFO:teuthology.orchestra.run.smithi115.stdout:(34/37): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-16T07:31:32.860 INFO:teuthology.orchestra.run.smithi115.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 806 kB/s | 20 kB 00:00 2024-09-16T07:31:32.886 INFO:teuthology.orchestra.run.smithi115.stdout:(36/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 5.0 MB/s | 427 kB 00:00 2024-09-16T07:31:32.969 INFO:teuthology.orchestra.run.smithi115.stdout:(37/37): lua-devel-5.4.4-4.el9.x86_64.rpm 34 kB/s | 22 kB 00:00 2024-09-16T07:31:32.974 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:31:32.974 INFO:teuthology.orchestra.run.smithi115.stdout:Total 17 MB/s | 84 MB 00:05 2024-09-16T07:31:33.128 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-09-16T07:31:33.168 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-09-16T07:31:33.168 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-09-16T07:31:33.933 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-09-16T07:31:33.933 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-09-16T07:31:35.583 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-09-16T07:31:35.655 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-16T07:31:35.695 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-16T07:31:35.732 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-16T07:31:35.804 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-16T07:31:35.848 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-16T07:31:35.883 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-16T07:31:35.975 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-16T07:31:36.061 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-16T07:31:36.110 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-16T07:31:36.146 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-16T07:31:36.175 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-16T07:31:36.210 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-16T07:31:36.243 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-16T07:31:36.284 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-16T07:31:36.335 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-16T07:31:36.399 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-16T07:31:36.453 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-16T07:31:36.484 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-16T07:31:36.556 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-16T07:31:36.694 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-16T07:31:36.768 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-16T07:31:36.945 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-16T07:31:36.984 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-16T07:31:37.049 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-16T07:31:37.105 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-16T07:31:37.292 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-16T07:31:37.346 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-16T07:31:37.433 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-16T07:31:37.529 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-16T07:31:37.577 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-16T07:31:37.707 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-16T07:31:37.899 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9. 32/37 2024-09-16T07:31:37.923 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/37 2024-09-16T07:31:37.949 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/37 2024-09-16T07:31:37.949 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T07:31:37.949 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-16T07:31:37.949 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T07:31:37.949 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T07:31:37.949 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:31:48.547 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/37 2024-09-16T07:31:48.575 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/37 2024-09-16T07:31:48.575 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T07:31:48.575 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-16T07:31:48.575 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T07:31:48.576 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T07:31:48.576 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:31:49.131 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 35/37 2024-09-16T07:31:49.156 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 35/37 2024-09-16T07:31:49.156 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T07:31:49.156 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-16T07:31:49.156 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T07:31:49.156 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T07:31:49.157 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:31:49.408 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 36/37 2024-09-16T07:31:49.435 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 36/37 2024-09-16T07:31:49.435 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T07:31:49.435 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-16T07:31:49.435 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T07:31:49.435 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T07:31:49.435 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:31:49.498 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 37/37 2024-09-16T07:31:56.146 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 37/37 2024-09-16T07:31:56.146 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/37 2024-09-16T07:31:56.147 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/37 2024-09-16T07:31:56.147 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/37 2024-09-16T07:31:56.147 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/37 2024-09-16T07:31:56.147 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 5/37 2024-09-16T07:31:56.147 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9. 6/37 2024-09-16T07:31:56.147 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-16T07:31:56.147 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-16T07:31:56.147 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-16T07:31:56.147 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-16T07:31:56.147 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-16T07:31:56.148 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-16T07:31:56.148 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-16T07:31:56.148 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-16T07:31:56.148 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-16T07:31:56.148 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-16T07:31:56.148 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-16T07:31:56.148 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-16T07:31:56.148 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-16T07:31:56.148 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-16T07:31:56.148 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-16T07:31:56.148 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-16T07:31:56.148 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-16T07:31:56.148 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-16T07:31:56.149 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-16T07:31:56.150 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-16T07:31:56.150 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-16T07:31:56.150 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-16T07:31:56.150 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-16T07:31:56.150 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-16T07:31:56.150 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-16T07:31:56.151 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-16T07:31:56.151 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-16T07:31:56.151 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-16T07:31:56.151 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-16T07:31:56.151 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-16T07:31:56.977 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-16T07:31:56.977 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:31:56.977 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-09-16T07:31:56.977 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:31:56.977 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:31:56.977 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:31:56.978 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:31:56.978 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:31:56.978 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:31:56.978 INFO:teuthology.orchestra.run.smithi115.stdout: lua-5.4.4-4.el9.x86_64 2024-09-16T07:31:56.978 INFO:teuthology.orchestra.run.smithi115.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-16T07:31:56.978 INFO:teuthology.orchestra.run.smithi115.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-16T07:31:56.978 INFO:teuthology.orchestra.run.smithi115.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-16T07:31:56.978 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-16T07:31:56.978 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-16T07:31:56.978 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-16T07:31:56.978 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-16T07:31:56.979 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-16T07:31:56.979 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-16T07:31:56.979 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-16T07:31:56.979 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-16T07:31:56.979 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-16T07:31:56.979 INFO:teuthology.orchestra.run.smithi115.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-16T07:31:56.979 INFO:teuthology.orchestra.run.smithi115.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-16T07:31:56.979 INFO:teuthology.orchestra.run.smithi115.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-16T07:31:56.979 INFO:teuthology.orchestra.run.smithi115.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-16T07:31:56.979 INFO:teuthology.orchestra.run.smithi115.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-16T07:31:56.979 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-16T07:31:56.979 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ply-3.11-14.el9.noarch 2024-09-16T07:31:56.979 INFO:teuthology.orchestra.run.smithi115.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-16T07:31:56.980 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-16T07:31:56.980 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-16T07:31:56.980 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-16T07:31:56.980 INFO:teuthology.orchestra.run.smithi115.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-16T07:31:56.980 INFO:teuthology.orchestra.run.smithi115.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-16T07:31:56.980 INFO:teuthology.orchestra.run.smithi115.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-16T07:31:56.980 INFO:teuthology.orchestra.run.smithi115.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-16T07:31:56.980 INFO:teuthology.orchestra.run.smithi115.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-16T07:31:56.980 INFO:teuthology.orchestra.run.smithi115.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-16T07:31:56.981 INFO:teuthology.orchestra.run.smithi115.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-16T07:31:56.981 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:31:56.981 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-16T07:31:57.293 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install ceph-base 2024-09-16T07:31:57.853 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:01:24 ago on Mon 16 Sep 2024 07:30:33 AM UTC. 2024-09-16T07:31:57.942 INFO:teuthology.orchestra.run.smithi115.stdout:Package ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:31:57.985 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-16T07:31:57.986 INFO:teuthology.orchestra.run.smithi115.stdout:Nothing to do. 2024-09-16T07:31:57.986 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-16T07:31:58.083 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install cephadm 2024-09-16T07:31:58.644 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:01:25 ago on Mon 16 Sep 2024 07:30:33 AM UTC. 2024-09-16T07:31:58.777 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-16T07:31:58.778 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-16T07:31:58.778 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repository Size 2024-09-16T07:31:58.778 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-16T07:31:58.778 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-09-16T07:31:58.778 INFO:teuthology.orchestra.run.smithi115.stdout: cephadm noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 785 k 2024-09-16T07:31:58.778 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:31:58.778 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-09-16T07:31:58.778 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-16T07:31:58.778 INFO:teuthology.orchestra.run.smithi115.stdout:Install 1 Package 2024-09-16T07:31:58.778 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:31:58.778 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 785 k 2024-09-16T07:31:58.778 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 791 k 2024-09-16T07:31:58.779 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-09-16T07:31:59.040 INFO:teuthology.orchestra.run.smithi115.stdout:cephadm-19.3.0-4879.g81fedcb3.el9.noarch.rpm 2.9 MB/s | 785 kB 00:00 2024-09-16T07:31:59.040 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:31:59.041 INFO:teuthology.orchestra.run.smithi115.stdout:Total 2.9 MB/s | 785 kB 00:00 2024-09-16T07:31:59.041 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-09-16T07:31:59.046 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-09-16T07:31:59.046 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-09-16T07:31:59.052 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-09-16T07:31:59.052 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-09-16T07:31:59.126 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-09-16T07:31:59.593 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T07:31:59.703 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T07:32:00.071 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T07:32:00.314 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T07:32:00.314 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:32:00.314 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-09-16T07:32:00.314 INFO:teuthology.orchestra.run.smithi115.stdout: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:32:00.315 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:32:00.315 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-16T07:32:00.565 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install ceph-immutable-object-cache 2024-09-16T07:32:01.143 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:01:28 ago on Mon 16 Sep 2024 07:30:33 AM UTC. 2024-09-16T07:32:01.277 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-16T07:32:01.278 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-16T07:32:01.278 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repo Size 2024-09-16T07:32:01.279 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-16T07:32:01.279 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-09-16T07:32:01.279 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 158 k 2024-09-16T07:32:01.279 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:32:01.279 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-09-16T07:32:01.279 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-16T07:32:01.279 INFO:teuthology.orchestra.run.smithi115.stdout:Install 1 Package 2024-09-16T07:32:01.279 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:32:01.279 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 158 k 2024-09-16T07:32:01.279 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 644 k 2024-09-16T07:32:01.279 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-09-16T07:32:01.536 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-immutable-object-cache-19.3.0-4879.g81fedc 617 kB/s | 158 kB 00:00 2024-09-16T07:32:01.536 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:32:01.536 INFO:teuthology.orchestra.run.smithi115.stdout:Total 612 kB/s | 158 kB 00:00 2024-09-16T07:32:01.537 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-09-16T07:32:01.546 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-09-16T07:32:01.546 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-09-16T07:32:01.603 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-09-16T07:32:01.603 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-09-16T07:32:01.747 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-09-16T07:32:01.823 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-16T07:32:01.848 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-16T07:32:01.848 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T07:32:01.848 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-16T07:32:01.848 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:32:02.814 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-16T07:32:02.815 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:32:02.815 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-09-16T07:32:02.815 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:32:02.815 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:32:02.815 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-16T07:32:03.050 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install ceph-mgr 2024-09-16T07:32:03.623 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:01:30 ago on Mon 16 Sep 2024 07:30:33 AM UTC. 2024-09-16T07:32:03.716 INFO:teuthology.orchestra.run.smithi115.stdout:Package ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:32:03.760 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-16T07:32:03.761 INFO:teuthology.orchestra.run.smithi115.stdout:Nothing to do. 2024-09-16T07:32:03.761 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-16T07:32:03.841 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install ceph-mgr-dashboard 2024-09-16T07:32:04.398 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:01:31 ago on Mon 16 Sep 2024 07:30:33 AM UTC. 2024-09-16T07:32:04.531 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-16T07:32:04.531 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-16T07:32:04.532 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repository Size 2024-09-16T07:32:04.532 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-16T07:32:04.532 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-09-16T07:32:04.532 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 14 M 2024-09-16T07:32:04.532 INFO:teuthology.orchestra.run.smithi115.stdout:Installing dependencies: 2024-09-16T07:32:04.532 INFO:teuthology.orchestra.run.smithi115.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-16T07:32:04.532 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 34 k 2024-09-16T07:32:04.532 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 16 k 2024-09-16T07:32:04.532 INFO:teuthology.orchestra.run.smithi115.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-16T07:32:04.532 INFO:teuthology.orchestra.run.smithi115.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-16T07:32:04.532 INFO:teuthology.orchestra.run.smithi115.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-16T07:32:04.532 INFO:teuthology.orchestra.run.smithi115.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-16T07:32:04.533 INFO:teuthology.orchestra.run.smithi115.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-16T07:32:04.533 INFO:teuthology.orchestra.run.smithi115.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-16T07:32:04.533 INFO:teuthology.orchestra.run.smithi115.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-16T07:32:04.533 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:32:04.533 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-09-16T07:32:04.533 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-16T07:32:04.533 INFO:teuthology.orchestra.run.smithi115.stdout:Install 11 Packages 2024-09-16T07:32:04.533 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:32:04.534 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 18 M 2024-09-16T07:32:04.534 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 155 M 2024-09-16T07:32:04.534 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-09-16T07:32:04.984 INFO:teuthology.orchestra.run.smithi115.stdout:(1/11): ceph-grafana-dashboards-19.3.0-4879.g81 241 kB/s | 34 kB 00:00 2024-09-16T07:32:05.009 INFO:teuthology.orchestra.run.smithi115.stdout:(2/11): ceph-prometheus-alerts-19.3.0-4879.g81f 98 kB/s | 16 kB 00:00 2024-09-16T07:32:05.185 INFO:teuthology.orchestra.run.smithi115.stdout:(3/11): protobuf-compiler-3.14.0-13.el9.x86_64. 4.8 MB/s | 863 kB 00:00 2024-09-16T07:32:05.235 INFO:teuthology.orchestra.run.smithi115.stdout:(4/11): abseil-cpp-20211102.0-3.el9.x86_64.rpm 11 MB/s | 548 kB 00:00 2024-09-16T07:32:05.260 INFO:teuthology.orchestra.run.smithi115.stdout:(5/11): python3-protobuf-3.14.0-13.el9.noarch.r 976 kB/s | 269 kB 00:00 2024-09-16T07:32:05.277 INFO:teuthology.orchestra.run.smithi115.stdout:(6/11): grpc-data-1.46.7-10.el9.noarch.rpm 462 kB/s | 19 kB 00:00 2024-09-16T07:32:05.319 INFO:teuthology.orchestra.run.smithi115.stdout:(7/11): python3-grpcio-tools-1.46.7-10.el9.x86_ 4.1 MB/s | 144 kB 00:00 2024-09-16T07:32:05.336 INFO:teuthology.orchestra.run.smithi115.stdout:(8/11): python3-repoze-lru-0.7-16.el9.noarch.rp 2.0 MB/s | 31 kB 00:00 2024-09-16T07:32:05.362 INFO:teuthology.orchestra.run.smithi115.stdout:(9/11): python3-routes-2.5.1-5.el9.noarch.rpm 7.4 MB/s | 188 kB 00:00 2024-09-16T07:32:05.420 INFO:teuthology.orchestra.run.smithi115.stdout:(10/11): python3-grpcio-1.46.7-10.el9.x86_64.rp 13 MB/s | 2.0 MB 00:00 2024-09-16T07:32:05.670 INFO:teuthology.orchestra.run.smithi115.stdout:(11/11): ceph-mgr-dashboard-19.3.0-4879.g81fedc 17 MB/s | 14 MB 00:00 2024-09-16T07:32:05.674 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:32:05.675 INFO:teuthology.orchestra.run.smithi115.stdout:Total 16 MB/s | 18 MB 00:01 2024-09-16T07:32:05.705 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-09-16T07:32:05.724 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-09-16T07:32:05.724 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-09-16T07:32:05.983 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-09-16T07:32:05.983 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-09-16T07:32:06.536 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-09-16T07:32:06.635 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/11 2024-09-16T07:32:06.674 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/11 2024-09-16T07:32:06.764 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 3/11 2024-09-16T07:32:06.892 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 4/11 2024-09-16T07:32:06.943 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 5/11 2024-09-16T07:32:07.029 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 6/11 2024-09-16T07:32:07.088 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 7/11 2024-09-16T07:32:07.116 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 8/11 2024-09-16T07:32:07.148 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9 9/11 2024-09-16T07:32:10.322 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el 10/11 2024-09-16T07:32:10.377 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 11/11 2024-09-16T07:32:12.091 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 11/11 2024-09-16T07:32:12.092 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el 1/11 2024-09-16T07:32:12.092 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 2/11 2024-09-16T07:32:12.092 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9 3/11 2024-09-16T07:32:12.092 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 4/11 2024-09-16T07:32:12.092 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 5/11 2024-09-16T07:32:12.092 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 6/11 2024-09-16T07:32:12.092 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 7/11 2024-09-16T07:32:12.092 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 8/11 2024-09-16T07:32:12.092 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/11 2024-09-16T07:32:12.092 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 10/11 2024-09-16T07:32:12.396 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 11/11 2024-09-16T07:32:12.396 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:32:12.396 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-09-16T07:32:12.396 INFO:teuthology.orchestra.run.smithi115.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-16T07:32:12.396 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:32:12.396 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:32:12.396 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:32:12.396 INFO:teuthology.orchestra.run.smithi115.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-16T07:32:12.396 INFO:teuthology.orchestra.run.smithi115.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-16T07:32:12.396 INFO:teuthology.orchestra.run.smithi115.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-16T07:32:12.396 INFO:teuthology.orchestra.run.smithi115.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-16T07:32:12.397 INFO:teuthology.orchestra.run.smithi115.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-16T07:32:12.397 INFO:teuthology.orchestra.run.smithi115.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-16T07:32:12.397 INFO:teuthology.orchestra.run.smithi115.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-16T07:32:12.397 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:32:12.397 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-16T07:32:12.690 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-16T07:32:13.253 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:01:40 ago on Mon 16 Sep 2024 07:30:33 AM UTC. 2024-09-16T07:32:13.388 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-16T07:32:13.389 INFO:teuthology.orchestra.run.smithi115.stdout:======================================================================================= 2024-09-16T07:32:13.389 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repository Size 2024-09-16T07:32:13.390 INFO:teuthology.orchestra.run.smithi115.stdout:======================================================================================= 2024-09-16T07:32:13.390 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-09-16T07:32:13.390 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 7.4 M 2024-09-16T07:32:13.390 INFO:teuthology.orchestra.run.smithi115.stdout:Installing dependencies: 2024-09-16T07:32:13.390 INFO:teuthology.orchestra.run.smithi115.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-16T07:32:13.390 INFO:teuthology.orchestra.run.smithi115.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-16T07:32:13.390 INFO:teuthology.orchestra.run.smithi115.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-16T07:32:13.390 INFO:teuthology.orchestra.run.smithi115.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-16T07:32:13.390 INFO:teuthology.orchestra.run.smithi115.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-16T07:32:13.390 INFO:teuthology.orchestra.run.smithi115.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-16T07:32:13.390 INFO:teuthology.orchestra.run.smithi115.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-16T07:32:13.390 INFO:teuthology.orchestra.run.smithi115.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-16T07:32:13.390 INFO:teuthology.orchestra.run.smithi115.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-16T07:32:13.391 INFO:teuthology.orchestra.run.smithi115.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-16T07:32:13.391 INFO:teuthology.orchestra.run.smithi115.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-16T07:32:13.391 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:32:13.391 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-09-16T07:32:13.391 INFO:teuthology.orchestra.run.smithi115.stdout:======================================================================================= 2024-09-16T07:32:13.391 INFO:teuthology.orchestra.run.smithi115.stdout:Install 12 Packages 2024-09-16T07:32:13.391 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:32:13.392 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 38 M 2024-09-16T07:32:13.392 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 212 M 2024-09-16T07:32:13.392 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-09-16T07:32:13.909 INFO:teuthology.orchestra.run.smithi115.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.3 MB/s | 191 kB 00:00 2024-09-16T07:32:13.951 INFO:teuthology.orchestra.run.smithi115.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 4.2 MB/s | 801 kB 00:00 2024-09-16T07:32:14.268 INFO:teuthology.orchestra.run.smithi115.stdout:(3/12): ceph-mgr-diskprediction-local-19.3.0-48 15 MB/s | 7.4 MB 00:00 2024-09-16T07:32:14.518 INFO:teuthology.orchestra.run.smithi115.stdout:(4/12): flexiblas-3.0.4-8.el9.x86_64.rpm 54 kB/s | 33 kB 00:00 2024-09-16T07:32:14.744 INFO:teuthology.orchestra.run.smithi115.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 38 kB/s | 18 kB 00:00 2024-09-16T07:32:15.027 INFO:teuthology.orchestra.run.smithi115.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 2.8 MB/s | 3.0 MB 00:01 2024-09-16T07:32:15.086 INFO:teuthology.orchestra.run.smithi115.stdout:(7/12): openblas-0.3.26-2.el9.x86_64.rpm 68 kB/s | 38 kB 00:00 2024-09-16T07:32:15.794 INFO:teuthology.orchestra.run.smithi115.stdout:(8/12): python3-devel-3.9.19-8.el9.x86_64.rpm 322 kB/s | 245 kB 00:00 2024-09-16T07:32:15.953 INFO:teuthology.orchestra.run.smithi115.stdout:(9/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 4.1 MB/s | 4.9 MB 00:01 2024-09-16T07:32:16.212 INFO:teuthology.orchestra.run.smithi115.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.5 MB/s | 5.1 MB 00:01 2024-09-16T07:32:16.603 INFO:teuthology.orchestra.run.smithi115.stdout:(11/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 310 kB/s | 250 kB 00:00 2024-09-16T07:32:17.412 INFO:teuthology.orchestra.run.smithi115.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-09-16T07:32:17.413 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:32:17.414 INFO:teuthology.orchestra.run.smithi115.stdout:Total 9.5 MB/s | 38 MB 00:04 2024-09-16T07:32:17.777 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-09-16T07:32:17.804 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-09-16T07:32:17.804 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-09-16T07:32:18.251 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-09-16T07:32:18.251 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-09-16T07:32:19.010 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-09-16T07:32:19.084 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-16T07:32:19.126 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-16T07:32:19.228 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-16T07:32:19.261 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-16T07:32:19.446 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-16T07:32:19.476 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-16T07:32:19.559 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-16T07:32:20.216 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-16T07:32:20.323 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-16T07:32:21.547 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-16T07:32:22.580 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-16T07:32:22.609 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 12/12 2024-09-16T07:32:25.181 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 12/12 2024-09-16T07:32:25.181 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 1/12 2024-09-16T07:32:25.182 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-16T07:32:25.182 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-16T07:32:25.182 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-16T07:32:25.182 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-16T07:32:25.182 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-16T07:32:25.182 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-16T07:32:25.182 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-16T07:32:25.182 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-16T07:32:25.182 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-16T07:32:25.182 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-16T07:32:25.583 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-16T07:32:25.583 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:32:25.583 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-09-16T07:32:25.583 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:32:25.583 INFO:teuthology.orchestra.run.smithi115.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-16T07:32:25.583 INFO:teuthology.orchestra.run.smithi115.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-16T07:32:25.584 INFO:teuthology.orchestra.run.smithi115.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-16T07:32:25.584 INFO:teuthology.orchestra.run.smithi115.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-16T07:32:25.584 INFO:teuthology.orchestra.run.smithi115.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-16T07:32:25.584 INFO:teuthology.orchestra.run.smithi115.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-16T07:32:25.584 INFO:teuthology.orchestra.run.smithi115.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-16T07:32:25.584 INFO:teuthology.orchestra.run.smithi115.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-16T07:32:25.584 INFO:teuthology.orchestra.run.smithi115.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-16T07:32:25.584 INFO:teuthology.orchestra.run.smithi115.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-16T07:32:25.584 INFO:teuthology.orchestra.run.smithi115.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-16T07:32:25.584 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:32:25.584 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-16T07:32:25.973 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install ceph-mgr-rook 2024-09-16T07:32:26.548 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:01:53 ago on Mon 16 Sep 2024 07:30:33 AM UTC. 2024-09-16T07:32:26.680 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-16T07:32:26.681 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-16T07:32:26.681 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repository Size 2024-09-16T07:32:26.681 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-16T07:32:26.681 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-09-16T07:32:26.681 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-rook noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 49 k 2024-09-16T07:32:26.681 INFO:teuthology.orchestra.run.smithi115.stdout:Installing dependencies: 2024-09-16T07:32:26.681 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-16T07:32:26.681 INFO:teuthology.orchestra.run.smithi115.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-16T07:32:26.682 INFO:teuthology.orchestra.run.smithi115.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-16T07:32:26.682 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-16T07:32:26.682 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-16T07:32:26.682 INFO:teuthology.orchestra.run.smithi115.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-16T07:32:26.682 INFO:teuthology.orchestra.run.smithi115.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-16T07:32:26.682 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-16T07:32:26.682 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-16T07:32:26.682 INFO:teuthology.orchestra.run.smithi115.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-16T07:32:26.682 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-16T07:32:26.682 INFO:teuthology.orchestra.run.smithi115.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-16T07:32:26.682 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:32:26.682 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-09-16T07:32:26.683 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-16T07:32:26.683 INFO:teuthology.orchestra.run.smithi115.stdout:Install 13 Packages 2024-09-16T07:32:26.683 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:32:26.683 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 2.2 M 2024-09-16T07:32:26.683 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 26 M 2024-09-16T07:32:26.683 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-09-16T07:32:26.844 INFO:teuthology.orchestra.run.smithi115.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 312 kB/s | 26 kB 00:00 2024-09-16T07:32:26.868 INFO:teuthology.orchestra.run.smithi115.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 179 kB/s | 19 kB 00:00 2024-09-16T07:32:26.952 INFO:teuthology.orchestra.run.smithi115.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.8 MB/s | 222 kB 00:00 2024-09-16T07:32:26.977 INFO:teuthology.orchestra.run.smithi115.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.5 MB/s | 159 kB 00:00 2024-09-16T07:32:27.011 INFO:teuthology.orchestra.run.smithi115.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 4.7 MB/s | 279 kB 00:00 2024-09-16T07:32:27.037 INFO:teuthology.orchestra.run.smithi115.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 913 kB/s | 54 kB 00:00 2024-09-16T07:32:27.078 INFO:teuthology.orchestra.run.smithi115.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 480 kB/s | 32 kB 00:00 2024-09-16T07:32:27.104 INFO:teuthology.orchestra.run.smithi115.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 211 kB/s | 14 kB 00:00 2024-09-16T07:32:27.120 INFO:teuthology.orchestra.run.smithi115.stdout:(9/13): python3-google-auth-2.34.0-1.el9.noarch 5.3 MB/s | 220 kB 00:00 2024-09-16T07:32:27.146 INFO:teuthology.orchestra.run.smithi115.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-16T07:32:27.163 INFO:teuthology.orchestra.run.smithi115.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 5.3 MB/s | 90 kB 00:00 2024-09-16T07:32:27.196 INFO:teuthology.orchestra.run.smithi115.stdout:(12/13): python3-kubernetes-26.1.0-2.el9.noarch 11 MB/s | 1.0 MB 00:00 2024-09-16T07:32:27.296 INFO:teuthology.orchestra.run.smithi115.stdout:(13/13): ceph-mgr-rook-19.3.0-4879.g81fedcb3.el 92 kB/s | 49 kB 00:00 2024-09-16T07:32:27.299 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:32:27.299 INFO:teuthology.orchestra.run.smithi115.stdout:Total 3.6 MB/s | 2.2 MB 00:00 2024-09-16T07:32:27.363 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-09-16T07:32:27.379 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-09-16T07:32:27.379 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-09-16T07:32:27.467 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-09-16T07:32:27.468 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-09-16T07:32:27.978 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-09-16T07:32:28.153 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-16T07:32:28.205 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-16T07:32:28.261 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-16T07:32:28.298 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-16T07:32:28.340 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-16T07:32:28.441 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-16T07:32:28.552 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-16T07:32:28.600 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-16T07:32:29.315 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-16T07:32:29.372 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-16T07:32:29.406 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-16T07:32:29.454 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-16T07:32:29.468 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 13/13 2024-09-16T07:32:30.242 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 13/13 2024-09-16T07:32:30.242 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 1/13 2024-09-16T07:32:30.242 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-16T07:32:30.242 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-16T07:32:30.242 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-16T07:32:30.242 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-16T07:32:30.242 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-16T07:32:30.242 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-16T07:32:30.243 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-16T07:32:30.243 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-16T07:32:30.243 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-16T07:32:30.243 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-16T07:32:30.243 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-16T07:32:30.578 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-16T07:32:30.578 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:32:30.578 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-09-16T07:32:30.578 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:32:30.579 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-16T07:32:30.579 INFO:teuthology.orchestra.run.smithi115.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-16T07:32:30.579 INFO:teuthology.orchestra.run.smithi115.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-16T07:32:30.579 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-16T07:32:30.579 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-16T07:32:30.579 INFO:teuthology.orchestra.run.smithi115.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-16T07:32:30.579 INFO:teuthology.orchestra.run.smithi115.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-16T07:32:30.579 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-16T07:32:30.579 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-16T07:32:30.579 INFO:teuthology.orchestra.run.smithi115.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-16T07:32:30.579 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-16T07:32:30.579 INFO:teuthology.orchestra.run.smithi115.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-16T07:32:30.579 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:32:30.579 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-16T07:32:30.827 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install ceph-mgr-cephadm 2024-09-16T07:32:31.394 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:01:58 ago on Mon 16 Sep 2024 07:30:33 AM UTC. 2024-09-16T07:32:31.529 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-16T07:32:31.529 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-16T07:32:31.529 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repository Size 2024-09-16T07:32:31.529 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-16T07:32:31.529 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-09-16T07:32:31.529 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 154 k 2024-09-16T07:32:31.529 INFO:teuthology.orchestra.run.smithi115.stdout:Installing dependencies: 2024-09-16T07:32:31.530 INFO:teuthology.orchestra.run.smithi115.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-16T07:32:31.530 INFO:teuthology.orchestra.run.smithi115.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-16T07:32:31.530 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-16T07:32:31.530 INFO:teuthology.orchestra.run.smithi115.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-16T07:32:31.530 INFO:teuthology.orchestra.run.smithi115.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-16T07:32:31.530 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:32:31.530 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-09-16T07:32:31.530 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-16T07:32:31.530 INFO:teuthology.orchestra.run.smithi115.stdout:Install 6 Packages 2024-09-16T07:32:31.530 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:32:31.530 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 7.0 M 2024-09-16T07:32:31.530 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 33 M 2024-09-16T07:32:31.531 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-09-16T07:32:32.157 INFO:teuthology.orchestra.run.smithi115.stdout:(1/6): ceph-mgr-cephadm-19.3.0-4879.g81fedcb3.e 725 kB/s | 154 kB 00:00 2024-09-16T07:32:32.207 INFO:teuthology.orchestra.run.smithi115.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 11 MB/s | 548 kB 00:00 2024-09-16T07:32:32.224 INFO:teuthology.orchestra.run.smithi115.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 3.4 MB/s | 58 kB 00:00 2024-09-16T07:32:32.249 INFO:teuthology.orchestra.run.smithi115.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.9 MB/s | 74 kB 00:00 2024-09-16T07:32:32.583 INFO:teuthology.orchestra.run.smithi115.stdout:(5/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 388 kB/s | 248 kB 00:00 2024-09-16T07:32:33.291 INFO:teuthology.orchestra.run.smithi115.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 4.4 MB/s | 6.0 MB 00:01 2024-09-16T07:32:33.293 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:32:33.293 INFO:teuthology.orchestra.run.smithi115.stdout:Total 4.0 MB/s | 7.0 MB 00:01 2024-09-16T07:32:33.365 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-09-16T07:32:33.376 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-09-16T07:32:33.377 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-09-16T07:32:33.477 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-09-16T07:32:33.477 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-09-16T07:32:33.797 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-09-16T07:32:33.966 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-16T07:32:34.018 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-16T07:32:34.549 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-16T07:32:34.637 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-16T07:32:34.704 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-16T07:32:34.731 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 6/6 2024-09-16T07:32:35.521 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 6/6 2024-09-16T07:32:35.521 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/6 2024-09-16T07:32:35.521 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-16T07:32:35.521 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-16T07:32:35.521 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-16T07:32:35.521 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-16T07:32:35.807 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-16T07:32:35.807 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:32:35.807 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-09-16T07:32:35.807 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:32:35.807 INFO:teuthology.orchestra.run.smithi115.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-16T07:32:35.807 INFO:teuthology.orchestra.run.smithi115.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-16T07:32:35.807 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-16T07:32:35.808 INFO:teuthology.orchestra.run.smithi115.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-16T07:32:35.808 INFO:teuthology.orchestra.run.smithi115.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-16T07:32:35.808 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:32:35.808 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-16T07:32:36.082 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install ceph-fuse 2024-09-16T07:32:36.648 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:02:03 ago on Mon 16 Sep 2024 07:30:33 AM UTC. 2024-09-16T07:32:36.781 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-16T07:32:36.782 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-16T07:32:36.782 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repository Size 2024-09-16T07:32:36.782 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-16T07:32:36.782 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-09-16T07:32:36.782 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-fuse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 884 k 2024-09-16T07:32:36.782 INFO:teuthology.orchestra.run.smithi115.stdout:Installing dependencies: 2024-09-16T07:32:36.782 INFO:teuthology.orchestra.run.smithi115.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-16T07:32:36.782 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:32:36.783 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-09-16T07:32:36.783 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-16T07:32:36.783 INFO:teuthology.orchestra.run.smithi115.stdout:Install 2 Packages 2024-09-16T07:32:36.783 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:32:36.783 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 964 k 2024-09-16T07:32:36.783 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 4.1 M 2024-09-16T07:32:36.783 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-09-16T07:32:36.927 INFO:teuthology.orchestra.run.smithi115.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 651 kB/s | 80 kB 00:00 2024-09-16T07:32:37.094 INFO:teuthology.orchestra.run.smithi115.stdout:(2/2): ceph-fuse-19.3.0-4879.g81fedcb3.el9.x86_ 3.0 MB/s | 884 kB 00:00 2024-09-16T07:32:37.094 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:32:37.094 INFO:teuthology.orchestra.run.smithi115.stdout:Total 3.0 MB/s | 964 kB 00:00 2024-09-16T07:32:37.105 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-09-16T07:32:37.129 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-09-16T07:32:37.129 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-09-16T07:32:37.210 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-09-16T07:32:37.210 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-09-16T07:32:37.422 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-09-16T07:32:37.580 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-16T07:32:37.651 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/2 2024-09-16T07:32:38.405 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/2 2024-09-16T07:32:38.405 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/2 2024-09-16T07:32:38.687 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-16T07:32:38.688 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:32:38.688 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-09-16T07:32:38.688 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-16T07:32:38.688 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:32:38.688 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-16T07:32:39.066 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install ceph-volume 2024-09-16T07:32:39.643 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:02:06 ago on Mon 16 Sep 2024 07:30:33 AM UTC. 2024-09-16T07:32:39.781 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-16T07:32:39.781 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-16T07:32:39.781 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repository Size 2024-09-16T07:32:39.781 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-16T07:32:39.782 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-09-16T07:32:39.782 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-volume noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 285 k 2024-09-16T07:32:39.782 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:32:39.782 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-09-16T07:32:39.782 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-16T07:32:39.782 INFO:teuthology.orchestra.run.smithi115.stdout:Install 1 Package 2024-09-16T07:32:39.782 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:32:39.782 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 285 k 2024-09-16T07:32:39.782 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 1.3 M 2024-09-16T07:32:39.782 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-09-16T07:32:40.015 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-volume-19.3.0-4879.g81fedcb3.el9.noarch.rp 1.2 MB/s | 285 kB 00:00 2024-09-16T07:32:40.015 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:32:40.016 INFO:teuthology.orchestra.run.smithi115.stdout:Total 1.2 MB/s | 285 kB 00:00 2024-09-16T07:32:40.016 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-09-16T07:32:40.024 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-09-16T07:32:40.024 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-09-16T07:32:40.057 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-09-16T07:32:40.057 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-09-16T07:32:40.273 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-09-16T07:32:40.350 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T07:32:40.366 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T07:32:40.367 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T07:32:40.367 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-16T07:32:40.367 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:32:41.339 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T07:32:41.339 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:32:41.339 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-09-16T07:32:41.339 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:32:41.339 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:32:41.339 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-16T07:32:41.703 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install librados-devel 2024-09-16T07:32:42.288 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:02:09 ago on Mon 16 Sep 2024 07:30:33 AM UTC. 2024-09-16T07:32:42.423 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-16T07:32:42.424 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-16T07:32:42.424 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repo Size 2024-09-16T07:32:42.424 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-16T07:32:42.424 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-09-16T07:32:42.424 INFO:teuthology.orchestra.run.smithi115.stdout: librados-devel x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 125 k 2024-09-16T07:32:42.424 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:32:42.425 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-09-16T07:32:42.425 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-16T07:32:42.425 INFO:teuthology.orchestra.run.smithi115.stdout:Install 1 Package 2024-09-16T07:32:42.425 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:32:42.425 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 125 k 2024-09-16T07:32:42.425 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 445 k 2024-09-16T07:32:42.425 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-09-16T07:32:42.620 INFO:teuthology.orchestra.run.smithi115.stdout:librados-devel-19.3.0-4879.g81fedcb3.el9.x86_64 641 kB/s | 125 kB 00:00 2024-09-16T07:32:42.620 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:32:42.620 INFO:teuthology.orchestra.run.smithi115.stdout:Total 636 kB/s | 125 kB 00:00 2024-09-16T07:32:42.620 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-09-16T07:32:42.626 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-09-16T07:32:42.626 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-09-16T07:32:42.690 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-09-16T07:32:42.690 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-09-16T07:32:42.846 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-09-16T07:32:42.942 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:32:43.401 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:32:43.666 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:32:43.667 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:32:43.667 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-09-16T07:32:43.667 INFO:teuthology.orchestra.run.smithi115.stdout: librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:32:43.667 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:32:43.667 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-16T07:32:43.931 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install libcephfs2 2024-09-16T07:32:44.507 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:02:11 ago on Mon 16 Sep 2024 07:30:33 AM UTC. 2024-09-16T07:32:44.599 INFO:teuthology.orchestra.run.smithi115.stdout:Package libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:32:44.644 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-16T07:32:44.645 INFO:teuthology.orchestra.run.smithi115.stdout:Nothing to do. 2024-09-16T07:32:44.645 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-16T07:32:44.724 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install libcephfs-devel 2024-09-16T07:32:45.291 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:02:12 ago on Mon 16 Sep 2024 07:30:33 AM UTC. 2024-09-16T07:32:45.425 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-16T07:32:45.425 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-16T07:32:45.425 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repo Size 2024-09-16T07:32:45.425 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-16T07:32:45.426 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-09-16T07:32:45.426 INFO:teuthology.orchestra.run.smithi115.stdout: libcephfs-devel x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 32 k 2024-09-16T07:32:45.426 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:32:45.426 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-09-16T07:32:45.426 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-16T07:32:45.426 INFO:teuthology.orchestra.run.smithi115.stdout:Install 1 Package 2024-09-16T07:32:45.426 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:32:45.426 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 32 k 2024-09-16T07:32:45.426 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 142 k 2024-09-16T07:32:45.426 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-09-16T07:32:45.690 INFO:teuthology.orchestra.run.smithi115.stdout:libcephfs-devel-19.3.0-4879.g81fedcb3.el9.x86_6 120 kB/s | 32 kB 00:00 2024-09-16T07:32:45.690 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:32:45.690 INFO:teuthology.orchestra.run.smithi115.stdout:Total 120 kB/s | 32 kB 00:00 2024-09-16T07:32:45.691 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-09-16T07:32:45.694 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-09-16T07:32:45.694 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-09-16T07:32:45.722 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-09-16T07:32:45.722 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-09-16T07:32:45.810 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-09-16T07:32:45.920 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:32:46.310 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:32:46.545 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:32:46.545 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:32:46.545 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-09-16T07:32:46.545 INFO:teuthology.orchestra.run.smithi115.stdout: libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:32:46.545 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:32:46.546 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-16T07:32:46.754 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install librados2 2024-09-16T07:32:47.324 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:02:14 ago on Mon 16 Sep 2024 07:30:33 AM UTC. 2024-09-16T07:32:47.415 INFO:teuthology.orchestra.run.smithi115.stdout:Package librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:32:47.459 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-16T07:32:47.459 INFO:teuthology.orchestra.run.smithi115.stdout:Nothing to do. 2024-09-16T07:32:47.460 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-16T07:32:47.542 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install librbd1 2024-09-16T07:32:48.105 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:02:15 ago on Mon 16 Sep 2024 07:30:33 AM UTC. 2024-09-16T07:32:48.195 INFO:teuthology.orchestra.run.smithi115.stdout:Package librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:32:48.238 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-16T07:32:48.239 INFO:teuthology.orchestra.run.smithi115.stdout:Nothing to do. 2024-09-16T07:32:48.239 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-16T07:32:48.316 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install python3-rados 2024-09-16T07:32:48.879 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:02:15 ago on Mon 16 Sep 2024 07:30:33 AM UTC. 2024-09-16T07:32:48.969 INFO:teuthology.orchestra.run.smithi115.stdout:Package python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:32:49.012 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-16T07:32:49.013 INFO:teuthology.orchestra.run.smithi115.stdout:Nothing to do. 2024-09-16T07:32:49.013 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-16T07:32:49.089 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install python3-rgw 2024-09-16T07:32:49.655 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:02:16 ago on Mon 16 Sep 2024 07:30:33 AM UTC. 2024-09-16T07:32:49.746 INFO:teuthology.orchestra.run.smithi115.stdout:Package python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:32:49.791 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-16T07:32:49.792 INFO:teuthology.orchestra.run.smithi115.stdout:Nothing to do. 2024-09-16T07:32:49.792 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-16T07:32:49.882 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install python3-cephfs 2024-09-16T07:32:50.452 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:02:17 ago on Mon 16 Sep 2024 07:30:33 AM UTC. 2024-09-16T07:32:50.543 INFO:teuthology.orchestra.run.smithi115.stdout:Package python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:32:50.585 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-16T07:32:50.586 INFO:teuthology.orchestra.run.smithi115.stdout:Nothing to do. 2024-09-16T07:32:50.586 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-16T07:32:50.666 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install python3-rbd 2024-09-16T07:32:51.235 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:02:18 ago on Mon 16 Sep 2024 07:30:33 AM UTC. 2024-09-16T07:32:51.325 INFO:teuthology.orchestra.run.smithi115.stdout:Package python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:32:51.368 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-16T07:32:51.369 INFO:teuthology.orchestra.run.smithi115.stdout:Nothing to do. 2024-09-16T07:32:51.369 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-16T07:32:51.448 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install rbd-fuse 2024-09-16T07:32:52.012 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:02:19 ago on Mon 16 Sep 2024 07:30:33 AM UTC. 2024-09-16T07:32:52.145 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-16T07:32:52.146 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-16T07:32:52.146 INFO:teuthology.orchestra.run.smithi115.stdout: Package Architecture Version Repository Size 2024-09-16T07:32:52.146 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-16T07:32:52.146 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-09-16T07:32:52.146 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-fuse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 91 k 2024-09-16T07:32:52.146 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:32:52.146 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-09-16T07:32:52.147 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-16T07:32:52.147 INFO:teuthology.orchestra.run.smithi115.stdout:Install 1 Package 2024-09-16T07:32:52.147 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:32:52.147 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 91 k 2024-09-16T07:32:52.147 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 321 k 2024-09-16T07:32:52.147 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-09-16T07:32:52.351 INFO:teuthology.orchestra.run.smithi115.stdout:rbd-fuse-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 446 kB/s | 91 kB 00:00 2024-09-16T07:32:52.351 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:32:52.352 INFO:teuthology.orchestra.run.smithi115.stdout:Total 443 kB/s | 91 kB 00:00 2024-09-16T07:32:52.352 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-09-16T07:32:52.361 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-09-16T07:32:52.361 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-09-16T07:32:52.426 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-09-16T07:32:52.426 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-09-16T07:32:52.573 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-09-16T07:32:52.665 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:32:53.067 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:32:53.346 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:32:53.346 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:32:53.346 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-09-16T07:32:53.346 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:32:53.346 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:32:53.346 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-16T07:32:53.650 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install rbd-mirror 2024-09-16T07:32:54.247 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:02:21 ago on Mon 16 Sep 2024 07:30:33 AM UTC. 2024-09-16T07:32:54.389 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-16T07:32:54.389 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-16T07:32:54.389 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repo Size 2024-09-16T07:32:54.389 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-16T07:32:54.390 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-09-16T07:32:54.390 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-mirror x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.5 M 2024-09-16T07:32:54.390 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:32:54.390 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-09-16T07:32:54.390 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-16T07:32:54.390 INFO:teuthology.orchestra.run.smithi115.stdout:Install 1 Package 2024-09-16T07:32:54.390 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:32:54.390 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 3.5 M 2024-09-16T07:32:54.390 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 30 M 2024-09-16T07:32:54.390 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-09-16T07:32:54.780 INFO:teuthology.orchestra.run.smithi115.stdout:rbd-mirror-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 9.0 MB/s | 3.5 MB 00:00 2024-09-16T07:32:54.781 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:32:54.781 INFO:teuthology.orchestra.run.smithi115.stdout:Total 9.0 MB/s | 3.5 MB 00:00 2024-09-16T07:32:54.781 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-09-16T07:32:54.793 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-09-16T07:32:54.793 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-09-16T07:32:54.877 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-09-16T07:32:54.877 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-09-16T07:32:55.460 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-09-16T07:32:55.522 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:32:55.549 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:32:55.549 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T07:32:55.549 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-16T07:32:55.549 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T07:32:55.549 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T07:32:55.549 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:32:56.755 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:32:56.755 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:32:56.755 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-09-16T07:32:56.755 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:32:56.755 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:32:56.755 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-16T07:32:57.031 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install rbd-nbd 2024-09-16T07:32:57.606 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:02:24 ago on Mon 16 Sep 2024 07:30:33 AM UTC. 2024-09-16T07:32:57.743 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-16T07:32:57.743 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-16T07:32:57.743 INFO:teuthology.orchestra.run.smithi115.stdout: Package Architecture Version Repository Size 2024-09-16T07:32:57.744 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-16T07:32:57.744 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-09-16T07:32:57.744 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-nbd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 177 k 2024-09-16T07:32:57.744 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:32:57.744 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-09-16T07:32:57.744 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-16T07:32:57.744 INFO:teuthology.orchestra.run.smithi115.stdout:Install 1 Package 2024-09-16T07:32:57.744 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:32:57.745 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 177 k 2024-09-16T07:32:57.745 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 685 k 2024-09-16T07:32:57.745 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-09-16T07:32:57.984 INFO:teuthology.orchestra.run.smithi115.stdout:rbd-nbd-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 740 kB/s | 177 kB 00:00 2024-09-16T07:32:57.984 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:32:57.984 INFO:teuthology.orchestra.run.smithi115.stdout:Total 736 kB/s | 177 kB 00:00 2024-09-16T07:32:57.985 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-09-16T07:32:57.994 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-09-16T07:32:57.994 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-09-16T07:32:58.063 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-09-16T07:32:58.063 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-09-16T07:32:58.245 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-09-16T07:32:58.339 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:32:58.766 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:32:59.024 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:32:59.024 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:32:59.024 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-09-16T07:32:59.024 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:32:59.025 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:32:59.025 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-16T07:32:59.305 DEBUG:teuthology.parallel:result is None 2024-09-16T07:32:59.305 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=81fedcb3b484c843d22ffbc8d179cb567b7083b5 2024-09-16T07:32:59.445 DEBUG:teuthology.orchestra.run.smithi115:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-16T07:32:59.467 INFO:teuthology.orchestra.run.smithi115.stdout:19.3.0-4879.g81fedcb3.el9 2024-09-16T07:32:59.468 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4879.g81fedcb3.el9 2024-09-16T07:32:59.468 INFO:teuthology.task.install:The correct ceph version 19.3.0-4879.g81fedcb3 is installed. 2024-09-16T07:32:59.470 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-16T07:32:59.470 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-16T07:32:59.470 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-16T07:32:59.552 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-16T07:32:59.553 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-16T07:32:59.553 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/usr/bin/daemon-helper 2024-09-16T07:32:59.618 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-16T07:32:59.683 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-16T07:32:59.683 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-16T07:32:59.683 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-16T07:32:59.747 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-16T07:32:59.812 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-16T07:32:59.812 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-16T07:32:59.812 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/usr/bin/stdin-killer 2024-09-16T07:32:59.878 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-16T07:32:59.944 INFO:teuthology.run_tasks:Running task ceph... 2024-09-16T07:33:00.336 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-16T07:33:00.336 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 777 /var/log/ceph 2024-09-16T07:33:00.362 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-16T07:33:00.362 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-16T07:33:00.428 INFO:tasks.ceph:Creating extra log directories... 2024-09-16T07:33:00.428 DEBUG:teuthology.orchestra.run.smithi115:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-16T07:33:00.500 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-16T07:33:00.500 INFO:tasks.ceph:config {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr stats period': 30}, 'osd.0': {'crimson seastar cpu cores': '0-1'}, 'osd.1': {'crimson seastar cpu cores': '2-3'}, 'osd.2': {'crimson seastar cpu cores': '4-5'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'is full \\(reached quota', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(POOL_FULL\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-16T07:33:00.501 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/matan-2024-09-16_07:15:55-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7906860', 'branch': 'wip-matanb-crimson-testing-59543', 'description': 'crimson-rados/rbd/{clusters/fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore tasks/rbd_api_tests}', 'email': None, 'first_in_suite': False, 'job_id': '7906860', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'matan-2024-09-16_07:15:55-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-matanb-crimson-testing-59543'}, 'ceph': {'conf': {'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr stats period': 30}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'osd pool default crimson': True}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'osd.0': {'crimson seastar cpu cores': '0-1'}, 'osd.1': {'crimson seastar cpu cores': '2-3'}, 'osd.2': {'crimson seastar cpu cores': '4-5'}}, 'flavor': 'crimson', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'is full \\(reached quota', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(POOL_FULL\\)'], 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'global': {'osd crush chooseleaf type': 0, 'osd pool default pg num': 128, 'osd pool default pgp num': 128, 'osd pool default size': 2}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'crimson', 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'workunit': {'branch': 'main', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': '0325fd3c11a225c0fd9eb38fab88aad1370ad779'}}, 'owner': 'scheduled_matan@teuthology', 'priority': 60, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0']], 'seed': 6651, 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5', 'sleep_before_teardown': 0, 'suite': 'crimson-rados', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '0325fd3c11a225c0fd9eb38fab88aad1370ad779', 'targets': {'smithi115.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPBXCvf4DHyewQs/qbPhnewSLr8leF6Rl2oZj/yTw1xlZjSzmdT5mK/HqfpW42MRuRq0dZH11iHltZH2oM5oJso='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr stats period': 30}, 'osd.0': {'crimson seastar cpu cores': '0-1'}, 'osd.1': {'crimson seastar cpu cores': '2-3'}, 'osd.2': {'crimson seastar cpu cores': '4-5'}}, 'flavor': 'crimson', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'is full \\(reached quota', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(POOL_FULL\\)'], 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5', 'cluster': 'ceph'}}, {'workunit': {'clients': {'client.0': ['rbd/crimson/test_crimson_librbd.sh']}, 'env': {'RBD_FEATURES': '61'}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-16_07:15:55', 'tube': 'smithi', 'user': 'matan', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-16T07:33:00.501 DEBUG:teuthology.orchestra.run.smithi115:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-16T07:33:00.548 DEBUG:teuthology.orchestra.run.smithi115:> sudo install -d -m0777 -- /var/run/ceph 2024-09-16T07:33:00.614 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-16T07:33:00.614 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/scratch_devs of=/dev/stdout 2024-09-16T07:33:00.670 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-16T07:33:00.670 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_1 2024-09-16T07:33:00.725 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-16T07:33:00.725 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T07:33:00.725 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-16T07:33:00.725 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T07:33:00.725 INFO:teuthology.orchestra.run.smithi115.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T07:33:00.726 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2024-09-16 07:32:55.796125930 +0000 2024-09-16T07:33:00.726 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2024-09-16 07:29:55.925532802 +0000 2024-09-16T07:33:00.726 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2024-09-16 07:29:55.925532802 +0000 2024-09-16T07:33:00.726 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: 2024-09-16 07:29:55.925532802 +0000 2024-09-16T07:33:00.726 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-16T07:33:00.788 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2024-09-16T07:33:00.788 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2024-09-16T07:33:00.788 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.00017827 s, 2.9 MB/s 2024-09-16T07:33:00.789 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-16T07:33:00.845 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_2 2024-09-16T07:33:00.901 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-16T07:33:00.902 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T07:33:00.902 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-16T07:33:00.902 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T07:33:00.902 INFO:teuthology.orchestra.run.smithi115.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T07:33:00.902 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2024-09-16 07:32:55.797125914 +0000 2024-09-16T07:33:00.902 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2024-09-16 07:29:56.259527323 +0000 2024-09-16T07:33:00.902 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2024-09-16 07:29:56.259527323 +0000 2024-09-16T07:33:00.902 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: 2024-09-16 07:29:56.259527323 +0000 2024-09-16T07:33:00.902 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-16T07:33:00.965 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2024-09-16T07:33:00.965 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2024-09-16T07:33:00.965 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.00019813 s, 2.6 MB/s 2024-09-16T07:33:00.966 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-16T07:33:01.023 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_3 2024-09-16T07:33:01.078 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-16T07:33:01.078 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T07:33:01.078 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-16T07:33:01.078 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T07:33:01.078 INFO:teuthology.orchestra.run.smithi115.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T07:33:01.078 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2024-09-16 07:32:55.797125914 +0000 2024-09-16T07:33:01.078 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2024-09-16 07:29:56.605521647 +0000 2024-09-16T07:33:01.078 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2024-09-16 07:29:56.605521647 +0000 2024-09-16T07:33:01.079 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: 2024-09-16 07:29:56.605521647 +0000 2024-09-16T07:33:01.079 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-16T07:33:01.141 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2024-09-16T07:33:01.141 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2024-09-16T07:33:01.141 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.00020434 s, 2.5 MB/s 2024-09-16T07:33:01.142 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-16T07:33:01.199 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_4 2024-09-16T07:33:01.255 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-16T07:33:01.255 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T07:33:01.255 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-16T07:33:01.255 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T07:33:01.256 INFO:teuthology.orchestra.run.smithi115.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T07:33:01.256 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2024-09-16 07:32:55.797125914 +0000 2024-09-16T07:33:01.256 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2024-09-16 07:29:56.935516234 +0000 2024-09-16T07:33:01.256 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2024-09-16 07:29:56.935516234 +0000 2024-09-16T07:33:01.256 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: 2024-09-16 07:29:56.935516234 +0000 2024-09-16T07:33:01.256 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-16T07:33:01.318 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2024-09-16T07:33:01.318 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2024-09-16T07:33:01.318 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.000227479 s, 2.3 MB/s 2024-09-16T07:33:01.319 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-16T07:33:01.376 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-16T07:33:01.377 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi115.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2024-09-16T07:33:01.377 INFO:tasks.ceph:Generating config... 2024-09-16T07:33:01.407 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2024-09-16T07:33:01.407 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2024-09-16T07:33:01.408 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2024-09-16T07:33:01.408 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2024-09-16T07:33:01.408 INFO:tasks.ceph:[mon] paxos service trim min = 10 2024-09-16T07:33:01.408 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-16T07:33:01.408 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-16T07:33:01.408 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-16T07:33:01.408 INFO:tasks.ceph:[mon] osd pool default crimson = True 2024-09-16T07:33:01.408 INFO:tasks.ceph:[osd] debug monc = 20 2024-09-16T07:33:01.408 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-16T07:33:01.408 INFO:tasks.ceph:[osd] bluestore compression algorithm = snappy 2024-09-16T07:33:01.408 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-09-16T07:33:01.408 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-16T07:33:01.408 INFO:tasks.ceph:[osd] bluestore rocksdb cf = False 2024-09-16T07:33:01.409 INFO:tasks.ceph:[osd] crimson alien thread cpu cores = 6-7 2024-09-16T07:33:01.409 INFO:tasks.ceph:[osd] crimson osd obc lru size = 10 2024-09-16T07:33:01.409 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-16T07:33:01.409 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-16T07:33:01.409 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-16T07:33:01.409 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-16T07:33:01.409 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-16T07:33:01.409 INFO:tasks.ceph:[osd] err to stderr = True 2024-09-16T07:33:01.409 INFO:tasks.ceph:[osd] log flush on exit = True 2024-09-16T07:33:01.409 INFO:tasks.ceph:[osd] log to file = False 2024-09-16T07:33:01.409 INFO:tasks.ceph:[osd] log to stderr = True 2024-09-16T07:33:01.409 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-16T07:33:01.409 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-16T07:33:01.409 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-16T07:33:01.410 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-16T07:33:01.410 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-16T07:33:01.410 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-16T07:33:01.410 INFO:tasks.ceph:[global] enable experimental unrecoverable data corrupting features = crimson 2024-09-16T07:33:01.410 INFO:tasks.ceph:[global] ms client mode = crc 2024-09-16T07:33:01.410 INFO:tasks.ceph:[global] ms cluster mode = crc 2024-09-16T07:33:01.410 INFO:tasks.ceph:[global] ms mon client mode = crc 2024-09-16T07:33:01.410 INFO:tasks.ceph:[global] ms mon cluster mode = crc 2024-09-16T07:33:01.410 INFO:tasks.ceph:[global] ms mon service mode = crc 2024-09-16T07:33:01.410 INFO:tasks.ceph:[global] ms service mode = crc 2024-09-16T07:33:01.410 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-16T07:33:01.411 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-16T07:33:01.411 INFO:tasks.ceph:[mgr] mgr stats period = 30 2024-09-16T07:33:01.411 INFO:tasks.ceph:[osd.0] crimson seastar cpu cores = 0-1 2024-09-16T07:33:01.411 INFO:tasks.ceph:[osd.1] crimson seastar cpu cores = 2-3 2024-09-16T07:33:01.411 INFO:tasks.ceph:[osd.2] crimson seastar cpu cores = 4-5 2024-09-16T07:33:01.411 INFO:tasks.ceph:Setting up mon.a... 2024-09-16T07:33:01.411 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-16T07:33:01.471 INFO:teuthology.orchestra.run.smithi115.stdout:creating /etc/ceph/ceph.keyring 2024-09-16T07:33:01.475 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-16T07:33:01.526 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-16T07:33:01.550 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.115')] 2024-09-16T07:33:01.551 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.115', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'mgr stats period': 30}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'osd pool default crimson': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'osd.0': {'crimson seastar cpu cores': '0-1'}, 'osd.1': {'crimson seastar cpu cores': '2-3'}, 'osd.2': {'crimson seastar cpu cores': '4-5'}} 2024-09-16T07:33:01.552 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-16T07:33:01.552 DEBUG:teuthology.orchestra.run.smithi115:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-16T07:33:01.607 DEBUG:teuthology.orchestra.run.smithi115:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.115 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-16T07:33:01.697 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T07:33:01.698+0000 7f1ad6e7df00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:01.698 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T07:33:01.698+0000 7f1ad6e7df00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:01.698 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T07:33:01.698+0000 7f1ad6e7df00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:01.698 INFO:teuthology.orchestra.run.smithi115.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-16T07:33:01.698 INFO:teuthology.orchestra.run.smithi115.stdout:monmaptool: generated fsid c399a571-d66b-4a13-8ade-7d949db2bd08 2024-09-16T07:33:01.698 INFO:teuthology.orchestra.run.smithi115.stdout:setting min_mon_release = quincy 2024-09-16T07:33:01.699 INFO:teuthology.orchestra.run.smithi115.stdout:epoch 0 2024-09-16T07:33:01.699 INFO:teuthology.orchestra.run.smithi115.stdout:fsid c399a571-d66b-4a13-8ade-7d949db2bd08 2024-09-16T07:33:01.699 INFO:teuthology.orchestra.run.smithi115.stdout:last_changed 2024-09-16T07:33:01.699663+0000 2024-09-16T07:33:01.699 INFO:teuthology.orchestra.run.smithi115.stdout:created 2024-09-16T07:33:01.699663+0000 2024-09-16T07:33:01.699 INFO:teuthology.orchestra.run.smithi115.stdout:min_mon_release 17 (quincy) 2024-09-16T07:33:01.699 INFO:teuthology.orchestra.run.smithi115.stdout:election_strategy: 1 2024-09-16T07:33:01.699 INFO:teuthology.orchestra.run.smithi115.stdout:0: [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] mon.a 2024-09-16T07:33:01.699 INFO:teuthology.orchestra.run.smithi115.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-09-16T07:33:01.701 DEBUG:teuthology.orchestra.run.smithi115:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-16T07:33:01.716 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID c399a571-d66b-4a13-8ade-7d949db2bd08... 2024-09-16T07:33:01.717 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-16T07:33:01.799 INFO:teuthology.orchestra.run.smithi115.stdout:[global] 2024-09-16T07:33:01.799 INFO:teuthology.orchestra.run.smithi115.stdout: chdir = "" 2024-09-16T07:33:01.799 INFO:teuthology.orchestra.run.smithi115.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-16T07:33:01.799 INFO:teuthology.orchestra.run.smithi115.stdout: auth supported = cephx 2024-09-16T07:33:01.799 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:33:01.799 INFO:teuthology.orchestra.run.smithi115.stdout: filestore xattr use omap = true 2024-09-16T07:33:01.799 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:33:01.800 INFO:teuthology.orchestra.run.smithi115.stdout: mon clock drift allowed = 1.000 2024-09-16T07:33:01.800 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:33:01.800 INFO:teuthology.orchestra.run.smithi115.stdout: osd crush chooseleaf type = 0 2024-09-16T07:33:01.800 INFO:teuthology.orchestra.run.smithi115.stdout: auth debug = true 2024-09-16T07:33:01.800 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:33:01.800 INFO:teuthology.orchestra.run.smithi115.stdout: ms die on old message = true 2024-09-16T07:33:01.800 INFO:teuthology.orchestra.run.smithi115.stdout: ms die on bug = true 2024-09-16T07:33:01.800 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:33:01.800 INFO:teuthology.orchestra.run.smithi115.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-16T07:33:01.800 INFO:teuthology.orchestra.run.smithi115.stdout: mon pg warn max object skew = 0 2024-09-16T07:33:01.800 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:33:01.800 INFO:teuthology.orchestra.run.smithi115.stdout: # disable pg_autoscaler by default for new pools 2024-09-16T07:33:01.801 INFO:teuthology.orchestra.run.smithi115.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-16T07:33:01.801 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:33:01.801 INFO:teuthology.orchestra.run.smithi115.stdout: osd pool default size = 2 2024-09-16T07:33:01.801 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:33:01.801 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd allow primary affinity = true 2024-09-16T07:33:01.801 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd allow pg remap = true 2024-09-16T07:33:01.801 INFO:teuthology.orchestra.run.smithi115.stdout: mon warn on legacy crush tunables = false 2024-09-16T07:33:01.801 INFO:teuthology.orchestra.run.smithi115.stdout: mon warn on crush straw calc version zero = false 2024-09-16T07:33:01.801 INFO:teuthology.orchestra.run.smithi115.stdout: mon warn on no sortbitwise = false 2024-09-16T07:33:01.801 INFO:teuthology.orchestra.run.smithi115.stdout: mon warn on osd down out interval zero = false 2024-09-16T07:33:01.801 INFO:teuthology.orchestra.run.smithi115.stdout: mon warn on too few osds = false 2024-09-16T07:33:01.801 INFO:teuthology.orchestra.run.smithi115.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-16T07:33:01.801 INFO:teuthology.orchestra.run.smithi115.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-16T07:33:01.801 INFO:teuthology.orchestra.run.smithi115.stdout: mon_allow_pool_size_one = true 2024-09-16T07:33:01.802 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:33:01.802 INFO:teuthology.orchestra.run.smithi115.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-16T07:33:01.802 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:33:01.802 INFO:teuthology.orchestra.run.smithi115.stdout: osd default data pool replay window = 5 2024-09-16T07:33:01.802 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:33:01.802 INFO:teuthology.orchestra.run.smithi115.stdout: mon allow pool delete = true 2024-09-16T07:33:01.802 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:33:01.802 INFO:teuthology.orchestra.run.smithi115.stdout: mon cluster log file level = debug 2024-09-16T07:33:01.802 INFO:teuthology.orchestra.run.smithi115.stdout: debug asserts on shutdown = true 2024-09-16T07:33:01.802 INFO:teuthology.orchestra.run.smithi115.stdout: mon health detail to clog = false 2024-09-16T07:33:01.802 INFO:teuthology.orchestra.run.smithi115.stdout: mon host = 172.21.15.115 2024-09-16T07:33:01.802 INFO:teuthology.orchestra.run.smithi115.stdout: enable experimental unrecoverable data corrupting features = crimson 2024-09-16T07:33:01.802 INFO:teuthology.orchestra.run.smithi115.stdout: ms client mode = crc 2024-09-16T07:33:01.802 INFO:teuthology.orchestra.run.smithi115.stdout: ms cluster mode = crc 2024-09-16T07:33:01.803 INFO:teuthology.orchestra.run.smithi115.stdout: ms mon client mode = crc 2024-09-16T07:33:01.803 INFO:teuthology.orchestra.run.smithi115.stdout: ms mon cluster mode = crc 2024-09-16T07:33:01.803 INFO:teuthology.orchestra.run.smithi115.stdout: ms mon service mode = crc 2024-09-16T07:33:01.803 INFO:teuthology.orchestra.run.smithi115.stdout: ms service mode = crc 2024-09-16T07:33:01.803 INFO:teuthology.orchestra.run.smithi115.stdout: fsid = c399a571-d66b-4a13-8ade-7d949db2bd08 2024-09-16T07:33:01.803 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:33:01.803 INFO:teuthology.orchestra.run.smithi115.stdout:[osd] 2024-09-16T07:33:01.803 INFO:teuthology.orchestra.run.smithi115.stdout: osd journal size = 100 2024-09-16T07:33:01.803 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:33:01.803 INFO:teuthology.orchestra.run.smithi115.stdout: osd scrub load threshold = 5.0 2024-09-16T07:33:01.803 INFO:teuthology.orchestra.run.smithi115.stdout: osd scrub max interval = 600 2024-09-16T07:33:01.803 INFO:teuthology.orchestra.run.smithi115.stdout: osd mclock profile = high_recovery_ops 2024-09-16T07:33:01.803 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:33:01.803 INFO:teuthology.orchestra.run.smithi115.stdout: osd recover clone overlap = true 2024-09-16T07:33:01.803 INFO:teuthology.orchestra.run.smithi115.stdout: osd recovery max chunk = 1048576 2024-09-16T07:33:01.804 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:33:01.804 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug shutdown = true 2024-09-16T07:33:01.804 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug op order = true 2024-09-16T07:33:01.804 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug verify stray on activate = true 2024-09-16T07:33:01.804 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug trim objects = true 2024-09-16T07:33:01.804 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:33:01.804 INFO:teuthology.orchestra.run.smithi115.stdout: osd open classes on start = true 2024-09-16T07:33:01.804 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug pg log writeout = true 2024-09-16T07:33:01.804 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:33:01.804 INFO:teuthology.orchestra.run.smithi115.stdout: osd deep scrub update digest min age = 30 2024-09-16T07:33:01.804 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:33:01.804 INFO:teuthology.orchestra.run.smithi115.stdout: osd map max advance = 10 2024-09-16T07:33:01.804 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:33:01.804 INFO:teuthology.orchestra.run.smithi115.stdout: journal zero on create = true 2024-09-16T07:33:01.805 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:33:01.805 INFO:teuthology.orchestra.run.smithi115.stdout: filestore ondisk finisher threads = 3 2024-09-16T07:33:01.805 INFO:teuthology.orchestra.run.smithi115.stdout: filestore apply finisher threads = 3 2024-09-16T07:33:01.805 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:33:01.805 INFO:teuthology.orchestra.run.smithi115.stdout: bdev debug aio = true 2024-09-16T07:33:01.805 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug misdirected ops = true 2024-09-16T07:33:01.805 INFO:teuthology.orchestra.run.smithi115.stdout: debug monc = 20 2024-09-16T07:33:01.805 INFO:teuthology.orchestra.run.smithi115.stdout: bluestore block size = 96636764160 2024-09-16T07:33:01.805 INFO:teuthology.orchestra.run.smithi115.stdout: bluestore compression algorithm = snappy 2024-09-16T07:33:01.805 INFO:teuthology.orchestra.run.smithi115.stdout: bluestore compression mode = aggressive 2024-09-16T07:33:01.805 INFO:teuthology.orchestra.run.smithi115.stdout: bluestore fsck on mount = True 2024-09-16T07:33:01.805 INFO:teuthology.orchestra.run.smithi115.stdout: bluestore rocksdb cf = False 2024-09-16T07:33:01.805 INFO:teuthology.orchestra.run.smithi115.stdout: crimson alien thread cpu cores = 6-7 2024-09-16T07:33:01.805 INFO:teuthology.orchestra.run.smithi115.stdout: crimson osd obc lru size = 10 2024-09-16T07:33:01.806 INFO:teuthology.orchestra.run.smithi115.stdout: debug bluefs = 20 2024-09-16T07:33:01.806 INFO:teuthology.orchestra.run.smithi115.stdout: debug bluestore = 20 2024-09-16T07:33:01.806 INFO:teuthology.orchestra.run.smithi115.stdout: debug ms = 1 2024-09-16T07:33:01.806 INFO:teuthology.orchestra.run.smithi115.stdout: debug osd = 20 2024-09-16T07:33:01.806 INFO:teuthology.orchestra.run.smithi115.stdout: debug rocksdb = 10 2024-09-16T07:33:01.806 INFO:teuthology.orchestra.run.smithi115.stdout: err to stderr = True 2024-09-16T07:33:01.806 INFO:teuthology.orchestra.run.smithi115.stdout: log flush on exit = True 2024-09-16T07:33:01.806 INFO:teuthology.orchestra.run.smithi115.stdout: log to file = False 2024-09-16T07:33:01.806 INFO:teuthology.orchestra.run.smithi115.stdout: log to stderr = True 2024-09-16T07:33:01.806 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd backfillfull_ratio = 0.85 2024-09-16T07:33:01.806 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd full ratio = 0.9 2024-09-16T07:33:01.806 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd nearfull ratio = 0.8 2024-09-16T07:33:01.806 INFO:teuthology.orchestra.run.smithi115.stdout: osd failsafe full ratio = 0.95 2024-09-16T07:33:01.807 INFO:teuthology.orchestra.run.smithi115.stdout: osd objectstore = bluestore 2024-09-16T07:33:01.807 INFO:teuthology.orchestra.run.smithi115.stdout: osd shutdown pgref assert = True 2024-09-16T07:33:01.807 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:33:01.807 INFO:teuthology.orchestra.run.smithi115.stdout:[mgr] 2024-09-16T07:33:01.807 INFO:teuthology.orchestra.run.smithi115.stdout: debug ms = 1 2024-09-16T07:33:01.807 INFO:teuthology.orchestra.run.smithi115.stdout: debug mgr = 20 2024-09-16T07:33:01.807 INFO:teuthology.orchestra.run.smithi115.stdout: debug mon = 20 2024-09-16T07:33:01.807 INFO:teuthology.orchestra.run.smithi115.stdout: debug auth = 20 2024-09-16T07:33:01.807 INFO:teuthology.orchestra.run.smithi115.stdout: mon reweight min pgs per osd = 4 2024-09-16T07:33:01.807 INFO:teuthology.orchestra.run.smithi115.stdout: mon reweight min bytes per osd = 10 2024-09-16T07:33:01.807 INFO:teuthology.orchestra.run.smithi115.stdout: mgr/telemetry/nag = false 2024-09-16T07:33:01.807 INFO:teuthology.orchestra.run.smithi115.stdout: mgr stats period = 30 2024-09-16T07:33:01.807 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:33:01.807 INFO:teuthology.orchestra.run.smithi115.stdout:[mon] 2024-09-16T07:33:01.808 INFO:teuthology.orchestra.run.smithi115.stdout: debug ms = 1 2024-09-16T07:33:01.808 INFO:teuthology.orchestra.run.smithi115.stdout: debug mon = 20 2024-09-16T07:33:01.808 INFO:teuthology.orchestra.run.smithi115.stdout: debug paxos = 20 2024-09-16T07:33:01.808 INFO:teuthology.orchestra.run.smithi115.stdout: debug auth = 20 2024-09-16T07:33:01.808 INFO:teuthology.orchestra.run.smithi115.stdout: mon data avail warn = 5 2024-09-16T07:33:01.808 INFO:teuthology.orchestra.run.smithi115.stdout: mon mgr mkfs grace = 240 2024-09-16T07:33:01.808 INFO:teuthology.orchestra.run.smithi115.stdout: mon reweight min pgs per osd = 4 2024-09-16T07:33:01.808 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd reporter subtree level = osd 2024-09-16T07:33:01.808 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd prime pg temp = true 2024-09-16T07:33:01.808 INFO:teuthology.orchestra.run.smithi115.stdout: mon reweight min bytes per osd = 10 2024-09-16T07:33:01.808 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:33:01.808 INFO:teuthology.orchestra.run.smithi115.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-16T07:33:01.808 INFO:teuthology.orchestra.run.smithi115.stdout: auth mon ticket ttl = 660 # 11m 2024-09-16T07:33:01.809 INFO:teuthology.orchestra.run.smithi115.stdout: auth service ticket ttl = 240 # 4m 2024-09-16T07:33:01.809 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:33:01.809 INFO:teuthology.orchestra.run.smithi115.stdout: # don't complain about insecure global_id in the test suite 2024-09-16T07:33:01.809 INFO:teuthology.orchestra.run.smithi115.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-16T07:33:01.809 INFO:teuthology.orchestra.run.smithi115.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-16T07:33:01.809 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:33:01.809 INFO:teuthology.orchestra.run.smithi115.stdout: # 1m isn't quite enough 2024-09-16T07:33:01.809 INFO:teuthology.orchestra.run.smithi115.stdout: mon_down_mkfs_grace = 2m 2024-09-16T07:33:01.809 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:33:01.809 INFO:teuthology.orchestra.run.smithi115.stdout: mon_warn_on_filestore_osds = false 2024-09-16T07:33:01.809 INFO:teuthology.orchestra.run.smithi115.stdout: mon min osdmap epochs = 50 2024-09-16T07:33:01.809 INFO:teuthology.orchestra.run.smithi115.stdout: mon osdmap full prune interval = 2 2024-09-16T07:33:01.809 INFO:teuthology.orchestra.run.smithi115.stdout: mon osdmap full prune min = 15 2024-09-16T07:33:01.810 INFO:teuthology.orchestra.run.smithi115.stdout: mon osdmap full prune txsize = 2 2024-09-16T07:33:01.810 INFO:teuthology.orchestra.run.smithi115.stdout: paxos service trim min = 10 2024-09-16T07:33:01.810 INFO:teuthology.orchestra.run.smithi115.stdout: osd pool default crimson = True 2024-09-16T07:33:01.810 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:33:01.810 INFO:teuthology.orchestra.run.smithi115.stdout:[client] 2024-09-16T07:33:01.810 INFO:teuthology.orchestra.run.smithi115.stdout: rgw cache enabled = true 2024-09-16T07:33:01.810 INFO:teuthology.orchestra.run.smithi115.stdout: rgw enable ops log = true 2024-09-16T07:33:01.810 INFO:teuthology.orchestra.run.smithi115.stdout: rgw enable usage log = true 2024-09-16T07:33:01.810 INFO:teuthology.orchestra.run.smithi115.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-16T07:33:01.810 INFO:teuthology.orchestra.run.smithi115.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-16T07:33:01.810 INFO:teuthology.orchestra.run.smithi115.stdout:[mon.a] 2024-09-16T07:33:01.810 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.0] 2024-09-16T07:33:01.810 INFO:teuthology.orchestra.run.smithi115.stdout: crimson seastar cpu cores = 0-1 2024-09-16T07:33:01.810 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.1] 2024-09-16T07:33:01.811 INFO:teuthology.orchestra.run.smithi115.stdout: crimson seastar cpu cores = 2-3 2024-09-16T07:33:01.811 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.2] 2024-09-16T07:33:01.811 INFO:teuthology.orchestra.run.smithi115.stdout: crimson seastar cpu cores = 4-5 2024-09-16T07:33:01.812 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-16T07:33:01.812 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-16T07:33:01.918 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-16T07:33:01.918 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-16T07:33:01.918 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-16T07:33:01.934 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-16T07:33:01.934 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-16T07:33:01.989 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi115.front.sepia.ceph.com 2024-09-16T07:33:01.989 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-16T07:33:01.989 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-16T07:33:01.989 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-16T07:33:02.063 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-16T07:33:02.063 DEBUG:teuthology.orchestra.run.smithi115:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-16T07:33:02.118 INFO:tasks.ceph:Setting up mon nodes... 2024-09-16T07:33:02.119 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-16T07:33:02.119 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-16T07:33:02.219 INFO:teuthology.orchestra.run.smithi115.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-16T07:33:02.221 INFO:tasks.ceph:Setting up mds nodes... 2024-09-16T07:33:02.221 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-16T07:33:02.222 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-16T07:33:02.271 INFO:teuthology.orchestra.run.smithi115.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-16T07:33:02.284 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-16T07:33:02.284 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi115.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2024-09-16T07:33:02.284 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-16T07:33:02.309 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-16T07:33:02.309 INFO:tasks.ceph:role: osd.0 2024-09-16T07:33:02.309 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi115.front.sepia.ceph.com 2024-09-16T07:33:02.309 DEBUG:teuthology.orchestra.run.smithi115:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-16T07:33:02.381 INFO:teuthology.orchestra.run.smithi115.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T07:33:02.381 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T07:33:02.381 INFO:teuthology.orchestra.run.smithi115.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T07:33:02.381 INFO:teuthology.orchestra.run.smithi115.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-16T07:33:02.381 INFO:teuthology.orchestra.run.smithi115.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T07:33:02.381 INFO:teuthology.orchestra.run.smithi115.stdout: = sunit=0 swidth=0 blks 2024-09-16T07:33:02.381 INFO:teuthology.orchestra.run.smithi115.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T07:33:02.381 INFO:teuthology.orchestra.run.smithi115.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-16T07:33:02.381 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T07:33:02.381 INFO:teuthology.orchestra.run.smithi115.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T07:33:02.892 INFO:teuthology.orchestra.run.smithi115.stdout:Discarding blocks...Done. 2024-09-16T07:33:02.894 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi115.front.sepia.ceph.com -o noatime 2024-09-16T07:33:02.894 DEBUG:teuthology.orchestra.run.smithi115:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-16T07:33:03.029 DEBUG:teuthology.orchestra.run.smithi115:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-16T07:33:03.062 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-16T07:33:03.129 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-16T07:33:03.129 INFO:tasks.ceph:role: osd.1 2024-09-16T07:33:03.129 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi115.front.sepia.ceph.com 2024-09-16T07:33:03.129 DEBUG:teuthology.orchestra.run.smithi115:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-16T07:33:03.202 INFO:teuthology.orchestra.run.smithi115.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T07:33:03.203 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T07:33:03.203 INFO:teuthology.orchestra.run.smithi115.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T07:33:03.203 INFO:teuthology.orchestra.run.smithi115.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-16T07:33:03.203 INFO:teuthology.orchestra.run.smithi115.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T07:33:03.203 INFO:teuthology.orchestra.run.smithi115.stdout: = sunit=0 swidth=0 blks 2024-09-16T07:33:03.203 INFO:teuthology.orchestra.run.smithi115.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T07:33:03.203 INFO:teuthology.orchestra.run.smithi115.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-16T07:33:03.203 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T07:33:03.203 INFO:teuthology.orchestra.run.smithi115.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T07:33:03.658 INFO:teuthology.orchestra.run.smithi115.stdout:Discarding blocks...Done. 2024-09-16T07:33:03.660 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi115.front.sepia.ceph.com -o noatime 2024-09-16T07:33:03.660 DEBUG:teuthology.orchestra.run.smithi115:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-16T07:33:03.754 DEBUG:teuthology.orchestra.run.smithi115:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-16T07:33:03.784 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-16T07:33:03.850 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-16T07:33:03.850 INFO:tasks.ceph:role: osd.2 2024-09-16T07:33:03.850 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi115.front.sepia.ceph.com 2024-09-16T07:33:03.850 DEBUG:teuthology.orchestra.run.smithi115:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-16T07:33:03.922 INFO:teuthology.orchestra.run.smithi115.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T07:33:03.923 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T07:33:03.923 INFO:teuthology.orchestra.run.smithi115.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T07:33:03.923 INFO:teuthology.orchestra.run.smithi115.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-16T07:33:03.923 INFO:teuthology.orchestra.run.smithi115.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T07:33:03.923 INFO:teuthology.orchestra.run.smithi115.stdout: = sunit=0 swidth=0 blks 2024-09-16T07:33:03.923 INFO:teuthology.orchestra.run.smithi115.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T07:33:03.923 INFO:teuthology.orchestra.run.smithi115.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-16T07:33:03.923 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T07:33:03.923 INFO:teuthology.orchestra.run.smithi115.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T07:33:04.421 INFO:teuthology.orchestra.run.smithi115.stdout:Discarding blocks...Done. 2024-09-16T07:33:04.423 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi115.front.sepia.ceph.com -o noatime 2024-09-16T07:33:04.423 DEBUG:teuthology.orchestra.run.smithi115:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-16T07:33:04.555 DEBUG:teuthology.orchestra.run.smithi115:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-16T07:33:04.588 DEBUG:teuthology.orchestra.run.smithi115:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T07:33:04.881 INFO:teuthology.orchestra.run.smithi115.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T07:33:04.882 INFO:teuthology.orchestra.run.smithi115.stderr:INFO 2024-09-16 07:33:04,884 seastar - Reactor backend: linux-aio 2024-09-16T07:33:04.897 INFO:teuthology.orchestra.run.smithi115.stderr:==27877==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T07:33:05.028 INFO:teuthology.orchestra.run.smithi115.stderr:INFO 2024-09-16 07:33:05,030 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-16T07:33:05.028 INFO:teuthology.orchestra.run.smithi115.stderr:INFO 2024-09-16 07:33:05,030 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 0-1 2024-09-16T07:33:05.029 INFO:teuthology.orchestra.run.smithi115.stderr:DEBUG 2024-09-16 07:33:05,030 [shard 0:main] seastar - reactor::drain 2024-09-16T07:33:05.548 INFO:teuthology.orchestra.run.smithi115.stderr:----------------------------------------------------- 2024-09-16T07:33:05.549 INFO:teuthology.orchestra.run.smithi115.stderr:Suppressions used: 2024-09-16T07:33:05.549 INFO:teuthology.orchestra.run.smithi115.stderr: count bytes template 2024-09-16T07:33:05.549 INFO:teuthology.orchestra.run.smithi115.stderr: 1 8 MallocExtension::Register 2024-09-16T07:33:05.549 INFO:teuthology.orchestra.run.smithi115.stderr:----------------------------------------------------- 2024-09-16T07:33:05.549 INFO:teuthology.orchestra.run.smithi115.stderr: 2024-09-16T07:33:05.608 INFO:teuthology.orchestra.run.smithi115.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T07:33:05.612 INFO:teuthology.orchestra.run.smithi115.stderr:INFO 2024-09-16 07:33:05,613 seastar - Reactor backend: linux-aio 2024-09-16T07:33:05.619 INFO:teuthology.orchestra.run.smithi115.stderr:==27875==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T07:33:10.295 INFO:teuthology.orchestra.run.smithi115.stderr:----------------------------------------------------- 2024-09-16T07:33:10.295 INFO:teuthology.orchestra.run.smithi115.stderr:Suppressions used: 2024-09-16T07:33:10.295 INFO:teuthology.orchestra.run.smithi115.stderr: count bytes template 2024-09-16T07:33:10.295 INFO:teuthology.orchestra.run.smithi115.stderr: 1 8 MallocExtension::Register 2024-09-16T07:33:10.295 INFO:teuthology.orchestra.run.smithi115.stderr:----------------------------------------------------- 2024-09-16T07:33:10.295 INFO:teuthology.orchestra.run.smithi115.stderr: 2024-09-16T07:33:10.317 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-16T07:33:10.343 DEBUG:teuthology.orchestra.run.smithi115:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T07:33:10.633 INFO:teuthology.orchestra.run.smithi115.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T07:33:10.634 INFO:teuthology.orchestra.run.smithi115.stderr:INFO 2024-09-16 07:33:10,636 seastar - Reactor backend: linux-aio 2024-09-16T07:33:10.639 INFO:teuthology.orchestra.run.smithi115.stderr:==28061==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T07:33:10.745 INFO:teuthology.orchestra.run.smithi115.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x3613ff6 0x5fdd113 0x5fdd518 0x5fdd8fa 0x6038b24 0x5fb8d06 0x5fb923a 0x5e00fef 0x5e19231 0x71579d2 0x71691a5 0x716a642 0x716a6c7 0x716a7c9 0x716a8c1 0x716aace 0x716acb4 0x716b003 0x716b3a7 0x716b5d7 0x716b841 0x716bb0e 0x716bd2c 0x716bde4 0x716beaa 0x716bf8b 0x5c63e30 0x5c63f3a 0x5c63ff6 0x5c640b2 0x5c6416e 0x5c642bb 0x5c64446 0x5c64807 0x5c7e60a 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3962bc0 0x396439a 0x3804c28 0x2958f 0x2963f 0x35ec9b4 2024-09-16T07:33:10.745 INFO:teuthology.orchestra.run.smithi115.stderr:kernel callstack: 2024-09-16T07:33:10.760 INFO:teuthology.orchestra.run.smithi115.stderr:INFO 2024-09-16 07:33:10,762 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-16T07:33:10.760 INFO:teuthology.orchestra.run.smithi115.stderr:INFO 2024-09-16 07:33:10,762 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 2-3 2024-09-16T07:33:10.761 INFO:teuthology.orchestra.run.smithi115.stderr:DEBUG 2024-09-16 07:33:10,763 [shard 0:main] seastar - reactor::drain 2024-09-16T07:33:11.265 INFO:teuthology.orchestra.run.smithi115.stderr:----------------------------------------------------- 2024-09-16T07:33:11.265 INFO:teuthology.orchestra.run.smithi115.stderr:Suppressions used: 2024-09-16T07:33:11.265 INFO:teuthology.orchestra.run.smithi115.stderr: count bytes template 2024-09-16T07:33:11.265 INFO:teuthology.orchestra.run.smithi115.stderr: 1 8 MallocExtension::Register 2024-09-16T07:33:11.265 INFO:teuthology.orchestra.run.smithi115.stderr:----------------------------------------------------- 2024-09-16T07:33:11.266 INFO:teuthology.orchestra.run.smithi115.stderr: 2024-09-16T07:33:11.323 INFO:teuthology.orchestra.run.smithi115.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T07:33:11.327 INFO:teuthology.orchestra.run.smithi115.stderr:INFO 2024-09-16 07:33:11,329 seastar - Reactor backend: linux-aio 2024-09-16T07:33:11.343 INFO:teuthology.orchestra.run.smithi115.stderr:==28059==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T07:33:11.408 INFO:teuthology.orchestra.run.smithi115.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x4abd0 0x5fe9be6 0x5fe9dae 0x5fe9fdf 0x5fea2b5 0x60389b3 0x6038bb9 0x5fb8d06 0x5fb923a 0x5e00fef 0x5e19231 0x71579d2 0x71691a5 0x716a642 0x716a6c7 0x716a7c9 0x716a8c1 0x716aace 0x716acb4 0x716b003 0x716b3a7 0x716b5d7 0x716b841 0x716bb0e 0x716bd2c 0x716bde4 0x716beaa 0x716bf8b 0x5c63e30 0x5c63f3a 0x5c63ff6 0x5c640b2 0x5c6416e 0x5c642bb 0x5c64446 0x5c64807 0x5c7e60a 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T07:33:11.408 INFO:teuthology.orchestra.run.smithi115.stderr:kernel callstack: 2024-09-16T07:33:16.016 INFO:teuthology.orchestra.run.smithi115.stderr:----------------------------------------------------- 2024-09-16T07:33:16.040 INFO:teuthology.orchestra.run.smithi115.stderr:Suppressions used: 2024-09-16T07:33:16.040 INFO:teuthology.orchestra.run.smithi115.stderr: count bytes template 2024-09-16T07:33:16.040 INFO:teuthology.orchestra.run.smithi115.stderr: 1 8 MallocExtension::Register 2024-09-16T07:33:16.040 INFO:teuthology.orchestra.run.smithi115.stderr:----------------------------------------------------- 2024-09-16T07:33:16.040 INFO:teuthology.orchestra.run.smithi115.stderr: 2024-09-16T07:33:16.042 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-16T07:33:16.066 DEBUG:teuthology.orchestra.run.smithi115:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T07:33:16.354 INFO:teuthology.orchestra.run.smithi115.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T07:33:16.354 INFO:teuthology.orchestra.run.smithi115.stderr:INFO 2024-09-16 07:33:16,353 seastar - Reactor backend: linux-aio 2024-09-16T07:33:16.356 INFO:teuthology.orchestra.run.smithi115.stderr:==28246==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T07:33:16.476 INFO:teuthology.orchestra.run.smithi115.stderr:INFO 2024-09-16 07:33:16,477 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-16T07:33:16.477 INFO:teuthology.orchestra.run.smithi115.stderr:INFO 2024-09-16 07:33:16,478 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 4-5 2024-09-16T07:33:16.477 INFO:teuthology.orchestra.run.smithi115.stderr:DEBUG 2024-09-16 07:33:16,478 [shard 0:main] seastar - reactor::drain 2024-09-16T07:33:16.982 INFO:teuthology.orchestra.run.smithi115.stderr:----------------------------------------------------- 2024-09-16T07:33:16.982 INFO:teuthology.orchestra.run.smithi115.stderr:Suppressions used: 2024-09-16T07:33:16.982 INFO:teuthology.orchestra.run.smithi115.stderr: count bytes template 2024-09-16T07:33:16.982 INFO:teuthology.orchestra.run.smithi115.stderr: 1 8 MallocExtension::Register 2024-09-16T07:33:16.982 INFO:teuthology.orchestra.run.smithi115.stderr:----------------------------------------------------- 2024-09-16T07:33:16.983 INFO:teuthology.orchestra.run.smithi115.stderr: 2024-09-16T07:33:17.040 INFO:teuthology.orchestra.run.smithi115.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T07:33:17.044 INFO:teuthology.orchestra.run.smithi115.stderr:INFO 2024-09-16 07:33:17,045 seastar - Reactor backend: linux-aio 2024-09-16T07:33:17.061 INFO:teuthology.orchestra.run.smithi115.stderr:==28244==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T07:33:21.724 INFO:teuthology.orchestra.run.smithi115.stderr:----------------------------------------------------- 2024-09-16T07:33:21.724 INFO:teuthology.orchestra.run.smithi115.stderr:Suppressions used: 2024-09-16T07:33:21.724 INFO:teuthology.orchestra.run.smithi115.stderr: count bytes template 2024-09-16T07:33:21.724 INFO:teuthology.orchestra.run.smithi115.stderr: 1 8 MallocExtension::Register 2024-09-16T07:33:21.724 INFO:teuthology.orchestra.run.smithi115.stderr:----------------------------------------------------- 2024-09-16T07:33:21.724 INFO:teuthology.orchestra.run.smithi115.stderr: 2024-09-16T07:33:21.746 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-16T07:33:21.772 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-16T07:33:21.772 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-16T07:33:21.772 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-16T07:33:21.836 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-16T07:33:21.836 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-16T07:33:21.900 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-16T07:33:21.900 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-16T07:33:21.965 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-16T07:33:21.965 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-16T07:33:22.029 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-16T07:33:22.029 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-16T07:33:22.085 INFO:tasks.ceph:Adding keys to all mons... 2024-09-16T07:33:22.085 DEBUG:teuthology.orchestra.run.smithi115:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-16T07:33:22.148 INFO:teuthology.orchestra.run.smithi115.stdout:[mgr.x] 2024-09-16T07:33:22.148 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQAu3+dm1nIlDRAA6AGQ/22XVxq0blL5+AYFPg== 2024-09-16T07:33:22.148 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.0] 2024-09-16T07:33:22.148 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQAx3+dmAZHULRAAum6Dfum1HcQjz5OxZAlWRA== 2024-09-16T07:33:22.148 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.1] 2024-09-16T07:33:22.148 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQA33+dmNt0qHRAARiGUqlV0cGveQ+uroEG+JA== 2024-09-16T07:33:22.149 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.2] 2024-09-16T07:33:22.149 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQA93+dmmWMpDBAAXY/cioRukqXLYFkO00ydfA== 2024-09-16T07:33:22.149 INFO:teuthology.orchestra.run.smithi115.stdout:[client.0] 2024-09-16T07:33:22.149 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQAu3+dmZ7BGEBAAfVEXZtWhCyft0BkjkPKXGA== 2024-09-16T07:33:22.150 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-16T07:33:22.251 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T07:33:22.312 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T07:33:22.373 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T07:33:22.434 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-16T07:33:22.499 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-16T07:33:22.500 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-16T07:33:22.524 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-16T07:33:22.629 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T07:33:22.630+0000 7eff8143bc00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:22.629 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T07:33:22.630+0000 7eff8143bc00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:22.642 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-16T07:33:22.667 DEBUG:teuthology.orchestra.run.smithi115:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-16T07:33:22.722 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-16T07:33:22.723 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-16T07:33:22.723 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-16T07:33:22.765 INFO:tasks.ceph.mon.a:Started 2024-09-16T07:33:22.766 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-16T07:33:22.766 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-16T07:33:22.766 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-16T07:33:22.768 INFO:tasks.ceph.mgr.x:Started 2024-09-16T07:33:22.768 DEBUG:tasks.ceph:set 0 configs 2024-09-16T07:33:22.769 INFO:tasks.ceph:Setting crush tunables to default 2024-09-16T07:33:22.769 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph osd crush tunables default 2024-09-16T07:33:22.847 INFO:tasks.ceph.mon.a.smithi115.stderr:2024-09-16T07:33:22.847+0000 7fb2f1e57c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:22.847 INFO:tasks.ceph.mon.a.smithi115.stderr:2024-09-16T07:33:22.847+0000 7fb2f1e57c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:22.847 INFO:tasks.ceph.mon.a.smithi115.stderr:2024-09-16T07:33:22.848+0000 7fb2f1e57c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:22.849 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-09-16T07:33:22.850+0000 7f95ec229000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:22.887 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T07:33:22.882+0000 7fae430c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:22.892 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T07:33:22.893+0000 7fae430c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:22.960 INFO:teuthology.orchestra.run.smithi115.stderr:adjusted tunables profile to default 2024-09-16T07:33:22.972 INFO:tasks.ceph:check_enable_crimson: True 2024-09-16T07:33:22.972 INFO:tasks.ceph:check_enable_crimson: setting set-allow-crimson 2024-09-16T07:33:22.973 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph osd set-allow-crimson --yes-i-really-mean-it 2024-09-16T07:33:23.055 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-09-16T07:33:23.056+0000 7f95ec229000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:23.055 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-09-16T07:33:23.056+0000 7f95ec229000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:23.079 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T07:33:23.075+0000 7f49bdf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:23.082 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T07:33:23.083+0000 7f49bdf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:23.163 INFO:tasks.ceph.mon.a.smithi115.stderr:2024-09-16T07:33:23.164+0000 7fb2e87f4640 -1 WARNING: experimental feature 'crimson' is enabled 2024-09-16T07:33:23.163 INFO:tasks.ceph.mon.a.smithi115.stderr:Please be aware that this feature is experimental, untested, 2024-09-16T07:33:23.163 INFO:tasks.ceph.mon.a.smithi115.stderr:unsupported, and may result in data corruption, data loss, 2024-09-16T07:33:23.163 INFO:tasks.ceph.mon.a.smithi115.stderr:and/or irreparable damage to your cluster. Do not use 2024-09-16T07:33:23.163 INFO:tasks.ceph.mon.a.smithi115.stderr:feature with important data. 2024-09-16T07:33:23.163 INFO:tasks.ceph.mon.a.smithi115.stderr: 2024-09-16T07:33:23.974 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-16T07:33:23.975 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-16T07:33:23.975 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-16T07:33:24.000 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-16T07:33:24.000 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-16T07:33:24.065 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-16T07:33:24.065 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-16T07:33:24.130 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph osd new 0a21085c-3d09-4977-9a2b-3283296cc2b2 0 2024-09-16T07:33:24.278 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T07:33:24.273+0000 7f1f69791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:24.281 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T07:33:24.282+0000 7f1f69791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:24.360 INFO:teuthology.orchestra.run.smithi115.stdout:0 2024-09-16T07:33:24.371 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph osd new 6e18cc80-ae51-4fdd-a98d-2e94ecef5335 1 2024-09-16T07:33:24.479 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T07:33:24.473+0000 7f37ef591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:24.482 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T07:33:24.483+0000 7f37ef591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:24.560 INFO:teuthology.orchestra.run.smithi115.stdout:1 2024-09-16T07:33:24.572 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph osd new 5116e0ce-2987-4710-91a0-d1ed0d7ae9ae 2 2024-09-16T07:33:24.680 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T07:33:24.674+0000 7fa605551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:24.683 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T07:33:24.684+0000 7fa605551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:24.761 INFO:teuthology.orchestra.run.smithi115.stdout:2 2024-09-16T07:33:24.772 DEBUG:teuthology.orchestra.run.smithi115:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.0.log 2024-09-16T07:33:24.802 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-16T07:33:24.802 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2024-09-16T07:33:24.844 INFO:tasks.ceph.osd.0:Started 2024-09-16T07:33:24.845 DEBUG:teuthology.orchestra.run.smithi115:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.1.log 2024-09-16T07:33:24.873 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-16T07:33:24.874 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2>> /var/log/ceph/ceph-osd.1.log 2024-09-16T07:33:24.916 INFO:tasks.ceph.osd.1:Started 2024-09-16T07:33:24.916 DEBUG:teuthology.orchestra.run.smithi115:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.2.log 2024-09-16T07:33:24.949 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-16T07:33:24.949 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log 2024-09-16T07:33:24.993 INFO:tasks.ceph.osd.2:Started 2024-09-16T07:33:24.993 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:33:25.117 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T07:33:25.113+0000 7f8bffebd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:25.122 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T07:33:25.123+0000 7f8bffebd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:25.192 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:33:25.192 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":6,"fsid":"c399a571-d66b-4a13-8ade-7d949db2bd08","created":"2024-09-16T07:33:22.877946+0000","modified":"2024-09-16T07:33:24.761978+0000","last_up_change":"0.000000","last_in_change":"2024-09-16T07:33:24.761978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"0a21085c-3d09-4977-9a2b-3283296cc2b2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6e18cc80-ae51-4fdd-a98d-2e94ecef5335","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5116e0ce-2987-4710-91a0-d1ed0d7ae9ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:33:25.206 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-16T07:33:25.206 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-16T07:33:25.508 DEBUG:teuthology.orchestra.run.smithi115:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-16T07:33:25.614 INFO:teuthology.misc.health.smithi115.stderr:2024-09-16T07:33:25.608+0000 7fcca7063640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:25.616 INFO:teuthology.misc.health.smithi115.stderr:2024-09-16T07:33:25.617+0000 7fcca7063640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:25.685 INFO:teuthology.misc.health.smithi115.stdout: 2024-09-16T07:33:25.685 INFO:teuthology.misc.health.smithi115.stdout:{"epoch":6,"fsid":"c399a571-d66b-4a13-8ade-7d949db2bd08","created":"2024-09-16T07:33:22.877946+0000","modified":"2024-09-16T07:33:24.761978+0000","last_up_change":"0.000000","last_in_change":"2024-09-16T07:33:24.761978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"0a21085c-3d09-4977-9a2b-3283296cc2b2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6e18cc80-ae51-4fdd-a98d-2e94ecef5335","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5116e0ce-2987-4710-91a0-d1ed0d7ae9ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:33:25.697 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-09-16T07:33:28.396 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-09-16T07:33:28.396+0000 7f9589953640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-16T07:33:32.000 DEBUG:teuthology.orchestra.run.smithi115:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-16T07:33:32.110 INFO:teuthology.misc.health.smithi115.stderr:2024-09-16T07:33:32.107+0000 7fc85fd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:32.113 INFO:teuthology.misc.health.smithi115.stderr:2024-09-16T07:33:32.114+0000 7fc85fd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:32.304 INFO:teuthology.misc.health.smithi115.stdout: 2024-09-16T07:33:32.304 INFO:teuthology.misc.health.smithi115.stdout:{"epoch":9,"fsid":"c399a571-d66b-4a13-8ade-7d949db2bd08","created":"2024-09-16T07:33:22.877946+0000","modified":"2024-09-16T07:33:31.405375+0000","last_up_change":"2024-09-16T07:33:31.405375+0000","last_in_change":"2024-09-16T07:33:24.761978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"0a21085c-3d09-4977-9a2b-3283296cc2b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":2264958825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":2264958825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":2264958825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":2264958825}]},"public_addr":"172.21.15.115:6809/2264958825","cluster_addr":"172.21.15.115:6808/2264958825","heartbeat_back_addr":"172.21.15.115:6812/2264958825","heartbeat_front_addr":"172.21.15.115:6810/2264958825","state":["exists","up"]},{"osd":1,"uuid":"6e18cc80-ae51-4fdd-a98d-2e94ecef5335","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":796798594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":796798594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":796798594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6803","nonce":796798594}]},"public_addr":"172.21.15.115:6804/796798594","cluster_addr":"172.21.15.115:6805/796798594","heartbeat_back_addr":"172.21.15.115:6802/796798594","heartbeat_front_addr":"172.21.15.115:6803/796798594","state":["exists","up"]},{"osd":2,"uuid":"5116e0ce-2987-4710-91a0-d1ed0d7ae9ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6807","nonce":2726377752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":2726377752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":2726377752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":2726377752}]},"public_addr":"172.21.15.115:6807/2726377752","cluster_addr":"172.21.15.115:6806/2726377752","heartbeat_back_addr":"172.21.15.115:6814/2726377752","heartbeat_front_addr":"172.21.15.115:6813/2726377752","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:33:32.315 DEBUG:teuthology.misc:3 of 3 OSDs are up 2024-09-16T07:33:32.315 INFO:tasks.ceph:Creating RBD pool 2024-09-16T07:33:32.315 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-16T07:33:32.428 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T07:33:32.420+0000 7f4698abd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:32.432 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T07:33:32.433+0000 7f4698abd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:33.406 INFO:teuthology.orchestra.run.smithi115.stderr:pool 'rbd' created 2024-09-16T07:33:33.431 DEBUG:teuthology.orchestra.run.smithi115:> rbd --cluster ceph pool init rbd 2024-09-16T07:33:33.535 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T07:33:33.536+0000 7f79f0fedac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:33.535 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T07:33:33.536+0000 7f79f0fedac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:33.541 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T07:33:33.542+0000 7f79f0fedac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:36.475 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-16T07:33:36.476 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-16T07:33:36.477 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-16T07:33:36.586 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T07:33:36.582+0000 7f9bc1abd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:36.590 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T07:33:36.591+0000 7f9bc1abd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:36.776 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:33:36.789 INFO:teuthology.orchestra.run.smithi115.stdout:[{"version":1,"timestamp":"0.000000","name":"","changes":[]}] 2024-09-16T07:33:36.789 INFO:tasks.ceph_manager:config epoch is 1 2024-09-16T07:33:36.789 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-16T07:33:36.789 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-16T07:33:36.789 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-16T07:33:36.897 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T07:33:36.894+0000 7f287ab91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:36.900 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T07:33:36.901+0000 7f287ab91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:37.136 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:33:37.147 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":5,"flags":0,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":1471221561},{"type":"v1","addr":"172.21.15.115:6801","nonce":1471221561}]},"active_addr":"172.21.15.115:6801/1471221561","active_change":"2024-09-16T07:33:27.389420+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.115:0","nonce":181500461}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.115:0","nonce":4276325750}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.115:0","nonce":79420704}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.115:0","nonce":4080068921}]}]} 2024-09-16T07:33:37.150 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-16T07:33:37.150 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-16T07:33:37.150 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:33:37.258 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T07:33:37.254+0000 7f792df91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:37.261 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T07:33:37.262+0000 7f792df91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:37.450 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:33:37.450 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":14,"fsid":"c399a571-d66b-4a13-8ade-7d949db2bd08","created":"2024-09-16T07:33:22.877946+0000","modified":"2024-09-16T07:33:36.425524+0000","last_up_change":"2024-09-16T07:33:31.405375+0000","last_in_change":"2024-09-16T07:33:24.761978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:33:31.413925+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-16T07:33:32.624710+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":14,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0a21085c-3d09-4977-9a2b-3283296cc2b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":2264958825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":2264958825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":2264958825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":2264958825}]},"public_addr":"172.21.15.115:6809/2264958825","cluster_addr":"172.21.15.115:6808/2264958825","heartbeat_back_addr":"172.21.15.115:6812/2264958825","heartbeat_front_addr":"172.21.15.115:6810/2264958825","state":["exists","up"]},{"osd":1,"uuid":"6e18cc80-ae51-4fdd-a98d-2e94ecef5335","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":796798594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":796798594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":796798594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6803","nonce":796798594}]},"public_addr":"172.21.15.115:6804/796798594","cluster_addr":"172.21.15.115:6805/796798594","heartbeat_back_addr":"172.21.15.115:6802/796798594","heartbeat_front_addr":"172.21.15.115:6803/796798594","state":["exists","up"]},{"osd":2,"uuid":"5116e0ce-2987-4710-91a0-d1ed0d7ae9ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6807","nonce":2726377752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":2726377752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":2726377752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":2726377752}]},"public_addr":"172.21.15.115:6807/2726377752","cluster_addr":"172.21.15.115:6806/2726377752","heartbeat_back_addr":"172.21.15.115:6814/2726377752","heartbeat_front_addr":"172.21.15.115:6813/2726377752","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:33:37.463 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-16T07:33:37.463 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:33:37.572 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T07:33:37.569+0000 7ff89df11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:37.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T07:33:37.576+0000 7ff89df11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:37.760 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:33:37.761 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":14,"fsid":"c399a571-d66b-4a13-8ade-7d949db2bd08","created":"2024-09-16T07:33:22.877946+0000","modified":"2024-09-16T07:33:36.425524+0000","last_up_change":"2024-09-16T07:33:31.405375+0000","last_in_change":"2024-09-16T07:33:24.761978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:33:31.413925+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-16T07:33:32.624710+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":14,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0a21085c-3d09-4977-9a2b-3283296cc2b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":2264958825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":2264958825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":2264958825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":2264958825}]},"public_addr":"172.21.15.115:6809/2264958825","cluster_addr":"172.21.15.115:6808/2264958825","heartbeat_back_addr":"172.21.15.115:6812/2264958825","heartbeat_front_addr":"172.21.15.115:6810/2264958825","state":["exists","up"]},{"osd":1,"uuid":"6e18cc80-ae51-4fdd-a98d-2e94ecef5335","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":796798594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":796798594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":796798594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6803","nonce":796798594}]},"public_addr":"172.21.15.115:6804/796798594","cluster_addr":"172.21.15.115:6805/796798594","heartbeat_back_addr":"172.21.15.115:6802/796798594","heartbeat_front_addr":"172.21.15.115:6803/796798594","state":["exists","up"]},{"osd":2,"uuid":"5116e0ce-2987-4710-91a0-d1ed0d7ae9ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6807","nonce":2726377752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":2726377752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":2726377752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":2726377752}]},"public_addr":"172.21.15.115:6807/2726377752","cluster_addr":"172.21.15.115:6806/2726377752","heartbeat_back_addr":"172.21.15.115:6814/2726377752","heartbeat_front_addr":"172.21.15.115:6813/2726377752","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:33:37.774 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-16T07:33:37.774 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-16T07:33:37.775 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-16T07:33:37.888 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T07:33:37.884+0000 7f0e6b591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:37.888 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T07:33:37.884+0000 7f26f4d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:37.889 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T07:33:37.884+0000 7fc892191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:37.892 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T07:33:37.893+0000 7f0e6b591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:37.892 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T07:33:37.893+0000 7fc892191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:37.893 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T07:33:37.894+0000 7f26f4d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:37.925 INFO:teuthology.orchestra.run.smithi115.stdout:34359738375 2024-09-16T07:33:37.925 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-16T07:33:37.928 INFO:teuthology.orchestra.run.smithi115.stdout:38654705670 2024-09-16T07:33:37.928 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-16T07:33:37.929 INFO:teuthology.orchestra.run.smithi115.stdout:38654705670 2024-09-16T07:33:37.929 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-16T07:33:38.038 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T07:33:38.034+0000 7f098b791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:38.043 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T07:33:38.044+0000 7f098b791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:38.082 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T07:33:38.078+0000 7fa681351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:38.086 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T07:33:38.088+0000 7fa681351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:38.092 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T07:33:38.087+0000 7fa8a2f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:38.097 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T07:33:38.099+0000 7fa8a2f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:38.259 INFO:teuthology.orchestra.run.smithi115.stdout:34359738375 2024-09-16T07:33:38.272 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738375 for osd.1 2024-09-16T07:33:38.273 DEBUG:teuthology.parallel:result is None 2024-09-16T07:33:38.288 INFO:teuthology.orchestra.run.smithi115.stdout:38654705670 2024-09-16T07:33:38.301 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.0 2024-09-16T07:33:38.302 DEBUG:teuthology.parallel:result is None 2024-09-16T07:33:38.308 INFO:teuthology.orchestra.run.smithi115.stdout:38654705670 2024-09-16T07:33:38.320 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.2 2024-09-16T07:33:38.321 DEBUG:teuthology.parallel:result is None 2024-09-16T07:33:38.321 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T07:33:38.321 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:33:38.470 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T07:33:38.467+0000 7fed9e991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:38.473 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T07:33:38.474+0000 7fed9e991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:38.657 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:33:38.657 INFO:teuthology.orchestra.run.smithi115.stderr:dumped all 2024-09-16T07:33:38.669 INFO:teuthology.orchestra.run.smithi115.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2024-09-16T07:33:37.916609+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":283115520,"kb_used":81004,"kb_used_data":476,"kb_used_omap":0,"kb_used_meta":80448,"kb_avail":283034516,"statfs":{"total":289910292480,"available":289827344384,"internally_reserved":0,"allocated":487424,"data_stored":1268746,"data_compressed":60100,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":82378752},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:33:36.452480+0000","last_change":"2024-09-16T07:33:36.455637+0000","last_active":"2024-09-16T07:33:36.452480+0000","last_peered":"2024-09-16T07:33:36.452480+0000","last_clean":"2024-09-16T07:33:36.452480+0000","last_became_active":"2024-09-16T07:33:34.518531+0000","last_became_peered":"2024-09-16T07:33:34.518531+0000","last_unstale":"2024-09-16T07:33:36.452480+0000","last_undegraded":"2024-09-16T07:33:36.452480+0000","last_fullsized":"2024-09-16T07:33:36.452480+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_clean_scrub_stamp":"2024-09-16T07:33:33.407142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:33:36.459166+0000","last_change":"2024-09-16T07:33:36.462702+0000","last_active":"2024-09-16T07:33:36.459166+0000","last_peered":"2024-09-16T07:33:36.459166+0000","last_clean":"2024-09-16T07:33:36.459166+0000","last_became_active":"2024-09-16T07:33:34.538238+0000","last_became_peered":"2024-09-16T07:33:34.538238+0000","last_unstale":"2024-09-16T07:33:36.459166+0000","last_undegraded":"2024-09-16T07:33:36.459166+0000","last_fullsized":"2024-09-16T07:33:36.459166+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_clean_scrub_stamp":"2024-09-16T07:33:33.407142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:33:36.448141+0000","last_change":"2024-09-16T07:33:36.455932+0000","last_active":"2024-09-16T07:33:36.448141+0000","last_peered":"2024-09-16T07:33:36.448141+0000","last_clean":"2024-09-16T07:33:36.448141+0000","last_became_active":"2024-09-16T07:33:34.499685+0000","last_became_peered":"2024-09-16T07:33:34.499685+0000","last_unstale":"2024-09-16T07:33:36.448141+0000","last_undegraded":"2024-09-16T07:33:36.448141+0000","last_fullsized":"2024-09-16T07:33:36.448141+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_clean_scrub_stamp":"2024-09-16T07:33:33.407142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:33:36.456115+0000","last_change":"2024-09-16T07:33:36.461997+0000","last_active":"2024-09-16T07:33:36.456115+0000","last_peered":"2024-09-16T07:33:36.456115+0000","last_clean":"2024-09-16T07:33:36.456115+0000","last_became_active":"2024-09-16T07:33:34.525935+0000","last_became_peered":"2024-09-16T07:33:34.525935+0000","last_unstale":"2024-09-16T07:33:36.456115+0000","last_undegraded":"2024-09-16T07:33:36.456115+0000","last_fullsized":"2024-09-16T07:33:36.456115+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_clean_scrub_stamp":"2024-09-16T07:33:33.407142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":17,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:33:36.459257+0000","last_change":"2024-09-16T07:33:36.459257+0000","last_active":"2024-09-16T07:33:36.459257+0000","last_peered":"2024-09-16T07:33:36.459257+0000","last_clean":"2024-09-16T07:33:36.459257+0000","last_became_active":"2024-09-16T07:33:34.504968+0000","last_became_peered":"2024-09-16T07:33:34.504968+0000","last_unstale":"2024-09-16T07:33:36.459257+0000","last_undegraded":"2024-09-16T07:33:36.459257+0000","last_fullsized":"2024-09-16T07:33:36.459257+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_clean_scrub_stamp":"2024-09-16T07:33:33.407142+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:33:36.456445+0000","last_change":"2024-09-16T07:33:36.458863+0000","last_active":"2024-09-16T07:33:36.456445+0000","last_peered":"2024-09-16T07:33:36.456445+0000","last_clean":"2024-09-16T07:33:36.456445+0000","last_became_active":"2024-09-16T07:33:34.534328+0000","last_became_peered":"2024-09-16T07:33:34.534328+0000","last_unstale":"2024-09-16T07:33:36.456445+0000","last_undegraded":"2024-09-16T07:33:36.456445+0000","last_fullsized":"2024-09-16T07:33:36.456445+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_clean_scrub_stamp":"2024-09-16T07:33:33.407142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:33:36.453358+0000","last_change":"2024-09-16T07:33:36.455952+0000","last_active":"2024-09-16T07:33:36.453358+0000","last_peered":"2024-09-16T07:33:36.453358+0000","last_clean":"2024-09-16T07:33:36.453358+0000","last_became_active":"2024-09-16T07:33:34.511137+0000","last_became_peered":"2024-09-16T07:33:34.511137+0000","last_unstale":"2024-09-16T07:33:36.453358+0000","last_undegraded":"2024-09-16T07:33:36.453358+0000","last_fullsized":"2024-09-16T07:33:36.453358+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_clean_scrub_stamp":"2024-09-16T07:33:33.407142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:33:36.458298+0000","last_change":"2024-09-16T07:33:36.462968+0000","last_active":"2024-09-16T07:33:36.458298+0000","last_peered":"2024-09-16T07:33:36.458298+0000","last_clean":"2024-09-16T07:33:36.458298+0000","last_became_active":"2024-09-16T07:33:34.503858+0000","last_became_peered":"2024-09-16T07:33:34.503858+0000","last_unstale":"2024-09-16T07:33:36.458298+0000","last_undegraded":"2024-09-16T07:33:36.458298+0000","last_fullsized":"2024-09-16T07:33:36.458298+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_clean_scrub_stamp":"2024-09-16T07:33:33.407142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":84,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:33:36.451765+0000","last_change":"2024-09-16T07:33:33.474665+0000","last_active":"2024-09-16T07:33:36.451765+0000","last_peered":"2024-09-16T07:33:36.451765+0000","last_clean":"2024-09-16T07:33:36.451765+0000","last_became_active":"2024-09-16T07:33:33.464426+0000","last_became_peered":"2024-09-16T07:33:33.464426+0000","last_unstale":"2024-09-16T07:33:36.451765+0000","last_undegraded":"2024-09-16T07:33:36.451765+0000","last_fullsized":"2024-09-16T07:33:36.451765+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:32.406213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:32.406213+0000","last_clean_scrub_stamp":"2024-09-16T07:33:32.406213+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30050,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26948,"kb_used_data":116,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344892,"statfs":{"total":96636764160,"available":96609169408,"internally_reserved":0,"allocated":118784,"data_stored":29324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738375,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27028,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344812,"statfs":{"total":96636764160,"available":96609087488,"internally_reserved":0,"allocated":184320,"data_stored":619711,"data_compressed":30050,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27028,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344812,"statfs":{"total":96636764160,"available":96609087488,"internally_reserved":0,"allocated":184320,"data_stored":619711,"data_compressed":30050,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30050,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:33:38.670 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:33:38.778 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T07:33:38.775+0000 7fe2cd151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:38.781 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T07:33:38.782+0000 7fe2cd151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:38.966 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:33:38.966 INFO:teuthology.orchestra.run.smithi115.stderr:dumped all 2024-09-16T07:33:38.979 INFO:teuthology.orchestra.run.smithi115.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2024-09-16T07:33:37.916609+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":283115520,"kb_used":81004,"kb_used_data":476,"kb_used_omap":0,"kb_used_meta":80448,"kb_avail":283034516,"statfs":{"total":289910292480,"available":289827344384,"internally_reserved":0,"allocated":487424,"data_stored":1268746,"data_compressed":60100,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":82378752},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:33:36.452480+0000","last_change":"2024-09-16T07:33:36.455637+0000","last_active":"2024-09-16T07:33:36.452480+0000","last_peered":"2024-09-16T07:33:36.452480+0000","last_clean":"2024-09-16T07:33:36.452480+0000","last_became_active":"2024-09-16T07:33:34.518531+0000","last_became_peered":"2024-09-16T07:33:34.518531+0000","last_unstale":"2024-09-16T07:33:36.452480+0000","last_undegraded":"2024-09-16T07:33:36.452480+0000","last_fullsized":"2024-09-16T07:33:36.452480+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_clean_scrub_stamp":"2024-09-16T07:33:33.407142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:33:36.459166+0000","last_change":"2024-09-16T07:33:36.462702+0000","last_active":"2024-09-16T07:33:36.459166+0000","last_peered":"2024-09-16T07:33:36.459166+0000","last_clean":"2024-09-16T07:33:36.459166+0000","last_became_active":"2024-09-16T07:33:34.538238+0000","last_became_peered":"2024-09-16T07:33:34.538238+0000","last_unstale":"2024-09-16T07:33:36.459166+0000","last_undegraded":"2024-09-16T07:33:36.459166+0000","last_fullsized":"2024-09-16T07:33:36.459166+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_clean_scrub_stamp":"2024-09-16T07:33:33.407142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:33:36.448141+0000","last_change":"2024-09-16T07:33:36.455932+0000","last_active":"2024-09-16T07:33:36.448141+0000","last_peered":"2024-09-16T07:33:36.448141+0000","last_clean":"2024-09-16T07:33:36.448141+0000","last_became_active":"2024-09-16T07:33:34.499685+0000","last_became_peered":"2024-09-16T07:33:34.499685+0000","last_unstale":"2024-09-16T07:33:36.448141+0000","last_undegraded":"2024-09-16T07:33:36.448141+0000","last_fullsized":"2024-09-16T07:33:36.448141+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_clean_scrub_stamp":"2024-09-16T07:33:33.407142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:33:36.456115+0000","last_change":"2024-09-16T07:33:36.461997+0000","last_active":"2024-09-16T07:33:36.456115+0000","last_peered":"2024-09-16T07:33:36.456115+0000","last_clean":"2024-09-16T07:33:36.456115+0000","last_became_active":"2024-09-16T07:33:34.525935+0000","last_became_peered":"2024-09-16T07:33:34.525935+0000","last_unstale":"2024-09-16T07:33:36.456115+0000","last_undegraded":"2024-09-16T07:33:36.456115+0000","last_fullsized":"2024-09-16T07:33:36.456115+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_clean_scrub_stamp":"2024-09-16T07:33:33.407142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":17,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:33:36.459257+0000","last_change":"2024-09-16T07:33:36.459257+0000","last_active":"2024-09-16T07:33:36.459257+0000","last_peered":"2024-09-16T07:33:36.459257+0000","last_clean":"2024-09-16T07:33:36.459257+0000","last_became_active":"2024-09-16T07:33:34.504968+0000","last_became_peered":"2024-09-16T07:33:34.504968+0000","last_unstale":"2024-09-16T07:33:36.459257+0000","last_undegraded":"2024-09-16T07:33:36.459257+0000","last_fullsized":"2024-09-16T07:33:36.459257+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_clean_scrub_stamp":"2024-09-16T07:33:33.407142+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:33:36.456445+0000","last_change":"2024-09-16T07:33:36.458863+0000","last_active":"2024-09-16T07:33:36.456445+0000","last_peered":"2024-09-16T07:33:36.456445+0000","last_clean":"2024-09-16T07:33:36.456445+0000","last_became_active":"2024-09-16T07:33:34.534328+0000","last_became_peered":"2024-09-16T07:33:34.534328+0000","last_unstale":"2024-09-16T07:33:36.456445+0000","last_undegraded":"2024-09-16T07:33:36.456445+0000","last_fullsized":"2024-09-16T07:33:36.456445+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_clean_scrub_stamp":"2024-09-16T07:33:33.407142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:33:36.453358+0000","last_change":"2024-09-16T07:33:36.455952+0000","last_active":"2024-09-16T07:33:36.453358+0000","last_peered":"2024-09-16T07:33:36.453358+0000","last_clean":"2024-09-16T07:33:36.453358+0000","last_became_active":"2024-09-16T07:33:34.511137+0000","last_became_peered":"2024-09-16T07:33:34.511137+0000","last_unstale":"2024-09-16T07:33:36.453358+0000","last_undegraded":"2024-09-16T07:33:36.453358+0000","last_fullsized":"2024-09-16T07:33:36.453358+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_clean_scrub_stamp":"2024-09-16T07:33:33.407142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:33:36.458298+0000","last_change":"2024-09-16T07:33:36.462968+0000","last_active":"2024-09-16T07:33:36.458298+0000","last_peered":"2024-09-16T07:33:36.458298+0000","last_clean":"2024-09-16T07:33:36.458298+0000","last_became_active":"2024-09-16T07:33:34.503858+0000","last_became_peered":"2024-09-16T07:33:34.503858+0000","last_unstale":"2024-09-16T07:33:36.458298+0000","last_undegraded":"2024-09-16T07:33:36.458298+0000","last_fullsized":"2024-09-16T07:33:36.458298+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_clean_scrub_stamp":"2024-09-16T07:33:33.407142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":84,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:33:36.451765+0000","last_change":"2024-09-16T07:33:33.474665+0000","last_active":"2024-09-16T07:33:36.451765+0000","last_peered":"2024-09-16T07:33:36.451765+0000","last_clean":"2024-09-16T07:33:36.451765+0000","last_became_active":"2024-09-16T07:33:33.464426+0000","last_became_peered":"2024-09-16T07:33:33.464426+0000","last_unstale":"2024-09-16T07:33:36.451765+0000","last_undegraded":"2024-09-16T07:33:36.451765+0000","last_fullsized":"2024-09-16T07:33:36.451765+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:32.406213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:32.406213+0000","last_clean_scrub_stamp":"2024-09-16T07:33:32.406213+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30050,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26948,"kb_used_data":116,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344892,"statfs":{"total":96636764160,"available":96609169408,"internally_reserved":0,"allocated":118784,"data_stored":29324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738375,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27028,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344812,"statfs":{"total":96636764160,"available":96609087488,"internally_reserved":0,"allocated":184320,"data_stored":619711,"data_compressed":30050,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27028,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344812,"statfs":{"total":96636764160,"available":96609087488,"internally_reserved":0,"allocated":184320,"data_stored":619711,"data_compressed":30050,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30050,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:33:38.980 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T07:33:38.980 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-16T07:33:38.980 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-16T07:33:38.980 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-16T07:33:39.087 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T07:33:39.086+0000 7fe60ded1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:39.091 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T07:33:39.092+0000 7fe60ded1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:39.312 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T07:33:39.312 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-16T07:33:39.328 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-16T07:33:39.328 INFO:teuthology.run_tasks:Running task workunit... 2024-09-16T07:33:39.377 INFO:tasks.workunit:Pulling workunits from ref 0325fd3c11a225c0fd9eb38fab88aad1370ad779 2024-09-16T07:33:39.377 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-16T07:33:39.378 DEBUG:teuthology.orchestra.run.smithi115:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-16T07:33:39.393 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T07:33:39.393 INFO:teuthology.orchestra.run.smithi115.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-16T07:33:39.394 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-16T07:33:39.450 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-16T07:33:39.450 DEBUG:teuthology.orchestra.run.smithi115:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-16T07:33:39.506 INFO:tasks.workunit:timeout=3h 2024-09-16T07:33:39.506 INFO:tasks.workunit:cleanup=True 2024-09-16T07:33:39.506 DEBUG:teuthology.orchestra.run.smithi115:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 0325fd3c11a225c0fd9eb38fab88aad1370ad779 2024-09-16T07:33:39.563 INFO:tasks.workunit.client.0.smithi115.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-16T07:34:30.727 INFO:tasks.workunit.client.0.smithi115.stderr:Note: switching to '0325fd3c11a225c0fd9eb38fab88aad1370ad779'. 2024-09-16T07:34:30.728 INFO:tasks.workunit.client.0.smithi115.stderr: 2024-09-16T07:34:30.728 INFO:tasks.workunit.client.0.smithi115.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-16T07:34:30.728 INFO:tasks.workunit.client.0.smithi115.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-16T07:34:30.728 INFO:tasks.workunit.client.0.smithi115.stderr:state without impacting any branches by switching back to a branch. 2024-09-16T07:34:30.728 INFO:tasks.workunit.client.0.smithi115.stderr: 2024-09-16T07:34:30.728 INFO:tasks.workunit.client.0.smithi115.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-16T07:34:30.728 INFO:tasks.workunit.client.0.smithi115.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-16T07:34:30.728 INFO:tasks.workunit.client.0.smithi115.stderr: 2024-09-16T07:34:30.728 INFO:tasks.workunit.client.0.smithi115.stderr: git switch -c 2024-09-16T07:34:30.728 INFO:tasks.workunit.client.0.smithi115.stderr: 2024-09-16T07:34:30.728 INFO:tasks.workunit.client.0.smithi115.stderr:Or undo this operation with: 2024-09-16T07:34:30.729 INFO:tasks.workunit.client.0.smithi115.stderr: 2024-09-16T07:34:30.729 INFO:tasks.workunit.client.0.smithi115.stderr: git switch - 2024-09-16T07:34:30.729 INFO:tasks.workunit.client.0.smithi115.stderr: 2024-09-16T07:34:30.729 INFO:tasks.workunit.client.0.smithi115.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-16T07:34:30.729 INFO:tasks.workunit.client.0.smithi115.stderr: 2024-09-16T07:34:30.729 INFO:tasks.workunit.client.0.smithi115.stderr:HEAD is now at 0325fd3c11a Merge pull request #58530 from zdover23/wip-doc-2024-07-11-radosgw-s3-authentication 2024-09-16T07:34:30.731 DEBUG:teuthology.orchestra.run.smithi115:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-16T07:34:30.826 INFO:tasks.workunit.client.0.smithi115.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-16T07:34:30.828 INFO:tasks.workunit.client.0.smithi115.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-16T07:34:30.829 INFO:tasks.workunit.client.0.smithi115.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-16T07:34:31.400 INFO:tasks.workunit.client.0.smithi115.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-16T07:34:31.476 INFO:tasks.workunit.client.0.smithi115.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-16T07:34:31.517 INFO:tasks.workunit.client.0.smithi115.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-16T07:34:31.519 INFO:tasks.workunit.client.0.smithi115.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-16T07:34:31.519 INFO:tasks.workunit.client.0.smithi115.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-16T07:34:31.559 INFO:tasks.workunit.client.0.smithi115.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-16T07:34:31.562 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-16T07:34:31.562 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-16T07:34:31.578 INFO:tasks.workunit:Running workunits matching rbd/crimson/test_crimson_librbd.sh on client.0... 2024-09-16T07:34:31.580 INFO:tasks.workunit:Running workunit rbd/crimson/test_crimson_librbd.sh... 2024-09-16T07:34:31.584 DEBUG:teuthology.orchestra.run.smithi115:workunit test rbd/crimson/test_crimson_librbd.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0325fd3c11a225c0fd9eb38fab88aad1370ad779 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_FEATURES=61 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/crimson/test_crimson_librbd.sh 2024-09-16T07:34:31.687 INFO:tasks.workunit.client.0.smithi115.stdout:seed 30516 2024-09-16T07:34:31.687 INFO:tasks.workunit.client.0.smithi115.stdout:Note: Google Test filter = TestLibRBD.* 2024-09-16T07:34:31.687 INFO:tasks.workunit.client.0.smithi115.stdout:[==========] Running 171 tests from 1 test suite. 2024-09-16T07:34:31.687 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] Global test environment set-up. 2024-09-16T07:34:31.688 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] 171 tests from TestLibRBD 2024-09-16T07:34:31.733 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.CreateAndStat 2024-09-16T07:34:32.900 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:34:35.113 INFO:tasks.workunit.client.0.smithi115.stdout:image has size 2097152 and order 22 2024-09-16T07:34:35.113 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.CreateAndStat (3380 ms) 2024-09-16T07:34:35.113 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.CreateWithSameDataPool 2024-09-16T07:34:35.114 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:34:35.275 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.CreateWithSameDataPool (161 ms) 2024-09-16T07:34:35.275 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.CreateAndStatPP 2024-09-16T07:34:35.275 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:34:35.452 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.CreateAndStatPP (178 ms) 2024-09-16T07:34:35.452 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.GetId 2024-09-16T07:34:35.453 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:34:35.717 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.GetId (265 ms) 2024-09-16T07:34:35.718 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.GetIdPP 2024-09-16T07:34:35.718 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:34:35.980 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.GetIdPP (263 ms) 2024-09-16T07:34:35.980 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.GetBlockNamePrefix 2024-09-16T07:34:35.980 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:34:36.151 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.GetBlockNamePrefix (170 ms) 2024-09-16T07:34:36.151 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.GetBlockNamePrefixPP 2024-09-16T07:34:36.151 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:34:36.318 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.GetBlockNamePrefixPP (167 ms) 2024-09-16T07:34:36.318 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.TestGetCreateTimestamp 2024-09-16T07:34:36.318 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:34:36.490 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.TestGetCreateTimestamp (172 ms) 2024-09-16T07:34:36.490 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.GetCreateTimestampPP 2024-09-16T07:34:36.490 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:34:36.657 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.GetCreateTimestampPP (167 ms) 2024-09-16T07:34:36.657 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.OpenAio 2024-09-16T07:34:36.657 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:34:36.828 INFO:tasks.workunit.client.0.smithi115.stdout:image has size 2097152 and order 22 2024-09-16T07:34:36.828 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.OpenAio (172 ms) 2024-09-16T07:34:36.828 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.OpenAioFail 2024-09-16T07:34:36.839 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.OpenAioFail (11 ms) 2024-09-16T07:34:36.840 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.OpenAioPP 2024-09-16T07:34:36.840 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:34:37.105 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.OpenAioPP (264 ms) 2024-09-16T07:34:37.105 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.OpenAioFailPP 2024-09-16T07:34:37.114 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.OpenAioFailPP (11 ms) 2024-09-16T07:34:37.114 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.ResizeAndStat 2024-09-16T07:34:37.115 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:34:37.561 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.ResizeAndStat (446 ms) 2024-09-16T07:34:37.561 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.ResizeAndStatPP 2024-09-16T07:34:37.561 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:34:37.932 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.ResizeAndStatPP (371 ms) 2024-09-16T07:34:37.932 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.UpdateWatchAndResize 2024-09-16T07:34:37.932 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:34:38.377 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.UpdateWatchAndResize (445 ms) 2024-09-16T07:34:38.377 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.UpdateWatchAndResizePP 2024-09-16T07:34:38.377 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:34:38.816 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.UpdateWatchAndResizePP (439 ms) 2024-09-16T07:34:38.816 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.TestCreateLsDelete 2024-09-16T07:34:40.189 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:34:42.077 INFO:tasks.workunit.client.0.smithi115.stdout:image: image18 2024-09-16T07:34:42.078 INFO:tasks.workunit.client.0.smithi115.stdout:expected = image18 2024-09-16T07:34:42.078 INFO:tasks.workunit.client.0.smithi115.stdout:found image18 2024-09-16T07:34:42.078 INFO:tasks.workunit.client.0.smithi115.stdout:erased image18 2024-09-16T07:34:42.078 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:34:42.925 INFO:tasks.workunit.client.0.smithi115.stdout:image: image18 2024-09-16T07:34:42.925 INFO:tasks.workunit.client.0.smithi115.stdout:image: image19 2024-09-16T07:34:42.925 INFO:tasks.workunit.client.0.smithi115.stdout:expected = image18 2024-09-16T07:34:42.925 INFO:tasks.workunit.client.0.smithi115.stdout:found image18 2024-09-16T07:34:42.925 INFO:tasks.workunit.client.0.smithi115.stdout:erased image18 2024-09-16T07:34:42.925 INFO:tasks.workunit.client.0.smithi115.stdout:expected = image19 2024-09-16T07:34:42.925 INFO:tasks.workunit.client.0.smithi115.stdout:found image19 2024-09-16T07:34:42.925 INFO:tasks.workunit.client.0.smithi115.stdout:erased image19 2024-09-16T07:34:42.925 INFO:tasks.workunit.client.0.smithi115.stdout:image: image19 2024-09-16T07:34:42.925 INFO:tasks.workunit.client.0.smithi115.stdout:expected = image19 2024-09-16T07:34:42.926 INFO:tasks.workunit.client.0.smithi115.stdout:found image19 2024-09-16T07:34:42.926 INFO:tasks.workunit.client.0.smithi115.stdout:erased image19 2024-09-16T07:34:42.926 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.TestCreateLsDelete (4109 ms) 2024-09-16T07:34:42.926 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.TestCreateLsDeletePP 2024-09-16T07:34:44.956 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:34:47.116 INFO:tasks.workunit.client.0.smithi115.stdout:num images is: 1 2024-09-16T07:34:47.116 INFO:tasks.workunit.client.0.smithi115.stdout:expected: 1 2024-09-16T07:34:47.116 INFO:tasks.workunit.client.0.smithi115.stdout:image: image20 2024-09-16T07:34:47.116 INFO:tasks.workunit.client.0.smithi115.stdout:expected = image20 2024-09-16T07:34:47.116 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:34:47.202 INFO:tasks.workunit.client.0.smithi115.stdout:num images is: 2 2024-09-16T07:34:47.202 INFO:tasks.workunit.client.0.smithi115.stdout:expected: 2 2024-09-16T07:34:47.202 INFO:tasks.workunit.client.0.smithi115.stdout:image: image20 2024-09-16T07:34:47.202 INFO:tasks.workunit.client.0.smithi115.stdout:image: image21 2024-09-16T07:34:47.202 INFO:tasks.workunit.client.0.smithi115.stdout:expected = image20 2024-09-16T07:34:47.202 INFO:tasks.workunit.client.0.smithi115.stdout:expected = image21 2024-09-16T07:34:47.885 INFO:tasks.workunit.client.0.smithi115.stdout:num images is: 1 2024-09-16T07:34:47.885 INFO:tasks.workunit.client.0.smithi115.stdout:expected: 1 2024-09-16T07:34:47.885 INFO:tasks.workunit.client.0.smithi115.stdout:image: image21 2024-09-16T07:34:47.885 INFO:tasks.workunit.client.0.smithi115.stdout:expected = image21 2024-09-16T07:34:47.885 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.TestCreateLsDeletePP (4960 ms) 2024-09-16T07:34:47.885 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.TestCopy 2024-09-16T07:34:48.973 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:34:56.562 INFO:tasks.workunit.client.0.smithi115.stdout:image: image22 2024-09-16T07:34:56.563 INFO:tasks.workunit.client.0.smithi115.stdout:expected = image22 2024-09-16T07:34:56.563 INFO:tasks.workunit.client.0.smithi115.stdout:found image22 2024-09-16T07:34:56.563 INFO:tasks.workunit.client.0.smithi115.stdout:erased image22 2024-09-16T07:34:56.563 INFO:tasks.workunit.client.0.smithi115.stdout:image: image22 2024-09-16T07:34:56.563 INFO:tasks.workunit.client.0.smithi115.stdout:image: image23 2024-09-16T07:34:56.563 INFO:tasks.workunit.client.0.smithi115.stdout:expected = image22 2024-09-16T07:34:56.563 INFO:tasks.workunit.client.0.smithi115.stdout:found image22 2024-09-16T07:34:56.563 INFO:tasks.workunit.client.0.smithi115.stdout:erased image22 2024-09-16T07:34:56.563 INFO:tasks.workunit.client.0.smithi115.stdout:expected = image23 2024-09-16T07:34:56.564 INFO:tasks.workunit.client.0.smithi115.stdout:found image23 2024-09-16T07:34:56.564 INFO:tasks.workunit.client.0.smithi115.stdout:erased image23 2024-09-16T07:34:56.564 INFO:tasks.workunit.client.0.smithi115.stdout:100.00% done 2024-09-16T07:34:56.564 INFO:tasks.workunit.client.0.smithi115.stdout:image: image22 2024-09-16T07:34:56.564 INFO:tasks.workunit.client.0.smithi115.stdout:image: image23 2024-09-16T07:34:56.564 INFO:tasks.workunit.client.0.smithi115.stdout:image: image24 2024-09-16T07:34:56.564 INFO:tasks.workunit.client.0.smithi115.stdout:expected = image22 2024-09-16T07:34:56.564 INFO:tasks.workunit.client.0.smithi115.stdout:found image22 2024-09-16T07:34:56.564 INFO:tasks.workunit.client.0.smithi115.stdout:erased image22 2024-09-16T07:34:56.564 INFO:tasks.workunit.client.0.smithi115.stdout:expected = image23 2024-09-16T07:34:56.564 INFO:tasks.workunit.client.0.smithi115.stdout:found image23 2024-09-16T07:34:56.564 INFO:tasks.workunit.client.0.smithi115.stdout:erased image23 2024-09-16T07:34:56.565 INFO:tasks.workunit.client.0.smithi115.stdout:expected = image24 2024-09-16T07:34:56.565 INFO:tasks.workunit.client.0.smithi115.stdout:found image24 2024-09-16T07:34:56.565 INFO:tasks.workunit.client.0.smithi115.stdout:erased image24 2024-09-16T07:34:56.565 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.TestCopy (8678 ms) 2024-09-16T07:34:56.565 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.TestCopyPP 2024-09-16T07:34:57.990 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:35:04.242 INFO:tasks.workunit.client.0.smithi115.stdout:num images is: 1 2024-09-16T07:35:04.242 INFO:tasks.workunit.client.0.smithi115.stdout:expected: 1 2024-09-16T07:35:04.242 INFO:tasks.workunit.client.0.smithi115.stdout:image: image25 2024-09-16T07:35:04.242 INFO:tasks.workunit.client.0.smithi115.stdout:expected = image25 2024-09-16T07:35:04.458 INFO:tasks.workunit.client.0.smithi115.stdout:num images is: 2 2024-09-16T07:35:04.458 INFO:tasks.workunit.client.0.smithi115.stdout:expected: 2 2024-09-16T07:35:04.458 INFO:tasks.workunit.client.0.smithi115.stdout:image: image25 2024-09-16T07:35:04.458 INFO:tasks.workunit.client.0.smithi115.stdout:image: image26 2024-09-16T07:35:04.458 INFO:tasks.workunit.client.0.smithi115.stdout:expected = image25 2024-09-16T07:35:04.458 INFO:tasks.workunit.client.0.smithi115.stdout:expected = image26 2024-09-16T07:35:05.132 INFO:tasks.workunit.client.0.smithi115.stdout:100.00% done 2024-09-16T07:35:05.132 INFO:tasks.workunit.client.0.smithi115.stdout:num images is: 3 2024-09-16T07:35:05.133 INFO:tasks.workunit.client.0.smithi115.stdout:expected: 3 2024-09-16T07:35:05.133 INFO:tasks.workunit.client.0.smithi115.stdout:image: image25 2024-09-16T07:35:05.133 INFO:tasks.workunit.client.0.smithi115.stdout:image: image26 2024-09-16T07:35:05.133 INFO:tasks.workunit.client.0.smithi115.stdout:image: image27 2024-09-16T07:35:05.133 INFO:tasks.workunit.client.0.smithi115.stdout:expected = image25 2024-09-16T07:35:05.133 INFO:tasks.workunit.client.0.smithi115.stdout:expected = image26 2024-09-16T07:35:05.133 INFO:tasks.workunit.client.0.smithi115.stdout:expected = image27 2024-09-16T07:35:05.737 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.TestCopyPP (9175 ms) 2024-09-16T07:35:05.737 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.TestDeepCopy 2024-09-16T07:35:07.023 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:35:21.082 INFO:tasks.workunit.client.0.smithi115.stdout:image: image28 2024-09-16T07:35:21.082 INFO:tasks.workunit.client.0.smithi115.stdout:expected = image28 2024-09-16T07:35:21.082 INFO:tasks.workunit.client.0.smithi115.stdout:found image28 2024-09-16T07:35:21.083 INFO:tasks.workunit.client.0.smithi115.stdout:erased image28 2024-09-16T07:35:21.083 INFO:tasks.workunit.client.0.smithi115.stdout:image: image28 2024-09-16T07:35:21.083 INFO:tasks.workunit.client.0.smithi115.stdout:image: image29 2024-09-16T07:35:21.083 INFO:tasks.workunit.client.0.smithi115.stdout:expected = image28 2024-09-16T07:35:21.083 INFO:tasks.workunit.client.0.smithi115.stdout:found image28 2024-09-16T07:35:21.083 INFO:tasks.workunit.client.0.smithi115.stdout:erased image28 2024-09-16T07:35:21.083 INFO:tasks.workunit.client.0.smithi115.stdout:expected = image29 2024-09-16T07:35:21.083 INFO:tasks.workunit.client.0.smithi115.stdout:found image29 2024-09-16T07:35:21.083 INFO:tasks.workunit.client.0.smithi115.stdout:erased image29 2024-09-16T07:35:21.083 INFO:tasks.workunit.client.0.smithi115.stdout:100.00% done 2024-09-16T07:35:21.083 INFO:tasks.workunit.client.0.smithi115.stdout:image: image28 2024-09-16T07:35:21.083 INFO:tasks.workunit.client.0.smithi115.stdout:image: image29 2024-09-16T07:35:21.083 INFO:tasks.workunit.client.0.smithi115.stdout:image: image30 2024-09-16T07:35:21.084 INFO:tasks.workunit.client.0.smithi115.stdout:expected = image28 2024-09-16T07:35:21.084 INFO:tasks.workunit.client.0.smithi115.stdout:found image28 2024-09-16T07:35:21.084 INFO:tasks.workunit.client.0.smithi115.stdout:erased image28 2024-09-16T07:35:21.084 INFO:tasks.workunit.client.0.smithi115.stdout:expected = image29 2024-09-16T07:35:21.084 INFO:tasks.workunit.client.0.smithi115.stdout:found image29 2024-09-16T07:35:21.084 INFO:tasks.workunit.client.0.smithi115.stdout:erased image29 2024-09-16T07:35:21.084 INFO:tasks.workunit.client.0.smithi115.stdout:expected = image30 2024-09-16T07:35:21.084 INFO:tasks.workunit.client.0.smithi115.stdout:found image30 2024-09-16T07:35:21.084 INFO:tasks.workunit.client.0.smithi115.stdout:erased image30 2024-09-16T07:35:21.084 INFO:tasks.workunit.client.0.smithi115.stdout:image: image28 2024-09-16T07:35:21.084 INFO:tasks.workunit.client.0.smithi115.stdout:image: image29 2024-09-16T07:35:21.084 INFO:tasks.workunit.client.0.smithi115.stdout:image: image30 2024-09-16T07:35:21.084 INFO:tasks.workunit.client.0.smithi115.stdout:image: image31 2024-09-16T07:35:21.085 INFO:tasks.workunit.client.0.smithi115.stdout:expected = image28 2024-09-16T07:35:21.085 INFO:tasks.workunit.client.0.smithi115.stdout:found image28 2024-09-16T07:35:21.085 INFO:tasks.workunit.client.0.smithi115.stdout:erased image28 2024-09-16T07:35:21.085 INFO:tasks.workunit.client.0.smithi115.stdout:expected = image29 2024-09-16T07:35:21.085 INFO:tasks.workunit.client.0.smithi115.stdout:found image29 2024-09-16T07:35:21.085 INFO:tasks.workunit.client.0.smithi115.stdout:erased image29 2024-09-16T07:35:21.085 INFO:tasks.workunit.client.0.smithi115.stdout:expected = image30 2024-09-16T07:35:21.085 INFO:tasks.workunit.client.0.smithi115.stdout:found image30 2024-09-16T07:35:21.085 INFO:tasks.workunit.client.0.smithi115.stdout:erased image30 2024-09-16T07:35:21.085 INFO:tasks.workunit.client.0.smithi115.stdout:expected = image31 2024-09-16T07:35:21.085 INFO:tasks.workunit.client.0.smithi115.stdout:found image31 2024-09-16T07:35:21.085 INFO:tasks.workunit.client.0.smithi115.stdout:erased image31 2024-09-16T07:35:21.085 INFO:tasks.workunit.client.0.smithi115.stdout:image: image28 2024-09-16T07:35:21.086 INFO:tasks.workunit.client.0.smithi115.stdout:image: image29 2024-09-16T07:35:21.086 INFO:tasks.workunit.client.0.smithi115.stdout:image: image30 2024-09-16T07:35:21.086 INFO:tasks.workunit.client.0.smithi115.stdout:image: image31 2024-09-16T07:35:21.086 INFO:tasks.workunit.client.0.smithi115.stdout:image: image32 2024-09-16T07:35:21.086 INFO:tasks.workunit.client.0.smithi115.stdout:expected = image28 2024-09-16T07:35:21.086 INFO:tasks.workunit.client.0.smithi115.stdout:found image28 2024-09-16T07:35:21.086 INFO:tasks.workunit.client.0.smithi115.stdout:erased image28 2024-09-16T07:35:21.086 INFO:tasks.workunit.client.0.smithi115.stdout:expected = image29 2024-09-16T07:35:21.086 INFO:tasks.workunit.client.0.smithi115.stdout:found image29 2024-09-16T07:35:21.086 INFO:tasks.workunit.client.0.smithi115.stdout:erased image29 2024-09-16T07:35:21.086 INFO:tasks.workunit.client.0.smithi115.stdout:expected = image30 2024-09-16T07:35:21.086 INFO:tasks.workunit.client.0.smithi115.stdout:found image30 2024-09-16T07:35:21.086 INFO:tasks.workunit.client.0.smithi115.stdout:erased image30 2024-09-16T07:35:21.087 INFO:tasks.workunit.client.0.smithi115.stdout:expected = image31 2024-09-16T07:35:21.087 INFO:tasks.workunit.client.0.smithi115.stdout:found image31 2024-09-16T07:35:21.087 INFO:tasks.workunit.client.0.smithi115.stdout:erased image31 2024-09-16T07:35:21.087 INFO:tasks.workunit.client.0.smithi115.stdout:expected = image32 2024-09-16T07:35:21.087 INFO:tasks.workunit.client.0.smithi115.stdout:found image32 2024-09-16T07:35:21.087 INFO:tasks.workunit.client.0.smithi115.stdout:erased image32 2024-09-16T07:35:21.087 INFO:tasks.workunit.client.0.smithi115.stdout:100.00% done 2024-09-16T07:35:21.087 INFO:tasks.workunit.client.0.smithi115.stdout:image: image28 2024-09-16T07:35:21.087 INFO:tasks.workunit.client.0.smithi115.stdout:image: image29 2024-09-16T07:35:21.087 INFO:tasks.workunit.client.0.smithi115.stdout:image: image30 2024-09-16T07:35:21.087 INFO:tasks.workunit.client.0.smithi115.stdout:image: image31 2024-09-16T07:35:21.087 INFO:tasks.workunit.client.0.smithi115.stdout:image: image32 2024-09-16T07:35:21.087 INFO:tasks.workunit.client.0.smithi115.stdout:image: image33 2024-09-16T07:35:21.088 INFO:tasks.workunit.client.0.smithi115.stdout:expected = image28 2024-09-16T07:35:21.088 INFO:tasks.workunit.client.0.smithi115.stdout:found image28 2024-09-16T07:35:21.088 INFO:tasks.workunit.client.0.smithi115.stdout:erased image28 2024-09-16T07:35:21.088 INFO:tasks.workunit.client.0.smithi115.stdout:expected = image29 2024-09-16T07:35:21.088 INFO:tasks.workunit.client.0.smithi115.stdout:found image29 2024-09-16T07:35:21.088 INFO:tasks.workunit.client.0.smithi115.stdout:erased image29 2024-09-16T07:35:21.088 INFO:tasks.workunit.client.0.smithi115.stdout:expected = image30 2024-09-16T07:35:21.088 INFO:tasks.workunit.client.0.smithi115.stdout:found image30 2024-09-16T07:35:21.088 INFO:tasks.workunit.client.0.smithi115.stdout:erased image30 2024-09-16T07:35:21.088 INFO:tasks.workunit.client.0.smithi115.stdout:expected = image31 2024-09-16T07:35:21.088 INFO:tasks.workunit.client.0.smithi115.stdout:found image31 2024-09-16T07:35:21.088 INFO:tasks.workunit.client.0.smithi115.stdout:erased image31 2024-09-16T07:35:21.089 INFO:tasks.workunit.client.0.smithi115.stdout:expected = image32 2024-09-16T07:35:21.089 INFO:tasks.workunit.client.0.smithi115.stdout:found image32 2024-09-16T07:35:21.089 INFO:tasks.workunit.client.0.smithi115.stdout:erased image32 2024-09-16T07:35:21.089 INFO:tasks.workunit.client.0.smithi115.stdout:expected = image33 2024-09-16T07:35:21.089 INFO:tasks.workunit.client.0.smithi115.stdout:found image33 2024-09-16T07:35:21.089 INFO:tasks.workunit.client.0.smithi115.stdout:erased image33 2024-09-16T07:35:21.089 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.TestDeepCopy (15344 ms) 2024-09-16T07:35:21.089 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.TestDeepCopyPP 2024-09-16T07:35:23.065 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:35:29.451 INFO:tasks.workunit.client.0.smithi115.stdout:num images is: 1 2024-09-16T07:35:29.451 INFO:tasks.workunit.client.0.smithi115.stdout:expected: 1 2024-09-16T07:35:29.451 INFO:tasks.workunit.client.0.smithi115.stdout:image: image34 2024-09-16T07:35:29.451 INFO:tasks.workunit.client.0.smithi115.stdout:expected = image34 2024-09-16T07:35:29.768 INFO:tasks.workunit.client.0.smithi115.stdout:num images is: 2 2024-09-16T07:35:29.768 INFO:tasks.workunit.client.0.smithi115.stdout:expected: 2 2024-09-16T07:35:29.768 INFO:tasks.workunit.client.0.smithi115.stdout:image: image34 2024-09-16T07:35:29.768 INFO:tasks.workunit.client.0.smithi115.stdout:image: image35 2024-09-16T07:35:29.768 INFO:tasks.workunit.client.0.smithi115.stdout:expected = image34 2024-09-16T07:35:29.768 INFO:tasks.workunit.client.0.smithi115.stdout:expected = image35 2024-09-16T07:35:30.602 INFO:tasks.workunit.client.0.smithi115.stdout:100.00% done 2024-09-16T07:35:30.602 INFO:tasks.workunit.client.0.smithi115.stdout:num images is: 3 2024-09-16T07:35:30.602 INFO:tasks.workunit.client.0.smithi115.stdout:expected: 3 2024-09-16T07:35:30.602 INFO:tasks.workunit.client.0.smithi115.stdout:image: image34 2024-09-16T07:35:30.602 INFO:tasks.workunit.client.0.smithi115.stdout:image: image35 2024-09-16T07:35:30.602 INFO:tasks.workunit.client.0.smithi115.stdout:image: image36 2024-09-16T07:35:30.602 INFO:tasks.workunit.client.0.smithi115.stdout:expected = image34 2024-09-16T07:35:30.602 INFO:tasks.workunit.client.0.smithi115.stdout:expected = image35 2024-09-16T07:35:30.602 INFO:tasks.workunit.client.0.smithi115.stdout:expected = image36 2024-09-16T07:35:31.173 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.TestDeepCopyPP (10091 ms) 2024-09-16T07:35:31.173 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.TestCreateLsDeleteSnap 2024-09-16T07:35:31.173 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:35:35.318 INFO:tasks.workunit.client.0.smithi115.stdout:num snaps is: 1 2024-09-16T07:35:35.318 INFO:tasks.workunit.client.0.smithi115.stdout:expected: 1 2024-09-16T07:35:35.318 INFO:tasks.workunit.client.0.smithi115.stdout:snap: snap1 2024-09-16T07:35:35.318 INFO:tasks.workunit.client.0.smithi115.stdout:found snap1 with size 2097152 2024-09-16T07:35:35.318 INFO:tasks.workunit.client.0.smithi115.stdout:num snaps is: 2 2024-09-16T07:35:35.318 INFO:tasks.workunit.client.0.smithi115.stdout:expected: 2 2024-09-16T07:35:35.318 INFO:tasks.workunit.client.0.smithi115.stdout:snap: snap1 2024-09-16T07:35:35.318 INFO:tasks.workunit.client.0.smithi115.stdout:snap: snap2 2024-09-16T07:35:35.318 INFO:tasks.workunit.client.0.smithi115.stdout:found snap1 with size 2097152 2024-09-16T07:35:35.318 INFO:tasks.workunit.client.0.smithi115.stdout:found snap2 with size 4194304 2024-09-16T07:35:35.319 INFO:tasks.workunit.client.0.smithi115.stdout:num snaps is: 1 2024-09-16T07:35:35.319 INFO:tasks.workunit.client.0.smithi115.stdout:expected: 1 2024-09-16T07:35:35.319 INFO:tasks.workunit.client.0.smithi115.stdout:snap: snap2 2024-09-16T07:35:35.319 INFO:tasks.workunit.client.0.smithi115.stdout:found snap2 with size 4194304 2024-09-16T07:35:35.319 INFO:tasks.workunit.client.0.smithi115.stdout:num snaps is: 0 2024-09-16T07:35:35.319 INFO:tasks.workunit.client.0.smithi115.stdout:expected: 0 2024-09-16T07:35:35.319 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.TestCreateLsDeleteSnap (4145 ms) 2024-09-16T07:35:35.319 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.TestGetSnapShotTimeStamp 2024-09-16T07:35:35.319 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:35:37.460 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.TestGetSnapShotTimeStamp (2143 ms) 2024-09-16T07:35:37.461 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.TestCreateLsDeleteSnapPP 2024-09-16T07:35:37.461 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:35:38.400 INFO:tasks.workunit.client.0.smithi115.stdout:num snaps is: 1 2024-09-16T07:35:38.400 INFO:tasks.workunit.client.0.smithi115.stdout:expected: 1 2024-09-16T07:35:38.400 INFO:tasks.workunit.client.0.smithi115.stdout:snap: snap1 2024-09-16T07:35:38.401 INFO:tasks.workunit.client.0.smithi115.stdout:found snap1 with size 2097152 2024-09-16T07:35:39.414 INFO:tasks.workunit.client.0.smithi115.stdout:num snaps is: 2 2024-09-16T07:35:39.414 INFO:tasks.workunit.client.0.smithi115.stdout:expected: 2 2024-09-16T07:35:39.414 INFO:tasks.workunit.client.0.smithi115.stdout:snap: snap1 2024-09-16T07:35:39.414 INFO:tasks.workunit.client.0.smithi115.stdout:snap: snap2 2024-09-16T07:35:39.414 INFO:tasks.workunit.client.0.smithi115.stdout:found snap1 with size 2097152 2024-09-16T07:35:39.415 INFO:tasks.workunit.client.0.smithi115.stdout:found snap2 with size 4194304 2024-09-16T07:35:40.335 INFO:tasks.workunit.client.0.smithi115.stdout:num snaps is: 1 2024-09-16T07:35:40.335 INFO:tasks.workunit.client.0.smithi115.stdout:expected: 1 2024-09-16T07:35:40.335 INFO:tasks.workunit.client.0.smithi115.stdout:snap: snap2 2024-09-16T07:35:40.335 INFO:tasks.workunit.client.0.smithi115.stdout:found snap2 with size 4194304 2024-09-16T07:35:41.399 INFO:tasks.workunit.client.0.smithi115.stdout:num snaps is: 0 2024-09-16T07:35:41.399 INFO:tasks.workunit.client.0.smithi115.stdout:expected: 0 2024-09-16T07:35:41.450 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.TestCreateLsDeleteSnapPP (3989 ms) 2024-09-16T07:35:41.450 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.TestGetNameIdSnapPP 2024-09-16T07:35:41.450 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:35:47.446 INFO:tasks.workunit.client.0.smithi115.stdout:num snaps is: 0 2024-09-16T07:35:47.446 INFO:tasks.workunit.client.0.smithi115.stdout:expected: 0 2024-09-16T07:35:47.521 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.TestGetNameIdSnapPP (6072 ms) 2024-09-16T07:35:47.521 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.TestCreateLsRenameSnapPP 2024-09-16T07:35:47.521 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:35:48.406 INFO:tasks.workunit.client.0.smithi115.stdout:num snaps is: 1 2024-09-16T07:35:48.406 INFO:tasks.workunit.client.0.smithi115.stdout:expected: 1 2024-09-16T07:35:48.406 INFO:tasks.workunit.client.0.smithi115.stdout:snap: snap1 2024-09-16T07:35:48.406 INFO:tasks.workunit.client.0.smithi115.stdout:found snap1 with size 2097152 2024-09-16T07:35:49.461 INFO:tasks.workunit.client.0.smithi115.stdout:num snaps is: 2 2024-09-16T07:35:49.461 INFO:tasks.workunit.client.0.smithi115.stdout:expected: 2 2024-09-16T07:35:49.461 INFO:tasks.workunit.client.0.smithi115.stdout:snap: snap1 2024-09-16T07:35:49.461 INFO:tasks.workunit.client.0.smithi115.stdout:snap: snap2 2024-09-16T07:35:49.462 INFO:tasks.workunit.client.0.smithi115.stdout:found snap1 with size 2097152 2024-09-16T07:35:49.462 INFO:tasks.workunit.client.0.smithi115.stdout:found snap2 with size 4194304 2024-09-16T07:35:49.533 INFO:tasks.workunit.client.0.smithi115.stdout:num snaps is: 2 2024-09-16T07:35:49.533 INFO:tasks.workunit.client.0.smithi115.stdout:expected: 2 2024-09-16T07:35:49.533 INFO:tasks.workunit.client.0.smithi115.stdout:snap: snap1-rename 2024-09-16T07:35:49.533 INFO:tasks.workunit.client.0.smithi115.stdout:snap: snap2 2024-09-16T07:35:49.534 INFO:tasks.workunit.client.0.smithi115.stdout:found snap1-rename with size 2097152 2024-09-16T07:35:49.534 INFO:tasks.workunit.client.0.smithi115.stdout:found snap2 with size 4194304 2024-09-16T07:35:50.464 INFO:tasks.workunit.client.0.smithi115.stdout:num snaps is: 1 2024-09-16T07:35:50.465 INFO:tasks.workunit.client.0.smithi115.stdout:expected: 1 2024-09-16T07:35:50.465 INFO:tasks.workunit.client.0.smithi115.stdout:snap: snap2-rename 2024-09-16T07:35:50.465 INFO:tasks.workunit.client.0.smithi115.stdout:found snap2-rename with size 4194304 2024-09-16T07:35:51.386 INFO:tasks.workunit.client.0.smithi115.stdout:num snaps is: 0 2024-09-16T07:35:51.386 INFO:tasks.workunit.client.0.smithi115.stdout:expected: 0 2024-09-16T07:35:51.432 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.TestCreateLsRenameSnapPP (3909 ms) 2024-09-16T07:35:51.432 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.ConcurrentCreatesUnvalidatedPool 2024-09-16T07:35:52.895 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:35:52.895 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:35:52.896 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:35:52.896 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:35:58.161 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.ConcurrentCreatesUnvalidatedPool (6730 ms) 2024-09-16T07:35:58.161 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.RemoveFullTry 2024-09-16T07:36:03.117 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:36:34.380 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.RemoveFullTry (36219 ms) 2024-09-16T07:36:34.381 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.RemoveFullTryDataPool 2024-09-16T07:36:41.234 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:37:08.921 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:37:10.221 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:37:11.304 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:37:12.384 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:37:13.476 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:37:14.330 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.RemoveFullTryDataPool (39950 ms) 2024-09-16T07:37:14.330 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.RemoveFullTryNamespace 2024-09-16T07:37:16.711 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:37:39.073 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.RemoveFullTryNamespace (24743 ms) 2024-09-16T07:37:39.073 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.RemoveFullTryNamespaceDataPool 2024-09-16T07:37:43.629 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:38:08.935 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:38:10.387 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:38:11.501 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:38:12.589 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:38:13.665 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:38:14.537 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.RemoveFullTryNamespaceDataPool (35465 ms) 2024-09-16T07:38:14.538 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.TestIO 2024-09-16T07:38:14.538 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:38:43.654 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 512 2024-09-16T07:38:43.654 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 512 2024-09-16T07:38:43.654 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 512 2024-09-16T07:38:43.654 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 512 2024-09-16T07:38:43.654 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 512 2024-09-16T07:38:43.654 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:38:43.655 INFO:tasks.workunit.client.0.smithi115.stdout:started write 2024-09-16T07:38:43.655 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:38:43.655 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:38:43.655 INFO:tasks.workunit.client.0.smithi115.stdout:finished write 2024-09-16T07:38:43.655 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:38:43.655 INFO:tasks.workunit.client.0.smithi115.stdout:started write 2024-09-16T07:38:43.655 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:38:43.655 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:38:43.655 INFO:tasks.workunit.client.0.smithi115.stdout:finished write 2024-09-16T07:38:43.655 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:38:43.655 INFO:tasks.workunit.client.0.smithi115.stdout:started write 2024-09-16T07:38:43.655 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:38:43.655 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:38:43.655 INFO:tasks.workunit.client.0.smithi115.stdout:finished write 2024-09-16T07:38:43.656 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:38:43.656 INFO:tasks.workunit.client.0.smithi115.stdout:started write 2024-09-16T07:38:43.656 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:38:43.656 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:38:43.656 INFO:tasks.workunit.client.0.smithi115.stdout:finished write 2024-09-16T07:38:43.656 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:38:43.656 INFO:tasks.workunit.client.0.smithi115.stdout:started write 2024-09-16T07:38:43.656 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:38:43.656 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:38:43.656 INFO:tasks.workunit.client.0.smithi115.stdout:finished write 2024-09-16T07:38:43.656 INFO:tasks.workunit.client.0.smithi115.stdout:start compare and write 2024-09-16T07:38:43.656 INFO:tasks.workunit.client.0.smithi115.stdout:compare and wrote: 512 2024-09-16T07:38:43.656 INFO:tasks.workunit.client.0.smithi115.stdout:start compare and write 2024-09-16T07:38:43.657 INFO:tasks.workunit.client.0.smithi115.stdout:compare and wrote: 512 2024-09-16T07:38:43.657 INFO:tasks.workunit.client.0.smithi115.stdout:start compare and write 2024-09-16T07:38:43.657 INFO:tasks.workunit.client.0.smithi115.stdout:compare and wrote: 512 2024-09-16T07:38:43.657 INFO:tasks.workunit.client.0.smithi115.stdout:start compare and write 2024-09-16T07:38:43.657 INFO:tasks.workunit.client.0.smithi115.stdout:compare and wrote: 512 2024-09-16T07:38:43.657 INFO:tasks.workunit.client.0.smithi115.stdout:start compare and write 2024-09-16T07:38:43.657 INFO:tasks.workunit.client.0.smithi115.stdout:compare and wrote: 512 2024-09-16T07:38:43.658 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:38:43.658 INFO:tasks.workunit.client.0.smithi115.stdout:started aio compare and write 2024-09-16T07:38:43.658 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:38:43.658 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:38:43.658 INFO:tasks.workunit.client.0.smithi115.stdout:finished aio compare and write 2024-09-16T07:38:43.658 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:38:43.658 INFO:tasks.workunit.client.0.smithi115.stdout:started aio compare and write 2024-09-16T07:38:43.658 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:38:43.658 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:38:43.659 INFO:tasks.workunit.client.0.smithi115.stdout:finished aio compare and write 2024-09-16T07:38:43.659 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:38:43.659 INFO:tasks.workunit.client.0.smithi115.stdout:started aio compare and write 2024-09-16T07:38:43.659 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:38:43.659 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:38:43.659 INFO:tasks.workunit.client.0.smithi115.stdout:finished aio compare and write 2024-09-16T07:38:43.659 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:38:43.659 INFO:tasks.workunit.client.0.smithi115.stdout:started aio compare and write 2024-09-16T07:38:43.659 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:38:43.659 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:38:43.659 INFO:tasks.workunit.client.0.smithi115.stdout:finished aio compare and write 2024-09-16T07:38:43.659 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:38:43.659 INFO:tasks.workunit.client.0.smithi115.stdout:started aio compare and write 2024-09-16T07:38:43.659 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:38:43.660 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:38:43.660 INFO:tasks.workunit.client.0.smithi115.stdout:finished aio compare and write 2024-09-16T07:38:43.660 INFO:tasks.workunit.client.0.smithi115.stdout:read: 512 2024-09-16T07:38:43.660 INFO:tasks.workunit.client.0.smithi115.stdout:read: 512 2024-09-16T07:38:43.660 INFO:tasks.workunit.client.0.smithi115.stdout:read: 512 2024-09-16T07:38:43.660 INFO:tasks.workunit.client.0.smithi115.stdout:read: 512 2024-09-16T07:38:43.660 INFO:tasks.workunit.client.0.smithi115.stdout:read: 512 2024-09-16T07:38:43.660 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:38:43.660 INFO:tasks.workunit.client.0.smithi115.stdout:started read 2024-09-16T07:38:43.660 INFO:tasks.workunit.client.0.smithi115.stdout:read completion cb called! 2024-09-16T07:38:43.660 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 512 2024-09-16T07:38:43.660 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:38:43.660 INFO:tasks.workunit.client.0.smithi115.stdout:started read 2024-09-16T07:38:43.660 INFO:tasks.workunit.client.0.smithi115.stdout:read completion cb called! 2024-09-16T07:38:43.661 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 512 2024-09-16T07:38:43.661 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:38:43.661 INFO:tasks.workunit.client.0.smithi115.stdout:started read 2024-09-16T07:38:43.661 INFO:tasks.workunit.client.0.smithi115.stdout:read completion cb called! 2024-09-16T07:38:43.661 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 512 2024-09-16T07:38:43.661 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:38:43.661 INFO:tasks.workunit.client.0.smithi115.stdout:started read 2024-09-16T07:38:43.661 INFO:tasks.workunit.client.0.smithi115.stdout:read completion cb called! 2024-09-16T07:38:43.661 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 512 2024-09-16T07:38:43.661 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:38:43.661 INFO:tasks.workunit.client.0.smithi115.stdout:started read 2024-09-16T07:38:43.661 INFO:tasks.workunit.client.0.smithi115.stdout:read completion cb called! 2024-09-16T07:38:43.661 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 512 2024-09-16T07:38:43.661 INFO:tasks.workunit.client.0.smithi115.stdout:discard: 512~512 = 512 2024-09-16T07:38:43.662 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:38:43.662 INFO:tasks.workunit.client.0.smithi115.stdout:aio discard: 1536~512 = 0 2024-09-16T07:38:43.662 INFO:tasks.workunit.client.0.smithi115.stdout:read: 512 2024-09-16T07:38:43.662 INFO:tasks.workunit.client.0.smithi115.stdout:read: 512 2024-09-16T07:38:43.662 INFO:tasks.workunit.client.0.smithi115.stdout:read: 512 2024-09-16T07:38:43.662 INFO:tasks.workunit.client.0.smithi115.stdout:read: 512 2024-09-16T07:38:43.662 INFO:tasks.workunit.client.0.smithi115.stdout:read: 512 2024-09-16T07:38:43.662 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 0 2024-09-16T07:38:43.662 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:38:43.662 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:38:43.662 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 0 2024-09-16T07:38:43.662 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:38:43.662 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:38:43.662 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 16384 2024-09-16T07:38:43.663 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:38:43.663 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:38:43.663 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 16384 2024-09-16T07:38:43.663 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:38:43.663 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:38:43.663 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:38:43.663 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:38:43.663 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 49152 2024-09-16T07:38:43.663 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:38:43.663 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:38:43.663 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 49152 2024-09-16T07:38:43.663 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:38:43.663 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:38:43.663 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 65536 2024-09-16T07:38:43.664 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:38:43.664 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:38:43.664 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 65536 2024-09-16T07:38:43.664 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:38:43.664 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:38:43.664 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:38:43.664 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:38:43.664 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 98304 2024-09-16T07:38:43.664 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:38:43.664 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:38:43.664 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 98304 2024-09-16T07:38:43.664 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:38:43.664 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:38:43.664 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 114688 2024-09-16T07:38:43.665 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:38:43.665 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:38:43.665 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 114688 2024-09-16T07:38:43.665 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:38:43.665 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:38:43.665 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:38:43.665 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:38:43.665 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 147456 2024-09-16T07:38:43.665 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:38:43.665 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:38:43.665 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 147456 2024-09-16T07:38:43.665 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:38:43.665 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:38:43.665 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 163840 2024-09-16T07:38:43.666 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:38:43.666 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:38:43.666 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 163840 2024-09-16T07:38:43.666 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:38:43.666 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:38:43.666 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:38:43.666 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:38:43.666 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 196608 2024-09-16T07:38:43.666 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:38:43.666 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:38:43.666 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 196608 2024-09-16T07:38:43.666 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:38:43.666 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:38:43.666 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 212992 2024-09-16T07:38:43.667 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:38:43.667 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:38:43.667 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 212992 2024-09-16T07:38:43.667 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:38:43.667 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:38:43.667 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:38:43.667 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:38:43.667 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:38:43.667 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:38:43.667 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:38:43.667 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:38:43.667 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:38:43.667 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:38:43.667 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:38:43.668 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:38:43.668 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:38:43.668 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:38:43.668 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:38:43.668 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:38:43.668 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:38:43.668 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:38:43.668 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:38:43.668 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:38:43.668 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:38:43.668 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:38:43.668 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:38:43.668 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:38:43.669 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:38:43.669 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:38:43.669 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:38:43.669 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:38:43.669 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:38:43.669 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:38:43.669 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:38:43.669 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:38:43.669 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:38:43.669 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:38:43.669 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:38:43.669 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:38:43.670 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:38:43.670 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:38:43.670 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:38:43.670 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:38:43.670 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:38:43.670 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:38:43.670 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:38:43.670 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:38:43.670 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:38:43.670 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:38:43.670 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:38:43.670 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:38:43.670 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:38:43.671 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:38:43.671 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:38:43.671 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:38:43.671 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:39:08.738 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:39:08.738 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:39:08.738 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:39:08.738 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:39:08.739 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:39:08.739 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:39:08.739 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:39:08.739 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:39:08.739 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:39:08.739 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:39:08.739 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:39:08.739 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:39:08.739 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:39:08.739 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:39:08.739 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:39:08.739 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:39:08.739 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:39:08.739 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:39:08.739 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:39:08.739 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:39:08.740 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:39:08.740 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:39:08.740 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:39:08.740 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:39:08.740 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:39:08.740 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:39:08.740 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:39:08.740 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:39:08.740 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:39:08.740 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:39:08.740 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:39:08.740 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:39:08.740 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:39:08.740 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:39:08.741 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:39:08.741 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:39:08.741 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:39:08.741 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:39:08.741 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:39:08.741 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:39:08.741 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:39:08.741 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:39:08.741 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:39:08.741 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:39:08.741 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:39:08.741 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:39:08.741 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:39:08.742 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:39:08.742 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:39:08.742 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:39:08.742 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:39:08.742 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:39:08.742 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:39:08.742 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:39:08.742 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:39:08.742 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:39:08.742 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:39:08.742 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:39:08.742 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:39:08.742 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:39:08.742 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:39:08.742 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:39:08.743 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:39:08.743 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:39:08.743 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:39:08.743 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:39:08.743 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:39:08.743 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:39:08.743 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:39:08.743 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:39:08.743 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:39:08.743 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:39:08.743 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:39:08.743 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:39:08.743 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:39:08.743 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:39:08.743 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:39:08.744 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:39:08.744 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:39:08.744 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:39:08.744 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:39:08.744 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:39:08.744 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:39:08.744 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:39:08.744 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:39:08.744 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:39:08.744 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:39:08.744 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:39:08.744 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:39:08.744 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:39:08.744 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:39:08.745 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:39:08.745 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:39:08.745 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:39:08.745 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:39:08.745 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:39:08.745 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:39:08.745 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:39:08.745 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:39:08.745 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:39:08.745 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:39:08.745 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:39:08.745 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:39:08.745 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:39:08.746 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:39:08.746 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:39:08.746 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:39:08.746 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:39:08.746 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:39:08.746 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:39:08.746 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:39:08.746 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:39:08.746 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:39:08.746 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:39:08.746 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:39:08.746 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:39:08.746 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:39:08.746 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:39:08.747 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:39:08.747 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:39:08.747 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:39:08.747 INFO:tasks.workunit.client.0.smithi115.stdout:read completion cb called! 2024-09-16T07:39:08.747 INFO:tasks.workunit.client.0.smithi115.stdout:read completion cb called! 2024-09-16T07:39:08.747 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 512 2024-09-16T07:39:08.747 INFO:tasks.workunit.client.0.smithi115.stdout:read completion cb called! 2024-09-16T07:39:08.747 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.TestIO (54200 ms) 2024-09-16T07:39:08.747 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.TestEncryptionLUKS1 2024-09-16T07:39:08.747 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:39:42.374 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 512 2024-09-16T07:39:42.374 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 512 2024-09-16T07:39:42.374 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 512 2024-09-16T07:39:42.375 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 512 2024-09-16T07:39:42.375 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 512 2024-09-16T07:39:42.375 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:39:42.375 INFO:tasks.workunit.client.0.smithi115.stdout:started write 2024-09-16T07:39:42.375 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:39:42.375 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:39:42.375 INFO:tasks.workunit.client.0.smithi115.stdout:finished write 2024-09-16T07:39:42.375 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:39:42.375 INFO:tasks.workunit.client.0.smithi115.stdout:started write 2024-09-16T07:39:42.375 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:39:42.375 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:39:42.376 INFO:tasks.workunit.client.0.smithi115.stdout:finished write 2024-09-16T07:39:42.376 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:39:42.376 INFO:tasks.workunit.client.0.smithi115.stdout:started write 2024-09-16T07:39:42.376 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:39:42.376 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:39:42.376 INFO:tasks.workunit.client.0.smithi115.stdout:finished write 2024-09-16T07:39:42.376 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:39:42.376 INFO:tasks.workunit.client.0.smithi115.stdout:started write 2024-09-16T07:39:42.376 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:39:42.376 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:39:42.377 INFO:tasks.workunit.client.0.smithi115.stdout:finished write 2024-09-16T07:39:42.377 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:39:42.377 INFO:tasks.workunit.client.0.smithi115.stdout:started write 2024-09-16T07:39:42.377 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:39:42.377 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:39:42.377 INFO:tasks.workunit.client.0.smithi115.stdout:finished write 2024-09-16T07:39:42.377 INFO:tasks.workunit.client.0.smithi115.stdout:start compare and write 2024-09-16T07:39:42.377 INFO:tasks.workunit.client.0.smithi115.stdout:compare and wrote: 512 2024-09-16T07:39:42.377 INFO:tasks.workunit.client.0.smithi115.stdout:start compare and write 2024-09-16T07:39:42.377 INFO:tasks.workunit.client.0.smithi115.stdout:compare and wrote: 512 2024-09-16T07:39:42.377 INFO:tasks.workunit.client.0.smithi115.stdout:start compare and write 2024-09-16T07:39:42.377 INFO:tasks.workunit.client.0.smithi115.stdout:compare and wrote: 512 2024-09-16T07:39:42.377 INFO:tasks.workunit.client.0.smithi115.stdout:start compare and write 2024-09-16T07:39:42.378 INFO:tasks.workunit.client.0.smithi115.stdout:compare and wrote: 512 2024-09-16T07:39:42.378 INFO:tasks.workunit.client.0.smithi115.stdout:start compare and write 2024-09-16T07:39:42.378 INFO:tasks.workunit.client.0.smithi115.stdout:compare and wrote: 512 2024-09-16T07:39:42.378 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:39:42.378 INFO:tasks.workunit.client.0.smithi115.stdout:started aio compare and write 2024-09-16T07:39:42.378 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:39:42.378 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:39:42.378 INFO:tasks.workunit.client.0.smithi115.stdout:finished aio compare and write 2024-09-16T07:39:42.378 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:39:42.378 INFO:tasks.workunit.client.0.smithi115.stdout:started aio compare and write 2024-09-16T07:39:42.378 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:39:42.379 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:39:42.379 INFO:tasks.workunit.client.0.smithi115.stdout:finished aio compare and write 2024-09-16T07:39:42.379 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:39:42.379 INFO:tasks.workunit.client.0.smithi115.stdout:started aio compare and write 2024-09-16T07:39:42.379 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:39:42.379 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:39:42.379 INFO:tasks.workunit.client.0.smithi115.stdout:finished aio compare and write 2024-09-16T07:39:42.379 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:39:42.379 INFO:tasks.workunit.client.0.smithi115.stdout:started aio compare and write 2024-09-16T07:39:42.379 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:39:42.379 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:39:42.380 INFO:tasks.workunit.client.0.smithi115.stdout:finished aio compare and write 2024-09-16T07:39:42.380 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:39:42.380 INFO:tasks.workunit.client.0.smithi115.stdout:started aio compare and write 2024-09-16T07:39:42.380 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:39:42.380 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:39:42.380 INFO:tasks.workunit.client.0.smithi115.stdout:finished aio compare and write 2024-09-16T07:39:42.380 INFO:tasks.workunit.client.0.smithi115.stdout:read: 512 2024-09-16T07:39:42.380 INFO:tasks.workunit.client.0.smithi115.stdout:read: 512 2024-09-16T07:39:42.380 INFO:tasks.workunit.client.0.smithi115.stdout:read: 512 2024-09-16T07:39:42.380 INFO:tasks.workunit.client.0.smithi115.stdout:read: 512 2024-09-16T07:39:42.380 INFO:tasks.workunit.client.0.smithi115.stdout:read: 512 2024-09-16T07:39:42.381 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:39:42.381 INFO:tasks.workunit.client.0.smithi115.stdout:started read 2024-09-16T07:39:42.381 INFO:tasks.workunit.client.0.smithi115.stdout:read completion cb called! 2024-09-16T07:39:42.381 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 512 2024-09-16T07:39:42.381 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:39:42.381 INFO:tasks.workunit.client.0.smithi115.stdout:started read 2024-09-16T07:39:42.381 INFO:tasks.workunit.client.0.smithi115.stdout:read completion cb called! 2024-09-16T07:39:42.381 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 512 2024-09-16T07:39:42.381 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:39:42.381 INFO:tasks.workunit.client.0.smithi115.stdout:started read 2024-09-16T07:39:42.381 INFO:tasks.workunit.client.0.smithi115.stdout:read completion cb called! 2024-09-16T07:39:42.382 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 512 2024-09-16T07:39:42.382 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:39:42.382 INFO:tasks.workunit.client.0.smithi115.stdout:started read 2024-09-16T07:39:42.382 INFO:tasks.workunit.client.0.smithi115.stdout:read completion cb called! 2024-09-16T07:39:42.382 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 512 2024-09-16T07:39:42.382 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:39:42.382 INFO:tasks.workunit.client.0.smithi115.stdout:started read 2024-09-16T07:39:42.382 INFO:tasks.workunit.client.0.smithi115.stdout:read completion cb called! 2024-09-16T07:39:42.382 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 512 2024-09-16T07:39:42.382 INFO:tasks.workunit.client.0.smithi115.stdout:discard: 512~512 = 512 2024-09-16T07:39:42.382 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:39:42.382 INFO:tasks.workunit.client.0.smithi115.stdout:aio discard: 1536~512 = 0 2024-09-16T07:39:42.383 INFO:tasks.workunit.client.0.smithi115.stdout:read: 512 2024-09-16T07:39:42.383 INFO:tasks.workunit.client.0.smithi115.stdout:read: 512 2024-09-16T07:39:42.383 INFO:tasks.workunit.client.0.smithi115.stdout:read: 512 2024-09-16T07:39:42.383 INFO:tasks.workunit.client.0.smithi115.stdout:read: 512 2024-09-16T07:39:42.383 INFO:tasks.workunit.client.0.smithi115.stdout:read: 512 2024-09-16T07:39:42.383 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 0 2024-09-16T07:39:42.383 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:39:42.383 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:39:42.383 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 0 2024-09-16T07:39:42.383 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:39:42.383 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:39:42.383 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 16384 2024-09-16T07:39:42.384 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:39:42.384 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:39:42.384 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 16384 2024-09-16T07:39:42.384 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:39:42.384 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:39:42.384 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:39:42.384 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:39:42.384 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 49152 2024-09-16T07:39:42.384 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:39:42.384 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:39:42.384 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 49152 2024-09-16T07:39:42.385 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:39:42.385 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:39:42.385 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 65536 2024-09-16T07:39:42.385 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:39:42.385 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:39:42.385 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 65536 2024-09-16T07:39:42.385 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:39:42.385 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:39:42.385 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:39:42.385 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:39:42.385 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 98304 2024-09-16T07:39:42.386 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:39:42.386 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:39:42.386 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 98304 2024-09-16T07:39:42.386 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:39:42.386 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:39:42.386 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 114688 2024-09-16T07:39:42.386 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:39:42.386 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:39:42.386 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 114688 2024-09-16T07:39:42.386 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:39:42.386 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:39:42.386 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:39:42.386 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:39:42.387 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 147456 2024-09-16T07:39:42.387 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:39:42.387 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:39:42.387 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 147456 2024-09-16T07:39:42.387 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:39:42.387 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:39:42.387 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 163840 2024-09-16T07:39:42.387 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:39:42.387 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:39:42.387 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 163840 2024-09-16T07:39:42.387 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:39:42.388 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:39:42.388 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:39:42.388 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:39:42.388 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 196608 2024-09-16T07:39:42.388 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:39:42.388 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:39:42.388 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 196608 2024-09-16T07:39:42.388 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:39:42.388 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:39:42.388 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 212992 2024-09-16T07:39:42.388 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:39:42.389 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:39:42.389 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 212992 2024-09-16T07:39:42.389 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:39:42.389 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:39:42.389 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:39:42.389 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:39:42.389 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:39:42.389 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:39:42.389 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:39:42.389 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:39:42.389 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:39:42.390 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:39:42.390 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:39:42.390 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:39:42.390 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:39:42.390 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:39:42.390 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:39:42.390 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:39:42.390 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:39:42.390 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:39:42.391 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:39:42.391 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:39:42.391 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:39:42.391 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:39:42.391 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:39:42.391 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:39:42.391 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:39:42.391 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:39:42.391 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:39:42.391 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:39:42.392 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:39:42.392 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:39:42.392 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:39:42.392 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:39:42.392 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:39:42.392 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:39:42.392 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:39:42.392 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:39:42.392 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:39:42.392 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:39:42.392 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:39:42.393 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:39:42.393 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:39:42.393 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:39:42.393 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:39:42.393 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:39:42.393 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:39:42.393 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:39:42.393 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:39:42.393 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:39:42.393 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:39:42.393 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:39:42.393 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:39:42.394 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:39:42.394 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:40:12.969 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:40:12.969 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:40:12.969 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:40:12.969 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:40:12.969 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:40:12.969 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:40:12.969 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:40:12.970 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:40:12.970 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:40:12.970 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:40:12.970 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:40:12.970 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:40:12.970 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:40:12.970 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:40:12.970 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:40:12.970 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:40:12.970 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:40:12.970 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:40:12.970 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:40:12.970 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:40:12.971 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:40:12.971 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:40:12.971 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:40:12.971 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:40:12.971 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:40:12.971 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:40:12.971 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:40:12.971 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:40:12.971 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:40:12.971 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:40:12.971 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:40:12.971 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:40:12.971 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:40:12.971 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:40:12.972 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:40:12.972 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:40:12.972 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:40:12.972 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:40:12.972 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:40:12.972 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:40:12.972 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:40:12.972 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:40:12.972 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:40:12.972 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:40:12.972 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:40:12.972 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:40:12.972 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:40:12.973 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:40:12.973 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:40:12.973 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:40:12.973 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:40:12.973 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:40:12.973 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:40:12.973 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:40:12.973 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:40:12.973 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:40:12.973 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:40:12.973 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:40:12.973 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:40:12.973 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:40:12.973 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:40:12.974 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:40:12.974 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:40:12.974 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:40:12.974 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:40:12.974 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:40:12.974 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:40:12.974 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:40:12.974 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:40:12.974 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:40:12.974 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:40:12.974 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:40:12.974 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:40:12.975 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:40:12.975 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:40:12.975 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:40:12.975 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:40:12.975 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:40:12.975 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:40:12.975 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:40:12.975 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:40:12.975 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:40:12.975 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:40:12.975 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:40:12.976 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:40:12.976 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:40:12.976 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:40:12.976 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:40:12.976 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:40:12.976 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:40:12.976 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:40:12.976 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:40:12.976 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:40:12.976 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:40:12.976 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:40:12.976 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:40:12.977 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:40:12.977 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:40:12.977 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:40:12.977 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:40:12.977 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:40:12.977 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:40:12.977 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:40:12.977 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:40:12.977 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:40:12.977 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:40:12.977 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:40:12.978 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:40:12.978 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:40:12.978 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:40:12.978 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:40:12.978 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:40:12.978 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:40:12.978 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:40:12.978 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:40:12.978 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:40:12.978 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:40:12.978 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:40:12.978 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:40:12.979 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:40:12.979 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:40:12.979 INFO:tasks.workunit.client.0.smithi115.stdout:read completion cb called! 2024-09-16T07:40:12.979 INFO:tasks.workunit.client.0.smithi115.stdout:read completion cb called! 2024-09-16T07:40:12.979 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 512 2024-09-16T07:40:12.979 INFO:tasks.workunit.client.0.smithi115.stdout:read completion cb called! 2024-09-16T07:40:12.979 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 4 2024-09-16T07:40:12.979 INFO:tasks.workunit.client.0.smithi115.stdout:read: 4 2024-09-16T07:40:12.979 INFO:tasks.workunit.client.0.smithi115.stdout:read: 4 2024-09-16T07:40:12.979 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.TestEncryptionLUKS1 (64230 ms) 2024-09-16T07:40:12.979 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.TestEncryptionLUKS2 2024-09-16T07:40:12.979 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:40:48.271 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 512 2024-09-16T07:40:48.272 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 512 2024-09-16T07:40:48.272 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 512 2024-09-16T07:40:48.272 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 512 2024-09-16T07:40:48.272 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 512 2024-09-16T07:40:48.272 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:40:48.272 INFO:tasks.workunit.client.0.smithi115.stdout:started write 2024-09-16T07:40:48.272 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:40:48.272 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:40:48.272 INFO:tasks.workunit.client.0.smithi115.stdout:finished write 2024-09-16T07:40:48.272 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:40:48.272 INFO:tasks.workunit.client.0.smithi115.stdout:started write 2024-09-16T07:40:48.272 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:40:48.273 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:40:48.273 INFO:tasks.workunit.client.0.smithi115.stdout:finished write 2024-09-16T07:40:48.273 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:40:48.273 INFO:tasks.workunit.client.0.smithi115.stdout:started write 2024-09-16T07:40:48.273 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:40:48.273 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:40:48.273 INFO:tasks.workunit.client.0.smithi115.stdout:finished write 2024-09-16T07:40:48.273 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:40:48.273 INFO:tasks.workunit.client.0.smithi115.stdout:started write 2024-09-16T07:40:48.273 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:40:48.273 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:40:48.273 INFO:tasks.workunit.client.0.smithi115.stdout:finished write 2024-09-16T07:40:48.273 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:40:48.274 INFO:tasks.workunit.client.0.smithi115.stdout:started write 2024-09-16T07:40:48.274 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:40:48.274 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:40:48.274 INFO:tasks.workunit.client.0.smithi115.stdout:finished write 2024-09-16T07:40:48.274 INFO:tasks.workunit.client.0.smithi115.stdout:start compare and write 2024-09-16T07:40:48.274 INFO:tasks.workunit.client.0.smithi115.stdout:compare and wrote: 512 2024-09-16T07:40:48.274 INFO:tasks.workunit.client.0.smithi115.stdout:start compare and write 2024-09-16T07:40:48.274 INFO:tasks.workunit.client.0.smithi115.stdout:compare and wrote: 512 2024-09-16T07:40:48.274 INFO:tasks.workunit.client.0.smithi115.stdout:start compare and write 2024-09-16T07:40:48.274 INFO:tasks.workunit.client.0.smithi115.stdout:compare and wrote: 512 2024-09-16T07:40:48.274 INFO:tasks.workunit.client.0.smithi115.stdout:start compare and write 2024-09-16T07:40:48.274 INFO:tasks.workunit.client.0.smithi115.stdout:compare and wrote: 512 2024-09-16T07:40:48.274 INFO:tasks.workunit.client.0.smithi115.stdout:start compare and write 2024-09-16T07:40:48.274 INFO:tasks.workunit.client.0.smithi115.stdout:compare and wrote: 512 2024-09-16T07:40:48.274 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:40:48.275 INFO:tasks.workunit.client.0.smithi115.stdout:started aio compare and write 2024-09-16T07:40:48.275 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:40:48.275 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:40:48.275 INFO:tasks.workunit.client.0.smithi115.stdout:finished aio compare and write 2024-09-16T07:40:48.275 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:40:48.275 INFO:tasks.workunit.client.0.smithi115.stdout:started aio compare and write 2024-09-16T07:40:48.275 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:40:48.275 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:40:48.275 INFO:tasks.workunit.client.0.smithi115.stdout:finished aio compare and write 2024-09-16T07:40:48.275 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:40:48.275 INFO:tasks.workunit.client.0.smithi115.stdout:started aio compare and write 2024-09-16T07:40:48.275 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:40:48.275 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:40:48.275 INFO:tasks.workunit.client.0.smithi115.stdout:finished aio compare and write 2024-09-16T07:40:48.275 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:40:48.276 INFO:tasks.workunit.client.0.smithi115.stdout:started aio compare and write 2024-09-16T07:40:48.276 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:40:48.276 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:40:48.276 INFO:tasks.workunit.client.0.smithi115.stdout:finished aio compare and write 2024-09-16T07:40:48.276 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:40:48.276 INFO:tasks.workunit.client.0.smithi115.stdout:started aio compare and write 2024-09-16T07:40:48.276 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:40:48.276 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:40:48.276 INFO:tasks.workunit.client.0.smithi115.stdout:finished aio compare and write 2024-09-16T07:40:48.276 INFO:tasks.workunit.client.0.smithi115.stdout:read: 512 2024-09-16T07:40:48.276 INFO:tasks.workunit.client.0.smithi115.stdout:read: 512 2024-09-16T07:40:48.276 INFO:tasks.workunit.client.0.smithi115.stdout:read: 512 2024-09-16T07:40:48.276 INFO:tasks.workunit.client.0.smithi115.stdout:read: 512 2024-09-16T07:40:48.277 INFO:tasks.workunit.client.0.smithi115.stdout:read: 512 2024-09-16T07:40:48.277 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:40:48.277 INFO:tasks.workunit.client.0.smithi115.stdout:started read 2024-09-16T07:40:48.277 INFO:tasks.workunit.client.0.smithi115.stdout:read completion cb called! 2024-09-16T07:40:48.277 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 512 2024-09-16T07:40:48.277 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:40:48.277 INFO:tasks.workunit.client.0.smithi115.stdout:started read 2024-09-16T07:40:48.277 INFO:tasks.workunit.client.0.smithi115.stdout:read completion cb called! 2024-09-16T07:40:48.277 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 512 2024-09-16T07:40:48.277 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:40:48.277 INFO:tasks.workunit.client.0.smithi115.stdout:started read 2024-09-16T07:40:48.277 INFO:tasks.workunit.client.0.smithi115.stdout:read completion cb called! 2024-09-16T07:40:48.278 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 512 2024-09-16T07:40:48.278 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:40:48.278 INFO:tasks.workunit.client.0.smithi115.stdout:started read 2024-09-16T07:40:48.278 INFO:tasks.workunit.client.0.smithi115.stdout:read completion cb called! 2024-09-16T07:40:48.278 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 512 2024-09-16T07:40:48.278 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:40:48.278 INFO:tasks.workunit.client.0.smithi115.stdout:started read 2024-09-16T07:40:48.278 INFO:tasks.workunit.client.0.smithi115.stdout:read completion cb called! 2024-09-16T07:40:48.278 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 512 2024-09-16T07:40:48.279 INFO:tasks.workunit.client.0.smithi115.stdout:discard: 512~512 = 512 2024-09-16T07:40:48.279 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:40:48.279 INFO:tasks.workunit.client.0.smithi115.stdout:aio discard: 1536~512 = 0 2024-09-16T07:40:48.279 INFO:tasks.workunit.client.0.smithi115.stdout:read: 512 2024-09-16T07:40:48.279 INFO:tasks.workunit.client.0.smithi115.stdout:read: 512 2024-09-16T07:40:48.279 INFO:tasks.workunit.client.0.smithi115.stdout:read: 512 2024-09-16T07:40:48.279 INFO:tasks.workunit.client.0.smithi115.stdout:read: 512 2024-09-16T07:40:48.279 INFO:tasks.workunit.client.0.smithi115.stdout:read: 512 2024-09-16T07:40:48.279 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 0 2024-09-16T07:40:48.279 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:40:48.280 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:40:48.280 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 0 2024-09-16T07:40:48.280 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:40:48.280 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:40:48.280 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 16384 2024-09-16T07:40:48.280 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:40:48.281 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:40:48.281 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 16384 2024-09-16T07:40:48.281 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:40:48.281 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:40:48.281 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:40:48.281 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:40:48.281 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 49152 2024-09-16T07:40:48.281 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:40:48.281 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:40:48.281 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 49152 2024-09-16T07:40:48.281 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:40:48.281 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:40:48.282 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 65536 2024-09-16T07:40:48.282 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:40:48.282 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:40:48.282 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 65536 2024-09-16T07:40:48.282 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:40:48.282 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:40:48.282 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:40:48.282 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:40:48.282 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 98304 2024-09-16T07:40:48.282 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:40:48.282 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:40:48.282 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 98304 2024-09-16T07:40:48.282 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:40:48.282 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:40:48.283 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 114688 2024-09-16T07:40:48.283 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:40:48.283 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:40:48.283 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 114688 2024-09-16T07:40:48.283 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:40:48.283 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:40:48.283 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:40:48.283 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:40:48.283 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 147456 2024-09-16T07:40:48.283 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:40:48.283 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:40:48.283 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 147456 2024-09-16T07:40:48.283 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:40:48.283 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:40:48.284 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 163840 2024-09-16T07:40:48.284 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:40:48.284 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:40:48.284 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 163840 2024-09-16T07:40:48.284 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:40:48.284 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:40:48.284 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:40:48.284 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:40:48.284 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 196608 2024-09-16T07:40:48.285 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:40:48.285 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:40:48.285 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 196608 2024-09-16T07:40:48.285 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:40:48.285 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:40:48.285 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 212992 2024-09-16T07:40:48.285 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:40:48.285 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:40:48.285 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 212992 2024-09-16T07:40:48.285 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:40:48.285 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:40:48.285 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:40:48.285 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:40:48.285 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:40:48.286 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:40:48.286 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:40:48.286 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:40:48.286 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:40:48.286 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:40:48.286 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:40:48.286 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:40:48.286 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:40:48.286 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:40:48.287 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:40:48.287 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:40:48.287 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:40:48.287 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:40:48.287 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:40:48.287 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:40:48.287 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:40:48.287 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:40:48.287 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:40:48.287 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:40:48.287 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:40:48.288 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:40:48.288 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:40:48.288 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:40:48.288 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:40:48.288 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:40:48.288 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:40:48.288 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:40:48.288 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:40:48.288 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:40:48.288 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:40:48.288 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:40:48.289 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:40:48.289 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:40:48.289 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:40:48.289 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:40:48.289 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:40:48.289 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:40:48.289 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:40:48.289 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:40:48.289 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:40:48.289 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:40:48.290 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:40:48.290 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:40:48.290 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:40:48.290 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:40:48.290 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:40:48.290 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:40:48.290 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:41:16.805 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:41:16.805 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:41:16.806 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:41:16.806 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:41:16.806 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:41:16.806 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:41:16.806 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:41:16.806 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:41:16.806 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:41:16.806 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:41:16.806 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:41:16.806 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:41:16.807 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:41:16.807 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:41:16.807 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:41:16.807 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:41:16.807 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:41:16.807 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:41:16.807 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:41:16.807 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:41:16.807 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:41:16.807 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:41:16.807 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:41:16.807 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:41:16.807 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:41:16.808 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:41:16.808 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:41:16.808 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:41:16.808 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:41:16.808 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:41:16.808 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:41:16.808 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:41:16.808 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:41:16.808 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:41:16.808 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:41:16.809 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:41:16.809 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:41:16.809 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:41:16.809 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:41:16.809 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:41:16.809 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:41:16.809 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:41:16.809 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:41:16.809 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:41:16.809 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:41:16.809 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:41:16.809 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:41:16.809 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:41:16.810 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:41:16.810 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:41:16.810 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:41:16.810 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:41:16.810 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:41:16.810 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:41:16.810 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:41:16.810 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:41:16.810 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:41:16.810 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:41:16.810 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:41:16.810 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:41:16.810 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:41:16.810 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:41:16.811 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:41:16.811 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:41:16.811 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:41:16.811 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:41:16.811 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:41:16.811 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:41:16.811 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:41:16.811 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:41:16.811 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:41:16.811 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:41:16.811 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:41:16.811 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:41:16.811 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:41:16.811 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:41:16.811 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:41:16.812 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:41:16.812 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:41:16.812 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:41:16.812 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:41:16.812 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:41:16.812 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:41:16.812 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:41:16.812 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:41:16.812 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:41:16.812 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:41:16.812 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:41:16.812 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:41:16.812 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:41:16.813 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:41:16.813 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:41:16.813 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:41:16.813 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:41:16.813 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:41:16.813 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:41:16.813 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:41:16.813 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:41:16.813 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:41:16.813 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:41:16.813 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:41:16.814 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:41:16.814 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:41:16.814 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:41:16.814 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:41:16.814 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:41:16.814 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:41:16.814 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:41:16.814 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:41:16.814 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:41:16.814 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:41:16.814 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:41:16.814 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:41:16.815 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:41:16.815 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:41:16.815 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:41:16.815 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:41:16.815 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:41:16.815 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:41:16.815 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:41:16.815 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:41:16.815 INFO:tasks.workunit.client.0.smithi115.stdout:read completion cb called! 2024-09-16T07:41:16.815 INFO:tasks.workunit.client.0.smithi115.stdout:read completion cb called! 2024-09-16T07:41:16.815 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 512 2024-09-16T07:41:16.815 INFO:tasks.workunit.client.0.smithi115.stdout:read completion cb called! 2024-09-16T07:41:16.816 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 4 2024-09-16T07:41:16.816 INFO:tasks.workunit.client.0.smithi115.stdout:read: 4 2024-09-16T07:41:16.816 INFO:tasks.workunit.client.0.smithi115.stdout:read: 4 2024-09-16T07:41:16.816 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.TestEncryptionLUKS2 (63836 ms) 2024-09-16T07:41:16.816 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.TestCloneEncryption 2024-09-16T07:41:16.816 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:42:21.370 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 4 2024-09-16T07:42:21.371 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 4 2024-09-16T07:42:21.371 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 4 2024-09-16T07:42:21.371 INFO:tasks.workunit.client.0.smithi115.stdout:read: 4 2024-09-16T07:42:21.371 INFO:tasks.workunit.client.0.smithi115.stdout:read: 4 2024-09-16T07:42:21.371 INFO:tasks.workunit.client.0.smithi115.stdout:read: 4 2024-09-16T07:42:21.371 INFO:tasks.workunit.client.0.smithi115.stdout:read: 4 2024-09-16T07:42:21.371 INFO:tasks.workunit.client.0.smithi115.stdout:read: 4 2024-09-16T07:42:21.371 INFO:tasks.workunit.client.0.smithi115.stdout:read: 4 2024-09-16T07:42:21.371 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.TestCloneEncryption (64565 ms) 2024-09-16T07:42:21.371 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.LUKS1UnderLUKS2WithoutResize 2024-09-16T07:42:21.371 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:42:38.063 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.LUKS1UnderLUKS2WithoutResize (16694 ms) 2024-09-16T07:42:38.063 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.LUKS2UnderLUKS1WithoutResize 2024-09-16T07:42:38.064 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:42:54.135 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.LUKS2UnderLUKS1WithoutResize (16071 ms) 2024-09-16T07:42:54.136 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.EncryptionFormatNoData 2024-09-16T07:42:54.136 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:42:58.802 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.EncryptionFormatNoData (4668 ms) 2024-09-16T07:42:58.803 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.EncryptionLoadBadSize 2024-09-16T07:42:58.803 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:43:05.141 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.EncryptionLoadBadSize (6338 ms) 2024-09-16T07:43:05.141 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.EncryptionLoadBadStripePattern 2024-09-16T07:43:05.142 INFO:tasks.workunit.client.0.smithi115.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:2905: Skipped 2024-09-16T07:43:05.142 INFO:tasks.workunit.client.0.smithi115.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:43:05.142 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestLibRBD.EncryptionLoadBadStripePattern (0 ms) 2024-09-16T07:43:05.142 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.EncryptionLoadFormatMismatch 2024-09-16T07:43:05.142 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:45:23.131 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.EncryptionLoadFormatMismatch (137990 ms) 2024-09-16T07:45:23.131 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.EncryptedResize 2024-09-16T07:45:23.131 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:45:36.277 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.EncryptedResize (13147 ms) 2024-09-16T07:45:36.278 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.EncryptedFlattenSmallData 2024-09-16T07:45:36.278 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:45:51.826 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.EncryptedFlattenSmallData (15548 ms) 2024-09-16T07:45:51.826 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.TestIOWithIOHint 2024-09-16T07:45:51.826 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:46:20.072 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 512 2024-09-16T07:46:20.072 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 512 2024-09-16T07:46:20.073 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 512 2024-09-16T07:46:20.073 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 512 2024-09-16T07:46:20.073 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 512 2024-09-16T07:46:20.073 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:46:20.073 INFO:tasks.workunit.client.0.smithi115.stdout:started write 2024-09-16T07:46:20.073 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:46:20.073 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:46:20.073 INFO:tasks.workunit.client.0.smithi115.stdout:finished write 2024-09-16T07:46:20.073 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:46:20.073 INFO:tasks.workunit.client.0.smithi115.stdout:started write 2024-09-16T07:46:20.073 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:46:20.073 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:46:20.073 INFO:tasks.workunit.client.0.smithi115.stdout:finished write 2024-09-16T07:46:20.074 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:46:20.074 INFO:tasks.workunit.client.0.smithi115.stdout:started write 2024-09-16T07:46:20.074 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:46:20.074 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:46:20.074 INFO:tasks.workunit.client.0.smithi115.stdout:finished write 2024-09-16T07:46:20.074 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:46:20.074 INFO:tasks.workunit.client.0.smithi115.stdout:started write 2024-09-16T07:46:20.074 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:46:20.074 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:46:20.074 INFO:tasks.workunit.client.0.smithi115.stdout:finished write 2024-09-16T07:46:20.074 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:46:20.074 INFO:tasks.workunit.client.0.smithi115.stdout:started write 2024-09-16T07:46:20.074 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:46:20.074 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:46:20.075 INFO:tasks.workunit.client.0.smithi115.stdout:finished write 2024-09-16T07:46:20.075 INFO:tasks.workunit.client.0.smithi115.stdout:start compare and write 2024-09-16T07:46:20.075 INFO:tasks.workunit.client.0.smithi115.stdout:compare and wrote: 512 2024-09-16T07:46:20.075 INFO:tasks.workunit.client.0.smithi115.stdout:start compare and write 2024-09-16T07:46:20.075 INFO:tasks.workunit.client.0.smithi115.stdout:compare and wrote: 512 2024-09-16T07:46:20.075 INFO:tasks.workunit.client.0.smithi115.stdout:start compare and write 2024-09-16T07:46:20.075 INFO:tasks.workunit.client.0.smithi115.stdout:compare and wrote: 512 2024-09-16T07:46:20.075 INFO:tasks.workunit.client.0.smithi115.stdout:start compare and write 2024-09-16T07:46:20.075 INFO:tasks.workunit.client.0.smithi115.stdout:compare and wrote: 512 2024-09-16T07:46:20.075 INFO:tasks.workunit.client.0.smithi115.stdout:start compare and write 2024-09-16T07:46:20.075 INFO:tasks.workunit.client.0.smithi115.stdout:compare and wrote: 512 2024-09-16T07:46:20.075 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:46:20.075 INFO:tasks.workunit.client.0.smithi115.stdout:started aio compare and write 2024-09-16T07:46:20.075 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:46:20.076 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:46:20.076 INFO:tasks.workunit.client.0.smithi115.stdout:finished aio compare and write 2024-09-16T07:46:20.076 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:46:20.076 INFO:tasks.workunit.client.0.smithi115.stdout:started aio compare and write 2024-09-16T07:46:20.076 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:46:20.076 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:46:20.076 INFO:tasks.workunit.client.0.smithi115.stdout:finished aio compare and write 2024-09-16T07:46:20.076 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:46:20.076 INFO:tasks.workunit.client.0.smithi115.stdout:started aio compare and write 2024-09-16T07:46:20.076 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:46:20.076 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:46:20.076 INFO:tasks.workunit.client.0.smithi115.stdout:finished aio compare and write 2024-09-16T07:46:20.076 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:46:20.077 INFO:tasks.workunit.client.0.smithi115.stdout:started aio compare and write 2024-09-16T07:46:20.077 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:46:20.077 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:46:20.077 INFO:tasks.workunit.client.0.smithi115.stdout:finished aio compare and write 2024-09-16T07:46:20.077 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:46:20.077 INFO:tasks.workunit.client.0.smithi115.stdout:started aio compare and write 2024-09-16T07:46:20.077 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:46:20.077 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:46:20.077 INFO:tasks.workunit.client.0.smithi115.stdout:finished aio compare and write 2024-09-16T07:46:20.077 INFO:tasks.workunit.client.0.smithi115.stdout:read: 512 2024-09-16T07:46:20.077 INFO:tasks.workunit.client.0.smithi115.stdout:read: 512 2024-09-16T07:46:20.077 INFO:tasks.workunit.client.0.smithi115.stdout:read: 512 2024-09-16T07:46:20.077 INFO:tasks.workunit.client.0.smithi115.stdout:read: 512 2024-09-16T07:46:20.077 INFO:tasks.workunit.client.0.smithi115.stdout:read: 512 2024-09-16T07:46:20.077 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:46:20.078 INFO:tasks.workunit.client.0.smithi115.stdout:started read 2024-09-16T07:46:20.078 INFO:tasks.workunit.client.0.smithi115.stdout:read completion cb called! 2024-09-16T07:46:20.078 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 512 2024-09-16T07:46:20.078 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:46:20.078 INFO:tasks.workunit.client.0.smithi115.stdout:started read 2024-09-16T07:46:20.078 INFO:tasks.workunit.client.0.smithi115.stdout:read completion cb called! 2024-09-16T07:46:20.078 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 512 2024-09-16T07:46:20.078 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:46:20.078 INFO:tasks.workunit.client.0.smithi115.stdout:started read 2024-09-16T07:46:20.078 INFO:tasks.workunit.client.0.smithi115.stdout:read completion cb called! 2024-09-16T07:46:20.078 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 512 2024-09-16T07:46:20.079 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:46:20.079 INFO:tasks.workunit.client.0.smithi115.stdout:started read 2024-09-16T07:46:20.079 INFO:tasks.workunit.client.0.smithi115.stdout:read completion cb called! 2024-09-16T07:46:20.079 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 512 2024-09-16T07:46:20.079 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:46:20.079 INFO:tasks.workunit.client.0.smithi115.stdout:started read 2024-09-16T07:46:20.079 INFO:tasks.workunit.client.0.smithi115.stdout:read completion cb called! 2024-09-16T07:46:20.079 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 512 2024-09-16T07:46:20.079 INFO:tasks.workunit.client.0.smithi115.stdout:discard: 512~512 = 512 2024-09-16T07:46:20.079 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:46:20.079 INFO:tasks.workunit.client.0.smithi115.stdout:aio discard: 1536~512 = 0 2024-09-16T07:46:20.079 INFO:tasks.workunit.client.0.smithi115.stdout:read: 512 2024-09-16T07:46:20.079 INFO:tasks.workunit.client.0.smithi115.stdout:read: 512 2024-09-16T07:46:20.079 INFO:tasks.workunit.client.0.smithi115.stdout:read: 512 2024-09-16T07:46:20.080 INFO:tasks.workunit.client.0.smithi115.stdout:read: 512 2024-09-16T07:46:20.080 INFO:tasks.workunit.client.0.smithi115.stdout:read: 512 2024-09-16T07:46:20.080 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 0 2024-09-16T07:46:20.080 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:46:20.080 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:46:20.080 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 0 2024-09-16T07:46:20.080 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:46:20.080 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:46:20.080 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 16384 2024-09-16T07:46:20.080 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:46:20.080 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:46:20.080 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 16384 2024-09-16T07:46:20.080 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:46:20.081 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:46:20.081 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:46:20.081 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:46:20.081 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 49152 2024-09-16T07:46:20.081 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:46:20.081 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:46:20.081 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 49152 2024-09-16T07:46:20.081 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:46:20.081 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:46:20.081 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 65536 2024-09-16T07:46:20.082 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:46:20.082 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:46:20.082 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 65536 2024-09-16T07:46:20.082 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:46:20.082 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:46:20.082 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:46:20.082 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:46:20.082 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 98304 2024-09-16T07:46:20.082 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:46:20.082 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:46:20.082 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 98304 2024-09-16T07:46:20.082 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:46:20.082 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:46:20.083 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 114688 2024-09-16T07:46:20.083 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:46:20.083 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:46:20.083 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 114688 2024-09-16T07:46:20.083 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:46:20.083 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:46:20.083 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:46:20.083 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:46:20.083 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 147456 2024-09-16T07:46:20.083 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:46:20.083 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:46:20.083 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 147456 2024-09-16T07:46:20.083 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:46:20.083 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:46:20.083 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 163840 2024-09-16T07:46:20.084 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:46:20.084 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:46:20.084 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 163840 2024-09-16T07:46:20.084 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:46:20.084 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:46:20.084 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:46:20.085 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:46:20.085 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 196608 2024-09-16T07:46:20.085 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:46:20.085 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:46:20.085 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 196608 2024-09-16T07:46:20.085 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:46:20.085 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:46:20.085 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 212992 2024-09-16T07:46:20.085 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:46:20.085 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:46:20.085 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 212992 2024-09-16T07:46:20.085 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:46:20.085 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:46:20.085 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:46:20.085 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:46:20.086 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:46:20.086 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:46:20.086 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:46:20.086 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:46:20.086 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:46:20.086 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:46:20.086 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:46:20.086 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:46:20.086 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:46:20.086 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:46:20.086 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:46:20.086 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:46:20.086 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:46:20.087 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:46:20.087 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:46:20.087 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:46:20.087 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:46:20.087 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:46:20.087 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:46:20.087 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:46:20.087 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:46:20.087 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:46:20.087 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:46:20.088 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:46:20.088 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:46:20.088 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:46:20.088 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:46:20.088 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:46:20.088 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:46:20.088 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:46:20.089 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:46:20.089 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:46:20.089 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:46:20.089 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:46:20.089 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:46:20.089 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:46:20.089 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:46:20.089 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:46:20.089 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:46:20.089 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:46:20.089 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:46:20.089 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:46:20.089 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:46:20.090 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:46:20.090 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:46:20.090 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:46:20.090 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:46:20.090 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:46:20.090 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:46:44.670 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:46:44.671 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:46:44.671 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:46:44.671 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:46:44.671 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:46:44.671 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:46:44.671 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:46:44.671 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:46:44.671 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:46:44.671 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:46:44.671 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:46:44.671 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:46:44.671 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:46:44.672 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:46:44.672 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:46:44.672 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:46:44.672 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:46:44.672 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:46:44.672 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:46:44.672 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:46:44.672 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:46:44.672 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:46:44.672 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:46:44.672 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:46:44.672 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:46:44.672 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:46:44.672 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:46:44.673 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:46:44.673 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:46:44.673 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:46:44.673 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:46:44.673 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:46:44.673 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:46:44.673 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:46:44.673 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:46:44.673 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:46:44.673 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:46:44.673 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:46:44.673 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:46:44.673 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:46:44.673 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:46:44.674 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:46:44.674 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:46:44.674 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:46:44.674 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:46:44.674 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:46:44.674 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:46:44.674 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:46:44.674 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:46:44.674 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:46:44.674 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:46:44.674 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:46:44.674 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:46:44.674 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:46:44.674 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:46:44.674 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:46:44.675 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:46:44.675 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:46:44.675 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:46:44.675 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:46:44.675 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:46:44.675 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:46:44.675 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:46:44.675 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:46:44.675 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:46:44.675 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:46:44.675 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:46:44.675 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:46:44.675 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:46:44.675 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:46:44.676 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:46:44.676 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:46:44.676 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:46:44.676 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:46:44.676 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:46:44.676 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:46:44.676 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:46:44.676 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:46:44.676 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:46:44.676 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:46:44.676 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:46:44.676 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:46:44.676 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:46:44.677 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:46:44.677 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:46:44.677 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:46:44.677 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:46:44.677 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:46:44.677 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:46:44.677 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:46:44.677 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:46:44.677 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:46:44.677 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:46:44.677 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:46:44.677 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:46:44.677 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:46:44.678 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:46:44.678 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:46:44.678 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:46:44.678 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:46:44.678 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:46:44.678 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:46:44.678 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:46:44.678 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:46:44.678 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:46:44.678 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:46:44.678 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:46:44.678 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:46:44.679 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:46:44.679 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:46:44.679 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:46:44.679 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:46:44.679 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:46:44.679 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:46:44.679 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:46:44.679 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:46:44.679 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:46:44.679 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:46:44.679 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:46:44.679 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:46:44.679 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:46:44.680 INFO:tasks.workunit.client.0.smithi115.stdout:read completion cb called! 2024-09-16T07:46:44.680 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 512 2024-09-16T07:46:44.680 INFO:tasks.workunit.client.0.smithi115.stdout:read completion cb called! 2024-09-16T07:46:44.680 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.TestIOWithIOHint (52844 ms) 2024-09-16T07:46:44.680 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.TestDataPoolIO 2024-09-16T07:46:46.142 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:46:48.977 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 512 2024-09-16T07:46:48.977 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 512 2024-09-16T07:46:48.977 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 512 2024-09-16T07:46:48.978 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 512 2024-09-16T07:46:48.978 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 512 2024-09-16T07:46:48.978 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:46:48.978 INFO:tasks.workunit.client.0.smithi115.stdout:started write 2024-09-16T07:46:48.978 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:46:48.978 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:46:48.978 INFO:tasks.workunit.client.0.smithi115.stdout:finished write 2024-09-16T07:46:48.978 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:46:48.978 INFO:tasks.workunit.client.0.smithi115.stdout:started write 2024-09-16T07:46:48.978 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:46:48.979 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:46:48.979 INFO:tasks.workunit.client.0.smithi115.stdout:finished write 2024-09-16T07:46:48.979 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:46:48.979 INFO:tasks.workunit.client.0.smithi115.stdout:started write 2024-09-16T07:46:48.979 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:46:48.979 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:46:48.979 INFO:tasks.workunit.client.0.smithi115.stdout:finished write 2024-09-16T07:46:48.979 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:46:48.979 INFO:tasks.workunit.client.0.smithi115.stdout:started write 2024-09-16T07:46:48.979 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:46:48.979 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:46:48.980 INFO:tasks.workunit.client.0.smithi115.stdout:finished write 2024-09-16T07:46:48.980 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:46:48.980 INFO:tasks.workunit.client.0.smithi115.stdout:started write 2024-09-16T07:46:48.980 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:46:48.980 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:46:48.980 INFO:tasks.workunit.client.0.smithi115.stdout:finished write 2024-09-16T07:46:48.980 INFO:tasks.workunit.client.0.smithi115.stdout:read: 512 2024-09-16T07:46:48.980 INFO:tasks.workunit.client.0.smithi115.stdout:read: 512 2024-09-16T07:46:48.980 INFO:tasks.workunit.client.0.smithi115.stdout:read: 512 2024-09-16T07:46:48.980 INFO:tasks.workunit.client.0.smithi115.stdout:read: 512 2024-09-16T07:46:48.980 INFO:tasks.workunit.client.0.smithi115.stdout:read: 512 2024-09-16T07:46:48.980 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:46:48.981 INFO:tasks.workunit.client.0.smithi115.stdout:started read 2024-09-16T07:46:48.981 INFO:tasks.workunit.client.0.smithi115.stdout:read completion cb called! 2024-09-16T07:46:48.981 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 512 2024-09-16T07:46:48.981 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:46:48.981 INFO:tasks.workunit.client.0.smithi115.stdout:started read 2024-09-16T07:46:48.981 INFO:tasks.workunit.client.0.smithi115.stdout:read completion cb called! 2024-09-16T07:46:48.981 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 512 2024-09-16T07:46:48.981 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:46:48.981 INFO:tasks.workunit.client.0.smithi115.stdout:started read 2024-09-16T07:46:48.981 INFO:tasks.workunit.client.0.smithi115.stdout:read completion cb called! 2024-09-16T07:46:48.981 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 512 2024-09-16T07:46:48.982 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:46:48.982 INFO:tasks.workunit.client.0.smithi115.stdout:started read 2024-09-16T07:46:48.982 INFO:tasks.workunit.client.0.smithi115.stdout:read completion cb called! 2024-09-16T07:46:48.982 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 512 2024-09-16T07:46:48.982 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:46:48.982 INFO:tasks.workunit.client.0.smithi115.stdout:started read 2024-09-16T07:46:48.982 INFO:tasks.workunit.client.0.smithi115.stdout:read completion cb called! 2024-09-16T07:46:48.982 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 512 2024-09-16T07:46:48.982 INFO:tasks.workunit.client.0.smithi115.stdout:discard: 512~512 = 512 2024-09-16T07:46:48.982 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:46:48.982 INFO:tasks.workunit.client.0.smithi115.stdout:aio discard: 1536~512 = 0 2024-09-16T07:46:48.982 INFO:tasks.workunit.client.0.smithi115.stdout:read: 512 2024-09-16T07:46:48.982 INFO:tasks.workunit.client.0.smithi115.stdout:read: 512 2024-09-16T07:46:48.983 INFO:tasks.workunit.client.0.smithi115.stdout:read: 512 2024-09-16T07:46:48.983 INFO:tasks.workunit.client.0.smithi115.stdout:read: 512 2024-09-16T07:46:48.983 INFO:tasks.workunit.client.0.smithi115.stdout:read: 512 2024-09-16T07:46:48.983 INFO:tasks.workunit.client.0.smithi115.stdout:read completion cb called! 2024-09-16T07:46:48.983 INFO:tasks.workunit.client.0.smithi115.stdout:read completion cb called! 2024-09-16T07:46:48.983 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.TestDataPoolIO (4308 ms) 2024-09-16T07:46:48.983 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteMismatch 2024-09-16T07:46:48.983 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:46:49.299 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.TestCompareAndWriteMismatch (322 ms) 2024-09-16T07:46:49.299 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteMismatch 2024-09-16T07:46:49.299 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:46:49.692 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteMismatch (393 ms) 2024-09-16T07:46:49.692 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteSuccess 2024-09-16T07:46:49.692 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:46:49.991 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.TestCompareAndWriteSuccess (299 ms) 2024-09-16T07:46:49.992 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteSuccess 2024-09-16T07:46:49.992 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:46:50.296 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteSuccess (305 ms) 2024-09-16T07:46:50.296 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteStripeUnitUnaligned 2024-09-16T07:46:50.296 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:46:50.739 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.TestCompareAndWriteStripeUnitUnaligned (443 ms) 2024-09-16T07:46:50.739 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteStripeUnitUnaligned 2024-09-16T07:46:50.739 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:46:51.146 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteStripeUnitUnaligned (406 ms) 2024-09-16T07:46:51.146 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteTooLarge 2024-09-16T07:46:51.146 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:46:51.615 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.TestCompareAndWriteTooLarge (470 ms) 2024-09-16T07:46:51.615 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteTooLarge 2024-09-16T07:46:51.615 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:46:51.989 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteTooLarge (374 ms) 2024-09-16T07:46:51.989 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteStripeUnitSuccess 2024-09-16T07:46:51.989 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:46:54.831 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.TestCompareAndWriteStripeUnitSuccess (2842 ms) 2024-09-16T07:46:54.832 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteStripeUnitSuccess 2024-09-16T07:46:54.832 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:46:57.547 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteStripeUnitSuccess (2715 ms) 2024-09-16T07:46:57.547 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteVIovecLenDiffers 2024-09-16T07:46:57.547 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:46:57.832 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteVIovecLenDiffers (285 ms) 2024-09-16T07:46:57.832 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteVMismatch 2024-09-16T07:46:57.832 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:46:58.136 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteVMismatch (305 ms) 2024-09-16T07:46:58.136 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteVSuccess 2024-09-16T07:46:58.136 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:46:58.441 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteVSuccess (305 ms) 2024-09-16T07:46:58.441 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.TestScatterGatherIO 2024-09-16T07:46:58.441 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:46:58.763 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.TestScatterGatherIO (322 ms) 2024-09-16T07:46:58.763 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.TestEmptyDiscard 2024-09-16T07:46:58.763 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:46:59.019 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:46:59.020 INFO:tasks.workunit.client.0.smithi115.stdout:aio discard: 0~1048576 = 0 2024-09-16T07:46:59.020 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:46:59.020 INFO:tasks.workunit.client.0.smithi115.stdout:aio discard: 0~4194304 = 0 2024-09-16T07:46:59.020 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:46:59.020 INFO:tasks.workunit.client.0.smithi115.stdout:aio discard: 3145728~1048576 = 0 2024-09-16T07:46:59.020 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.TestEmptyDiscard (256 ms) 2024-09-16T07:46:59.020 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.TestFUA 2024-09-16T07:46:59.020 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:47:00.524 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 512 2024-09-16T07:47:00.524 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 512 2024-09-16T07:47:00.524 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 512 2024-09-16T07:47:00.525 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 512 2024-09-16T07:47:00.525 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 512 2024-09-16T07:47:00.525 INFO:tasks.workunit.client.0.smithi115.stdout:read: 512 2024-09-16T07:47:00.525 INFO:tasks.workunit.client.0.smithi115.stdout:read: 512 2024-09-16T07:47:00.525 INFO:tasks.workunit.client.0.smithi115.stdout:read: 512 2024-09-16T07:47:00.525 INFO:tasks.workunit.client.0.smithi115.stdout:read: 512 2024-09-16T07:47:00.525 INFO:tasks.workunit.client.0.smithi115.stdout:read: 512 2024-09-16T07:47:00.525 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:47:00.525 INFO:tasks.workunit.client.0.smithi115.stdout:started write 2024-09-16T07:47:00.525 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:47:00.525 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:47:00.525 INFO:tasks.workunit.client.0.smithi115.stdout:finished write 2024-09-16T07:47:00.525 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:47:00.525 INFO:tasks.workunit.client.0.smithi115.stdout:started write 2024-09-16T07:47:00.526 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:47:00.526 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:47:00.526 INFO:tasks.workunit.client.0.smithi115.stdout:finished write 2024-09-16T07:47:00.526 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:47:00.526 INFO:tasks.workunit.client.0.smithi115.stdout:started write 2024-09-16T07:47:00.526 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:47:00.526 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:47:00.526 INFO:tasks.workunit.client.0.smithi115.stdout:finished write 2024-09-16T07:47:00.526 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:47:00.526 INFO:tasks.workunit.client.0.smithi115.stdout:started write 2024-09-16T07:47:00.526 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:47:00.526 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:47:00.526 INFO:tasks.workunit.client.0.smithi115.stdout:finished write 2024-09-16T07:47:00.526 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:47:00.527 INFO:tasks.workunit.client.0.smithi115.stdout:started write 2024-09-16T07:47:00.527 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:47:00.527 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:47:00.527 INFO:tasks.workunit.client.0.smithi115.stdout:finished write 2024-09-16T07:47:00.527 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:47:00.527 INFO:tasks.workunit.client.0.smithi115.stdout:started read 2024-09-16T07:47:00.527 INFO:tasks.workunit.client.0.smithi115.stdout:read completion cb called! 2024-09-16T07:47:00.527 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 512 2024-09-16T07:47:00.527 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:47:00.527 INFO:tasks.workunit.client.0.smithi115.stdout:started read 2024-09-16T07:47:00.527 INFO:tasks.workunit.client.0.smithi115.stdout:read completion cb called! 2024-09-16T07:47:00.527 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 512 2024-09-16T07:47:00.527 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:47:00.528 INFO:tasks.workunit.client.0.smithi115.stdout:started read 2024-09-16T07:47:00.528 INFO:tasks.workunit.client.0.smithi115.stdout:read completion cb called! 2024-09-16T07:47:00.528 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 512 2024-09-16T07:47:00.528 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:47:00.528 INFO:tasks.workunit.client.0.smithi115.stdout:started read 2024-09-16T07:47:00.528 INFO:tasks.workunit.client.0.smithi115.stdout:read completion cb called! 2024-09-16T07:47:00.528 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 512 2024-09-16T07:47:00.528 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:47:00.528 INFO:tasks.workunit.client.0.smithi115.stdout:started read 2024-09-16T07:47:00.528 INFO:tasks.workunit.client.0.smithi115.stdout:read completion cb called! 2024-09-16T07:47:00.528 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 512 2024-09-16T07:47:00.528 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.TestFUA (1505 ms) 2024-09-16T07:47:00.528 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.TestIOPP 2024-09-16T07:47:00.528 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:47:00.734 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 512 2024-09-16T07:47:00.735 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 512 2024-09-16T07:47:00.735 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 512 2024-09-16T07:47:00.735 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 512 2024-09-16T07:47:00.735 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 512 2024-09-16T07:47:00.735 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:47:00.735 INFO:tasks.workunit.client.0.smithi115.stdout:started write 2024-09-16T07:47:00.735 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:47:00.735 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:47:00.735 INFO:tasks.workunit.client.0.smithi115.stdout:finished write 2024-09-16T07:47:00.735 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:47:00.735 INFO:tasks.workunit.client.0.smithi115.stdout:started write 2024-09-16T07:47:00.735 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:47:00.735 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:47:00.736 INFO:tasks.workunit.client.0.smithi115.stdout:finished write 2024-09-16T07:47:00.736 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:47:00.736 INFO:tasks.workunit.client.0.smithi115.stdout:started write 2024-09-16T07:47:00.736 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:47:00.736 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:47:00.736 INFO:tasks.workunit.client.0.smithi115.stdout:finished write 2024-09-16T07:47:00.736 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:47:00.736 INFO:tasks.workunit.client.0.smithi115.stdout:started write 2024-09-16T07:47:00.736 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:47:00.736 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:47:00.736 INFO:tasks.workunit.client.0.smithi115.stdout:finished write 2024-09-16T07:47:00.736 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:47:00.736 INFO:tasks.workunit.client.0.smithi115.stdout:started write 2024-09-16T07:47:00.737 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:47:00.919 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:47:00.919 INFO:tasks.workunit.client.0.smithi115.stdout:finished write 2024-09-16T07:47:00.919 INFO:tasks.workunit.client.0.smithi115.stdout:start compare and write 2024-09-16T07:47:00.919 INFO:tasks.workunit.client.0.smithi115.stdout:compare and wrote: 512 2024-09-16T07:47:00.919 INFO:tasks.workunit.client.0.smithi115.stdout:start compare and write 2024-09-16T07:47:00.919 INFO:tasks.workunit.client.0.smithi115.stdout:compare and wrote: 512 2024-09-16T07:47:00.919 INFO:tasks.workunit.client.0.smithi115.stdout:start compare and write 2024-09-16T07:47:00.919 INFO:tasks.workunit.client.0.smithi115.stdout:compare and wrote: 512 2024-09-16T07:47:00.920 INFO:tasks.workunit.client.0.smithi115.stdout:start compare and write 2024-09-16T07:47:00.920 INFO:tasks.workunit.client.0.smithi115.stdout:compare and wrote: 512 2024-09-16T07:47:00.920 INFO:tasks.workunit.client.0.smithi115.stdout:start compare and write 2024-09-16T07:47:00.920 INFO:tasks.workunit.client.0.smithi115.stdout:compare and wrote: 512 2024-09-16T07:47:00.920 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:47:00.920 INFO:tasks.workunit.client.0.smithi115.stdout:started aio compare and write 2024-09-16T07:47:00.920 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:47:00.932 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:47:00.932 INFO:tasks.workunit.client.0.smithi115.stdout:finished aio compare and write 2024-09-16T07:47:00.932 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:47:00.932 INFO:tasks.workunit.client.0.smithi115.stdout:started aio compare and write 2024-09-16T07:47:00.932 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:47:00.945 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:47:00.945 INFO:tasks.workunit.client.0.smithi115.stdout:finished aio compare and write 2024-09-16T07:47:00.945 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:47:00.945 INFO:tasks.workunit.client.0.smithi115.stdout:started aio compare and write 2024-09-16T07:47:00.945 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:47:00.958 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:47:00.958 INFO:tasks.workunit.client.0.smithi115.stdout:finished aio compare and write 2024-09-16T07:47:00.959 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:47:00.959 INFO:tasks.workunit.client.0.smithi115.stdout:started aio compare and write 2024-09-16T07:47:00.959 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:47:00.971 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:47:00.971 INFO:tasks.workunit.client.0.smithi115.stdout:finished aio compare and write 2024-09-16T07:47:00.971 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:47:00.971 INFO:tasks.workunit.client.0.smithi115.stdout:started aio compare and write 2024-09-16T07:47:00.971 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:47:00.999 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:47:00.999 INFO:tasks.workunit.client.0.smithi115.stdout:finished aio compare and write 2024-09-16T07:47:00.999 INFO:tasks.workunit.client.0.smithi115.stdout:read: 512 2024-09-16T07:47:00.999 INFO:tasks.workunit.client.0.smithi115.stdout:read: 512 2024-09-16T07:47:00.999 INFO:tasks.workunit.client.0.smithi115.stdout:read: 512 2024-09-16T07:47:00.999 INFO:tasks.workunit.client.0.smithi115.stdout:read: 512 2024-09-16T07:47:00.999 INFO:tasks.workunit.client.0.smithi115.stdout:read: 512 2024-09-16T07:47:01.000 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:47:01.000 INFO:tasks.workunit.client.0.smithi115.stdout:started read 2024-09-16T07:47:01.000 INFO:tasks.workunit.client.0.smithi115.stdout:read completion cb called! 2024-09-16T07:47:01.002 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 512 2024-09-16T07:47:01.002 INFO:tasks.workunit.client.0.smithi115.stdout:finished read 2024-09-16T07:47:01.003 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:47:01.003 INFO:tasks.workunit.client.0.smithi115.stdout:started read 2024-09-16T07:47:01.003 INFO:tasks.workunit.client.0.smithi115.stdout:read completion cb called! 2024-09-16T07:47:01.006 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 512 2024-09-16T07:47:01.007 INFO:tasks.workunit.client.0.smithi115.stdout:finished read 2024-09-16T07:47:01.007 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:47:01.007 INFO:tasks.workunit.client.0.smithi115.stdout:started read 2024-09-16T07:47:01.007 INFO:tasks.workunit.client.0.smithi115.stdout:read completion cb called! 2024-09-16T07:47:01.011 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 512 2024-09-16T07:47:01.011 INFO:tasks.workunit.client.0.smithi115.stdout:finished read 2024-09-16T07:47:01.011 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:47:01.011 INFO:tasks.workunit.client.0.smithi115.stdout:started read 2024-09-16T07:47:01.011 INFO:tasks.workunit.client.0.smithi115.stdout:read completion cb called! 2024-09-16T07:47:01.015 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 512 2024-09-16T07:47:01.015 INFO:tasks.workunit.client.0.smithi115.stdout:finished read 2024-09-16T07:47:01.015 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:47:01.015 INFO:tasks.workunit.client.0.smithi115.stdout:started read 2024-09-16T07:47:01.015 INFO:tasks.workunit.client.0.smithi115.stdout:read completion cb called! 2024-09-16T07:47:01.015 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 512 2024-09-16T07:47:01.015 INFO:tasks.workunit.client.0.smithi115.stdout:finished read 2024-09-16T07:47:01.016 INFO:tasks.workunit.client.0.smithi115.stdout:discard: 512~512 2024-09-16T07:47:01.016 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:47:21.926 INFO:tasks.workunit.client.0.smithi115.stdout:read: 512 2024-09-16T07:47:21.927 INFO:tasks.workunit.client.0.smithi115.stdout:read: 512 2024-09-16T07:47:21.927 INFO:tasks.workunit.client.0.smithi115.stdout:read: 512 2024-09-16T07:47:21.927 INFO:tasks.workunit.client.0.smithi115.stdout:read: 512 2024-09-16T07:47:21.927 INFO:tasks.workunit.client.0.smithi115.stdout:read: 512 2024-09-16T07:47:21.927 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 0 2024-09-16T07:47:21.927 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:47:21.927 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:47:21.927 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 0 2024-09-16T07:47:21.928 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:47:21.928 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:47:21.928 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 16384 2024-09-16T07:47:21.928 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:47:21.928 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:47:21.928 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 16384 2024-09-16T07:47:21.928 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:47:21.928 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:47:21.928 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:47:21.928 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:47:21.928 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 49152 2024-09-16T07:47:21.928 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:47:21.929 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:47:21.929 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 49152 2024-09-16T07:47:21.929 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:47:21.929 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:47:21.929 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 65536 2024-09-16T07:47:21.929 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:47:21.929 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:47:21.929 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 65536 2024-09-16T07:47:21.929 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:47:21.929 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:47:21.929 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:47:21.929 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:47:21.929 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 98304 2024-09-16T07:47:21.929 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:47:21.930 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:47:21.930 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 98304 2024-09-16T07:47:21.930 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:47:21.930 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:47:21.930 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 114688 2024-09-16T07:47:21.930 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:47:21.930 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:47:21.930 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 114688 2024-09-16T07:47:21.930 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:47:21.930 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:47:21.931 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:47:21.931 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:47:21.931 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 147456 2024-09-16T07:47:21.931 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:47:21.931 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:47:21.931 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 147456 2024-09-16T07:47:21.931 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:47:21.931 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:47:21.931 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 163840 2024-09-16T07:47:21.932 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:47:21.932 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:47:21.932 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 163840 2024-09-16T07:47:21.932 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:47:21.932 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:47:21.932 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:47:21.932 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:47:21.932 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 196608 2024-09-16T07:47:21.932 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:47:21.932 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:47:21.932 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 196608 2024-09-16T07:47:21.932 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:47:21.932 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:47:21.933 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 212992 2024-09-16T07:47:21.933 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:47:21.933 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:47:21.933 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 212992 2024-09-16T07:47:21.933 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:47:21.933 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:47:21.933 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:47:21.933 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:47:21.933 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:47:21.933 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:47:21.933 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:47:21.933 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:47:21.933 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:47:21.933 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:47:21.934 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:47:21.934 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:47:21.934 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:47:21.934 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:47:21.934 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:47:21.934 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:47:21.934 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:47:21.934 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:47:21.934 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:47:21.934 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:47:21.934 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:47:22.081 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:47:22.081 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:47:22.081 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:47:22.081 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:47:22.081 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:47:22.081 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:47:22.081 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:47:22.218 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:47:22.218 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:47:22.218 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:47:22.218 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:47:22.218 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:47:22.218 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:47:22.218 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:47:22.218 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:47:22.218 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:47:22.219 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:47:22.219 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:47:22.219 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:47:22.219 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:47:22.732 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:47:22.732 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:47:22.732 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:47:22.733 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:47:22.733 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:47:22.733 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:47:22.733 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:47:23.114 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:47:23.114 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:47:23.114 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:47:23.114 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:47:23.114 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:47:23.114 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:47:23.114 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:47:23.848 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:47:23.849 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:47:23.849 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:47:23.849 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:47:23.849 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:47:23.849 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:47:23.849 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:47:24.367 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:47:24.367 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:47:24.367 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:47:24.367 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:47:24.367 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:47:24.367 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:47:24.367 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:47:24.367 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:47:24.367 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:47:24.367 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:47:24.368 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:47:24.368 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:47:24.368 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:47:25.314 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:47:25.314 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:47:25.314 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:47:25.314 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:47:25.314 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:47:25.314 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:47:25.314 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:47:26.188 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:47:26.188 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:47:26.189 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:47:26.189 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:47:26.189 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:47:26.189 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:47:26.189 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:47:27.496 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:47:27.496 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:47:27.496 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:47:27.496 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:47:27.496 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:47:27.496 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:47:27.496 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:47:28.424 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:47:28.424 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:47:28.425 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:47:28.425 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:47:28.425 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:47:28.425 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:47:28.425 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:47:28.425 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:47:28.425 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:47:28.425 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:47:28.425 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:47:28.425 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:47:28.425 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:47:30.116 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:47:30.116 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:47:30.116 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:47:30.116 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:47:30.116 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:47:30.116 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:47:30.116 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:47:31.337 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:47:31.337 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:47:31.337 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:47:31.337 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:47:31.337 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:47:31.337 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:47:31.338 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:47:33.037 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:47:33.038 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:47:33.038 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:47:33.038 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:47:33.038 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:47:33.038 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:47:33.038 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:47:34.496 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:47:34.496 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:47:34.496 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:47:34.496 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:47:34.496 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:47:34.497 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:47:34.497 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:47:34.497 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:47:34.497 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:47:34.497 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:47:34.497 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:47:34.497 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:47:34.497 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:47:36.681 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:47:36.681 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:47:36.682 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:47:36.682 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:47:36.682 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:47:36.682 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:47:36.682 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:47:38.445 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:47:38.445 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:47:38.445 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:47:38.445 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:47:38.445 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:47:38.445 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:47:38.445 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:47:40.601 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:47:40.601 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:47:40.601 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:47:40.602 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:47:40.602 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:47:40.602 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:47:40.602 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:47:42.468 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:47:42.468 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:47:42.468 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:47:42.468 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:47:42.469 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:47:42.469 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:47:42.469 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:47:42.469 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:47:42.469 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:47:42.469 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:47:42.470 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.TestIOPP (41943 ms) 2024-09-16T07:47:42.470 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteCompareTooSmallPP 2024-09-16T07:47:42.470 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:47:42.873 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.TestCompareAndWriteCompareTooSmallPP (406 ms) 2024-09-16T07:47:42.874 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteCompareTooSmallPP 2024-09-16T07:47:42.874 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:47:43.151 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteCompareTooSmallPP (278 ms) 2024-09-16T07:47:43.151 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteWriteTooSmallPP 2024-09-16T07:47:43.151 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:47:43.429 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.TestCompareAndWriteWriteTooSmallPP (278 ms) 2024-09-16T07:47:43.429 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteWriteTooSmallPP 2024-09-16T07:47:43.429 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:47:43.737 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteWriteTooSmallPP (307 ms) 2024-09-16T07:47:43.737 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteMismatchPP 2024-09-16T07:47:43.737 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:47:44.029 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.TestCompareAndWriteMismatchPP (293 ms) 2024-09-16T07:47:44.029 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteMismatchPP 2024-09-16T07:47:44.029 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:47:44.264 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:47:44.320 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteMismatchPP (291 ms) 2024-09-16T07:47:44.320 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteMismatchBufferlistGreaterLenPP 2024-09-16T07:47:44.320 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:47:44.659 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.TestCompareAndWriteMismatchBufferlistGreaterLenPP (338 ms) 2024-09-16T07:47:44.659 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteMismatchBufferlistGreaterLenPP 2024-09-16T07:47:44.659 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:47:44.891 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:47:44.944 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteMismatchBufferlistGreaterLenPP (285 ms) 2024-09-16T07:47:44.945 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteSuccessPP 2024-09-16T07:47:44.945 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:47:45.307 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.TestCompareAndWriteSuccessPP (362 ms) 2024-09-16T07:47:45.307 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteSuccessPP 2024-09-16T07:47:45.307 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:47:45.676 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:47:45.731 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteSuccessPP (424 ms) 2024-09-16T07:47:45.731 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteSuccessBufferlistGreaterLenPP 2024-09-16T07:47:45.731 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:47:46.044 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.TestCompareAndWriteSuccessBufferlistGreaterLenPP (314 ms) 2024-09-16T07:47:46.044 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteSuccessBufferlistGreaterLenPP 2024-09-16T07:47:46.045 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:47:46.293 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:47:46.355 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteSuccessBufferlistGreaterLenPP (311 ms) 2024-09-16T07:47:46.355 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteStripeUnitUnalignedPP 2024-09-16T07:47:46.355 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:47:46.786 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.TestCompareAndWriteStripeUnitUnalignedPP (431 ms) 2024-09-16T07:47:46.787 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteStripeUnitUnalignedPP 2024-09-16T07:47:46.787 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:47:47.144 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:47:47.226 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteStripeUnitUnalignedPP (440 ms) 2024-09-16T07:47:47.226 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteTooLargePP 2024-09-16T07:47:47.226 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:47:47.695 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.TestCompareAndWriteTooLargePP (469 ms) 2024-09-16T07:47:47.695 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteTooLargePP 2024-09-16T07:47:47.695 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:47:48.012 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:47:48.089 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteTooLargePP (393 ms) 2024-09-16T07:47:48.089 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteStripeUnitSuccessPP 2024-09-16T07:47:48.089 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:47:50.917 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.TestCompareAndWriteStripeUnitSuccessPP (2828 ms) 2024-09-16T07:47:50.917 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteStripeUnitSuccessPP 2024-09-16T07:47:50.917 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:47:53.433 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:47:53.666 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteStripeUnitSuccessPP (2748 ms) 2024-09-16T07:47:53.666 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.TestIOPPWithIOHint 2024-09-16T07:47:53.666 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:47:53.961 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 512 2024-09-16T07:47:53.961 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 512 2024-09-16T07:47:53.961 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 512 2024-09-16T07:47:53.961 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 512 2024-09-16T07:47:53.962 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 512 2024-09-16T07:47:53.962 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:47:53.962 INFO:tasks.workunit.client.0.smithi115.stdout:started write 2024-09-16T07:47:53.962 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:47:53.974 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:47:53.974 INFO:tasks.workunit.client.0.smithi115.stdout:finished write 2024-09-16T07:47:53.974 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:47:53.974 INFO:tasks.workunit.client.0.smithi115.stdout:started write 2024-09-16T07:47:53.974 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:47:53.986 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:47:53.986 INFO:tasks.workunit.client.0.smithi115.stdout:finished write 2024-09-16T07:47:53.986 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:47:53.986 INFO:tasks.workunit.client.0.smithi115.stdout:started write 2024-09-16T07:47:53.986 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:47:53.999 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:47:53.999 INFO:tasks.workunit.client.0.smithi115.stdout:finished write 2024-09-16T07:47:53.999 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:47:53.999 INFO:tasks.workunit.client.0.smithi115.stdout:started write 2024-09-16T07:47:53.999 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:47:54.012 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:47:54.012 INFO:tasks.workunit.client.0.smithi115.stdout:finished write 2024-09-16T07:47:54.012 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:47:54.012 INFO:tasks.workunit.client.0.smithi115.stdout:started write 2024-09-16T07:47:54.012 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:47:54.021 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:47:54.021 INFO:tasks.workunit.client.0.smithi115.stdout:finished write 2024-09-16T07:47:54.021 INFO:tasks.workunit.client.0.smithi115.stdout:read: 512 2024-09-16T07:47:54.021 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:47:54.021 INFO:tasks.workunit.client.0.smithi115.stdout:started read 2024-09-16T07:47:54.021 INFO:tasks.workunit.client.0.smithi115.stdout:read completion cb called! 2024-09-16T07:47:54.025 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 512 2024-09-16T07:47:54.025 INFO:tasks.workunit.client.0.smithi115.stdout:finished read 2024-09-16T07:47:54.025 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:47:54.025 INFO:tasks.workunit.client.0.smithi115.stdout:started read 2024-09-16T07:47:54.025 INFO:tasks.workunit.client.0.smithi115.stdout:read completion cb called! 2024-09-16T07:47:54.029 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 512 2024-09-16T07:47:54.029 INFO:tasks.workunit.client.0.smithi115.stdout:finished read 2024-09-16T07:47:54.029 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:47:54.029 INFO:tasks.workunit.client.0.smithi115.stdout:started read 2024-09-16T07:47:54.029 INFO:tasks.workunit.client.0.smithi115.stdout:read completion cb called! 2024-09-16T07:47:54.033 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 512 2024-09-16T07:47:54.034 INFO:tasks.workunit.client.0.smithi115.stdout:finished read 2024-09-16T07:47:54.034 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:47:54.034 INFO:tasks.workunit.client.0.smithi115.stdout:started read 2024-09-16T07:47:54.034 INFO:tasks.workunit.client.0.smithi115.stdout:read completion cb called! 2024-09-16T07:47:54.038 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 512 2024-09-16T07:47:54.038 INFO:tasks.workunit.client.0.smithi115.stdout:finished read 2024-09-16T07:47:54.038 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:47:54.038 INFO:tasks.workunit.client.0.smithi115.stdout:started read 2024-09-16T07:47:54.038 INFO:tasks.workunit.client.0.smithi115.stdout:read completion cb called! 2024-09-16T07:48:14.300 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 512 2024-09-16T07:48:14.300 INFO:tasks.workunit.client.0.smithi115.stdout:finished read 2024-09-16T07:48:14.300 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 0 2024-09-16T07:48:14.300 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:48:14.300 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:48:14.301 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 0 2024-09-16T07:48:14.301 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:48:14.301 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:48:14.301 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 16384 2024-09-16T07:48:14.301 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:48:14.301 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:48:14.301 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 16384 2024-09-16T07:48:14.301 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:48:14.301 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:48:14.301 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:48:14.301 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:48:14.301 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 49152 2024-09-16T07:48:14.302 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:48:14.302 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:48:14.302 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 49152 2024-09-16T07:48:14.302 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:48:14.302 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:48:14.302 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 65536 2024-09-16T07:48:14.302 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:48:14.302 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:48:14.302 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 65536 2024-09-16T07:48:14.302 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:48:14.302 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:48:14.302 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:48:14.302 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:48:14.303 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 98304 2024-09-16T07:48:14.303 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:48:14.303 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:48:14.303 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 98304 2024-09-16T07:48:14.303 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:48:14.303 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:48:14.303 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 114688 2024-09-16T07:48:14.303 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:48:14.303 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:48:14.303 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 114688 2024-09-16T07:48:14.303 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:48:14.304 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:48:14.304 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:48:14.304 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:48:14.304 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 147456 2024-09-16T07:48:14.304 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:48:14.304 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:48:14.304 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 147456 2024-09-16T07:48:14.304 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:48:14.304 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:48:14.304 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 163840 2024-09-16T07:48:14.304 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:48:14.304 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:48:14.305 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 163840 2024-09-16T07:48:14.305 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:48:14.305 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:48:14.305 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:48:14.305 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:48:14.305 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 196608 2024-09-16T07:48:14.305 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:48:14.305 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:48:14.305 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 196608 2024-09-16T07:48:14.305 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:48:14.305 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:48:14.305 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 212992 2024-09-16T07:48:14.306 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:48:14.306 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:48:14.306 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 212992 2024-09-16T07:48:14.306 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:48:14.306 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:48:14.306 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:48:14.306 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:48:14.306 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:48:14.306 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:48:14.306 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:48:14.306 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:48:14.306 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:48:14.306 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:48:14.306 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:48:14.307 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:48:14.307 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:48:14.307 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:48:14.313 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:48:14.313 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:48:14.313 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:48:14.313 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:48:14.314 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:48:14.314 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:48:14.314 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:48:14.529 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:48:14.529 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:48:14.529 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:48:14.529 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:48:14.529 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:48:14.529 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:48:14.529 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:48:14.814 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:48:14.814 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:48:14.814 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:48:14.815 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:48:14.815 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:48:14.815 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:48:14.815 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:48:14.815 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:48:14.815 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:48:14.815 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:48:14.815 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:48:14.815 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:48:14.815 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:48:15.249 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:48:15.249 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:48:15.249 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:48:15.249 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:48:15.249 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:48:15.249 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:48:15.249 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:48:15.671 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:48:15.671 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:48:15.671 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:48:15.671 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:48:15.671 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:48:15.671 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:48:15.671 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:48:16.254 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:48:16.255 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:48:16.255 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:48:16.255 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:48:16.256 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:48:16.256 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:48:16.256 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:48:16.831 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:48:16.831 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:48:16.831 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:48:16.831 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:48:16.831 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:48:16.831 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:48:16.831 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:48:16.831 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:48:16.832 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:48:16.832 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:48:16.832 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:48:16.832 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:48:16.832 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:48:17.948 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:48:17.948 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:48:17.949 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:48:17.949 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:48:17.949 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:48:17.949 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:48:17.949 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:48:18.786 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:48:18.787 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:48:18.787 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:48:18.787 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:48:18.787 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:48:18.787 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:48:18.787 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:48:19.982 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:48:19.983 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:48:19.983 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:48:19.983 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:48:19.983 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:48:19.983 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:48:19.983 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:48:20.969 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:48:20.969 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:48:20.969 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:48:20.969 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:48:20.970 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:48:20.970 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:48:20.970 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:48:20.970 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:48:20.970 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:48:20.970 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:48:20.970 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:48:20.970 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:48:20.970 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:48:22.549 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:48:22.549 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:48:22.549 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:48:22.549 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:48:22.550 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:48:22.550 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:48:22.550 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:48:23.848 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:48:23.848 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:48:23.849 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:48:23.849 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:48:23.849 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:48:23.849 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:48:23.849 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:48:25.598 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:48:25.599 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:48:25.599 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:48:25.599 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:48:25.599 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:48:25.599 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:48:25.599 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:48:26.927 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:48:26.927 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:48:26.927 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:48:26.927 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:48:26.927 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:48:26.927 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:48:26.927 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:48:26.928 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:48:26.928 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:48:26.928 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:48:26.928 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:48:26.928 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:48:26.928 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:48:29.017 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:48:29.017 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:48:29.017 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:48:29.017 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:48:29.017 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:48:29.017 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:48:29.017 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:48:30.871 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:48:30.871 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:48:30.871 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:48:30.871 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:48:30.871 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:48:30.872 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:48:30.872 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:48:32.832 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:48:32.832 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:48:32.832 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:48:32.832 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:48:32.832 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:48:32.832 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:48:32.833 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:48:34.836 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:48:34.836 INFO:tasks.workunit.client.0.smithi115.stdout:finished writesame 2024-09-16T07:48:34.836 INFO:tasks.workunit.client.0.smithi115.stdout:to verify the data 2024-09-16T07:48:34.836 INFO:tasks.workunit.client.0.smithi115.stdout:verified 2024-09-16T07:48:34.836 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:48:34.836 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:48:34.836 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:48:34.836 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:48:34.836 INFO:tasks.workunit.client.0.smithi115.stdout:started writesame 2024-09-16T07:48:34.837 INFO:tasks.workunit.client.0.smithi115.stdout:expected fail, finished writesame 2024-09-16T07:48:34.837 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.TestIOPPWithIOHint (41170 ms) 2024-09-16T07:48:34.837 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.TestIOToSnapshot 2024-09-16T07:48:34.837 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:48:37.521 INFO:tasks.workunit.client.0.smithi115.stdout:num snaps is: 0 2024-09-16T07:48:37.521 INFO:tasks.workunit.client.0.smithi115.stdout:expected: 0 2024-09-16T07:48:37.521 INFO:tasks.workunit.client.0.smithi115.stdout:num snaps is: 1 2024-09-16T07:48:37.521 INFO:tasks.workunit.client.0.smithi115.stdout:expected: 1 2024-09-16T07:48:37.521 INFO:tasks.workunit.client.0.smithi115.stdout:snap: orig 2024-09-16T07:48:37.521 INFO:tasks.workunit.client.0.smithi115.stdout:found orig with size 2097152 2024-09-16T07:48:37.521 INFO:tasks.workunit.client.0.smithi115.stdout:read: 80 2024-09-16T07:48:37.521 INFO:tasks.workunit.client.0.smithi115.stdout:write test data! 2024-09-16T07:48:37.522 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 80 2024-09-16T07:48:37.522 INFO:tasks.workunit.client.0.smithi115.stdout:num snaps is: 2 2024-09-16T07:48:37.522 INFO:tasks.workunit.client.0.smithi115.stdout:expected: 2 2024-09-16T07:48:37.522 INFO:tasks.workunit.client.0.smithi115.stdout:snap: orig 2024-09-16T07:48:37.522 INFO:tasks.workunit.client.0.smithi115.stdout:snap: written 2024-09-16T07:48:37.522 INFO:tasks.workunit.client.0.smithi115.stdout:found orig with size 2097152 2024-09-16T07:48:37.522 INFO:tasks.workunit.client.0.smithi115.stdout:found written with size 2097152 2024-09-16T07:48:37.522 INFO:tasks.workunit.client.0.smithi115.stdout:read: 80 2024-09-16T07:48:37.522 INFO:tasks.workunit.client.0.smithi115.stdout:read: 80 2024-09-16T07:48:37.522 INFO:tasks.workunit.client.0.smithi115.stdout:read: 80 2024-09-16T07:48:37.522 INFO:tasks.workunit.client.0.smithi115.stdout:write to snapshot returned -30 2024-09-16T07:48:37.522 INFO:tasks.workunit.client.0.smithi115.stdout:Read-only file system 2024-09-16T07:48:37.836 INFO:tasks.workunit.client.0.smithi115.stdout:read: 80 2024-09-16T07:48:37.836 INFO:tasks.workunit.client.0.smithi115.stdout:read: 80 2024-09-16T07:48:37.836 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 80 2024-09-16T07:48:37.836 INFO:tasks.workunit.client.0.smithi115.stdout:opening testimg@orig 2024-09-16T07:48:37.836 INFO:tasks.workunit.client.0.smithi115.stdout:read: 80 2024-09-16T07:48:37.836 INFO:tasks.workunit.client.0.smithi115.stdout:write to snapshot returned -30 2024-09-16T07:48:37.836 INFO:tasks.workunit.client.0.smithi115.stdout:Read-only file system 2024-09-16T07:48:39.435 INFO:tasks.workunit.client.0.smithi115.stdout:num snaps is: 2 2024-09-16T07:48:39.435 INFO:tasks.workunit.client.0.smithi115.stdout:expected: 2 2024-09-16T07:48:39.435 INFO:tasks.workunit.client.0.smithi115.stdout:snap: orig 2024-09-16T07:48:39.436 INFO:tasks.workunit.client.0.smithi115.stdout:snap: written 2024-09-16T07:48:39.436 INFO:tasks.workunit.client.0.smithi115.stdout:found orig with size 2097152 2024-09-16T07:48:39.436 INFO:tasks.workunit.client.0.smithi115.stdout:found written with size 2097152 2024-09-16T07:48:39.436 INFO:tasks.workunit.client.0.smithi115.stdout:num snaps is: 1 2024-09-16T07:48:39.436 INFO:tasks.workunit.client.0.smithi115.stdout:expected: 1 2024-09-16T07:48:39.436 INFO:tasks.workunit.client.0.smithi115.stdout:snap: orig 2024-09-16T07:48:39.436 INFO:tasks.workunit.client.0.smithi115.stdout:found orig with size 2097152 2024-09-16T07:48:39.436 INFO:tasks.workunit.client.0.smithi115.stdout:num snaps is: 0 2024-09-16T07:48:39.436 INFO:tasks.workunit.client.0.smithi115.stdout:expected: 0 2024-09-16T07:48:39.436 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.TestIOToSnapshot (4600 ms) 2024-09-16T07:48:39.436 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.TestSnapshotDeletedIo 2024-09-16T07:48:39.436 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:48:41.555 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.TestSnapshotDeletedIo (2120 ms) 2024-09-16T07:48:41.555 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.TestClone 2024-09-16T07:48:41.555 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:48:50.368 INFO:tasks.workunit.client.0.smithi115.stdout:made parent image "parent" 2024-09-16T07:48:50.368 INFO:tasks.workunit.client.0.smithi115.stdout:parent has no parent info 2024-09-16T07:48:50.368 INFO:tasks.workunit.client.0.smithi115.stdout:made snapshot "parent@parent_snap" 2024-09-16T07:48:50.368 INFO:tasks.workunit.client.0.smithi115.stdout:can't unprotect an unprotected snap 2024-09-16T07:48:50.368 INFO:tasks.workunit.client.0.smithi115.stdout:can't protect a protected snap 2024-09-16T07:48:50.368 INFO:tasks.workunit.client.0.smithi115.stdout:made and opened clone "child" 2024-09-16T07:48:50.368 INFO:tasks.workunit.client.0.smithi115.stdout:read: 8 2024-09-16T07:48:50.368 INFO:tasks.workunit.client.0.smithi115.stdout:read: 8 2024-09-16T07:48:50.369 INFO:tasks.workunit.client.0.smithi115.stdout:read: 8 2024-09-16T07:48:50.369 INFO:tasks.workunit.client.0.smithi115.stdout:sizes and overlaps are good between parent and child 2024-09-16T07:48:50.369 INFO:tasks.workunit.client.0.smithi115.stdout:child image successfully cloned all image-meta pairs 2024-09-16T07:48:50.369 INFO:tasks.workunit.client.0.smithi115.stdout:sized down clone, changed overlap 2024-09-16T07:48:50.369 INFO:tasks.workunit.client.0.smithi115.stdout:parent info: size 4194304 obj_size 4194304 parent_pool 18446744073709551615 2024-09-16T07:48:50.369 INFO:tasks.workunit.client.0.smithi115.stdout:sized up clone, changed size but not overlap or parent's size 2024-09-16T07:48:50.369 INFO:tasks.workunit.client.0.smithi115.stdout:can't remove parent while child still exists 2024-09-16T07:48:50.369 INFO:tasks.workunit.client.0.smithi115.stdout:can't remove parent while still protected 2024-09-16T07:48:50.369 INFO:tasks.workunit.client.0.smithi115.stdout:removed parent snap after unprotecting 2024-09-16T07:48:50.369 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.TestClone (8812 ms) 2024-09-16T07:48:50.369 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.TestClone2 2024-09-16T07:48:50.369 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:48:56.828 INFO:tasks.workunit.client.0.smithi115.stdout:made parent image "parent" 2024-09-16T07:48:56.828 INFO:tasks.workunit.client.0.smithi115.stdout:parent has no parent info 2024-09-16T07:48:56.828 INFO:tasks.workunit.client.0.smithi115.stdout:made snapshot "parent@parent_snap" 2024-09-16T07:48:56.828 INFO:tasks.workunit.client.0.smithi115.stdout:made and opened clone "child" 2024-09-16T07:48:56.828 INFO:tasks.workunit.client.0.smithi115.stdout:child image successfully cloned all image-meta pairs 2024-09-16T07:48:56.829 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.TestClone2 (6460 ms) 2024-09-16T07:48:56.829 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.ListChildren 2024-09-16T07:49:00.085 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:49:12.322 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:49:12.322 INFO:tasks.workunit.client.0.smithi115.stdout:trying to find test-librbd-smithi115-30516-17/image125 2024-09-16T07:49:12.322 INFO:tasks.workunit.client.0.smithi115.stdout:checking test-librbd-smithi115-30516-17/image125 2024-09-16T07:49:12.322 INFO:tasks.workunit.client.0.smithi115.stdout:found child test-librbd-smithi115-30516-17/image125 2024-09-16T07:49:12.322 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:49:12.322 INFO:tasks.workunit.client.0.smithi115.stdout:num children is: 1 2024-09-16T07:49:12.322 INFO:tasks.workunit.client.0.smithi115.stdout:expected: 1 2024-09-16T07:49:12.323 INFO:tasks.workunit.client.0.smithi115.stdout:child: image125 2024-09-16T07:49:12.323 INFO:tasks.workunit.client.0.smithi115.stdout:found child test-librbd-smithi115-30516-17/image125/105fa63a14b0 2024-09-16T07:49:12.323 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:49:12.323 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:49:12.323 INFO:tasks.workunit.client.0.smithi115.stdout:trying to find test-librbd-smithi115-30516-17/image125 2024-09-16T07:49:12.323 INFO:tasks.workunit.client.0.smithi115.stdout:checking test-librbd-smithi115-30516-16/image126 2024-09-16T07:49:12.323 INFO:tasks.workunit.client.0.smithi115.stdout:checking test-librbd-smithi115-30516-17/image125 2024-09-16T07:49:12.323 INFO:tasks.workunit.client.0.smithi115.stdout:found child test-librbd-smithi115-30516-17/image125 2024-09-16T07:49:12.323 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:49:12.323 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:49:12.323 INFO:tasks.workunit.client.0.smithi115.stdout:trying to find test-librbd-smithi115-30516-16/image126 2024-09-16T07:49:12.323 INFO:tasks.workunit.client.0.smithi115.stdout:checking test-librbd-smithi115-30516-16/image126 2024-09-16T07:49:12.323 INFO:tasks.workunit.client.0.smithi115.stdout:found child test-librbd-smithi115-30516-16/image126 2024-09-16T07:49:12.324 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:49:12.324 INFO:tasks.workunit.client.0.smithi115.stdout:num children is: 2 2024-09-16T07:49:12.324 INFO:tasks.workunit.client.0.smithi115.stdout:expected: 2 2024-09-16T07:49:12.324 INFO:tasks.workunit.client.0.smithi115.stdout:child: image126 2024-09-16T07:49:12.324 INFO:tasks.workunit.client.0.smithi115.stdout:child: image125 2024-09-16T07:49:12.324 INFO:tasks.workunit.client.0.smithi115.stdout:found child test-librbd-smithi115-30516-17/image125/105fa63a14b0 2024-09-16T07:49:12.324 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:49:12.324 INFO:tasks.workunit.client.0.smithi115.stdout:found child test-librbd-smithi115-30516-16/image126/105f5d5419f6 2024-09-16T07:49:12.324 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:49:12.324 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:49:12.324 INFO:tasks.workunit.client.0.smithi115.stdout:trying to find test-librbd-smithi115-30516-17/image125 2024-09-16T07:49:12.324 INFO:tasks.workunit.client.0.smithi115.stdout:checking test-librbd-smithi115-30516-16/image126 2024-09-16T07:49:12.324 INFO:tasks.workunit.client.0.smithi115.stdout:checking test-librbd-smithi115-30516-17/image125 2024-09-16T07:49:12.325 INFO:tasks.workunit.client.0.smithi115.stdout:found child test-librbd-smithi115-30516-17/image125 2024-09-16T07:49:12.325 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:49:12.325 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:49:12.325 INFO:tasks.workunit.client.0.smithi115.stdout:trying to find test-librbd-smithi115-30516-16/image126 2024-09-16T07:49:12.325 INFO:tasks.workunit.client.0.smithi115.stdout:checking test-librbd-smithi115-30516-16/image126 2024-09-16T07:49:12.325 INFO:tasks.workunit.client.0.smithi115.stdout:found child test-librbd-smithi115-30516-16/image126 2024-09-16T07:49:12.325 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:49:12.325 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:49:12.325 INFO:tasks.workunit.client.0.smithi115.stdout:trying to find test-librbd-smithi115-30516-17/image127 2024-09-16T07:49:12.325 INFO:tasks.workunit.client.0.smithi115.stdout:checking test-librbd-smithi115-30516-16/image126 2024-09-16T07:49:12.325 INFO:tasks.workunit.client.0.smithi115.stdout:checking test-librbd-smithi115-30516-17/image125 2024-09-16T07:49:12.325 INFO:tasks.workunit.client.0.smithi115.stdout:checking test-librbd-smithi115-30516-17/image127 2024-09-16T07:49:12.326 INFO:tasks.workunit.client.0.smithi115.stdout:found child test-librbd-smithi115-30516-17/image127 2024-09-16T07:49:12.326 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:49:12.326 INFO:tasks.workunit.client.0.smithi115.stdout:num children is: 3 2024-09-16T07:49:12.326 INFO:tasks.workunit.client.0.smithi115.stdout:expected: 3 2024-09-16T07:49:12.326 INFO:tasks.workunit.client.0.smithi115.stdout:child: image126 2024-09-16T07:49:12.326 INFO:tasks.workunit.client.0.smithi115.stdout:child: image125 2024-09-16T07:49:12.326 INFO:tasks.workunit.client.0.smithi115.stdout:child: image127 2024-09-16T07:49:12.326 INFO:tasks.workunit.client.0.smithi115.stdout:found child test-librbd-smithi115-30516-17/image125/105fa63a14b0 2024-09-16T07:49:12.326 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:49:12.326 INFO:tasks.workunit.client.0.smithi115.stdout:found child test-librbd-smithi115-30516-16/image126/105f5d5419f6 2024-09-16T07:49:12.326 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:49:12.326 INFO:tasks.workunit.client.0.smithi115.stdout:found child test-librbd-smithi115-30516-17/image127/105fcfd95a63 2024-09-16T07:49:12.326 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:49:12.326 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:49:12.327 INFO:tasks.workunit.client.0.smithi115.stdout:trying to find test-librbd-smithi115-30516-17/image125 2024-09-16T07:49:12.327 INFO:tasks.workunit.client.0.smithi115.stdout:checking test-librbd-smithi115-30516-16/image126 2024-09-16T07:49:12.327 INFO:tasks.workunit.client.0.smithi115.stdout:checking test-librbd-smithi115-30516-17/image125 2024-09-16T07:49:12.327 INFO:tasks.workunit.client.0.smithi115.stdout:found child test-librbd-smithi115-30516-17/image125 2024-09-16T07:49:12.327 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:49:12.327 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:49:12.327 INFO:tasks.workunit.client.0.smithi115.stdout:trying to find test-librbd-smithi115-30516-16/image126 2024-09-16T07:49:12.327 INFO:tasks.workunit.client.0.smithi115.stdout:checking test-librbd-smithi115-30516-16/image126 2024-09-16T07:49:12.327 INFO:tasks.workunit.client.0.smithi115.stdout:found child test-librbd-smithi115-30516-16/image126 2024-09-16T07:49:12.327 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:49:12.327 INFO:tasks.workunit.client.0.smithi115.stdout:num children is: 3 2024-09-16T07:49:12.327 INFO:tasks.workunit.client.0.smithi115.stdout:expected: 3 2024-09-16T07:49:12.327 INFO:tasks.workunit.client.0.smithi115.stdout:child: image126 2024-09-16T07:49:12.327 INFO:tasks.workunit.client.0.smithi115.stdout:child: image125 2024-09-16T07:49:12.328 INFO:tasks.workunit.client.0.smithi115.stdout:child: image127 2024-09-16T07:49:12.328 INFO:tasks.workunit.client.0.smithi115.stdout:found child test-librbd-smithi115-30516-17/image125/105fa63a14b0 2024-09-16T07:49:12.328 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:49:12.328 INFO:tasks.workunit.client.0.smithi115.stdout:found child test-librbd-smithi115-30516-16/image126/105f5d5419f6 2024-09-16T07:49:12.328 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:49:12.328 INFO:tasks.workunit.client.0.smithi115.stdout:found child test-librbd-smithi115-30516-17/image127/105fcfd95a63 2024-09-16T07:49:12.328 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:49:12.328 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:49:12.328 INFO:tasks.workunit.client.0.smithi115.stdout:trying to find test-librbd-smithi115-30516-17/image125 2024-09-16T07:49:12.328 INFO:tasks.workunit.client.0.smithi115.stdout:checking test-librbd-smithi115-30516-16/image126 2024-09-16T07:49:12.328 INFO:tasks.workunit.client.0.smithi115.stdout:checking test-librbd-smithi115-30516-17/image125 2024-09-16T07:49:12.328 INFO:tasks.workunit.client.0.smithi115.stdout:found child test-librbd-smithi115-30516-17/image125 2024-09-16T07:49:12.328 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:49:12.329 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:49:12.329 INFO:tasks.workunit.client.0.smithi115.stdout:trying to find test-librbd-smithi115-30516-16/image126 2024-09-16T07:49:12.329 INFO:tasks.workunit.client.0.smithi115.stdout:checking test-librbd-smithi115-30516-16/image126 2024-09-16T07:49:12.329 INFO:tasks.workunit.client.0.smithi115.stdout:found child test-librbd-smithi115-30516-16/image126 2024-09-16T07:49:12.329 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:49:12.329 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:49:12.329 INFO:tasks.workunit.client.0.smithi115.stdout:trying to find test-librbd-smithi115-30516-17/image128 2024-09-16T07:49:12.329 INFO:tasks.workunit.client.0.smithi115.stdout:checking test-librbd-smithi115-30516-16/image126 2024-09-16T07:49:12.329 INFO:tasks.workunit.client.0.smithi115.stdout:checking test-librbd-smithi115-30516-17/image125 2024-09-16T07:49:12.329 INFO:tasks.workunit.client.0.smithi115.stdout:checking test-librbd-smithi115-30516-17/image128 2024-09-16T07:49:12.329 INFO:tasks.workunit.client.0.smithi115.stdout:found child test-librbd-smithi115-30516-17/image128 2024-09-16T07:49:12.329 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:49:12.329 INFO:tasks.workunit.client.0.smithi115.stdout:num children is: 4 2024-09-16T07:49:12.329 INFO:tasks.workunit.client.0.smithi115.stdout:expected: 4 2024-09-16T07:49:12.330 INFO:tasks.workunit.client.0.smithi115.stdout:child: image126 2024-09-16T07:49:12.330 INFO:tasks.workunit.client.0.smithi115.stdout:child: image125 2024-09-16T07:49:12.330 INFO:tasks.workunit.client.0.smithi115.stdout:child: image127 2024-09-16T07:49:12.330 INFO:tasks.workunit.client.0.smithi115.stdout:child: image128 2024-09-16T07:49:12.330 INFO:tasks.workunit.client.0.smithi115.stdout:found child test-librbd-smithi115-30516-17/image125/105fa63a14b0 2024-09-16T07:49:12.330 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:49:12.330 INFO:tasks.workunit.client.0.smithi115.stdout:found child test-librbd-smithi115-30516-16/image126/105f5d5419f6 2024-09-16T07:49:12.330 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:49:12.330 INFO:tasks.workunit.client.0.smithi115.stdout:found child test-librbd-smithi115-30516-17/image127/105fcfd95a63 2024-09-16T07:49:12.330 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:49:12.330 INFO:tasks.workunit.client.0.smithi115.stdout:found child test-librbd-smithi115-30516-17/image128/105fb2f9d507 2024-09-16T07:49:12.330 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:49:12.330 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:49:12.330 INFO:tasks.workunit.client.0.smithi115.stdout:trying to find test-librbd-smithi115-30516-17/image125 2024-09-16T07:49:12.331 INFO:tasks.workunit.client.0.smithi115.stdout:checking test-librbd-smithi115-30516-16/image126 2024-09-16T07:49:12.331 INFO:tasks.workunit.client.0.smithi115.stdout:checking test-librbd-smithi115-30516-17/image125 2024-09-16T07:49:12.331 INFO:tasks.workunit.client.0.smithi115.stdout:found child test-librbd-smithi115-30516-17/image125 2024-09-16T07:49:12.331 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:49:12.331 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:49:12.331 INFO:tasks.workunit.client.0.smithi115.stdout:trying to find test-librbd-smithi115-30516-16/image126 2024-09-16T07:49:12.331 INFO:tasks.workunit.client.0.smithi115.stdout:checking test-librbd-smithi115-30516-16/image126 2024-09-16T07:49:12.331 INFO:tasks.workunit.client.0.smithi115.stdout:found child test-librbd-smithi115-30516-16/image126 2024-09-16T07:49:12.331 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:49:12.331 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:49:12.331 INFO:tasks.workunit.client.0.smithi115.stdout:trying to find test-librbd-smithi115-30516-17/image127 2024-09-16T07:49:12.331 INFO:tasks.workunit.client.0.smithi115.stdout:checking test-librbd-smithi115-30516-16/image126 2024-09-16T07:49:12.332 INFO:tasks.workunit.client.0.smithi115.stdout:checking test-librbd-smithi115-30516-17/image125 2024-09-16T07:49:12.332 INFO:tasks.workunit.client.0.smithi115.stdout:checking test-librbd-smithi115-30516-17/image127 2024-09-16T07:49:12.332 INFO:tasks.workunit.client.0.smithi115.stdout:found child test-librbd-smithi115-30516-17/image127 2024-09-16T07:49:12.332 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:49:12.332 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:49:12.332 INFO:tasks.workunit.client.0.smithi115.stdout:trying to find test-librbd-smithi115-30516-17/image128 2024-09-16T07:49:12.332 INFO:tasks.workunit.client.0.smithi115.stdout:checking test-librbd-smithi115-30516-16/image126 2024-09-16T07:49:20.112 INFO:tasks.workunit.client.0.smithi115.stdout:checking test-librbd-smithi115-30516-17/image125 2024-09-16T07:49:20.112 INFO:tasks.workunit.client.0.smithi115.stdout:checking test-librbd-smithi115-30516-17/image127 2024-09-16T07:49:20.112 INFO:tasks.workunit.client.0.smithi115.stdout:checking test-librbd-smithi115-30516-17/image128 2024-09-16T07:49:20.112 INFO:tasks.workunit.client.0.smithi115.stdout:found child test-librbd-smithi115-30516-17/image128 2024-09-16T07:49:20.113 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:49:20.113 INFO:tasks.workunit.client.0.smithi115.stdout:num children is: 4 2024-09-16T07:49:20.113 INFO:tasks.workunit.client.0.smithi115.stdout:expected: 4 2024-09-16T07:49:20.113 INFO:tasks.workunit.client.0.smithi115.stdout:child: image126 2024-09-16T07:49:20.113 INFO:tasks.workunit.client.0.smithi115.stdout:child: image125 2024-09-16T07:49:20.113 INFO:tasks.workunit.client.0.smithi115.stdout:child: image127 2024-09-16T07:49:20.113 INFO:tasks.workunit.client.0.smithi115.stdout:child: image128 2024-09-16T07:49:20.113 INFO:tasks.workunit.client.0.smithi115.stdout:found child test-librbd-smithi115-30516-17/image125/105fa63a14b0 2024-09-16T07:49:20.113 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:49:20.114 INFO:tasks.workunit.client.0.smithi115.stdout:found child test-librbd-smithi115-30516-16/image126/105f5d5419f6 2024-09-16T07:49:20.114 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:49:20.114 INFO:tasks.workunit.client.0.smithi115.stdout:found child test-librbd-smithi115-30516-17/image127/105fcfd95a63 2024-09-16T07:49:20.114 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:49:20.114 INFO:tasks.workunit.client.0.smithi115.stdout:found child test-librbd-smithi115-30516-17/image128/105fb2f9d507 2024-09-16T07:49:20.114 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:49:20.115 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:49:20.115 INFO:tasks.workunit.client.0.smithi115.stdout:trying to find test-librbd-smithi115-30516-16/image126 2024-09-16T07:49:20.115 INFO:tasks.workunit.client.0.smithi115.stdout:checking test-librbd-smithi115-30516-16/image126 2024-09-16T07:49:20.115 INFO:tasks.workunit.client.0.smithi115.stdout:found child test-librbd-smithi115-30516-16/image126 2024-09-16T07:49:20.115 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:49:20.115 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:49:20.115 INFO:tasks.workunit.client.0.smithi115.stdout:trying to find test-librbd-smithi115-30516-17/image127 2024-09-16T07:49:20.115 INFO:tasks.workunit.client.0.smithi115.stdout:checking test-librbd-smithi115-30516-16/image126 2024-09-16T07:49:20.116 INFO:tasks.workunit.client.0.smithi115.stdout:checking test-librbd-smithi115-30516-17/image127 2024-09-16T07:49:20.116 INFO:tasks.workunit.client.0.smithi115.stdout:found child test-librbd-smithi115-30516-17/image127 2024-09-16T07:49:20.116 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:49:20.116 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:49:20.116 INFO:tasks.workunit.client.0.smithi115.stdout:trying to find test-librbd-smithi115-30516-17/image128 2024-09-16T07:49:20.116 INFO:tasks.workunit.client.0.smithi115.stdout:checking test-librbd-smithi115-30516-16/image126 2024-09-16T07:49:20.116 INFO:tasks.workunit.client.0.smithi115.stdout:checking test-librbd-smithi115-30516-17/image127 2024-09-16T07:49:20.116 INFO:tasks.workunit.client.0.smithi115.stdout:checking test-librbd-smithi115-30516-17/image128 2024-09-16T07:49:20.117 INFO:tasks.workunit.client.0.smithi115.stdout:found child test-librbd-smithi115-30516-17/image128 2024-09-16T07:49:20.117 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:49:20.117 INFO:tasks.workunit.client.0.smithi115.stdout:num children is: 3 2024-09-16T07:49:20.117 INFO:tasks.workunit.client.0.smithi115.stdout:expected: 3 2024-09-16T07:49:20.117 INFO:tasks.workunit.client.0.smithi115.stdout:child: image126 2024-09-16T07:49:20.117 INFO:tasks.workunit.client.0.smithi115.stdout:child: image127 2024-09-16T07:49:20.117 INFO:tasks.workunit.client.0.smithi115.stdout:child: image128 2024-09-16T07:49:20.117 INFO:tasks.workunit.client.0.smithi115.stdout:found child test-librbd-smithi115-30516-16/image126/105f5d5419f6 2024-09-16T07:49:20.118 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:49:20.118 INFO:tasks.workunit.client.0.smithi115.stdout:found child test-librbd-smithi115-30516-17/image127/105fcfd95a63 2024-09-16T07:49:20.118 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:49:20.118 INFO:tasks.workunit.client.0.smithi115.stdout:found child test-librbd-smithi115-30516-17/image128/105fb2f9d507 2024-09-16T07:49:20.118 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:49:20.118 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:49:20.118 INFO:tasks.workunit.client.0.smithi115.stdout:trying to find test-librbd-smithi115-30516-16/image126 2024-09-16T07:49:20.118 INFO:tasks.workunit.client.0.smithi115.stdout:checking test-librbd-smithi115-30516-16/image126 2024-09-16T07:49:20.118 INFO:tasks.workunit.client.0.smithi115.stdout:found child test-librbd-smithi115-30516-16/image126 2024-09-16T07:49:20.118 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:49:20.118 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:49:20.118 INFO:tasks.workunit.client.0.smithi115.stdout:trying to find test-librbd-smithi115-30516-17/image128 2024-09-16T07:49:20.118 INFO:tasks.workunit.client.0.smithi115.stdout:checking test-librbd-smithi115-30516-16/image126 2024-09-16T07:49:20.118 INFO:tasks.workunit.client.0.smithi115.stdout:checking test-librbd-smithi115-30516-17/image128 2024-09-16T07:49:20.119 INFO:tasks.workunit.client.0.smithi115.stdout:found child test-librbd-smithi115-30516-17/image128 2024-09-16T07:49:20.119 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:49:20.119 INFO:tasks.workunit.client.0.smithi115.stdout:num children is: 2 2024-09-16T07:49:20.119 INFO:tasks.workunit.client.0.smithi115.stdout:expected: 2 2024-09-16T07:49:20.119 INFO:tasks.workunit.client.0.smithi115.stdout:child: image126 2024-09-16T07:49:20.119 INFO:tasks.workunit.client.0.smithi115.stdout:child: image128 2024-09-16T07:49:20.119 INFO:tasks.workunit.client.0.smithi115.stdout:found child test-librbd-smithi115-30516-16/image126/105f5d5419f6 2024-09-16T07:49:20.119 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:49:20.119 INFO:tasks.workunit.client.0.smithi115.stdout:found child test-librbd-smithi115-30516-17/image128/105fb2f9d507 2024-09-16T07:49:20.119 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:49:20.119 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:49:20.119 INFO:tasks.workunit.client.0.smithi115.stdout:trying to find test-librbd-smithi115-30516-16/image126 2024-09-16T07:49:20.119 INFO:tasks.workunit.client.0.smithi115.stdout:checking test-librbd-smithi115-30516-16/image126 2024-09-16T07:49:20.119 INFO:tasks.workunit.client.0.smithi115.stdout:found child test-librbd-smithi115-30516-16/image126 2024-09-16T07:49:20.120 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:49:20.120 INFO:tasks.workunit.client.0.smithi115.stdout:num children is: 1 2024-09-16T07:49:20.120 INFO:tasks.workunit.client.0.smithi115.stdout:expected: 1 2024-09-16T07:49:20.120 INFO:tasks.workunit.client.0.smithi115.stdout:child: image126 2024-09-16T07:49:20.120 INFO:tasks.workunit.client.0.smithi115.stdout:found child test-librbd-smithi115-30516-16/image126/105f5d5419f6 2024-09-16T07:49:20.120 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:49:20.120 INFO:tasks.workunit.client.0.smithi115.stdout:num children is: 0 2024-09-16T07:49:20.120 INFO:tasks.workunit.client.0.smithi115.stdout:expected: 0 2024-09-16T07:49:20.121 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.ListChildren (23284 ms) 2024-09-16T07:49:20.121 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.ListChildrenTiered 2024-09-16T07:49:20.121 INFO:tasks.workunit.client.0.smithi115.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:6995: Skipped 2024-09-16T07:49:20.121 INFO:tasks.workunit.client.0.smithi115.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:49:20.121 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestLibRBD.ListChildrenTiered (0 ms) 2024-09-16T07:49:20.121 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.LockingPP 2024-09-16T07:49:20.121 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:49:20.712 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.LockingPP (600 ms) 2024-09-16T07:49:20.712 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.FlushAio 2024-09-16T07:49:20.712 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:49:24.246 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.FlushAio (3535 ms) 2024-09-16T07:49:24.246 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.FlushAioPP 2024-09-16T07:49:24.247 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:49:27.512 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.FlushAioPP (3266 ms) 2024-09-16T07:49:27.512 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.ZeroLengthWrite 2024-09-16T07:49:27.512 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:49:27.786 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.ZeroLengthWrite (273 ms) 2024-09-16T07:49:27.786 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.ZeroLengthDiscard 2024-09-16T07:49:27.786 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:49:28.081 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.ZeroLengthDiscard (296 ms) 2024-09-16T07:49:28.081 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.ZeroLengthRead 2024-09-16T07:49:28.081 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:49:28.262 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.ZeroLengthRead (181 ms) 2024-09-16T07:49:28.263 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.LargeCacheRead 2024-09-16T07:49:28.263 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:49:28.631 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.LargeCacheRead (369 ms) 2024-09-16T07:49:28.631 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.TestPendingAio 2024-09-16T07:49:28.631 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:49:32.154 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.TestPendingAio (3523 ms) 2024-09-16T07:49:32.154 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.CompareAndWriteCopyup 2024-09-16T07:49:32.154 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:49:34.260 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:49:37.818 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.CompareAndWriteCopyup (5664 ms) 2024-09-16T07:49:37.818 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.CompareAndWriteCopyupMismatch 2024-09-16T07:49:37.818 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:49:40.289 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:49:43.684 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.CompareAndWriteCopyupMismatch (5866 ms) 2024-09-16T07:49:43.684 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.Flatten 2024-09-16T07:49:43.684 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:49:45.541 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.Flatten (1856 ms) 2024-09-16T07:49:45.541 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.Sparsify 2024-09-16T07:49:45.541 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:49:46.019 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 32768 2024-09-16T07:49:46.020 INFO:tasks.workunit.client.0.smithi115.stdout:read: 32768 2024-09-16T07:49:46.020 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.Sparsify (479 ms) 2024-09-16T07:49:46.020 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.SparsifyPP 2024-09-16T07:49:46.020 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:49:46.394 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.SparsifyPP (374 ms) 2024-09-16T07:49:46.394 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.SnapshotLimit 2024-09-16T07:49:46.394 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:49:51.563 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.SnapshotLimit (5168 ms) 2024-09-16T07:49:51.563 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.SnapshotLimitPP 2024-09-16T07:49:51.563 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:49:56.646 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.SnapshotLimitPP (5083 ms) 2024-09-16T07:49:56.646 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.RebuildObjectMapViaLockOwner 2024-09-16T07:49:56.646 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:49:57.324 INFO:tasks.workunit.client.0.smithi115.stdout:0.00% done 2024-09-16T07:49:57.324 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.RebuildObjectMapViaLockOwner (679 ms) 2024-09-16T07:49:57.324 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.RenameViaLockOwner 2024-09-16T07:49:57.324 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:49:58.229 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.RenameViaLockOwner (904 ms) 2024-09-16T07:49:58.229 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.SnapCreateViaLockOwner 2024-09-16T07:49:58.229 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:49:59.713 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.SnapCreateViaLockOwner (1484 ms) 2024-09-16T07:49:59.713 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.SnapRemoveViaLockOwner 2024-09-16T07:49:59.713 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:50:01.911 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.SnapRemoveViaLockOwner (2198 ms) 2024-09-16T07:50:01.911 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.UpdateFeaturesViaLockOwner 2024-09-16T07:50:01.911 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:50:02.594 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.UpdateFeaturesViaLockOwner (684 ms) 2024-09-16T07:50:02.595 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.EnableJournalingViaLockOwner 2024-09-16T07:50:02.595 INFO:tasks.workunit.client.0.smithi115.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:9736: Skipped 2024-09-16T07:50:02.595 INFO:tasks.workunit.client.0.smithi115.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:02.595 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestLibRBD.EnableJournalingViaLockOwner (0 ms) 2024-09-16T07:50:02.595 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.SnapRemove2 2024-09-16T07:50:02.595 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:50:05.670 INFO:tasks.workunit.client.0.smithi115.stdout:100.00% done 2024-09-16T07:50:05.670 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.SnapRemove2 (3076 ms) 2024-09-16T07:50:05.670 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.SnapRenameViaLockOwner 2024-09-16T07:50:05.671 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:50:07.014 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.SnapRenameViaLockOwner (1341 ms) 2024-09-16T07:50:07.014 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.SnapProtectViaLockOwner 2024-09-16T07:50:07.014 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:50:08.844 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.SnapProtectViaLockOwner (1832 ms) 2024-09-16T07:50:08.844 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.SnapUnprotectViaLockOwner 2024-09-16T07:50:08.845 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:50:10.216 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.SnapUnprotectViaLockOwner (1373 ms) 2024-09-16T07:50:10.217 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.FlattenViaLockOwner 2024-09-16T07:50:10.217 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:50:12.849 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.FlattenViaLockOwner (2633 ms) 2024-09-16T07:50:12.850 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.ResizeViaLockOwner 2024-09-16T07:50:12.850 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:50:13.748 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.ResizeViaLockOwner (899 ms) 2024-09-16T07:50:13.748 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.SparsifyViaLockOwner 2024-09-16T07:50:13.749 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:50:14.220 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.SparsifyViaLockOwner (471 ms) 2024-09-16T07:50:14.220 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.ObjectMapConsistentSnap 2024-09-16T07:50:14.220 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:50:34.508 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.ObjectMapConsistentSnap (20288 ms) 2024-09-16T07:50:34.508 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.Metadata 2024-09-16T07:50:34.508 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:50:37.778 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.Metadata (3270 ms) 2024-09-16T07:50:37.778 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.MetadataPP 2024-09-16T07:50:37.778 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:50:40.488 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.MetadataPP (2710 ms) 2024-09-16T07:50:40.488 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.UpdateFeatures 2024-09-16T07:50:40.488 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:50:42.224 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.UpdateFeatures (1736 ms) 2024-09-16T07:50:42.224 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.FeaturesBitmaskString 2024-09-16T07:50:42.224 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.FeaturesBitmaskString (0 ms) 2024-09-16T07:50:42.224 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.RebuildObjectMap 2024-09-16T07:50:42.224 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:50:44.065 INFO:tasks.workunit.client.0.smithi115.stdout:0.00% done 2024-09-16T07:50:44.065 INFO:tasks.workunit.client.0.smithi115.stdout:25.00% done 2024-09-16T07:50:44.066 INFO:tasks.workunit.client.0.smithi115.stdout:50.00% done 2024-09-16T07:50:44.066 INFO:tasks.workunit.client.0.smithi115.stdout:75.00% done 2024-09-16T07:50:44.066 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.RebuildObjectMap (1842 ms) 2024-09-16T07:50:44.066 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.RebuildNewObjectMap 2024-09-16T07:50:44.495 INFO:tasks.workunit.client.0.smithi115.stdout:0.00% done 2024-09-16T07:50:44.495 INFO:tasks.workunit.client.0.smithi115.stdout:25.00% done 2024-09-16T07:50:44.495 INFO:tasks.workunit.client.0.smithi115.stdout:50.00% done 2024-09-16T07:50:44.495 INFO:tasks.workunit.client.0.smithi115.stdout:75.00% done 2024-09-16T07:50:44.495 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.RebuildNewObjectMap (430 ms) 2024-09-16T07:50:44.496 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.CheckObjectMap 2024-09-16T07:50:44.496 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:50:46.089 INFO:tasks.workunit.client.0.smithi115.stdout:0.00% done 2024-09-16T07:50:46.089 INFO:tasks.workunit.client.0.smithi115.stdout:25.00% done 2024-09-16T07:50:46.090 INFO:tasks.workunit.client.0.smithi115.stdout:50.00% done 2024-09-16T07:50:46.090 INFO:tasks.workunit.client.0.smithi115.stdout:75.00% done 2024-09-16T07:50:46.090 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.CheckObjectMap (1594 ms) 2024-09-16T07:50:46.090 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.BlockingAIO 2024-09-16T07:50:46.090 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:50:46.389 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.BlockingAIO (300 ms) 2024-09-16T07:50:46.389 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.ExclusiveLockTransition 2024-09-16T07:50:46.389 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:50:49.111 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.ExclusiveLockTransition (2722 ms) 2024-09-16T07:50:49.112 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.ExclusiveLockReadTransition 2024-09-16T07:50:49.112 INFO:tasks.workunit.client.0.smithi115.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:10793: Skipped 2024-09-16T07:50:49.112 INFO:tasks.workunit.client.0.smithi115.stdout:Skipping due to unmet REQUIRE 2024-09-16T07:50:49.112 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestLibRBD.ExclusiveLockReadTransition (0 ms) 2024-09-16T07:50:49.112 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.CacheMayCopyOnWrite 2024-09-16T07:50:49.112 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:50:51.166 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.CacheMayCopyOnWrite (2054 ms) 2024-09-16T07:50:51.166 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.FlushEmptyOpsOnExternalSnapshot 2024-09-16T07:50:51.166 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:50:52.564 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.FlushEmptyOpsOnExternalSnapshot (1399 ms) 2024-09-16T07:50:52.565 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.TestImageOptions 2024-09-16T07:50:54.820 INFO:tasks.workunit.client.0.smithi115.stdout:0.00% done 2024-09-16T07:50:54.820 INFO:tasks.workunit.client.0.smithi115.stdout:100.00% done 2024-09-16T07:50:54.820 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.TestImageOptions (2255 ms) 2024-09-16T07:50:54.821 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.TestImageOptionsPP 2024-09-16T07:50:56.397 INFO:tasks.workunit.client.0.smithi115.stdout:0.00% done 2024-09-16T07:50:56.398 INFO:tasks.workunit.client.0.smithi115.stdout:100.00% done 2024-09-16T07:50:56.398 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.TestImageOptionsPP (1578 ms) 2024-09-16T07:50:56.398 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.EventSocketPipe 2024-09-16T07:50:56.398 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.EventSocketPipe (0 ms) 2024-09-16T07:50:56.398 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.EventSocketEventfd 2024-09-16T07:50:56.398 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.EventSocketEventfd (0 ms) 2024-09-16T07:50:56.398 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.ImagePollIO 2024-09-16T07:50:56.398 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:50:56.886 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 512 2024-09-16T07:50:56.886 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 512 2024-09-16T07:50:56.886 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 512 2024-09-16T07:50:56.886 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 512 2024-09-16T07:50:56.886 INFO:tasks.workunit.client.0.smithi115.stdout:wrote: 512 2024-09-16T07:50:56.886 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:50:56.886 INFO:tasks.workunit.client.0.smithi115.stdout:started write 2024-09-16T07:50:56.886 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:50:56.886 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:50:56.886 INFO:tasks.workunit.client.0.smithi115.stdout:finished write 2024-09-16T07:50:56.886 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:50:56.887 INFO:tasks.workunit.client.0.smithi115.stdout:started write 2024-09-16T07:50:56.887 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:50:56.887 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:50:56.887 INFO:tasks.workunit.client.0.smithi115.stdout:finished write 2024-09-16T07:50:56.887 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:50:56.887 INFO:tasks.workunit.client.0.smithi115.stdout:started write 2024-09-16T07:50:56.887 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:50:56.887 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:50:56.887 INFO:tasks.workunit.client.0.smithi115.stdout:finished write 2024-09-16T07:50:56.887 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:50:56.887 INFO:tasks.workunit.client.0.smithi115.stdout:started write 2024-09-16T07:50:56.887 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:50:56.887 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:50:56.888 INFO:tasks.workunit.client.0.smithi115.stdout:finished write 2024-09-16T07:50:56.888 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:50:56.888 INFO:tasks.workunit.client.0.smithi115.stdout:started write 2024-09-16T07:50:56.888 INFO:tasks.workunit.client.0.smithi115.stdout:write completion cb called! 2024-09-16T07:50:56.888 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 0 2024-09-16T07:50:56.888 INFO:tasks.workunit.client.0.smithi115.stdout:finished write 2024-09-16T07:50:56.888 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:50:56.888 INFO:tasks.workunit.client.0.smithi115.stdout:started read 2024-09-16T07:50:56.888 INFO:tasks.workunit.client.0.smithi115.stdout:read completion cb called! 2024-09-16T07:50:56.888 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 512 2024-09-16T07:50:56.888 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:50:56.888 INFO:tasks.workunit.client.0.smithi115.stdout:started read 2024-09-16T07:50:56.888 INFO:tasks.workunit.client.0.smithi115.stdout:read completion cb called! 2024-09-16T07:50:56.889 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 512 2024-09-16T07:50:56.889 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:50:56.889 INFO:tasks.workunit.client.0.smithi115.stdout:started read 2024-09-16T07:50:56.889 INFO:tasks.workunit.client.0.smithi115.stdout:read completion cb called! 2024-09-16T07:50:56.889 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 512 2024-09-16T07:50:56.889 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:50:56.889 INFO:tasks.workunit.client.0.smithi115.stdout:started read 2024-09-16T07:50:56.889 INFO:tasks.workunit.client.0.smithi115.stdout:read completion cb called! 2024-09-16T07:50:56.889 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 512 2024-09-16T07:50:56.889 INFO:tasks.workunit.client.0.smithi115.stdout:created completion 2024-09-16T07:50:56.889 INFO:tasks.workunit.client.0.smithi115.stdout:started read 2024-09-16T07:50:56.890 INFO:tasks.workunit.client.0.smithi115.stdout:read completion cb called! 2024-09-16T07:50:56.890 INFO:tasks.workunit.client.0.smithi115.stdout:return value is: 512 2024-09-16T07:50:56.890 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.ImagePollIO (488 ms) 2024-09-16T07:50:56.890 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.Mirror 2024-09-16T07:50:56.939 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:50:57.017 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:51:00.344 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.Mirror (3459 ms) 2024-09-16T07:51:00.345 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.MirrorPeerAttributes 2024-09-16T07:51:00.494 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.MirrorPeerAttributes (150 ms) 2024-09-16T07:51:00.494 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.CreateWithMirrorEnabled 2024-09-16T07:51:08.368 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.CreateWithMirrorEnabled (7873 ms) 2024-09-16T07:51:08.368 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.FlushCacheWithCopyupOnExternalSnapshot 2024-09-16T07:51:08.368 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:51:11.894 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.FlushCacheWithCopyupOnExternalSnapshot (3526 ms) 2024-09-16T07:51:11.894 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.ExclusiveLock 2024-09-16T07:51:11.894 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:51:12.466 INFO:tasks.workunit.client.0.smithi115.stdout:2: acquiring exclusive lock 2024-09-16T07:51:12.466 INFO:tasks.workunit.client.0.smithi115.stdout:1: acquiring exclusive lock 2024-09-16T07:51:12.536 INFO:tasks.workunit.client.0.smithi115.stdout:2: exclusive lock acquired 2024-09-16T07:51:12.563 INFO:tasks.workunit.client.0.smithi115.stdout:2: releasing exclusive lock 2024-09-16T07:51:12.610 INFO:tasks.workunit.client.0.smithi115.stdout:2: exclusive lock released 2024-09-16T07:51:12.610 INFO:tasks.workunit.client.0.smithi115.stdout:2: acquiring exclusive lock 2024-09-16T07:51:12.701 INFO:tasks.workunit.client.0.smithi115.stdout:1: exclusive lock acquired 2024-09-16T07:51:12.732 INFO:tasks.workunit.client.0.smithi115.stdout:1: releasing exclusive lock 2024-09-16T07:51:12.818 INFO:tasks.workunit.client.0.smithi115.stdout:1: exclusive lock released 2024-09-16T07:51:12.818 INFO:tasks.workunit.client.0.smithi115.stdout:1: acquiring exclusive lock 2024-09-16T07:51:12.894 INFO:tasks.workunit.client.0.smithi115.stdout:1: exclusive lock acquired 2024-09-16T07:51:12.901 INFO:tasks.workunit.client.0.smithi115.stdout:1: releasing exclusive lock 2024-09-16T07:51:12.944 INFO:tasks.workunit.client.0.smithi115.stdout:1: exclusive lock released 2024-09-16T07:51:12.944 INFO:tasks.workunit.client.0.smithi115.stdout:1: acquiring exclusive lock 2024-09-16T07:51:13.000 INFO:tasks.workunit.client.0.smithi115.stdout:2: exclusive lock acquired 2024-09-16T07:51:13.019 INFO:tasks.workunit.client.0.smithi115.stdout:2: releasing exclusive lock 2024-09-16T07:51:13.076 INFO:tasks.workunit.client.0.smithi115.stdout:2: exclusive lock released 2024-09-16T07:51:13.076 INFO:tasks.workunit.client.0.smithi115.stdout:2: acquiring exclusive lock 2024-09-16T07:51:13.142 INFO:tasks.workunit.client.0.smithi115.stdout:1: exclusive lock acquired 2024-09-16T07:51:13.154 INFO:tasks.workunit.client.0.smithi115.stdout:1: releasing exclusive lock 2024-09-16T07:51:13.206 INFO:tasks.workunit.client.0.smithi115.stdout:1: exclusive lock released 2024-09-16T07:51:13.207 INFO:tasks.workunit.client.0.smithi115.stdout:1: acquiring exclusive lock 2024-09-16T07:51:13.281 INFO:tasks.workunit.client.0.smithi115.stdout:1: exclusive lock acquired 2024-09-16T07:51:13.321 INFO:tasks.workunit.client.0.smithi115.stdout:1: releasing exclusive lock 2024-09-16T07:51:13.361 INFO:tasks.workunit.client.0.smithi115.stdout:1: exclusive lock released 2024-09-16T07:51:13.361 INFO:tasks.workunit.client.0.smithi115.stdout:1: acquiring exclusive lock 2024-09-16T07:51:13.417 INFO:tasks.workunit.client.0.smithi115.stdout:2: exclusive lock acquired 2024-09-16T07:51:13.418 INFO:tasks.workunit.client.0.smithi115.stdout:2: releasing exclusive lock 2024-09-16T07:51:13.517 INFO:tasks.workunit.client.0.smithi115.stdout:2: exclusive lock released 2024-09-16T07:51:13.517 INFO:tasks.workunit.client.0.smithi115.stdout:2: acquiring exclusive lock 2024-09-16T07:51:13.612 INFO:tasks.workunit.client.0.smithi115.stdout:1: exclusive lock acquired 2024-09-16T07:51:13.626 INFO:tasks.workunit.client.0.smithi115.stdout:1: releasing exclusive lock 2024-09-16T07:51:13.792 INFO:tasks.workunit.client.0.smithi115.stdout:1: exclusive lock released 2024-09-16T07:51:13.845 INFO:tasks.workunit.client.0.smithi115.stdout:2: exclusive lock acquired 2024-09-16T07:51:13.866 INFO:tasks.workunit.client.0.smithi115.stdout:2: releasing exclusive lock 2024-09-16T07:51:13.907 INFO:tasks.workunit.client.0.smithi115.stdout:2: exclusive lock released 2024-09-16T07:51:13.907 INFO:tasks.workunit.client.0.smithi115.stdout:2: acquiring exclusive lock 2024-09-16T07:51:13.957 INFO:tasks.workunit.client.0.smithi115.stdout:2: exclusive lock acquired 2024-09-16T07:51:13.958 INFO:tasks.workunit.client.0.smithi115.stdout:2: releasing exclusive lock 2024-09-16T07:51:14.000 INFO:tasks.workunit.client.0.smithi115.stdout:2: exclusive lock released 2024-09-16T07:51:14.211 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.ExclusiveLock (2318 ms) 2024-09-16T07:51:14.212 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.BreakLock 2024-09-16T07:51:14.212 INFO:tasks.workunit.client.0.smithi115.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:11553: Skipped 2024-09-16T07:51:14.212 INFO:tasks.workunit.client.0.smithi115.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:51:14.212 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestLibRBD.BreakLock (0 ms) 2024-09-16T07:51:14.212 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.DiscardAfterWrite 2024-09-16T07:51:14.212 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:51:14.475 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.DiscardAfterWrite (264 ms) 2024-09-16T07:51:14.475 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.DefaultFeatures 2024-09-16T07:51:14.475 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.DefaultFeatures (0 ms) 2024-09-16T07:51:14.475 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.TestTrashMoveAndPurge 2024-09-16T07:51:14.476 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:51:15.291 INFO:tasks.workunit.client.0.smithi115.stdout:0.00% done 2024-09-16T07:51:15.292 INFO:tasks.workunit.client.0.smithi115.stdout:1.56% done 2024-09-16T07:51:15.292 INFO:tasks.workunit.client.0.smithi115.stdout:3.12% done 2024-09-16T07:51:15.292 INFO:tasks.workunit.client.0.smithi115.stdout:4.69% done 2024-09-16T07:51:15.292 INFO:tasks.workunit.client.0.smithi115.stdout:6.25% done 2024-09-16T07:51:15.292 INFO:tasks.workunit.client.0.smithi115.stdout:7.81% done 2024-09-16T07:51:15.292 INFO:tasks.workunit.client.0.smithi115.stdout:9.38% done 2024-09-16T07:51:15.292 INFO:tasks.workunit.client.0.smithi115.stdout:10.94% done 2024-09-16T07:51:15.292 INFO:tasks.workunit.client.0.smithi115.stdout:12.50% done 2024-09-16T07:51:15.293 INFO:tasks.workunit.client.0.smithi115.stdout:14.06% done 2024-09-16T07:51:15.293 INFO:tasks.workunit.client.0.smithi115.stdout:15.62% done 2024-09-16T07:51:15.293 INFO:tasks.workunit.client.0.smithi115.stdout:17.19% done 2024-09-16T07:51:15.293 INFO:tasks.workunit.client.0.smithi115.stdout:18.75% done 2024-09-16T07:51:15.293 INFO:tasks.workunit.client.0.smithi115.stdout:20.31% done 2024-09-16T07:51:15.293 INFO:tasks.workunit.client.0.smithi115.stdout:21.88% done 2024-09-16T07:51:15.293 INFO:tasks.workunit.client.0.smithi115.stdout:23.44% done 2024-09-16T07:51:15.293 INFO:tasks.workunit.client.0.smithi115.stdout:25.00% done 2024-09-16T07:51:15.293 INFO:tasks.workunit.client.0.smithi115.stdout:26.56% done 2024-09-16T07:51:15.293 INFO:tasks.workunit.client.0.smithi115.stdout:28.12% done 2024-09-16T07:51:15.293 INFO:tasks.workunit.client.0.smithi115.stdout:29.69% done 2024-09-16T07:51:15.293 INFO:tasks.workunit.client.0.smithi115.stdout:31.25% done 2024-09-16T07:51:15.293 INFO:tasks.workunit.client.0.smithi115.stdout:32.81% done 2024-09-16T07:51:15.294 INFO:tasks.workunit.client.0.smithi115.stdout:34.38% done 2024-09-16T07:51:15.294 INFO:tasks.workunit.client.0.smithi115.stdout:35.94% done 2024-09-16T07:51:15.294 INFO:tasks.workunit.client.0.smithi115.stdout:37.50% done 2024-09-16T07:51:15.294 INFO:tasks.workunit.client.0.smithi115.stdout:39.06% done 2024-09-16T07:51:15.294 INFO:tasks.workunit.client.0.smithi115.stdout:40.62% done 2024-09-16T07:51:15.294 INFO:tasks.workunit.client.0.smithi115.stdout:42.19% done 2024-09-16T07:51:15.294 INFO:tasks.workunit.client.0.smithi115.stdout:43.75% done 2024-09-16T07:51:15.294 INFO:tasks.workunit.client.0.smithi115.stdout:45.31% done 2024-09-16T07:51:15.294 INFO:tasks.workunit.client.0.smithi115.stdout:46.88% done 2024-09-16T07:51:15.294 INFO:tasks.workunit.client.0.smithi115.stdout:48.44% done 2024-09-16T07:51:15.294 INFO:tasks.workunit.client.0.smithi115.stdout:50.00% done 2024-09-16T07:51:15.294 INFO:tasks.workunit.client.0.smithi115.stdout:51.56% done 2024-09-16T07:51:15.294 INFO:tasks.workunit.client.0.smithi115.stdout:53.12% done 2024-09-16T07:51:15.294 INFO:tasks.workunit.client.0.smithi115.stdout:54.69% done 2024-09-16T07:51:15.295 INFO:tasks.workunit.client.0.smithi115.stdout:56.25% done 2024-09-16T07:51:15.295 INFO:tasks.workunit.client.0.smithi115.stdout:57.81% done 2024-09-16T07:51:15.295 INFO:tasks.workunit.client.0.smithi115.stdout:59.38% done 2024-09-16T07:51:15.295 INFO:tasks.workunit.client.0.smithi115.stdout:60.94% done 2024-09-16T07:51:15.295 INFO:tasks.workunit.client.0.smithi115.stdout:62.50% done 2024-09-16T07:51:15.295 INFO:tasks.workunit.client.0.smithi115.stdout:64.06% done 2024-09-16T07:51:15.295 INFO:tasks.workunit.client.0.smithi115.stdout:65.62% done 2024-09-16T07:51:15.295 INFO:tasks.workunit.client.0.smithi115.stdout:67.19% done 2024-09-16T07:51:15.295 INFO:tasks.workunit.client.0.smithi115.stdout:68.75% done 2024-09-16T07:51:15.295 INFO:tasks.workunit.client.0.smithi115.stdout:70.31% done 2024-09-16T07:51:15.295 INFO:tasks.workunit.client.0.smithi115.stdout:71.88% done 2024-09-16T07:51:15.295 INFO:tasks.workunit.client.0.smithi115.stdout:73.44% done 2024-09-16T07:51:15.295 INFO:tasks.workunit.client.0.smithi115.stdout:75.00% done 2024-09-16T07:51:15.295 INFO:tasks.workunit.client.0.smithi115.stdout:76.56% done 2024-09-16T07:51:15.296 INFO:tasks.workunit.client.0.smithi115.stdout:78.12% done 2024-09-16T07:51:15.296 INFO:tasks.workunit.client.0.smithi115.stdout:79.69% done 2024-09-16T07:51:15.296 INFO:tasks.workunit.client.0.smithi115.stdout:81.25% done 2024-09-16T07:51:15.296 INFO:tasks.workunit.client.0.smithi115.stdout:82.81% done 2024-09-16T07:51:15.296 INFO:tasks.workunit.client.0.smithi115.stdout:84.38% done 2024-09-16T07:51:15.296 INFO:tasks.workunit.client.0.smithi115.stdout:85.94% done 2024-09-16T07:51:15.296 INFO:tasks.workunit.client.0.smithi115.stdout:87.50% done 2024-09-16T07:51:15.296 INFO:tasks.workunit.client.0.smithi115.stdout:89.06% done 2024-09-16T07:51:15.296 INFO:tasks.workunit.client.0.smithi115.stdout:90.62% done 2024-09-16T07:51:15.296 INFO:tasks.workunit.client.0.smithi115.stdout:92.19% done 2024-09-16T07:51:15.296 INFO:tasks.workunit.client.0.smithi115.stdout:93.75% done 2024-09-16T07:51:15.296 INFO:tasks.workunit.client.0.smithi115.stdout:95.31% done 2024-09-16T07:51:15.297 INFO:tasks.workunit.client.0.smithi115.stdout:96.88% done 2024-09-16T07:51:15.297 INFO:tasks.workunit.client.0.smithi115.stdout:98.44% done 2024-09-16T07:51:15.297 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.TestTrashMoveAndPurge (816 ms) 2024-09-16T07:51:15.297 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.TestTrashMoveAndPurgeNonExpiredDelay 2024-09-16T07:51:15.297 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:51:16.114 INFO:tasks.workunit.client.0.smithi115.stdout:0.00% done 2024-09-16T07:51:16.114 INFO:tasks.workunit.client.0.smithi115.stdout:1.56% done 2024-09-16T07:51:16.114 INFO:tasks.workunit.client.0.smithi115.stdout:3.12% done 2024-09-16T07:51:16.114 INFO:tasks.workunit.client.0.smithi115.stdout:4.69% done 2024-09-16T07:51:16.115 INFO:tasks.workunit.client.0.smithi115.stdout:6.25% done 2024-09-16T07:51:16.115 INFO:tasks.workunit.client.0.smithi115.stdout:7.81% done 2024-09-16T07:51:16.115 INFO:tasks.workunit.client.0.smithi115.stdout:9.38% done 2024-09-16T07:51:16.115 INFO:tasks.workunit.client.0.smithi115.stdout:10.94% done 2024-09-16T07:51:16.115 INFO:tasks.workunit.client.0.smithi115.stdout:12.50% done 2024-09-16T07:51:16.115 INFO:tasks.workunit.client.0.smithi115.stdout:14.06% done 2024-09-16T07:51:16.115 INFO:tasks.workunit.client.0.smithi115.stdout:15.62% done 2024-09-16T07:51:16.115 INFO:tasks.workunit.client.0.smithi115.stdout:17.19% done 2024-09-16T07:51:16.115 INFO:tasks.workunit.client.0.smithi115.stdout:18.75% done 2024-09-16T07:51:16.115 INFO:tasks.workunit.client.0.smithi115.stdout:20.31% done 2024-09-16T07:51:16.115 INFO:tasks.workunit.client.0.smithi115.stdout:21.88% done 2024-09-16T07:51:16.115 INFO:tasks.workunit.client.0.smithi115.stdout:23.44% done 2024-09-16T07:51:16.115 INFO:tasks.workunit.client.0.smithi115.stdout:25.00% done 2024-09-16T07:51:16.116 INFO:tasks.workunit.client.0.smithi115.stdout:26.56% done 2024-09-16T07:51:16.116 INFO:tasks.workunit.client.0.smithi115.stdout:28.12% done 2024-09-16T07:51:16.116 INFO:tasks.workunit.client.0.smithi115.stdout:29.69% done 2024-09-16T07:51:16.116 INFO:tasks.workunit.client.0.smithi115.stdout:31.25% done 2024-09-16T07:51:16.116 INFO:tasks.workunit.client.0.smithi115.stdout:32.81% done 2024-09-16T07:51:16.116 INFO:tasks.workunit.client.0.smithi115.stdout:34.38% done 2024-09-16T07:51:16.116 INFO:tasks.workunit.client.0.smithi115.stdout:35.94% done 2024-09-16T07:51:16.116 INFO:tasks.workunit.client.0.smithi115.stdout:37.50% done 2024-09-16T07:51:16.116 INFO:tasks.workunit.client.0.smithi115.stdout:39.06% done 2024-09-16T07:51:16.116 INFO:tasks.workunit.client.0.smithi115.stdout:40.62% done 2024-09-16T07:51:16.116 INFO:tasks.workunit.client.0.smithi115.stdout:42.19% done 2024-09-16T07:51:16.116 INFO:tasks.workunit.client.0.smithi115.stdout:43.75% done 2024-09-16T07:51:16.116 INFO:tasks.workunit.client.0.smithi115.stdout:45.31% done 2024-09-16T07:51:16.117 INFO:tasks.workunit.client.0.smithi115.stdout:46.88% done 2024-09-16T07:51:16.117 INFO:tasks.workunit.client.0.smithi115.stdout:48.44% done 2024-09-16T07:51:16.117 INFO:tasks.workunit.client.0.smithi115.stdout:50.00% done 2024-09-16T07:51:16.117 INFO:tasks.workunit.client.0.smithi115.stdout:51.56% done 2024-09-16T07:51:16.117 INFO:tasks.workunit.client.0.smithi115.stdout:53.12% done 2024-09-16T07:51:16.117 INFO:tasks.workunit.client.0.smithi115.stdout:54.69% done 2024-09-16T07:51:16.117 INFO:tasks.workunit.client.0.smithi115.stdout:56.25% done 2024-09-16T07:51:16.117 INFO:tasks.workunit.client.0.smithi115.stdout:57.81% done 2024-09-16T07:51:16.117 INFO:tasks.workunit.client.0.smithi115.stdout:59.38% done 2024-09-16T07:51:16.117 INFO:tasks.workunit.client.0.smithi115.stdout:60.94% done 2024-09-16T07:51:16.117 INFO:tasks.workunit.client.0.smithi115.stdout:62.50% done 2024-09-16T07:51:16.117 INFO:tasks.workunit.client.0.smithi115.stdout:64.06% done 2024-09-16T07:51:16.117 INFO:tasks.workunit.client.0.smithi115.stdout:65.62% done 2024-09-16T07:51:16.117 INFO:tasks.workunit.client.0.smithi115.stdout:67.19% done 2024-09-16T07:51:16.118 INFO:tasks.workunit.client.0.smithi115.stdout:68.75% done 2024-09-16T07:51:16.118 INFO:tasks.workunit.client.0.smithi115.stdout:70.31% done 2024-09-16T07:51:16.118 INFO:tasks.workunit.client.0.smithi115.stdout:71.88% done 2024-09-16T07:51:16.118 INFO:tasks.workunit.client.0.smithi115.stdout:73.44% done 2024-09-16T07:51:16.118 INFO:tasks.workunit.client.0.smithi115.stdout:75.00% done 2024-09-16T07:51:16.118 INFO:tasks.workunit.client.0.smithi115.stdout:76.56% done 2024-09-16T07:51:16.118 INFO:tasks.workunit.client.0.smithi115.stdout:78.12% done 2024-09-16T07:51:16.118 INFO:tasks.workunit.client.0.smithi115.stdout:79.69% done 2024-09-16T07:51:16.118 INFO:tasks.workunit.client.0.smithi115.stdout:81.25% done 2024-09-16T07:51:16.118 INFO:tasks.workunit.client.0.smithi115.stdout:82.81% done 2024-09-16T07:51:16.118 INFO:tasks.workunit.client.0.smithi115.stdout:84.38% done 2024-09-16T07:51:16.118 INFO:tasks.workunit.client.0.smithi115.stdout:85.94% done 2024-09-16T07:51:16.118 INFO:tasks.workunit.client.0.smithi115.stdout:87.50% done 2024-09-16T07:51:16.119 INFO:tasks.workunit.client.0.smithi115.stdout:89.06% done 2024-09-16T07:51:16.119 INFO:tasks.workunit.client.0.smithi115.stdout:90.62% done 2024-09-16T07:51:16.119 INFO:tasks.workunit.client.0.smithi115.stdout:92.19% done 2024-09-16T07:51:16.119 INFO:tasks.workunit.client.0.smithi115.stdout:93.75% done 2024-09-16T07:51:16.119 INFO:tasks.workunit.client.0.smithi115.stdout:95.31% done 2024-09-16T07:51:16.119 INFO:tasks.workunit.client.0.smithi115.stdout:96.88% done 2024-09-16T07:51:16.119 INFO:tasks.workunit.client.0.smithi115.stdout:98.44% done 2024-09-16T07:51:16.119 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.TestTrashMoveAndPurgeNonExpiredDelay (823 ms) 2024-09-16T07:51:16.119 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.TestTrashPurge 2024-09-16T07:51:16.119 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:51:16.190 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:51:17.904 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.TestTrashPurge (1790 ms) 2024-09-16T07:51:17.905 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.TestTrashMoveAndRestore 2024-09-16T07:51:17.905 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:51:18.467 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.TestTrashMoveAndRestore (562 ms) 2024-09-16T07:51:18.467 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.TestListWatchers 2024-09-16T07:51:18.467 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:51:18.986 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.TestListWatchers (519 ms) 2024-09-16T07:51:18.986 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.TestSetSnapById 2024-09-16T07:51:18.986 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:51:20.514 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.TestSetSnapById (1528 ms) 2024-09-16T07:51:20.514 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.Namespaces 2024-09-16T07:51:20.828 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.Namespaces (313 ms) 2024-09-16T07:51:20.828 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.NamespacesPP 2024-09-16T07:51:21.160 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:51:21.189 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:51:22.336 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.NamespacesPP (1508 ms) 2024-09-16T07:51:22.336 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.Migration 2024-09-16T07:51:22.336 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:51:22.336 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:51:28.246 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.Migration (5910 ms) 2024-09-16T07:51:28.246 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.MigrationPP 2024-09-16T07:51:28.246 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:51:28.246 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:51:34.104 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.MigrationPP (5859 ms) 2024-09-16T07:51:34.104 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.TestGetAccessTimestamp 2024-09-16T07:51:34.104 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:51:34.282 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.TestGetAccessTimestamp (178 ms) 2024-09-16T07:51:34.282 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.TestGetModifyTimestamp 2024-09-16T07:51:34.282 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:51:34.468 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.TestGetModifyTimestamp (185 ms) 2024-09-16T07:51:34.468 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.ZeroOverlapFlatten 2024-09-16T07:51:34.468 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:51:36.283 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.ZeroOverlapFlatten (1816 ms) 2024-09-16T07:51:36.283 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.PoolMetadata 2024-09-16T07:51:36.552 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.PoolMetadata (269 ms) 2024-09-16T07:51:36.552 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.PoolMetadataPP 2024-09-16T07:51:36.796 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.PoolMetadataPP (244 ms) 2024-09-16T07:51:36.796 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.Config 2024-09-16T07:51:36.825 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:51:37.291 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.Config (495 ms) 2024-09-16T07:51:37.291 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.ConfigPP 2024-09-16T07:51:37.312 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:51:37.996 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.ConfigPP (705 ms) 2024-09-16T07:51:37.996 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.PoolStatsPP 2024-09-16T07:51:39.038 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:51:41.461 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:51:41.537 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:51:41.612 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:51:43.064 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.PoolStatsPP (5068 ms) 2024-09-16T07:51:43.064 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.ImageSpec 2024-09-16T07:51:45.058 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:51:52.049 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.ImageSpec (8984 ms) 2024-09-16T07:51:52.049 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.SnapRemoveWithChildMissing 2024-09-16T07:51:54.089 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:52:07.627 INFO:tasks.workunit.client.0.smithi115.stdout:num children is: 3 2024-09-16T07:52:07.628 INFO:tasks.workunit.client.0.smithi115.stdout:expected: 3 2024-09-16T07:52:07.628 INFO:tasks.workunit.client.0.smithi115.stdout:child: image224 2024-09-16T07:52:07.628 INFO:tasks.workunit.client.0.smithi115.stdout:child: image226 2024-09-16T07:52:07.628 INFO:tasks.workunit.client.0.smithi115.stdout:child: image225 2024-09-16T07:52:07.628 INFO:tasks.workunit.client.0.smithi115.stdout:found child test-librbd-smithi115-30516-1/image224/105f1b6967a6 2024-09-16T07:52:07.628 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:52:07.628 INFO:tasks.workunit.client.0.smithi115.stdout:found child test-librbd-smithi115-30516-20/image225/105f8b5496e9 2024-09-16T07:52:07.628 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:52:07.629 INFO:tasks.workunit.client.0.smithi115.stdout:found child test-librbd-smithi115-30516-1/image226/105f3c686277 2024-09-16T07:52:07.629 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:52:07.629 INFO:tasks.workunit.client.0.smithi115.stdout:num children is: 0 2024-09-16T07:52:07.629 INFO:tasks.workunit.client.0.smithi115.stdout:expected: 0 2024-09-16T07:52:07.629 INFO:tasks.workunit.client.0.smithi115.stdout:num snaps is: 0 2024-09-16T07:52:07.629 INFO:tasks.workunit.client.0.smithi115.stdout:expected: 0 2024-09-16T07:52:07.629 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.SnapRemoveWithChildMissing (15577 ms) 2024-09-16T07:52:07.629 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.QuiesceWatch 2024-09-16T07:52:09.146 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:52:18.479 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.QuiesceWatch (10853 ms) 2024-09-16T07:52:18.479 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.QuiesceWatchPP 2024-09-16T07:52:18.479 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:52:25.470 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.QuiesceWatchPP (6990 ms) 2024-09-16T07:52:25.470 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.QuiesceWatchError 2024-09-16T07:52:25.470 INFO:tasks.workunit.client.0.smithi115.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:13115: Skipped 2024-09-16T07:52:25.470 INFO:tasks.workunit.client.0.smithi115.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:52:25.470 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestLibRBD.QuiesceWatchError (0 ms) 2024-09-16T07:52:25.470 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.QuiesceWatchTimeout 2024-09-16T07:52:25.470 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:52:25.640 INFO:tasks.workunit.client.0.smithi115.stderr:test quiesce is not long enough to time out 2024-09-16T07:52:34.845 INFO:tasks.workunit.client.0.smithi115.stderr:test quiesce is timed out 2024-09-16T07:52:34.920 INFO:tasks.workunit.client.0.smithi115.stderr:waiting for timed out ... 0 2024-09-16T07:52:35.921 INFO:tasks.workunit.client.0.smithi115.stderr:waiting for timed out ... 1 2024-09-16T07:52:36.921 INFO:tasks.workunit.client.0.smithi115.stderr:waiting for timed out ... 2 2024-09-16T07:52:37.921 INFO:tasks.workunit.client.0.smithi115.stderr:waiting for timed out ... 3 2024-09-16T07:52:38.921 INFO:tasks.workunit.client.0.smithi115.stderr:waiting for timed out ... 4 2024-09-16T07:52:39.921 INFO:tasks.workunit.client.0.smithi115.stderr:waiting for timed out ... 5 2024-09-16T07:52:40.921 INFO:tasks.workunit.client.0.smithi115.stderr:waiting for timed out ... 6 2024-09-16T07:52:41.921 INFO:tasks.workunit.client.0.smithi115.stderr:waiting for timed out ... 7 2024-09-16T07:52:42.921 INFO:tasks.workunit.client.0.smithi115.stderr:waiting for timed out ... 8 2024-09-16T07:52:43.922 INFO:tasks.workunit.client.0.smithi115.stderr:waiting for timed out ... 9 2024-09-16T07:52:44.922 INFO:tasks.workunit.client.0.smithi115.stderr:waiting for timed out ... 10 2024-09-16T07:52:55.922 INFO:tasks.workunit.client.0.smithi115.stderr:test retry succeeds 2024-09-16T07:52:59.572 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.QuiesceWatchTimeout (34103 ms) 2024-09-16T07:52:59.572 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.WriteZeroes 2024-09-16T07:52:59.572 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:53:00.076 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.WriteZeroes (504 ms) 2024-09-16T07:53:00.077 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.WriteZeroesThickProvision 2024-09-16T07:53:00.077 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:53:00.516 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.WriteZeroesThickProvision (440 ms) 2024-09-16T07:53:00.516 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.ConcurrentOperations 2024-09-16T07:53:00.516 INFO:tasks.workunit.client.0.smithi115.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:13474: Skipped 2024-09-16T07:53:00.516 INFO:tasks.workunit.client.0.smithi115.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:53:00.516 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestLibRBD.ConcurrentOperations (0 ms) 2024-09-16T07:53:00.516 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestLibRBD.FormatAndCloneFormatOptions 2024-09-16T07:53:08.013 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestLibRBD.FormatAndCloneFormatOptions (7496 ms) 2024-09-16T07:53:27.094 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] 171 tests from TestLibRBD (1116279 ms total) 2024-09-16T07:53:27.095 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:53:27.095 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] Global test environment tear-down 2024-09-16T07:53:27.095 INFO:tasks.workunit.client.0.smithi115.stdout:[==========] 171 tests from 1 test suite ran. (1135407 ms total) 2024-09-16T07:53:27.095 INFO:tasks.workunit.client.0.smithi115.stdout:[ PASSED ] 164 tests. 2024-09-16T07:53:27.095 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] 7 tests, listed below: 2024-09-16T07:53:27.095 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestLibRBD.EncryptionLoadBadStripePattern 2024-09-16T07:53:27.095 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestLibRBD.ListChildrenTiered 2024-09-16T07:53:27.095 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestLibRBD.EnableJournalingViaLockOwner 2024-09-16T07:53:27.095 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestLibRBD.ExclusiveLockReadTransition 2024-09-16T07:53:27.095 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestLibRBD.BreakLock 2024-09-16T07:53:27.095 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestLibRBD.QuiesceWatchError 2024-09-16T07:53:27.095 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestLibRBD.ConcurrentOperations 2024-09-16T07:53:27.096 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:53:27.096 INFO:tasks.workunit.client.0.smithi115.stdout: YOU HAVE 1 DISABLED TEST 2024-09-16T07:53:27.096 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:53:27.226 INFO:tasks.workunit.client.0.smithi115.stdout:seed 40059 2024-09-16T07:53:27.227 INFO:tasks.workunit.client.0.smithi115.stdout:Note: Google Test filter = EncryptedFlattenTest/0.* 2024-09-16T07:53:27.227 INFO:tasks.workunit.client.0.smithi115.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-16T07:53:27.227 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] Global test environment set-up. 2024-09-16T07:53:27.227 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] 7 tests from EncryptedFlattenTest/0, where TypeParam = PlaintextUnderLUKS1 2024-09-16T07:53:27.302 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] EncryptedFlattenTest/0.Simple 2024-09-16T07:53:29.060 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:53:41.668 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] EncryptedFlattenTest/0.Simple (14365 ms) 2024-09-16T07:53:41.668 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] EncryptedFlattenTest/0.Grow 2024-09-16T07:53:41.668 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:53:52.817 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] EncryptedFlattenTest/0.Grow (11149 ms) 2024-09-16T07:53:52.817 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] EncryptedFlattenTest/0.Shrink 2024-09-16T07:53:52.817 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:54:03.768 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] EncryptedFlattenTest/0.Shrink (10951 ms) 2024-09-16T07:54:03.769 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] EncryptedFlattenTest/0.ShrinkToOne 2024-09-16T07:54:03.769 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:54:14.290 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] EncryptedFlattenTest/0.ShrinkToOne (10523 ms) 2024-09-16T07:54:14.291 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] EncryptedFlattenTest/0.ShrinkToOneAfterSnapshot 2024-09-16T07:54:14.291 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:54:25.710 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] EncryptedFlattenTest/0.ShrinkToOneAfterSnapshot (11420 ms) 2024-09-16T07:54:25.710 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] EncryptedFlattenTest/0.MinOverlap 2024-09-16T07:54:25.710 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:54:36.465 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] EncryptedFlattenTest/0.MinOverlap (10755 ms) 2024-09-16T07:54:36.465 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] EncryptedFlattenTest/0.ZeroOverlap 2024-09-16T07:54:36.465 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:54:47.353 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] EncryptedFlattenTest/0.ZeroOverlap (10887 ms) 2024-09-16T07:54:48.112 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] 7 tests from EncryptedFlattenTest/0 (80050 ms total) 2024-09-16T07:54:48.112 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:54:48.112 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] Global test environment tear-down 2024-09-16T07:54:48.112 INFO:tasks.workunit.client.0.smithi115.stdout:[==========] 7 tests from 1 test suite ran. (80885 ms total) 2024-09-16T07:54:48.112 INFO:tasks.workunit.client.0.smithi115.stdout:[ PASSED ] 7 tests. 2024-09-16T07:54:48.218 INFO:tasks.workunit.client.0.smithi115.stdout:seed 40175 2024-09-16T07:54:48.219 INFO:tasks.workunit.client.0.smithi115.stdout:Note: Google Test filter = EncryptedFlattenTest/1.* 2024-09-16T07:54:48.219 INFO:tasks.workunit.client.0.smithi115.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-16T07:54:48.224 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] Global test environment set-up. 2024-09-16T07:54:48.224 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] 7 tests from EncryptedFlattenTest/1, where TypeParam = PlaintextUnderLUKS2 2024-09-16T07:54:48.306 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] EncryptedFlattenTest/1.Simple 2024-09-16T07:54:50.130 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:55:07.776 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] EncryptedFlattenTest/1.Simple (19470 ms) 2024-09-16T07:55:07.776 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] EncryptedFlattenTest/1.Grow 2024-09-16T07:55:07.776 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:55:20.623 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] EncryptedFlattenTest/1.Grow (12847 ms) 2024-09-16T07:55:20.623 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] EncryptedFlattenTest/1.Shrink 2024-09-16T07:55:20.624 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:55:34.433 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] EncryptedFlattenTest/1.Shrink (13809 ms) 2024-09-16T07:55:34.433 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] EncryptedFlattenTest/1.ShrinkToOne 2024-09-16T07:55:34.434 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:55:46.008 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] EncryptedFlattenTest/1.ShrinkToOne (11575 ms) 2024-09-16T07:55:46.008 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] EncryptedFlattenTest/1.ShrinkToOneAfterSnapshot 2024-09-16T07:55:46.008 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:56:04.268 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] EncryptedFlattenTest/1.ShrinkToOneAfterSnapshot (18261 ms) 2024-09-16T07:56:04.269 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] EncryptedFlattenTest/1.MinOverlap 2024-09-16T07:56:04.269 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:56:17.065 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] EncryptedFlattenTest/1.MinOverlap (12797 ms) 2024-09-16T07:56:17.066 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] EncryptedFlattenTest/1.ZeroOverlap 2024-09-16T07:56:17.066 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:56:28.777 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] EncryptedFlattenTest/1.ZeroOverlap (11711 ms) 2024-09-16T07:56:29.112 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] 7 tests from EncryptedFlattenTest/1 (100470 ms total) 2024-09-16T07:56:29.113 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:56:29.113 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] Global test environment tear-down 2024-09-16T07:56:29.113 INFO:tasks.workunit.client.0.smithi115.stdout:[==========] 7 tests from 1 test suite ran. (100893 ms total) 2024-09-16T07:56:29.113 INFO:tasks.workunit.client.0.smithi115.stdout:[ PASSED ] 7 tests. 2024-09-16T07:56:29.216 INFO:tasks.workunit.client.0.smithi115.stdout:seed 46273 2024-09-16T07:56:29.216 INFO:tasks.workunit.client.0.smithi115.stdout:Note: Google Test filter = EncryptedFlattenTest/2.* 2024-09-16T07:56:29.217 INFO:tasks.workunit.client.0.smithi115.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-16T07:56:29.217 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] Global test environment set-up. 2024-09-16T07:56:29.217 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] 7 tests from EncryptedFlattenTest/2, where TypeParam = UnformattedLUKS1 2024-09-16T07:56:29.300 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] EncryptedFlattenTest/2.Simple 2024-09-16T07:56:31.124 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:56:46.226 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] EncryptedFlattenTest/2.Simple (16926 ms) 2024-09-16T07:56:46.227 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] EncryptedFlattenTest/2.Grow 2024-09-16T07:56:46.227 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:56:58.756 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] EncryptedFlattenTest/2.Grow (12530 ms) 2024-09-16T07:56:58.757 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] EncryptedFlattenTest/2.Shrink 2024-09-16T07:56:58.757 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:57:11.309 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] EncryptedFlattenTest/2.Shrink (12553 ms) 2024-09-16T07:57:11.310 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] EncryptedFlattenTest/2.ShrinkToOne 2024-09-16T07:57:11.310 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:57:24.268 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] EncryptedFlattenTest/2.ShrinkToOne (12958 ms) 2024-09-16T07:57:24.268 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] EncryptedFlattenTest/2.ShrinkToOneAfterSnapshot 2024-09-16T07:57:24.268 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:57:38.838 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] EncryptedFlattenTest/2.ShrinkToOneAfterSnapshot (14570 ms) 2024-09-16T07:57:38.839 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] EncryptedFlattenTest/2.MinOverlap 2024-09-16T07:57:38.839 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:57:51.040 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] EncryptedFlattenTest/2.MinOverlap (12202 ms) 2024-09-16T07:57:51.040 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] EncryptedFlattenTest/2.ZeroOverlap 2024-09-16T07:57:51.040 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:58:03.834 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] EncryptedFlattenTest/2.ZeroOverlap (12795 ms) 2024-09-16T07:58:04.119 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] 7 tests from EncryptedFlattenTest/2 (94534 ms total) 2024-09-16T07:58:04.119 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T07:58:04.119 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] Global test environment tear-down 2024-09-16T07:58:04.119 INFO:tasks.workunit.client.0.smithi115.stdout:[==========] 7 tests from 1 test suite ran. (94903 ms total) 2024-09-16T07:58:04.119 INFO:tasks.workunit.client.0.smithi115.stdout:[ PASSED ] 7 tests. 2024-09-16T07:58:04.223 INFO:tasks.workunit.client.0.smithi115.stdout:seed 46345 2024-09-16T07:58:04.223 INFO:tasks.workunit.client.0.smithi115.stdout:Note: Google Test filter = EncryptedFlattenTest/3.* 2024-09-16T07:58:04.223 INFO:tasks.workunit.client.0.smithi115.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-16T07:58:04.223 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] Global test environment set-up. 2024-09-16T07:58:04.223 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] 7 tests from EncryptedFlattenTest/3, where TypeParam = LUKS1UnderLUKS1 2024-09-16T07:58:04.300 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] EncryptedFlattenTest/3.Simple 2024-09-16T07:58:06.129 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:58:24.624 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] EncryptedFlattenTest/3.Simple (20324 ms) 2024-09-16T07:58:24.625 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] EncryptedFlattenTest/3.Grow 2024-09-16T07:58:24.625 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:58:40.844 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] EncryptedFlattenTest/3.Grow (16219 ms) 2024-09-16T07:58:40.845 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] EncryptedFlattenTest/3.Shrink 2024-09-16T07:58:40.845 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:58:57.148 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] EncryptedFlattenTest/3.Shrink (16305 ms) 2024-09-16T07:58:57.149 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] EncryptedFlattenTest/3.ShrinkToOne 2024-09-16T07:58:57.149 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:59:13.520 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] EncryptedFlattenTest/3.ShrinkToOne (16371 ms) 2024-09-16T07:59:13.521 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] EncryptedFlattenTest/3.ShrinkToOneAfterSnapshot 2024-09-16T07:59:13.521 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:59:30.809 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] EncryptedFlattenTest/3.ShrinkToOneAfterSnapshot (17289 ms) 2024-09-16T07:59:30.809 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] EncryptedFlattenTest/3.MinOverlap 2024-09-16T07:59:30.809 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T07:59:46.696 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] EncryptedFlattenTest/3.MinOverlap (15887 ms) 2024-09-16T07:59:46.696 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] EncryptedFlattenTest/3.ZeroOverlap 2024-09-16T07:59:46.696 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T08:00:02.256 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] EncryptedFlattenTest/3.ZeroOverlap (15561 ms) 2024-09-16T08:00:03.157 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] 7 tests from EncryptedFlattenTest/3 (117956 ms total) 2024-09-16T08:00:03.157 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T08:00:03.158 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] Global test environment tear-down 2024-09-16T08:00:03.158 INFO:tasks.workunit.client.0.smithi115.stdout:[==========] 7 tests from 1 test suite ran. (118934 ms total) 2024-09-16T08:00:03.158 INFO:tasks.workunit.client.0.smithi115.stdout:[ PASSED ] 7 tests. 2024-09-16T08:00:03.263 INFO:tasks.workunit.client.0.smithi115.stdout:seed 46412 2024-09-16T08:00:03.263 INFO:tasks.workunit.client.0.smithi115.stdout:Note: Google Test filter = EncryptedFlattenTest/4.* 2024-09-16T08:00:03.263 INFO:tasks.workunit.client.0.smithi115.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-16T08:00:03.263 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] Global test environment set-up. 2024-09-16T08:00:03.264 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] 7 tests from EncryptedFlattenTest/4, where TypeParam = LUKS1UnderLUKS2 2024-09-16T08:00:03.339 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] EncryptedFlattenTest/4.Simple 2024-09-16T08:00:05.166 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T08:00:25.363 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] EncryptedFlattenTest/4.Simple (22023 ms) 2024-09-16T08:00:25.363 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] EncryptedFlattenTest/4.Grow 2024-09-16T08:00:25.363 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T08:00:43.441 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] EncryptedFlattenTest/4.Grow (18079 ms) 2024-09-16T08:00:43.442 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] EncryptedFlattenTest/4.Shrink 2024-09-16T08:00:43.442 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T08:01:01.811 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] EncryptedFlattenTest/4.Shrink (18369 ms) 2024-09-16T08:01:01.811 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] EncryptedFlattenTest/4.ShrinkToOne 2024-09-16T08:01:01.811 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T08:01:19.350 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] EncryptedFlattenTest/4.ShrinkToOne (17539 ms) 2024-09-16T08:01:19.350 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] EncryptedFlattenTest/4.ShrinkToOneAfterSnapshot 2024-09-16T08:01:19.350 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T08:01:38.635 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] EncryptedFlattenTest/4.ShrinkToOneAfterSnapshot (19285 ms) 2024-09-16T08:01:38.636 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] EncryptedFlattenTest/4.MinOverlap 2024-09-16T08:01:38.636 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T08:01:57.024 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] EncryptedFlattenTest/4.MinOverlap (18389 ms) 2024-09-16T08:01:57.024 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] EncryptedFlattenTest/4.ZeroOverlap 2024-09-16T08:01:57.024 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T08:02:16.164 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] EncryptedFlattenTest/4.ZeroOverlap (19141 ms) 2024-09-16T08:02:16.227 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] 7 tests from EncryptedFlattenTest/4 (132825 ms total) 2024-09-16T08:02:16.227 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T08:02:16.227 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] Global test environment tear-down 2024-09-16T08:02:16.227 INFO:tasks.workunit.client.0.smithi115.stdout:[==========] 7 tests from 1 test suite ran. (132966 ms total) 2024-09-16T08:02:16.227 INFO:tasks.workunit.client.0.smithi115.stdout:[ PASSED ] 7 tests. 2024-09-16T08:02:16.336 INFO:tasks.workunit.client.0.smithi115.stdout:seed 51756 2024-09-16T08:02:16.336 INFO:tasks.workunit.client.0.smithi115.stdout:Note: Google Test filter = EncryptedFlattenTest/5.* 2024-09-16T08:02:16.336 INFO:tasks.workunit.client.0.smithi115.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-16T08:02:16.336 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] Global test environment set-up. 2024-09-16T08:02:16.336 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] 7 tests from EncryptedFlattenTest/5, where TypeParam = UnformattedLUKS2 2024-09-16T08:02:16.414 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] EncryptedFlattenTest/5.Simple 2024-09-16T08:02:18.236 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T08:02:34.804 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] EncryptedFlattenTest/5.Simple (18390 ms) 2024-09-16T08:02:34.805 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] EncryptedFlattenTest/5.Grow 2024-09-16T08:02:34.805 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T08:02:48.876 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] EncryptedFlattenTest/5.Grow (14072 ms) 2024-09-16T08:02:48.877 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] EncryptedFlattenTest/5.Shrink 2024-09-16T08:02:48.877 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T08:03:05.571 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] EncryptedFlattenTest/5.Shrink (16694 ms) 2024-09-16T08:03:05.571 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] EncryptedFlattenTest/5.ShrinkToOne 2024-09-16T08:03:05.571 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T08:03:19.499 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] EncryptedFlattenTest/5.ShrinkToOne (13928 ms) 2024-09-16T08:03:19.499 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] EncryptedFlattenTest/5.ShrinkToOneAfterSnapshot 2024-09-16T08:03:19.499 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T08:03:34.962 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] EncryptedFlattenTest/5.ShrinkToOneAfterSnapshot (15463 ms) 2024-09-16T08:03:34.962 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] EncryptedFlattenTest/5.MinOverlap 2024-09-16T08:03:34.962 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T08:03:49.496 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] EncryptedFlattenTest/5.MinOverlap (14534 ms) 2024-09-16T08:03:49.496 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] EncryptedFlattenTest/5.ZeroOverlap 2024-09-16T08:03:49.496 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T08:04:06.061 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] EncryptedFlattenTest/5.ZeroOverlap (16565 ms) 2024-09-16T08:04:06.220 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] 7 tests from EncryptedFlattenTest/5 (109647 ms total) 2024-09-16T08:04:06.220 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T08:04:06.220 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] Global test environment tear-down 2024-09-16T08:04:06.220 INFO:tasks.workunit.client.0.smithi115.stdout:[==========] 7 tests from 1 test suite ran. (109883 ms total) 2024-09-16T08:04:06.220 INFO:tasks.workunit.client.0.smithi115.stdout:[ PASSED ] 7 tests. 2024-09-16T08:04:06.318 INFO:tasks.workunit.client.0.smithi115.stdout:seed 57920 2024-09-16T08:04:06.318 INFO:tasks.workunit.client.0.smithi115.stdout:Note: Google Test filter = EncryptedFlattenTest/6.* 2024-09-16T08:04:06.318 INFO:tasks.workunit.client.0.smithi115.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-16T08:04:06.318 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] Global test environment set-up. 2024-09-16T08:04:06.318 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] 7 tests from EncryptedFlattenTest/6, where TypeParam = LUKS2UnderLUKS2 2024-09-16T08:04:06.409 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] EncryptedFlattenTest/6.Simple 2024-09-16T08:04:08.235 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T08:04:30.944 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] EncryptedFlattenTest/6.Simple (24533 ms) 2024-09-16T08:04:30.944 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] EncryptedFlattenTest/6.Grow 2024-09-16T08:04:30.944 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T08:04:57.531 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] EncryptedFlattenTest/6.Grow (26588 ms) 2024-09-16T08:04:57.531 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] EncryptedFlattenTest/6.Shrink 2024-09-16T08:04:57.531 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T08:05:19.797 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] EncryptedFlattenTest/6.Shrink (22266 ms) 2024-09-16T08:05:19.798 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] EncryptedFlattenTest/6.ShrinkToOne 2024-09-16T08:05:19.798 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T08:05:40.048 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] EncryptedFlattenTest/6.ShrinkToOne (20251 ms) 2024-09-16T08:05:40.048 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] EncryptedFlattenTest/6.ShrinkToOneAfterSnapshot 2024-09-16T08:05:40.049 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T08:06:00.965 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] EncryptedFlattenTest/6.ShrinkToOneAfterSnapshot (20917 ms) 2024-09-16T08:06:00.966 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] EncryptedFlattenTest/6.MinOverlap 2024-09-16T08:06:00.966 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T08:06:20.237 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] EncryptedFlattenTest/6.MinOverlap (19271 ms) 2024-09-16T08:06:20.238 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] EncryptedFlattenTest/6.ZeroOverlap 2024-09-16T08:06:20.238 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T08:06:39.765 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] EncryptedFlattenTest/6.ZeroOverlap (19528 ms) 2024-09-16T08:06:40.220 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] 7 tests from EncryptedFlattenTest/6 (153355 ms total) 2024-09-16T08:06:40.220 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T08:06:40.220 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] Global test environment tear-down 2024-09-16T08:06:40.220 INFO:tasks.workunit.client.0.smithi115.stdout:[==========] 7 tests from 1 test suite ran. (153901 ms total) 2024-09-16T08:06:40.220 INFO:tasks.workunit.client.0.smithi115.stdout:[ PASSED ] 7 tests. 2024-09-16T08:06:40.312 INFO:tasks.workunit.client.0.smithi115.stdout:seed 68330 2024-09-16T08:06:40.312 INFO:tasks.workunit.client.0.smithi115.stdout:Note: Google Test filter = EncryptedFlattenTest/7.* 2024-09-16T08:06:40.312 INFO:tasks.workunit.client.0.smithi115.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-16T08:06:40.312 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] Global test environment set-up. 2024-09-16T08:06:40.312 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] 7 tests from EncryptedFlattenTest/7, where TypeParam = LUKS2UnderLUKS1 2024-09-16T08:06:40.405 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] EncryptedFlattenTest/7.Simple 2024-09-16T08:06:42.227 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T08:07:06.483 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] EncryptedFlattenTest/7.Simple (26078 ms) 2024-09-16T08:07:06.483 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] EncryptedFlattenTest/7.Grow 2024-09-16T08:07:06.483 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T08:07:28.661 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] EncryptedFlattenTest/7.Grow (22178 ms) 2024-09-16T08:07:28.661 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] EncryptedFlattenTest/7.Shrink 2024-09-16T08:07:28.661 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T08:07:50.733 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] EncryptedFlattenTest/7.Shrink (22071 ms) 2024-09-16T08:07:50.734 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] EncryptedFlattenTest/7.ShrinkToOne 2024-09-16T08:07:50.734 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T08:08:12.370 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] EncryptedFlattenTest/7.ShrinkToOne (21638 ms) 2024-09-16T08:08:12.370 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] EncryptedFlattenTest/7.ShrinkToOneAfterSnapshot 2024-09-16T08:08:12.370 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T08:08:36.987 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] EncryptedFlattenTest/7.ShrinkToOneAfterSnapshot (24616 ms) 2024-09-16T08:08:36.987 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] EncryptedFlattenTest/7.MinOverlap 2024-09-16T08:08:36.987 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T08:09:03.121 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] EncryptedFlattenTest/7.MinOverlap (26135 ms) 2024-09-16T08:09:03.122 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] EncryptedFlattenTest/7.ZeroOverlap 2024-09-16T08:09:03.122 INFO:tasks.workunit.client.0.smithi115.stdout:using new format! 2024-09-16T08:09:25.361 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] EncryptedFlattenTest/7.ZeroOverlap (22240 ms) 2024-09-16T08:09:26.317 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] 7 tests from EncryptedFlattenTest/7 (164956 ms total) 2024-09-16T08:09:26.317 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T08:09:26.317 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] Global test environment tear-down 2024-09-16T08:09:26.317 INFO:tasks.workunit.client.0.smithi115.stdout:[==========] 7 tests from 1 test suite ran. (166005 ms total) 2024-09-16T08:09:26.317 INFO:tasks.workunit.client.0.smithi115.stdout:[ PASSED ] 7 tests. 2024-09-16T08:09:26.411 INFO:tasks.workunit.client.0.smithi115.stdout:seed 73807 2024-09-16T08:09:26.412 INFO:tasks.workunit.client.0.smithi115.stdout:Note: Google Test filter = TestImageWatcher.* 2024-09-16T08:09:26.412 INFO:tasks.workunit.client.0.smithi115.stdout:[==========] Running 17 tests from 1 test suite. 2024-09-16T08:09:26.412 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] Global test environment set-up. 2024-09-16T08:09:26.412 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] 17 tests from TestImageWatcher 2024-09-16T08:09:28.323 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestImageWatcher.NotifyHeaderUpdate 2024-09-16T08:09:30.587 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestImageWatcher.NotifyHeaderUpdate (2265 ms) 2024-09-16T08:09:30.587 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestImageWatcher.NotifyFlatten 2024-09-16T08:09:30.848 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestImageWatcher.NotifyFlatten (260 ms) 2024-09-16T08:09:30.848 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestImageWatcher.NotifyResize 2024-09-16T08:09:31.102 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestImageWatcher.NotifyResize (254 ms) 2024-09-16T08:09:31.103 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestImageWatcher.NotifyRebuildObjectMap 2024-09-16T08:09:31.357 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestImageWatcher.NotifyRebuildObjectMap (254 ms) 2024-09-16T08:09:31.357 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestImageWatcher.NotifyUpdateFeatures 2024-09-16T08:09:31.597 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestImageWatcher.NotifyUpdateFeatures (241 ms) 2024-09-16T08:09:31.598 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestImageWatcher.NotifySnapCreate 2024-09-16T08:09:31.847 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestImageWatcher.NotifySnapCreate (249 ms) 2024-09-16T08:09:31.847 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestImageWatcher.NotifySnapCreateError 2024-09-16T08:09:32.087 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestImageWatcher.NotifySnapCreateError (241 ms) 2024-09-16T08:09:32.087 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestImageWatcher.NotifySnapRename 2024-09-16T08:09:32.329 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestImageWatcher.NotifySnapRename (241 ms) 2024-09-16T08:09:32.329 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestImageWatcher.NotifySnapRenameError 2024-09-16T08:09:32.557 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestImageWatcher.NotifySnapRenameError (228 ms) 2024-09-16T08:09:32.557 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestImageWatcher.NotifySnapRemove 2024-09-16T08:09:32.800 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestImageWatcher.NotifySnapRemove (244 ms) 2024-09-16T08:09:32.801 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestImageWatcher.NotifySnapProtect 2024-09-16T08:09:33.042 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestImageWatcher.NotifySnapProtect (242 ms) 2024-09-16T08:09:33.042 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestImageWatcher.NotifySnapUnprotect 2024-09-16T08:09:33.285 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestImageWatcher.NotifySnapUnprotect (242 ms) 2024-09-16T08:09:33.285 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestImageWatcher.NotifyRename 2024-09-16T08:09:33.524 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestImageWatcher.NotifyRename (239 ms) 2024-09-16T08:09:33.524 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestImageWatcher.NotifyAsyncTimedOut 2024-09-16T08:09:33.760 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestImageWatcher.NotifyAsyncTimedOut (235 ms) 2024-09-16T08:09:33.760 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestImageWatcher.NotifyAsyncError 2024-09-16T08:09:33.988 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestImageWatcher.NotifyAsyncError (228 ms) 2024-09-16T08:09:33.988 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestImageWatcher.NotifyAsyncCompleteError 2024-09-16T08:09:34.221 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestImageWatcher.NotifyAsyncCompleteError (234 ms) 2024-09-16T08:09:34.221 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestImageWatcher.NotifyAsyncRequestTimedOut 2024-09-16T08:09:34.462 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestImageWatcher.NotifyAsyncRequestTimedOut (240 ms) 2024-09-16T08:09:35.347 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] 17 tests from TestImageWatcher (6139 ms total) 2024-09-16T08:09:35.347 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T08:09:35.347 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] Global test environment tear-down 2024-09-16T08:09:35.347 INFO:tasks.workunit.client.0.smithi115.stdout:[==========] 17 tests from 1 test suite ran. (8935 ms total) 2024-09-16T08:09:35.348 INFO:tasks.workunit.client.0.smithi115.stdout:[ PASSED ] 17 tests. 2024-09-16T08:09:35.433 INFO:tasks.workunit.client.0.smithi115.stdout:seed 73873 2024-09-16T08:09:35.434 INFO:tasks.workunit.client.0.smithi115.stdout:Note: Google Test filter = TestInternal.* 2024-09-16T08:09:35.434 INFO:tasks.workunit.client.0.smithi115.stdout:[==========] Running 34 tests from 1 test suite. 2024-09-16T08:09:35.434 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] Global test environment set-up. 2024-09-16T08:09:35.434 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] 34 tests from TestInternal 2024-09-16T08:09:37.353 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestInternal.OpenByID 2024-09-16T08:09:39.643 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestInternal.OpenByID (2290 ms) 2024-09-16T08:09:39.643 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestInternal.OpenSnapDNE 2024-09-16T08:09:39.882 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestInternal.OpenSnapDNE (238 ms) 2024-09-16T08:09:39.882 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestInternal.IsExclusiveLockOwner 2024-09-16T08:09:40.143 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestInternal.IsExclusiveLockOwner (262 ms) 2024-09-16T08:09:40.143 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestInternal.ResizeLocksImage 2024-09-16T08:09:40.416 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestInternal.ResizeLocksImage (273 ms) 2024-09-16T08:09:40.416 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestInternal.ResizeFailsToLockImage 2024-09-16T08:09:40.607 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestInternal.ResizeFailsToLockImage (192 ms) 2024-09-16T08:09:40.608 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestInternal.SnapCreateLocksImage 2024-09-16T08:09:42.485 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestInternal.SnapCreateLocksImage (1877 ms) 2024-09-16T08:09:42.485 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestInternal.SnapCreateFailsToLockImage 2024-09-16T08:09:42.697 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestInternal.SnapCreateFailsToLockImage (213 ms) 2024-09-16T08:09:42.697 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestInternal.SnapRollbackLocksImage 2024-09-16T08:09:44.536 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestInternal.SnapRollbackLocksImage (1839 ms) 2024-09-16T08:09:44.537 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestInternal.SnapRollbackFailsToLockImage 2024-09-16T08:09:46.519 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestInternal.SnapRollbackFailsToLockImage (1982 ms) 2024-09-16T08:09:46.519 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestInternal.SnapSetReleasesLock 2024-09-16T08:09:48.370 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestInternal.SnapSetReleasesLock (1852 ms) 2024-09-16T08:09:48.371 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestInternal.FlattenLocksImage 2024-09-16T08:09:51.582 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestInternal.FlattenLocksImage (3211 ms) 2024-09-16T08:09:51.582 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestInternal.FlattenFailsToLockImage 2024-09-16T08:09:54.557 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestInternal.FlattenFailsToLockImage (2976 ms) 2024-09-16T08:09:54.558 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestInternal.WriteFailsToLockImageBlocklisted 2024-09-16T08:09:54.634 INFO:tasks.workunit.client.0.smithi115.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:382: Skipped 2024-09-16T08:09:54.634 INFO:tasks.workunit.client.0.smithi115.stdout:Not supported by crimson yet. Skipped 2024-09-16T08:09:54.634 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestInternal.WriteFailsToLockImageBlocklisted (76 ms) 2024-09-16T08:09:54.634 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestInternal.WriteFailsToLockImageBlocklistedWatch 2024-09-16T08:09:54.709 INFO:tasks.workunit.client.0.smithi115.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:416: Skipped 2024-09-16T08:09:54.709 INFO:tasks.workunit.client.0.smithi115.stdout:Not supported by crimson yet. Skipped 2024-09-16T08:09:54.709 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestInternal.WriteFailsToLockImageBlocklistedWatch (73 ms) 2024-09-16T08:09:54.709 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestInternal.AioWriteRequestsLock 2024-09-16T08:09:55.014 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestInternal.AioWriteRequestsLock (308 ms) 2024-09-16T08:09:55.015 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestInternal.AioDiscardRequestsLock 2024-09-16T08:09:55.302 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestInternal.AioDiscardRequestsLock (288 ms) 2024-09-16T08:09:55.302 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestInternal.CancelAsyncResize 2024-09-16T08:09:55.835 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestInternal.CancelAsyncResize (532 ms) 2024-09-16T08:09:55.835 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestInternal.MultipleResize 2024-09-16T08:09:56.575 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestInternal.MultipleResize (741 ms) 2024-09-16T08:09:56.575 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestInternal.Metadata 2024-09-16T08:09:57.227 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestInternal.Metadata (651 ms) 2024-09-16T08:09:57.227 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestInternal.MetadataConfApply 2024-09-16T08:09:57.583 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestInternal.MetadataConfApply (356 ms) 2024-09-16T08:09:57.583 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestInternal.SnapshotCopyup 2024-09-16T08:09:57.657 INFO:tasks.workunit.client.0.smithi115.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:662: Skipped 2024-09-16T08:09:57.657 INFO:tasks.workunit.client.0.smithi115.stdout:Not supported by crimson yet. Skipped 2024-09-16T08:09:57.657 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestInternal.SnapshotCopyup (74 ms) 2024-09-16T08:09:57.657 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestInternal.SnapshotCopyupZeros 2024-09-16T08:09:59.216 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestInternal.SnapshotCopyupZeros (1560 ms) 2024-09-16T08:09:59.217 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestInternal.SnapshotCopyupZerosMigration 2024-09-16T08:10:01.197 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestInternal.SnapshotCopyupZerosMigration (1981 ms) 2024-09-16T08:10:01.198 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestInternal.ResizeCopyup 2024-09-16T08:10:03.546 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestInternal.ResizeCopyup (2348 ms) 2024-09-16T08:10:03.546 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestInternal.DiscardCopyup 2024-09-16T08:10:03.617 INFO:tasks.workunit.client.0.smithi115.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:1055: Skipped 2024-09-16T08:10:03.617 INFO:tasks.workunit.client.0.smithi115.stdout:Skipping due to unmet REQUIRE 2024-09-16T08:10:03.618 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestInternal.DiscardCopyup (72 ms) 2024-09-16T08:10:03.618 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestInternal.ImageOptions 2024-09-16T08:10:03.692 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestInternal.ImageOptions (75 ms) 2024-09-16T08:10:03.692 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestInternal.WriteFullCopyup 2024-09-16T08:10:08.395 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestInternal.WriteFullCopyup (4702 ms) 2024-09-16T08:10:08.395 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestInternal.DiffIterateCloneOverwrite 2024-09-16T08:10:10.495 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestInternal.DiffIterateCloneOverwrite (2100 ms) 2024-09-16T08:10:10.495 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestInternal.TestCoR 2024-09-16T08:10:10.569 INFO:tasks.workunit.client.0.smithi115.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:1312: Skipped 2024-09-16T08:10:10.569 INFO:tasks.workunit.client.0.smithi115.stdout:Skipping due to disabled copy-on-read 2024-09-16T08:10:10.569 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestInternal.TestCoR (74 ms) 2024-09-16T08:10:10.569 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestInternal.FlattenNoEmptyObjects 2024-09-16T08:10:13.725 INFO:tasks.workunit.client.0.smithi115.stdout:made parent image "image39": 4194304K (1024 * 4K) 2024-09-16T08:10:13.725 INFO:tasks.workunit.client.0.smithi115.stdout:generated random write map: 2024-09-16T08:10:13.725 INFO:tasks.workunit.client.0.smithi115.stdout: [5 , 23891 ] 2024-09-16T08:10:13.725 INFO:tasks.workunit.client.0.smithi115.stdout: [7 , 30044 ] 2024-09-16T08:10:13.725 INFO:tasks.workunit.client.0.smithi115.stdout: [21 , 86718 ] 2024-09-16T08:10:13.726 INFO:tasks.workunit.client.0.smithi115.stdout: [28 , 116849 ] 2024-09-16T08:10:13.726 INFO:tasks.workunit.client.0.smithi115.stdout: [34 , 139849 ] 2024-09-16T08:10:13.726 INFO:tasks.workunit.client.0.smithi115.stdout: [39 , 161985 ] 2024-09-16T08:10:13.726 INFO:tasks.workunit.client.0.smithi115.stdout: [91 , 373738 ] 2024-09-16T08:10:13.726 INFO:tasks.workunit.client.0.smithi115.stdout: [100 , 409720 ] 2024-09-16T08:10:13.726 INFO:tasks.workunit.client.0.smithi115.stdout: [103 , 422426 ] 2024-09-16T08:10:13.726 INFO:tasks.workunit.client.0.smithi115.stdout: [107 , 439290 ] 2024-09-16T08:10:13.726 INFO:tasks.workunit.client.0.smithi115.stdout: [116 , 476297 ] 2024-09-16T08:10:13.726 INFO:tasks.workunit.client.0.smithi115.stdout: [136 , 559843 ] 2024-09-16T08:10:13.726 INFO:tasks.workunit.client.0.smithi115.stdout: [139 , 570167 ] 2024-09-16T08:10:13.726 INFO:tasks.workunit.client.0.smithi115.stdout: [148 , 609218 ] 2024-09-16T08:10:13.727 INFO:tasks.workunit.client.0.smithi115.stdout: [150 , 615552 ] 2024-09-16T08:10:13.727 INFO:tasks.workunit.client.0.smithi115.stdout: [154 , 633317 ] 2024-09-16T08:10:13.727 INFO:tasks.workunit.client.0.smithi115.stdout: [156 , 640740 ] 2024-09-16T08:10:13.727 INFO:tasks.workunit.client.0.smithi115.stdout: [198 , 812531 ] 2024-09-16T08:10:13.727 INFO:tasks.workunit.client.0.smithi115.stdout: [201 , 824816 ] 2024-09-16T08:10:13.727 INFO:tasks.workunit.client.0.smithi115.stdout: [208 , 853375 ] 2024-09-16T08:10:13.727 INFO:tasks.workunit.client.0.smithi115.stdout: [220 , 903505 ] 2024-09-16T08:10:13.727 INFO:tasks.workunit.client.0.smithi115.stdout: [228 , 936492 ] 2024-09-16T08:10:13.727 INFO:tasks.workunit.client.0.smithi115.stdout: [232 , 950376 ] 2024-09-16T08:10:13.727 INFO:tasks.workunit.client.0.smithi115.stdout: [236 , 967547 ] 2024-09-16T08:10:13.727 INFO:tasks.workunit.client.0.smithi115.stdout: [243 , 998541 ] 2024-09-16T08:10:13.727 INFO:tasks.workunit.client.0.smithi115.stdout: [244 , 1002559 ] 2024-09-16T08:10:13.727 INFO:tasks.workunit.client.0.smithi115.stdout: [248 , 1019201 ] 2024-09-16T08:10:13.728 INFO:tasks.workunit.client.0.smithi115.stdout: [249 , 1021436 ] 2024-09-16T08:10:13.728 INFO:tasks.workunit.client.0.smithi115.stdout: [269 , 1103646 ] 2024-09-16T08:10:13.728 INFO:tasks.workunit.client.0.smithi115.stdout: [298 , 1222409 ] 2024-09-16T08:10:13.728 INFO:tasks.workunit.client.0.smithi115.stdout: [301 , 1233601 ] 2024-09-16T08:10:13.728 INFO:tasks.workunit.client.0.smithi115.stdout: [314 , 1288156 ] 2024-09-16T08:10:13.728 INFO:tasks.workunit.client.0.smithi115.stdout: [319 , 1308269 ] 2024-09-16T08:10:13.728 INFO:tasks.workunit.client.0.smithi115.stdout: [331 , 1356343 ] 2024-09-16T08:10:13.728 INFO:tasks.workunit.client.0.smithi115.stdout: [332 , 1362801 ] 2024-09-16T08:10:13.728 INFO:tasks.workunit.client.0.smithi115.stdout: [337 , 1383123 ] 2024-09-16T08:10:13.728 INFO:tasks.workunit.client.0.smithi115.stdout: [355 , 1457071 ] 2024-09-16T08:10:13.728 INFO:tasks.workunit.client.0.smithi115.stdout: [357 , 1465226 ] 2024-09-16T08:10:13.728 INFO:tasks.workunit.client.0.smithi115.stdout: [369 , 1513205 ] 2024-09-16T08:10:13.728 INFO:tasks.workunit.client.0.smithi115.stdout: [375 , 1539544 ] 2024-09-16T08:10:13.729 INFO:tasks.workunit.client.0.smithi115.stdout: [394 , 1614677 ] 2024-09-16T08:10:13.729 INFO:tasks.workunit.client.0.smithi115.stdout: [402 , 1648600 ] 2024-09-16T08:10:13.729 INFO:tasks.workunit.client.0.smithi115.stdout: [427 , 1751221 ] 2024-09-16T08:10:13.729 INFO:tasks.workunit.client.0.smithi115.stdout: [439 , 1800736 ] 2024-09-16T08:10:13.729 INFO:tasks.workunit.client.0.smithi115.stdout: [441 , 1809345 ] 2024-09-16T08:10:13.729 INFO:tasks.workunit.client.0.smithi115.stdout: [451 , 1847684 ] 2024-09-16T08:10:13.729 INFO:tasks.workunit.client.0.smithi115.stdout: [463 , 1898022 ] 2024-09-16T08:10:13.729 INFO:tasks.workunit.client.0.smithi115.stdout: [475 , 1948259 ] 2024-09-16T08:10:13.729 INFO:tasks.workunit.client.0.smithi115.stdout: [495 , 2028488 ] 2024-09-16T08:10:13.729 INFO:tasks.workunit.client.0.smithi115.stdout: [540 , 2212855 ] 2024-09-16T08:10:13.729 INFO:tasks.workunit.client.0.smithi115.stdout: [549 , 2250889 ] 2024-09-16T08:10:13.729 INFO:tasks.workunit.client.0.smithi115.stdout: [554 , 2272129 ] 2024-09-16T08:10:13.729 INFO:tasks.workunit.client.0.smithi115.stdout: [564 , 2312827 ] 2024-09-16T08:10:13.729 INFO:tasks.workunit.client.0.smithi115.stdout: [580 , 2377992 ] 2024-09-16T08:10:13.730 INFO:tasks.workunit.client.0.smithi115.stdout: [582 , 2385560 ] 2024-09-16T08:10:13.730 INFO:tasks.workunit.client.0.smithi115.stdout: [585 , 2396927 ] 2024-09-16T08:10:13.730 INFO:tasks.workunit.client.0.smithi115.stdout: [592 , 2425367 ] 2024-09-16T08:10:13.730 INFO:tasks.workunit.client.0.smithi115.stdout: [600 , 2459791 ] 2024-09-16T08:10:13.730 INFO:tasks.workunit.client.0.smithi115.stdout: [607 , 2486406 ] 2024-09-16T08:10:13.730 INFO:tasks.workunit.client.0.smithi115.stdout: [611 , 2502965 ] 2024-09-16T08:10:13.730 INFO:tasks.workunit.client.0.smithi115.stdout: [615 , 2519449 ] 2024-09-16T08:10:13.730 INFO:tasks.workunit.client.0.smithi115.stdout: [659 , 2701435 ] 2024-09-16T08:10:13.730 INFO:tasks.workunit.client.0.smithi115.stdout: [683 , 2800010 ] 2024-09-16T08:10:13.730 INFO:tasks.workunit.client.0.smithi115.stdout: [684 , 2803199 ] 2024-09-16T08:10:13.730 INFO:tasks.workunit.client.0.smithi115.stdout: [700 , 2869991 ] 2024-09-16T08:10:13.730 INFO:tasks.workunit.client.0.smithi115.stdout: [701 , 2873792 ] 2024-09-16T08:10:13.730 INFO:tasks.workunit.client.0.smithi115.stdout: [707 , 2897288 ] 2024-09-16T08:10:13.730 INFO:tasks.workunit.client.0.smithi115.stdout: [723 , 2963615 ] 2024-09-16T08:10:13.731 INFO:tasks.workunit.client.0.smithi115.stdout: [728 , 2984613 ] 2024-09-16T08:10:13.731 INFO:tasks.workunit.client.0.smithi115.stdout: [753 , 3086494 ] 2024-09-16T08:10:13.731 INFO:tasks.workunit.client.0.smithi115.stdout: [770 , 3156913 ] 2024-09-16T08:10:13.731 INFO:tasks.workunit.client.0.smithi115.stdout: [796 , 3263611 ] 2024-09-16T08:10:13.731 INFO:tasks.workunit.client.0.smithi115.stdout: [797 , 3266251 ] 2024-09-16T08:10:13.731 INFO:tasks.workunit.client.0.smithi115.stdout: [806 , 3301570 ] 2024-09-16T08:10:13.731 INFO:tasks.workunit.client.0.smithi115.stdout: [818 , 3351813 ] 2024-09-16T08:10:13.731 INFO:tasks.workunit.client.0.smithi115.stdout: [826 , 3385618 ] 2024-09-16T08:10:13.731 INFO:tasks.workunit.client.0.smithi115.stdout: [828 , 3391758 ] 2024-09-16T08:10:13.731 INFO:tasks.workunit.client.0.smithi115.stdout: [845 , 3463251 ] 2024-09-16T08:10:13.731 INFO:tasks.workunit.client.0.smithi115.stdout: [847 , 3469961 ] 2024-09-16T08:10:13.731 INFO:tasks.workunit.client.0.smithi115.stdout: [862 , 3530950 ] 2024-09-16T08:10:13.731 INFO:tasks.workunit.client.0.smithi115.stdout: [876 , 3589083 ] 2024-09-16T08:10:13.731 INFO:tasks.workunit.client.0.smithi115.stdout: [888 , 3637560 ] 2024-09-16T08:10:13.732 INFO:tasks.workunit.client.0.smithi115.stdout: [905 , 3709918 ] 2024-09-16T08:10:13.732 INFO:tasks.workunit.client.0.smithi115.stdout: [929 , 3807360 ] 2024-09-16T08:10:13.732 INFO:tasks.workunit.client.0.smithi115.stdout: [932 , 3818899 ] 2024-09-16T08:10:13.732 INFO:tasks.workunit.client.0.smithi115.stdout: [936 , 3835311 ] 2024-09-16T08:10:13.732 INFO:tasks.workunit.client.0.smithi115.stdout: [969 , 3970569 ] 2024-09-16T08:10:13.732 INFO:tasks.workunit.client.0.smithi115.stdout: [972 , 3984270 ] 2024-09-16T08:10:13.732 INFO:tasks.workunit.client.0.smithi115.stdout: [973 , 3985763 ] 2024-09-16T08:10:13.732 INFO:tasks.workunit.client.0.smithi115.stdout: [979 , 4010711 ] 2024-09-16T08:10:13.732 INFO:tasks.workunit.client.0.smithi115.stdout: [980 , 4014489 ] 2024-09-16T08:10:13.732 INFO:tasks.workunit.client.0.smithi115.stdout: [988 , 4049965 ] 2024-09-16T08:10:13.732 INFO:tasks.workunit.client.0.smithi115.stdout: [1014 , 4154695 ] 2024-09-16T08:10:13.732 INFO:tasks.workunit.client.0.smithi115.stdout:write data based on random map 2024-09-16T08:10:13.732 INFO:tasks.workunit.client.0.smithi115.stdout: write object-5 2024-09-16T08:10:13.732 INFO:tasks.workunit.client.0.smithi115.stdout: write object-7 2024-09-16T08:10:13.733 INFO:tasks.workunit.client.0.smithi115.stdout: write object-21 2024-09-16T08:10:13.733 INFO:tasks.workunit.client.0.smithi115.stdout: write object-28 2024-09-16T08:10:13.733 INFO:tasks.workunit.client.0.smithi115.stdout: write object-34 2024-09-16T08:10:13.733 INFO:tasks.workunit.client.0.smithi115.stdout: write object-39 2024-09-16T08:10:13.733 INFO:tasks.workunit.client.0.smithi115.stdout: write object-91 2024-09-16T08:10:13.733 INFO:tasks.workunit.client.0.smithi115.stdout: write object-100 2024-09-16T08:10:13.733 INFO:tasks.workunit.client.0.smithi115.stdout: write object-103 2024-09-16T08:10:13.733 INFO:tasks.workunit.client.0.smithi115.stdout: write object-107 2024-09-16T08:10:13.733 INFO:tasks.workunit.client.0.smithi115.stdout: write object-116 2024-09-16T08:10:13.733 INFO:tasks.workunit.client.0.smithi115.stdout: write object-136 2024-09-16T08:10:13.733 INFO:tasks.workunit.client.0.smithi115.stdout: write object-139 2024-09-16T08:10:13.733 INFO:tasks.workunit.client.0.smithi115.stdout: write object-148 2024-09-16T08:10:13.733 INFO:tasks.workunit.client.0.smithi115.stdout: write object-150 2024-09-16T08:10:13.733 INFO:tasks.workunit.client.0.smithi115.stdout: write object-154 2024-09-16T08:10:13.734 INFO:tasks.workunit.client.0.smithi115.stdout: write object-156 2024-09-16T08:10:13.734 INFO:tasks.workunit.client.0.smithi115.stdout: write object-198 2024-09-16T08:10:13.734 INFO:tasks.workunit.client.0.smithi115.stdout: write object-201 2024-09-16T08:10:13.734 INFO:tasks.workunit.client.0.smithi115.stdout: write object-208 2024-09-16T08:10:13.734 INFO:tasks.workunit.client.0.smithi115.stdout: write object-220 2024-09-16T08:10:13.734 INFO:tasks.workunit.client.0.smithi115.stdout: write object-228 2024-09-16T08:10:13.734 INFO:tasks.workunit.client.0.smithi115.stdout: write object-232 2024-09-16T08:10:13.734 INFO:tasks.workunit.client.0.smithi115.stdout: write object-236 2024-09-16T08:10:13.734 INFO:tasks.workunit.client.0.smithi115.stdout: write object-243 2024-09-16T08:10:13.734 INFO:tasks.workunit.client.0.smithi115.stdout: write object-244 2024-09-16T08:10:13.734 INFO:tasks.workunit.client.0.smithi115.stdout: write object-248 2024-09-16T08:10:13.734 INFO:tasks.workunit.client.0.smithi115.stdout: write object-249 2024-09-16T08:10:13.734 INFO:tasks.workunit.client.0.smithi115.stdout: write object-269 2024-09-16T08:10:13.735 INFO:tasks.workunit.client.0.smithi115.stdout: write object-298 2024-09-16T08:10:13.735 INFO:tasks.workunit.client.0.smithi115.stdout: write object-301 2024-09-16T08:10:13.735 INFO:tasks.workunit.client.0.smithi115.stdout: write object-314 2024-09-16T08:10:13.735 INFO:tasks.workunit.client.0.smithi115.stdout: write object-319 2024-09-16T08:10:13.735 INFO:tasks.workunit.client.0.smithi115.stdout: write object-331 2024-09-16T08:10:13.735 INFO:tasks.workunit.client.0.smithi115.stdout: write object-332 2024-09-16T08:10:13.735 INFO:tasks.workunit.client.0.smithi115.stdout: write object-337 2024-09-16T08:10:13.735 INFO:tasks.workunit.client.0.smithi115.stdout: write object-355 2024-09-16T08:10:13.735 INFO:tasks.workunit.client.0.smithi115.stdout: write object-357 2024-09-16T08:10:13.736 INFO:tasks.workunit.client.0.smithi115.stdout: write object-369 2024-09-16T08:10:13.736 INFO:tasks.workunit.client.0.smithi115.stdout: write object-375 2024-09-16T08:10:13.736 INFO:tasks.workunit.client.0.smithi115.stdout: write object-394 2024-09-16T08:10:13.736 INFO:tasks.workunit.client.0.smithi115.stdout: write object-402 2024-09-16T08:10:13.736 INFO:tasks.workunit.client.0.smithi115.stdout: write object-427 2024-09-16T08:10:13.736 INFO:tasks.workunit.client.0.smithi115.stdout: write object-439 2024-09-16T08:10:13.736 INFO:tasks.workunit.client.0.smithi115.stdout: write object-441 2024-09-16T08:10:13.736 INFO:tasks.workunit.client.0.smithi115.stdout: write object-451 2024-09-16T08:10:13.736 INFO:tasks.workunit.client.0.smithi115.stdout: write object-463 2024-09-16T08:10:13.736 INFO:tasks.workunit.client.0.smithi115.stdout: write object-475 2024-09-16T08:10:13.736 INFO:tasks.workunit.client.0.smithi115.stdout: write object-495 2024-09-16T08:10:13.736 INFO:tasks.workunit.client.0.smithi115.stdout: write object-540 2024-09-16T08:10:13.737 INFO:tasks.workunit.client.0.smithi115.stdout: write object-549 2024-09-16T08:10:13.737 INFO:tasks.workunit.client.0.smithi115.stdout: write object-554 2024-09-16T08:10:13.737 INFO:tasks.workunit.client.0.smithi115.stdout: write object-564 2024-09-16T08:10:13.737 INFO:tasks.workunit.client.0.smithi115.stdout: write object-580 2024-09-16T08:10:13.737 INFO:tasks.workunit.client.0.smithi115.stdout: write object-582 2024-09-16T08:10:13.737 INFO:tasks.workunit.client.0.smithi115.stdout: write object-585 2024-09-16T08:10:13.737 INFO:tasks.workunit.client.0.smithi115.stdout: write object-592 2024-09-16T08:10:13.737 INFO:tasks.workunit.client.0.smithi115.stdout: write object-600 2024-09-16T08:10:13.737 INFO:tasks.workunit.client.0.smithi115.stdout: write object-607 2024-09-16T08:10:13.737 INFO:tasks.workunit.client.0.smithi115.stdout: write object-611 2024-09-16T08:10:13.737 INFO:tasks.workunit.client.0.smithi115.stdout: write object-615 2024-09-16T08:10:13.737 INFO:tasks.workunit.client.0.smithi115.stdout: write object-659 2024-09-16T08:10:13.738 INFO:tasks.workunit.client.0.smithi115.stdout: write object-683 2024-09-16T08:10:13.738 INFO:tasks.workunit.client.0.smithi115.stdout: write object-684 2024-09-16T08:10:13.738 INFO:tasks.workunit.client.0.smithi115.stdout: write object-700 2024-09-16T08:10:13.738 INFO:tasks.workunit.client.0.smithi115.stdout: write object-701 2024-09-16T08:10:13.738 INFO:tasks.workunit.client.0.smithi115.stdout: write object-707 2024-09-16T08:10:13.738 INFO:tasks.workunit.client.0.smithi115.stdout: write object-723 2024-09-16T08:10:13.738 INFO:tasks.workunit.client.0.smithi115.stdout: write object-728 2024-09-16T08:10:13.738 INFO:tasks.workunit.client.0.smithi115.stdout: write object-753 2024-09-16T08:10:13.738 INFO:tasks.workunit.client.0.smithi115.stdout: write object-770 2024-09-16T08:10:13.738 INFO:tasks.workunit.client.0.smithi115.stdout: write object-796 2024-09-16T08:10:13.738 INFO:tasks.workunit.client.0.smithi115.stdout: write object-797 2024-09-16T08:10:13.738 INFO:tasks.workunit.client.0.smithi115.stdout: write object-806 2024-09-16T08:10:13.738 INFO:tasks.workunit.client.0.smithi115.stdout: write object-818 2024-09-16T08:10:13.738 INFO:tasks.workunit.client.0.smithi115.stdout: write object-826 2024-09-16T08:10:13.738 INFO:tasks.workunit.client.0.smithi115.stdout: write object-828 2024-09-16T08:10:13.739 INFO:tasks.workunit.client.0.smithi115.stdout: write object-845 2024-09-16T08:10:13.739 INFO:tasks.workunit.client.0.smithi115.stdout: write object-847 2024-09-16T08:10:13.739 INFO:tasks.workunit.client.0.smithi115.stdout: write object-862 2024-09-16T08:10:13.739 INFO:tasks.workunit.client.0.smithi115.stdout: write object-876 2024-09-16T08:10:13.739 INFO:tasks.workunit.client.0.smithi115.stdout: write object-888 2024-09-16T08:10:13.739 INFO:tasks.workunit.client.0.smithi115.stdout: write object-905 2024-09-16T08:10:13.739 INFO:tasks.workunit.client.0.smithi115.stdout: write object-929 2024-09-16T08:10:13.739 INFO:tasks.workunit.client.0.smithi115.stdout: write object-932 2024-09-16T08:10:13.739 INFO:tasks.workunit.client.0.smithi115.stdout: write object-936 2024-09-16T08:10:13.739 INFO:tasks.workunit.client.0.smithi115.stdout: write object-969 2024-09-16T08:10:13.739 INFO:tasks.workunit.client.0.smithi115.stdout: write object-972 2024-09-16T08:10:13.739 INFO:tasks.workunit.client.0.smithi115.stdout: write object-973 2024-09-16T08:10:13.739 INFO:tasks.workunit.client.0.smithi115.stdout: write object-979 2024-09-16T08:10:13.739 INFO:tasks.workunit.client.0.smithi115.stdout: write object-980 2024-09-16T08:10:13.740 INFO:tasks.workunit.client.0.smithi115.stdout: write object-988 2024-09-16T08:10:17.249 INFO:tasks.workunit.client.0.smithi115.stdout: write object-1014 2024-09-16T08:10:17.249 INFO:tasks.workunit.client.0.smithi115.stdout:verify written data by reading 2024-09-16T08:10:17.249 INFO:tasks.workunit.client.0.smithi115.stdout: read object-5 2024-09-16T08:10:17.249 INFO:tasks.workunit.client.0.smithi115.stdout:made snapshot "image39@parent_snap" and protect it 2024-09-16T08:10:17.249 INFO:tasks.workunit.client.0.smithi115.stdout:made and opened clone "image40" 2024-09-16T08:10:17.249 INFO:tasks.workunit.client.0.smithi115.stdout:flattening clone: "image40" 2024-09-16T08:10:17.249 INFO:tasks.workunit.client.0.smithi115.stdout:check whether child image has the same set of objects as parent 2024-09-16T08:10:17.249 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestInternal.FlattenNoEmptyObjects (6680 ms) 2024-09-16T08:10:17.249 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestInternal.PoolMetadataConfApply 2024-09-16T08:10:18.076 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestInternal.PoolMetadataConfApply (828 ms) 2024-09-16T08:10:18.077 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestInternal.Sparsify 2024-09-16T08:10:18.340 INFO:tasks.workunit.client.0.smithi115.stdout:sparsify_supported=1 2024-09-16T08:10:18.341 INFO:tasks.workunit.client.0.smithi115.stdout:sparse_read_supported=1 2024-09-16T08:10:18.767 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestInternal.Sparsify (690 ms) 2024-09-16T08:10:18.767 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestInternal.SparsifyClone 2024-09-16T08:10:18.956 INFO:tasks.workunit.client.0.smithi115.stdout:sparsify_supported=1 2024-09-16T08:10:21.717 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestInternal.SparsifyClone (2950 ms) 2024-09-16T08:10:21.718 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestInternal.MissingDataPool 2024-09-16T08:10:23.913 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestInternal.MissingDataPool (2197 ms) 2024-09-16T08:10:24.605 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] 34 tests from TestInternal (46561 ms total) 2024-09-16T08:10:24.605 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T08:10:24.605 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] Global test environment tear-down 2024-09-16T08:10:24.605 INFO:tasks.workunit.client.0.smithi115.stdout:[==========] 34 tests from 1 test suite ran. (49171 ms total) 2024-09-16T08:10:24.605 INFO:tasks.workunit.client.0.smithi115.stdout:[ PASSED ] 29 tests. 2024-09-16T08:10:24.605 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] 5 tests, listed below: 2024-09-16T08:10:24.605 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestInternal.WriteFailsToLockImageBlocklisted 2024-09-16T08:10:24.606 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestInternal.WriteFailsToLockImageBlocklistedWatch 2024-09-16T08:10:24.606 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestInternal.SnapshotCopyup 2024-09-16T08:10:24.606 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestInternal.DiscardCopyup 2024-09-16T08:10:24.606 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestInternal.TestCoR 2024-09-16T08:10:24.695 INFO:tasks.workunit.client.0.smithi115.stdout:seed 73939 2024-09-16T08:10:24.695 INFO:tasks.workunit.client.0.smithi115.stdout:Note: Google Test filter = TestMirroring.* 2024-09-16T08:10:24.696 INFO:tasks.workunit.client.0.smithi115.stdout:[==========] Running 51 tests from 1 test suite. 2024-09-16T08:10:24.696 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] Global test environment set-up. 2024-09-16T08:10:24.696 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] 51 tests from TestMirroring 2024-09-16T08:10:26.615 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModeImage 2024-09-16T08:10:29.882 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModeImage (3268 ms) 2024-09-16T08:10:29.882 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModePool 2024-09-16T08:10:31.242 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModePool (1359 ms) 2024-09-16T08:10:31.242 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModeDisabled 2024-09-16T08:10:32.283 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModeDisabled (1041 ms) 2024-09-16T08:10:32.283 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestMirroring.DisableImageMirror_In_MirrorModeImage 2024-09-16T08:10:33.687 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestMirroring.DisableImageMirror_In_MirrorModeImage (1405 ms) 2024-09-16T08:10:33.687 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestMirroring.DisableImageMirror_In_MirrorModeImage_NoObjectMap 2024-09-16T08:10:34.955 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestMirroring.DisableImageMirror_In_MirrorModeImage_NoObjectMap (1267 ms) 2024-09-16T08:10:34.955 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestMirroring.DisableImageMirror_In_MirrorModePool 2024-09-16T08:10:36.244 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestMirroring.DisableImageMirror_In_MirrorModePool (1289 ms) 2024-09-16T08:10:36.244 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestMirroring.DisableImageMirror_In_MirrorModeDisabled 2024-09-16T08:10:37.697 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestMirroring.DisableImageMirror_In_MirrorModeDisabled (1452 ms) 2024-09-16T08:10:37.698 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestMirroring.DisableImageMirrorWithPeer 2024-09-16T08:10:37.698 INFO:tasks.workunit.client.0.smithi115.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_mirroring.cc:482: Skipped 2024-09-16T08:10:37.698 INFO:tasks.workunit.client.0.smithi115.stdout:Skipping due to unmet REQUIRE 2024-09-16T08:10:37.698 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestMirroring.DisableImageMirrorWithPeer (0 ms) 2024-09-16T08:10:37.698 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestMirroring.DisableJournalingWithPeer 2024-09-16T08:10:37.699 INFO:tasks.workunit.client.0.smithi115.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_mirroring.cc:520: Skipped 2024-09-16T08:10:37.699 INFO:tasks.workunit.client.0.smithi115.stdout:Skipping due to unmet REQUIRE 2024-09-16T08:10:37.699 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestMirroring.DisableJournalingWithPeer (0 ms) 2024-09-16T08:10:37.699 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModeDisabled_WithoutJournaling 2024-09-16T08:10:38.564 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModeDisabled_WithoutJournaling (868 ms) 2024-09-16T08:10:38.564 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModePool_WithoutJournaling 2024-09-16T08:10:39.560 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModePool_WithoutJournaling (995 ms) 2024-09-16T08:10:39.560 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModeImage_WithoutJournaling 2024-09-16T08:10:41.748 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModeImage_WithoutJournaling (2189 ms) 2024-09-16T08:10:41.749 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModeImage_WithoutExclusiveLock 2024-09-16T08:10:43.650 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModeImage_WithoutExclusiveLock (1901 ms) 2024-09-16T08:10:43.650 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestMirroring.CreateImage_In_MirrorModeDisabled 2024-09-16T08:10:44.763 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestMirroring.CreateImage_In_MirrorModeDisabled (1113 ms) 2024-09-16T08:10:44.763 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestMirroring.CreateImage_In_MirrorModeImage 2024-09-16T08:10:45.884 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestMirroring.CreateImage_In_MirrorModeImage (1121 ms) 2024-09-16T08:10:45.884 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestMirroring.CreateImage_In_MirrorModePool 2024-09-16T08:10:47.220 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestMirroring.CreateImage_In_MirrorModePool (1337 ms) 2024-09-16T08:10:47.221 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestMirroring.CreateImage_In_MirrorModePool_WithoutJournaling 2024-09-16T08:10:48.289 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestMirroring.CreateImage_In_MirrorModePool_WithoutJournaling (1068 ms) 2024-09-16T08:10:48.289 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestMirroring.CreateImage_In_MirrorModeImage_WithoutJournaling 2024-09-16T08:10:49.284 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestMirroring.CreateImage_In_MirrorModeImage_WithoutJournaling (996 ms) 2024-09-16T08:10:49.284 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestMirroring.EnableJournaling_In_MirrorModeDisabled 2024-09-16T08:10:50.516 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestMirroring.EnableJournaling_In_MirrorModeDisabled (1232 ms) 2024-09-16T08:10:50.516 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestMirroring.EnableJournaling_In_MirrorModeImage 2024-09-16T08:10:51.861 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestMirroring.EnableJournaling_In_MirrorModeImage (1345 ms) 2024-09-16T08:10:51.861 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestMirroring.EnableJournaling_In_MirrorModeImage_SnapshotMirroringEnabled 2024-09-16T08:10:54.940 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestMirroring.EnableJournaling_In_MirrorModeImage_SnapshotMirroringEnabled (3078 ms) 2024-09-16T08:10:54.940 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestMirroring.EnableJournaling_In_MirrorModePool 2024-09-16T08:10:56.380 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestMirroring.EnableJournaling_In_MirrorModePool (1440 ms) 2024-09-16T08:10:56.380 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestMirroring.DisableJournaling_In_MirrorModePool 2024-09-16T08:10:57.733 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestMirroring.DisableJournaling_In_MirrorModePool (1354 ms) 2024-09-16T08:10:57.733 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestMirroring.DisableJournaling_In_MirrorModeImage 2024-09-16T08:10:59.090 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestMirroring.DisableJournaling_In_MirrorModeImage (1356 ms) 2024-09-16T08:10:59.090 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestMirroring.MirrorModeSet_DisabledMode_To_PoolMode 2024-09-16T08:11:01.052 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestMirroring.MirrorModeSet_DisabledMode_To_PoolMode (1962 ms) 2024-09-16T08:11:01.052 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestMirroring.MirrorModeSet_PoolMode_To_DisabledMode 2024-09-16T08:11:03.035 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestMirroring.MirrorModeSet_PoolMode_To_DisabledMode (1983 ms) 2024-09-16T08:11:03.035 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestMirroring.MirrorModeSet_DisabledMode_To_ImageMode 2024-09-16T08:11:04.753 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestMirroring.MirrorModeSet_DisabledMode_To_ImageMode (1718 ms) 2024-09-16T08:11:04.753 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestMirroring.MirrorModeSet_PoolMode_To_ImageMode 2024-09-16T08:11:06.559 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestMirroring.MirrorModeSet_PoolMode_To_ImageMode (1807 ms) 2024-09-16T08:11:06.560 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestMirroring.MirrorModeSet_ImageMode_To_PoolMode 2024-09-16T08:11:08.519 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestMirroring.MirrorModeSet_ImageMode_To_PoolMode (1960 ms) 2024-09-16T08:11:08.519 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestMirroring.MirrorModeSet_ImageMode_To_DisabledMode 2024-09-16T08:11:10.701 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestMirroring.MirrorModeSet_ImageMode_To_DisabledMode (2182 ms) 2024-09-16T08:11:10.702 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestMirroring.RemoveImage_With_MirrorImageEnabled 2024-09-16T08:11:11.745 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestMirroring.RemoveImage_With_MirrorImageEnabled (1043 ms) 2024-09-16T08:11:11.745 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestMirroring.RemoveImage_With_MirrorImageDisabled 2024-09-16T08:11:12.728 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestMirroring.RemoveImage_With_MirrorImageDisabled (984 ms) 2024-09-16T08:11:12.729 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestMirroring.RemoveImage_With_ImageWithoutJournal 2024-09-16T08:11:13.530 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestMirroring.RemoveImage_With_ImageWithoutJournal (802 ms) 2024-09-16T08:11:13.531 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestMirroring.RemoveImage_With_MirrorImageDemoted 2024-09-16T08:11:15.219 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestMirroring.RemoveImage_With_MirrorImageDemoted (1688 ms) 2024-09-16T08:11:15.219 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestMirroring.TrashMoveRestore_PoolMode 2024-09-16T08:11:16.800 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestMirroring.TrashMoveRestore_PoolMode (1582 ms) 2024-09-16T08:11:16.801 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestMirroring.TrashMoveRestore_ImageMode_MirroringDisabled 2024-09-16T08:11:18.145 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestMirroring.TrashMoveRestore_ImageMode_MirroringDisabled (1345 ms) 2024-09-16T08:11:18.146 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestMirroring.TrashMoveRestore_ImageMode_MirroringEnabled 2024-09-16T08:11:19.609 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestMirroring.TrashMoveRestore_ImageMode_MirroringEnabled (1463 ms) 2024-09-16T08:11:19.609 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestMirroring.MirrorStatusList 2024-09-16T08:11:20.538 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestMirroring.MirrorStatusList (929 ms) 2024-09-16T08:11:20.538 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestMirroring.RemoveBootstrapped 2024-09-16T08:11:21.747 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestMirroring.RemoveBootstrapped (1210 ms) 2024-09-16T08:11:21.747 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestMirroring.AioPromoteDemote 2024-09-16T08:11:27.885 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestMirroring.AioPromoteDemote (6137 ms) 2024-09-16T08:11:27.885 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestMirroring.AioGetInfo 2024-09-16T08:11:32.362 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestMirroring.AioGetInfo (4477 ms) 2024-09-16T08:11:32.363 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestMirroring.AioGetStatus 2024-09-16T08:11:35.134 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestMirroring.AioGetStatus (2773 ms) 2024-09-16T08:11:35.134 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestMirroring.SiteName 2024-09-16T08:11:35.140 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestMirroring.SiteName (6 ms) 2024-09-16T08:11:35.140 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestMirroring.Bootstrap 2024-09-16T08:11:47.049 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestMirroring.Bootstrap (11908 ms) 2024-09-16T08:11:47.049 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestMirroring.PeerDirection 2024-09-16T08:11:47.125 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestMirroring.PeerDirection (76 ms) 2024-09-16T08:11:47.125 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestMirroring.Snapshot 2024-09-16T08:12:04.191 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestMirroring.Snapshot (17065 ms) 2024-09-16T08:12:04.191 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestMirroring.SnapshotRemoveOnDisable 2024-09-16T08:12:09.221 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestMirroring.SnapshotRemoveOnDisable (5028 ms) 2024-09-16T08:12:09.221 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestMirroring.SnapshotUnlinkPeer 2024-09-16T08:12:21.147 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestMirroring.SnapshotUnlinkPeer (11928 ms) 2024-09-16T08:12:21.147 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestMirroring.SnapshotImageState 2024-09-16T08:12:27.772 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestMirroring.SnapshotImageState (6626 ms) 2024-09-16T08:12:27.772 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestMirroring.SnapshotPromoteDemote 2024-09-16T08:12:37.881 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestMirroring.SnapshotPromoteDemote (10108 ms) 2024-09-16T08:12:37.881 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestMirroring.AioSnapshotCreate 2024-09-16T08:13:12.976 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestMirroring.AioSnapshotCreate (35094 ms) 2024-09-16T08:13:13.921 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] 51 tests from TestMirroring (166360 ms total) 2024-09-16T08:13:13.921 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T08:13:13.921 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] Global test environment tear-down 2024-09-16T08:13:13.921 INFO:tasks.workunit.client.0.smithi115.stdout:[==========] 51 tests from 1 test suite ran. (169226 ms total) 2024-09-16T08:13:13.922 INFO:tasks.workunit.client.0.smithi115.stdout:[ PASSED ] 49 tests. 2024-09-16T08:13:13.922 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] 2 tests, listed below: 2024-09-16T08:13:13.922 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestMirroring.DisableImageMirrorWithPeer 2024-09-16T08:13:13.922 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestMirroring.DisableJournalingWithPeer 2024-09-16T08:13:14.046 INFO:tasks.workunit.client.0.smithi115.stdout:seed 74447 2024-09-16T08:13:14.047 INFO:tasks.workunit.client.0.smithi115.stdout:Note: Google Test filter = TestGroup.* 2024-09-16T08:13:14.047 INFO:tasks.workunit.client.0.smithi115.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-16T08:13:14.047 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] Global test environment set-up. 2024-09-16T08:13:14.047 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] 13 tests from TestGroup 2024-09-16T08:13:15.928 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestGroup.group_create 2024-09-16T08:13:18.140 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestGroup.group_create (2212 ms) 2024-09-16T08:13:18.140 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestGroup.group_createPP 2024-09-16T08:13:18.344 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestGroup.group_createPP (205 ms) 2024-09-16T08:13:18.344 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestGroup.group_get_id 2024-09-16T08:13:18.499 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestGroup.group_get_id (154 ms) 2024-09-16T08:13:18.499 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestGroup.group_get_idPP 2024-09-16T08:13:18.647 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestGroup.group_get_idPP (148 ms) 2024-09-16T08:13:18.647 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestGroup.add_image 2024-09-16T08:13:19.137 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestGroup.add_image (490 ms) 2024-09-16T08:13:19.138 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestGroup.add_imagePP 2024-09-16T08:13:19.624 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestGroup.add_imagePP (486 ms) 2024-09-16T08:13:19.624 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestGroup.add_snapshot 2024-09-16T08:13:26.531 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestGroup.add_snapshot (6907 ms) 2024-09-16T08:13:26.531 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestGroup.add_snapshotPP 2024-09-16T08:13:32.546 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestGroup.add_snapshotPP (6016 ms) 2024-09-16T08:13:32.547 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestGroup.snap_get_info 2024-09-16T08:13:37.341 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestGroup.snap_get_info (4794 ms) 2024-09-16T08:13:37.341 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestGroup.snap_get_infoPP 2024-09-16T08:13:42.370 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestGroup.snap_get_infoPP (5029 ms) 2024-09-16T08:13:42.370 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestGroup.snap_list2 2024-09-16T08:13:53.289 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestGroup.snap_list2 (10919 ms) 2024-09-16T08:13:53.290 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestGroup.snap_list2PP 2024-09-16T08:14:04.458 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestGroup.snap_list2PP (11169 ms) 2024-09-16T08:14:04.458 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestGroup.snap_list_internal 2024-09-16T08:14:06.226 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestGroup.snap_list_internal (1768 ms) 2024-09-16T08:14:06.461 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] 13 tests from TestGroup (50298 ms total) 2024-09-16T08:14:06.461 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T08:14:06.462 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] Global test environment tear-down 2024-09-16T08:14:06.462 INFO:tasks.workunit.client.0.smithi115.stdout:[==========] 13 tests from 1 test suite ran. (52414 ms total) 2024-09-16T08:14:06.462 INFO:tasks.workunit.client.0.smithi115.stdout:[ PASSED ] 13 tests. 2024-09-16T08:14:06.551 INFO:tasks.workunit.client.0.smithi115.stdout:seed 74510 2024-09-16T08:14:06.551 INFO:tasks.workunit.client.0.smithi115.stdout:Note: Google Test filter = TestMirroringWatcher.* 2024-09-16T08:14:06.551 INFO:tasks.workunit.client.0.smithi115.stdout:[==========] Running 2 tests from 1 test suite. 2024-09-16T08:14:06.552 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] Global test environment set-up. 2024-09-16T08:14:06.552 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] 2 tests from TestMirroringWatcher 2024-09-16T08:14:08.293 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestMirroringWatcher.ModeUpdated 2024-09-16T08:14:10.742 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestMirroringWatcher.ModeUpdated (2449 ms) 2024-09-16T08:14:10.742 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestMirroringWatcher.ImageStatusUpdated 2024-09-16T08:14:10.945 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestMirroringWatcher.ImageStatusUpdated (204 ms) 2024-09-16T08:14:11.487 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] 2 tests from TestMirroringWatcher (2653 ms total) 2024-09-16T08:14:11.526 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T08:14:11.526 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] Global test environment tear-down 2024-09-16T08:14:11.526 INFO:tasks.workunit.client.0.smithi115.stdout:[==========] 2 tests from 1 test suite ran. (4935 ms total) 2024-09-16T08:14:11.526 INFO:tasks.workunit.client.0.smithi115.stdout:[ PASSED ] 2 tests. 2024-09-16T08:14:11.567 INFO:tasks.workunit.client.0.smithi115.stdout:seed 74562 2024-09-16T08:14:11.568 INFO:tasks.workunit.client.0.smithi115.stdout:Note: Google Test filter = TestObjectMap.* 2024-09-16T08:14:11.568 INFO:tasks.workunit.client.0.smithi115.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-16T08:14:11.568 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] Global test environment set-up. 2024-09-16T08:14:11.568 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] 4 tests from TestObjectMap 2024-09-16T08:14:13.496 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestObjectMap.RefreshInvalidatesWhenCorrupt 2024-09-16T08:14:15.837 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestObjectMap.RefreshInvalidatesWhenCorrupt (2341 ms) 2024-09-16T08:14:15.837 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestObjectMap.RefreshInvalidatesWhenTooSmall 2024-09-16T08:14:16.123 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestObjectMap.RefreshInvalidatesWhenTooSmall (286 ms) 2024-09-16T08:14:16.123 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestObjectMap.InvalidateFlagOnDisk 2024-09-16T08:14:16.519 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestObjectMap.InvalidateFlagOnDisk (396 ms) 2024-09-16T08:14:16.519 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestObjectMap.AcquireLockInvalidatesWhenTooSmall 2024-09-16T08:14:16.846 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestObjectMap.AcquireLockInvalidatesWhenTooSmall (326 ms) 2024-09-16T08:14:17.512 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] 4 tests from TestObjectMap (3349 ms total) 2024-09-16T08:14:17.512 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T08:14:17.512 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] Global test environment tear-down 2024-09-16T08:14:17.512 INFO:tasks.workunit.client.0.smithi115.stdout:[==========] 4 tests from 1 test suite ran. (5944 ms total) 2024-09-16T08:14:17.512 INFO:tasks.workunit.client.0.smithi115.stdout:[ PASSED ] 4 tests. 2024-09-16T08:14:17.512 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T08:14:17.512 INFO:tasks.workunit.client.0.smithi115.stdout: YOU HAVE 1 DISABLED TEST 2024-09-16T08:14:17.512 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T08:14:17.615 INFO:tasks.workunit.client.0.smithi115.stdout:seed 74615 2024-09-16T08:14:17.616 INFO:tasks.workunit.client.0.smithi115.stdout:Note: Google Test filter = TestOperations.* 2024-09-16T08:14:17.616 INFO:tasks.workunit.client.0.smithi115.stdout:[==========] Running 1 test from 1 test suite. 2024-09-16T08:14:17.616 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] Global test environment set-up. 2024-09-16T08:14:17.616 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] 1 test from TestOperations 2024-09-16T08:14:19.519 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestOperations.DisableJournalingCorrupt 2024-09-16T08:14:21.659 INFO:tasks.workunit.client.0.smithi115.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_Operations.cc:18: Skipped 2024-09-16T08:14:21.659 INFO:tasks.workunit.client.0.smithi115.stdout:Skipping due to unmet REQUIRE 2024-09-16T08:14:21.659 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestOperations.DisableJournalingCorrupt (2140 ms) 2024-09-16T08:14:22.534 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] 1 test from TestOperations (2140 ms total) 2024-09-16T08:14:22.534 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T08:14:22.534 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] Global test environment tear-down 2024-09-16T08:14:22.535 INFO:tasks.workunit.client.0.smithi115.stdout:[==========] 1 test from 1 test suite ran. (4918 ms total) 2024-09-16T08:14:22.535 INFO:tasks.workunit.client.0.smithi115.stdout:[ PASSED ] 0 tests. 2024-09-16T08:14:22.535 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] 1 test, listed below: 2024-09-16T08:14:22.535 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestOperations.DisableJournalingCorrupt 2024-09-16T08:14:22.605 INFO:tasks.workunit.client.0.smithi115.stdout:seed 74664 2024-09-16T08:14:22.605 INFO:tasks.workunit.client.0.smithi115.stdout:Note: Google Test filter = TestTrash.* 2024-09-16T08:14:22.605 INFO:tasks.workunit.client.0.smithi115.stdout:[==========] Running 2 tests from 1 test suite. 2024-09-16T08:14:22.605 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] Global test environment set-up. 2024-09-16T08:14:22.606 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] 2 tests from TestTrash 2024-09-16T08:14:24.301 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestTrash.UserRemovingSource 2024-09-16T08:14:27.160 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestTrash.UserRemovingSource (2859 ms) 2024-09-16T08:14:27.160 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestTrash.RestoreMirroringSource 2024-09-16T08:14:27.635 INFO:tasks.workunit.client.0.smithi115.stdout:[ OK ] TestTrash.RestoreMirroringSource (475 ms) 2024-09-16T08:14:28.299 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] 2 tests from TestTrash (3334 ms total) 2024-09-16T08:14:28.300 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T08:14:28.300 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] Global test environment tear-down 2024-09-16T08:14:28.300 INFO:tasks.workunit.client.0.smithi115.stdout:[==========] 2 tests from 1 test suite ran. (5695 ms total) 2024-09-16T08:14:28.300 INFO:tasks.workunit.client.0.smithi115.stdout:[ PASSED ] 2 tests. 2024-09-16T08:14:28.377 INFO:tasks.workunit.client.0.smithi115.stdout:seed 74716 2024-09-16T08:14:28.378 INFO:tasks.workunit.client.0.smithi115.stdout:Note: Google Test filter = TestJournalEntries.* 2024-09-16T08:14:28.378 INFO:tasks.workunit.client.0.smithi115.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-16T08:14:28.378 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] Global test environment set-up. 2024-09-16T08:14:28.378 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] 4 tests from TestJournalEntries 2024-09-16T08:14:30.322 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestJournalEntries.AioWrite 2024-09-16T08:14:32.449 INFO:tasks.workunit.client.0.smithi115.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Entries.cc:118: Skipped 2024-09-16T08:14:32.449 INFO:tasks.workunit.client.0.smithi115.stdout:Skipping due to unmet REQUIRE 2024-09-16T08:14:32.449 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestJournalEntries.AioWrite (2126 ms) 2024-09-16T08:14:32.449 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestJournalEntries.AioDiscard 2024-09-16T08:14:32.521 INFO:tasks.workunit.client.0.smithi115.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Entries.cc:163: Skipped 2024-09-16T08:14:32.521 INFO:tasks.workunit.client.0.smithi115.stdout:Skipping due to unmet REQUIRE 2024-09-16T08:14:32.521 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestJournalEntries.AioDiscard (72 ms) 2024-09-16T08:14:32.521 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestJournalEntries.AioDiscardWithPrune 2024-09-16T08:14:32.595 INFO:tasks.workunit.client.0.smithi115.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Entries.cc:200: Skipped 2024-09-16T08:14:32.595 INFO:tasks.workunit.client.0.smithi115.stdout:Skipping due to unmet REQUIRE 2024-09-16T08:14:32.595 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestJournalEntries.AioDiscardWithPrune (74 ms) 2024-09-16T08:14:32.595 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestJournalEntries.AioFlush 2024-09-16T08:14:32.669 INFO:tasks.workunit.client.0.smithi115.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Entries.cc:263: Skipped 2024-09-16T08:14:32.669 INFO:tasks.workunit.client.0.smithi115.stdout:Skipping due to unmet REQUIRE 2024-09-16T08:14:32.669 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestJournalEntries.AioFlush (74 ms) 2024-09-16T08:14:33.339 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] 4 tests from TestJournalEntries (2346 ms total) 2024-09-16T08:14:33.340 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T08:14:33.340 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] Global test environment tear-down 2024-09-16T08:14:33.340 INFO:tasks.workunit.client.0.smithi115.stdout:[==========] 4 tests from 1 test suite ran. (4960 ms total) 2024-09-16T08:14:33.340 INFO:tasks.workunit.client.0.smithi115.stdout:[ PASSED ] 0 tests. 2024-09-16T08:14:33.340 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] 4 tests, listed below: 2024-09-16T08:14:33.340 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestJournalEntries.AioWrite 2024-09-16T08:14:33.341 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestJournalEntries.AioDiscard 2024-09-16T08:14:33.341 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestJournalEntries.AioDiscardWithPrune 2024-09-16T08:14:33.341 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestJournalEntries.AioFlush 2024-09-16T08:14:33.443 INFO:tasks.workunit.client.0.smithi115.stdout:seed 74765 2024-09-16T08:14:33.443 INFO:tasks.workunit.client.0.smithi115.stdout:Note: Google Test filter = TestJournalReplay.* 2024-09-16T08:14:33.443 INFO:tasks.workunit.client.0.smithi115.stdout:[==========] Running 16 tests from 1 test suite. 2024-09-16T08:14:33.443 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] Global test environment set-up. 2024-09-16T08:14:33.444 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] 16 tests from TestJournalReplay 2024-09-16T08:14:35.346 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestJournalReplay.AioDiscardEvent 2024-09-16T08:14:37.472 INFO:tasks.workunit.client.0.smithi115.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:109: Skipped 2024-09-16T08:14:37.472 INFO:tasks.workunit.client.0.smithi115.stdout:Skipping due to unmet REQUIRE 2024-09-16T08:14:37.472 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestJournalReplay.AioDiscardEvent (2126 ms) 2024-09-16T08:14:37.472 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestJournalReplay.AioWriteEvent 2024-09-16T08:14:37.543 INFO:tasks.workunit.client.0.smithi115.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:200: Skipped 2024-09-16T08:14:37.543 INFO:tasks.workunit.client.0.smithi115.stdout:Skipping due to unmet REQUIRE 2024-09-16T08:14:37.543 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestJournalReplay.AioWriteEvent (71 ms) 2024-09-16T08:14:37.543 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestJournalReplay.AioFlushEvent 2024-09-16T08:14:37.618 INFO:tasks.workunit.client.0.smithi115.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:261: Skipped 2024-09-16T08:14:37.618 INFO:tasks.workunit.client.0.smithi115.stdout:Skipping due to unmet REQUIRE 2024-09-16T08:14:37.618 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestJournalReplay.AioFlushEvent (75 ms) 2024-09-16T08:14:37.618 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestJournalReplay.SnapCreate 2024-09-16T08:14:37.690 INFO:tasks.workunit.client.0.smithi115.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:307: Skipped 2024-09-16T08:14:37.690 INFO:tasks.workunit.client.0.smithi115.stdout:Skipping due to unmet REQUIRE 2024-09-16T08:14:37.690 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestJournalReplay.SnapCreate (72 ms) 2024-09-16T08:14:37.691 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestJournalReplay.SnapProtect 2024-09-16T08:14:37.766 INFO:tasks.workunit.client.0.smithi115.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:348: Skipped 2024-09-16T08:14:37.766 INFO:tasks.workunit.client.0.smithi115.stdout:Skipping due to unmet REQUIRE 2024-09-16T08:14:37.767 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestJournalReplay.SnapProtect (77 ms) 2024-09-16T08:14:37.767 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestJournalReplay.SnapUnprotect 2024-09-16T08:14:37.840 INFO:tasks.workunit.client.0.smithi115.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:394: Skipped 2024-09-16T08:14:37.840 INFO:tasks.workunit.client.0.smithi115.stdout:Skipping due to unmet REQUIRE 2024-09-16T08:14:37.841 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestJournalReplay.SnapUnprotect (73 ms) 2024-09-16T08:14:37.841 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestJournalReplay.SnapRename 2024-09-16T08:14:37.914 INFO:tasks.workunit.client.0.smithi115.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:450: Skipped 2024-09-16T08:14:37.915 INFO:tasks.workunit.client.0.smithi115.stdout:Skipping due to unmet REQUIRE 2024-09-16T08:14:37.915 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestJournalReplay.SnapRename (75 ms) 2024-09-16T08:14:37.915 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestJournalReplay.SnapRollback 2024-09-16T08:14:37.990 INFO:tasks.workunit.client.0.smithi115.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:500: Skipped 2024-09-16T08:14:37.990 INFO:tasks.workunit.client.0.smithi115.stdout:Skipping due to unmet REQUIRE 2024-09-16T08:14:37.990 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestJournalReplay.SnapRollback (75 ms) 2024-09-16T08:14:37.990 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestJournalReplay.SnapRemove 2024-09-16T08:14:38.063 INFO:tasks.workunit.client.0.smithi115.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:541: Skipped 2024-09-16T08:14:38.063 INFO:tasks.workunit.client.0.smithi115.stdout:Skipping due to unmet REQUIRE 2024-09-16T08:14:38.063 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestJournalReplay.SnapRemove (73 ms) 2024-09-16T08:14:38.063 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestJournalReplay.Rename 2024-09-16T08:14:38.140 INFO:tasks.workunit.client.0.smithi115.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:590: Skipped 2024-09-16T08:14:38.140 INFO:tasks.workunit.client.0.smithi115.stdout:Skipping due to unmet REQUIRE 2024-09-16T08:14:38.140 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestJournalReplay.Rename (77 ms) 2024-09-16T08:14:38.141 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestJournalReplay.Resize 2024-09-16T08:14:38.213 INFO:tasks.workunit.client.0.smithi115.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:624: Skipped 2024-09-16T08:14:38.213 INFO:tasks.workunit.client.0.smithi115.stdout:Skipping due to unmet REQUIRE 2024-09-16T08:14:38.213 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestJournalReplay.Resize (73 ms) 2024-09-16T08:14:38.213 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestJournalReplay.Flatten 2024-09-16T08:14:38.287 INFO:tasks.workunit.client.0.smithi115.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:657: Skipped 2024-09-16T08:14:38.287 INFO:tasks.workunit.client.0.smithi115.stdout:Skipping due to unmet REQUIRE 2024-09-16T08:14:38.287 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestJournalReplay.Flatten (74 ms) 2024-09-16T08:14:38.287 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestJournalReplay.UpdateFeatures 2024-09-16T08:14:38.385 INFO:tasks.workunit.client.0.smithi115.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:704: Skipped 2024-09-16T08:14:38.385 INFO:tasks.workunit.client.0.smithi115.stdout:Skipping due to unmet REQUIRE 2024-09-16T08:14:38.385 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestJournalReplay.UpdateFeatures (98 ms) 2024-09-16T08:14:38.385 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestJournalReplay.MetadataSet 2024-09-16T08:14:38.459 INFO:tasks.workunit.client.0.smithi115.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:741: Skipped 2024-09-16T08:14:38.460 INFO:tasks.workunit.client.0.smithi115.stdout:Skipping due to unmet REQUIRE 2024-09-16T08:14:38.460 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestJournalReplay.MetadataSet (74 ms) 2024-09-16T08:14:38.460 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestJournalReplay.MetadataRemove 2024-09-16T08:14:38.533 INFO:tasks.workunit.client.0.smithi115.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:781: Skipped 2024-09-16T08:14:38.533 INFO:tasks.workunit.client.0.smithi115.stdout:Skipping due to unmet REQUIRE 2024-09-16T08:14:38.533 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestJournalReplay.MetadataRemove (74 ms) 2024-09-16T08:14:38.533 INFO:tasks.workunit.client.0.smithi115.stdout:[ RUN ] TestJournalReplay.ObjectPosition 2024-09-16T08:14:38.606 INFO:tasks.workunit.client.0.smithi115.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:824: Skipped 2024-09-16T08:14:38.606 INFO:tasks.workunit.client.0.smithi115.stdout:Skipping due to unmet REQUIRE 2024-09-16T08:14:38.606 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestJournalReplay.ObjectPosition (73 ms) 2024-09-16T08:14:39.374 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] 16 tests from TestJournalReplay (3260 ms total) 2024-09-16T08:14:39.374 INFO:tasks.workunit.client.0.smithi115.stdout: 2024-09-16T08:14:39.374 INFO:tasks.workunit.client.0.smithi115.stdout:[----------] Global test environment tear-down 2024-09-16T08:14:39.375 INFO:tasks.workunit.client.0.smithi115.stdout:[==========] 16 tests from 1 test suite ran. (5933 ms total) 2024-09-16T08:14:39.375 INFO:tasks.workunit.client.0.smithi115.stdout:[ PASSED ] 0 tests. 2024-09-16T08:14:39.375 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] 16 tests, listed below: 2024-09-16T08:14:39.375 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestJournalReplay.AioDiscardEvent 2024-09-16T08:14:39.375 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestJournalReplay.AioWriteEvent 2024-09-16T08:14:39.375 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestJournalReplay.AioFlushEvent 2024-09-16T08:14:39.375 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestJournalReplay.SnapCreate 2024-09-16T08:14:39.375 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestJournalReplay.SnapProtect 2024-09-16T08:14:39.375 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestJournalReplay.SnapUnprotect 2024-09-16T08:14:39.375 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestJournalReplay.SnapRename 2024-09-16T08:14:39.375 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestJournalReplay.SnapRollback 2024-09-16T08:14:39.375 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestJournalReplay.SnapRemove 2024-09-16T08:14:39.375 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestJournalReplay.Rename 2024-09-16T08:14:39.376 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestJournalReplay.Resize 2024-09-16T08:14:39.376 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestJournalReplay.Flatten 2024-09-16T08:14:39.376 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestJournalReplay.UpdateFeatures 2024-09-16T08:14:39.376 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestJournalReplay.MetadataSet 2024-09-16T08:14:39.376 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestJournalReplay.MetadataRemove 2024-09-16T08:14:39.376 INFO:tasks.workunit.client.0.smithi115.stdout:[ SKIPPED ] TestJournalReplay.ObjectPosition 2024-09-16T08:14:39.381 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-16T08:14:39.381 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-16T08:14:39.414 INFO:tasks.workunit:Stopping ['rbd/crimson/test_crimson_librbd.sh'] on client.0... 2024-09-16T08:14:39.414 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-16T08:14:39.843 DEBUG:teuthology.parallel:result is None 2024-09-16T08:14:39.844 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-16T08:14:39.869 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-16T08:14:39.869 DEBUG:teuthology.orchestra.run.smithi115:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-16T08:14:39.933 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-16T08:14:39.934 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-16T08:14:39.944 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T08:14:39.944 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T08:14:40.083 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T08:14:40.080+0000 7fa00c391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:14:40.087 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T08:14:40.087+0000 7fa00c391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:14:40.274 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T08:14:40.275 INFO:teuthology.orchestra.run.smithi115.stderr:dumped all 2024-09-16T08:14:40.287 INFO:teuthology.orchestra.run.smithi115.stdout:{"pg_ready":true,"pg_map":{"version":1876,"stamp":"2024-09-16T08:14:40.000185+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":283115520,"kb_used":200476,"kb_used_data":3084,"kb_used_omap":0,"kb_used_meta":197056,"kb_avail":282915044,"statfs":{"total":289910292480,"available":289705005056,"internally_reserved":0,"allocated":3158016,"data_stored":2405490,"data_compressed":60100,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":201785344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000838"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":1890,"reported_epoch":639,"state":"active+clean","last_fresh":"2024-09-16T08:14:30.354818+0000","last_change":"2024-09-16T07:33:36.455637+0000","last_active":"2024-09-16T08:14:30.354818+0000","last_peered":"2024-09-16T08:14:30.354818+0000","last_clean":"2024-09-16T08:14:30.354818+0000","last_became_active":"2024-09-16T07:33:34.518531+0000","last_became_peered":"2024-09-16T07:33:34.518531+0000","last_unstale":"2024-09-16T08:14:30.354818+0000","last_undegraded":"2024-09-16T08:14:30.354818+0000","last_fullsized":"2024-09-16T08:14:30.354818+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_clean_scrub_stamp":"2024-09-16T07:33:33.407142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1890,"reported_epoch":639,"state":"active+clean","last_fresh":"2024-09-16T08:14:30.369326+0000","last_change":"2024-09-16T07:33:36.462702+0000","last_active":"2024-09-16T08:14:30.369326+0000","last_peered":"2024-09-16T08:14:30.369326+0000","last_clean":"2024-09-16T08:14:30.369326+0000","last_became_active":"2024-09-16T07:33:34.538238+0000","last_became_peered":"2024-09-16T07:33:34.538238+0000","last_unstale":"2024-09-16T08:14:30.369326+0000","last_undegraded":"2024-09-16T08:14:30.369326+0000","last_fullsized":"2024-09-16T08:14:30.369326+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_clean_scrub_stamp":"2024-09-16T07:33:33.407142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1890,"reported_epoch":639,"state":"active+clean","last_fresh":"2024-09-16T08:14:30.356908+0000","last_change":"2024-09-16T07:33:36.455932+0000","last_active":"2024-09-16T08:14:30.356908+0000","last_peered":"2024-09-16T08:14:30.356908+0000","last_clean":"2024-09-16T08:14:30.356908+0000","last_became_active":"2024-09-16T07:33:34.499685+0000","last_became_peered":"2024-09-16T07:33:34.499685+0000","last_unstale":"2024-09-16T08:14:30.356908+0000","last_undegraded":"2024-09-16T08:14:30.356908+0000","last_fullsized":"2024-09-16T08:14:30.356908+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_clean_scrub_stamp":"2024-09-16T07:33:33.407142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1890,"reported_epoch":639,"state":"active+clean","last_fresh":"2024-09-16T08:14:30.358015+0000","last_change":"2024-09-16T07:33:36.461997+0000","last_active":"2024-09-16T08:14:30.358015+0000","last_peered":"2024-09-16T08:14:30.358015+0000","last_clean":"2024-09-16T08:14:30.358015+0000","last_became_active":"2024-09-16T07:33:34.525935+0000","last_became_peered":"2024-09-16T07:33:34.525935+0000","last_unstale":"2024-09-16T08:14:30.358015+0000","last_undegraded":"2024-09-16T08:14:30.358015+0000","last_fullsized":"2024-09-16T08:14:30.358015+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_clean_scrub_stamp":"2024-09-16T07:33:33.407142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":1898,"reported_epoch":641,"state":"active+clean","last_fresh":"2024-09-16T08:14:32.361433+0000","last_change":"2024-09-16T07:33:36.459257+0000","last_active":"2024-09-16T08:14:32.361433+0000","last_peered":"2024-09-16T08:14:32.361433+0000","last_clean":"2024-09-16T08:14:32.361433+0000","last_became_active":"2024-09-16T07:33:34.504968+0000","last_became_peered":"2024-09-16T07:33:34.504968+0000","last_unstale":"2024-09-16T08:14:32.361433+0000","last_undegraded":"2024-09-16T08:14:32.361433+0000","last_fullsized":"2024-09-16T08:14:32.361433+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_clean_scrub_stamp":"2024-09-16T07:33:33.407142+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1896,"reported_epoch":641,"state":"active+clean","last_fresh":"2024-09-16T08:14:32.377796+0000","last_change":"2024-09-16T07:33:36.458863+0000","last_active":"2024-09-16T08:14:32.377796+0000","last_peered":"2024-09-16T08:14:32.377796+0000","last_clean":"2024-09-16T08:14:32.377796+0000","last_became_active":"2024-09-16T07:33:34.534328+0000","last_became_peered":"2024-09-16T07:33:34.534328+0000","last_unstale":"2024-09-16T08:14:32.377796+0000","last_undegraded":"2024-09-16T08:14:32.377796+0000","last_fullsized":"2024-09-16T08:14:32.377796+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_clean_scrub_stamp":"2024-09-16T07:33:33.407142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1896,"reported_epoch":641,"state":"active+clean","last_fresh":"2024-09-16T08:14:32.363037+0000","last_change":"2024-09-16T07:33:36.455952+0000","last_active":"2024-09-16T08:14:32.363037+0000","last_peered":"2024-09-16T08:14:32.363037+0000","last_clean":"2024-09-16T08:14:32.363037+0000","last_became_active":"2024-09-16T07:33:34.511137+0000","last_became_peered":"2024-09-16T07:33:34.511137+0000","last_unstale":"2024-09-16T08:14:32.363037+0000","last_undegraded":"2024-09-16T08:14:32.363037+0000","last_fullsized":"2024-09-16T08:14:32.363037+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_clean_scrub_stamp":"2024-09-16T07:33:33.407142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":1891,"reported_epoch":639,"state":"active+clean","last_fresh":"2024-09-16T08:14:30.373468+0000","last_change":"2024-09-16T07:33:36.462968+0000","last_active":"2024-09-16T08:14:30.373468+0000","last_peered":"2024-09-16T08:14:30.373468+0000","last_clean":"2024-09-16T08:14:30.373468+0000","last_became_active":"2024-09-16T07:33:34.503858+0000","last_became_peered":"2024-09-16T07:33:34.503858+0000","last_unstale":"2024-09-16T08:14:30.373468+0000","last_undegraded":"2024-09-16T08:14:30.373468+0000","last_fullsized":"2024-09-16T08:14:30.373468+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_clean_scrub_stamp":"2024-09-16T07:33:33.407142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":1959,"reported_epoch":639,"state":"active+clean","last_fresh":"2024-09-16T08:14:30.352534+0000","last_change":"2024-09-16T07:33:33.474665+0000","last_active":"2024-09-16T08:14:30.352534+0000","last_peered":"2024-09-16T08:14:30.352534+0000","last_clean":"2024-09-16T08:14:30.352534+0000","last_became_active":"2024-09-16T07:33:33.464426+0000","last_became_peered":"2024-09-16T07:33:33.464426+0000","last_unstale":"2024-09-16T08:14:30.352534+0000","last_undegraded":"2024-09-16T08:14:30.352534+0000","last_fullsized":"2024-09-16T08:14:30.352534+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:32.406213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:32.406213+0000","last_clean_scrub_stamp":"2024-09-16T07:33:32.406213+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30050,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654708117,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":63940,"kb_used_data":980,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94307900,"statfs":{"total":96636764160,"available":96571289600,"internally_reserved":0,"allocated":1003520,"data_stored":403892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359740822,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":68264,"kb_used_data":1064,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94303576,"statfs":{"total":96636764160,"available":96566861824,"internally_reserved":0,"allocated":1089536,"data_stored":1007327,"data_compressed":30050,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654708113,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":68272,"kb_used_data":1040,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94303568,"statfs":{"total":96636764160,"available":96566853632,"internally_reserved":0,"allocated":1064960,"data_stored":994271,"data_compressed":30050,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30050,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T08:14:40.288 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T08:14:40.397 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T08:14:40.393+0000 7f579bcd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:14:40.400 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T08:14:40.401+0000 7f579bcd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:14:40.585 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T08:14:40.586 INFO:teuthology.orchestra.run.smithi115.stderr:dumped all 2024-09-16T08:14:40.598 INFO:teuthology.orchestra.run.smithi115.stdout:{"pg_ready":true,"pg_map":{"version":1876,"stamp":"2024-09-16T08:14:40.000185+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":283115520,"kb_used":200476,"kb_used_data":3084,"kb_used_omap":0,"kb_used_meta":197056,"kb_avail":282915044,"statfs":{"total":289910292480,"available":289705005056,"internally_reserved":0,"allocated":3158016,"data_stored":2405490,"data_compressed":60100,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":201785344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000838"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":1890,"reported_epoch":639,"state":"active+clean","last_fresh":"2024-09-16T08:14:30.354818+0000","last_change":"2024-09-16T07:33:36.455637+0000","last_active":"2024-09-16T08:14:30.354818+0000","last_peered":"2024-09-16T08:14:30.354818+0000","last_clean":"2024-09-16T08:14:30.354818+0000","last_became_active":"2024-09-16T07:33:34.518531+0000","last_became_peered":"2024-09-16T07:33:34.518531+0000","last_unstale":"2024-09-16T08:14:30.354818+0000","last_undegraded":"2024-09-16T08:14:30.354818+0000","last_fullsized":"2024-09-16T08:14:30.354818+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_clean_scrub_stamp":"2024-09-16T07:33:33.407142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1890,"reported_epoch":639,"state":"active+clean","last_fresh":"2024-09-16T08:14:30.369326+0000","last_change":"2024-09-16T07:33:36.462702+0000","last_active":"2024-09-16T08:14:30.369326+0000","last_peered":"2024-09-16T08:14:30.369326+0000","last_clean":"2024-09-16T08:14:30.369326+0000","last_became_active":"2024-09-16T07:33:34.538238+0000","last_became_peered":"2024-09-16T07:33:34.538238+0000","last_unstale":"2024-09-16T08:14:30.369326+0000","last_undegraded":"2024-09-16T08:14:30.369326+0000","last_fullsized":"2024-09-16T08:14:30.369326+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_clean_scrub_stamp":"2024-09-16T07:33:33.407142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1890,"reported_epoch":639,"state":"active+clean","last_fresh":"2024-09-16T08:14:30.356908+0000","last_change":"2024-09-16T07:33:36.455932+0000","last_active":"2024-09-16T08:14:30.356908+0000","last_peered":"2024-09-16T08:14:30.356908+0000","last_clean":"2024-09-16T08:14:30.356908+0000","last_became_active":"2024-09-16T07:33:34.499685+0000","last_became_peered":"2024-09-16T07:33:34.499685+0000","last_unstale":"2024-09-16T08:14:30.356908+0000","last_undegraded":"2024-09-16T08:14:30.356908+0000","last_fullsized":"2024-09-16T08:14:30.356908+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_clean_scrub_stamp":"2024-09-16T07:33:33.407142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1890,"reported_epoch":639,"state":"active+clean","last_fresh":"2024-09-16T08:14:30.358015+0000","last_change":"2024-09-16T07:33:36.461997+0000","last_active":"2024-09-16T08:14:30.358015+0000","last_peered":"2024-09-16T08:14:30.358015+0000","last_clean":"2024-09-16T08:14:30.358015+0000","last_became_active":"2024-09-16T07:33:34.525935+0000","last_became_peered":"2024-09-16T07:33:34.525935+0000","last_unstale":"2024-09-16T08:14:30.358015+0000","last_undegraded":"2024-09-16T08:14:30.358015+0000","last_fullsized":"2024-09-16T08:14:30.358015+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_clean_scrub_stamp":"2024-09-16T07:33:33.407142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":1898,"reported_epoch":641,"state":"active+clean","last_fresh":"2024-09-16T08:14:32.361433+0000","last_change":"2024-09-16T07:33:36.459257+0000","last_active":"2024-09-16T08:14:32.361433+0000","last_peered":"2024-09-16T08:14:32.361433+0000","last_clean":"2024-09-16T08:14:32.361433+0000","last_became_active":"2024-09-16T07:33:34.504968+0000","last_became_peered":"2024-09-16T07:33:34.504968+0000","last_unstale":"2024-09-16T08:14:32.361433+0000","last_undegraded":"2024-09-16T08:14:32.361433+0000","last_fullsized":"2024-09-16T08:14:32.361433+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_clean_scrub_stamp":"2024-09-16T07:33:33.407142+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1896,"reported_epoch":641,"state":"active+clean","last_fresh":"2024-09-16T08:14:32.377796+0000","last_change":"2024-09-16T07:33:36.458863+0000","last_active":"2024-09-16T08:14:32.377796+0000","last_peered":"2024-09-16T08:14:32.377796+0000","last_clean":"2024-09-16T08:14:32.377796+0000","last_became_active":"2024-09-16T07:33:34.534328+0000","last_became_peered":"2024-09-16T07:33:34.534328+0000","last_unstale":"2024-09-16T08:14:32.377796+0000","last_undegraded":"2024-09-16T08:14:32.377796+0000","last_fullsized":"2024-09-16T08:14:32.377796+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_clean_scrub_stamp":"2024-09-16T07:33:33.407142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1896,"reported_epoch":641,"state":"active+clean","last_fresh":"2024-09-16T08:14:32.363037+0000","last_change":"2024-09-16T07:33:36.455952+0000","last_active":"2024-09-16T08:14:32.363037+0000","last_peered":"2024-09-16T08:14:32.363037+0000","last_clean":"2024-09-16T08:14:32.363037+0000","last_became_active":"2024-09-16T07:33:34.511137+0000","last_became_peered":"2024-09-16T07:33:34.511137+0000","last_unstale":"2024-09-16T08:14:32.363037+0000","last_undegraded":"2024-09-16T08:14:32.363037+0000","last_fullsized":"2024-09-16T08:14:32.363037+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_clean_scrub_stamp":"2024-09-16T07:33:33.407142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":1891,"reported_epoch":639,"state":"active+clean","last_fresh":"2024-09-16T08:14:30.373468+0000","last_change":"2024-09-16T07:33:36.462968+0000","last_active":"2024-09-16T08:14:30.373468+0000","last_peered":"2024-09-16T08:14:30.373468+0000","last_clean":"2024-09-16T08:14:30.373468+0000","last_became_active":"2024-09-16T07:33:34.503858+0000","last_became_peered":"2024-09-16T07:33:34.503858+0000","last_unstale":"2024-09-16T08:14:30.373468+0000","last_undegraded":"2024-09-16T08:14:30.373468+0000","last_fullsized":"2024-09-16T08:14:30.373468+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_clean_scrub_stamp":"2024-09-16T07:33:33.407142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":1959,"reported_epoch":639,"state":"active+clean","last_fresh":"2024-09-16T08:14:30.352534+0000","last_change":"2024-09-16T07:33:33.474665+0000","last_active":"2024-09-16T08:14:30.352534+0000","last_peered":"2024-09-16T08:14:30.352534+0000","last_clean":"2024-09-16T08:14:30.352534+0000","last_became_active":"2024-09-16T07:33:33.464426+0000","last_became_peered":"2024-09-16T07:33:33.464426+0000","last_unstale":"2024-09-16T08:14:30.352534+0000","last_undegraded":"2024-09-16T08:14:30.352534+0000","last_fullsized":"2024-09-16T08:14:30.352534+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:32.406213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:32.406213+0000","last_clean_scrub_stamp":"2024-09-16T07:33:32.406213+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30050,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654708117,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":63940,"kb_used_data":980,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94307900,"statfs":{"total":96636764160,"available":96571289600,"internally_reserved":0,"allocated":1003520,"data_stored":403892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359740822,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":68264,"kb_used_data":1064,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94303576,"statfs":{"total":96636764160,"available":96566861824,"internally_reserved":0,"allocated":1089536,"data_stored":1007327,"data_compressed":30050,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654708113,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":68272,"kb_used_data":1040,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94303568,"statfs":{"total":96636764160,"available":96566853632,"internally_reserved":0,"allocated":1064960,"data_stored":994271,"data_compressed":30050,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30050,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T08:14:40.599 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T08:14:40.599 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T08:14:40.707 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T08:14:40.704+0000 7f1557b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:14:40.711 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T08:14:40.711+0000 7f1557b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:14:40.894 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T08:14:40.894 INFO:teuthology.orchestra.run.smithi115.stderr:dumped all 2024-09-16T08:14:40.907 INFO:teuthology.orchestra.run.smithi115.stdout:{"pg_ready":true,"pg_map":{"version":1876,"stamp":"2024-09-16T08:14:40.000185+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":283115520,"kb_used":200476,"kb_used_data":3084,"kb_used_omap":0,"kb_used_meta":197056,"kb_avail":282915044,"statfs":{"total":289910292480,"available":289705005056,"internally_reserved":0,"allocated":3158016,"data_stored":2405490,"data_compressed":60100,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":201785344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000838"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":1890,"reported_epoch":639,"state":"active+clean","last_fresh":"2024-09-16T08:14:30.354818+0000","last_change":"2024-09-16T07:33:36.455637+0000","last_active":"2024-09-16T08:14:30.354818+0000","last_peered":"2024-09-16T08:14:30.354818+0000","last_clean":"2024-09-16T08:14:30.354818+0000","last_became_active":"2024-09-16T07:33:34.518531+0000","last_became_peered":"2024-09-16T07:33:34.518531+0000","last_unstale":"2024-09-16T08:14:30.354818+0000","last_undegraded":"2024-09-16T08:14:30.354818+0000","last_fullsized":"2024-09-16T08:14:30.354818+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_clean_scrub_stamp":"2024-09-16T07:33:33.407142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1890,"reported_epoch":639,"state":"active+clean","last_fresh":"2024-09-16T08:14:30.369326+0000","last_change":"2024-09-16T07:33:36.462702+0000","last_active":"2024-09-16T08:14:30.369326+0000","last_peered":"2024-09-16T08:14:30.369326+0000","last_clean":"2024-09-16T08:14:30.369326+0000","last_became_active":"2024-09-16T07:33:34.538238+0000","last_became_peered":"2024-09-16T07:33:34.538238+0000","last_unstale":"2024-09-16T08:14:30.369326+0000","last_undegraded":"2024-09-16T08:14:30.369326+0000","last_fullsized":"2024-09-16T08:14:30.369326+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_clean_scrub_stamp":"2024-09-16T07:33:33.407142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1890,"reported_epoch":639,"state":"active+clean","last_fresh":"2024-09-16T08:14:30.356908+0000","last_change":"2024-09-16T07:33:36.455932+0000","last_active":"2024-09-16T08:14:30.356908+0000","last_peered":"2024-09-16T08:14:30.356908+0000","last_clean":"2024-09-16T08:14:30.356908+0000","last_became_active":"2024-09-16T07:33:34.499685+0000","last_became_peered":"2024-09-16T07:33:34.499685+0000","last_unstale":"2024-09-16T08:14:30.356908+0000","last_undegraded":"2024-09-16T08:14:30.356908+0000","last_fullsized":"2024-09-16T08:14:30.356908+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_clean_scrub_stamp":"2024-09-16T07:33:33.407142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1890,"reported_epoch":639,"state":"active+clean","last_fresh":"2024-09-16T08:14:30.358015+0000","last_change":"2024-09-16T07:33:36.461997+0000","last_active":"2024-09-16T08:14:30.358015+0000","last_peered":"2024-09-16T08:14:30.358015+0000","last_clean":"2024-09-16T08:14:30.358015+0000","last_became_active":"2024-09-16T07:33:34.525935+0000","last_became_peered":"2024-09-16T07:33:34.525935+0000","last_unstale":"2024-09-16T08:14:30.358015+0000","last_undegraded":"2024-09-16T08:14:30.358015+0000","last_fullsized":"2024-09-16T08:14:30.358015+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_clean_scrub_stamp":"2024-09-16T07:33:33.407142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":1898,"reported_epoch":641,"state":"active+clean","last_fresh":"2024-09-16T08:14:32.361433+0000","last_change":"2024-09-16T07:33:36.459257+0000","last_active":"2024-09-16T08:14:32.361433+0000","last_peered":"2024-09-16T08:14:32.361433+0000","last_clean":"2024-09-16T08:14:32.361433+0000","last_became_active":"2024-09-16T07:33:34.504968+0000","last_became_peered":"2024-09-16T07:33:34.504968+0000","last_unstale":"2024-09-16T08:14:32.361433+0000","last_undegraded":"2024-09-16T08:14:32.361433+0000","last_fullsized":"2024-09-16T08:14:32.361433+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_clean_scrub_stamp":"2024-09-16T07:33:33.407142+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1896,"reported_epoch":641,"state":"active+clean","last_fresh":"2024-09-16T08:14:32.377796+0000","last_change":"2024-09-16T07:33:36.458863+0000","last_active":"2024-09-16T08:14:32.377796+0000","last_peered":"2024-09-16T08:14:32.377796+0000","last_clean":"2024-09-16T08:14:32.377796+0000","last_became_active":"2024-09-16T07:33:34.534328+0000","last_became_peered":"2024-09-16T07:33:34.534328+0000","last_unstale":"2024-09-16T08:14:32.377796+0000","last_undegraded":"2024-09-16T08:14:32.377796+0000","last_fullsized":"2024-09-16T08:14:32.377796+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_clean_scrub_stamp":"2024-09-16T07:33:33.407142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1896,"reported_epoch":641,"state":"active+clean","last_fresh":"2024-09-16T08:14:32.363037+0000","last_change":"2024-09-16T07:33:36.455952+0000","last_active":"2024-09-16T08:14:32.363037+0000","last_peered":"2024-09-16T08:14:32.363037+0000","last_clean":"2024-09-16T08:14:32.363037+0000","last_became_active":"2024-09-16T07:33:34.511137+0000","last_became_peered":"2024-09-16T07:33:34.511137+0000","last_unstale":"2024-09-16T08:14:32.363037+0000","last_undegraded":"2024-09-16T08:14:32.363037+0000","last_fullsized":"2024-09-16T08:14:32.363037+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_clean_scrub_stamp":"2024-09-16T07:33:33.407142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":1891,"reported_epoch":639,"state":"active+clean","last_fresh":"2024-09-16T08:14:30.373468+0000","last_change":"2024-09-16T07:33:36.462968+0000","last_active":"2024-09-16T08:14:30.373468+0000","last_peered":"2024-09-16T08:14:30.373468+0000","last_clean":"2024-09-16T08:14:30.373468+0000","last_became_active":"2024-09-16T07:33:34.503858+0000","last_became_peered":"2024-09-16T07:33:34.503858+0000","last_unstale":"2024-09-16T08:14:30.373468+0000","last_undegraded":"2024-09-16T08:14:30.373468+0000","last_fullsized":"2024-09-16T08:14:30.373468+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_clean_scrub_stamp":"2024-09-16T07:33:33.407142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":1959,"reported_epoch":639,"state":"active+clean","last_fresh":"2024-09-16T08:14:30.352534+0000","last_change":"2024-09-16T07:33:33.474665+0000","last_active":"2024-09-16T08:14:30.352534+0000","last_peered":"2024-09-16T08:14:30.352534+0000","last_clean":"2024-09-16T08:14:30.352534+0000","last_became_active":"2024-09-16T07:33:33.464426+0000","last_became_peered":"2024-09-16T07:33:33.464426+0000","last_unstale":"2024-09-16T08:14:30.352534+0000","last_undegraded":"2024-09-16T08:14:30.352534+0000","last_fullsized":"2024-09-16T08:14:30.352534+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:32.406213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:32.406213+0000","last_clean_scrub_stamp":"2024-09-16T07:33:32.406213+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30050,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654708117,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":63940,"kb_used_data":980,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94307900,"statfs":{"total":96636764160,"available":96571289600,"internally_reserved":0,"allocated":1003520,"data_stored":403892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359740822,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":68264,"kb_used_data":1064,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94303576,"statfs":{"total":96636764160,"available":96566861824,"internally_reserved":0,"allocated":1089536,"data_stored":1007327,"data_compressed":30050,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654708113,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":68272,"kb_used_data":1040,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94303568,"statfs":{"total":96636764160,"available":96566853632,"internally_reserved":0,"allocated":1064960,"data_stored":994271,"data_compressed":30050,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30050,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T08:14:40.908 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T08:14:41.015 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T08:14:41.012+0000 7fc64bf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:14:41.019 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T08:14:41.019+0000 7fc64bf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:14:41.207 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T08:14:41.207 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":648,"fsid":"c399a571-d66b-4a13-8ade-7d949db2bd08","created":"2024-09-16T07:33:22.877946+0000","modified":"2024-09-16T08:14:39.360887+0000","last_up_change":"2024-09-16T07:33:31.405375+0000","last_in_change":"2024-09-16T07:33:24.761978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":45,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:33:31.413925+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-16T07:33:32.624710+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":14,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0a21085c-3d09-4977-9a2b-3283296cc2b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":643,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":2264958825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":2264958825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":2264958825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":2264958825}]},"public_addr":"172.21.15.115:6809/2264958825","cluster_addr":"172.21.15.115:6808/2264958825","heartbeat_back_addr":"172.21.15.115:6812/2264958825","heartbeat_front_addr":"172.21.15.115:6810/2264958825","state":["exists","up"]},{"osd":1,"uuid":"6e18cc80-ae51-4fdd-a98d-2e94ecef5335","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":643,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":796798594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6805","nonce":796798594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":796798594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6803","nonce":796798594}]},"public_addr":"172.21.15.115:6804/796798594","cluster_addr":"172.21.15.115:6805/796798594","heartbeat_back_addr":"172.21.15.115:6802/796798594","heartbeat_front_addr":"172.21.15.115:6803/796798594","state":["exists","up"]},{"osd":2,"uuid":"5116e0ce-2987-4710-91a0-d1ed0d7ae9ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":643,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6807","nonce":2726377752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":2726377752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":2726377752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6813","nonce":2726377752}]},"public_addr":"172.21.15.115:6807/2726377752","cluster_addr":"172.21.15.115:6806/2726377752","heartbeat_back_addr":"172.21.15.115:6814/2726377752","heartbeat_front_addr":"172.21.15.115:6813/2726377752","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]},{"pool":3,"snaps":[{"begin":2,"length":3},{"begin":7,"length":11},{"begin":23,"length":4},{"begin":37,"length":1},{"begin":41,"length":1},{"begin":44,"length":2},{"begin":69,"length":1},{"begin":71,"length":1}]},{"pool":4,"snaps":[{"begin":2,"length":1}]},{"pool":5,"snaps":[{"begin":2,"length":1}]},{"pool":6,"snaps":[{"begin":2,"length":1}]},{"pool":7,"snaps":[{"begin":2,"length":1}]},{"pool":8,"snaps":[{"begin":2,"length":1}]},{"pool":9,"snaps":[{"begin":2,"length":1}]},{"pool":10,"snaps":[{"begin":2,"length":4}]},{"pool":11,"snaps":[{"begin":2,"length":1}]},{"pool":12,"snaps":[{"begin":2,"length":1}]},{"pool":13,"snaps":[{"begin":2,"length":1}]},{"pool":14,"snaps":[{"begin":2,"length":1}]},{"pool":16,"snaps":[{"begin":2,"length":1}]},{"pool":17,"snaps":[{"begin":2,"length":1}]},{"pool":18,"snaps":[{"begin":2,"length":2}]},{"pool":19,"snaps":[{"begin":2,"length":1}]},{"pool":20,"snaps":[{"begin":2,"length":1}]},{"pool":21,"snaps":[{"begin":2,"length":1}]},{"pool":22,"snaps":[{"begin":2,"length":3}]},{"pool":23,"snaps":[{"begin":2,"length":9}]},{"pool":24,"snaps":[{"begin":2,"length":1}]},{"pool":25,"snaps":[{"begin":2,"length":1}]},{"pool":26,"snaps":[{"begin":2,"length":1}]},{"pool":27,"snaps":[{"begin":2,"length":1}]},{"pool":28,"snaps":[{"begin":2,"length":1}]},{"pool":29,"snaps":[{"begin":2,"length":1}]},{"pool":30,"snaps":[{"begin":2,"length":1}]},{"pool":31,"snaps":[{"begin":2,"length":1}]},{"pool":32,"snaps":[{"begin":2,"length":1}]},{"pool":33,"snaps":[{"begin":2,"length":7},{"begin":14,"length":2},{"begin":19,"length":1}]},{"pool":34,"snaps":[{"begin":2,"length":46}]},{"pool":35,"snaps":[{"begin":2,"length":13}]},{"pool":38,"snaps":[{"begin":2,"length":3}]},{"pool":39,"snaps":[{"begin":2,"length":3}]},{"pool":40,"snaps":[{"begin":2,"length":1}]},{"pool":41,"snaps":[{"begin":2,"length":1}]},{"pool":42,"snaps":[{"begin":2,"length":1}]},{"pool":43,"snaps":[{"begin":2,"length":1}]},{"pool":44,"snaps":[{"begin":2,"length":1}]},{"pool":45,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T08:14:42.222 INFO:tasks.ceph:Scrubbing osd.0 2024-09-16T08:14:42.223 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-16T08:14:42.348 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T08:14:42.340+0000 7fd5e3351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:14:42.352 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T08:14:42.352+0000 7fd5e3351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:14:42.367 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-16T08:14:42.367 INFO:teuthology.orchestra.run.smithi115.stdout: "success": "" 2024-09-16T08:14:42.367 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-16T08:14:42.379 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-16T08:14:42.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T08:14:42.483+0000 7f66cf311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:14:42.491 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T08:14:42.492+0000 7f66cf311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:14:42.676 INFO:teuthology.orchestra.run.smithi115.stderr:instructed osd(s) 0 to deep-scrub 2024-09-16T08:14:42.694 INFO:tasks.ceph:Scrubbing osd.1 2024-09-16T08:14:42.694 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-16T08:14:42.806 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T08:14:42.798+0000 7f75de0bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:14:42.809 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T08:14:42.810+0000 7f75de0bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:14:42.824 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-16T08:14:42.824 INFO:teuthology.orchestra.run.smithi115.stdout: "success": "" 2024-09-16T08:14:42.825 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-16T08:14:42.836 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-16T08:14:42.944 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T08:14:42.939+0000 7fc84f591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:14:42.947 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T08:14:42.948+0000 7fc84f591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:14:43.135 INFO:teuthology.orchestra.run.smithi115.stderr:instructed osd(s) 1 to deep-scrub 2024-09-16T08:14:43.156 INFO:tasks.ceph:Scrubbing osd.2 2024-09-16T08:14:43.156 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-16T08:14:43.275 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T08:14:43.266+0000 7f8b61791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:14:43.278 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T08:14:43.279+0000 7f8b61791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:14:43.292 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-16T08:14:43.292 INFO:teuthology.orchestra.run.smithi115.stdout: "success": "" 2024-09-16T08:14:43.292 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-16T08:14:43.311 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-16T08:14:43.421 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T08:14:43.417+0000 7f0adcd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:14:43.425 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T08:14:43.426+0000 7f0adcd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:14:43.611 INFO:teuthology.orchestra.run.smithi115.stderr:instructed osd(s) 2 to deep-scrub 2024-09-16T08:14:43.628 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T08:14:43.737 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T08:14:43.734+0000 7ff4db591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:14:43.740 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T08:14:43.741+0000 7ff4db591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:14:43.923 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T08:14:43.923 INFO:teuthology.orchestra.run.smithi115.stderr:dumped all 2024-09-16T08:14:43.936 INFO:teuthology.orchestra.run.smithi115.stdout:{"pg_ready":true,"pg_map":{"version":1878,"stamp":"2024-09-16T08:14:43.298225+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":283115520,"kb_used":200476,"kb_used_data":3084,"kb_used_omap":0,"kb_used_meta":197056,"kb_avail":282915044,"statfs":{"total":289910292480,"available":289705005056,"internally_reserved":0,"allocated":3158016,"data_stored":2405490,"data_compressed":60100,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":201785344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.941003"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":1890,"reported_epoch":639,"state":"active+clean","last_fresh":"2024-09-16T08:14:30.354818+0000","last_change":"2024-09-16T07:33:36.455637+0000","last_active":"2024-09-16T08:14:30.354818+0000","last_peered":"2024-09-16T08:14:30.354818+0000","last_clean":"2024-09-16T08:14:30.354818+0000","last_became_active":"2024-09-16T07:33:34.518531+0000","last_became_peered":"2024-09-16T07:33:34.518531+0000","last_unstale":"2024-09-16T08:14:30.354818+0000","last_undegraded":"2024-09-16T08:14:30.354818+0000","last_fullsized":"2024-09-16T08:14:30.354818+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_clean_scrub_stamp":"2024-09-16T07:33:33.407142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1890,"reported_epoch":639,"state":"active+clean","last_fresh":"2024-09-16T08:14:30.369326+0000","last_change":"2024-09-16T07:33:36.462702+0000","last_active":"2024-09-16T08:14:30.369326+0000","last_peered":"2024-09-16T08:14:30.369326+0000","last_clean":"2024-09-16T08:14:30.369326+0000","last_became_active":"2024-09-16T07:33:34.538238+0000","last_became_peered":"2024-09-16T07:33:34.538238+0000","last_unstale":"2024-09-16T08:14:30.369326+0000","last_undegraded":"2024-09-16T08:14:30.369326+0000","last_fullsized":"2024-09-16T08:14:30.369326+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_clean_scrub_stamp":"2024-09-16T07:33:33.407142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1890,"reported_epoch":639,"state":"active+clean","last_fresh":"2024-09-16T08:14:30.356908+0000","last_change":"2024-09-16T07:33:36.455932+0000","last_active":"2024-09-16T08:14:30.356908+0000","last_peered":"2024-09-16T08:14:30.356908+0000","last_clean":"2024-09-16T08:14:30.356908+0000","last_became_active":"2024-09-16T07:33:34.499685+0000","last_became_peered":"2024-09-16T07:33:34.499685+0000","last_unstale":"2024-09-16T08:14:30.356908+0000","last_undegraded":"2024-09-16T08:14:30.356908+0000","last_fullsized":"2024-09-16T08:14:30.356908+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_clean_scrub_stamp":"2024-09-16T07:33:33.407142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1890,"reported_epoch":639,"state":"active+clean","last_fresh":"2024-09-16T08:14:30.358015+0000","last_change":"2024-09-16T07:33:36.461997+0000","last_active":"2024-09-16T08:14:30.358015+0000","last_peered":"2024-09-16T08:14:30.358015+0000","last_clean":"2024-09-16T08:14:30.358015+0000","last_became_active":"2024-09-16T07:33:34.525935+0000","last_became_peered":"2024-09-16T07:33:34.525935+0000","last_unstale":"2024-09-16T08:14:30.358015+0000","last_undegraded":"2024-09-16T08:14:30.358015+0000","last_fullsized":"2024-09-16T08:14:30.358015+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_clean_scrub_stamp":"2024-09-16T07:33:33.407142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":1898,"reported_epoch":641,"state":"active+clean","last_fresh":"2024-09-16T08:14:32.361433+0000","last_change":"2024-09-16T07:33:36.459257+0000","last_active":"2024-09-16T08:14:32.361433+0000","last_peered":"2024-09-16T08:14:32.361433+0000","last_clean":"2024-09-16T08:14:32.361433+0000","last_became_active":"2024-09-16T07:33:34.504968+0000","last_became_peered":"2024-09-16T07:33:34.504968+0000","last_unstale":"2024-09-16T08:14:32.361433+0000","last_undegraded":"2024-09-16T08:14:32.361433+0000","last_fullsized":"2024-09-16T08:14:32.361433+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_clean_scrub_stamp":"2024-09-16T07:33:33.407142+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1896,"reported_epoch":641,"state":"active+clean","last_fresh":"2024-09-16T08:14:32.377796+0000","last_change":"2024-09-16T07:33:36.458863+0000","last_active":"2024-09-16T08:14:32.377796+0000","last_peered":"2024-09-16T08:14:32.377796+0000","last_clean":"2024-09-16T08:14:32.377796+0000","last_became_active":"2024-09-16T07:33:34.534328+0000","last_became_peered":"2024-09-16T07:33:34.534328+0000","last_unstale":"2024-09-16T08:14:32.377796+0000","last_undegraded":"2024-09-16T08:14:32.377796+0000","last_fullsized":"2024-09-16T08:14:32.377796+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_clean_scrub_stamp":"2024-09-16T07:33:33.407142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1896,"reported_epoch":641,"state":"active+clean","last_fresh":"2024-09-16T08:14:32.363037+0000","last_change":"2024-09-16T07:33:36.455952+0000","last_active":"2024-09-16T08:14:32.363037+0000","last_peered":"2024-09-16T08:14:32.363037+0000","last_clean":"2024-09-16T08:14:32.363037+0000","last_became_active":"2024-09-16T07:33:34.511137+0000","last_became_peered":"2024-09-16T07:33:34.511137+0000","last_unstale":"2024-09-16T08:14:32.363037+0000","last_undegraded":"2024-09-16T08:14:32.363037+0000","last_fullsized":"2024-09-16T08:14:32.363037+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_clean_scrub_stamp":"2024-09-16T07:33:33.407142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":1891,"reported_epoch":639,"state":"active+clean","last_fresh":"2024-09-16T08:14:30.373468+0000","last_change":"2024-09-16T07:33:36.462968+0000","last_active":"2024-09-16T08:14:30.373468+0000","last_peered":"2024-09-16T08:14:30.373468+0000","last_clean":"2024-09-16T08:14:30.373468+0000","last_became_active":"2024-09-16T07:33:34.503858+0000","last_became_peered":"2024-09-16T07:33:34.503858+0000","last_unstale":"2024-09-16T08:14:30.373468+0000","last_undegraded":"2024-09-16T08:14:30.373468+0000","last_fullsized":"2024-09-16T08:14:30.373468+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:33.407142+0000","last_clean_scrub_stamp":"2024-09-16T07:33:33.407142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":1959,"reported_epoch":639,"state":"active+clean","last_fresh":"2024-09-16T08:14:30.352534+0000","last_change":"2024-09-16T07:33:33.474665+0000","last_active":"2024-09-16T08:14:30.352534+0000","last_peered":"2024-09-16T08:14:30.352534+0000","last_clean":"2024-09-16T08:14:30.352534+0000","last_became_active":"2024-09-16T07:33:33.464426+0000","last_became_peered":"2024-09-16T07:33:33.464426+0000","last_unstale":"2024-09-16T08:14:30.352534+0000","last_undegraded":"2024-09-16T08:14:30.352534+0000","last_fullsized":"2024-09-16T08:14:30.352534+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:32.406213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:32.406213+0000","last_clean_scrub_stamp":"2024-09-16T07:33:32.406213+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30050,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654708117,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":63940,"kb_used_data":980,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94307900,"statfs":{"total":96636764160,"available":96571289600,"internally_reserved":0,"allocated":1003520,"data_stored":403892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359740822,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":68264,"kb_used_data":1064,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94303576,"statfs":{"total":96636764160,"available":96566861824,"internally_reserved":0,"allocated":1089536,"data_stored":1007327,"data_compressed":30050,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654708113,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":68272,"kb_used_data":1040,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94303568,"statfs":{"total":96636764160,"available":96566853632,"internally_reserved":0,"allocated":1064960,"data_stored":994271,"data_compressed":30050,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30050,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T08:14:43.939 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-16T07:33:33.407142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=33, tm_sec=33, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=8, tm_min=14, tm_sec=41, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T08:14:43.940 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-16T07:33:33.407142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=33, tm_sec=33, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=8, tm_min=14, tm_sec=41, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T08:14:43.940 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-16T07:33:33.407142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=33, tm_sec=33, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=8, tm_min=14, tm_sec=41, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T08:14:43.940 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-16T07:33:33.407142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=33, tm_sec=33, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=8, tm_min=14, tm_sec=41, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T08:14:43.940 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-16T07:33:33.407142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=33, tm_sec=33, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=8, tm_min=14, tm_sec=41, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T08:14:43.940 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-16T07:33:33.407142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=33, tm_sec=33, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=8, tm_min=14, tm_sec=41, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T08:14:43.940 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-16T07:33:33.407142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=33, tm_sec=33, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=8, tm_min=14, tm_sec=41, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T08:14:43.940 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-16T07:33:33.407142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=33, tm_sec=33, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=8, tm_min=14, tm_sec=41, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T08:14:43.940 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-16T07:33:32.406213+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=33, tm_sec=32, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=8, tm_min=14, tm_sec=41, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T08:14:43.940 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T08:15:03.942 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T08:15:04.063 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T08:15:04.059+0000 7fac9c948640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:15:04.067 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T08:15:04.066+0000 7fac9c948640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:15:04.251 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-16T08:15:04.251 INFO:teuthology.orchestra.run.smithi115.stderr:dumped all 2024-09-16T08:15:04.264 INFO:teuthology.orchestra.run.smithi115.stdout:{"pg_ready":true,"pg_map":{"version":1889,"stamp":"2024-09-16T08:15:04.006092+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":283115520,"kb_used":226768,"kb_used_data":3296,"kb_used_omap":0,"kb_used_meta":223424,"kb_avail":282888752,"statfs":{"total":289910292480,"available":289678082048,"internally_reserved":0,"allocated":3375104,"data_stored":2510548,"data_compressed":60100,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":228786176},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003151"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":1922,"reported_epoch":649,"state":"active+clean","last_fresh":"2024-09-16T08:14:43.309590+0000","last_change":"2024-09-16T08:14:43.213116+0000","last_active":"2024-09-16T08:14:43.309590+0000","last_peered":"2024-09-16T08:14:43.309590+0000","last_clean":"2024-09-16T08:14:43.309590+0000","last_became_active":"2024-09-16T07:33:34.518531+0000","last_became_peered":"2024-09-16T07:33:34.518531+0000","last_unstale":"2024-09-16T08:14:43.309590+0000","last_undegraded":"2024-09-16T08:14:43.309590+0000","last_fullsized":"2024-09-16T08:14:43.309590+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T08:14:43.212956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T08:14:43.212956+0000","last_clean_scrub_stamp":"2024-09-16T07:33:33.407142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1922,"reported_epoch":649,"state":"active+clean","last_fresh":"2024-09-16T08:14:43.315394+0000","last_change":"2024-09-16T08:14:43.165697+0000","last_active":"2024-09-16T08:14:43.315394+0000","last_peered":"2024-09-16T08:14:43.315394+0000","last_clean":"2024-09-16T08:14:43.315394+0000","last_became_active":"2024-09-16T07:33:34.538238+0000","last_became_peered":"2024-09-16T07:33:34.538238+0000","last_unstale":"2024-09-16T08:14:43.315394+0000","last_undegraded":"2024-09-16T08:14:43.315394+0000","last_fullsized":"2024-09-16T08:14:43.315394+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T08:14:43.165426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T08:14:43.165426+0000","last_clean_scrub_stamp":"2024-09-16T07:33:33.407142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1922,"reported_epoch":649,"state":"active+clean","last_fresh":"2024-09-16T08:14:43.312224+0000","last_change":"2024-09-16T08:14:43.190891+0000","last_active":"2024-09-16T08:14:43.312224+0000","last_peered":"2024-09-16T08:14:43.312224+0000","last_clean":"2024-09-16T08:14:43.312224+0000","last_became_active":"2024-09-16T07:33:34.499685+0000","last_became_peered":"2024-09-16T07:33:34.499685+0000","last_unstale":"2024-09-16T08:14:43.312224+0000","last_undegraded":"2024-09-16T08:14:43.312224+0000","last_fullsized":"2024-09-16T08:14:43.312224+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T08:14:43.190607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T08:14:43.190607+0000","last_clean_scrub_stamp":"2024-09-16T07:33:33.407142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1922,"reported_epoch":649,"state":"active+clean","last_fresh":"2024-09-16T08:14:43.314993+0000","last_change":"2024-09-16T08:14:43.161250+0000","last_active":"2024-09-16T08:14:43.314993+0000","last_peered":"2024-09-16T08:14:43.314993+0000","last_clean":"2024-09-16T08:14:43.314993+0000","last_became_active":"2024-09-16T07:33:34.525935+0000","last_became_peered":"2024-09-16T07:33:34.525935+0000","last_unstale":"2024-09-16T08:14:43.314993+0000","last_undegraded":"2024-09-16T08:14:43.314993+0000","last_fullsized":"2024-09-16T08:14:43.314993+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T08:14:43.160970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T08:14:43.160970+0000","last_clean_scrub_stamp":"2024-09-16T07:33:33.407142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":1924,"reported_epoch":649,"state":"active+clean","last_fresh":"2024-09-16T08:14:43.312982+0000","last_change":"2024-09-16T08:14:42.690929+0000","last_active":"2024-09-16T08:14:43.312982+0000","last_peered":"2024-09-16T08:14:43.312982+0000","last_clean":"2024-09-16T08:14:43.312982+0000","last_became_active":"2024-09-16T07:33:34.504968+0000","last_became_peered":"2024-09-16T07:33:34.504968+0000","last_unstale":"2024-09-16T08:14:43.312982+0000","last_undegraded":"2024-09-16T08:14:43.312982+0000","last_fullsized":"2024-09-16T08:14:43.312982+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'2","last_scrub_stamp":"2024-09-16T08:14:42.690710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T08:14:42.690710+0000","last_clean_scrub_stamp":"2024-09-16T07:33:33.407142+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1922,"reported_epoch":649,"state":"active+clean","last_fresh":"2024-09-16T08:14:43.615591+0000","last_change":"2024-09-16T08:14:43.622581+0000","last_active":"2024-09-16T08:14:43.615591+0000","last_peered":"2024-09-16T08:14:43.615591+0000","last_clean":"2024-09-16T08:14:43.615591+0000","last_became_active":"2024-09-16T07:33:34.534328+0000","last_became_peered":"2024-09-16T07:33:34.534328+0000","last_unstale":"2024-09-16T08:14:43.615591+0000","last_undegraded":"2024-09-16T08:14:43.615591+0000","last_fullsized":"2024-09-16T08:14:43.615591+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T08:14:43.622404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T08:14:43.622404+0000","last_clean_scrub_stamp":"2024-09-16T07:33:33.407142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1922,"reported_epoch":649,"state":"active+clean","last_fresh":"2024-09-16T08:14:43.614365+0000","last_change":"2024-09-16T08:14:43.623213+0000","last_active":"2024-09-16T08:14:43.614365+0000","last_peered":"2024-09-16T08:14:43.614365+0000","last_clean":"2024-09-16T08:14:43.614365+0000","last_became_active":"2024-09-16T07:33:34.511137+0000","last_became_peered":"2024-09-16T07:33:34.511137+0000","last_unstale":"2024-09-16T08:14:43.614365+0000","last_undegraded":"2024-09-16T08:14:43.614365+0000","last_fullsized":"2024-09-16T08:14:43.614365+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T08:14:43.623043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T08:14:43.623043+0000","last_clean_scrub_stamp":"2024-09-16T07:33:33.407142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":1923,"reported_epoch":649,"state":"active+clean","last_fresh":"2024-09-16T08:14:43.316046+0000","last_change":"2024-09-16T08:14:43.210657+0000","last_active":"2024-09-16T08:14:43.316046+0000","last_peered":"2024-09-16T08:14:43.316046+0000","last_clean":"2024-09-16T08:14:43.316046+0000","last_became_active":"2024-09-16T07:33:34.503858+0000","last_became_peered":"2024-09-16T07:33:34.503858+0000","last_unstale":"2024-09-16T08:14:43.316046+0000","last_undegraded":"2024-09-16T08:14:43.316046+0000","last_fullsized":"2024-09-16T08:14:43.316046+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"12'1","last_scrub_stamp":"2024-09-16T08:14:43.210457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T08:14:43.210457+0000","last_clean_scrub_stamp":"2024-09-16T07:33:33.407142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":1991,"reported_epoch":649,"state":"active+clean","last_fresh":"2024-09-16T08:14:43.310587+0000","last_change":"2024-09-16T08:14:43.183233+0000","last_active":"2024-09-16T08:14:43.310587+0000","last_peered":"2024-09-16T08:14:43.310587+0000","last_clean":"2024-09-16T08:14:43.310587+0000","last_became_active":"2024-09-16T07:33:33.464426+0000","last_became_peered":"2024-09-16T07:33:33.464426+0000","last_unstale":"2024-09-16T08:14:43.310587+0000","last_undegraded":"2024-09-16T08:14:43.310587+0000","last_fullsized":"2024-09-16T08:14:43.310587+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"11'52","last_scrub_stamp":"2024-09-16T08:14:43.182905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T08:14:43.182905+0000","last_clean_scrub_stamp":"2024-09-16T07:33:32.406213+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30050,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654708147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":68144,"kb_used_data":1056,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94303696,"statfs":{"total":96636764160,"available":96566984704,"internally_reserved":0,"allocated":1081344,"data_stored":443258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359740852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":90416,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94281424,"statfs":{"total":96636764160,"available":96544178176,"internally_reserved":0,"allocated":1146880,"data_stored":1033645,"data_compressed":30050,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654708143,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":68208,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94303632,"statfs":{"total":96636764160,"available":96566919168,"internally_reserved":0,"allocated":1146880,"data_stored":1033645,"data_compressed":30050,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30050,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T08:15:04.265 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-16T08:15:04.372 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T08:15:04.365+0000 7f23dfb51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:15:04.376 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-16T08:15:04.375+0000 7f23dfb51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:15:04.581 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-16T08:15:04.582 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-16T08:15:04.582 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-16T08:15:04.582 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T08:15:04.672 INFO:tasks.ceph.osd.0:Stopped 2024-09-16T08:15:04.672 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-16T08:15:04.672 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T08:15:04.758 INFO:tasks.ceph.osd.1:Stopped 2024-09-16T08:15:04.758 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-16T08:15:04.759 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T08:15:04.841 INFO:tasks.ceph.osd.2:Stopped 2024-09-16T08:15:04.841 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-16T08:15:04.842 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-16T08:15:04.842 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T08:15:04.871 INFO:tasks.ceph.mgr.x:Stopped 2024-09-16T08:15:04.871 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-16T08:15:04.871 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-16T08:15:04.871 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T08:15:04.929 INFO:tasks.ceph.mon.a:Stopped 2024-09-16T08:15:04.929 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-16T08:15:04.930 DEBUG:teuthology.orchestra.run.smithi115:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'is full \(reached quota' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(POOL_FULL\)' | head -n 1 2024-09-16T08:15:04.998 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi115.front.sepia.ceph.com 2024-09-16T08:15:04.998 DEBUG:teuthology.orchestra.run.smithi115:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-16T08:15:05.243 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi115.front.sepia.ceph.com 2024-09-16T08:15:05.243 DEBUG:teuthology.orchestra.run.smithi115:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-16T08:15:05.350 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi115.front.sepia.ceph.com 2024-09-16T08:15:05.351 DEBUG:teuthology.orchestra.run.smithi115:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-16T08:15:05.440 INFO:tasks.ceph:Archiving mon data... 2024-09-16T08:15:05.442 DEBUG:teuthology.misc:Transferring archived files from smithi115:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/matan-2024-09-16_07:15:55-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7906860/data/mon.a.tgz 2024-09-16T08:15:05.442 DEBUG:teuthology.orchestra.run.smithi115:> mktemp 2024-09-16T08:15:05.459 INFO:teuthology.orchestra.run.smithi115.stdout:/tmp/tmp.bPnM6q9UFp 2024-09-16T08:15:05.460 DEBUG:teuthology.orchestra.run.smithi115:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.bPnM6q9UFp 2024-09-16T08:15:05.587 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 0666 /tmp/tmp.bPnM6q9UFp 2024-09-16T08:15:05.670 DEBUG:teuthology.orchestra.remote:smithi115:/tmp/tmp.bPnM6q9UFp is 276KB 2024-09-16T08:15:05.774 DEBUG:teuthology.orchestra.run.smithi115:> rm -fr /tmp/tmp.bPnM6q9UFp 2024-09-16T08:15:05.790 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-16T08:15:05.790 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-16T08:15:05.910 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-16T08:15:05.911 INFO:tasks.ceph:Archiving crash dumps... 2024-09-16T08:15:05.912 DEBUG:teuthology.misc:Transferring archived files from smithi115:/var/lib/ceph/crash to /home/teuthworker/archive/matan-2024-09-16_07:15:55-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7906860/remote/smithi115/crash 2024-09-16T08:15:05.913 DEBUG:teuthology.orchestra.run.smithi115:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-16T08:15:05.974 INFO:tasks.ceph:Compressing logs... 2024-09-16T08:15:05.974 DEBUG:teuthology.orchestra.run.smithi115:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-16T08:15:06.061 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29216.log 2024-09-16T08:15:06.061 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-16T08:15:06.061 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.29216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74945.log 2024-09-16T08:15:06.061 INFO:teuthology.orchestra.run.smithi115.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29216.log.gz 2024-09-16T08:15:06.062 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51756.log 2024-09-16T08:15:06.062 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.74945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75239.log 2024-09-16T08:15:06.062 INFO:teuthology.orchestra.run.smithi115.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.74945.log.gz 2024-09-16T08:15:06.062 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.51756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29724.log 2024-09-16T08:15:06.062 INFO:teuthology.orchestra.run.smithi115.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.51756.log.gz 2024-09-16T08:15:06.062 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.75239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28967.log 2024-09-16T08:15:06.062 INFO:teuthology.orchestra.run.smithi115.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.75239.log.gz 2024-09-16T08:15:06.062 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.29724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57920.log 2024-09-16T08:15:06.062 INFO:teuthology.orchestra.run.smithi115.stderr: 66.7% -- replaced with /var/log/ceph/ceph-client.admin.29724.log.gz 2024-09-16T08:15:06.062 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.28967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75323.log 2024-09-16T08:15:06.062 INFO:teuthology.orchestra.run.smithi115.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28967.log.gz 2024-09-16T08:15:06.062 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.57920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29836.log 2024-09-16T08:15:06.062 INFO:teuthology.orchestra.run.smithi115.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.57920.log.gz 2024-09-16T08:15:06.063 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.75323.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-16T08:15:06.063 INFO:teuthology.orchestra.run.smithi115.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.75323.log.gz 2024-09-16T08:15:06.063 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.29836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29920.log 2024-09-16T08:15:06.063 INFO:teuthology.orchestra.run.smithi115.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29836.log.gz 2024-09-16T08:15:06.063 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30002.log 2024-09-16T08:15:06.063 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.29920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46345.log 2024-09-16T08:15:06.063 INFO:teuthology.orchestra.run.smithi115.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29920.log.gz 2024-09-16T08:15:06.063 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.30002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30000.log 2024-09-16T08:15:06.063 INFO:teuthology.orchestra.run.smithi115.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30002.log.gz 2024-09-16T08:15:06.063 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.46345.log: gzip 79.9% -5 -- replaced with /var/log/ceph/ceph-client.admin.46345.log.gz --verbose 2024-09-16T08:15:06.063 INFO:teuthology.orchestra.run.smithi115.stderr: -- /var/log/ceph/ceph-client.admin.73807.log 2024-09-16T08:15:06.063 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.30000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68330.log 2024-09-16T08:15:06.064 INFO:teuthology.orchestra.run.smithi115.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30000.log.gz 2024-09-16T08:15:06.064 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.73807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30298.log 2024-09-16T08:15:06.064 INFO:teuthology.orchestra.run.smithi115.stderr: 76.6% -- replaced with /var/log/ceph/ceph-client.admin.73807.log.gz 2024-09-16T08:15:06.064 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.68330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30088.log 2024-09-16T08:15:06.064 INFO:teuthology.orchestra.run.smithi115.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.68330.log.gz 2024-09-16T08:15:06.064 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.30298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29878.log 2024-09-16T08:15:06.064 INFO:teuthology.orchestra.run.smithi115.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30298.log.gz 2024-09-16T08:15:06.064 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.30088.log: gzip 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30088.log.gz -5 2024-09-16T08:15:06.064 INFO:teuthology.orchestra.run.smithi115.stderr: --verbose -- /var/log/ceph/ceph-client.admin.40175.log 2024-09-16T08:15:06.064 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.29878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74664.log 2024-09-16T08:15:06.064 INFO:teuthology.orchestra.run.smithi115.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29878.log.gz 2024-09-16T08:15:06.064 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.40175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29246.log 2024-09-16T08:15:06.064 INFO:teuthology.orchestra.run.smithi115.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.40175.log.gz 2024-09-16T08:15:06.065 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.74664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75281.log 2024-09-16T08:15:06.065 INFO:teuthology.orchestra.run.smithi115.stderr: 77.1% -- replaced with /var/log/ceph/ceph-client.admin.74664.log.gz 2024-09-16T08:15:06.065 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.29246.log: gzip -5 --verbose -- 49.6% /var/log/ceph/ceph.audit.log 2024-09-16T08:15:06.065 INFO:teuthology.orchestra.run.smithi115.stderr: -- replaced with /var/log/ceph/ceph-client.admin.29246.log.gz 2024-09-16T08:15:06.065 INFO:teuthology.orchestra.run.smithi115.stderr:gzip/var/log/ceph/ceph-client.admin.75281.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.46273.log 2024-09-16T08:15:06.065 INFO:teuthology.orchestra.run.smithi115.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.75281.log.gz 2024-09-16T08:15:06.065 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28857.log 2024-09-16T08:15:06.065 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.46273.log: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.46273.log.gzgzip 2024-09-16T08:15:06.065 INFO:teuthology.orchestra.run.smithi115.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.30516.log 2024-09-16T08:15:06.065 INFO:teuthology.orchestra.run.smithi115.stderr: 88.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-16T08:15:06.065 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75029.log 2024-09-16T08:15:06.065 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.28857.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.28857.log.gz 2024-09-16T08:15:06.065 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.30516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74765.log 2024-09-16T08:15:06.066 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.75029.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.75029.log.gz 2024-09-16T08:15:06.066 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28769.log 2024-09-16T08:15:06.066 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74987.log 2024-09-16T08:15:06.066 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.74765.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.30516.log.gz 2024-09-16T08:15:06.066 INFO:teuthology.orchestra.run.smithi115.stderr: 76.7% -- replaced with /var/log/ceph/ceph-client.admin.74765.log.gz 2024-09-16T08:15:06.066 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.28769.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.28769.log.gz 2024-09-16T08:15:06.066 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30127.log 2024-09-16T08:15:06.066 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.74987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74510.log 2024-09-16T08:15:06.066 INFO:teuthology.orchestra.run.smithi115.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.74987.log.gz 2024-09-16T08:15:06.066 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.30127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73939.log 2024-09-16T08:15:06.066 INFO:teuthology.orchestra.run.smithi115.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30127.log.gz 2024-09-16T08:15:06.066 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.74510.log: 76.9% -- replaced with /var/log/ceph/ceph-client.admin.74510.log.gz 2024-09-16T08:15:06.066 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74716.log 2024-09-16T08:15:06.067 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.73939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40059.log 2024-09-16T08:15:06.067 INFO:teuthology.orchestra.run.smithi115.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.73939.log.gz 2024-09-16T08:15:06.067 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.74716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29794.log 2024-09-16T08:15:06.067 INFO:teuthology.orchestra.run.smithi115.stderr: 76.9% -- replaced with /var/log/ceph/ceph-client.admin.74716.log.gz 2024-09-16T08:15:06.067 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.40059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75365.log 2024-09-16T08:15:06.067 INFO:teuthology.orchestra.run.smithi115.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.40059.log.gz 2024-09-16T08:15:06.067 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.29794.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29794.log.gz 2024-09-16T08:15:06.067 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30001.log 2024-09-16T08:15:06.067 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.75365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75405.log 2024-09-16T08:15:06.067 INFO:teuthology.orchestra.run.smithi115.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.75365.log.gz 2024-09-16T08:15:06.067 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.30001.log: gzip -5 49.6% --verbose -- replaced with /var/log/ceph/ceph-client.admin.30001.log.gz -- 2024-09-16T08:15:06.067 INFO:teuthology.orchestra.run.smithi115.stderr: /var/log/ceph/ceph-mon.a.log 2024-09-16T08:15:06.067 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.75405.log: gzip 50.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.75405.log.gz 2024-09-16T08:15:06.068 INFO:teuthology.orchestra.run.smithi115.stderr: -- /var/log/ceph/ceph-client.admin.29007.log 2024-09-16T08:15:06.068 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29699.log 2024-09-16T08:15:06.068 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.29007.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29007.log.gz 2024-09-16T08:15:06.068 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73873.log 2024-09-16T08:15:06.068 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-16T08:15:06.068 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.29699.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29699.log.gz 2024-09-16T08:15:06.068 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.73873.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-16T08:15:06.068 INFO:teuthology.orchestra.run.smithi115.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.73873.log.gz 2024-09-16T08:15:06.068 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75113.log 2024-09-16T08:15:06.068 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-16T08:15:06.068 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.75113.log: gzip -5 --verbose 49.6% -- replaced with /var/log/ceph/ceph-client.admin.75113.log.gz 2024-09-16T08:15:06.068 INFO:teuthology.orchestra.run.smithi115.stderr: -- /var/log/ceph/ceph-client.admin.74562.log 2024-09-16T08:15:06.068 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74615.log 2024-09-16T08:15:06.069 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.74562.log: gzip -5 --verbose 83.3% -- replaced with /var/log/ceph/ceph-client.admin.74562.log.gz 2024-09-16T08:15:06.069 INFO:teuthology.orchestra.run.smithi115.stderr: -- /var/log/ceph/ceph.tmp-client.admin.27403.log 2024-09-16T08:15:06.069 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46412.log 2024-09-16T08:15:06.069 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph.tmp-client.admin.27403.log: /var/log/ceph/ceph-client.admin.74615.log: 67.7% 76.9% -- replaced with /var/log/ceph/ceph-client.admin.74615.log.gz 2024-09-16T08:15:06.069 INFO:teuthology.orchestra.run.smithi115.stderr: -- replaced with /var/log/ceph/ceph.tmp-client.admin.27403.log.gz 2024-09-16T08:15:06.069 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75197.log 2024-09-16T08:15:06.069 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.46412.log: gzip 80.5% -- replaced with /var/log/ceph/ceph-client.admin.46412.log.gz 2024-09-16T08:15:06.069 INFO:teuthology.orchestra.run.smithi115.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.29643.log 2024-09-16T08:15:06.069 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74903.log 2024-09-16T08:15:06.069 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.29643.log: /var/log/ceph/ceph-client.admin.75197.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.75197.log.gz 2024-09-16T08:15:06.069 INFO:teuthology.orchestra.run.smithi115.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29643.log.gz 2024-09-16T08:15:06.069 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30128.log 2024-09-16T08:15:06.069 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30256.log 2024-09-16T08:15:06.069 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.74903.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.74903.log.gz 2024-09-16T08:15:06.070 INFO:teuthology.orchestra.run.smithi115.stderr: 88.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-16T08:15:06.070 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.30128.log: 50.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74447.log 2024-09-16T08:15:06.070 INFO:teuthology.orchestra.run.smithi115.stderr: -- replaced with /var/log/ceph/ceph-client.admin.30128.log.gz 2024-09-16T08:15:06.070 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.30256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30214.log 2024-09-16T08:15:06.070 INFO:teuthology.orchestra.run.smithi115.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30256.log.gz 2024-09-16T08:15:06.070 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.74447.log: -- /var/log/ceph/ceph-client.admin.75155.log 2024-09-16T08:15:06.070 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.30214.log: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.74447.log.gz 2024-09-16T08:15:06.070 INFO:teuthology.orchestra.run.smithi115.stderr:gzip 50.0% -5 --verbose -- /var/log/ceph/ceph-client.admin.29058.log 2024-09-16T08:15:06.070 INFO:teuthology.orchestra.run.smithi115.stderr: -- replaced with /var/log/ceph/ceph-client.admin.30214.log.gz 2024-09-16T08:15:06.070 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.75155.log: gzip -5 --verbose -- 49.6% -- replaced with /var/log/ceph/ceph-client.admin.75155.log.gz 2024-09-16T08:15:06.070 INFO:teuthology.orchestra.run.smithi115.stderr: /var/log/ceph/ceph-client.admin.75071.log 2024-09-16T08:15:06.070 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.29058.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29058.log.gz 2024-09-16T08:15:06.070 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.75071.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.75071.log.gz 2024-09-16T08:15:06.211 INFO:teuthology.orchestra.run.smithi115.stderr: 93.3% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-16T08:15:07.001 INFO:teuthology.orchestra.run.smithi115.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-16T08:15:22.290 INFO:teuthology.orchestra.run.smithi115.stderr: 94.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-16T08:15:22.545 INFO:teuthology.orchestra.run.smithi115.stderr: 94.4% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-16T08:15:22.631 INFO:teuthology.orchestra.run.smithi115.stderr: 94.4% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-16T08:15:22.633 INFO:teuthology.orchestra.run.smithi115.stderr: 2024-09-16T08:15:22.634 INFO:teuthology.orchestra.run.smithi115.stderr:real 0m16.604s 2024-09-16T08:15:22.634 INFO:teuthology.orchestra.run.smithi115.stderr:user 0m48.339s 2024-09-16T08:15:22.634 INFO:teuthology.orchestra.run.smithi115.stderr:sys 0m2.055s 2024-09-16T08:15:22.634 INFO:tasks.ceph:Archiving logs... 2024-09-16T08:15:22.634 DEBUG:teuthology.misc:Transferring archived files from smithi115:/var/log/ceph to /home/teuthworker/archive/matan-2024-09-16_07:15:55-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7906860/remote/smithi115/log 2024-09-16T08:15:22.635 DEBUG:teuthology.orchestra.run.smithi115:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-16T08:15:29.484 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-16T08:15:29.493 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-16T08:15:29.494 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-16T08:15:29.555 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-16T08:15:29.564 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-16T08:15:29.564 DEBUG:teuthology.orchestra.run.smithi115:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T08:15:29.585 INFO:teuthology.orchestra.run.smithi115.stderr:bash: line 1: ntpq: command not found 2024-09-16T08:15:29.590 INFO:teuthology.orchestra.run.smithi115.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T08:15:29.590 INFO:teuthology.orchestra.run.smithi115.stdout:=============================================================================== 2024-09-16T08:15:29.590 INFO:teuthology.orchestra.run.smithi115.stdout:^* hv01.front.sepia.ceph.com 3 6 377 58 +1226us[+1235us] +/- 38ms 2024-09-16T08:15:29.590 INFO:teuthology.orchestra.run.smithi115.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 56 -3870us[-3870us] +/- 77ms 2024-09-16T08:15:29.590 INFO:teuthology.orchestra.run.smithi115.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 120 +1279us[+1287us] +/- 78ms 2024-09-16T08:15:29.590 INFO:teuthology.orchestra.run.smithi115.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T08:15:29.591 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-16T08:15:29.599 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-16T08:15:29.600 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-16T08:15:29.607 DEBUG:teuthology.orchestra.run.smithi115:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-16T08:15:29.697 DEBUG:teuthology.orchestra.run.smithi115:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T08:15:29.725 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T08:15:29.726 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-16T08:15:29.735 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-16T08:15:29.744 INFO:teuthology.task.internal:Duration was 2936.208033 seconds 2024-09-16T08:15:29.744 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-16T08:15:29.752 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-16T08:15:29.752 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-16T08:15:29.806 INFO:teuthology.orchestra.run.smithi115.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T08:15:30.017 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-16T08:15:30.017 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi115.front.sepia.ceph.com 2024-09-16T08:15:30.017 DEBUG:teuthology.orchestra.run.smithi115:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-16T08:15:30.078 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-16T08:15:30.078 DEBUG:teuthology.orchestra.run.smithi115:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-16T08:15:30.145 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-16T08:15:30.145 DEBUG:teuthology.orchestra.run.smithi115:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-16T08:15:30.287 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-16T08:15:30.296 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-16T08:15:30.297 DEBUG:teuthology.orchestra.run.smithi115:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-16T08:15:30.322 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-16T08:15:30.330 DEBUG:teuthology.orchestra.run.smithi115:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-16T08:15:30.384 INFO:teuthology.orchestra.run.smithi115.stdout:kernel.core_pattern = core 2024-09-16T08:15:30.397 DEBUG:teuthology.orchestra.run.smithi115:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-16T08:15:30.450 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T08:15:30.450 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-16T08:15:30.465 INFO:teuthology.task.internal:Transferring archived files... 2024-09-16T08:15:30.466 DEBUG:teuthology.misc:Transferring archived files from smithi115:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/matan-2024-09-16_07:15:55-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7906860/remote/smithi115 2024-09-16T08:15:30.467 DEBUG:teuthology.orchestra.run.smithi115:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-16T08:15:30.525 INFO:teuthology.task.internal:Removing archive directory... 2024-09-16T08:15:30.525 DEBUG:teuthology.orchestra.run.smithi115:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-16T08:15:30.575 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-16T08:15:30.586 INFO:teuthology.task.internal:Not uploading archives. 2024-09-16T08:15:30.586 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-16T08:15:30.594 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-16T08:15:30.595 DEBUG:teuthology.orchestra.run.smithi115:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-16T08:15:30.630 INFO:teuthology.orchestra.run.smithi115.stdout: 265972 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 16 08:15 /home/ubuntu/cephtest 2024-09-16T08:15:30.631 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-16T08:15:30.641 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-16T08:15:30.661 INFO:teuthology.run:Summary data: description: crimson-rados/rbd/{clusters/fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore tasks/rbd_api_tests} duration: 2936.208032608032 flavor: crimson owner: scheduled_matan@teuthology success: true 2024-09-16T08:15:30.662 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-16T08:15:30.736 INFO:teuthology.run:pass