2024-09-16T16:31:41.375 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-16T16:31:41.390 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-16T16:31:41.476 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7907393 branch: wip-matanb-crimson-testing-59543 description: crimson-rados/rbd/{clusters/fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore tasks/rbd_api_tests_old_format} email: null first_in_suite: false job_id: '7907393' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-matanb-crimson-testing-59543 ceph: conf: global: enable experimental unrecoverable data corrupting features: crimson ms client mode: crc ms cluster mode: crc ms mon client mode: crc ms mon cluster mode: crc ms mon service mode: crc ms service mode: crc mgr: debug mgr: 20 debug ms: 1 mgr stats period: 30 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd pool default crimson: true osd: bluestore block size: 96636764160 bluestore compression algorithm: snappy bluestore compression mode: aggressive bluestore fsck on mount: true bluestore rocksdb cf: false crimson alien thread cpu cores: 6-7 crimson osd obc lru size: 10 debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 err to stderr: true log flush on exit: true log to file: false log to stderr: true mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd.0: crimson seastar cpu cores: 0-1 osd.1: crimson seastar cpu cores: 2-3 osd.2: crimson seastar cpu cores: 4-5 flavor: crimson fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(CACHE_POOL_NO_HIT_SET\) - \(POOL_APP_NOT_ENABLED\) - is full \(reached quota - \(POOL_FULL\) sha1: 81fedcb3b484c843d22ffbc8d179cb567b7083b5 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log global: osd crush chooseleaf type: 0 osd pool default pg num: 128 osd pool default pgp num: 128 osd pool default size: 2 mon: {} install: ceph: flavor: crimson sha1: 81fedcb3b484c843d22ffbc8d179cb567b7083b5 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 workunit: branch: main env: CRIMSON_COMPAT: '1' sha1: 0325fd3c11a225c0fd9eb38fab88aad1370ad779 owner: scheduled_matan@teuthology priority: 60 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 seed: 6678 sha1: 81fedcb3b484c843d22ffbc8d179cb567b7083b5 sleep_before_teardown: 0 suite: crimson-rados suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 0325fd3c11a225c0fd9eb38fab88aad1370ad779 targets: smithi172.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGcOfqPrhU2PrL2dowLgnnIN35RzIgwLeT/uRxHrUymUf7Y0pWos5orbBU+sMrm7JB5LdMpaau/ePDFk4xqulTo= tasks: - install: null - ceph: conf: mon: mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 paxos service trim min: 10 osd: debug monc: 20 flavor: crimson - workunit: clients: client.0: - rbd/crimson/test_crimson_librbd.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-16_16:23:48 tube: smithi user: matan verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-16T16:31:41.477 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa; will attempt to use it 2024-09-16T16:31:41.477 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa/tasks 2024-09-16T16:31:41.477 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-16T16:31:41.479 INFO:teuthology.task.internal:Checking packages... 2024-09-16T16:31:41.500 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'crimson' and ceph hash '81fedcb3b484c843d22ffbc8d179cb567b7083b5' 2024-09-16T16:31:41.500 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-16T16:31:41.500 INFO:teuthology.packaging:ref: None 2024-09-16T16:31:41.500 INFO:teuthology.packaging:tag: None 2024-09-16T16:31:41.500 INFO:teuthology.packaging:branch: wip-matanb-crimson-testing-59543 2024-09-16T16:31:41.500 INFO:teuthology.packaging:sha1: 81fedcb3b484c843d22ffbc8d179cb567b7083b5 2024-09-16T16:31:41.501 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&ref=wip-matanb-crimson-testing-59543 2024-09-16T16:31:41.637 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4879.g81fedcb3 2024-09-16T16:31:41.638 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-16T16:31:41.645 INFO:teuthology.task.internal:no buildpackages task found 2024-09-16T16:31:41.645 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-16T16:31:41.661 INFO:teuthology.task.internal:Saving configuration 2024-09-16T16:31:41.674 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-16T16:31:41.706 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-16T16:31:41.729 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi172.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7907393', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-16 16:24:59.531657', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGcOfqPrhU2PrL2dowLgnnIN35RzIgwLeT/uRxHrUymUf7Y0pWos5orbBU+sMrm7JB5LdMpaau/ePDFk4xqulTo='} 2024-09-16T16:31:41.729 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-16T16:31:41.737 INFO:teuthology.task.internal:roles: ubuntu@smithi172.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2024-09-16T16:31:41.737 INFO:teuthology.run_tasks:Running task console_log... 2024-09-16T16:31:41.771 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4246167be0>, signals=[15]) 2024-09-16T16:31:41.772 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-16T16:31:41.779 INFO:teuthology.task.internal:Opening connections... 2024-09-16T16:31:41.779 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi172.front.sepia.ceph.com 2024-09-16T16:31:41.780 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T16:31:41.853 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-16T16:31:41.860 DEBUG:teuthology.orchestra.run.smithi172:> uname -m 2024-09-16T16:31:41.938 INFO:teuthology.orchestra.run.smithi172.stdout:x86_64 2024-09-16T16:31:41.939 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release 2024-09-16T16:31:41.995 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="CentOS Stream" 2024-09-16T16:31:41.995 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="9" 2024-09-16T16:31:41.995 INFO:teuthology.orchestra.run.smithi172.stdout:ID="centos" 2024-09-16T16:31:41.995 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="rhel fedora" 2024-09-16T16:31:41.996 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="9" 2024-09-16T16:31:41.996 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el9" 2024-09-16T16:31:41.996 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-16T16:31:41.996 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31" 2024-09-16T16:31:41.996 INFO:teuthology.orchestra.run.smithi172.stdout:LOGO="fedora-logo-icon" 2024-09-16T16:31:41.996 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-16T16:31:41.996 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://centos.org/" 2024-09-16T16:31:41.996 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-16T16:31:41.996 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-16T16:31:41.996 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-16T16:31:41.997 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2024-09-16T16:31:42.019 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-16T16:31:42.026 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-16T16:31:42.034 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-16T16:31:42.035 DEBUG:teuthology.orchestra.run.smithi172:> test '!' -e /home/ubuntu/cephtest 2024-09-16T16:31:42.052 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-16T16:31:42.057 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-16T16:31:42.057 DEBUG:teuthology.orchestra.run.smithi172:> test -z $(ls -A /var/lib/ceph) 2024-09-16T16:31:42.118 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-16T16:31:42.154 INFO:teuthology.run_tasks:Running task kernel... 2024-09-16T16:31:42.166 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-09-16T16:31:42.167 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-09-16T16:31:42.167 DEBUG:teuthology.orchestra.run.smithi172:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-16T16:31:42.183 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T16:31:42.184 DEBUG:teuthology.orchestra.run.smithi172:> uname -r 2024-09-16T16:31:42.242 INFO:teuthology.orchestra.run.smithi172.stdout:5.14.0-503.el9.x86_64 2024-09-16T16:31:42.242 INFO:teuthology.task.kernel:Running kernel on smithi172: 5.14.0-503.el9.x86_64 2024-09-16T16:31:42.242 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum install -y kernel 2024-09-16T16:31:44.777 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.2 MB 00:00 2024-09-16T16:31:46.911 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - AppStream 20 MB/s | 20 MB 00:01 2024-09-16T16:31:51.879 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - CRB 5.8 MB/s | 6.5 MB 00:01 2024-09-16T16:31:54.871 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - Extras packages 10 kB/s | 19 kB 00:01 2024-09-16T16:31:56.200 INFO:teuthology.orchestra.run.smithi172.stdout:Extra Packages for Enterprise Linux 19 MB/s | 23 MB 00:01 2024-09-16T16:32:01.663 INFO:teuthology.orchestra.run.smithi172.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-16T16:32:03.711 INFO:teuthology.orchestra.run.smithi172.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-16T16:32:03.711 INFO:teuthology.orchestra.run.smithi172.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-16T16:32:03.816 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-16T16:32:03.821 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T16:32:03.821 INFO:teuthology.orchestra.run.smithi172.stdout: Package Architecture Version Repository Size 2024-09-16T16:32:03.821 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T16:32:03.821 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-09-16T16:32:03.821 INFO:teuthology.orchestra.run.smithi172.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-16T16:32:03.821 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2024-09-16T16:32:03.821 INFO:teuthology.orchestra.run.smithi172.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-16T16:32:03.821 INFO:teuthology.orchestra.run.smithi172.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-16T16:32:03.821 INFO:teuthology.orchestra.run.smithi172.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-16T16:32:03.821 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:32:03.821 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-09-16T16:32:03.821 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T16:32:03.822 INFO:teuthology.orchestra.run.smithi172.stdout:Install 4 Packages 2024-09-16T16:32:03.822 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:32:03.822 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 79 M 2024-09-16T16:32:03.822 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 126 M 2024-09-16T16:32:03.822 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-09-16T16:32:04.398 INFO:teuthology.orchestra.run.smithi172.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 41 kB/s | 23 kB 00:00 2024-09-16T16:32:05.232 INFO:teuthology.orchestra.run.smithi172.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-09-16T16:32:05.890 INFO:teuthology.orchestra.run.smithi172.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 17 MB/s | 35 MB 00:02 2024-09-16T16:32:07.066 INFO:teuthology.orchestra.run.smithi172.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 11 MB/s | 29 MB 00:02 2024-09-16T16:32:07.066 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:32:07.066 INFO:teuthology.orchestra.run.smithi172.stdout:Total 24 MB/s | 79 MB 00:03 2024-09-16T16:32:07.752 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-09-16T16:32:08.119 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-09-16T16:32:08.119 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-09-16T16:32:09.068 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-09-16T16:32:09.068 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-09-16T16:32:11.515 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-09-16T16:32:12.258 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-16T16:32:12.350 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T16:32:15.153 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T16:32:15.287 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T16:32:20.099 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T16:32:20.287 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T16:32:25.100 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T16:33:02.921 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T16:33:02.963 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-16T16:33:03.310 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T16:33:03.310 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-16T16:33:03.310 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T16:33:03.311 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T16:33:04.180 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T16:33:04.180 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:33:04.180 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-09-16T16:33:04.180 INFO:teuthology.orchestra.run.smithi172.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-16T16:33:04.180 INFO:teuthology.orchestra.run.smithi172.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-16T16:33:04.181 INFO:teuthology.orchestra.run.smithi172.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-16T16:33:04.181 INFO:teuthology.orchestra.run.smithi172.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-16T16:33:04.181 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:33:04.181 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-16T16:33:04.545 DEBUG:teuthology.orchestra.run.smithi172:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T16:33:04.630 INFO:teuthology.orchestra.run.smithi172.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T16:33:04.631 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T16:33:04.631 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-16T16:33:04.631 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-16T16:33:04.631 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-16T16:33:04.631 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-16T16:33:04.632 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi172.front.sepia.ceph.com, path=None, version=distro) 2024-09-16T16:33:04.632 DEBUG:teuthology.orchestra.run.smithi172:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T16:33:04.690 INFO:teuthology.orchestra.run.smithi172.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T16:33:04.690 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T16:33:04.690 DEBUG:teuthology.orchestra.run.smithi172:> sudo rpm -qi grub2-tools 2024-09-16T16:33:04.727 INFO:teuthology.orchestra.run.smithi172.stdout:Name : grub2-tools 2024-09-16T16:33:04.727 INFO:teuthology.orchestra.run.smithi172.stdout:Epoch : 1 2024-09-16T16:33:04.727 INFO:teuthology.orchestra.run.smithi172.stdout:Version : 2.06 2024-09-16T16:33:04.727 INFO:teuthology.orchestra.run.smithi172.stdout:Release : 82.el9 2024-09-16T16:33:04.727 INFO:teuthology.orchestra.run.smithi172.stdout:Architecture: x86_64 2024-09-16T16:33:04.727 INFO:teuthology.orchestra.run.smithi172.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-16T16:33:04.727 INFO:teuthology.orchestra.run.smithi172.stdout:Group : Unspecified 2024-09-16T16:33:04.728 INFO:teuthology.orchestra.run.smithi172.stdout:Size : 8274670 2024-09-16T16:33:04.728 INFO:teuthology.orchestra.run.smithi172.stdout:License : GPLv3+ 2024-09-16T16:33:04.728 INFO:teuthology.orchestra.run.smithi172.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-16T16:33:04.728 INFO:teuthology.orchestra.run.smithi172.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-16T16:33:04.728 INFO:teuthology.orchestra.run.smithi172.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-16T16:33:04.728 INFO:teuthology.orchestra.run.smithi172.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-16T16:33:04.728 INFO:teuthology.orchestra.run.smithi172.stdout:Packager : builder@centos.org 2024-09-16T16:33:04.728 INFO:teuthology.orchestra.run.smithi172.stdout:Vendor : CentOS 2024-09-16T16:33:04.728 INFO:teuthology.orchestra.run.smithi172.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-16T16:33:04.728 INFO:teuthology.orchestra.run.smithi172.stdout:Summary : Support tools for GRUB. 2024-09-16T16:33:04.728 INFO:teuthology.orchestra.run.smithi172.stdout:Description : 2024-09-16T16:33:04.728 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:33:04.728 INFO:teuthology.orchestra.run.smithi172.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-16T16:33:04.729 INFO:teuthology.orchestra.run.smithi172.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-16T16:33:04.729 INFO:teuthology.orchestra.run.smithi172.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-16T16:33:04.729 INFO:teuthology.orchestra.run.smithi172.stdout:hardware devices. 2024-09-16T16:33:04.729 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:33:04.729 INFO:teuthology.orchestra.run.smithi172.stdout:This subpackage provides tools for support of all platforms. 2024-09-16T16:33:04.730 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-16T16:33:04.730 INFO:teuthology.task.kernel:Updating grub on smithi172 to boot 5.14.0-505.el9.x86_64 2024-09-16T16:33:04.730 DEBUG:teuthology.orchestra.run.smithi172:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-16T16:33:05.319 INFO:teuthology.orchestra.run.smithi172.stderr:Generating grub configuration file ... 2024-09-16T16:33:06.647 INFO:teuthology.orchestra.run.smithi172.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-16T16:33:06.683 INFO:teuthology.orchestra.run.smithi172.stderr:done 2024-09-16T16:33:06.685 DEBUG:teuthology.orchestra.run.smithi172:> mktemp 2024-09-16T16:33:06.701 INFO:teuthology.orchestra.run.smithi172.stdout:/tmp/tmp.ESo6W5SsDy 2024-09-16T16:33:06.701 DEBUG:teuthology.orchestra.run.smithi172:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.ESo6W5SsDy 2024-09-16T16:33:06.769 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 0666 /tmp/tmp.ESo6W5SsDy 2024-09-16T16:33:06.907 DEBUG:teuthology.orchestra.remote:smithi172:/tmp/tmp.ESo6W5SsDy is 6KB 2024-09-16T16:33:06.955 DEBUG:teuthology.orchestra.run.smithi172:> rm -fr /tmp/tmp.ESo6W5SsDy 2024-09-16T16:33:06.970 DEBUG:teuthology.orchestra.run.smithi172:> sudo /bin/ls /boot/loader/entries || true 2024-09-16T16:33:07.044 INFO:teuthology.orchestra.run.smithi172.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-16T16:33:07.044 INFO:teuthology.orchestra.run.smithi172.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-16T16:33:07.044 INFO:teuthology.orchestra.run.smithi172.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-16T16:33:07.044 INFO:teuthology.orchestra.run.smithi172.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-16T16:33:07.046 DEBUG:teuthology.orchestra.run.smithi172:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-16T16:33:07.220 DEBUG:teuthology.orchestra.run.smithi172:> sudo shutdown -r now 2024-09-16T16:33:37.253 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-16T16:33:37.254 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-09-16T16:33:37.255 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T16:33:55.773 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-09-16T16:34:04.783 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-09-16T16:34:04.784 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T16:34:07.837 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-09-16T16:34:19.849 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-09-16T16:34:19.850 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T16:34:38.273 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-09-16T16:34:53.289 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-09-16T16:34:53.290 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T16:34:53.611 DEBUG:teuthology.orchestra.run.smithi172:> true 2024-09-16T16:34:53.979 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-09-16T16:34:53.979 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-16T16:34:53.979 DEBUG:teuthology.orchestra.run.smithi172:> uname -r 2024-09-16T16:34:53.994 INFO:teuthology.orchestra.run.smithi172.stdout:5.14.0-505.el9.x86_64 2024-09-16T16:34:53.995 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-16T16:34:53.995 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-16T16:34:53.995 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-16T16:34:54.996 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-16T16:34:54.996 DEBUG:teuthology.orchestra.run.smithi172:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-16T16:34:55.083 INFO:teuthology.orchestra.run.smithi172.stdout:ttyS1 2024-09-16T16:34:55.103 DEBUG:teuthology.parallel:result is None 2024-09-16T16:34:55.103 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-16T16:34:55.114 INFO:teuthology.task.internal:Creating test directory... 2024-09-16T16:34:55.115 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-16T16:34:55.130 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-16T16:34:55.136 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-16T16:34:55.144 INFO:teuthology.task.internal:Creating archive directory... 2024-09-16T16:34:55.144 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-16T16:34:55.213 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-16T16:34:55.219 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-16T16:34:55.220 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-16T16:34:55.398 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T16:34:55.409 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T16:34:55.410 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-16T16:34:55.419 INFO:teuthology.task.internal:Configuring sudo... 2024-09-16T16:34:55.420 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-16T16:34:55.445 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-16T16:34:55.455 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-16T16:34:55.455 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-16T16:34:55.501 DEBUG:teuthology.orchestra.run.smithi172:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T16:34:55.583 DEBUG:teuthology.orchestra.run.smithi172:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T16:34:55.651 DEBUG:teuthology.orchestra.run.smithi172:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T16:34:55.698 DEBUG:teuthology.orchestra.run.smithi172:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T16:34:55.764 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-16T16:34:55.765 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-16T16:34:55.823 DEBUG:teuthology.orchestra.run.smithi172:> sudo service rsyslog restart 2024-09-16T16:34:55.973 INFO:teuthology.orchestra.run.smithi172.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T16:34:56.483 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-16T16:34:56.490 INFO:teuthology.task.internal:Starting timer... 2024-09-16T16:34:56.491 INFO:teuthology.run_tasks:Running task pcp... 2024-09-16T16:34:56.502 INFO:teuthology.run_tasks:Running task selinux... 2024-09-16T16:34:56.510 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-09-16T16:34:56.511 DEBUG:teuthology.orchestra.run.smithi172:> sudo service auditd rotate 2024-09-16T16:34:56.620 INFO:teuthology.orchestra.run.smithi172.stdout:Rotating logs: 2024-09-16T16:34:56.625 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-16T16:34:56.625 DEBUG:teuthology.orchestra.run.smithi172:> /usr/sbin/getenforce 2024-09-16T16:34:56.645 INFO:teuthology.orchestra.run.smithi172.stdout:Permissive 2024-09-16T16:34:56.645 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi172.front.sepia.ceph.com': 'permissive'} 2024-09-16T16:34:56.645 DEBUG:teuthology.orchestra.run.smithi172:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T16:34:56.711 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T16:34:56.711 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-16T16:34:56.711 DEBUG:teuthology.orchestra.run.smithi172:> sudo /usr/sbin/setenforce permissive 2024-09-16T16:34:56.790 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-16T16:34:56.799 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-16T16:34:56.810 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-16T16:34:56.811 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi172.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-16T16:39:16.086 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi172.front.sepia.ceph.com')] 2024-09-16T16:39:16.087 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-09-16T16:39:16.088 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T16:39:16.181 DEBUG:teuthology.orchestra.run.smithi172:> true 2024-09-16T16:39:16.264 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-09-16T16:39:16.265 INFO:teuthology.run_tasks:Running task clock... 2024-09-16T16:39:16.280 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-16T16:39:16.281 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-16T16:39:16.281 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T16:39:16.335 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-16T16:39:16.350 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-16T16:39:16.374 INFO:teuthology.orchestra.run.smithi172.stderr:sudo: ntpd: command not found 2024-09-16T16:39:16.385 INFO:teuthology.orchestra.run.smithi172.stdout:506 Cannot talk to daemon 2024-09-16T16:39:16.399 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-16T16:39:16.413 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-16T16:39:16.481 INFO:teuthology.orchestra.run.smithi172.stderr:bash: line 1: ntpq: command not found 2024-09-16T16:39:16.482 INFO:teuthology.orchestra.run.smithi172.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T16:39:16.482 INFO:teuthology.orchestra.run.smithi172.stdout:=============================================================================== 2024-09-16T16:39:16.482 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T16:39:16.482 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T16:39:16.482 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T16:39:16.482 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T16:39:16.482 INFO:teuthology.run_tasks:Running task install... 2024-09-16T16:39:16.490 DEBUG:teuthology.task.install:project ceph 2024-09-16T16:39:16.490 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'crimson', 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'}} 2024-09-16T16:39:16.490 DEBUG:teuthology.task.install:config {'flavor': 'crimson', 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'} 2024-09-16T16:39:16.490 INFO:teuthology.task.install:Using flavor: crimson 2024-09-16T16:39:16.496 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-16T16:39:16.497 INFO:teuthology.task.install:extra packages: [] 2024-09-16T16:39:16.497 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'crimson', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5', 'tag': None, 'wait_for_package': False} 2024-09-16T16:39:16.498 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=81fedcb3b484c843d22ffbc8d179cb567b7083b5 2024-09-16T16:39:16.642 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/ 2024-09-16T16:39:16.642 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4879.g81fedcb3 2024-09-16T16:39:16.771 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-16T16:39:16.771 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-16T16:39:16.771 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-16T16:39:16.801 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-16T16:39:16.801 DEBUG:teuthology.orchestra.run.smithi172:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/81fedcb3b484c843d22ffbc8d179cb567b7083b5/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-16T16:39:16.868 DEBUG:teuthology.orchestra.run.smithi172:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-16T16:39:16.944 DEBUG:teuthology.orchestra.run.smithi172:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-16T16:39:17.010 INFO:teuthology.orchestra.run.smithi172.stdout:check_obsoletes = 1 2024-09-16T16:39:17.010 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum clean all 2024-09-16T16:39:17.240 INFO:teuthology.orchestra.run.smithi172.stdout:45 files removed 2024-09-16T16:39:17.268 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-radosgw 2024-09-16T16:39:17.821 INFO:teuthology.orchestra.run.smithi172.stdout:ceph packages for x86_64 332 kB/s | 88 kB 00:00 2024-09-16T16:39:18.113 INFO:teuthology.orchestra.run.smithi172.stdout:ceph noarch packages 97 kB/s | 24 kB 00:00 2024-09-16T16:39:18.380 INFO:teuthology.orchestra.run.smithi172.stdout:ceph source packages 9.0 kB/s | 2.1 kB 00:00 2024-09-16T16:39:20.005 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - BaseOS 5.2 MB/s | 8.2 MB 00:01 2024-09-16T16:39:29.289 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - AppStream 2.5 MB/s | 20 MB 00:08 2024-09-16T16:39:33.831 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - CRB 9.3 MB/s | 6.5 MB 00:00 2024-09-16T16:39:35.623 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - Extras packages 39 kB/s | 19 kB 00:00 2024-09-16T16:39:36.612 INFO:teuthology.orchestra.run.smithi172.stdout:Extra Packages for Enterprise Linux 26 MB/s | 23 MB 00:00 2024-09-16T16:39:42.075 INFO:teuthology.orchestra.run.smithi172.stdout:lab-extras 15 kB/s | 1.7 kB 00:00 2024-09-16T16:39:44.493 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-16T16:39:44.507 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T16:39:44.507 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2024-09-16T16:39:44.507 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T16:39:44.508 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-09-16T16:39:44.508 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-radosgw x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 10 M 2024-09-16T16:39:44.508 INFO:teuthology.orchestra.run.smithi172.stdout:Upgrading: 2024-09-16T16:39:44.508 INFO:teuthology.orchestra.run.smithi172.stdout: librados2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.5 M 2024-09-16T16:39:44.508 INFO:teuthology.orchestra.run.smithi172.stdout: librbd1 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.8 M 2024-09-16T16:39:44.508 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2024-09-16T16:39:44.508 INFO:teuthology.orchestra.run.smithi172.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-16T16:39:44.508 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-base x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 6.1 M 2024-09-16T16:39:44.508 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-common x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 20 M 2024-09-16T16:39:44.508 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-selinux x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 25 k 2024-09-16T16:39:44.508 INFO:teuthology.orchestra.run.smithi172.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-16T16:39:44.508 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-16T16:39:44.508 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-16T16:39:44.509 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 809 k 2024-09-16T16:39:44.509 INFO:teuthology.orchestra.run.smithi172.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-16T16:39:44.509 INFO:teuthology.orchestra.run.smithi172.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-16T16:39:44.509 INFO:teuthology.orchestra.run.smithi172.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-16T16:39:44.509 INFO:teuthology.orchestra.run.smithi172.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-16T16:39:44.509 INFO:teuthology.orchestra.run.smithi172.stdout: libradosstriper1 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 558 k 2024-09-16T16:39:44.509 INFO:teuthology.orchestra.run.smithi172.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-16T16:39:44.509 INFO:teuthology.orchestra.run.smithi172.stdout: librgw2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 5.4 M 2024-09-16T16:39:44.509 INFO:teuthology.orchestra.run.smithi172.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-16T16:39:44.509 INFO:teuthology.orchestra.run.smithi172.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-16T16:39:44.509 INFO:teuthology.orchestra.run.smithi172.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-16T16:39:44.509 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-argparse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 45 k 2024-09-16T16:39:44.509 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-common x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 143 k 2024-09-16T16:39:44.510 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cephfs x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 160 k 2024-09-16T16:39:44.510 INFO:teuthology.orchestra.run.smithi172.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-16T16:39:44.510 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rados x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 315 k 2024-09-16T16:39:44.510 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rbd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 302 k 2024-09-16T16:39:44.510 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rgw x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 99 k 2024-09-16T16:39:44.510 INFO:teuthology.orchestra.run.smithi172.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-16T16:39:44.510 INFO:teuthology.orchestra.run.smithi172.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-16T16:39:44.510 INFO:teuthology.orchestra.run.smithi172.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-16T16:39:44.510 INFO:teuthology.orchestra.run.smithi172.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-16T16:39:44.510 INFO:teuthology.orchestra.run.smithi172.stdout:Installing weak dependencies: 2024-09-16T16:39:44.510 INFO:teuthology.orchestra.run.smithi172.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-16T16:39:44.510 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:39:44.510 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-09-16T16:39:44.510 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T16:39:44.511 INFO:teuthology.orchestra.run.smithi172.stdout:Install 31 Packages 2024-09-16T16:39:44.511 INFO:teuthology.orchestra.run.smithi172.stdout:Upgrade 2 Packages 2024-09-16T16:39:44.511 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:39:44.511 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 60 M 2024-09-16T16:39:44.511 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-09-16T16:39:45.584 INFO:teuthology.orchestra.run.smithi172.stdout:(1/33): ceph-base-19.3.0-4879.g81fedcb3.el9.x86 10 MB/s | 6.1 MB 00:00 2024-09-16T16:39:45.667 INFO:teuthology.orchestra.run.smithi172.stdout:(2/33): ceph-selinux-19.3.0-4879.g81fedcb3.el9. 301 kB/s | 25 kB 00:00 2024-09-16T16:39:45.776 INFO:teuthology.orchestra.run.smithi172.stdout:(3/33): ceph-radosgw-19.3.0-4879.g81fedcb3.el9. 13 MB/s | 10 MB 00:00 2024-09-16T16:39:45.810 INFO:teuthology.orchestra.run.smithi172.stdout:(4/33): libcephfs2-19.3.0-4879.g81fedcb3.el9.x8 5.6 MB/s | 809 kB 00:00 2024-09-16T16:39:45.851 INFO:teuthology.orchestra.run.smithi172.stdout:(5/33): libradosstriper1-19.3.0-4879.g81fedcb3. 7.3 MB/s | 558 kB 00:00 2024-09-16T16:39:45.927 INFO:teuthology.orchestra.run.smithi172.stdout:(6/33): python3-ceph-argparse-19.3.0-4879.g81fe 601 kB/s | 45 kB 00:00 2024-09-16T16:39:46.010 INFO:teuthology.orchestra.run.smithi172.stdout:(7/33): python3-ceph-common-19.3.0-4879.g81fedc 1.7 MB/s | 143 kB 00:00 2024-09-16T16:39:46.211 INFO:teuthology.orchestra.run.smithi172.stdout:(8/33): ceph-common-19.3.0-4879.g81fedcb3.el9.x 16 MB/s | 20 MB 00:01 2024-09-16T16:39:46.236 INFO:teuthology.orchestra.run.smithi172.stdout:(9/33): python3-cephfs-19.3.0-4879.g81fedcb3.el 709 kB/s | 160 kB 00:00 2024-09-16T16:39:46.262 INFO:teuthology.orchestra.run.smithi172.stdout:(10/33): python3-rados-19.3.0-4879.g81fedcb3.el 6.2 MB/s | 315 kB 00:00 2024-09-16T16:39:46.295 INFO:teuthology.orchestra.run.smithi172.stdout:(11/33): python3-rbd-19.3.0-4879.g81fedcb3.el9. 5.1 MB/s | 302 kB 00:00 2024-09-16T16:39:46.320 INFO:teuthology.orchestra.run.smithi172.stdout:(12/33): python3-rgw-19.3.0-4879.g81fedcb3.el9. 1.7 MB/s | 99 kB 00:00 2024-09-16T16:39:46.395 INFO:teuthology.orchestra.run.smithi172.stdout:(13/33): librgw2-19.3.0-4879.g81fedcb3.el9.x86_ 9.2 MB/s | 5.4 MB 00:00 2024-09-16T16:39:46.587 INFO:teuthology.orchestra.run.smithi172.stdout:(14/33): boost-program-options-1.75.0-8.el9.x86 366 kB/s | 107 kB 00:00 2024-09-16T16:39:46.612 INFO:teuthology.orchestra.run.smithi172.stdout:(15/33): libnbd-1.20.2-2.el9.x86_64.rpm 584 kB/s | 171 kB 00:00 2024-09-16T16:39:46.638 INFO:teuthology.orchestra.run.smithi172.stdout:(16/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 662 kB/s | 160 kB 00:00 2024-09-16T16:39:46.663 INFO:teuthology.orchestra.run.smithi172.stdout:(17/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 600 kB/s | 45 kB 00:00 2024-09-16T16:39:46.713 INFO:teuthology.orchestra.run.smithi172.stdout:(18/33): python3-prettytable-0.7.2-27.el9.noarc 846 kB/s | 42 kB 00:00 2024-09-16T16:39:46.747 INFO:teuthology.orchestra.run.smithi172.stdout:(19/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-09-16T16:39:46.797 INFO:teuthology.orchestra.run.smithi172.stdout:(20/33): qatlib-service-24.02.0-1.el9.x86_64.rp 718 kB/s | 36 kB 00:00 2024-09-16T16:39:46.822 INFO:teuthology.orchestra.run.smithi172.stdout:(21/33): librdkafka-1.6.1-102.el9.x86_64.rpm 3.1 MB/s | 662 kB 00:00 2024-09-16T16:39:46.848 INFO:teuthology.orchestra.run.smithi172.stdout:(22/33): qatlib-24.02.0-1.el9.x86_64.rpm 1.6 MB/s | 221 kB 00:00 2024-09-16T16:39:46.873 INFO:teuthology.orchestra.run.smithi172.stdout:(23/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 624 kB/s | 47 kB 00:00 2024-09-16T16:39:46.940 INFO:teuthology.orchestra.run.smithi172.stdout:(24/33): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.6 MB/s | 308 kB 00:00 2024-09-16T16:39:46.965 INFO:teuthology.orchestra.run.smithi172.stdout:(25/33): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-16T16:39:46.985 INFO:teuthology.orchestra.run.smithi172.stdout:(26/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 276 kB/s | 26 kB 00:00 2024-09-16T16:39:47.008 INFO:teuthology.orchestra.run.smithi172.stdout:(27/33): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-09-16T16:39:47.050 INFO:teuthology.orchestra.run.smithi172.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-16T16:39:47.091 INFO:teuthology.orchestra.run.smithi172.stdout:(29/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.5 MB/s | 839 kB 00:00 2024-09-16T16:39:47.192 INFO:teuthology.orchestra.run.smithi172.stdout:(30/33): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-09-16T16:39:47.284 INFO:teuthology.orchestra.run.smithi172.stdout:(31/33): libarrow-9.0.0-11.el9.x86_64.rpm 10 MB/s | 4.4 MB 00:00 2024-09-16T16:39:47.509 INFO:teuthology.orchestra.run.smithi172.stdout:(32/33): librados2-19.3.0-4879.g81fedcb3.el9.x8 8.3 MB/s | 3.5 MB 00:00 2024-09-16T16:39:47.585 INFO:teuthology.orchestra.run.smithi172.stdout:(33/33): librbd1-19.3.0-4879.g81fedcb3.el9.x86_ 9.7 MB/s | 3.8 MB 00:00 2024-09-16T16:39:47.589 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:39:47.590 INFO:teuthology.orchestra.run.smithi172.stdout:Total 20 MB/s | 60 MB 00:03 2024-09-16T16:39:47.706 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-09-16T16:39:47.743 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-09-16T16:39:47.743 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-09-16T16:39:48.420 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-09-16T16:39:48.421 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-09-16T16:39:49.916 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-09-16T16:39:50.458 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-16T16:39:50.528 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-16T16:39:50.620 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-16T16:39:50.736 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/35 2024-09-16T16:39:50.763 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-16T16:39:50.825 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-16T16:39:50.872 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : liboath-2.6.7-2.el9.x86_64 5/35 2024-09-16T16:39:50.901 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/35 2024-09-16T16:39:50.926 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/35 2024-09-16T16:39:50.948 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-16T16:39:50.975 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-16T16:39:51.167 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-16T16:39:51.198 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-16T16:39:51.233 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/35 2024-09-16T16:39:51.286 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9. 11/35 2024-09-16T16:39:51.315 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 12/35 2024-09-16T16:39:51.404 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 13/35 2024-09-16T16:39:51.436 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 14/35 2024-09-16T16:39:51.525 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 14/35 2024-09-16T16:39:51.569 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : thrift-0.15.0-2.el9.x86_64 15/35 2024-09-16T16:39:51.684 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : re2-1:20211101-20.el9.x86_64 16/35 2024-09-16T16:39:51.720 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/35 2024-09-16T16:39:51.769 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 18/35 2024-09-16T16:39:51.801 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 19/35 2024-09-16T16:39:51.830 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 20/35 2024-09-16T16:39:51.867 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 21/35 2024-09-16T16:39:52.238 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-16T16:39:52.293 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 23/35 2024-09-16T16:39:52.384 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 23/35 2024-09-16T16:39:52.414 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 24/35 2024-09-16T16:39:52.468 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-16T16:39:53.047 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-16T16:39:53.079 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 27/35 2024-09-16T16:39:53.151 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 27/35 2024-09-16T16:39:53.228 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 28/35 2024-09-16T16:39:53.264 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x8 29/35 2024-09-16T16:39:55.729 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-16T16:39:55.777 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-16T16:39:56.474 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-16T16:39:56.515 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 31/35 2024-09-16T16:39:56.607 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 31/35 2024-09-16T16:39:56.608 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-16T16:39:56.608 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-16T16:39:56.608 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:39:56.640 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-16T16:40:07.256 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-16T16:40:07.257 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /sys 2024-09-16T16:40:07.257 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /proc 2024-09-16T16:40:07.257 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /mnt 2024-09-16T16:40:07.257 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /var/tmp 2024-09-16T16:40:07.257 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /home 2024-09-16T16:40:07.257 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /root 2024-09-16T16:40:07.257 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /tmp 2024-09-16T16:40:07.257 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:40:08.389 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/35 2024-09-16T16:40:08.415 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/35 2024-09-16T16:40:08.415 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:40:08.415 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-16T16:40:08.415 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T16:40:08.415 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T16:40:08.416 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:40:08.417 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-16T16:40:08.508 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-16T16:40:08.509 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-16T16:40:09.831 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-16T16:40:09.831 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/35 2024-09-16T16:40:09.831 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-16T16:40:09.831 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/35 2024-09-16T16:40:09.831 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-16T16:40:09.832 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 5/35 2024-09-16T16:40:09.832 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 6/35 2024-09-16T16:40:09.832 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 7/35 2024-09-16T16:40:09.832 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9. 8/35 2024-09-16T16:40:09.832 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x8 9/35 2024-09-16T16:40:09.832 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 10/35 2024-09-16T16:40:09.832 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 11/35 2024-09-16T16:40:09.832 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 12/35 2024-09-16T16:40:09.832 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 13/35 2024-09-16T16:40:09.832 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-16T16:40:09.832 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-16T16:40:09.832 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-16T16:40:09.833 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-16T16:40:09.833 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-16T16:40:09.833 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-16T16:40:09.833 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-16T16:40:09.833 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-16T16:40:09.833 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-16T16:40:09.833 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-16T16:40:09.833 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 24/35 2024-09-16T16:40:09.833 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-16T16:40:09.833 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-16T16:40:09.833 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-16T16:40:09.833 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-16T16:40:09.833 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-16T16:40:09.834 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-16T16:40:09.834 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-16T16:40:09.834 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-16T16:40:09.834 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-16T16:40:09.834 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/35 2024-09-16T16:40:10.891 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-16T16:40:10.891 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:40:10.891 INFO:teuthology.orchestra.run.smithi172.stdout:Upgraded: 2024-09-16T16:40:10.891 INFO:teuthology.orchestra.run.smithi172.stdout: librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:40:10.891 INFO:teuthology.orchestra.run.smithi172.stdout: librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:40:10.891 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-09-16T16:40:10.891 INFO:teuthology.orchestra.run.smithi172.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-16T16:40:10.891 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:40:10.892 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:40:10.892 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:40:10.892 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:40:10.892 INFO:teuthology.orchestra.run.smithi172.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-16T16:40:10.892 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-16T16:40:10.892 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-16T16:40:10.892 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:40:10.892 INFO:teuthology.orchestra.run.smithi172.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-16T16:40:10.892 INFO:teuthology.orchestra.run.smithi172.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-16T16:40:10.892 INFO:teuthology.orchestra.run.smithi172.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-16T16:40:10.892 INFO:teuthology.orchestra.run.smithi172.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-16T16:40:10.892 INFO:teuthology.orchestra.run.smithi172.stdout: libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:40:10.892 INFO:teuthology.orchestra.run.smithi172.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-16T16:40:10.893 INFO:teuthology.orchestra.run.smithi172.stdout: librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:40:10.893 INFO:teuthology.orchestra.run.smithi172.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-16T16:40:10.893 INFO:teuthology.orchestra.run.smithi172.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-16T16:40:10.893 INFO:teuthology.orchestra.run.smithi172.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-16T16:40:10.893 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:40:10.893 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:40:10.893 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:40:10.893 INFO:teuthology.orchestra.run.smithi172.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-16T16:40:10.893 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:40:10.893 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:40:10.893 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:40:10.893 INFO:teuthology.orchestra.run.smithi172.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-16T16:40:10.893 INFO:teuthology.orchestra.run.smithi172.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-16T16:40:10.893 INFO:teuthology.orchestra.run.smithi172.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-16T16:40:10.894 INFO:teuthology.orchestra.run.smithi172.stdout: re2-1:20211101-20.el9.x86_64 2024-09-16T16:40:10.894 INFO:teuthology.orchestra.run.smithi172.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-16T16:40:10.894 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:40:10.894 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-16T16:40:11.193 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-test 2024-09-16T16:40:11.764 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:00:30 ago on Mon 16 Sep 2024 04:39:41 PM UTC. 2024-09-16T16:40:11.902 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-16T16:40:11.903 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T16:40:11.903 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2024-09-16T16:40:11.903 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T16:40:11.903 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-09-16T16:40:11.904 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-test x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 85 M 2024-09-16T16:40:11.904 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2024-09-16T16:40:11.904 INFO:teuthology.orchestra.run.smithi172.stdout: libasan8 x86_64 14.2.1-1.2.el9 appstream 513 k 2024-09-16T16:40:11.904 INFO:teuthology.orchestra.run.smithi172.stdout: libcephsqlite x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 175 k 2024-09-16T16:40:11.904 INFO:teuthology.orchestra.run.smithi172.stdout: libubsan x86_64 11.5.0-2.el9 appstream 183 k 2024-09-16T16:40:11.904 INFO:teuthology.orchestra.run.smithi172.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-16T16:40:11.904 INFO:teuthology.orchestra.run.smithi172.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-16T16:40:11.904 INFO:teuthology.orchestra.run.smithi172.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-16T16:40:11.904 INFO:teuthology.orchestra.run.smithi172.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-16T16:40:11.904 INFO:teuthology.orchestra.run.smithi172.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2024-09-16T16:40:11.904 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:40:11.904 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-09-16T16:40:11.905 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T16:40:11.905 INFO:teuthology.orchestra.run.smithi172.stdout:Install 9 Packages 2024-09-16T16:40:11.905 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:40:11.905 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 87 M 2024-09-16T16:40:11.905 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 797 M 2024-09-16T16:40:11.905 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-09-16T16:40:12.380 INFO:teuthology.orchestra.run.smithi172.stdout:(1/9): lksctp-tools-1.0.19-2.el9.x86_64.rpm 602 kB/s | 94 kB 00:00 2024-09-16T16:40:12.563 INFO:teuthology.orchestra.run.smithi172.stdout:(2/9): libcephsqlite-19.3.0-4879.g81fedcb3.el9. 515 kB/s | 175 kB 00:00 2024-09-16T16:40:13.114 INFO:teuthology.orchestra.run.smithi172.stdout:(3/9): libasan8-14.2.1-1.2.el9.x86_64.rpm 700 kB/s | 513 kB 00:00 2024-09-16T16:40:13.139 INFO:teuthology.orchestra.run.smithi172.stdout:(4/9): libubsan-11.5.0-2.el9.x86_64.rpm 317 kB/s | 183 kB 00:00 2024-09-16T16:40:13.348 INFO:teuthology.orchestra.run.smithi172.stdout:(5/9): socat-1.7.4.1-6.el9.x86_64.rpm 1.4 MB/s | 304 kB 00:00 2024-09-16T16:40:13.464 INFO:teuthology.orchestra.run.smithi172.stdout:(6/9): xmlstarlet-1.6.1-20.el9.x86_64.rpm 547 kB/s | 64 kB 00:00 2024-09-16T16:40:13.523 INFO:teuthology.orchestra.run.smithi172.stdout:(7/9): yaml-cpp-0.6.3-5.el9.x86_64.rpm 2.0 MB/s | 122 kB 00:00 2024-09-16T16:40:13.615 INFO:teuthology.orchestra.run.smithi172.stdout:(8/9): protobuf-3.14.0-13.el9.x86_64.rpm 2.0 MB/s | 1.0 MB 00:00 2024-09-16T16:40:16.182 INFO:teuthology.orchestra.run.smithi172.stdout:(9/9): ceph-test-19.3.0-4879.g81fedcb3.el9.x86_ 21 MB/s | 85 MB 00:03 2024-09-16T16:40:16.185 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:40:16.185 INFO:teuthology.orchestra.run.smithi172.stdout:Total 20 MB/s | 87 MB 00:04 2024-09-16T16:40:16.270 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-09-16T16:40:16.293 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-09-16T16:40:16.293 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-09-16T16:40:16.927 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-09-16T16:40:16.928 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-09-16T16:40:17.832 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-09-16T16:40:17.924 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/9 2024-09-16T16:40:17.974 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 2/9 2024-09-16T16:40:18.020 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 3/9 2024-09-16T16:40:18.046 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 4/9 2024-09-16T16:40:18.077 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-16T16:40:18.110 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-16T16:40:18.189 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-16T16:40:18.236 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 7/9 2024-09-16T16:40:18.263 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 8/9 2024-09-16T16:40:29.566 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 8/9 2024-09-16T16:40:29.643 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 9/9 2024-09-16T16:40:35.690 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 9/9 2024-09-16T16:40:35.690 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/9 2024-09-16T16:40:35.690 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/9 2024-09-16T16:40:35.691 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 3/9 2024-09-16T16:40:35.691 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libasan8-14.2.1-1.2.el9.x86_64 4/9 2024-09-16T16:40:35.691 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-16T16:40:35.691 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 6/9 2024-09-16T16:40:35.691 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 7/9 2024-09-16T16:40:35.691 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 8/9 2024-09-16T16:40:36.110 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 9/9 2024-09-16T16:40:36.110 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:40:36.110 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-09-16T16:40:36.110 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:40:36.110 INFO:teuthology.orchestra.run.smithi172.stdout: libasan8-14.2.1-1.2.el9.x86_64 2024-09-16T16:40:36.111 INFO:teuthology.orchestra.run.smithi172.stdout: libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:40:36.111 INFO:teuthology.orchestra.run.smithi172.stdout: libubsan-11.5.0-2.el9.x86_64 2024-09-16T16:40:36.111 INFO:teuthology.orchestra.run.smithi172.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-16T16:40:36.111 INFO:teuthology.orchestra.run.smithi172.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-16T16:40:36.111 INFO:teuthology.orchestra.run.smithi172.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-16T16:40:36.111 INFO:teuthology.orchestra.run.smithi172.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-16T16:40:36.111 INFO:teuthology.orchestra.run.smithi172.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2024-09-16T16:40:36.111 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:40:36.111 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-16T16:40:36.466 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph 2024-09-16T16:40:37.032 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:00:56 ago on Mon 16 Sep 2024 04:39:41 PM UTC. 2024-09-16T16:40:37.168 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-16T16:40:37.170 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T16:40:37.170 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2024-09-16T16:40:37.170 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T16:40:37.170 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-09-16T16:40:37.171 INFO:teuthology.orchestra.run.smithi172.stdout: ceph x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 6.5 k 2024-09-16T16:40:37.171 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2024-09-16T16:40:37.171 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mds x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 2.2 M 2024-09-16T16:40:37.171 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 1.6 M 2024-09-16T16:40:37.171 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 291 k 2024-09-16T16:40:37.171 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mon x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 5.1 M 2024-09-16T16:40:37.171 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-osd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 70 M 2024-09-16T16:40:37.171 INFO:teuthology.orchestra.run.smithi172.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-16T16:40:37.171 INFO:teuthology.orchestra.run.smithi172.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-16T16:40:37.171 INFO:teuthology.orchestra.run.smithi172.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-16T16:40:37.171 INFO:teuthology.orchestra.run.smithi172.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-16T16:40:37.171 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-16T16:40:37.171 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-16T16:40:37.172 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-16T16:40:37.172 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-16T16:40:37.172 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-16T16:40:37.172 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-16T16:40:37.172 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-collections 2024-09-16T16:40:37.172 INFO:teuthology.orchestra.run.smithi172.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-16T16:40:37.172 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-16T16:40:37.172 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-16T16:40:37.172 INFO:teuthology.orchestra.run.smithi172.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-16T16:40:37.172 INFO:teuthology.orchestra.run.smithi172.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-16T16:40:37.172 INFO:teuthology.orchestra.run.smithi172.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-16T16:40:37.173 INFO:teuthology.orchestra.run.smithi172.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-16T16:40:37.173 INFO:teuthology.orchestra.run.smithi172.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-16T16:40:37.173 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-16T16:40:37.173 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-16T16:40:37.173 INFO:teuthology.orchestra.run.smithi172.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-16T16:40:37.173 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-16T16:40:37.173 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-16T16:40:37.173 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-16T16:40:37.173 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-16T16:40:37.173 INFO:teuthology.orchestra.run.smithi172.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-16T16:40:37.173 INFO:teuthology.orchestra.run.smithi172.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-16T16:40:37.173 INFO:teuthology.orchestra.run.smithi172.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-16T16:40:37.173 INFO:teuthology.orchestra.run.smithi172.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-16T16:40:37.173 INFO:teuthology.orchestra.run.smithi172.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-16T16:40:37.174 INFO:teuthology.orchestra.run.smithi172.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-16T16:40:37.174 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:40:37.174 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-09-16T16:40:37.174 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T16:40:37.174 INFO:teuthology.orchestra.run.smithi172.stdout:Install 37 Packages 2024-09-16T16:40:37.174 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:40:37.175 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 84 M 2024-09-16T16:40:37.175 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 897 M 2024-09-16T16:40:37.175 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-09-16T16:40:38.463 INFO:teuthology.orchestra.run.smithi172.stdout:(1/37): ceph-19.3.0-4879.g81fedcb3.el9.x86_64.r 18 kB/s | 6.5 kB 00:00 2024-09-16T16:40:40.080 INFO:teuthology.orchestra.run.smithi172.stdout:(2/37): ceph-mgr-19.3.0-4879.g81fedcb3.el9.x86_ 826 kB/s | 1.6 MB 00:01 2024-09-16T16:40:40.130 INFO:teuthology.orchestra.run.smithi172.stdout:(3/37): ceph-mds-19.3.0-4879.g81fedcb3.el9.x86_ 1.1 MB/s | 2.2 MB 00:02 2024-09-16T16:40:40.372 INFO:teuthology.orchestra.run.smithi172.stdout:(4/37): ceph-mgr-modules-core-19.3.0-4879.g81fe 1.2 MB/s | 291 kB 00:00 2024-09-16T16:40:40.522 INFO:teuthology.orchestra.run.smithi172.stdout:(5/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.7 MB/s | 253 kB 00:00 2024-09-16T16:40:40.614 INFO:teuthology.orchestra.run.smithi172.stdout:(6/37): python3-cryptography-36.0.1-4.el9.x86_6 13 MB/s | 1.2 MB 00:00 2024-09-16T16:40:40.656 INFO:teuthology.orchestra.run.smithi172.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-16T16:40:40.707 INFO:teuthology.orchestra.run.smithi172.stdout:(8/37): python3-pycparser-2.20-6.el9.noarch.rpm 2.6 MB/s | 135 kB 00:00 2024-09-16T16:40:40.748 INFO:teuthology.orchestra.run.smithi172.stdout:(9/37): python3-requests-2.25.1-8.el9.noarch.rp 2.9 MB/s | 125 kB 00:00 2024-09-16T16:40:40.799 INFO:teuthology.orchestra.run.smithi172.stdout:(10/37): python3-urllib3-1.26.5-6.el9.noarch.rp 4.2 MB/s | 215 kB 00:00 2024-09-16T16:40:40.999 INFO:teuthology.orchestra.run.smithi172.stdout:(11/37): lua-5.4.4-4.el9.x86_64.rpm 943 kB/s | 188 kB 00:00 2024-09-16T16:40:41.074 INFO:teuthology.orchestra.run.smithi172.stdout:(12/37): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-09-16T16:40:41.158 INFO:teuthology.orchestra.run.smithi172.stdout:(13/37): ceph-mon-19.3.0-4879.g81fedcb3.el9.x86 1.9 MB/s | 5.1 MB 00:02 2024-09-16T16:40:41.175 INFO:teuthology.orchestra.run.smithi172.stdout:(14/37): python3-markupsafe-1.1.1-12.el9.x86_64 346 kB/s | 35 kB 00:00 2024-09-16T16:40:41.217 INFO:teuthology.orchestra.run.smithi172.stdout:(15/37): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-16T16:40:41.259 INFO:teuthology.orchestra.run.smithi172.stdout:(16/37): python3-toml-0.10.2-6.el9.noarch.rpm 998 kB/s | 42 kB 00:00 2024-09-16T16:40:41.292 INFO:teuthology.orchestra.run.smithi172.stdout:(17/37): python3-packaging-20.9-5.el9.noarch.rp 576 kB/s | 77 kB 00:00 2024-09-16T16:40:41.334 INFO:teuthology.orchestra.run.smithi172.stdout:(18/37): luarocks-3.9.2-5.el9.noarch.rpm 3.5 MB/s | 151 kB 00:00 2024-09-16T16:40:41.360 INFO:teuthology.orchestra.run.smithi172.stdout:(19/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.7 MB/s | 43 kB 00:00 2024-09-16T16:40:41.385 INFO:teuthology.orchestra.run.smithi172.stdout:(20/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 6.7 MB/s | 172 kB 00:00 2024-09-16T16:40:41.419 INFO:teuthology.orchestra.run.smithi172.stdout:(21/37): python3-cherrypy-18.6.1-2.el9.noarch.r 11 MB/s | 358 kB 00:00 2024-09-16T16:40:41.452 INFO:teuthology.orchestra.run.smithi172.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 321 kB/s | 11 kB 00:00 2024-09-16T16:40:41.478 INFO:teuthology.orchestra.run.smithi172.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 702 kB/s | 18 kB 00:00 2024-09-16T16:40:41.494 INFO:teuthology.orchestra.run.smithi172.stdout:(24/37): python3-jaraco-collections-3.0.0-8.el9 1.4 MB/s | 23 kB 00:00 2024-09-16T16:40:41.512 INFO:teuthology.orchestra.run.smithi172.stdout:(25/37): lua-devel-5.4.4-4.el9.x86_64.rpm 88 kB/s | 22 kB 00:00 2024-09-16T16:40:41.528 INFO:teuthology.orchestra.run.smithi172.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 580 kB/s | 19 kB 00:00 2024-09-16T16:40:41.554 INFO:teuthology.orchestra.run.smithi172.stdout:(27/37): python3-logutils-0.3.5-21.el9.noarch.r 2.5 MB/s | 46 kB 00:00 2024-09-16T16:40:41.579 INFO:teuthology.orchestra.run.smithi172.stdout:(28/37): python3-more-itertools-8.12.0-2.el9.no 3.3 MB/s | 79 kB 00:00 2024-09-16T16:40:41.604 INFO:teuthology.orchestra.run.smithi172.stdout:(29/37): python3-jaraco-text-3.2.0-6.el9.noarch 213 kB/s | 20 kB 00:00 2024-09-16T16:40:41.629 INFO:teuthology.orchestra.run.smithi172.stdout:(30/37): python3-portend-3.1.0-2.el9.noarch.rpm 663 kB/s | 16 kB 00:00 2024-09-16T16:40:41.655 INFO:teuthology.orchestra.run.smithi172.stdout:(31/37): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-16T16:40:41.681 INFO:teuthology.orchestra.run.smithi172.stdout:(32/37): python3-tempora-5.0.0-2.el9.noarch.rpm 1.4 MB/s | 36 kB 00:00 2024-09-16T16:40:41.705 INFO:teuthology.orchestra.run.smithi172.stdout:(33/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.2 MB/s | 90 kB 00:00 2024-09-16T16:40:41.739 INFO:teuthology.orchestra.run.smithi172.stdout:(34/37): python3-webob-1.8.8-2.el9.noarch.rpm 3.8 MB/s | 230 kB 00:00 2024-09-16T16:40:41.764 INFO:teuthology.orchestra.run.smithi172.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 799 kB/s | 20 kB 00:00 2024-09-16T16:40:41.815 INFO:teuthology.orchestra.run.smithi172.stdout:(36/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.8 MB/s | 427 kB 00:00 2024-09-16T16:41:51.013 INFO:teuthology.orchestra.run.smithi172.stdout:(37/37): ceph-osd-19.3.0-4879.g81fedcb3.el9.x86 1.0 MB/s | 70 MB 01:10 2024-09-16T16:41:51.016 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:41:51.016 INFO:teuthology.orchestra.run.smithi172.stdout:Total 1.1 MB/s | 84 MB 01:13 2024-09-16T16:41:51.147 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-09-16T16:41:51.189 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-09-16T16:41:51.189 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-09-16T16:41:51.975 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-09-16T16:41:51.976 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-09-16T16:41:53.681 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-09-16T16:41:53.740 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-16T16:41:53.773 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-16T16:41:53.808 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-16T16:41:53.880 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-16T16:41:53.916 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-16T16:41:53.949 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-16T16:41:54.042 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-16T16:41:54.136 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-16T16:41:54.176 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-16T16:41:54.211 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-16T16:41:54.241 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-16T16:41:54.275 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-16T16:41:54.308 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-16T16:41:54.358 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-16T16:41:54.409 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-16T16:41:54.452 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-16T16:41:54.501 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-16T16:41:54.532 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-16T16:41:54.606 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-16T16:41:54.745 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-16T16:41:54.824 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-16T16:41:54.877 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-16T16:41:54.923 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-16T16:41:54.990 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-16T16:41:55.045 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-16T16:41:55.244 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-16T16:41:55.294 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-16T16:41:55.383 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-16T16:41:55.480 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-16T16:41:55.525 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-16T16:41:55.659 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-16T16:41:55.849 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9. 32/37 2024-09-16T16:41:55.872 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/37 2024-09-16T16:41:55.897 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/37 2024-09-16T16:41:55.897 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:41:55.897 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-16T16:41:55.897 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T16:41:55.897 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T16:41:55.897 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:42:06.488 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/37 2024-09-16T16:42:06.515 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/37 2024-09-16T16:42:06.515 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:42:06.515 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-16T16:42:06.515 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T16:42:06.515 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T16:42:06.515 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:42:07.064 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 35/37 2024-09-16T16:42:07.087 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 35/37 2024-09-16T16:42:07.087 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:42:07.087 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-16T16:42:07.087 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T16:42:07.087 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T16:42:07.087 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:42:07.323 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 36/37 2024-09-16T16:42:07.345 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 36/37 2024-09-16T16:42:07.345 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:42:07.345 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-16T16:42:07.346 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T16:42:07.346 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T16:42:07.346 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:42:07.411 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 37/37 2024-09-16T16:42:13.807 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 37/37 2024-09-16T16:42:13.807 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/37 2024-09-16T16:42:13.808 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/37 2024-09-16T16:42:13.808 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/37 2024-09-16T16:42:13.808 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/37 2024-09-16T16:42:13.808 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 5/37 2024-09-16T16:42:13.808 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9. 6/37 2024-09-16T16:42:13.808 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-16T16:42:13.808 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-16T16:42:13.808 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-16T16:42:13.808 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-16T16:42:13.808 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-16T16:42:13.808 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-16T16:42:13.808 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-16T16:42:13.808 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-16T16:42:13.808 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-16T16:42:13.809 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-16T16:42:13.809 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-16T16:42:13.809 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-16T16:42:13.809 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-16T16:42:13.809 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-16T16:42:13.809 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-16T16:42:13.809 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-16T16:42:13.809 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-16T16:42:13.809 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-16T16:42:13.809 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-16T16:42:13.809 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-16T16:42:13.809 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-16T16:42:13.809 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-16T16:42:13.809 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-16T16:42:13.810 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-16T16:42:13.810 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-16T16:42:13.810 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-16T16:42:13.810 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-16T16:42:13.810 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-16T16:42:13.810 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-16T16:42:13.810 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-16T16:42:14.610 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-16T16:42:14.610 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:42:14.610 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-09-16T16:42:14.610 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:42:14.610 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:42:14.610 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:42:14.610 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:42:14.610 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:42:14.610 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:42:14.610 INFO:teuthology.orchestra.run.smithi172.stdout: lua-5.4.4-4.el9.x86_64 2024-09-16T16:42:14.610 INFO:teuthology.orchestra.run.smithi172.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-16T16:42:14.611 INFO:teuthology.orchestra.run.smithi172.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-16T16:42:14.611 INFO:teuthology.orchestra.run.smithi172.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-16T16:42:14.611 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-16T16:42:14.611 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-16T16:42:14.611 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-16T16:42:14.611 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-16T16:42:14.611 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-16T16:42:14.611 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-16T16:42:14.611 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-16T16:42:14.611 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-16T16:42:14.611 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-16T16:42:14.611 INFO:teuthology.orchestra.run.smithi172.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-16T16:42:14.611 INFO:teuthology.orchestra.run.smithi172.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-16T16:42:14.611 INFO:teuthology.orchestra.run.smithi172.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-16T16:42:14.611 INFO:teuthology.orchestra.run.smithi172.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-16T16:42:14.612 INFO:teuthology.orchestra.run.smithi172.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-16T16:42:14.612 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-16T16:42:14.612 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ply-3.11-14.el9.noarch 2024-09-16T16:42:14.612 INFO:teuthology.orchestra.run.smithi172.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-16T16:42:14.612 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-16T16:42:14.612 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-16T16:42:14.612 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-16T16:42:14.612 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-16T16:42:14.612 INFO:teuthology.orchestra.run.smithi172.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-16T16:42:14.612 INFO:teuthology.orchestra.run.smithi172.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-16T16:42:14.612 INFO:teuthology.orchestra.run.smithi172.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-16T16:42:14.612 INFO:teuthology.orchestra.run.smithi172.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-16T16:42:14.612 INFO:teuthology.orchestra.run.smithi172.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-16T16:42:14.613 INFO:teuthology.orchestra.run.smithi172.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-16T16:42:14.613 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:42:14.613 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-16T16:42:14.857 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-base 2024-09-16T16:42:15.424 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:02:34 ago on Mon 16 Sep 2024 04:39:41 PM UTC. 2024-09-16T16:42:15.515 INFO:teuthology.orchestra.run.smithi172.stdout:Package ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:42:15.556 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-16T16:42:15.557 INFO:teuthology.orchestra.run.smithi172.stdout:Nothing to do. 2024-09-16T16:42:15.557 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-16T16:42:15.632 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install cephadm 2024-09-16T16:42:16.189 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:02:35 ago on Mon 16 Sep 2024 04:39:41 PM UTC. 2024-09-16T16:42:16.321 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-16T16:42:16.322 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T16:42:16.322 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2024-09-16T16:42:16.322 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T16:42:16.322 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-09-16T16:42:16.323 INFO:teuthology.orchestra.run.smithi172.stdout: cephadm noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 785 k 2024-09-16T16:42:16.323 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:42:16.323 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-09-16T16:42:16.323 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T16:42:16.323 INFO:teuthology.orchestra.run.smithi172.stdout:Install 1 Package 2024-09-16T16:42:16.323 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:42:16.323 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 785 k 2024-09-16T16:42:16.323 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 791 k 2024-09-16T16:42:16.323 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-09-16T16:42:18.012 INFO:teuthology.orchestra.run.smithi172.stdout:cephadm-19.3.0-4879.g81fedcb3.el9.noarch.rpm 465 kB/s | 785 kB 00:01 2024-09-16T16:42:18.013 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:42:18.013 INFO:teuthology.orchestra.run.smithi172.stdout:Total 464 kB/s | 785 kB 00:01 2024-09-16T16:42:18.013 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-09-16T16:42:18.019 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-09-16T16:42:18.020 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-09-16T16:42:18.026 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-09-16T16:42:18.027 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-09-16T16:42:18.101 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-09-16T16:42:18.594 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:42:18.684 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:42:19.022 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:42:19.276 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:42:19.276 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:42:19.276 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-09-16T16:42:19.276 INFO:teuthology.orchestra.run.smithi172.stdout: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:42:19.277 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:42:19.277 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-16T16:42:19.509 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-immutable-object-cache 2024-09-16T16:42:20.084 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:02:39 ago on Mon 16 Sep 2024 04:39:41 PM UTC. 2024-09-16T16:42:20.218 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-16T16:42:20.218 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T16:42:20.218 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repo Size 2024-09-16T16:42:20.219 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T16:42:20.219 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-09-16T16:42:20.219 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 158 k 2024-09-16T16:42:20.219 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:42:20.219 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-09-16T16:42:20.219 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T16:42:20.219 INFO:teuthology.orchestra.run.smithi172.stdout:Install 1 Package 2024-09-16T16:42:20.219 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:42:20.220 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 158 k 2024-09-16T16:42:20.220 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 644 k 2024-09-16T16:42:20.220 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-09-16T16:42:20.801 INFO:teuthology.orchestra.run.smithi172.stdout:ceph-immutable-object-cache-19.3.0-4879.g81fedc 272 kB/s | 158 kB 00:00 2024-09-16T16:42:20.801 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:42:20.802 INFO:teuthology.orchestra.run.smithi172.stdout:Total 271 kB/s | 158 kB 00:00 2024-09-16T16:42:20.802 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-09-16T16:42:20.812 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-09-16T16:42:20.812 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-09-16T16:42:20.869 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-09-16T16:42:20.870 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-09-16T16:42:21.020 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-09-16T16:42:21.102 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-16T16:42:21.127 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-16T16:42:21.127 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:42:21.127 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-16T16:42:21.127 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:42:22.042 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-16T16:42:22.042 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:42:22.042 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-09-16T16:42:22.042 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:42:22.042 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:42:22.042 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-16T16:42:22.262 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-mgr 2024-09-16T16:42:22.839 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:02:41 ago on Mon 16 Sep 2024 04:39:41 PM UTC. 2024-09-16T16:42:22.933 INFO:teuthology.orchestra.run.smithi172.stdout:Package ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:42:22.975 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-16T16:42:22.976 INFO:teuthology.orchestra.run.smithi172.stdout:Nothing to do. 2024-09-16T16:42:22.976 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-16T16:42:23.054 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-mgr-dashboard 2024-09-16T16:42:23.617 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:02:42 ago on Mon 16 Sep 2024 04:39:41 PM UTC. 2024-09-16T16:42:23.750 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-16T16:42:23.751 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T16:42:23.751 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2024-09-16T16:42:23.751 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T16:42:23.751 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-09-16T16:42:23.751 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 14 M 2024-09-16T16:42:23.751 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2024-09-16T16:42:23.752 INFO:teuthology.orchestra.run.smithi172.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-16T16:42:23.752 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 34 k 2024-09-16T16:42:23.752 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 16 k 2024-09-16T16:42:23.752 INFO:teuthology.orchestra.run.smithi172.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-16T16:42:23.752 INFO:teuthology.orchestra.run.smithi172.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-16T16:42:23.752 INFO:teuthology.orchestra.run.smithi172.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-16T16:42:23.752 INFO:teuthology.orchestra.run.smithi172.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-16T16:42:23.752 INFO:teuthology.orchestra.run.smithi172.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-16T16:42:23.752 INFO:teuthology.orchestra.run.smithi172.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-16T16:42:23.752 INFO:teuthology.orchestra.run.smithi172.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-16T16:42:23.752 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:42:23.752 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-09-16T16:42:23.753 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T16:42:23.753 INFO:teuthology.orchestra.run.smithi172.stdout:Install 11 Packages 2024-09-16T16:42:23.753 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:42:23.753 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 18 M 2024-09-16T16:42:23.753 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 155 M 2024-09-16T16:42:23.753 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-09-16T16:42:24.529 INFO:teuthology.orchestra.run.smithi172.stdout:(1/11): ceph-prometheus-alerts-19.3.0-4879.g81f 38 kB/s | 16 kB 00:00 2024-09-16T16:42:24.587 INFO:teuthology.orchestra.run.smithi172.stdout:(2/11): ceph-grafana-dashboards-19.3.0-4879.g81 69 kB/s | 34 kB 00:00 2024-09-16T16:42:24.796 INFO:teuthology.orchestra.run.smithi172.stdout:(3/11): protobuf-compiler-3.14.0-13.el9.x86_64. 4.0 MB/s | 863 kB 00:00 2024-09-16T16:42:24.863 INFO:teuthology.orchestra.run.smithi172.stdout:(4/11): abseil-cpp-20211102.0-3.el9.x86_64.rpm 8.0 MB/s | 548 kB 00:00 2024-09-16T16:42:24.880 INFO:teuthology.orchestra.run.smithi172.stdout:(5/11): grpc-data-1.46.7-10.el9.noarch.rpm 1.1 MB/s | 19 kB 00:00 2024-09-16T16:42:25.006 INFO:teuthology.orchestra.run.smithi172.stdout:(6/11): python3-grpcio-1.46.7-10.el9.x86_64.rpm 16 MB/s | 2.0 MB 00:00 2024-09-16T16:42:25.031 INFO:teuthology.orchestra.run.smithi172.stdout:(7/11): python3-grpcio-tools-1.46.7-10.el9.x86_ 5.7 MB/s | 144 kB 00:00 2024-09-16T16:42:25.047 INFO:teuthology.orchestra.run.smithi172.stdout:(8/11): python3-repoze-lru-0.7-16.el9.noarch.rp 1.8 MB/s | 31 kB 00:00 2024-09-16T16:42:25.081 INFO:teuthology.orchestra.run.smithi172.stdout:(9/11): python3-routes-2.5.1-5.el9.noarch.rpm 5.5 MB/s | 188 kB 00:00 2024-09-16T16:42:25.332 INFO:teuthology.orchestra.run.smithi172.stdout:(10/11): python3-protobuf-3.14.0-13.el9.noarch. 336 kB/s | 269 kB 00:00 2024-09-16T16:42:48.487 INFO:teuthology.orchestra.run.smithi172.stdout:(11/11): ceph-mgr-dashboard-19.3.0-4879.g81fedc 594 kB/s | 14 MB 00:24 2024-09-16T16:42:48.490 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:42:48.491 INFO:teuthology.orchestra.run.smithi172.stdout:Total 756 kB/s | 18 MB 00:24 2024-09-16T16:42:48.524 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-09-16T16:42:48.545 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-09-16T16:42:48.545 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-09-16T16:42:48.807 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-09-16T16:42:48.807 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-09-16T16:42:49.349 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-09-16T16:42:49.427 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/11 2024-09-16T16:42:49.465 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/11 2024-09-16T16:42:49.556 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 3/11 2024-09-16T16:42:49.692 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 4/11 2024-09-16T16:42:49.743 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 5/11 2024-09-16T16:42:49.828 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 6/11 2024-09-16T16:42:49.878 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 7/11 2024-09-16T16:42:49.906 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 8/11 2024-09-16T16:42:49.939 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9 9/11 2024-09-16T16:42:53.151 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el 10/11 2024-09-16T16:42:53.218 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 11/11 2024-09-16T16:42:54.971 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 11/11 2024-09-16T16:42:54.971 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el 1/11 2024-09-16T16:42:54.971 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 2/11 2024-09-16T16:42:54.971 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9 3/11 2024-09-16T16:42:54.971 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 4/11 2024-09-16T16:42:54.971 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 5/11 2024-09-16T16:42:54.971 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 6/11 2024-09-16T16:42:54.971 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 7/11 2024-09-16T16:42:54.971 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 8/11 2024-09-16T16:42:54.972 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/11 2024-09-16T16:42:54.972 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 10/11 2024-09-16T16:42:55.279 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 11/11 2024-09-16T16:42:55.279 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:42:55.280 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-09-16T16:42:55.280 INFO:teuthology.orchestra.run.smithi172.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-16T16:42:55.280 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:42:55.280 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:42:55.280 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:42:55.280 INFO:teuthology.orchestra.run.smithi172.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-16T16:42:55.280 INFO:teuthology.orchestra.run.smithi172.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-16T16:42:55.280 INFO:teuthology.orchestra.run.smithi172.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-16T16:42:55.280 INFO:teuthology.orchestra.run.smithi172.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-16T16:42:55.280 INFO:teuthology.orchestra.run.smithi172.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-16T16:42:55.280 INFO:teuthology.orchestra.run.smithi172.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-16T16:42:55.280 INFO:teuthology.orchestra.run.smithi172.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-16T16:42:55.280 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:42:55.280 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-16T16:42:55.546 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-16T16:42:56.115 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:03:15 ago on Mon 16 Sep 2024 04:39:41 PM UTC. 2024-09-16T16:42:56.249 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-16T16:42:56.250 INFO:teuthology.orchestra.run.smithi172.stdout:======================================================================================= 2024-09-16T16:42:56.250 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2024-09-16T16:42:56.250 INFO:teuthology.orchestra.run.smithi172.stdout:======================================================================================= 2024-09-16T16:42:56.250 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-09-16T16:42:56.250 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 7.4 M 2024-09-16T16:42:56.250 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2024-09-16T16:42:56.250 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-16T16:42:56.250 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-16T16:42:56.251 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-16T16:42:56.251 INFO:teuthology.orchestra.run.smithi172.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-16T16:42:56.251 INFO:teuthology.orchestra.run.smithi172.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-16T16:42:56.251 INFO:teuthology.orchestra.run.smithi172.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-16T16:42:56.251 INFO:teuthology.orchestra.run.smithi172.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-16T16:42:56.251 INFO:teuthology.orchestra.run.smithi172.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-16T16:42:56.251 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-16T16:42:56.251 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-16T16:42:56.251 INFO:teuthology.orchestra.run.smithi172.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-16T16:42:56.251 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:42:56.251 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-09-16T16:42:56.251 INFO:teuthology.orchestra.run.smithi172.stdout:======================================================================================= 2024-09-16T16:42:56.251 INFO:teuthology.orchestra.run.smithi172.stdout:Install 12 Packages 2024-09-16T16:42:56.251 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:42:56.252 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 38 M 2024-09-16T16:42:56.252 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 212 M 2024-09-16T16:42:56.252 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-09-16T16:42:56.634 INFO:teuthology.orchestra.run.smithi172.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 914 kB/s | 191 kB 00:00 2024-09-16T16:42:56.743 INFO:teuthology.orchestra.run.smithi172.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 2.5 MB/s | 801 kB 00:00 2024-09-16T16:42:56.768 INFO:teuthology.orchestra.run.smithi172.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 246 kB/s | 33 kB 00:00 2024-09-16T16:42:56.852 INFO:teuthology.orchestra.run.smithi172.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 218 kB/s | 18 kB 00:00 2024-09-16T16:42:56.935 INFO:teuthology.orchestra.run.smithi172.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 461 kB/s | 38 kB 00:00 2024-09-16T16:42:57.536 INFO:teuthology.orchestra.run.smithi172.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 3.8 MB/s | 3.0 MB 00:00 2024-09-16T16:42:57.652 INFO:teuthology.orchestra.run.smithi172.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 2.1 MB/s | 245 kB 00:00 2024-09-16T16:42:58.069 INFO:teuthology.orchestra.run.smithi172.stdout:(8/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 4.4 MB/s | 4.9 MB 00:01 2024-09-16T16:42:58.153 INFO:teuthology.orchestra.run.smithi172.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.9 MB/s | 250 kB 00:00 2024-09-16T16:42:58.961 INFO:teuthology.orchestra.run.smithi172.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 3.9 MB/s | 5.1 MB 00:01 2024-09-16T16:43:00.653 INFO:teuthology.orchestra.run.smithi172.stdout:(11/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 6.5 MB/s | 16 MB 00:02 2024-09-16T16:43:02.020 INFO:teuthology.orchestra.run.smithi172.stdout:(12/12): ceph-mgr-diskprediction-local-19.3.0-4 1.3 MB/s | 7.4 MB 00:05 2024-09-16T16:43:02.021 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:43:02.022 INFO:teuthology.orchestra.run.smithi172.stdout:Total 6.6 MB/s | 38 MB 00:05 2024-09-16T16:43:02.385 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-09-16T16:43:02.411 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-09-16T16:43:02.411 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-09-16T16:43:02.856 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-09-16T16:43:02.856 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-09-16T16:43:03.618 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-09-16T16:43:03.689 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-16T16:43:03.726 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-16T16:43:03.821 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-16T16:43:03.861 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-16T16:43:04.052 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-16T16:43:04.084 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-16T16:43:04.171 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-16T16:43:04.839 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-16T16:43:04.974 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-16T16:43:06.221 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-16T16:43:07.264 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-16T16:43:07.308 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 12/12 2024-09-16T16:43:09.893 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 12/12 2024-09-16T16:43:09.893 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 1/12 2024-09-16T16:43:09.893 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-16T16:43:09.893 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-16T16:43:09.893 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-16T16:43:09.893 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-16T16:43:09.893 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-16T16:43:09.893 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-16T16:43:09.893 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-16T16:43:09.894 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-16T16:43:09.894 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-16T16:43:09.894 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-16T16:43:10.338 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-16T16:43:10.339 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:43:10.339 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-09-16T16:43:10.339 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:43:10.339 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-16T16:43:10.339 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-16T16:43:10.339 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-16T16:43:10.339 INFO:teuthology.orchestra.run.smithi172.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-16T16:43:10.339 INFO:teuthology.orchestra.run.smithi172.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-16T16:43:10.339 INFO:teuthology.orchestra.run.smithi172.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-16T16:43:10.339 INFO:teuthology.orchestra.run.smithi172.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-16T16:43:10.339 INFO:teuthology.orchestra.run.smithi172.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-16T16:43:10.339 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-16T16:43:10.340 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-16T16:43:10.340 INFO:teuthology.orchestra.run.smithi172.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-16T16:43:10.340 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:43:10.340 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-16T16:43:10.769 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-mgr-rook 2024-09-16T16:43:11.351 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:03:30 ago on Mon 16 Sep 2024 04:39:41 PM UTC. 2024-09-16T16:43:11.486 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-16T16:43:11.487 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T16:43:11.487 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2024-09-16T16:43:11.487 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T16:43:11.487 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-09-16T16:43:11.487 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-rook noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 49 k 2024-09-16T16:43:11.487 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2024-09-16T16:43:11.487 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-16T16:43:11.487 INFO:teuthology.orchestra.run.smithi172.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-16T16:43:11.487 INFO:teuthology.orchestra.run.smithi172.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-16T16:43:11.488 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-16T16:43:11.488 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-16T16:43:11.488 INFO:teuthology.orchestra.run.smithi172.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-16T16:43:11.488 INFO:teuthology.orchestra.run.smithi172.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-16T16:43:11.488 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-16T16:43:11.488 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-16T16:43:11.488 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-16T16:43:11.488 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-16T16:43:11.488 INFO:teuthology.orchestra.run.smithi172.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-16T16:43:11.488 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:43:11.488 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-09-16T16:43:11.488 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T16:43:11.488 INFO:teuthology.orchestra.run.smithi172.stdout:Install 13 Packages 2024-09-16T16:43:11.489 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:43:11.489 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 2.2 M 2024-09-16T16:43:11.489 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 26 M 2024-09-16T16:43:11.489 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-09-16T16:43:12.190 INFO:teuthology.orchestra.run.smithi172.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 38 kB/s | 19 kB 00:00 2024-09-16T16:43:12.224 INFO:teuthology.orchestra.run.smithi172.stdout:(2/13): ceph-mgr-rook-19.3.0-4879.g81fedcb3.el9 92 kB/s | 49 kB 00:00 2024-09-16T16:43:12.249 INFO:teuthology.orchestra.run.smithi172.stdout:(3/13): python3-jsonpatch-1.21-16.el9.noarch.rp 46 kB/s | 26 kB 00:00 2024-09-16T16:43:13.000 INFO:teuthology.orchestra.run.smithi172.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 205 kB/s | 159 kB 00:00 2024-09-16T16:43:13.041 INFO:teuthology.orchestra.run.smithi172.stdout:(5/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 261 kB/s | 222 kB 00:00 2024-09-16T16:43:13.092 INFO:teuthology.orchestra.run.smithi172.stdout:(6/13): python3-cachetools-4.2.4-1.el9.noarch.r 650 kB/s | 32 kB 00:00 2024-09-16T16:43:13.117 INFO:teuthology.orchestra.run.smithi172.stdout:(7/13): python3-certifi-2023.05.07-4.el9.noarch 565 kB/s | 14 kB 00:00 2024-09-16T16:43:13.142 INFO:teuthology.orchestra.run.smithi172.stdout:(8/13): python3-pyasn1-modules-0.4.8-6.el9.noar 312 kB/s | 279 kB 00:00 2024-09-16T16:43:13.184 INFO:teuthology.orchestra.run.smithi172.stdout:(9/13): python3-google-auth-2.34.0-1.el9.noarch 3.2 MB/s | 220 kB 00:00 2024-09-16T16:43:13.209 INFO:teuthology.orchestra.run.smithi172.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 2.5 MB/s | 59 kB 00:00 2024-09-16T16:43:13.243 INFO:teuthology.orchestra.run.smithi172.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 2.6 MB/s | 90 kB 00:00 2024-09-16T16:43:13.310 INFO:teuthology.orchestra.run.smithi172.stdout:(12/13): python3-kubernetes-26.1.0-2.el9.noarch 6.1 MB/s | 1.0 MB 00:00 2024-09-16T16:43:13.652 INFO:teuthology.orchestra.run.smithi172.stdout:(13/13): python3-requests-oauthlib-1.3.0-12.el9 82 kB/s | 54 kB 00:00 2024-09-16T16:43:13.655 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:43:13.656 INFO:teuthology.orchestra.run.smithi172.stdout:Total 1.0 MB/s | 2.2 MB 00:02 2024-09-16T16:43:13.726 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-09-16T16:43:13.743 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-09-16T16:43:13.743 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-09-16T16:43:13.834 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-09-16T16:43:13.835 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-09-16T16:43:14.340 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-09-16T16:43:14.506 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-16T16:43:14.569 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-16T16:43:14.625 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-16T16:43:14.662 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-16T16:43:14.741 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-16T16:43:14.838 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-16T16:43:14.949 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-16T16:43:15.013 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-16T16:43:15.735 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-16T16:43:15.785 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-16T16:43:15.827 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-16T16:43:15.875 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-16T16:43:15.897 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 13/13 2024-09-16T16:43:16.660 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 13/13 2024-09-16T16:43:16.661 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 1/13 2024-09-16T16:43:16.661 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-16T16:43:16.661 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-16T16:43:16.661 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-16T16:43:16.661 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-16T16:43:16.661 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-16T16:43:16.661 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-16T16:43:16.661 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-16T16:43:16.661 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-16T16:43:16.661 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-16T16:43:16.661 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-16T16:43:16.662 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-16T16:43:16.992 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-16T16:43:16.992 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:43:16.992 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-09-16T16:43:16.992 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:43:16.992 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-16T16:43:16.992 INFO:teuthology.orchestra.run.smithi172.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-16T16:43:16.992 INFO:teuthology.orchestra.run.smithi172.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-16T16:43:16.993 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-16T16:43:16.993 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-16T16:43:16.993 INFO:teuthology.orchestra.run.smithi172.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-16T16:43:16.993 INFO:teuthology.orchestra.run.smithi172.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-16T16:43:16.993 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-16T16:43:16.993 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-16T16:43:16.993 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-16T16:43:16.993 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-16T16:43:16.993 INFO:teuthology.orchestra.run.smithi172.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-16T16:43:16.993 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:43:16.993 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-16T16:43:17.265 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-mgr-cephadm 2024-09-16T16:43:17.840 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:03:36 ago on Mon 16 Sep 2024 04:39:41 PM UTC. 2024-09-16T16:43:17.976 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-16T16:43:17.976 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T16:43:17.976 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2024-09-16T16:43:17.977 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T16:43:17.977 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-09-16T16:43:17.977 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 154 k 2024-09-16T16:43:17.977 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2024-09-16T16:43:17.977 INFO:teuthology.orchestra.run.smithi172.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-16T16:43:17.977 INFO:teuthology.orchestra.run.smithi172.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-16T16:43:17.977 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-16T16:43:17.977 INFO:teuthology.orchestra.run.smithi172.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-16T16:43:17.977 INFO:teuthology.orchestra.run.smithi172.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-16T16:43:17.977 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:43:17.977 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-09-16T16:43:17.978 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T16:43:17.978 INFO:teuthology.orchestra.run.smithi172.stdout:Install 6 Packages 2024-09-16T16:43:17.978 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:43:17.978 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 7.0 M 2024-09-16T16:43:17.978 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 33 M 2024-09-16T16:43:17.978 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-09-16T16:43:18.670 INFO:teuthology.orchestra.run.smithi172.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 2.0 MB/s | 248 kB 00:00 2024-09-16T16:43:18.769 INFO:teuthology.orchestra.run.smithi172.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 5.4 MB/s | 548 kB 00:00 2024-09-16T16:43:18.803 INFO:teuthology.orchestra.run.smithi172.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.7 MB/s | 58 kB 00:00 2024-09-16T16:43:18.828 INFO:teuthology.orchestra.run.smithi172.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.9 MB/s | 74 kB 00:00 2024-09-16T16:43:19.412 INFO:teuthology.orchestra.run.smithi172.stdout:(5/6): ceph-mgr-cephadm-19.3.0-4879.g81fedcb3.e 179 kB/s | 154 kB 00:00 2024-09-16T16:43:20.028 INFO:teuthology.orchestra.run.smithi172.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 4.0 MB/s | 6.0 MB 00:01 2024-09-16T16:43:20.030 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:43:20.031 INFO:teuthology.orchestra.run.smithi172.stdout:Total 3.4 MB/s | 7.0 MB 00:02 2024-09-16T16:43:20.102 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-09-16T16:43:20.114 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-09-16T16:43:20.114 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-09-16T16:43:20.216 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-09-16T16:43:20.216 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-09-16T16:43:20.516 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-09-16T16:43:20.690 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-16T16:43:20.747 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-16T16:43:21.277 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-16T16:43:21.359 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-16T16:43:21.426 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-16T16:43:21.451 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 6/6 2024-09-16T16:43:22.205 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 6/6 2024-09-16T16:43:22.205 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/6 2024-09-16T16:43:22.205 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-16T16:43:22.205 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-16T16:43:22.206 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-16T16:43:22.206 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-16T16:43:22.496 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-16T16:43:22.497 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:43:22.497 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-09-16T16:43:22.497 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:43:22.497 INFO:teuthology.orchestra.run.smithi172.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-16T16:43:22.497 INFO:teuthology.orchestra.run.smithi172.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-16T16:43:22.497 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-16T16:43:22.497 INFO:teuthology.orchestra.run.smithi172.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-16T16:43:22.497 INFO:teuthology.orchestra.run.smithi172.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-16T16:43:22.497 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:43:22.497 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-16T16:43:22.768 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-fuse 2024-09-16T16:43:23.338 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:03:42 ago on Mon 16 Sep 2024 04:39:41 PM UTC. 2024-09-16T16:43:23.474 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-16T16:43:23.474 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T16:43:23.474 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2024-09-16T16:43:23.474 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T16:43:23.474 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-09-16T16:43:23.474 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-fuse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 884 k 2024-09-16T16:43:23.475 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2024-09-16T16:43:23.475 INFO:teuthology.orchestra.run.smithi172.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-16T16:43:23.475 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:43:23.475 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-09-16T16:43:23.475 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T16:43:23.475 INFO:teuthology.orchestra.run.smithi172.stdout:Install 2 Packages 2024-09-16T16:43:23.475 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:43:23.475 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 964 k 2024-09-16T16:43:23.475 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 4.1 M 2024-09-16T16:43:23.476 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-09-16T16:43:23.797 INFO:teuthology.orchestra.run.smithi172.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 530 kB/s | 80 kB 00:00 2024-09-16T16:43:25.555 INFO:teuthology.orchestra.run.smithi172.stdout:(2/2): ceph-fuse-19.3.0-4879.g81fedcb3.el9.x86_ 463 kB/s | 884 kB 00:01 2024-09-16T16:43:25.556 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:43:25.556 INFO:teuthology.orchestra.run.smithi172.stdout:Total 463 kB/s | 964 kB 00:02 2024-09-16T16:43:25.568 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-09-16T16:43:25.593 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-09-16T16:43:25.593 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-09-16T16:43:25.674 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-09-16T16:43:25.675 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-09-16T16:43:25.868 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-09-16T16:43:26.026 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-16T16:43:26.097 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/2 2024-09-16T16:43:26.858 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/2 2024-09-16T16:43:26.858 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/2 2024-09-16T16:43:27.152 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-16T16:43:27.152 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:43:27.152 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-09-16T16:43:27.152 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-16T16:43:27.152 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:43:27.152 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-16T16:43:27.437 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-volume 2024-09-16T16:43:28.021 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:03:47 ago on Mon 16 Sep 2024 04:39:41 PM UTC. 2024-09-16T16:43:28.158 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-16T16:43:28.159 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T16:43:28.160 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2024-09-16T16:43:28.160 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T16:43:28.160 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-09-16T16:43:28.160 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-volume noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 285 k 2024-09-16T16:43:28.160 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:43:28.160 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-09-16T16:43:28.160 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T16:43:28.160 INFO:teuthology.orchestra.run.smithi172.stdout:Install 1 Package 2024-09-16T16:43:28.160 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:43:28.160 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 285 k 2024-09-16T16:43:28.161 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 1.3 M 2024-09-16T16:43:28.161 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-09-16T16:43:29.310 INFO:teuthology.orchestra.run.smithi172.stdout:ceph-volume-19.3.0-4879.g81fedcb3.el9.noarch.rp 248 kB/s | 285 kB 00:01 2024-09-16T16:43:29.310 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:43:29.311 INFO:teuthology.orchestra.run.smithi172.stdout:Total 248 kB/s | 285 kB 00:01 2024-09-16T16:43:29.311 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-09-16T16:43:29.321 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-09-16T16:43:29.321 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-09-16T16:43:29.356 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-09-16T16:43:29.356 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-09-16T16:43:29.582 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-09-16T16:43:29.654 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:43:29.670 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:43:29.670 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:43:29.670 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-16T16:43:29.670 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:43:30.715 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:43:30.715 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:43:30.715 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-09-16T16:43:30.715 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:43:30.715 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:43:30.715 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-16T16:43:31.054 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install librados-devel 2024-09-16T16:43:31.639 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:03:50 ago on Mon 16 Sep 2024 04:39:41 PM UTC. 2024-09-16T16:43:31.782 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-16T16:43:31.783 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T16:43:31.783 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repo Size 2024-09-16T16:43:31.783 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T16:43:31.783 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-09-16T16:43:31.783 INFO:teuthology.orchestra.run.smithi172.stdout: librados-devel x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 125 k 2024-09-16T16:43:31.783 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:43:31.783 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-09-16T16:43:31.783 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T16:43:31.783 INFO:teuthology.orchestra.run.smithi172.stdout:Install 1 Package 2024-09-16T16:43:31.783 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:43:31.783 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 125 k 2024-09-16T16:43:31.783 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 445 k 2024-09-16T16:43:31.784 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-09-16T16:43:32.382 INFO:teuthology.orchestra.run.smithi172.stdout:librados-devel-19.3.0-4879.g81fedcb3.el9.x86_64 209 kB/s | 125 kB 00:00 2024-09-16T16:43:32.382 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:43:32.383 INFO:teuthology.orchestra.run.smithi172.stdout:Total 208 kB/s | 125 kB 00:00 2024-09-16T16:43:32.383 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-09-16T16:43:32.389 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-09-16T16:43:32.389 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-09-16T16:43:32.456 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-09-16T16:43:32.456 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-09-16T16:43:32.626 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-09-16T16:43:32.721 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:43:33.211 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:43:33.419 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:43:33.419 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:43:33.419 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-09-16T16:43:33.419 INFO:teuthology.orchestra.run.smithi172.stdout: librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:43:33.419 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:43:33.419 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-16T16:43:33.650 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install libcephfs2 2024-09-16T16:43:34.231 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:03:53 ago on Mon 16 Sep 2024 04:39:41 PM UTC. 2024-09-16T16:43:34.323 INFO:teuthology.orchestra.run.smithi172.stdout:Package libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:43:34.369 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-16T16:43:34.370 INFO:teuthology.orchestra.run.smithi172.stdout:Nothing to do. 2024-09-16T16:43:34.371 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-16T16:43:34.449 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install libcephfs-devel 2024-09-16T16:43:35.018 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:03:54 ago on Mon 16 Sep 2024 04:39:41 PM UTC. 2024-09-16T16:43:35.151 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-16T16:43:35.152 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T16:43:35.152 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repo Size 2024-09-16T16:43:35.152 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T16:43:35.152 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-09-16T16:43:35.152 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs-devel x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 32 k 2024-09-16T16:43:35.152 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:43:35.152 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-09-16T16:43:35.153 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T16:43:35.153 INFO:teuthology.orchestra.run.smithi172.stdout:Install 1 Package 2024-09-16T16:43:35.153 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:43:35.153 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 32 k 2024-09-16T16:43:35.153 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 142 k 2024-09-16T16:43:35.154 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-09-16T16:43:35.743 INFO:teuthology.orchestra.run.smithi172.stdout:libcephfs-devel-19.3.0-4879.g81fedcb3.el9.x86_6 54 kB/s | 32 kB 00:00 2024-09-16T16:43:35.744 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:43:35.744 INFO:teuthology.orchestra.run.smithi172.stdout:Total 54 kB/s | 32 kB 00:00 2024-09-16T16:43:35.744 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-09-16T16:43:35.748 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-09-16T16:43:35.748 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-09-16T16:43:35.769 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-09-16T16:43:35.770 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-09-16T16:43:35.862 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-09-16T16:43:35.965 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:43:36.357 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:43:36.578 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:43:36.578 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:43:36.578 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-09-16T16:43:36.578 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:43:36.578 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:43:36.578 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-16T16:43:36.785 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install librados2 2024-09-16T16:43:37.358 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:03:56 ago on Mon 16 Sep 2024 04:39:41 PM UTC. 2024-09-16T16:43:37.447 INFO:teuthology.orchestra.run.smithi172.stdout:Package librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:43:37.491 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-16T16:43:37.492 INFO:teuthology.orchestra.run.smithi172.stdout:Nothing to do. 2024-09-16T16:43:37.492 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-16T16:43:37.577 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install librbd1 2024-09-16T16:43:38.142 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:03:57 ago on Mon 16 Sep 2024 04:39:41 PM UTC. 2024-09-16T16:43:38.231 INFO:teuthology.orchestra.run.smithi172.stdout:Package librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:43:38.277 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-16T16:43:38.277 INFO:teuthology.orchestra.run.smithi172.stdout:Nothing to do. 2024-09-16T16:43:38.277 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-16T16:43:38.361 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install python3-rados 2024-09-16T16:43:38.927 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:03:57 ago on Mon 16 Sep 2024 04:39:41 PM UTC. 2024-09-16T16:43:39.017 INFO:teuthology.orchestra.run.smithi172.stdout:Package python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:43:39.060 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-16T16:43:39.061 INFO:teuthology.orchestra.run.smithi172.stdout:Nothing to do. 2024-09-16T16:43:39.061 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-16T16:43:39.142 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install python3-rgw 2024-09-16T16:43:39.712 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:03:58 ago on Mon 16 Sep 2024 04:39:41 PM UTC. 2024-09-16T16:43:39.801 INFO:teuthology.orchestra.run.smithi172.stdout:Package python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:43:39.844 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-16T16:43:39.845 INFO:teuthology.orchestra.run.smithi172.stdout:Nothing to do. 2024-09-16T16:43:39.845 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-16T16:43:39.927 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install python3-cephfs 2024-09-16T16:43:40.495 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:03:59 ago on Mon 16 Sep 2024 04:39:41 PM UTC. 2024-09-16T16:43:40.584 INFO:teuthology.orchestra.run.smithi172.stdout:Package python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:43:40.629 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-16T16:43:40.630 INFO:teuthology.orchestra.run.smithi172.stdout:Nothing to do. 2024-09-16T16:43:40.630 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-16T16:43:40.710 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install python3-rbd 2024-09-16T16:43:41.277 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:04:00 ago on Mon 16 Sep 2024 04:39:41 PM UTC. 2024-09-16T16:43:41.366 INFO:teuthology.orchestra.run.smithi172.stdout:Package python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:43:41.410 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-16T16:43:41.411 INFO:teuthology.orchestra.run.smithi172.stdout:Nothing to do. 2024-09-16T16:43:41.411 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-16T16:43:41.493 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install rbd-fuse 2024-09-16T16:43:42.054 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:04:01 ago on Mon 16 Sep 2024 04:39:41 PM UTC. 2024-09-16T16:43:42.188 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-16T16:43:42.189 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T16:43:42.189 INFO:teuthology.orchestra.run.smithi172.stdout: Package Architecture Version Repository Size 2024-09-16T16:43:42.189 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T16:43:42.189 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-09-16T16:43:42.189 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-fuse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 91 k 2024-09-16T16:43:42.189 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:43:42.189 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-09-16T16:43:42.189 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T16:43:42.189 INFO:teuthology.orchestra.run.smithi172.stdout:Install 1 Package 2024-09-16T16:43:42.189 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:43:42.189 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 91 k 2024-09-16T16:43:42.189 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 321 k 2024-09-16T16:43:42.189 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-09-16T16:43:42.780 INFO:teuthology.orchestra.run.smithi172.stdout:rbd-fuse-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 154 kB/s | 91 kB 00:00 2024-09-16T16:43:42.780 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:43:42.780 INFO:teuthology.orchestra.run.smithi172.stdout:Total 154 kB/s | 91 kB 00:00 2024-09-16T16:43:42.781 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-09-16T16:43:42.790 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-09-16T16:43:42.790 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-09-16T16:43:42.854 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-09-16T16:43:42.855 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-09-16T16:43:43.009 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-09-16T16:43:43.127 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:43:43.520 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:43:43.743 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:43:43.744 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:43:43.744 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-09-16T16:43:43.744 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:43:43.744 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:43:43.744 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-16T16:43:44.095 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install rbd-mirror 2024-09-16T16:43:44.678 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:04:03 ago on Mon 16 Sep 2024 04:39:41 PM UTC. 2024-09-16T16:43:44.818 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-16T16:43:44.819 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T16:43:44.819 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repo Size 2024-09-16T16:43:44.819 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T16:43:44.819 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-09-16T16:43:44.819 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-mirror x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.5 M 2024-09-16T16:43:44.819 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:43:44.819 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-09-16T16:43:44.819 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T16:43:44.819 INFO:teuthology.orchestra.run.smithi172.stdout:Install 1 Package 2024-09-16T16:43:44.819 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:43:44.820 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 3.5 M 2024-09-16T16:43:44.820 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 30 M 2024-09-16T16:43:44.820 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-09-16T16:43:47.149 INFO:teuthology.orchestra.run.smithi172.stdout:rbd-mirror-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 1.5 MB/s | 3.5 MB 00:02 2024-09-16T16:43:47.150 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:43:47.150 INFO:teuthology.orchestra.run.smithi172.stdout:Total 1.5 MB/s | 3.5 MB 00:02 2024-09-16T16:43:47.151 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-09-16T16:43:47.164 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-09-16T16:43:47.164 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-09-16T16:43:47.250 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-09-16T16:43:47.250 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-09-16T16:43:47.856 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-09-16T16:43:47.925 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:43:47.949 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:43:47.949 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:43:47.949 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-16T16:43:47.949 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T16:43:47.949 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T16:43:47.949 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:43:49.219 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:43:49.219 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:43:49.219 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-09-16T16:43:49.220 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:43:49.220 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:43:49.220 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-16T16:43:49.484 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install rbd-nbd 2024-09-16T16:43:50.058 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:04:09 ago on Mon 16 Sep 2024 04:39:41 PM UTC. 2024-09-16T16:43:50.195 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-16T16:43:50.196 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T16:43:50.196 INFO:teuthology.orchestra.run.smithi172.stdout: Package Architecture Version Repository Size 2024-09-16T16:43:50.196 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T16:43:50.196 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-09-16T16:43:50.196 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-nbd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 177 k 2024-09-16T16:43:50.196 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:43:50.196 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-09-16T16:43:50.196 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T16:43:50.196 INFO:teuthology.orchestra.run.smithi172.stdout:Install 1 Package 2024-09-16T16:43:50.197 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:43:50.197 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 177 k 2024-09-16T16:43:50.197 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 685 k 2024-09-16T16:43:50.197 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-09-16T16:43:51.643 INFO:teuthology.orchestra.run.smithi172.stdout:rbd-nbd-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 122 kB/s | 177 kB 00:01 2024-09-16T16:43:51.644 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:43:51.644 INFO:teuthology.orchestra.run.smithi172.stdout:Total 122 kB/s | 177 kB 00:01 2024-09-16T16:43:51.645 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-09-16T16:43:51.656 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-09-16T16:43:51.656 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-09-16T16:43:51.730 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-09-16T16:43:51.731 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-09-16T16:43:51.909 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-09-16T16:43:52.008 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:43:52.430 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:43:52.709 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:43:52.709 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:43:52.709 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-09-16T16:43:52.709 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:43:52.710 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:43:52.710 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-16T16:43:53.007 DEBUG:teuthology.parallel:result is None 2024-09-16T16:43:53.008 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=81fedcb3b484c843d22ffbc8d179cb567b7083b5 2024-09-16T16:43:53.150 DEBUG:teuthology.orchestra.run.smithi172:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-16T16:43:53.173 INFO:teuthology.orchestra.run.smithi172.stdout:19.3.0-4879.g81fedcb3.el9 2024-09-16T16:43:53.173 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4879.g81fedcb3.el9 2024-09-16T16:43:53.173 INFO:teuthology.task.install:The correct ceph version 19.3.0-4879.g81fedcb3 is installed. 2024-09-16T16:43:53.175 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-16T16:43:53.175 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-16T16:43:53.175 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-16T16:43:53.239 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-16T16:43:53.240 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-16T16:43:53.240 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/daemon-helper 2024-09-16T16:43:53.306 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-16T16:43:53.370 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-16T16:43:53.371 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-16T16:43:53.371 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-16T16:43:53.435 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-16T16:43:53.500 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-16T16:43:53.501 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-16T16:43:53.501 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/stdin-killer 2024-09-16T16:43:53.565 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-16T16:43:53.630 INFO:teuthology.run_tasks:Running task ceph... 2024-09-16T16:43:53.711 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-16T16:43:53.712 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 777 /var/log/ceph 2024-09-16T16:43:53.745 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-16T16:43:53.745 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-16T16:43:53.812 INFO:tasks.ceph:Creating extra log directories... 2024-09-16T16:43:53.813 DEBUG:teuthology.orchestra.run.smithi172:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-16T16:43:53.886 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-16T16:43:53.887 INFO:tasks.ceph:config {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr stats period': 30}, 'osd.0': {'crimson seastar cpu cores': '0-1'}, 'osd.1': {'crimson seastar cpu cores': '2-3'}, 'osd.2': {'crimson seastar cpu cores': '4-5'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'is full \\(reached quota', '\\(POOL_FULL\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-16T16:43:53.887 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7907393', 'branch': 'wip-matanb-crimson-testing-59543', 'description': 'crimson-rados/rbd/{clusters/fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore tasks/rbd_api_tests_old_format}', 'email': None, 'first_in_suite': False, 'job_id': '7907393', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-matanb-crimson-testing-59543'}, 'ceph': {'conf': {'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr stats period': 30}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'osd pool default crimson': True}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'osd.0': {'crimson seastar cpu cores': '0-1'}, 'osd.1': {'crimson seastar cpu cores': '2-3'}, 'osd.2': {'crimson seastar cpu cores': '4-5'}}, 'flavor': 'crimson', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'is full \\(reached quota', '\\(POOL_FULL\\)'], 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'global': {'osd crush chooseleaf type': 0, 'osd pool default pg num': 128, 'osd pool default pgp num': 128, 'osd pool default size': 2}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'crimson', 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'workunit': {'branch': 'main', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': '0325fd3c11a225c0fd9eb38fab88aad1370ad779'}}, 'owner': 'scheduled_matan@teuthology', 'priority': 60, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0']], 'seed': 6678, 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5', 'sleep_before_teardown': 0, 'suite': 'crimson-rados', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '0325fd3c11a225c0fd9eb38fab88aad1370ad779', 'targets': {'smithi172.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGcOfqPrhU2PrL2dowLgnnIN35RzIgwLeT/uRxHrUymUf7Y0pWos5orbBU+sMrm7JB5LdMpaau/ePDFk4xqulTo='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr stats period': 30}, 'osd.0': {'crimson seastar cpu cores': '0-1'}, 'osd.1': {'crimson seastar cpu cores': '2-3'}, 'osd.2': {'crimson seastar cpu cores': '4-5'}}, 'flavor': 'crimson', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'is full \\(reached quota', '\\(POOL_FULL\\)'], 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5', 'cluster': 'ceph'}}, {'workunit': {'clients': {'client.0': ['rbd/crimson/test_crimson_librbd.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-16_16:23:48', 'tube': 'smithi', 'user': 'matan', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-16T16:43:53.887 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-16T16:43:53.935 DEBUG:teuthology.orchestra.run.smithi172:> sudo install -d -m0777 -- /var/run/ceph 2024-09-16T16:43:54.002 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-16T16:43:54.002 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/scratch_devs of=/dev/stdout 2024-09-16T16:43:54.057 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-16T16:43:54.057 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_1 2024-09-16T16:43:54.111 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-16T16:43:54.112 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T16:43:54.112 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-16T16:43:54.112 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T16:43:54.112 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T16:43:54.112 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-09-16 16:43:48.202239058 +0000 2024-09-16T16:43:54.112 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-09-16 16:38:49.508141729 +0000 2024-09-16T16:43:54.112 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-09-16 16:38:49.508141729 +0000 2024-09-16T16:43:54.112 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-09-16 16:38:49.508141729 +0000 2024-09-16T16:43:54.112 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-16T16:43:54.175 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-09-16T16:43:54.175 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-09-16T16:43:54.175 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.00020799 s, 2.5 MB/s 2024-09-16T16:43:54.176 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-16T16:43:54.233 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_2 2024-09-16T16:43:54.288 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-16T16:43:54.288 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T16:43:54.288 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-16T16:43:54.288 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T16:43:54.288 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T16:43:54.288 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-09-16 16:43:48.202239058 +0000 2024-09-16T16:43:54.288 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-09-16 16:38:49.877132975 +0000 2024-09-16T16:43:54.288 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-09-16 16:38:49.877132975 +0000 2024-09-16T16:43:54.288 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-09-16 16:38:49.877132975 +0000 2024-09-16T16:43:54.289 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-16T16:43:54.350 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-09-16T16:43:54.351 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-09-16T16:43:54.351 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000192022 s, 2.7 MB/s 2024-09-16T16:43:54.352 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-16T16:43:54.407 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_3 2024-09-16T16:43:54.462 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-16T16:43:54.462 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T16:43:54.463 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-16T16:43:54.463 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T16:43:54.463 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T16:43:54.463 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-09-16 16:43:48.202239058 +0000 2024-09-16T16:43:54.463 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-09-16 16:38:50.239124388 +0000 2024-09-16T16:43:54.463 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-09-16 16:38:50.239124388 +0000 2024-09-16T16:43:54.463 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-09-16 16:38:50.239124388 +0000 2024-09-16T16:43:54.463 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-16T16:43:54.526 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-09-16T16:43:54.526 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-09-16T16:43:54.526 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000242054 s, 2.1 MB/s 2024-09-16T16:43:54.528 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-16T16:43:54.584 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_4 2024-09-16T16:43:54.640 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-16T16:43:54.640 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T16:43:54.640 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-16T16:43:54.640 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T16:43:54.640 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T16:43:54.640 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-09-16 16:43:48.202239058 +0000 2024-09-16T16:43:54.640 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-09-16 16:38:50.603115753 +0000 2024-09-16T16:43:54.641 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-09-16 16:38:50.603115753 +0000 2024-09-16T16:43:54.641 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-09-16 16:38:50.603115753 +0000 2024-09-16T16:43:54.641 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-16T16:43:54.703 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-09-16T16:43:54.703 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-09-16T16:43:54.703 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000222146 s, 2.3 MB/s 2024-09-16T16:43:54.704 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-16T16:43:54.761 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-16T16:43:54.761 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi172.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2024-09-16T16:43:54.761 INFO:tasks.ceph:Generating config... 2024-09-16T16:43:54.762 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2024-09-16T16:43:54.762 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2024-09-16T16:43:54.762 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2024-09-16T16:43:54.762 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2024-09-16T16:43:54.762 INFO:tasks.ceph:[mon] paxos service trim min = 10 2024-09-16T16:43:54.762 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-16T16:43:54.763 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-16T16:43:54.763 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-16T16:43:54.763 INFO:tasks.ceph:[mon] osd pool default crimson = True 2024-09-16T16:43:54.763 INFO:tasks.ceph:[osd] debug monc = 20 2024-09-16T16:43:54.763 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-16T16:43:54.763 INFO:tasks.ceph:[osd] bluestore compression algorithm = snappy 2024-09-16T16:43:54.763 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-09-16T16:43:54.763 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-16T16:43:54.763 INFO:tasks.ceph:[osd] bluestore rocksdb cf = False 2024-09-16T16:43:54.763 INFO:tasks.ceph:[osd] crimson alien thread cpu cores = 6-7 2024-09-16T16:43:54.763 INFO:tasks.ceph:[osd] crimson osd obc lru size = 10 2024-09-16T16:43:54.763 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-16T16:43:54.763 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-16T16:43:54.763 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-16T16:43:54.763 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-16T16:43:54.763 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-16T16:43:54.764 INFO:tasks.ceph:[osd] err to stderr = True 2024-09-16T16:43:54.764 INFO:tasks.ceph:[osd] log flush on exit = True 2024-09-16T16:43:54.764 INFO:tasks.ceph:[osd] log to file = False 2024-09-16T16:43:54.764 INFO:tasks.ceph:[osd] log to stderr = True 2024-09-16T16:43:54.764 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-16T16:43:54.764 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-16T16:43:54.764 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-16T16:43:54.764 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-16T16:43:54.764 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-16T16:43:54.764 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-16T16:43:54.764 INFO:tasks.ceph:[global] enable experimental unrecoverable data corrupting features = crimson 2024-09-16T16:43:54.764 INFO:tasks.ceph:[global] ms client mode = crc 2024-09-16T16:43:54.764 INFO:tasks.ceph:[global] ms cluster mode = crc 2024-09-16T16:43:54.764 INFO:tasks.ceph:[global] ms mon client mode = crc 2024-09-16T16:43:54.764 INFO:tasks.ceph:[global] ms mon cluster mode = crc 2024-09-16T16:43:54.764 INFO:tasks.ceph:[global] ms mon service mode = crc 2024-09-16T16:43:54.765 INFO:tasks.ceph:[global] ms service mode = crc 2024-09-16T16:43:54.765 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-16T16:43:54.765 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-16T16:43:54.765 INFO:tasks.ceph:[mgr] mgr stats period = 30 2024-09-16T16:43:54.765 INFO:tasks.ceph:[osd.0] crimson seastar cpu cores = 0-1 2024-09-16T16:43:54.765 INFO:tasks.ceph:[osd.1] crimson seastar cpu cores = 2-3 2024-09-16T16:43:54.765 INFO:tasks.ceph:[osd.2] crimson seastar cpu cores = 4-5 2024-09-16T16:43:54.765 INFO:tasks.ceph:Setting up mon.a... 2024-09-16T16:43:54.765 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-16T16:43:54.877 INFO:teuthology.orchestra.run.smithi172.stdout:creating /etc/ceph/ceph.keyring 2024-09-16T16:43:54.880 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-16T16:43:54.930 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-16T16:43:54.954 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.172')] 2024-09-16T16:43:54.954 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.172', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'mgr stats period': 30}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'osd pool default crimson': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'osd.0': {'crimson seastar cpu cores': '0-1'}, 'osd.1': {'crimson seastar cpu cores': '2-3'}, 'osd.2': {'crimson seastar cpu cores': '4-5'}} 2024-09-16T16:43:54.955 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-16T16:43:54.955 DEBUG:teuthology.orchestra.run.smithi172:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-16T16:43:55.009 DEBUG:teuthology.orchestra.run.smithi172:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.172 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-16T16:43:55.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:43:55.100+0000 7fa1ea343f00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:43:55.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:43:55.100+0000 7fa1ea343f00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:43:55.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:43:55.101+0000 7fa1ea343f00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:43:55.101 INFO:teuthology.orchestra.run.smithi172.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-16T16:43:55.101 INFO:teuthology.orchestra.run.smithi172.stdout:monmaptool: generated fsid b37952f5-be5e-4143-b02a-8a862025ace7 2024-09-16T16:43:55.102 INFO:teuthology.orchestra.run.smithi172.stdout:setting min_mon_release = quincy 2024-09-16T16:43:55.102 INFO:teuthology.orchestra.run.smithi172.stdout:epoch 0 2024-09-16T16:43:55.102 INFO:teuthology.orchestra.run.smithi172.stdout:fsid b37952f5-be5e-4143-b02a-8a862025ace7 2024-09-16T16:43:55.102 INFO:teuthology.orchestra.run.smithi172.stdout:last_changed 2024-09-16T16:43:55.102069+0000 2024-09-16T16:43:55.102 INFO:teuthology.orchestra.run.smithi172.stdout:created 2024-09-16T16:43:55.102069+0000 2024-09-16T16:43:55.102 INFO:teuthology.orchestra.run.smithi172.stdout:min_mon_release 17 (quincy) 2024-09-16T16:43:55.102 INFO:teuthology.orchestra.run.smithi172.stdout:election_strategy: 1 2024-09-16T16:43:55.102 INFO:teuthology.orchestra.run.smithi172.stdout:0: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.a 2024-09-16T16:43:55.102 INFO:teuthology.orchestra.run.smithi172.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-09-16T16:43:55.103 DEBUG:teuthology.orchestra.run.smithi172:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-16T16:43:55.118 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID b37952f5-be5e-4143-b02a-8a862025ace7... 2024-09-16T16:43:55.118 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-16T16:43:55.200 INFO:teuthology.orchestra.run.smithi172.stdout:[global] 2024-09-16T16:43:55.201 INFO:teuthology.orchestra.run.smithi172.stdout: chdir = "" 2024-09-16T16:43:55.201 INFO:teuthology.orchestra.run.smithi172.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-16T16:43:55.201 INFO:teuthology.orchestra.run.smithi172.stdout: auth supported = cephx 2024-09-16T16:43:55.201 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:43:55.201 INFO:teuthology.orchestra.run.smithi172.stdout: filestore xattr use omap = true 2024-09-16T16:43:55.201 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:43:55.201 INFO:teuthology.orchestra.run.smithi172.stdout: mon clock drift allowed = 1.000 2024-09-16T16:43:55.201 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:43:55.201 INFO:teuthology.orchestra.run.smithi172.stdout: osd crush chooseleaf type = 0 2024-09-16T16:43:55.201 INFO:teuthology.orchestra.run.smithi172.stdout: auth debug = true 2024-09-16T16:43:55.201 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:43:55.201 INFO:teuthology.orchestra.run.smithi172.stdout: ms die on old message = true 2024-09-16T16:43:55.202 INFO:teuthology.orchestra.run.smithi172.stdout: ms die on bug = true 2024-09-16T16:43:55.202 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:43:55.202 INFO:teuthology.orchestra.run.smithi172.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-16T16:43:55.202 INFO:teuthology.orchestra.run.smithi172.stdout: mon pg warn max object skew = 0 2024-09-16T16:43:55.202 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:43:55.202 INFO:teuthology.orchestra.run.smithi172.stdout: # disable pg_autoscaler by default for new pools 2024-09-16T16:43:55.202 INFO:teuthology.orchestra.run.smithi172.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-16T16:43:55.202 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:43:55.202 INFO:teuthology.orchestra.run.smithi172.stdout: osd pool default size = 2 2024-09-16T16:43:55.202 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:43:55.202 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd allow primary affinity = true 2024-09-16T16:43:55.202 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd allow pg remap = true 2024-09-16T16:43:55.202 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on legacy crush tunables = false 2024-09-16T16:43:55.202 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on crush straw calc version zero = false 2024-09-16T16:43:55.203 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on no sortbitwise = false 2024-09-16T16:43:55.203 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on osd down out interval zero = false 2024-09-16T16:43:55.203 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on too few osds = false 2024-09-16T16:43:55.203 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-16T16:43:55.203 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-16T16:43:55.203 INFO:teuthology.orchestra.run.smithi172.stdout: mon_allow_pool_size_one = true 2024-09-16T16:43:55.203 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:43:55.203 INFO:teuthology.orchestra.run.smithi172.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-16T16:43:55.203 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:43:55.203 INFO:teuthology.orchestra.run.smithi172.stdout: osd default data pool replay window = 5 2024-09-16T16:43:55.203 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:43:55.203 INFO:teuthology.orchestra.run.smithi172.stdout: mon allow pool delete = true 2024-09-16T16:43:55.203 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:43:55.203 INFO:teuthology.orchestra.run.smithi172.stdout: mon cluster log file level = debug 2024-09-16T16:43:55.203 INFO:teuthology.orchestra.run.smithi172.stdout: debug asserts on shutdown = true 2024-09-16T16:43:55.204 INFO:teuthology.orchestra.run.smithi172.stdout: mon health detail to clog = false 2024-09-16T16:43:55.204 INFO:teuthology.orchestra.run.smithi172.stdout: mon host = 172.21.15.172 2024-09-16T16:43:55.204 INFO:teuthology.orchestra.run.smithi172.stdout: enable experimental unrecoverable data corrupting features = crimson 2024-09-16T16:43:55.204 INFO:teuthology.orchestra.run.smithi172.stdout: ms client mode = crc 2024-09-16T16:43:55.204 INFO:teuthology.orchestra.run.smithi172.stdout: ms cluster mode = crc 2024-09-16T16:43:55.204 INFO:teuthology.orchestra.run.smithi172.stdout: ms mon client mode = crc 2024-09-16T16:43:55.204 INFO:teuthology.orchestra.run.smithi172.stdout: ms mon cluster mode = crc 2024-09-16T16:43:55.204 INFO:teuthology.orchestra.run.smithi172.stdout: ms mon service mode = crc 2024-09-16T16:43:55.204 INFO:teuthology.orchestra.run.smithi172.stdout: ms service mode = crc 2024-09-16T16:43:55.204 INFO:teuthology.orchestra.run.smithi172.stdout: fsid = b37952f5-be5e-4143-b02a-8a862025ace7 2024-09-16T16:43:55.204 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:43:55.204 INFO:teuthology.orchestra.run.smithi172.stdout:[osd] 2024-09-16T16:43:55.204 INFO:teuthology.orchestra.run.smithi172.stdout: osd journal size = 100 2024-09-16T16:43:55.204 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:43:55.204 INFO:teuthology.orchestra.run.smithi172.stdout: osd scrub load threshold = 5.0 2024-09-16T16:43:55.205 INFO:teuthology.orchestra.run.smithi172.stdout: osd scrub max interval = 600 2024-09-16T16:43:55.205 INFO:teuthology.orchestra.run.smithi172.stdout: osd mclock profile = high_recovery_ops 2024-09-16T16:43:55.205 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:43:55.205 INFO:teuthology.orchestra.run.smithi172.stdout: osd recover clone overlap = true 2024-09-16T16:43:55.205 INFO:teuthology.orchestra.run.smithi172.stdout: osd recovery max chunk = 1048576 2024-09-16T16:43:55.205 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:43:55.205 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug shutdown = true 2024-09-16T16:43:55.205 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug op order = true 2024-09-16T16:43:55.205 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug verify stray on activate = true 2024-09-16T16:43:55.205 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug trim objects = true 2024-09-16T16:43:55.205 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:43:55.205 INFO:teuthology.orchestra.run.smithi172.stdout: osd open classes on start = true 2024-09-16T16:43:55.205 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug pg log writeout = true 2024-09-16T16:43:55.205 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:43:55.205 INFO:teuthology.orchestra.run.smithi172.stdout: osd deep scrub update digest min age = 30 2024-09-16T16:43:55.206 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:43:55.206 INFO:teuthology.orchestra.run.smithi172.stdout: osd map max advance = 10 2024-09-16T16:43:55.206 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:43:55.206 INFO:teuthology.orchestra.run.smithi172.stdout: journal zero on create = true 2024-09-16T16:43:55.206 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:43:55.206 INFO:teuthology.orchestra.run.smithi172.stdout: filestore ondisk finisher threads = 3 2024-09-16T16:43:55.206 INFO:teuthology.orchestra.run.smithi172.stdout: filestore apply finisher threads = 3 2024-09-16T16:43:55.206 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:43:55.206 INFO:teuthology.orchestra.run.smithi172.stdout: bdev debug aio = true 2024-09-16T16:43:55.206 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug misdirected ops = true 2024-09-16T16:43:55.206 INFO:teuthology.orchestra.run.smithi172.stdout: debug monc = 20 2024-09-16T16:43:55.206 INFO:teuthology.orchestra.run.smithi172.stdout: bluestore block size = 96636764160 2024-09-16T16:43:55.206 INFO:teuthology.orchestra.run.smithi172.stdout: bluestore compression algorithm = snappy 2024-09-16T16:43:55.206 INFO:teuthology.orchestra.run.smithi172.stdout: bluestore compression mode = aggressive 2024-09-16T16:43:55.206 INFO:teuthology.orchestra.run.smithi172.stdout: bluestore fsck on mount = True 2024-09-16T16:43:55.207 INFO:teuthology.orchestra.run.smithi172.stdout: bluestore rocksdb cf = False 2024-09-16T16:43:55.207 INFO:teuthology.orchestra.run.smithi172.stdout: crimson alien thread cpu cores = 6-7 2024-09-16T16:43:55.207 INFO:teuthology.orchestra.run.smithi172.stdout: crimson osd obc lru size = 10 2024-09-16T16:43:55.207 INFO:teuthology.orchestra.run.smithi172.stdout: debug bluefs = 20 2024-09-16T16:43:55.207 INFO:teuthology.orchestra.run.smithi172.stdout: debug bluestore = 20 2024-09-16T16:43:55.207 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2024-09-16T16:43:55.207 INFO:teuthology.orchestra.run.smithi172.stdout: debug osd = 20 2024-09-16T16:43:55.207 INFO:teuthology.orchestra.run.smithi172.stdout: debug rocksdb = 10 2024-09-16T16:43:55.207 INFO:teuthology.orchestra.run.smithi172.stdout: err to stderr = True 2024-09-16T16:43:55.207 INFO:teuthology.orchestra.run.smithi172.stdout: log flush on exit = True 2024-09-16T16:43:55.207 INFO:teuthology.orchestra.run.smithi172.stdout: log to file = False 2024-09-16T16:43:55.207 INFO:teuthology.orchestra.run.smithi172.stdout: log to stderr = True 2024-09-16T16:43:55.207 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd backfillfull_ratio = 0.85 2024-09-16T16:43:55.207 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd full ratio = 0.9 2024-09-16T16:43:55.207 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd nearfull ratio = 0.8 2024-09-16T16:43:55.207 INFO:teuthology.orchestra.run.smithi172.stdout: osd failsafe full ratio = 0.95 2024-09-16T16:43:55.208 INFO:teuthology.orchestra.run.smithi172.stdout: osd objectstore = bluestore 2024-09-16T16:43:55.208 INFO:teuthology.orchestra.run.smithi172.stdout: osd shutdown pgref assert = True 2024-09-16T16:43:55.208 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:43:55.208 INFO:teuthology.orchestra.run.smithi172.stdout:[mgr] 2024-09-16T16:43:55.208 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2024-09-16T16:43:55.208 INFO:teuthology.orchestra.run.smithi172.stdout: debug mgr = 20 2024-09-16T16:43:55.208 INFO:teuthology.orchestra.run.smithi172.stdout: debug mon = 20 2024-09-16T16:43:55.208 INFO:teuthology.orchestra.run.smithi172.stdout: debug auth = 20 2024-09-16T16:43:55.208 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min pgs per osd = 4 2024-09-16T16:43:55.208 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min bytes per osd = 10 2024-09-16T16:43:55.208 INFO:teuthology.orchestra.run.smithi172.stdout: mgr/telemetry/nag = false 2024-09-16T16:43:55.208 INFO:teuthology.orchestra.run.smithi172.stdout: mgr stats period = 30 2024-09-16T16:43:55.208 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:43:55.208 INFO:teuthology.orchestra.run.smithi172.stdout:[mon] 2024-09-16T16:43:55.208 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2024-09-16T16:43:55.209 INFO:teuthology.orchestra.run.smithi172.stdout: debug mon = 20 2024-09-16T16:43:55.209 INFO:teuthology.orchestra.run.smithi172.stdout: debug paxos = 20 2024-09-16T16:43:55.209 INFO:teuthology.orchestra.run.smithi172.stdout: debug auth = 20 2024-09-16T16:43:55.209 INFO:teuthology.orchestra.run.smithi172.stdout: mon data avail warn = 5 2024-09-16T16:43:55.209 INFO:teuthology.orchestra.run.smithi172.stdout: mon mgr mkfs grace = 240 2024-09-16T16:43:55.209 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min pgs per osd = 4 2024-09-16T16:43:55.209 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd reporter subtree level = osd 2024-09-16T16:43:55.209 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd prime pg temp = true 2024-09-16T16:43:55.209 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min bytes per osd = 10 2024-09-16T16:43:55.209 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:43:55.209 INFO:teuthology.orchestra.run.smithi172.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-16T16:43:55.209 INFO:teuthology.orchestra.run.smithi172.stdout: auth mon ticket ttl = 660 # 11m 2024-09-16T16:43:55.209 INFO:teuthology.orchestra.run.smithi172.stdout: auth service ticket ttl = 240 # 4m 2024-09-16T16:43:55.210 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:43:55.210 INFO:teuthology.orchestra.run.smithi172.stdout: # don't complain about insecure global_id in the test suite 2024-09-16T16:43:55.210 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-16T16:43:55.210 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-16T16:43:55.210 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:43:55.210 INFO:teuthology.orchestra.run.smithi172.stdout: # 1m isn't quite enough 2024-09-16T16:43:55.210 INFO:teuthology.orchestra.run.smithi172.stdout: mon_down_mkfs_grace = 2m 2024-09-16T16:43:55.210 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:43:55.210 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_filestore_osds = false 2024-09-16T16:43:55.210 INFO:teuthology.orchestra.run.smithi172.stdout: mon min osdmap epochs = 50 2024-09-16T16:43:55.210 INFO:teuthology.orchestra.run.smithi172.stdout: mon osdmap full prune interval = 2 2024-09-16T16:43:55.210 INFO:teuthology.orchestra.run.smithi172.stdout: mon osdmap full prune min = 15 2024-09-16T16:43:55.210 INFO:teuthology.orchestra.run.smithi172.stdout: mon osdmap full prune txsize = 2 2024-09-16T16:43:55.210 INFO:teuthology.orchestra.run.smithi172.stdout: paxos service trim min = 10 2024-09-16T16:43:55.211 INFO:teuthology.orchestra.run.smithi172.stdout: osd pool default crimson = True 2024-09-16T16:43:55.211 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:43:55.211 INFO:teuthology.orchestra.run.smithi172.stdout:[client] 2024-09-16T16:43:55.211 INFO:teuthology.orchestra.run.smithi172.stdout: rgw cache enabled = true 2024-09-16T16:43:55.211 INFO:teuthology.orchestra.run.smithi172.stdout: rgw enable ops log = true 2024-09-16T16:43:55.211 INFO:teuthology.orchestra.run.smithi172.stdout: rgw enable usage log = true 2024-09-16T16:43:55.211 INFO:teuthology.orchestra.run.smithi172.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-16T16:43:55.211 INFO:teuthology.orchestra.run.smithi172.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-16T16:43:55.211 INFO:teuthology.orchestra.run.smithi172.stdout:[mon.a] 2024-09-16T16:43:55.211 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.0] 2024-09-16T16:43:55.211 INFO:teuthology.orchestra.run.smithi172.stdout: crimson seastar cpu cores = 0-1 2024-09-16T16:43:55.211 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.1] 2024-09-16T16:43:55.211 INFO:teuthology.orchestra.run.smithi172.stdout: crimson seastar cpu cores = 2-3 2024-09-16T16:43:55.211 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.2] 2024-09-16T16:43:55.211 INFO:teuthology.orchestra.run.smithi172.stdout: crimson seastar cpu cores = 4-5 2024-09-16T16:43:55.212 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-16T16:43:55.212 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-16T16:43:55.320 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-16T16:43:55.320 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-16T16:43:55.320 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-16T16:43:55.335 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-16T16:43:55.335 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-16T16:43:55.391 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi172.front.sepia.ceph.com 2024-09-16T16:43:55.391 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-16T16:43:55.391 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-16T16:43:55.391 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-16T16:43:55.465 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-16T16:43:55.465 DEBUG:teuthology.orchestra.run.smithi172:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-16T16:43:55.520 INFO:tasks.ceph:Setting up mon nodes... 2024-09-16T16:43:55.520 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-16T16:43:55.520 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-16T16:43:55.621 INFO:teuthology.orchestra.run.smithi172.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-16T16:43:55.624 INFO:tasks.ceph:Setting up mds nodes... 2024-09-16T16:43:55.624 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-16T16:43:55.624 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-16T16:43:55.674 INFO:teuthology.orchestra.run.smithi172.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-16T16:43:55.687 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-16T16:43:55.687 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi172.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2024-09-16T16:43:55.687 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-16T16:43:55.711 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-16T16:43:55.711 INFO:tasks.ceph:role: osd.0 2024-09-16T16:43:55.711 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi172.front.sepia.ceph.com 2024-09-16T16:43:55.712 DEBUG:teuthology.orchestra.run.smithi172:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-16T16:43:55.783 INFO:teuthology.orchestra.run.smithi172.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T16:43:55.783 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T16:43:55.783 INFO:teuthology.orchestra.run.smithi172.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T16:43:55.783 INFO:teuthology.orchestra.run.smithi172.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-16T16:43:55.784 INFO:teuthology.orchestra.run.smithi172.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T16:43:55.784 INFO:teuthology.orchestra.run.smithi172.stdout: = sunit=0 swidth=0 blks 2024-09-16T16:43:55.784 INFO:teuthology.orchestra.run.smithi172.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T16:43:55.784 INFO:teuthology.orchestra.run.smithi172.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-16T16:43:55.784 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T16:43:55.784 INFO:teuthology.orchestra.run.smithi172.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T16:43:56.286 INFO:teuthology.orchestra.run.smithi172.stdout:Discarding blocks...Done. 2024-09-16T16:43:56.287 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi172.front.sepia.ceph.com -o noatime 2024-09-16T16:43:56.288 DEBUG:teuthology.orchestra.run.smithi172:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-16T16:43:56.430 DEBUG:teuthology.orchestra.run.smithi172:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-16T16:43:56.461 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-16T16:43:56.527 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-16T16:43:56.527 INFO:tasks.ceph:role: osd.1 2024-09-16T16:43:56.527 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi172.front.sepia.ceph.com 2024-09-16T16:43:56.527 DEBUG:teuthology.orchestra.run.smithi172:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-16T16:43:56.599 INFO:teuthology.orchestra.run.smithi172.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T16:43:56.599 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T16:43:56.599 INFO:teuthology.orchestra.run.smithi172.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T16:43:56.600 INFO:teuthology.orchestra.run.smithi172.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-16T16:43:56.600 INFO:teuthology.orchestra.run.smithi172.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T16:43:56.600 INFO:teuthology.orchestra.run.smithi172.stdout: = sunit=0 swidth=0 blks 2024-09-16T16:43:56.600 INFO:teuthology.orchestra.run.smithi172.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T16:43:56.600 INFO:teuthology.orchestra.run.smithi172.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-16T16:43:56.600 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T16:43:56.600 INFO:teuthology.orchestra.run.smithi172.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T16:43:57.050 INFO:teuthology.orchestra.run.smithi172.stdout:Discarding blocks...Done. 2024-09-16T16:43:57.052 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi172.front.sepia.ceph.com -o noatime 2024-09-16T16:43:57.052 DEBUG:teuthology.orchestra.run.smithi172:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-16T16:43:57.133 DEBUG:teuthology.orchestra.run.smithi172:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-16T16:43:57.207 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-16T16:43:57.272 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-16T16:43:57.272 INFO:tasks.ceph:role: osd.2 2024-09-16T16:43:57.272 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi172.front.sepia.ceph.com 2024-09-16T16:43:57.272 DEBUG:teuthology.orchestra.run.smithi172:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-16T16:43:57.345 INFO:teuthology.orchestra.run.smithi172.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T16:43:57.346 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T16:43:57.346 INFO:teuthology.orchestra.run.smithi172.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T16:43:57.346 INFO:teuthology.orchestra.run.smithi172.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-16T16:43:57.346 INFO:teuthology.orchestra.run.smithi172.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T16:43:57.346 INFO:teuthology.orchestra.run.smithi172.stdout: = sunit=0 swidth=0 blks 2024-09-16T16:43:57.346 INFO:teuthology.orchestra.run.smithi172.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T16:43:57.346 INFO:teuthology.orchestra.run.smithi172.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-16T16:43:57.346 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T16:43:57.346 INFO:teuthology.orchestra.run.smithi172.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T16:43:57.828 INFO:teuthology.orchestra.run.smithi172.stdout:Discarding blocks...Done. 2024-09-16T16:43:57.830 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi172.front.sepia.ceph.com -o noatime 2024-09-16T16:43:57.831 DEBUG:teuthology.orchestra.run.smithi172:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-16T16:43:57.956 DEBUG:teuthology.orchestra.run.smithi172:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-16T16:43:57.989 DEBUG:teuthology.orchestra.run.smithi172:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T16:43:58.291 INFO:teuthology.orchestra.run.smithi172.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T16:43:58.292 INFO:teuthology.orchestra.run.smithi172.stderr:INFO 2024-09-16 16:43:58,292 seastar - Reactor backend: linux-aio 2024-09-16T16:43:58.303 INFO:teuthology.orchestra.run.smithi172.stderr:==27639==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T16:43:58.423 INFO:teuthology.orchestra.run.smithi172.stderr:INFO 2024-09-16 16:43:58,424 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-16T16:43:58.423 INFO:teuthology.orchestra.run.smithi172.stderr:INFO 2024-09-16 16:43:58,424 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 0-1 2024-09-16T16:43:58.424 INFO:teuthology.orchestra.run.smithi172.stderr:DEBUG 2024-09-16 16:43:58,425 [shard 0:main] seastar - reactor::drain 2024-09-16T16:43:58.950 INFO:teuthology.orchestra.run.smithi172.stderr:----------------------------------------------------- 2024-09-16T16:43:58.950 INFO:teuthology.orchestra.run.smithi172.stderr:Suppressions used: 2024-09-16T16:43:58.950 INFO:teuthology.orchestra.run.smithi172.stderr: count bytes template 2024-09-16T16:43:58.951 INFO:teuthology.orchestra.run.smithi172.stderr: 1 8 MallocExtension::Register 2024-09-16T16:43:58.951 INFO:teuthology.orchestra.run.smithi172.stderr:----------------------------------------------------- 2024-09-16T16:43:58.951 INFO:teuthology.orchestra.run.smithi172.stderr: 2024-09-16T16:43:59.008 INFO:teuthology.orchestra.run.smithi172.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T16:43:59.012 INFO:teuthology.orchestra.run.smithi172.stderr:INFO 2024-09-16 16:43:59,013 seastar - Reactor backend: linux-aio 2024-09-16T16:43:59.020 INFO:teuthology.orchestra.run.smithi172.stderr:==27637==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T16:43:59.085 INFO:teuthology.orchestra.run.smithi172.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x5fdd502 0x5fdd8fa 0x6038b24 0x5fb8d06 0x5fb923a 0x5e00fef 0x5e19231 0x71579d2 0x71691a5 0x716a642 0x716a6c7 0x716a7c9 0x716a8c1 0x716aace 0x716acb4 0x716b003 0x716b3a7 0x716b5d7 0x716b841 0x716bb0e 0x716bd2c 0x716bde4 0x716beaa 0x716bf8b 0x5c63e30 0x5c63f3a 0x5c63ff6 0x5c640b2 0x5c6416e 0x5c642bb 0x5c64446 0x5c64807 0x5c7e60a 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:43:59.085 INFO:teuthology.orchestra.run.smithi172.stderr:kernel callstack: 2024-09-16T16:44:03.716 INFO:teuthology.orchestra.run.smithi172.stderr:----------------------------------------------------- 2024-09-16T16:44:03.717 INFO:teuthology.orchestra.run.smithi172.stderr:Suppressions used: 2024-09-16T16:44:03.717 INFO:teuthology.orchestra.run.smithi172.stderr: count bytes template 2024-09-16T16:44:03.717 INFO:teuthology.orchestra.run.smithi172.stderr: 1 8 MallocExtension::Register 2024-09-16T16:44:03.717 INFO:teuthology.orchestra.run.smithi172.stderr:----------------------------------------------------- 2024-09-16T16:44:03.717 INFO:teuthology.orchestra.run.smithi172.stderr: 2024-09-16T16:44:03.739 DEBUG:teuthology.orchestra.run.smithi172:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-16T16:44:03.764 DEBUG:teuthology.orchestra.run.smithi172:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T16:44:04.044 INFO:teuthology.orchestra.run.smithi172.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T16:44:04.045 INFO:teuthology.orchestra.run.smithi172.stderr:INFO 2024-09-16 16:44:04,045 seastar - Reactor backend: linux-aio 2024-09-16T16:44:04.050 INFO:teuthology.orchestra.run.smithi172.stderr:==27823==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T16:44:04.157 INFO:teuthology.orchestra.run.smithi172.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0xdd2d4 0x4ab1c 0x3817ea5 0x4621ee0 0x5fdbff1 0x5fdc222 0x5fb92bb 0x5e00fef 0x5e19231 0x71579d2 0x71691a5 0x716a642 0x716a6c7 0x716a7c9 0x716a8c1 0x716aace 0x716acb4 0x716b003 0x716b3a7 0x716b5d7 0x716b841 0x716bb0e 0x716bd2c 0x716bde4 0x716beaa 0x716bf8b 0x5c63e30 0x5c63f3a 0x5c63ff6 0x5c640b2 0x5c6416e 0x5c642bb 0x5c64446 0x5c64807 0x5c7e60a 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3962bc0 0x396439a 0x3804c28 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:44:04.157 INFO:teuthology.orchestra.run.smithi172.stderr:kernel callstack: 2024-09-16T16:44:04.172 INFO:teuthology.orchestra.run.smithi172.stderr:INFO 2024-09-16 16:44:04,173 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-16T16:44:04.172 INFO:teuthology.orchestra.run.smithi172.stderr:INFO 2024-09-16 16:44:04,173 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 2-3 2024-09-16T16:44:04.173 INFO:teuthology.orchestra.run.smithi172.stderr:DEBUG 2024-09-16 16:44:04,174 [shard 0:main] seastar - reactor::drain 2024-09-16T16:44:04.678 INFO:teuthology.orchestra.run.smithi172.stderr:----------------------------------------------------- 2024-09-16T16:44:04.678 INFO:teuthology.orchestra.run.smithi172.stderr:Suppressions used: 2024-09-16T16:44:04.678 INFO:teuthology.orchestra.run.smithi172.stderr: count bytes template 2024-09-16T16:44:04.678 INFO:teuthology.orchestra.run.smithi172.stderr: 1 8 MallocExtension::Register 2024-09-16T16:44:04.678 INFO:teuthology.orchestra.run.smithi172.stderr:----------------------------------------------------- 2024-09-16T16:44:04.678 INFO:teuthology.orchestra.run.smithi172.stderr: 2024-09-16T16:44:04.733 INFO:teuthology.orchestra.run.smithi172.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T16:44:04.736 INFO:teuthology.orchestra.run.smithi172.stderr:INFO 2024-09-16 16:44:04,737 seastar - Reactor backend: linux-aio 2024-09-16T16:44:04.749 INFO:teuthology.orchestra.run.smithi172.stderr:==27821==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T16:44:09.431 INFO:teuthology.orchestra.run.smithi172.stderr:----------------------------------------------------- 2024-09-16T16:44:09.431 INFO:teuthology.orchestra.run.smithi172.stderr:Suppressions used: 2024-09-16T16:44:09.431 INFO:teuthology.orchestra.run.smithi172.stderr: count bytes template 2024-09-16T16:44:09.431 INFO:teuthology.orchestra.run.smithi172.stderr: 1 8 MallocExtension::Register 2024-09-16T16:44:09.431 INFO:teuthology.orchestra.run.smithi172.stderr:----------------------------------------------------- 2024-09-16T16:44:09.432 INFO:teuthology.orchestra.run.smithi172.stderr: 2024-09-16T16:44:09.453 DEBUG:teuthology.orchestra.run.smithi172:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-16T16:44:09.477 DEBUG:teuthology.orchestra.run.smithi172:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T16:44:09.757 INFO:teuthology.orchestra.run.smithi172.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T16:44:09.757 INFO:teuthology.orchestra.run.smithi172.stderr:INFO 2024-09-16 16:44:09,758 seastar - Reactor backend: linux-aio 2024-09-16T16:44:09.763 INFO:teuthology.orchestra.run.smithi172.stderr:==28007==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T16:44:09.870 INFO:teuthology.orchestra.run.smithi172.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x416dc3f 0x5fb8ce4 0x5fb923a 0x5e00fef 0x5e19231 0x71579d2 0x71691a5 0x716a642 0x716a6c7 0x716a7c9 0x716a8c1 0x716aace 0x716acb4 0x716b003 0x716b3a7 0x716b5d7 0x716b841 0x716bb0e 0x716bd2c 0x716bde4 0x716beaa 0x716bf8b 0x5c63e30 0x5c63f3a 0x5c63ff6 0x5c640b2 0x5c6416e 0x5c642bb 0x5c64446 0x5c64807 0x5c7e60a 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3962bc0 0x396439a 0x3804c28 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:44:09.870 INFO:teuthology.orchestra.run.smithi172.stderr:kernel callstack: 2024-09-16T16:44:09.883 INFO:teuthology.orchestra.run.smithi172.stderr:INFO 2024-09-16 16:44:09,884 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-16T16:44:09.884 INFO:teuthology.orchestra.run.smithi172.stderr:INFO 2024-09-16 16:44:09,884 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 4-5 2024-09-16T16:44:09.884 INFO:teuthology.orchestra.run.smithi172.stderr:DEBUG 2024-09-16 16:44:09,885 [shard 0:main] seastar - reactor::drain 2024-09-16T16:44:10.387 INFO:teuthology.orchestra.run.smithi172.stderr:----------------------------------------------------- 2024-09-16T16:44:10.387 INFO:teuthology.orchestra.run.smithi172.stderr:Suppressions used: 2024-09-16T16:44:10.388 INFO:teuthology.orchestra.run.smithi172.stderr: count bytes template 2024-09-16T16:44:10.388 INFO:teuthology.orchestra.run.smithi172.stderr: 1 8 MallocExtension::Register 2024-09-16T16:44:10.388 INFO:teuthology.orchestra.run.smithi172.stderr:----------------------------------------------------- 2024-09-16T16:44:10.388 INFO:teuthology.orchestra.run.smithi172.stderr: 2024-09-16T16:44:10.444 INFO:teuthology.orchestra.run.smithi172.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T16:44:10.448 INFO:teuthology.orchestra.run.smithi172.stderr:INFO 2024-09-16 16:44:10,449 seastar - Reactor backend: linux-aio 2024-09-16T16:44:10.462 INFO:teuthology.orchestra.run.smithi172.stderr:==28005==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T16:44:15.141 INFO:teuthology.orchestra.run.smithi172.stderr:----------------------------------------------------- 2024-09-16T16:44:15.141 INFO:teuthology.orchestra.run.smithi172.stderr:Suppressions used: 2024-09-16T16:44:15.141 INFO:teuthology.orchestra.run.smithi172.stderr: count bytes template 2024-09-16T16:44:15.141 INFO:teuthology.orchestra.run.smithi172.stderr: 1 8 MallocExtension::Register 2024-09-16T16:44:15.141 INFO:teuthology.orchestra.run.smithi172.stderr:----------------------------------------------------- 2024-09-16T16:44:15.141 INFO:teuthology.orchestra.run.smithi172.stderr: 2024-09-16T16:44:15.163 DEBUG:teuthology.orchestra.run.smithi172:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-16T16:44:15.188 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-16T16:44:15.188 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-16T16:44:15.188 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-16T16:44:15.252 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-16T16:44:15.252 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-16T16:44:15.317 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-16T16:44:15.318 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-16T16:44:15.382 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-16T16:44:15.382 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-16T16:44:15.448 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-16T16:44:15.448 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-16T16:44:15.503 INFO:tasks.ceph:Adding keys to all mons... 2024-09-16T16:44:15.503 DEBUG:teuthology.orchestra.run.smithi172:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-16T16:44:15.565 INFO:teuthology.orchestra.run.smithi172.stdout:[mgr.x] 2024-09-16T16:44:15.566 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQBLYOhmV4AZJRAAmyD2nbKOwukFo+io68Q4Lg== 2024-09-16T16:44:15.566 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.0] 2024-09-16T16:44:15.566 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQBPYOhmRKv4CRAAGBRrL82THCOZgZO5IOUihA== 2024-09-16T16:44:15.566 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.1] 2024-09-16T16:44:15.566 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQBUYOhmduxUNRAARsmDEydP3aBZLx/dYPM5lQ== 2024-09-16T16:44:15.566 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.2] 2024-09-16T16:44:15.566 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQBaYOhmttIqJBAAgJYykyFU3IbSaSHPXfKw4A== 2024-09-16T16:44:15.566 INFO:teuthology.orchestra.run.smithi172.stdout:[client.0] 2024-09-16T16:44:15.566 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQBLYOhmClE5KBAACPhSGYz+94wFc75t4xJiAQ== 2024-09-16T16:44:15.567 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-16T16:44:15.667 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T16:44:15.729 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T16:44:15.790 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T16:44:15.852 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-16T16:44:15.916 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-16T16:44:15.917 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-16T16:44:15.941 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-16T16:44:16.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:44:16.057+0000 7fc1fccd1c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:44:16.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:44:16.057+0000 7fc1fccd1c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:44:16.070 DEBUG:teuthology.orchestra.run.smithi172:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-16T16:44:16.095 DEBUG:teuthology.orchestra.run.smithi172:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-16T16:44:16.150 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-16T16:44:16.150 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-16T16:44:16.150 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-16T16:44:16.192 INFO:tasks.ceph.mon.a:Started 2024-09-16T16:44:16.192 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-16T16:44:16.193 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-16T16:44:16.193 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-16T16:44:16.195 INFO:tasks.ceph.mgr.x:Started 2024-09-16T16:44:16.195 DEBUG:tasks.ceph:set 0 configs 2024-09-16T16:44:16.195 INFO:tasks.ceph:Setting crush tunables to default 2024-09-16T16:44:16.195 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd crush tunables default 2024-09-16T16:44:16.276 INFO:tasks.ceph.mon.a.smithi172.stderr:2024-09-16T16:44:16.276+0000 7ff15ad14c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:44:16.276 INFO:tasks.ceph.mon.a.smithi172.stderr:2024-09-16T16:44:16.276+0000 7ff15ad14c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:44:16.276 INFO:tasks.ceph.mon.a.smithi172.stderr:2024-09-16T16:44:16.276+0000 7ff15ad14c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:44:16.278 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-09-16T16:44:16.278+0000 7fa56caff000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:44:16.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:44:16.300+0000 7fc0c3088640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:44:16.310 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:44:16.311+0000 7fc0c3088640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:44:16.380 INFO:teuthology.orchestra.run.smithi172.stderr:adjusted tunables profile to default 2024-09-16T16:44:16.391 INFO:tasks.ceph:check_enable_crimson: True 2024-09-16T16:44:16.391 INFO:tasks.ceph:check_enable_crimson: setting set-allow-crimson 2024-09-16T16:44:16.392 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd set-allow-crimson --yes-i-really-mean-it 2024-09-16T16:44:16.484 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-09-16T16:44:16.484+0000 7fa56caff000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:44:16.484 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-09-16T16:44:16.484+0000 7fa56caff000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:44:16.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:44:16.493+0000 7f0e0f6f4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:44:16.502 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:44:16.502+0000 7f0e0f6f4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:44:16.584 INFO:tasks.ceph.mon.a.smithi172.stderr:2024-09-16T16:44:16.584+0000 7ff1519f4640 -1 WARNING: experimental feature 'crimson' is enabled 2024-09-16T16:44:16.585 INFO:tasks.ceph.mon.a.smithi172.stderr:Please be aware that this feature is experimental, untested, 2024-09-16T16:44:16.585 INFO:tasks.ceph.mon.a.smithi172.stderr:unsupported, and may result in data corruption, data loss, 2024-09-16T16:44:16.585 INFO:tasks.ceph.mon.a.smithi172.stderr:and/or irreparable damage to your cluster. Do not use 2024-09-16T16:44:16.585 INFO:tasks.ceph.mon.a.smithi172.stderr:feature with important data. 2024-09-16T16:44:16.585 INFO:tasks.ceph.mon.a.smithi172.stderr: 2024-09-16T16:44:17.392 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-16T16:44:17.392 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-16T16:44:17.393 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-16T16:44:17.417 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-16T16:44:17.417 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-16T16:44:17.483 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-16T16:44:17.484 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-16T16:44:17.549 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd new a0d1e13b-881e-4468-8a85-2287def18a29 0 2024-09-16T16:44:17.698 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:44:17.691+0000 7f687b991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:44:17.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:44:17.702+0000 7f687b991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:44:17.780 INFO:teuthology.orchestra.run.smithi172.stdout:0 2024-09-16T16:44:17.792 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd new 8a3815ab-c40e-4af9-8454-fd1430d0a3b0 1 2024-09-16T16:44:17.901 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:44:17.894+0000 7f2c784d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:44:17.904 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:44:17.904+0000 7f2c784d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:44:17.982 INFO:teuthology.orchestra.run.smithi172.stdout:1 2024-09-16T16:44:17.996 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd new 8e992d53-ac88-41dd-a522-8052ee8469d1 2 2024-09-16T16:44:18.105 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:44:18.098+0000 7f0451391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:44:18.108 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:44:18.109+0000 7f0451391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:44:18.188 INFO:teuthology.orchestra.run.smithi172.stdout:2 2024-09-16T16:44:18.200 DEBUG:teuthology.orchestra.run.smithi172:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.0.log 2024-09-16T16:44:18.229 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-16T16:44:18.230 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2024-09-16T16:44:18.272 INFO:tasks.ceph.osd.0:Started 2024-09-16T16:44:18.272 DEBUG:teuthology.orchestra.run.smithi172:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.1.log 2024-09-16T16:44:18.301 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-16T16:44:18.301 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2>> /var/log/ceph/ceph-osd.1.log 2024-09-16T16:44:18.343 INFO:tasks.ceph.osd.1:Started 2024-09-16T16:44:18.343 DEBUG:teuthology.orchestra.run.smithi172:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.2.log 2024-09-16T16:44:18.374 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-16T16:44:18.375 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log 2024-09-16T16:44:18.417 INFO:tasks.ceph.osd.2:Started 2024-09-16T16:44:18.418 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T16:44:18.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:44:18.535+0000 7fbfe6711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:44:18.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:44:18.545+0000 7fbfe6711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:44:18.613 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:44:18.613 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":6,"fsid":"b37952f5-be5e-4143-b02a-8a862025ace7","created":"2024-09-16T16:44:16.297687+0000","modified":"2024-09-16T16:44:18.188516+0000","last_up_change":"0.000000","last_in_change":"2024-09-16T16:44:18.188516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"a0d1e13b-881e-4468-8a85-2287def18a29","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8a3815ab-c40e-4af9-8454-fd1430d0a3b0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8e992d53-ac88-41dd-a522-8052ee8469d1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T16:44:18.626 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-16T16:44:18.626 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-16T16:44:18.928 DEBUG:teuthology.orchestra.run.smithi172:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-16T16:44:19.033 INFO:teuthology.misc.health.smithi172.stderr:2024-09-16T16:44:19.029+0000 7f19b3b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:44:19.037 INFO:teuthology.misc.health.smithi172.stderr:2024-09-16T16:44:19.038+0000 7f19b3b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:44:19.108 INFO:teuthology.misc.health.smithi172.stdout: 2024-09-16T16:44:19.108 INFO:teuthology.misc.health.smithi172.stdout:{"epoch":6,"fsid":"b37952f5-be5e-4143-b02a-8a862025ace7","created":"2024-09-16T16:44:16.297687+0000","modified":"2024-09-16T16:44:18.188516+0000","last_up_change":"0.000000","last_in_change":"2024-09-16T16:44:18.188516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"a0d1e13b-881e-4468-8a85-2287def18a29","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8a3815ab-c40e-4af9-8454-fd1430d0a3b0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8e992d53-ac88-41dd-a522-8052ee8469d1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T16:44:19.118 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-09-16T16:44:21.948 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-09-16T16:44:21.948+0000 7fa50a2a5640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-16T16:44:25.421 DEBUG:teuthology.orchestra.run.smithi172:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-16T16:44:25.527 INFO:teuthology.misc.health.smithi172.stderr:2024-09-16T16:44:25.523+0000 7f5679591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:44:25.531 INFO:teuthology.misc.health.smithi172.stderr:2024-09-16T16:44:25.531+0000 7f5679591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:44:25.719 INFO:teuthology.misc.health.smithi172.stdout: 2024-09-16T16:44:25.719 INFO:teuthology.misc.health.smithi172.stdout:{"epoch":9,"fsid":"b37952f5-be5e-4143-b02a-8a862025ace7","created":"2024-09-16T16:44:16.297687+0000","modified":"2024-09-16T16:44:24.961212+0000","last_up_change":"2024-09-16T16:44:24.961212+0000","last_in_change":"2024-09-16T16:44:18.188516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T16:44:24.961123+0000","flags":294945,"flags_names":"hashpspool,nopgchange,creating,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"9","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a0d1e13b-881e-4468-8a85-2287def18a29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6803","nonce":3999995245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3999995245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3999995245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":3999995245}]},"public_addr":"172.21.15.172:6803/3999995245","cluster_addr":"172.21.15.172:6806/3999995245","heartbeat_back_addr":"172.21.15.172:6808/3999995245","heartbeat_front_addr":"172.21.15.172:6809/3999995245","state":["exists","up"]},{"osd":1,"uuid":"8a3815ab-c40e-4af9-8454-fd1430d0a3b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":1268064620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1268064620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1268064620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6807","nonce":1268064620}]},"public_addr":"172.21.15.172:6805/1268064620","cluster_addr":"172.21.15.172:6804/1268064620","heartbeat_back_addr":"172.21.15.172:6802/1268064620","heartbeat_front_addr":"172.21.15.172:6807/1268064620","state":["exists","up"]},{"osd":2,"uuid":"8e992d53-ac88-41dd-a522-8052ee8469d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":2451117477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6811","nonce":2451117477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2451117477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6815","nonce":2451117477}]},"public_addr":"172.21.15.172:6810/2451117477","cluster_addr":"172.21.15.172:6811/2451117477","heartbeat_back_addr":"172.21.15.172:6814/2451117477","heartbeat_front_addr":"172.21.15.172:6815/2451117477","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T16:44:25.731 DEBUG:teuthology.misc:3 of 3 OSDs are up 2024-09-16T16:44:25.731 INFO:tasks.ceph:Creating RBD pool 2024-09-16T16:44:25.732 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-16T16:44:25.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:44:25.833+0000 7f071df11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:44:25.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:44:25.844+0000 7f071df11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:44:26.973 INFO:teuthology.orchestra.run.smithi172.stderr:pool 'rbd' created 2024-09-16T16:44:26.997 DEBUG:teuthology.orchestra.run.smithi172:> rbd --cluster ceph pool init rbd 2024-09-16T16:44:27.097 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:44:27.097+0000 7f3bad824ac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:44:27.098 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:44:27.098+0000 7f3bad824ac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:44:27.102 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:44:27.102+0000 7f3bad824ac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:44:30.041 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-16T16:44:30.042 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-16T16:44:30.042 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-16T16:44:30.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:44:30.147+0000 7f0956cc8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:44:30.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:44:30.155+0000 7f0956cc8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:44:30.341 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:44:30.354 INFO:teuthology.orchestra.run.smithi172.stdout:[{"version":1,"timestamp":"0.000000","name":"","changes":[]}] 2024-09-16T16:44:30.354 INFO:tasks.ceph_manager:config epoch is 1 2024-09-16T16:44:30.354 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-16T16:44:30.355 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-16T16:44:30.355 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-16T16:44:30.463 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:44:30.459+0000 7fbb9e791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:44:30.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:44:30.466+0000 7fbb9e791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:44:30.698 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:44:30.710 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":5,"flags":0,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":4106207112},{"type":"v1","addr":"172.21.15.172:6801","nonce":4106207112}]},"active_addr":"172.21.15.172:6801/4106207112","active_change":"2024-09-16T16:44:20.940330+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.172:0","nonce":185413460}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.172:0","nonce":1777491282}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.172:0","nonce":1834468865}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.172:0","nonce":2443547316}]}]} 2024-09-16T16:44:30.714 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-16T16:44:30.714 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-16T16:44:30.714 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T16:44:30.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:44:30.819+0000 7f5f5c351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:44:30.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:44:30.827+0000 7f5f5c351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:44:31.019 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:44:31.019 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":14,"fsid":"b37952f5-be5e-4143-b02a-8a862025ace7","created":"2024-09-16T16:44:16.297687+0000","modified":"2024-09-16T16:44:29.992154+0000","last_up_change":"2024-09-16T16:44:24.961212+0000","last_in_change":"2024-09-16T16:44:18.188516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T16:44:24.961123+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-16T16:44:26.043950+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":14,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a0d1e13b-881e-4468-8a85-2287def18a29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6803","nonce":3999995245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3999995245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3999995245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":3999995245}]},"public_addr":"172.21.15.172:6803/3999995245","cluster_addr":"172.21.15.172:6806/3999995245","heartbeat_back_addr":"172.21.15.172:6808/3999995245","heartbeat_front_addr":"172.21.15.172:6809/3999995245","state":["exists","up"]},{"osd":1,"uuid":"8a3815ab-c40e-4af9-8454-fd1430d0a3b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":1268064620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1268064620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1268064620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6807","nonce":1268064620}]},"public_addr":"172.21.15.172:6805/1268064620","cluster_addr":"172.21.15.172:6804/1268064620","heartbeat_back_addr":"172.21.15.172:6802/1268064620","heartbeat_front_addr":"172.21.15.172:6807/1268064620","state":["exists","up"]},{"osd":2,"uuid":"8e992d53-ac88-41dd-a522-8052ee8469d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":2451117477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6811","nonce":2451117477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2451117477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6815","nonce":2451117477}]},"public_addr":"172.21.15.172:6810/2451117477","cluster_addr":"172.21.15.172:6811/2451117477","heartbeat_back_addr":"172.21.15.172:6814/2451117477","heartbeat_front_addr":"172.21.15.172:6815/2451117477","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T16:44:31.032 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-16T16:44:31.032 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T16:44:31.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:44:31.137+0000 7f8717d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:44:31.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:44:31.144+0000 7f8717d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:44:31.331 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:44:31.331 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":14,"fsid":"b37952f5-be5e-4143-b02a-8a862025ace7","created":"2024-09-16T16:44:16.297687+0000","modified":"2024-09-16T16:44:29.992154+0000","last_up_change":"2024-09-16T16:44:24.961212+0000","last_in_change":"2024-09-16T16:44:18.188516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T16:44:24.961123+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-16T16:44:26.043950+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":14,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a0d1e13b-881e-4468-8a85-2287def18a29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6803","nonce":3999995245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3999995245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3999995245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":3999995245}]},"public_addr":"172.21.15.172:6803/3999995245","cluster_addr":"172.21.15.172:6806/3999995245","heartbeat_back_addr":"172.21.15.172:6808/3999995245","heartbeat_front_addr":"172.21.15.172:6809/3999995245","state":["exists","up"]},{"osd":1,"uuid":"8a3815ab-c40e-4af9-8454-fd1430d0a3b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":1268064620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1268064620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1268064620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6807","nonce":1268064620}]},"public_addr":"172.21.15.172:6805/1268064620","cluster_addr":"172.21.15.172:6804/1268064620","heartbeat_back_addr":"172.21.15.172:6802/1268064620","heartbeat_front_addr":"172.21.15.172:6807/1268064620","state":["exists","up"]},{"osd":2,"uuid":"8e992d53-ac88-41dd-a522-8052ee8469d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":2451117477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6811","nonce":2451117477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2451117477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6815","nonce":2451117477}]},"public_addr":"172.21.15.172:6810/2451117477","cluster_addr":"172.21.15.172:6811/2451117477","heartbeat_back_addr":"172.21.15.172:6814/2451117477","heartbeat_front_addr":"172.21.15.172:6815/2451117477","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T16:44:31.344 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-16T16:44:31.344 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-16T16:44:31.344 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-16T16:44:31.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:44:31.455+0000 7f61926bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:44:31.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:44:31.455+0000 7f5090f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:44:31.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:44:31.455+0000 7f0f8e84f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:44:31.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:44:31.464+0000 7f5090f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:44:31.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:44:31.465+0000 7f0f8e84f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:44:31.465 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:44:31.465+0000 7f61926bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:44:31.496 INFO:teuthology.orchestra.run.smithi172.stdout:34359738375 2024-09-16T16:44:31.496 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-16T16:44:31.502 INFO:teuthology.orchestra.run.smithi172.stdout:38654705670 2024-09-16T16:44:31.502 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-16T16:44:31.502 INFO:teuthology.orchestra.run.smithi172.stdout:34359738375 2024-09-16T16:44:31.503 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-16T16:44:31.608 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:44:31.603+0000 7f4eb7391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:44:31.612 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:44:31.612+0000 7f4eb7391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:44:31.657 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:44:31.652+0000 7f035fc46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:44:31.661 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:44:31.661+0000 7f035fc46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:44:31.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:44:31.660+0000 7f422eb11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:44:31.677 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:44:31.677+0000 7f422eb11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:44:31.825 INFO:teuthology.orchestra.run.smithi172.stdout:34359738375 2024-09-16T16:44:31.839 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738375 for osd.1 2024-09-16T16:44:31.839 DEBUG:teuthology.parallel:result is None 2024-09-16T16:44:31.862 INFO:teuthology.orchestra.run.smithi172.stdout:34359738375 2024-09-16T16:44:31.876 INFO:teuthology.orchestra.run.smithi172.stdout:38654705670 2024-09-16T16:44:31.877 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738375 for osd.0 2024-09-16T16:44:31.877 DEBUG:teuthology.parallel:result is None 2024-09-16T16:44:31.887 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.2 2024-09-16T16:44:31.887 DEBUG:teuthology.parallel:result is None 2024-09-16T16:44:31.887 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T16:44:31.887 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:44:32.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:44:32.036+0000 7f83c5591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:44:32.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:44:32.043+0000 7f83c5591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:44:32.225 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:44:32.226 INFO:teuthology.orchestra.run.smithi172.stderr:dumped all 2024-09-16T16:44:32.238 INFO:teuthology.orchestra.run.smithi172.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2024-09-16T16:44:31.489865+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":283115520,"kb_used":80972,"kb_used_data":476,"kb_used_omap":0,"kb_used_meta":80448,"kb_avail":283034548,"statfs":{"total":289910292480,"available":289827377152,"internally_reserved":0,"allocated":487424,"data_stored":1270450,"data_compressed":60108,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":82378752},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T16:44:30.017593+0000","last_change":"2024-09-16T16:44:30.023111+0000","last_active":"2024-09-16T16:44:30.017593+0000","last_peered":"2024-09-16T16:44:30.017593+0000","last_clean":"2024-09-16T16:44:30.017593+0000","last_became_active":"2024-09-16T16:44:28.082969+0000","last_became_peered":"2024-09-16T16:44:28.082969+0000","last_unstale":"2024-09-16T16:44:30.017593+0000","last_undegraded":"2024-09-16T16:44:30.017593+0000","last_fullsized":"2024-09-16T16:44:30.017593+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_clean_scrub_stamp":"2024-09-16T16:44:26.972784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T16:44:30.022736+0000","last_change":"2024-09-16T16:44:30.026831+0000","last_active":"2024-09-16T16:44:30.022736+0000","last_peered":"2024-09-16T16:44:30.022736+0000","last_clean":"2024-09-16T16:44:30.022736+0000","last_became_active":"2024-09-16T16:44:28.115763+0000","last_became_peered":"2024-09-16T16:44:28.115763+0000","last_unstale":"2024-09-16T16:44:30.022736+0000","last_undegraded":"2024-09-16T16:44:30.022736+0000","last_fullsized":"2024-09-16T16:44:30.022736+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_clean_scrub_stamp":"2024-09-16T16:44:26.972784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T16:44:30.016025+0000","last_change":"2024-09-16T16:44:30.023390+0000","last_active":"2024-09-16T16:44:30.016025+0000","last_peered":"2024-09-16T16:44:30.016025+0000","last_clean":"2024-09-16T16:44:30.016025+0000","last_became_active":"2024-09-16T16:44:28.042234+0000","last_became_peered":"2024-09-16T16:44:28.042234+0000","last_unstale":"2024-09-16T16:44:30.016025+0000","last_undegraded":"2024-09-16T16:44:30.016025+0000","last_fullsized":"2024-09-16T16:44:30.016025+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_clean_scrub_stamp":"2024-09-16T16:44:26.972784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T16:44:30.018361+0000","last_change":"2024-09-16T16:44:30.022526+0000","last_active":"2024-09-16T16:44:30.018361+0000","last_peered":"2024-09-16T16:44:30.018361+0000","last_clean":"2024-09-16T16:44:30.018361+0000","last_became_active":"2024-09-16T16:44:28.065454+0000","last_became_peered":"2024-09-16T16:44:28.065454+0000","last_unstale":"2024-09-16T16:44:30.018361+0000","last_undegraded":"2024-09-16T16:44:30.018361+0000","last_fullsized":"2024-09-16T16:44:30.018361+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_clean_scrub_stamp":"2024-09-16T16:44:26.972784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":17,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T16:44:30.021241+0000","last_change":"2024-09-16T16:44:30.021241+0000","last_active":"2024-09-16T16:44:30.021241+0000","last_peered":"2024-09-16T16:44:30.021241+0000","last_clean":"2024-09-16T16:44:30.021241+0000","last_became_active":"2024-09-16T16:44:28.094925+0000","last_became_peered":"2024-09-16T16:44:28.094925+0000","last_unstale":"2024-09-16T16:44:30.021241+0000","last_undegraded":"2024-09-16T16:44:30.021241+0000","last_fullsized":"2024-09-16T16:44:30.021241+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_clean_scrub_stamp":"2024-09-16T16:44:26.972784+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T16:44:30.015406+0000","last_change":"2024-09-16T16:44:30.017303+0000","last_active":"2024-09-16T16:44:30.015406+0000","last_peered":"2024-09-16T16:44:30.015406+0000","last_clean":"2024-09-16T16:44:30.015406+0000","last_became_active":"2024-09-16T16:44:28.113269+0000","last_became_peered":"2024-09-16T16:44:28.113269+0000","last_unstale":"2024-09-16T16:44:30.015406+0000","last_undegraded":"2024-09-16T16:44:30.015406+0000","last_fullsized":"2024-09-16T16:44:30.015406+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_clean_scrub_stamp":"2024-09-16T16:44:26.972784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T16:44:30.012290+0000","last_change":"2024-09-16T16:44:30.015664+0000","last_active":"2024-09-16T16:44:30.012290+0000","last_peered":"2024-09-16T16:44:30.012290+0000","last_clean":"2024-09-16T16:44:30.012290+0000","last_became_active":"2024-09-16T16:44:28.100077+0000","last_became_peered":"2024-09-16T16:44:28.100077+0000","last_unstale":"2024-09-16T16:44:30.012290+0000","last_undegraded":"2024-09-16T16:44:30.012290+0000","last_fullsized":"2024-09-16T16:44:30.012290+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_clean_scrub_stamp":"2024-09-16T16:44:26.972784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T16:44:30.023865+0000","last_change":"2024-09-16T16:44:30.027539+0000","last_active":"2024-09-16T16:44:30.023865+0000","last_peered":"2024-09-16T16:44:30.023865+0000","last_clean":"2024-09-16T16:44:30.023865+0000","last_became_active":"2024-09-16T16:44:28.095919+0000","last_became_peered":"2024-09-16T16:44:28.095919+0000","last_unstale":"2024-09-16T16:44:30.023865+0000","last_undegraded":"2024-09-16T16:44:30.023865+0000","last_fullsized":"2024-09-16T16:44:30.023865+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_clean_scrub_stamp":"2024-09-16T16:44:26.972784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'52","reported_seq":87,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T16:44:30.013218+0000","last_change":"2024-09-16T16:44:26.004647+0000","last_active":"2024-09-16T16:44:30.013218+0000","last_peered":"2024-09-16T16:44:30.013218+0000","last_clean":"2024-09-16T16:44:30.013218+0000","last_became_active":"2024-09-16T16:44:25.997426+0000","last_became_peered":"2024-09-16T16:44:25.997426+0000","last_unstale":"2024-09-16T16:44:30.013218+0000","last_undegraded":"2024-09-16T16:44:30.013218+0000","last_fullsized":"2024-09-16T16:44:30.013218+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:44:24.961212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:44:24.961212+0000","last_clean_scrub_stamp":"2024-09-16T16:44:24.961212+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30054,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26948,"kb_used_data":116,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344892,"statfs":{"total":96636764160,"available":96609169408,"internally_reserved":0,"allocated":118784,"data_stored":29892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738375,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27012,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344828,"statfs":{"total":96636764160,"available":96609103872,"internally_reserved":0,"allocated":184320,"data_stored":620279,"data_compressed":30054,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738375,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27012,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344828,"statfs":{"total":96636764160,"available":96609103872,"internally_reserved":0,"allocated":184320,"data_stored":620279,"data_compressed":30054,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30054,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:44:32.239 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:44:32.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:44:32.344+0000 7f1db3191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:44:32.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:44:32.351+0000 7f1db3191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:44:32.536 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:44:32.536 INFO:teuthology.orchestra.run.smithi172.stderr:dumped all 2024-09-16T16:44:32.549 INFO:teuthology.orchestra.run.smithi172.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2024-09-16T16:44:31.489865+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":283115520,"kb_used":80972,"kb_used_data":476,"kb_used_omap":0,"kb_used_meta":80448,"kb_avail":283034548,"statfs":{"total":289910292480,"available":289827377152,"internally_reserved":0,"allocated":487424,"data_stored":1270450,"data_compressed":60108,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":82378752},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T16:44:30.017593+0000","last_change":"2024-09-16T16:44:30.023111+0000","last_active":"2024-09-16T16:44:30.017593+0000","last_peered":"2024-09-16T16:44:30.017593+0000","last_clean":"2024-09-16T16:44:30.017593+0000","last_became_active":"2024-09-16T16:44:28.082969+0000","last_became_peered":"2024-09-16T16:44:28.082969+0000","last_unstale":"2024-09-16T16:44:30.017593+0000","last_undegraded":"2024-09-16T16:44:30.017593+0000","last_fullsized":"2024-09-16T16:44:30.017593+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_clean_scrub_stamp":"2024-09-16T16:44:26.972784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T16:44:30.022736+0000","last_change":"2024-09-16T16:44:30.026831+0000","last_active":"2024-09-16T16:44:30.022736+0000","last_peered":"2024-09-16T16:44:30.022736+0000","last_clean":"2024-09-16T16:44:30.022736+0000","last_became_active":"2024-09-16T16:44:28.115763+0000","last_became_peered":"2024-09-16T16:44:28.115763+0000","last_unstale":"2024-09-16T16:44:30.022736+0000","last_undegraded":"2024-09-16T16:44:30.022736+0000","last_fullsized":"2024-09-16T16:44:30.022736+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_clean_scrub_stamp":"2024-09-16T16:44:26.972784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T16:44:30.016025+0000","last_change":"2024-09-16T16:44:30.023390+0000","last_active":"2024-09-16T16:44:30.016025+0000","last_peered":"2024-09-16T16:44:30.016025+0000","last_clean":"2024-09-16T16:44:30.016025+0000","last_became_active":"2024-09-16T16:44:28.042234+0000","last_became_peered":"2024-09-16T16:44:28.042234+0000","last_unstale":"2024-09-16T16:44:30.016025+0000","last_undegraded":"2024-09-16T16:44:30.016025+0000","last_fullsized":"2024-09-16T16:44:30.016025+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_clean_scrub_stamp":"2024-09-16T16:44:26.972784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T16:44:30.018361+0000","last_change":"2024-09-16T16:44:30.022526+0000","last_active":"2024-09-16T16:44:30.018361+0000","last_peered":"2024-09-16T16:44:30.018361+0000","last_clean":"2024-09-16T16:44:30.018361+0000","last_became_active":"2024-09-16T16:44:28.065454+0000","last_became_peered":"2024-09-16T16:44:28.065454+0000","last_unstale":"2024-09-16T16:44:30.018361+0000","last_undegraded":"2024-09-16T16:44:30.018361+0000","last_fullsized":"2024-09-16T16:44:30.018361+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_clean_scrub_stamp":"2024-09-16T16:44:26.972784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":17,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T16:44:30.021241+0000","last_change":"2024-09-16T16:44:30.021241+0000","last_active":"2024-09-16T16:44:30.021241+0000","last_peered":"2024-09-16T16:44:30.021241+0000","last_clean":"2024-09-16T16:44:30.021241+0000","last_became_active":"2024-09-16T16:44:28.094925+0000","last_became_peered":"2024-09-16T16:44:28.094925+0000","last_unstale":"2024-09-16T16:44:30.021241+0000","last_undegraded":"2024-09-16T16:44:30.021241+0000","last_fullsized":"2024-09-16T16:44:30.021241+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_clean_scrub_stamp":"2024-09-16T16:44:26.972784+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T16:44:30.015406+0000","last_change":"2024-09-16T16:44:30.017303+0000","last_active":"2024-09-16T16:44:30.015406+0000","last_peered":"2024-09-16T16:44:30.015406+0000","last_clean":"2024-09-16T16:44:30.015406+0000","last_became_active":"2024-09-16T16:44:28.113269+0000","last_became_peered":"2024-09-16T16:44:28.113269+0000","last_unstale":"2024-09-16T16:44:30.015406+0000","last_undegraded":"2024-09-16T16:44:30.015406+0000","last_fullsized":"2024-09-16T16:44:30.015406+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_clean_scrub_stamp":"2024-09-16T16:44:26.972784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T16:44:30.012290+0000","last_change":"2024-09-16T16:44:30.015664+0000","last_active":"2024-09-16T16:44:30.012290+0000","last_peered":"2024-09-16T16:44:30.012290+0000","last_clean":"2024-09-16T16:44:30.012290+0000","last_became_active":"2024-09-16T16:44:28.100077+0000","last_became_peered":"2024-09-16T16:44:28.100077+0000","last_unstale":"2024-09-16T16:44:30.012290+0000","last_undegraded":"2024-09-16T16:44:30.012290+0000","last_fullsized":"2024-09-16T16:44:30.012290+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_clean_scrub_stamp":"2024-09-16T16:44:26.972784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T16:44:30.023865+0000","last_change":"2024-09-16T16:44:30.027539+0000","last_active":"2024-09-16T16:44:30.023865+0000","last_peered":"2024-09-16T16:44:30.023865+0000","last_clean":"2024-09-16T16:44:30.023865+0000","last_became_active":"2024-09-16T16:44:28.095919+0000","last_became_peered":"2024-09-16T16:44:28.095919+0000","last_unstale":"2024-09-16T16:44:30.023865+0000","last_undegraded":"2024-09-16T16:44:30.023865+0000","last_fullsized":"2024-09-16T16:44:30.023865+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_clean_scrub_stamp":"2024-09-16T16:44:26.972784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'52","reported_seq":87,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T16:44:30.013218+0000","last_change":"2024-09-16T16:44:26.004647+0000","last_active":"2024-09-16T16:44:30.013218+0000","last_peered":"2024-09-16T16:44:30.013218+0000","last_clean":"2024-09-16T16:44:30.013218+0000","last_became_active":"2024-09-16T16:44:25.997426+0000","last_became_peered":"2024-09-16T16:44:25.997426+0000","last_unstale":"2024-09-16T16:44:30.013218+0000","last_undegraded":"2024-09-16T16:44:30.013218+0000","last_fullsized":"2024-09-16T16:44:30.013218+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:44:24.961212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:44:24.961212+0000","last_clean_scrub_stamp":"2024-09-16T16:44:24.961212+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30054,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26948,"kb_used_data":116,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344892,"statfs":{"total":96636764160,"available":96609169408,"internally_reserved":0,"allocated":118784,"data_stored":29892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738375,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27012,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344828,"statfs":{"total":96636764160,"available":96609103872,"internally_reserved":0,"allocated":184320,"data_stored":620279,"data_compressed":30054,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738375,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27012,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344828,"statfs":{"total":96636764160,"available":96609103872,"internally_reserved":0,"allocated":184320,"data_stored":620279,"data_compressed":30054,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30054,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:44:32.549 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T16:44:32.549 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-16T16:44:32.550 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-16T16:44:32.550 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-16T16:44:32.656 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:44:32.654+0000 7f127ee6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:44:32.660 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:44:32.660+0000 7f127ee6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:44:32.881 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:44:32.881 INFO:teuthology.orchestra.run.smithi172.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-16T16:44:32.895 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-16T16:44:32.895 INFO:teuthology.run_tasks:Running task workunit... 2024-09-16T16:44:32.911 INFO:tasks.workunit:Pulling workunits from ref 0325fd3c11a225c0fd9eb38fab88aad1370ad779 2024-09-16T16:44:32.911 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-16T16:44:32.911 DEBUG:teuthology.orchestra.run.smithi172:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-16T16:44:32.927 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T16:44:32.927 INFO:teuthology.orchestra.run.smithi172.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-16T16:44:32.927 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-16T16:44:32.983 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-16T16:44:32.983 DEBUG:teuthology.orchestra.run.smithi172:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-16T16:44:33.039 INFO:tasks.workunit:timeout=3h 2024-09-16T16:44:33.039 INFO:tasks.workunit:cleanup=True 2024-09-16T16:44:33.040 DEBUG:teuthology.orchestra.run.smithi172:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 0325fd3c11a225c0fd9eb38fab88aad1370ad779 2024-09-16T16:44:33.096 INFO:tasks.workunit.client.0.smithi172.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-16T16:45:24.821 INFO:tasks.workunit.client.0.smithi172.stderr:Updating files: 96% (11617/12088) Updating files: 97% (11726/12088) Updating files: 98% (11847/12088) Updating files: 99% (11968/12088) Updating files: 100% (12088/12088) Updating files: 100% (12088/12088), done. 2024-09-16T16:45:25.811 INFO:tasks.workunit.client.0.smithi172.stderr:Note: switching to '0325fd3c11a225c0fd9eb38fab88aad1370ad779'. 2024-09-16T16:45:25.812 INFO:tasks.workunit.client.0.smithi172.stderr: 2024-09-16T16:45:25.812 INFO:tasks.workunit.client.0.smithi172.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-16T16:45:25.812 INFO:tasks.workunit.client.0.smithi172.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-16T16:45:25.812 INFO:tasks.workunit.client.0.smithi172.stderr:state without impacting any branches by switching back to a branch. 2024-09-16T16:45:25.812 INFO:tasks.workunit.client.0.smithi172.stderr: 2024-09-16T16:45:25.812 INFO:tasks.workunit.client.0.smithi172.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-16T16:45:25.812 INFO:tasks.workunit.client.0.smithi172.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-16T16:45:25.812 INFO:tasks.workunit.client.0.smithi172.stderr: 2024-09-16T16:45:25.812 INFO:tasks.workunit.client.0.smithi172.stderr: git switch -c 2024-09-16T16:45:25.812 INFO:tasks.workunit.client.0.smithi172.stderr: 2024-09-16T16:45:25.812 INFO:tasks.workunit.client.0.smithi172.stderr:Or undo this operation with: 2024-09-16T16:45:25.812 INFO:tasks.workunit.client.0.smithi172.stderr: 2024-09-16T16:45:25.812 INFO:tasks.workunit.client.0.smithi172.stderr: git switch - 2024-09-16T16:45:25.813 INFO:tasks.workunit.client.0.smithi172.stderr: 2024-09-16T16:45:25.813 INFO:tasks.workunit.client.0.smithi172.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-16T16:45:25.813 INFO:tasks.workunit.client.0.smithi172.stderr: 2024-09-16T16:45:25.813 INFO:tasks.workunit.client.0.smithi172.stderr:HEAD is now at 0325fd3c11a Merge pull request #58530 from zdover23/wip-doc-2024-07-11-radosgw-s3-authentication 2024-09-16T16:45:25.816 DEBUG:teuthology.orchestra.run.smithi172:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-16T16:45:25.878 INFO:tasks.workunit.client.0.smithi172.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-16T16:45:25.880 INFO:tasks.workunit.client.0.smithi172.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-16T16:45:25.881 INFO:tasks.workunit.client.0.smithi172.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-16T16:45:26.514 INFO:tasks.workunit.client.0.smithi172.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-16T16:45:26.584 INFO:tasks.workunit.client.0.smithi172.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-16T16:45:26.624 INFO:tasks.workunit.client.0.smithi172.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-16T16:45:26.626 INFO:tasks.workunit.client.0.smithi172.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-16T16:45:26.626 INFO:tasks.workunit.client.0.smithi172.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-16T16:45:26.664 INFO:tasks.workunit.client.0.smithi172.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-16T16:45:26.668 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-16T16:45:26.668 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-16T16:45:26.724 INFO:tasks.workunit:Running workunits matching rbd/crimson/test_crimson_librbd.sh on client.0... 2024-09-16T16:45:26.725 INFO:tasks.workunit:Running workunit rbd/crimson/test_crimson_librbd.sh... 2024-09-16T16:45:26.726 DEBUG:teuthology.orchestra.run.smithi172:workunit test rbd/crimson/test_crimson_librbd.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0325fd3c11a225c0fd9eb38fab88aad1370ad779 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/crimson/test_crimson_librbd.sh 2024-09-16T16:45:26.832 INFO:tasks.workunit.client.0.smithi172.stdout:seed 30277 2024-09-16T16:45:26.833 INFO:tasks.workunit.client.0.smithi172.stdout:Note: Google Test filter = TestLibRBD.* 2024-09-16T16:45:26.833 INFO:tasks.workunit.client.0.smithi172.stdout:[==========] Running 171 tests from 1 test suite. 2024-09-16T16:45:26.833 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] Global test environment set-up. 2024-09-16T16:45:26.833 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] 171 tests from TestLibRBD 2024-09-16T16:45:26.880 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.CreateAndStat 2024-09-16T16:45:28.328 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:45:30.453 INFO:tasks.workunit.client.0.smithi172.stdout:image has size 2097152 and order 22 2024-09-16T16:45:30.453 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.CreateAndStat (3574 ms) 2024-09-16T16:45:30.453 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.CreateWithSameDataPool 2024-09-16T16:45:30.454 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:780: Skipped 2024-09-16T16:45:30.454 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:45:30.454 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.CreateWithSameDataPool (0 ms) 2024-09-16T16:45:30.454 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.CreateAndStatPP 2024-09-16T16:45:30.454 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:45:30.547 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.CreateAndStatPP (94 ms) 2024-09-16T16:45:30.547 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.GetId 2024-09-16T16:45:30.547 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:45:30.636 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.GetId (88 ms) 2024-09-16T16:45:30.636 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.GetIdPP 2024-09-16T16:45:30.636 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:45:30.731 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.GetIdPP (95 ms) 2024-09-16T16:45:30.731 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.GetBlockNamePrefix 2024-09-16T16:45:30.731 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:45:30.820 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.GetBlockNamePrefix (88 ms) 2024-09-16T16:45:30.820 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.GetBlockNamePrefixPP 2024-09-16T16:45:30.820 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:45:30.905 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.GetBlockNamePrefixPP (85 ms) 2024-09-16T16:45:30.905 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.TestGetCreateTimestamp 2024-09-16T16:45:30.905 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:939: Skipped 2024-09-16T16:45:30.905 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:45:30.905 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.TestGetCreateTimestamp (0 ms) 2024-09-16T16:45:30.905 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.GetCreateTimestampPP 2024-09-16T16:45:30.905 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:962: Skipped 2024-09-16T16:45:30.905 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:45:30.905 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.GetCreateTimestampPP (0 ms) 2024-09-16T16:45:30.906 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.OpenAio 2024-09-16T16:45:30.906 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:45:30.990 INFO:tasks.workunit.client.0.smithi172.stdout:image has size 2097152 and order 22 2024-09-16T16:45:30.990 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.OpenAio (85 ms) 2024-09-16T16:45:30.990 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.OpenAioFail 2024-09-16T16:45:31.001 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.OpenAioFail (11 ms) 2024-09-16T16:45:31.001 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.OpenAioPP 2024-09-16T16:45:31.001 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:45:31.134 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.OpenAioPP (133 ms) 2024-09-16T16:45:31.134 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.OpenAioFailPP 2024-09-16T16:45:31.146 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.OpenAioFailPP (11 ms) 2024-09-16T16:45:31.146 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.ResizeAndStat 2024-09-16T16:45:31.146 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:45:31.352 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.ResizeAndStat (206 ms) 2024-09-16T16:45:31.352 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.ResizeAndStatPP 2024-09-16T16:45:31.352 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:45:31.528 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.ResizeAndStatPP (176 ms) 2024-09-16T16:45:31.528 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.UpdateWatchAndResize 2024-09-16T16:45:31.528 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:45:31.735 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.UpdateWatchAndResize (207 ms) 2024-09-16T16:45:31.735 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.UpdateWatchAndResizePP 2024-09-16T16:45:31.735 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:45:31.944 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.UpdateWatchAndResizePP (209 ms) 2024-09-16T16:45:31.944 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.TestCreateLsDelete 2024-09-16T16:45:33.655 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:45:35.468 INFO:tasks.workunit.client.0.smithi172.stdout:image: image15 2024-09-16T16:45:35.469 INFO:tasks.workunit.client.0.smithi172.stdout:expected = image15 2024-09-16T16:45:35.469 INFO:tasks.workunit.client.0.smithi172.stdout:found image15 2024-09-16T16:45:35.469 INFO:tasks.workunit.client.0.smithi172.stdout:erased image15 2024-09-16T16:45:35.469 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:45:35.713 INFO:tasks.workunit.client.0.smithi172.stdout:image: image15 2024-09-16T16:45:35.713 INFO:tasks.workunit.client.0.smithi172.stdout:image: image16 2024-09-16T16:45:35.713 INFO:tasks.workunit.client.0.smithi172.stdout:expected = image15 2024-09-16T16:45:35.713 INFO:tasks.workunit.client.0.smithi172.stdout:found image15 2024-09-16T16:45:35.713 INFO:tasks.workunit.client.0.smithi172.stdout:erased image15 2024-09-16T16:45:35.713 INFO:tasks.workunit.client.0.smithi172.stdout:expected = image16 2024-09-16T16:45:35.713 INFO:tasks.workunit.client.0.smithi172.stdout:found image16 2024-09-16T16:45:35.713 INFO:tasks.workunit.client.0.smithi172.stdout:erased image16 2024-09-16T16:45:35.713 INFO:tasks.workunit.client.0.smithi172.stdout:image: image16 2024-09-16T16:45:35.714 INFO:tasks.workunit.client.0.smithi172.stdout:expected = image16 2024-09-16T16:45:35.714 INFO:tasks.workunit.client.0.smithi172.stdout:found image16 2024-09-16T16:45:35.714 INFO:tasks.workunit.client.0.smithi172.stdout:erased image16 2024-09-16T16:45:35.714 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.TestCreateLsDelete (3769 ms) 2024-09-16T16:45:35.714 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.TestCreateLsDeletePP 2024-09-16T16:45:37.387 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:45:39.522 INFO:tasks.workunit.client.0.smithi172.stdout:num images is: 1 2024-09-16T16:45:39.523 INFO:tasks.workunit.client.0.smithi172.stdout:expected: 1 2024-09-16T16:45:39.523 INFO:tasks.workunit.client.0.smithi172.stdout:image: image17 2024-09-16T16:45:39.523 INFO:tasks.workunit.client.0.smithi172.stdout:expected = image17 2024-09-16T16:45:39.523 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:45:39.573 INFO:tasks.workunit.client.0.smithi172.stdout:num images is: 2 2024-09-16T16:45:39.573 INFO:tasks.workunit.client.0.smithi172.stdout:expected: 2 2024-09-16T16:45:39.573 INFO:tasks.workunit.client.0.smithi172.stdout:image: image17 2024-09-16T16:45:39.573 INFO:tasks.workunit.client.0.smithi172.stdout:image: image18 2024-09-16T16:45:39.573 INFO:tasks.workunit.client.0.smithi172.stdout:expected = image17 2024-09-16T16:45:39.574 INFO:tasks.workunit.client.0.smithi172.stdout:expected = image18 2024-09-16T16:45:39.685 INFO:tasks.workunit.client.0.smithi172.stdout:num images is: 1 2024-09-16T16:45:39.685 INFO:tasks.workunit.client.0.smithi172.stdout:expected: 1 2024-09-16T16:45:39.685 INFO:tasks.workunit.client.0.smithi172.stdout:image: image18 2024-09-16T16:45:39.685 INFO:tasks.workunit.client.0.smithi172.stdout:expected = image18 2024-09-16T16:45:39.685 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.TestCreateLsDeletePP (3972 ms) 2024-09-16T16:45:39.685 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.TestCopy 2024-09-16T16:45:41.399 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:45:48.936 INFO:tasks.workunit.client.0.smithi172.stdout:image: image19 2024-09-16T16:45:48.936 INFO:tasks.workunit.client.0.smithi172.stdout:expected = image19 2024-09-16T16:45:48.936 INFO:tasks.workunit.client.0.smithi172.stdout:found image19 2024-09-16T16:45:48.936 INFO:tasks.workunit.client.0.smithi172.stdout:erased image19 2024-09-16T16:45:48.936 INFO:tasks.workunit.client.0.smithi172.stdout:image: image19 2024-09-16T16:45:48.936 INFO:tasks.workunit.client.0.smithi172.stdout:image: image20 2024-09-16T16:45:48.936 INFO:tasks.workunit.client.0.smithi172.stdout:expected = image19 2024-09-16T16:45:48.937 INFO:tasks.workunit.client.0.smithi172.stdout:found image19 2024-09-16T16:45:48.937 INFO:tasks.workunit.client.0.smithi172.stdout:erased image19 2024-09-16T16:45:48.937 INFO:tasks.workunit.client.0.smithi172.stdout:expected = image20 2024-09-16T16:45:48.937 INFO:tasks.workunit.client.0.smithi172.stdout:found image20 2024-09-16T16:45:48.937 INFO:tasks.workunit.client.0.smithi172.stdout:erased image20 2024-09-16T16:45:48.937 INFO:tasks.workunit.client.0.smithi172.stdout:0.00% done 2024-09-16T16:45:48.937 INFO:tasks.workunit.client.0.smithi172.stdout:100.00% done 2024-09-16T16:45:48.937 INFO:tasks.workunit.client.0.smithi172.stdout:image: image19 2024-09-16T16:45:48.937 INFO:tasks.workunit.client.0.smithi172.stdout:image: image20 2024-09-16T16:45:48.937 INFO:tasks.workunit.client.0.smithi172.stdout:image: image21 2024-09-16T16:45:48.937 INFO:tasks.workunit.client.0.smithi172.stdout:expected = image19 2024-09-16T16:45:48.937 INFO:tasks.workunit.client.0.smithi172.stdout:found image19 2024-09-16T16:45:48.937 INFO:tasks.workunit.client.0.smithi172.stdout:erased image19 2024-09-16T16:45:48.937 INFO:tasks.workunit.client.0.smithi172.stdout:expected = image20 2024-09-16T16:45:48.937 INFO:tasks.workunit.client.0.smithi172.stdout:found image20 2024-09-16T16:45:48.938 INFO:tasks.workunit.client.0.smithi172.stdout:erased image20 2024-09-16T16:45:48.938 INFO:tasks.workunit.client.0.smithi172.stdout:expected = image21 2024-09-16T16:45:48.938 INFO:tasks.workunit.client.0.smithi172.stdout:found image21 2024-09-16T16:45:48.938 INFO:tasks.workunit.client.0.smithi172.stdout:erased image21 2024-09-16T16:45:48.938 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.TestCopy (9251 ms) 2024-09-16T16:45:48.938 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.TestCopyPP 2024-09-16T16:45:50.441 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:45:55.158 INFO:tasks.workunit.client.0.smithi172.stdout:num images is: 1 2024-09-16T16:45:55.158 INFO:tasks.workunit.client.0.smithi172.stdout:expected: 1 2024-09-16T16:45:55.158 INFO:tasks.workunit.client.0.smithi172.stdout:image: image22 2024-09-16T16:45:55.158 INFO:tasks.workunit.client.0.smithi172.stdout:expected = image22 2024-09-16T16:45:56.791 INFO:tasks.workunit.client.0.smithi172.stdout:num images is: 2 2024-09-16T16:45:56.791 INFO:tasks.workunit.client.0.smithi172.stdout:expected: 2 2024-09-16T16:45:56.792 INFO:tasks.workunit.client.0.smithi172.stdout:image: image22 2024-09-16T16:45:56.792 INFO:tasks.workunit.client.0.smithi172.stdout:image: image23 2024-09-16T16:45:56.792 INFO:tasks.workunit.client.0.smithi172.stdout:expected = image22 2024-09-16T16:45:56.792 INFO:tasks.workunit.client.0.smithi172.stdout:expected = image23 2024-09-16T16:45:57.459 INFO:tasks.workunit.client.0.smithi172.stdout:0.00% done 2024-09-16T16:45:57.459 INFO:tasks.workunit.client.0.smithi172.stdout:100.00% done 2024-09-16T16:45:57.459 INFO:tasks.workunit.client.0.smithi172.stdout:num images is: 3 2024-09-16T16:45:57.460 INFO:tasks.workunit.client.0.smithi172.stdout:expected: 3 2024-09-16T16:45:57.460 INFO:tasks.workunit.client.0.smithi172.stdout:image: image22 2024-09-16T16:45:57.460 INFO:tasks.workunit.client.0.smithi172.stdout:image: image23 2024-09-16T16:45:57.460 INFO:tasks.workunit.client.0.smithi172.stdout:image: image24 2024-09-16T16:45:57.460 INFO:tasks.workunit.client.0.smithi172.stdout:expected = image22 2024-09-16T16:45:57.460 INFO:tasks.workunit.client.0.smithi172.stdout:expected = image23 2024-09-16T16:45:57.460 INFO:tasks.workunit.client.0.smithi172.stdout:expected = image24 2024-09-16T16:45:58.077 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.TestCopyPP (9141 ms) 2024-09-16T16:45:58.077 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.TestDeepCopy 2024-09-16T16:45:58.077 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:1578: Skipped 2024-09-16T16:45:58.077 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:45:58.077 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.TestDeepCopy (0 ms) 2024-09-16T16:45:58.077 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.TestDeepCopyPP 2024-09-16T16:45:58.078 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:1745: Skipped 2024-09-16T16:45:58.078 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:45:58.078 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.TestDeepCopyPP (0 ms) 2024-09-16T16:45:58.078 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.TestCreateLsDeleteSnap 2024-09-16T16:45:58.078 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:46:01.680 INFO:tasks.workunit.client.0.smithi172.stdout:num snaps is: 1 2024-09-16T16:46:01.680 INFO:tasks.workunit.client.0.smithi172.stdout:expected: 1 2024-09-16T16:46:01.680 INFO:tasks.workunit.client.0.smithi172.stdout:snap: snap1 2024-09-16T16:46:01.680 INFO:tasks.workunit.client.0.smithi172.stdout:found snap1 with size 2097152 2024-09-16T16:46:01.680 INFO:tasks.workunit.client.0.smithi172.stdout:num snaps is: 2 2024-09-16T16:46:01.681 INFO:tasks.workunit.client.0.smithi172.stdout:expected: 2 2024-09-16T16:46:01.681 INFO:tasks.workunit.client.0.smithi172.stdout:snap: snap1 2024-09-16T16:46:01.681 INFO:tasks.workunit.client.0.smithi172.stdout:snap: snap2 2024-09-16T16:46:01.681 INFO:tasks.workunit.client.0.smithi172.stdout:found snap1 with size 2097152 2024-09-16T16:46:01.681 INFO:tasks.workunit.client.0.smithi172.stdout:found snap2 with size 4194304 2024-09-16T16:46:01.681 INFO:tasks.workunit.client.0.smithi172.stdout:num snaps is: 1 2024-09-16T16:46:01.681 INFO:tasks.workunit.client.0.smithi172.stdout:expected: 1 2024-09-16T16:46:01.681 INFO:tasks.workunit.client.0.smithi172.stdout:snap: snap2 2024-09-16T16:46:01.681 INFO:tasks.workunit.client.0.smithi172.stdout:found snap2 with size 4194304 2024-09-16T16:46:01.681 INFO:tasks.workunit.client.0.smithi172.stdout:num snaps is: 0 2024-09-16T16:46:01.681 INFO:tasks.workunit.client.0.smithi172.stdout:expected: 0 2024-09-16T16:46:01.681 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.TestCreateLsDeleteSnap (3603 ms) 2024-09-16T16:46:01.681 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.TestGetSnapShotTimeStamp 2024-09-16T16:46:01.682 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:1890: Skipped 2024-09-16T16:46:01.682 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:46:01.682 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.TestGetSnapShotTimeStamp (0 ms) 2024-09-16T16:46:01.682 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.TestCreateLsDeleteSnapPP 2024-09-16T16:46:01.682 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:46:02.647 INFO:tasks.workunit.client.0.smithi172.stdout:num snaps is: 1 2024-09-16T16:46:02.647 INFO:tasks.workunit.client.0.smithi172.stdout:expected: 1 2024-09-16T16:46:02.647 INFO:tasks.workunit.client.0.smithi172.stdout:snap: snap1 2024-09-16T16:46:02.647 INFO:tasks.workunit.client.0.smithi172.stdout:found snap1 with size 2097152 2024-09-16T16:46:03.646 INFO:tasks.workunit.client.0.smithi172.stdout:num snaps is: 2 2024-09-16T16:46:03.647 INFO:tasks.workunit.client.0.smithi172.stdout:expected: 2 2024-09-16T16:46:03.647 INFO:tasks.workunit.client.0.smithi172.stdout:snap: snap1 2024-09-16T16:46:03.647 INFO:tasks.workunit.client.0.smithi172.stdout:snap: snap2 2024-09-16T16:46:03.647 INFO:tasks.workunit.client.0.smithi172.stdout:found snap1 with size 2097152 2024-09-16T16:46:03.647 INFO:tasks.workunit.client.0.smithi172.stdout:found snap2 with size 4194304 2024-09-16T16:46:04.655 INFO:tasks.workunit.client.0.smithi172.stdout:num snaps is: 1 2024-09-16T16:46:04.656 INFO:tasks.workunit.client.0.smithi172.stdout:expected: 1 2024-09-16T16:46:04.656 INFO:tasks.workunit.client.0.smithi172.stdout:snap: snap2 2024-09-16T16:46:04.656 INFO:tasks.workunit.client.0.smithi172.stdout:found snap2 with size 4194304 2024-09-16T16:46:05.729 INFO:tasks.workunit.client.0.smithi172.stdout:num snaps is: 0 2024-09-16T16:46:05.729 INFO:tasks.workunit.client.0.smithi172.stdout:expected: 0 2024-09-16T16:46:05.746 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.TestCreateLsDeleteSnapPP (4067 ms) 2024-09-16T16:46:05.746 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.TestGetNameIdSnapPP 2024-09-16T16:46:05.746 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:46:11.678 INFO:tasks.workunit.client.0.smithi172.stdout:num snaps is: 0 2024-09-16T16:46:11.678 INFO:tasks.workunit.client.0.smithi172.stdout:expected: 0 2024-09-16T16:46:11.690 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.TestGetNameIdSnapPP (5944 ms) 2024-09-16T16:46:11.690 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.TestCreateLsRenameSnapPP 2024-09-16T16:46:11.690 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:46:12.689 INFO:tasks.workunit.client.0.smithi172.stdout:num snaps is: 1 2024-09-16T16:46:12.689 INFO:tasks.workunit.client.0.smithi172.stdout:expected: 1 2024-09-16T16:46:12.689 INFO:tasks.workunit.client.0.smithi172.stdout:snap: snap1 2024-09-16T16:46:12.689 INFO:tasks.workunit.client.0.smithi172.stdout:found snap1 with size 2097152 2024-09-16T16:46:13.767 INFO:tasks.workunit.client.0.smithi172.stdout:num snaps is: 2 2024-09-16T16:46:13.767 INFO:tasks.workunit.client.0.smithi172.stdout:expected: 2 2024-09-16T16:46:13.767 INFO:tasks.workunit.client.0.smithi172.stdout:snap: snap1 2024-09-16T16:46:13.767 INFO:tasks.workunit.client.0.smithi172.stdout:snap: snap2 2024-09-16T16:46:13.767 INFO:tasks.workunit.client.0.smithi172.stdout:found snap1 with size 2097152 2024-09-16T16:46:13.767 INFO:tasks.workunit.client.0.smithi172.stdout:found snap2 with size 4194304 2024-09-16T16:46:13.817 INFO:tasks.workunit.client.0.smithi172.stdout:num snaps is: 2 2024-09-16T16:46:13.817 INFO:tasks.workunit.client.0.smithi172.stdout:expected: 2 2024-09-16T16:46:13.817 INFO:tasks.workunit.client.0.smithi172.stdout:snap: snap1-rename 2024-09-16T16:46:13.817 INFO:tasks.workunit.client.0.smithi172.stdout:snap: snap2 2024-09-16T16:46:13.817 INFO:tasks.workunit.client.0.smithi172.stdout:found snap1-rename with size 2097152 2024-09-16T16:46:13.817 INFO:tasks.workunit.client.0.smithi172.stdout:found snap2 with size 4194304 2024-09-16T16:46:14.783 INFO:tasks.workunit.client.0.smithi172.stdout:num snaps is: 1 2024-09-16T16:46:14.784 INFO:tasks.workunit.client.0.smithi172.stdout:expected: 1 2024-09-16T16:46:14.784 INFO:tasks.workunit.client.0.smithi172.stdout:snap: snap2-rename 2024-09-16T16:46:14.784 INFO:tasks.workunit.client.0.smithi172.stdout:found snap2-rename with size 4194304 2024-09-16T16:46:15.709 INFO:tasks.workunit.client.0.smithi172.stdout:num snaps is: 0 2024-09-16T16:46:15.709 INFO:tasks.workunit.client.0.smithi172.stdout:expected: 0 2024-09-16T16:46:15.722 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.TestCreateLsRenameSnapPP (4031 ms) 2024-09-16T16:46:15.722 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.ConcurrentCreatesUnvalidatedPool 2024-09-16T16:46:17.572 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:46:17.572 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:46:17.572 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:46:17.572 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:46:20.221 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.ConcurrentCreatesUnvalidatedPool (4499 ms) 2024-09-16T16:46:20.221 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.RemoveFullTry 2024-09-16T16:46:24.844 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:47:01.892 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.RemoveFullTry (41670 ms) 2024-09-16T16:47:01.892 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.RemoveFullTryDataPool 2024-09-16T16:47:01.892 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:2227: Skipped 2024-09-16T16:47:01.892 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:47:01.892 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.RemoveFullTryDataPool (0 ms) 2024-09-16T16:47:01.892 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.RemoveFullTryNamespace 2024-09-16T16:47:01.892 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:2247: Skipped 2024-09-16T16:47:01.892 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:47:01.892 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.RemoveFullTryNamespace (0 ms) 2024-09-16T16:47:01.892 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.RemoveFullTryNamespaceDataPool 2024-09-16T16:47:01.892 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:2269: Skipped 2024-09-16T16:47:01.893 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:47:01.893 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.RemoveFullTryNamespaceDataPool (0 ms) 2024-09-16T16:47:01.893 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.TestIO 2024-09-16T16:47:01.893 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:47:30.103 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 512 2024-09-16T16:47:30.103 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 512 2024-09-16T16:47:30.103 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 512 2024-09-16T16:47:30.103 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 512 2024-09-16T16:47:30.103 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 512 2024-09-16T16:47:30.103 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:47:30.103 INFO:tasks.workunit.client.0.smithi172.stdout:started write 2024-09-16T16:47:30.103 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:47:30.103 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:47:30.103 INFO:tasks.workunit.client.0.smithi172.stdout:finished write 2024-09-16T16:47:30.103 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:47:30.104 INFO:tasks.workunit.client.0.smithi172.stdout:started write 2024-09-16T16:47:30.104 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:47:30.104 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:47:30.104 INFO:tasks.workunit.client.0.smithi172.stdout:finished write 2024-09-16T16:47:30.104 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:47:30.104 INFO:tasks.workunit.client.0.smithi172.stdout:started write 2024-09-16T16:47:30.104 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:47:30.104 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:47:30.104 INFO:tasks.workunit.client.0.smithi172.stdout:finished write 2024-09-16T16:47:30.104 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:47:30.104 INFO:tasks.workunit.client.0.smithi172.stdout:started write 2024-09-16T16:47:30.104 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:47:30.104 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:47:30.105 INFO:tasks.workunit.client.0.smithi172.stdout:finished write 2024-09-16T16:47:30.105 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:47:30.105 INFO:tasks.workunit.client.0.smithi172.stdout:started write 2024-09-16T16:47:30.105 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:47:30.105 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:47:30.105 INFO:tasks.workunit.client.0.smithi172.stdout:finished write 2024-09-16T16:47:30.105 INFO:tasks.workunit.client.0.smithi172.stdout:start compare and write 2024-09-16T16:47:30.105 INFO:tasks.workunit.client.0.smithi172.stdout:compare and wrote: 512 2024-09-16T16:47:30.105 INFO:tasks.workunit.client.0.smithi172.stdout:start compare and write 2024-09-16T16:47:30.105 INFO:tasks.workunit.client.0.smithi172.stdout:compare and wrote: 512 2024-09-16T16:47:30.105 INFO:tasks.workunit.client.0.smithi172.stdout:start compare and write 2024-09-16T16:47:30.105 INFO:tasks.workunit.client.0.smithi172.stdout:compare and wrote: 512 2024-09-16T16:47:30.105 INFO:tasks.workunit.client.0.smithi172.stdout:start compare and write 2024-09-16T16:47:30.106 INFO:tasks.workunit.client.0.smithi172.stdout:compare and wrote: 512 2024-09-16T16:47:30.106 INFO:tasks.workunit.client.0.smithi172.stdout:start compare and write 2024-09-16T16:47:30.106 INFO:tasks.workunit.client.0.smithi172.stdout:compare and wrote: 512 2024-09-16T16:47:30.106 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:47:30.106 INFO:tasks.workunit.client.0.smithi172.stdout:started aio compare and write 2024-09-16T16:47:30.106 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:47:30.106 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:47:30.106 INFO:tasks.workunit.client.0.smithi172.stdout:finished aio compare and write 2024-09-16T16:47:30.106 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:47:30.106 INFO:tasks.workunit.client.0.smithi172.stdout:started aio compare and write 2024-09-16T16:47:30.106 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:47:30.106 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:47:30.106 INFO:tasks.workunit.client.0.smithi172.stdout:finished aio compare and write 2024-09-16T16:47:30.106 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:47:30.107 INFO:tasks.workunit.client.0.smithi172.stdout:started aio compare and write 2024-09-16T16:47:30.107 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:47:30.107 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:47:30.107 INFO:tasks.workunit.client.0.smithi172.stdout:finished aio compare and write 2024-09-16T16:47:30.107 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:47:30.107 INFO:tasks.workunit.client.0.smithi172.stdout:started aio compare and write 2024-09-16T16:47:30.107 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:47:30.107 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:47:30.107 INFO:tasks.workunit.client.0.smithi172.stdout:finished aio compare and write 2024-09-16T16:47:30.107 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:47:30.107 INFO:tasks.workunit.client.0.smithi172.stdout:started aio compare and write 2024-09-16T16:47:30.107 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:47:30.107 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:47:30.107 INFO:tasks.workunit.client.0.smithi172.stdout:finished aio compare and write 2024-09-16T16:47:30.108 INFO:tasks.workunit.client.0.smithi172.stdout:read: 512 2024-09-16T16:47:30.108 INFO:tasks.workunit.client.0.smithi172.stdout:read: 512 2024-09-16T16:47:30.108 INFO:tasks.workunit.client.0.smithi172.stdout:read: 512 2024-09-16T16:47:30.108 INFO:tasks.workunit.client.0.smithi172.stdout:read: 512 2024-09-16T16:47:30.108 INFO:tasks.workunit.client.0.smithi172.stdout:read: 512 2024-09-16T16:47:30.108 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:47:30.108 INFO:tasks.workunit.client.0.smithi172.stdout:started read 2024-09-16T16:47:30.108 INFO:tasks.workunit.client.0.smithi172.stdout:read completion cb called! 2024-09-16T16:47:30.108 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 512 2024-09-16T16:47:30.108 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:47:30.108 INFO:tasks.workunit.client.0.smithi172.stdout:started read 2024-09-16T16:47:30.108 INFO:tasks.workunit.client.0.smithi172.stdout:read completion cb called! 2024-09-16T16:47:30.108 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 512 2024-09-16T16:47:30.108 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:47:30.109 INFO:tasks.workunit.client.0.smithi172.stdout:started read 2024-09-16T16:47:30.109 INFO:tasks.workunit.client.0.smithi172.stdout:read completion cb called! 2024-09-16T16:47:30.109 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 512 2024-09-16T16:47:30.109 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:47:30.109 INFO:tasks.workunit.client.0.smithi172.stdout:started read 2024-09-16T16:47:30.109 INFO:tasks.workunit.client.0.smithi172.stdout:read completion cb called! 2024-09-16T16:47:30.109 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 512 2024-09-16T16:47:30.109 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:47:30.109 INFO:tasks.workunit.client.0.smithi172.stdout:started read 2024-09-16T16:47:30.109 INFO:tasks.workunit.client.0.smithi172.stdout:read completion cb called! 2024-09-16T16:47:30.109 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 512 2024-09-16T16:47:30.109 INFO:tasks.workunit.client.0.smithi172.stdout:discard: 512~512 = 512 2024-09-16T16:47:30.109 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:47:30.109 INFO:tasks.workunit.client.0.smithi172.stdout:aio discard: 1536~512 = 0 2024-09-16T16:47:30.110 INFO:tasks.workunit.client.0.smithi172.stdout:read: 512 2024-09-16T16:47:30.110 INFO:tasks.workunit.client.0.smithi172.stdout:read: 512 2024-09-16T16:47:30.110 INFO:tasks.workunit.client.0.smithi172.stdout:read: 512 2024-09-16T16:47:30.110 INFO:tasks.workunit.client.0.smithi172.stdout:read: 512 2024-09-16T16:47:30.110 INFO:tasks.workunit.client.0.smithi172.stdout:read: 512 2024-09-16T16:47:30.110 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 0 2024-09-16T16:47:30.110 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:47:30.110 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:47:30.110 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 0 2024-09-16T16:47:30.110 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:47:30.110 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:47:30.110 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 16384 2024-09-16T16:47:30.110 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:47:30.110 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:47:30.111 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 16384 2024-09-16T16:47:30.111 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:47:30.111 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:47:30.111 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:47:30.111 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:47:30.111 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 49152 2024-09-16T16:47:30.111 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:47:30.111 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:47:30.111 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 49152 2024-09-16T16:47:30.111 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:47:30.111 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:47:30.111 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 65536 2024-09-16T16:47:30.111 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:47:30.111 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:47:30.111 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 65536 2024-09-16T16:47:30.112 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:47:30.112 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:47:30.112 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:47:30.112 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:47:30.112 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 98304 2024-09-16T16:47:30.112 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:47:30.112 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:47:30.112 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 98304 2024-09-16T16:47:30.112 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:47:30.112 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:47:30.112 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 114688 2024-09-16T16:47:30.112 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:47:30.112 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:47:30.113 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 114688 2024-09-16T16:47:30.113 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:47:30.113 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:47:30.113 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:47:30.113 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:47:30.113 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 147456 2024-09-16T16:47:30.113 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:47:30.113 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:47:30.113 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 147456 2024-09-16T16:47:30.113 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:47:30.113 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:47:30.113 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 163840 2024-09-16T16:47:30.113 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:47:30.113 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:47:30.114 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 163840 2024-09-16T16:47:30.114 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:47:30.114 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:47:30.114 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:47:30.114 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:47:30.114 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 196608 2024-09-16T16:47:30.114 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:47:30.114 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:47:30.114 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 196608 2024-09-16T16:47:30.114 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:47:30.114 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:47:30.114 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 212992 2024-09-16T16:47:30.114 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:47:30.114 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:47:30.115 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 212992 2024-09-16T16:47:30.115 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:47:30.115 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:47:30.115 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:47:30.115 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:47:30.115 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:47:30.115 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:47:30.115 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:47:30.115 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:47:30.115 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:47:30.115 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:47:30.115 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:47:30.115 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:47:30.115 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:47:30.116 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:47:30.116 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:47:30.116 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:47:30.116 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:47:30.116 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:47:30.116 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:47:30.116 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:47:30.116 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:47:30.116 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:47:30.116 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:47:30.116 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:47:30.116 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:47:30.116 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:47:30.117 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:47:30.117 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:47:30.117 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:47:30.117 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:47:30.117 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:47:30.117 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:47:30.117 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:47:30.117 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:47:30.117 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:47:30.117 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:47:30.117 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:47:30.117 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:47:30.117 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:47:30.118 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:47:30.118 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:47:30.118 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:47:30.118 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:47:30.118 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:47:30.118 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:47:30.118 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:47:30.118 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:47:30.118 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:47:30.118 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:47:30.118 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:47:30.118 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:47:30.118 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:47:30.118 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:47:54.472 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:47:54.472 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:47:54.472 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:47:54.472 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:47:54.472 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:47:54.472 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:47:54.473 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:47:54.473 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:47:54.473 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:47:54.473 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:47:54.473 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:47:54.473 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:47:54.473 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:47:54.473 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:47:54.473 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:47:54.473 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:47:54.473 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:47:54.474 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:47:54.474 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:47:54.474 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:47:54.474 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:47:54.474 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:47:54.474 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:47:54.474 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:47:54.474 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:47:54.474 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:47:54.474 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:47:54.474 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:47:54.474 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:47:54.475 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:47:54.475 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:47:54.475 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:47:54.475 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:47:54.475 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:47:54.475 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:47:54.475 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:47:54.475 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:47:54.475 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:47:54.475 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:47:54.475 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:47:54.476 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:47:54.476 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:47:54.476 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:47:54.476 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:47:54.476 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:47:54.476 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:47:54.476 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:47:54.476 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:47:54.476 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:47:54.476 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:47:54.477 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:47:54.477 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:47:54.477 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:47:54.477 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:47:54.477 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:47:54.477 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:47:54.477 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:47:54.477 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:47:54.477 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:47:54.477 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:47:54.477 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:47:54.478 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:47:54.478 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:47:54.478 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:47:54.478 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:47:54.478 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:47:54.478 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:47:54.478 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:47:54.478 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:47:54.478 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:47:54.478 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:47:54.478 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:47:54.479 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:47:54.479 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:47:54.479 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:47:54.479 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:47:54.479 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:47:54.479 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:47:54.479 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:47:54.479 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:47:54.479 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:47:54.479 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:47:54.479 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:47:54.479 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:47:54.479 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:47:54.480 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:47:54.480 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:47:54.480 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:47:54.480 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:47:54.480 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:47:54.480 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:47:54.480 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:47:54.480 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:47:54.480 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:47:54.480 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:47:54.480 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:47:54.480 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:47:54.480 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:47:54.480 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:47:54.481 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:47:54.481 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:47:54.481 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:47:54.481 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:47:54.481 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:47:54.481 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:47:54.481 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:47:54.481 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:47:54.481 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:47:54.481 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:47:54.481 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:47:54.482 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:47:54.482 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:47:54.482 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:47:54.482 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:47:54.482 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:47:54.482 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:47:54.482 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:47:54.482 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:47:54.482 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:47:54.482 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:47:54.482 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:47:54.483 INFO:tasks.workunit.client.0.smithi172.stdout:read completion cb called! 2024-09-16T16:47:54.483 INFO:tasks.workunit.client.0.smithi172.stdout:read completion cb called! 2024-09-16T16:47:54.483 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 512 2024-09-16T16:47:54.483 INFO:tasks.workunit.client.0.smithi172.stdout:read completion cb called! 2024-09-16T16:47:54.483 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.TestIO (52581 ms) 2024-09-16T16:47:54.483 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.TestEncryptionLUKS1 2024-09-16T16:47:54.483 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:48:26.432 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 512 2024-09-16T16:48:26.432 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 512 2024-09-16T16:48:26.432 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 512 2024-09-16T16:48:26.432 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 512 2024-09-16T16:48:26.432 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 512 2024-09-16T16:48:26.433 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:48:26.433 INFO:tasks.workunit.client.0.smithi172.stdout:started write 2024-09-16T16:48:26.433 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:48:26.433 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:48:26.433 INFO:tasks.workunit.client.0.smithi172.stdout:finished write 2024-09-16T16:48:26.433 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:48:26.433 INFO:tasks.workunit.client.0.smithi172.stdout:started write 2024-09-16T16:48:26.433 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:48:26.433 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:48:26.433 INFO:tasks.workunit.client.0.smithi172.stdout:finished write 2024-09-16T16:48:26.433 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:48:26.433 INFO:tasks.workunit.client.0.smithi172.stdout:started write 2024-09-16T16:48:26.433 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:48:26.434 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:48:26.434 INFO:tasks.workunit.client.0.smithi172.stdout:finished write 2024-09-16T16:48:26.434 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:48:26.434 INFO:tasks.workunit.client.0.smithi172.stdout:started write 2024-09-16T16:48:26.434 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:48:26.434 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:48:26.434 INFO:tasks.workunit.client.0.smithi172.stdout:finished write 2024-09-16T16:48:26.434 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:48:26.434 INFO:tasks.workunit.client.0.smithi172.stdout:started write 2024-09-16T16:48:26.434 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:48:26.434 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:48:26.434 INFO:tasks.workunit.client.0.smithi172.stdout:finished write 2024-09-16T16:48:26.434 INFO:tasks.workunit.client.0.smithi172.stdout:start compare and write 2024-09-16T16:48:26.434 INFO:tasks.workunit.client.0.smithi172.stdout:compare and wrote: 512 2024-09-16T16:48:26.435 INFO:tasks.workunit.client.0.smithi172.stdout:start compare and write 2024-09-16T16:48:26.435 INFO:tasks.workunit.client.0.smithi172.stdout:compare and wrote: 512 2024-09-16T16:48:26.435 INFO:tasks.workunit.client.0.smithi172.stdout:start compare and write 2024-09-16T16:48:26.435 INFO:tasks.workunit.client.0.smithi172.stdout:compare and wrote: 512 2024-09-16T16:48:26.435 INFO:tasks.workunit.client.0.smithi172.stdout:start compare and write 2024-09-16T16:48:26.435 INFO:tasks.workunit.client.0.smithi172.stdout:compare and wrote: 512 2024-09-16T16:48:26.435 INFO:tasks.workunit.client.0.smithi172.stdout:start compare and write 2024-09-16T16:48:26.435 INFO:tasks.workunit.client.0.smithi172.stdout:compare and wrote: 512 2024-09-16T16:48:26.435 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:48:26.435 INFO:tasks.workunit.client.0.smithi172.stdout:started aio compare and write 2024-09-16T16:48:26.435 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:48:26.435 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:48:26.435 INFO:tasks.workunit.client.0.smithi172.stdout:finished aio compare and write 2024-09-16T16:48:26.435 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:48:26.435 INFO:tasks.workunit.client.0.smithi172.stdout:started aio compare and write 2024-09-16T16:48:26.436 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:48:26.436 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:48:26.436 INFO:tasks.workunit.client.0.smithi172.stdout:finished aio compare and write 2024-09-16T16:48:26.436 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:48:26.436 INFO:tasks.workunit.client.0.smithi172.stdout:started aio compare and write 2024-09-16T16:48:26.436 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:48:26.436 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:48:26.436 INFO:tasks.workunit.client.0.smithi172.stdout:finished aio compare and write 2024-09-16T16:48:26.436 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:48:26.436 INFO:tasks.workunit.client.0.smithi172.stdout:started aio compare and write 2024-09-16T16:48:26.436 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:48:26.436 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:48:26.436 INFO:tasks.workunit.client.0.smithi172.stdout:finished aio compare and write 2024-09-16T16:48:26.436 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:48:26.437 INFO:tasks.workunit.client.0.smithi172.stdout:started aio compare and write 2024-09-16T16:48:26.437 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:48:26.437 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:48:26.437 INFO:tasks.workunit.client.0.smithi172.stdout:finished aio compare and write 2024-09-16T16:48:26.437 INFO:tasks.workunit.client.0.smithi172.stdout:read: 512 2024-09-16T16:48:26.437 INFO:tasks.workunit.client.0.smithi172.stdout:read: 512 2024-09-16T16:48:26.437 INFO:tasks.workunit.client.0.smithi172.stdout:read: 512 2024-09-16T16:48:26.437 INFO:tasks.workunit.client.0.smithi172.stdout:read: 512 2024-09-16T16:48:26.437 INFO:tasks.workunit.client.0.smithi172.stdout:read: 512 2024-09-16T16:48:26.437 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:48:26.437 INFO:tasks.workunit.client.0.smithi172.stdout:started read 2024-09-16T16:48:26.437 INFO:tasks.workunit.client.0.smithi172.stdout:read completion cb called! 2024-09-16T16:48:26.437 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 512 2024-09-16T16:48:26.437 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:48:26.437 INFO:tasks.workunit.client.0.smithi172.stdout:started read 2024-09-16T16:48:26.438 INFO:tasks.workunit.client.0.smithi172.stdout:read completion cb called! 2024-09-16T16:48:26.438 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 512 2024-09-16T16:48:26.438 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:48:26.438 INFO:tasks.workunit.client.0.smithi172.stdout:started read 2024-09-16T16:48:26.438 INFO:tasks.workunit.client.0.smithi172.stdout:read completion cb called! 2024-09-16T16:48:26.438 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 512 2024-09-16T16:48:26.438 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:48:26.438 INFO:tasks.workunit.client.0.smithi172.stdout:started read 2024-09-16T16:48:26.438 INFO:tasks.workunit.client.0.smithi172.stdout:read completion cb called! 2024-09-16T16:48:26.438 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 512 2024-09-16T16:48:26.438 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:48:26.438 INFO:tasks.workunit.client.0.smithi172.stdout:started read 2024-09-16T16:48:26.438 INFO:tasks.workunit.client.0.smithi172.stdout:read completion cb called! 2024-09-16T16:48:26.438 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 512 2024-09-16T16:48:26.439 INFO:tasks.workunit.client.0.smithi172.stdout:discard: 512~512 = 512 2024-09-16T16:48:26.439 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:48:26.439 INFO:tasks.workunit.client.0.smithi172.stdout:aio discard: 1536~512 = 0 2024-09-16T16:48:26.439 INFO:tasks.workunit.client.0.smithi172.stdout:read: 512 2024-09-16T16:48:26.439 INFO:tasks.workunit.client.0.smithi172.stdout:read: 512 2024-09-16T16:48:26.439 INFO:tasks.workunit.client.0.smithi172.stdout:read: 512 2024-09-16T16:48:26.439 INFO:tasks.workunit.client.0.smithi172.stdout:read: 512 2024-09-16T16:48:26.439 INFO:tasks.workunit.client.0.smithi172.stdout:read: 512 2024-09-16T16:48:26.439 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 0 2024-09-16T16:48:26.439 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:48:26.439 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:48:26.439 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 0 2024-09-16T16:48:26.439 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:48:26.439 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:48:26.440 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 16384 2024-09-16T16:48:26.440 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:48:26.440 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:48:26.440 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 16384 2024-09-16T16:48:26.440 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:48:26.440 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:48:26.440 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:48:26.440 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:48:26.440 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 49152 2024-09-16T16:48:26.440 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:48:26.440 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:48:26.440 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 49152 2024-09-16T16:48:26.440 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:48:26.440 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:48:26.441 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 65536 2024-09-16T16:48:26.441 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:48:26.441 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:48:26.441 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 65536 2024-09-16T16:48:26.441 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:48:26.441 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:48:26.441 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:48:26.441 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:48:26.441 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 98304 2024-09-16T16:48:26.441 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:48:26.441 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:48:26.441 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 98304 2024-09-16T16:48:26.441 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:48:26.441 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:48:26.441 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 114688 2024-09-16T16:48:26.442 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:48:26.442 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:48:26.442 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 114688 2024-09-16T16:48:26.442 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:48:26.442 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:48:26.442 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:48:26.442 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:48:26.442 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 147456 2024-09-16T16:48:26.442 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:48:26.442 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:48:26.442 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 147456 2024-09-16T16:48:26.442 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:48:26.442 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:48:26.442 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 163840 2024-09-16T16:48:26.443 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:48:26.443 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:48:26.443 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 163840 2024-09-16T16:48:26.443 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:48:26.443 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:48:26.443 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:48:26.443 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:48:26.443 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 196608 2024-09-16T16:48:26.443 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:48:26.443 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:48:26.443 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 196608 2024-09-16T16:48:26.443 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:48:26.443 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:48:26.443 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 212992 2024-09-16T16:48:26.444 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:48:26.444 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:48:26.444 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 212992 2024-09-16T16:48:26.444 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:48:26.444 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:48:26.444 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:48:26.444 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:48:26.444 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:48:26.444 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:48:26.444 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:48:26.444 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:48:26.444 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:48:26.444 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:48:26.444 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:48:26.445 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:48:26.445 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:48:26.445 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:48:26.445 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:48:26.445 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:48:26.445 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:48:26.445 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:48:26.445 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:48:26.445 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:48:26.445 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:48:26.445 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:48:26.445 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:48:26.445 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:48:26.445 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:48:26.445 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:48:26.445 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:48:26.446 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:48:26.446 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:48:26.446 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:48:26.446 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:48:26.446 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:48:26.446 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:48:26.446 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:48:26.446 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:48:26.446 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:48:26.446 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:48:26.446 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:48:26.446 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:48:26.446 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:48:26.446 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:48:26.447 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:48:26.447 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:48:26.447 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:48:26.447 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:48:26.447 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:48:26.447 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:48:26.447 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:48:26.447 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:48:26.447 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:48:26.447 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:48:26.447 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:48:26.447 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:48:55.339 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:48:55.339 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:48:55.339 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:48:55.339 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:48:55.339 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:48:55.339 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:48:55.339 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:48:55.339 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:48:55.339 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:48:55.340 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:48:55.340 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:48:55.340 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:48:55.340 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:48:55.340 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:48:55.340 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:48:55.340 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:48:55.340 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:48:55.340 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:48:55.340 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:48:55.340 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:48:55.340 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:48:55.340 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:48:55.340 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:48:55.341 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:48:55.341 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:48:55.341 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:48:55.341 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:48:55.341 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:48:55.341 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:48:55.341 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:48:55.341 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:48:55.341 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:48:55.341 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:48:55.341 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:48:55.341 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:48:55.341 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:48:55.341 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:48:55.341 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:48:55.342 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:48:55.342 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:48:55.342 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:48:55.342 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:48:55.342 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:48:55.342 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:48:55.342 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:48:55.342 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:48:55.342 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:48:55.342 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:48:55.342 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:48:55.342 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:48:55.342 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:48:55.342 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:48:55.342 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:48:55.343 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:48:55.343 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:48:55.343 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:48:55.343 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:48:55.343 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:48:55.343 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:48:55.343 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:48:55.343 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:48:55.343 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:48:55.343 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:48:55.343 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:48:55.343 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:48:55.343 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:48:55.343 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:48:55.343 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:48:55.344 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:48:55.344 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:48:55.344 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:48:55.344 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:48:55.344 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:48:55.344 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:48:55.344 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:48:55.344 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:48:55.344 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:48:55.344 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:48:55.344 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:48:55.344 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:48:55.344 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:48:55.344 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:48:55.344 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:48:55.345 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:48:55.345 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:48:55.345 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:48:55.345 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:48:55.345 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:48:55.345 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:48:55.345 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:48:55.345 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:48:55.345 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:48:55.345 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:48:55.345 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:48:55.345 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:48:55.345 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:48:55.345 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:48:55.346 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:48:55.346 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:48:55.346 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:48:55.346 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:48:55.346 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:48:55.346 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:48:55.346 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:48:55.346 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:48:55.346 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:48:55.346 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:48:55.346 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:48:55.346 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:48:55.346 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:48:55.346 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:48:55.346 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:48:55.346 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:48:55.347 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:48:55.347 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:48:55.347 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:48:55.347 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:48:55.347 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:48:55.347 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:48:55.347 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:48:55.347 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:48:55.347 INFO:tasks.workunit.client.0.smithi172.stdout:read completion cb called! 2024-09-16T16:48:55.347 INFO:tasks.workunit.client.0.smithi172.stdout:read completion cb called! 2024-09-16T16:48:55.347 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 512 2024-09-16T16:48:55.347 INFO:tasks.workunit.client.0.smithi172.stdout:read completion cb called! 2024-09-16T16:48:55.347 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 4 2024-09-16T16:48:55.347 INFO:tasks.workunit.client.0.smithi172.stdout:read: 4 2024-09-16T16:48:55.348 INFO:tasks.workunit.client.0.smithi172.stdout:read: 4 2024-09-16T16:48:55.348 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.TestEncryptionLUKS1 (60867 ms) 2024-09-16T16:48:55.348 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.TestEncryptionLUKS2 2024-09-16T16:48:55.348 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:49:31.274 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 512 2024-09-16T16:49:31.275 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 512 2024-09-16T16:49:31.275 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 512 2024-09-16T16:49:31.275 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 512 2024-09-16T16:49:31.275 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 512 2024-09-16T16:49:31.275 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:49:31.275 INFO:tasks.workunit.client.0.smithi172.stdout:started write 2024-09-16T16:49:31.275 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:49:31.275 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:49:31.275 INFO:tasks.workunit.client.0.smithi172.stdout:finished write 2024-09-16T16:49:31.275 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:49:31.275 INFO:tasks.workunit.client.0.smithi172.stdout:started write 2024-09-16T16:49:31.275 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:49:31.276 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:49:31.276 INFO:tasks.workunit.client.0.smithi172.stdout:finished write 2024-09-16T16:49:31.276 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:49:31.276 INFO:tasks.workunit.client.0.smithi172.stdout:started write 2024-09-16T16:49:31.276 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:49:31.276 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:49:31.276 INFO:tasks.workunit.client.0.smithi172.stdout:finished write 2024-09-16T16:49:31.276 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:49:31.276 INFO:tasks.workunit.client.0.smithi172.stdout:started write 2024-09-16T16:49:31.276 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:49:31.276 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:49:31.276 INFO:tasks.workunit.client.0.smithi172.stdout:finished write 2024-09-16T16:49:31.276 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:49:31.276 INFO:tasks.workunit.client.0.smithi172.stdout:started write 2024-09-16T16:49:31.277 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:49:31.277 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:49:31.277 INFO:tasks.workunit.client.0.smithi172.stdout:finished write 2024-09-16T16:49:31.277 INFO:tasks.workunit.client.0.smithi172.stdout:start compare and write 2024-09-16T16:49:31.277 INFO:tasks.workunit.client.0.smithi172.stdout:compare and wrote: 512 2024-09-16T16:49:31.277 INFO:tasks.workunit.client.0.smithi172.stdout:start compare and write 2024-09-16T16:49:31.277 INFO:tasks.workunit.client.0.smithi172.stdout:compare and wrote: 512 2024-09-16T16:49:31.277 INFO:tasks.workunit.client.0.smithi172.stdout:start compare and write 2024-09-16T16:49:31.277 INFO:tasks.workunit.client.0.smithi172.stdout:compare and wrote: 512 2024-09-16T16:49:31.277 INFO:tasks.workunit.client.0.smithi172.stdout:start compare and write 2024-09-16T16:49:31.277 INFO:tasks.workunit.client.0.smithi172.stdout:compare and wrote: 512 2024-09-16T16:49:31.277 INFO:tasks.workunit.client.0.smithi172.stdout:start compare and write 2024-09-16T16:49:31.277 INFO:tasks.workunit.client.0.smithi172.stdout:compare and wrote: 512 2024-09-16T16:49:31.277 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:49:31.278 INFO:tasks.workunit.client.0.smithi172.stdout:started aio compare and write 2024-09-16T16:49:31.278 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:49:31.278 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:49:31.278 INFO:tasks.workunit.client.0.smithi172.stdout:finished aio compare and write 2024-09-16T16:49:31.278 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:49:31.278 INFO:tasks.workunit.client.0.smithi172.stdout:started aio compare and write 2024-09-16T16:49:31.278 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:49:31.278 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:49:31.278 INFO:tasks.workunit.client.0.smithi172.stdout:finished aio compare and write 2024-09-16T16:49:31.278 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:49:31.278 INFO:tasks.workunit.client.0.smithi172.stdout:started aio compare and write 2024-09-16T16:49:31.278 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:49:31.278 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:49:31.279 INFO:tasks.workunit.client.0.smithi172.stdout:finished aio compare and write 2024-09-16T16:49:31.279 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:49:31.279 INFO:tasks.workunit.client.0.smithi172.stdout:started aio compare and write 2024-09-16T16:49:31.279 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:49:31.279 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:49:31.279 INFO:tasks.workunit.client.0.smithi172.stdout:finished aio compare and write 2024-09-16T16:49:31.279 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:49:31.279 INFO:tasks.workunit.client.0.smithi172.stdout:started aio compare and write 2024-09-16T16:49:31.279 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:49:31.279 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:49:31.279 INFO:tasks.workunit.client.0.smithi172.stdout:finished aio compare and write 2024-09-16T16:49:31.279 INFO:tasks.workunit.client.0.smithi172.stdout:read: 512 2024-09-16T16:49:31.279 INFO:tasks.workunit.client.0.smithi172.stdout:read: 512 2024-09-16T16:49:31.279 INFO:tasks.workunit.client.0.smithi172.stdout:read: 512 2024-09-16T16:49:31.280 INFO:tasks.workunit.client.0.smithi172.stdout:read: 512 2024-09-16T16:49:31.280 INFO:tasks.workunit.client.0.smithi172.stdout:read: 512 2024-09-16T16:49:31.280 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:49:31.280 INFO:tasks.workunit.client.0.smithi172.stdout:started read 2024-09-16T16:49:31.280 INFO:tasks.workunit.client.0.smithi172.stdout:read completion cb called! 2024-09-16T16:49:31.280 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 512 2024-09-16T16:49:31.280 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:49:31.280 INFO:tasks.workunit.client.0.smithi172.stdout:started read 2024-09-16T16:49:31.280 INFO:tasks.workunit.client.0.smithi172.stdout:read completion cb called! 2024-09-16T16:49:31.280 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 512 2024-09-16T16:49:31.280 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:49:31.280 INFO:tasks.workunit.client.0.smithi172.stdout:started read 2024-09-16T16:49:31.280 INFO:tasks.workunit.client.0.smithi172.stdout:read completion cb called! 2024-09-16T16:49:31.280 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 512 2024-09-16T16:49:31.281 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:49:31.281 INFO:tasks.workunit.client.0.smithi172.stdout:started read 2024-09-16T16:49:31.281 INFO:tasks.workunit.client.0.smithi172.stdout:read completion cb called! 2024-09-16T16:49:31.281 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 512 2024-09-16T16:49:31.281 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:49:31.281 INFO:tasks.workunit.client.0.smithi172.stdout:started read 2024-09-16T16:49:31.281 INFO:tasks.workunit.client.0.smithi172.stdout:read completion cb called! 2024-09-16T16:49:31.281 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 512 2024-09-16T16:49:31.281 INFO:tasks.workunit.client.0.smithi172.stdout:discard: 512~512 = 512 2024-09-16T16:49:31.281 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:49:31.281 INFO:tasks.workunit.client.0.smithi172.stdout:aio discard: 1536~512 = 0 2024-09-16T16:49:31.281 INFO:tasks.workunit.client.0.smithi172.stdout:read: 512 2024-09-16T16:49:31.282 INFO:tasks.workunit.client.0.smithi172.stdout:read: 512 2024-09-16T16:49:31.282 INFO:tasks.workunit.client.0.smithi172.stdout:read: 512 2024-09-16T16:49:31.282 INFO:tasks.workunit.client.0.smithi172.stdout:read: 512 2024-09-16T16:49:31.282 INFO:tasks.workunit.client.0.smithi172.stdout:read: 512 2024-09-16T16:49:31.282 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 0 2024-09-16T16:49:31.282 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:49:31.282 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:49:31.282 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 0 2024-09-16T16:49:31.282 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:49:31.282 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:49:31.282 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 16384 2024-09-16T16:49:31.282 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:49:31.282 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:49:31.282 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 16384 2024-09-16T16:49:31.282 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:49:31.283 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:49:31.283 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:49:31.283 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:49:31.283 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 49152 2024-09-16T16:49:31.283 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:49:31.283 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:49:31.283 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 49152 2024-09-16T16:49:31.283 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:49:31.283 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:49:31.283 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 65536 2024-09-16T16:49:31.283 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:49:31.283 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:49:31.283 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 65536 2024-09-16T16:49:31.283 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:49:31.284 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:49:31.284 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:49:31.284 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:49:31.284 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 98304 2024-09-16T16:49:31.284 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:49:31.284 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:49:31.284 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 98304 2024-09-16T16:49:31.284 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:49:31.284 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:49:31.284 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 114688 2024-09-16T16:49:31.284 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:49:31.284 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:49:31.285 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 114688 2024-09-16T16:49:31.285 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:49:31.285 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:49:31.285 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:49:31.285 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:49:31.285 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 147456 2024-09-16T16:49:31.285 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:49:31.285 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:49:31.285 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 147456 2024-09-16T16:49:31.285 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:49:31.285 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:49:31.285 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 163840 2024-09-16T16:49:31.285 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:49:31.286 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:49:31.286 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 163840 2024-09-16T16:49:31.286 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:49:31.286 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:49:31.286 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:49:31.286 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:49:31.286 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 196608 2024-09-16T16:49:31.286 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:49:31.286 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:49:31.286 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 196608 2024-09-16T16:49:31.286 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:49:31.286 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:49:31.286 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 212992 2024-09-16T16:49:31.286 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:49:31.287 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:49:31.287 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 212992 2024-09-16T16:49:31.287 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:49:31.287 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:49:31.287 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:49:31.287 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:49:31.287 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:49:31.287 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:49:31.287 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:49:31.287 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:49:31.287 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:49:31.287 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:49:31.287 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:49:31.288 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:49:31.288 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:49:31.288 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:49:31.288 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:49:31.288 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:49:31.288 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:49:31.288 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:49:31.288 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:49:31.288 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:49:31.288 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:49:31.288 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:49:31.288 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:49:31.288 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:49:31.289 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:49:31.289 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:49:31.289 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:49:31.289 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:49:31.289 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:49:31.289 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:49:31.289 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:49:31.289 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:49:31.289 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:49:31.289 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:49:31.289 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:49:31.289 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:49:31.289 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:49:31.289 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:49:31.290 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:49:31.290 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:49:31.290 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:49:31.290 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:49:31.290 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:49:31.290 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:49:31.290 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:49:31.290 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:49:31.290 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:49:31.290 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:49:31.290 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:49:31.290 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:49:31.290 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:49:31.290 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:49:31.290 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:50:00.582 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:50:00.582 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:50:00.582 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:50:00.582 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:50:00.582 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:50:00.582 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:50:00.582 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:50:00.582 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:50:00.582 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:50:00.583 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:50:00.583 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:50:00.583 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:50:00.583 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:50:00.583 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:50:00.583 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:50:00.583 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:50:00.583 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:50:00.583 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:50:00.583 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:50:00.583 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:50:00.583 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:50:00.583 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:50:00.583 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:50:00.583 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:50:00.584 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:50:00.584 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:50:00.584 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:50:00.584 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:50:00.584 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:50:00.584 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:50:00.584 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:50:00.584 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:50:00.584 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:50:00.584 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:50:00.584 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:50:00.584 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:50:00.584 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:50:00.584 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:50:00.584 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:50:00.585 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:50:00.585 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:50:00.585 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:50:00.585 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:50:00.585 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:50:00.585 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:50:00.585 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:50:00.585 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:50:00.585 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:50:00.585 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:50:00.585 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:50:00.585 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:50:00.585 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:50:00.585 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:50:00.585 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:50:00.586 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:50:00.586 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:50:00.586 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:50:00.586 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:50:00.586 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:50:00.586 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:50:00.586 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:50:00.586 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:50:00.586 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:50:00.586 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:50:00.586 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:50:00.586 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:50:00.586 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:50:00.586 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:50:00.586 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:50:00.587 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:50:00.587 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:50:00.587 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:50:00.587 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:50:00.587 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:50:00.587 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:50:00.587 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:50:00.587 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:50:00.587 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:50:00.587 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:50:00.587 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:50:00.587 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:50:00.587 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:50:00.587 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:50:00.588 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:50:00.588 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:50:00.588 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:50:00.588 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:50:00.588 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:50:00.588 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:50:00.588 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:50:00.588 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:50:00.588 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:50:00.588 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:50:00.588 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:50:00.588 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:50:00.588 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:50:00.589 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:50:00.589 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:50:00.589 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:50:00.589 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:50:00.589 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:50:00.589 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:50:00.589 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:50:00.589 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:50:00.589 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:50:00.589 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:50:00.589 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:50:00.589 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:50:00.589 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:50:00.589 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:50:00.589 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:50:00.590 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:50:00.590 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:50:00.590 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:50:00.590 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:50:00.590 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:50:00.590 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:50:00.590 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:50:00.590 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:50:00.590 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:50:00.590 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:50:00.590 INFO:tasks.workunit.client.0.smithi172.stdout:read completion cb called! 2024-09-16T16:50:00.590 INFO:tasks.workunit.client.0.smithi172.stdout:read completion cb called! 2024-09-16T16:50:00.590 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 512 2024-09-16T16:50:00.590 INFO:tasks.workunit.client.0.smithi172.stdout:read completion cb called! 2024-09-16T16:50:00.591 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 4 2024-09-16T16:50:00.591 INFO:tasks.workunit.client.0.smithi172.stdout:read: 4 2024-09-16T16:50:00.591 INFO:tasks.workunit.client.0.smithi172.stdout:read: 4 2024-09-16T16:50:00.591 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.TestEncryptionLUKS2 (65242 ms) 2024-09-16T16:50:00.591 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.TestCloneEncryption 2024-09-16T16:50:00.591 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:2471: Skipped 2024-09-16T16:50:00.591 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:50:00.591 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.TestCloneEncryption (0 ms) 2024-09-16T16:50:00.591 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.LUKS1UnderLUKS2WithoutResize 2024-09-16T16:50:00.591 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:2659: Skipped 2024-09-16T16:50:00.591 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:50:00.591 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.LUKS1UnderLUKS2WithoutResize (0 ms) 2024-09-16T16:50:00.591 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.LUKS2UnderLUKS1WithoutResize 2024-09-16T16:50:00.591 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:2735: Skipped 2024-09-16T16:50:00.591 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:50:00.592 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.LUKS2UnderLUKS1WithoutResize (0 ms) 2024-09-16T16:50:00.592 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.EncryptionFormatNoData 2024-09-16T16:50:00.592 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:50:05.023 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.EncryptionFormatNoData (4442 ms) 2024-09-16T16:50:05.023 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.EncryptionLoadBadSize 2024-09-16T16:50:05.023 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:50:10.901 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.EncryptionLoadBadSize (5878 ms) 2024-09-16T16:50:10.901 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.EncryptionLoadBadStripePattern 2024-09-16T16:50:10.901 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:2905: Skipped 2024-09-16T16:50:10.902 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:50:10.902 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.EncryptionLoadBadStripePattern (0 ms) 2024-09-16T16:50:10.902 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.EncryptionLoadFormatMismatch 2024-09-16T16:50:10.902 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:2985: Skipped 2024-09-16T16:50:10.902 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:50:10.902 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.EncryptionLoadFormatMismatch (0 ms) 2024-09-16T16:50:10.902 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.EncryptedResize 2024-09-16T16:50:10.902 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:50:24.052 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.EncryptedResize (13151 ms) 2024-09-16T16:50:24.052 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.EncryptedFlattenSmallData 2024-09-16T16:50:24.052 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3202: Skipped 2024-09-16T16:50:24.052 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:50:24.052 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.EncryptedFlattenSmallData (0 ms) 2024-09-16T16:50:24.052 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.TestIOWithIOHint 2024-09-16T16:50:24.052 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:50:51.099 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 512 2024-09-16T16:50:51.099 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 512 2024-09-16T16:50:51.100 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 512 2024-09-16T16:50:51.100 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 512 2024-09-16T16:50:51.100 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 512 2024-09-16T16:50:51.100 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:50:51.100 INFO:tasks.workunit.client.0.smithi172.stdout:started write 2024-09-16T16:50:51.100 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:50:51.100 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:50:51.100 INFO:tasks.workunit.client.0.smithi172.stdout:finished write 2024-09-16T16:50:51.100 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:50:51.100 INFO:tasks.workunit.client.0.smithi172.stdout:started write 2024-09-16T16:50:51.100 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:50:51.100 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:50:51.100 INFO:tasks.workunit.client.0.smithi172.stdout:finished write 2024-09-16T16:50:51.101 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:50:51.101 INFO:tasks.workunit.client.0.smithi172.stdout:started write 2024-09-16T16:50:51.101 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:50:51.101 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:50:51.101 INFO:tasks.workunit.client.0.smithi172.stdout:finished write 2024-09-16T16:50:51.101 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:50:51.101 INFO:tasks.workunit.client.0.smithi172.stdout:started write 2024-09-16T16:50:51.101 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:50:51.101 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:50:51.101 INFO:tasks.workunit.client.0.smithi172.stdout:finished write 2024-09-16T16:50:51.101 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:50:51.101 INFO:tasks.workunit.client.0.smithi172.stdout:started write 2024-09-16T16:50:51.101 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:50:51.101 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:50:51.102 INFO:tasks.workunit.client.0.smithi172.stdout:finished write 2024-09-16T16:50:51.102 INFO:tasks.workunit.client.0.smithi172.stdout:start compare and write 2024-09-16T16:50:51.102 INFO:tasks.workunit.client.0.smithi172.stdout:compare and wrote: 512 2024-09-16T16:50:51.102 INFO:tasks.workunit.client.0.smithi172.stdout:start compare and write 2024-09-16T16:50:51.102 INFO:tasks.workunit.client.0.smithi172.stdout:compare and wrote: 512 2024-09-16T16:50:51.102 INFO:tasks.workunit.client.0.smithi172.stdout:start compare and write 2024-09-16T16:50:51.102 INFO:tasks.workunit.client.0.smithi172.stdout:compare and wrote: 512 2024-09-16T16:50:51.102 INFO:tasks.workunit.client.0.smithi172.stdout:start compare and write 2024-09-16T16:50:51.102 INFO:tasks.workunit.client.0.smithi172.stdout:compare and wrote: 512 2024-09-16T16:50:51.102 INFO:tasks.workunit.client.0.smithi172.stdout:start compare and write 2024-09-16T16:50:51.102 INFO:tasks.workunit.client.0.smithi172.stdout:compare and wrote: 512 2024-09-16T16:50:51.102 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:50:51.102 INFO:tasks.workunit.client.0.smithi172.stdout:started aio compare and write 2024-09-16T16:50:51.103 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:50:51.103 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:50:51.103 INFO:tasks.workunit.client.0.smithi172.stdout:finished aio compare and write 2024-09-16T16:50:51.103 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:50:51.103 INFO:tasks.workunit.client.0.smithi172.stdout:started aio compare and write 2024-09-16T16:50:51.103 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:50:51.103 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:50:51.103 INFO:tasks.workunit.client.0.smithi172.stdout:finished aio compare and write 2024-09-16T16:50:51.103 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:50:51.103 INFO:tasks.workunit.client.0.smithi172.stdout:started aio compare and write 2024-09-16T16:50:51.103 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:50:51.103 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:50:51.103 INFO:tasks.workunit.client.0.smithi172.stdout:finished aio compare and write 2024-09-16T16:50:51.103 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:50:51.104 INFO:tasks.workunit.client.0.smithi172.stdout:started aio compare and write 2024-09-16T16:50:51.104 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:50:51.104 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:50:51.104 INFO:tasks.workunit.client.0.smithi172.stdout:finished aio compare and write 2024-09-16T16:50:51.104 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:50:51.104 INFO:tasks.workunit.client.0.smithi172.stdout:started aio compare and write 2024-09-16T16:50:51.104 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:50:51.104 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:50:51.104 INFO:tasks.workunit.client.0.smithi172.stdout:finished aio compare and write 2024-09-16T16:50:51.104 INFO:tasks.workunit.client.0.smithi172.stdout:read: 512 2024-09-16T16:50:51.104 INFO:tasks.workunit.client.0.smithi172.stdout:read: 512 2024-09-16T16:50:51.104 INFO:tasks.workunit.client.0.smithi172.stdout:read: 512 2024-09-16T16:50:51.104 INFO:tasks.workunit.client.0.smithi172.stdout:read: 512 2024-09-16T16:50:51.104 INFO:tasks.workunit.client.0.smithi172.stdout:read: 512 2024-09-16T16:50:51.104 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:50:51.105 INFO:tasks.workunit.client.0.smithi172.stdout:started read 2024-09-16T16:50:51.105 INFO:tasks.workunit.client.0.smithi172.stdout:read completion cb called! 2024-09-16T16:50:51.105 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 512 2024-09-16T16:50:51.105 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:50:51.105 INFO:tasks.workunit.client.0.smithi172.stdout:started read 2024-09-16T16:50:51.105 INFO:tasks.workunit.client.0.smithi172.stdout:read completion cb called! 2024-09-16T16:50:51.105 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 512 2024-09-16T16:50:51.105 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:50:51.105 INFO:tasks.workunit.client.0.smithi172.stdout:started read 2024-09-16T16:50:51.105 INFO:tasks.workunit.client.0.smithi172.stdout:read completion cb called! 2024-09-16T16:50:51.105 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 512 2024-09-16T16:50:51.105 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:50:51.105 INFO:tasks.workunit.client.0.smithi172.stdout:started read 2024-09-16T16:50:51.106 INFO:tasks.workunit.client.0.smithi172.stdout:read completion cb called! 2024-09-16T16:50:51.106 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 512 2024-09-16T16:50:51.106 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:50:51.106 INFO:tasks.workunit.client.0.smithi172.stdout:started read 2024-09-16T16:50:51.106 INFO:tasks.workunit.client.0.smithi172.stdout:read completion cb called! 2024-09-16T16:50:51.106 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 512 2024-09-16T16:50:51.106 INFO:tasks.workunit.client.0.smithi172.stdout:discard: 512~512 = 512 2024-09-16T16:50:51.106 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:50:51.106 INFO:tasks.workunit.client.0.smithi172.stdout:aio discard: 1536~512 = 0 2024-09-16T16:50:51.106 INFO:tasks.workunit.client.0.smithi172.stdout:read: 512 2024-09-16T16:50:51.106 INFO:tasks.workunit.client.0.smithi172.stdout:read: 512 2024-09-16T16:50:51.106 INFO:tasks.workunit.client.0.smithi172.stdout:read: 512 2024-09-16T16:50:51.107 INFO:tasks.workunit.client.0.smithi172.stdout:read: 512 2024-09-16T16:50:51.107 INFO:tasks.workunit.client.0.smithi172.stdout:read: 512 2024-09-16T16:50:51.107 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 0 2024-09-16T16:50:51.107 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:50:51.107 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:50:51.107 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 0 2024-09-16T16:50:51.107 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:50:51.107 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:50:51.107 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 16384 2024-09-16T16:50:51.107 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:50:51.107 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:50:51.107 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 16384 2024-09-16T16:50:51.107 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:50:51.107 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:50:51.108 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:50:51.108 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:50:51.108 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 49152 2024-09-16T16:50:51.108 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:50:51.108 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:50:51.108 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 49152 2024-09-16T16:50:51.108 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:50:51.108 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:50:51.108 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 65536 2024-09-16T16:50:51.108 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:50:51.108 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:50:51.108 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 65536 2024-09-16T16:50:51.108 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:50:51.108 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:50:51.109 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:50:51.109 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:50:51.109 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 98304 2024-09-16T16:50:51.109 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:50:51.109 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:50:51.109 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 98304 2024-09-16T16:50:51.109 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:50:51.109 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:50:51.109 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 114688 2024-09-16T16:50:51.109 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:50:51.109 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:50:51.109 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 114688 2024-09-16T16:50:51.110 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:50:51.110 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:50:51.110 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:50:51.110 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:50:51.110 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 147456 2024-09-16T16:50:51.110 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:50:51.110 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:50:51.110 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 147456 2024-09-16T16:50:51.110 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:50:51.110 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:50:51.110 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 163840 2024-09-16T16:50:51.110 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:50:51.110 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:50:51.110 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 163840 2024-09-16T16:50:51.110 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:50:51.111 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:50:51.111 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:50:51.111 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:50:51.111 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 196608 2024-09-16T16:50:51.111 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:50:51.111 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:50:51.111 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 196608 2024-09-16T16:50:51.111 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:50:51.111 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:50:51.111 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 212992 2024-09-16T16:50:51.111 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:50:51.111 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:50:51.111 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 212992 2024-09-16T16:50:51.111 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:50:51.111 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:50:51.111 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:50:51.112 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:50:51.112 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:50:51.112 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:50:51.112 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:50:51.112 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:50:51.112 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:50:51.112 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:50:51.112 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:50:51.112 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:50:51.112 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:50:51.112 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:50:51.112 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:50:51.112 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:50:51.112 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:50:51.112 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:50:51.112 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:50:51.113 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:50:51.113 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:50:51.113 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:50:51.113 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:50:51.113 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:50:51.113 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:50:51.113 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:50:51.113 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:50:51.113 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:50:51.113 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:50:51.113 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:50:51.113 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:50:51.113 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:50:51.113 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:50:51.114 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:50:51.114 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:50:51.114 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:50:51.114 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:50:51.114 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:50:51.114 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:50:51.114 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:50:51.114 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:50:51.114 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:50:51.114 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:50:51.114 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:50:51.114 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:50:51.114 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:50:51.114 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:50:51.114 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:50:51.115 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:50:51.115 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:50:51.115 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:50:51.115 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:50:51.115 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:14.519 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:51:14.519 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:51:14.519 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:51:14.519 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:51:14.519 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:51:14.519 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:51:14.520 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:14.520 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:51:14.520 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:51:14.520 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:51:14.520 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:51:14.520 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:51:14.520 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:51:14.520 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:14.520 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:51:14.520 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:51:14.520 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:14.520 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:51:14.520 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:51:14.520 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:14.520 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:51:14.521 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:51:14.521 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:51:14.521 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:51:14.521 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:51:14.521 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:51:14.521 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:14.521 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:51:14.521 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:51:14.521 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:51:14.521 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:51:14.521 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:51:14.521 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:51:14.521 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:14.521 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:51:14.521 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:51:14.522 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:51:14.522 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:51:14.522 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:51:14.522 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:51:14.522 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:14.522 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:51:14.522 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:51:14.522 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:51:14.522 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:51:14.522 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:51:14.522 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:51:14.522 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:14.522 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:51:14.522 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:51:14.523 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:14.523 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:51:14.523 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:51:14.523 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:14.523 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:51:14.523 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:51:14.523 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:51:14.523 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:51:14.523 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:51:14.523 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:51:14.523 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:14.523 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:51:14.523 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:51:14.523 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:51:14.523 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:51:14.523 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:51:14.524 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:51:14.524 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:14.524 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:51:14.524 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:51:14.524 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:51:14.524 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:51:14.524 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:51:14.524 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:51:14.524 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:14.524 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:51:14.524 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:51:14.524 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:51:14.524 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:51:14.524 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:51:14.525 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:51:14.525 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:14.525 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:51:14.525 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:51:14.525 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:14.525 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:51:14.525 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:51:14.525 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:14.525 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:51:14.525 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:51:14.525 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:51:14.525 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:51:14.525 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:51:14.525 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:51:14.525 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:14.525 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:51:14.526 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:51:14.526 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:51:14.526 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:51:14.526 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:51:14.526 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:51:14.526 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:14.526 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:51:14.526 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:51:14.526 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:51:14.526 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:51:14.526 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:51:14.526 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:51:14.526 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:14.526 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:51:14.526 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:51:14.527 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:51:14.527 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:51:14.527 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:51:14.527 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:51:14.527 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:14.527 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:51:14.527 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:51:14.527 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:14.527 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:51:14.527 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:51:14.527 INFO:tasks.workunit.client.0.smithi172.stdout:read completion cb called! 2024-09-16T16:51:14.527 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 512 2024-09-16T16:51:14.527 INFO:tasks.workunit.client.0.smithi172.stdout:read completion cb called! 2024-09-16T16:51:14.527 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.TestIOWithIOHint (50466 ms) 2024-09-16T16:51:14.528 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.TestDataPoolIO 2024-09-16T16:51:14.528 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3947: Skipped 2024-09-16T16:51:14.528 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:51:14.528 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.TestDataPoolIO (0 ms) 2024-09-16T16:51:14.528 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteMismatch 2024-09-16T16:51:14.528 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:51:14.645 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.TestCompareAndWriteMismatch (126 ms) 2024-09-16T16:51:14.645 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteMismatch 2024-09-16T16:51:14.645 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:51:14.777 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteMismatch (132 ms) 2024-09-16T16:51:14.777 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteSuccess 2024-09-16T16:51:14.777 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:51:14.905 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.TestCompareAndWriteSuccess (128 ms) 2024-09-16T16:51:14.905 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteSuccess 2024-09-16T16:51:14.905 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:51:15.042 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteSuccess (137 ms) 2024-09-16T16:51:15.042 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteStripeUnitUnaligned 2024-09-16T16:51:15.043 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:51:15.266 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.TestCompareAndWriteStripeUnitUnaligned (224 ms) 2024-09-16T16:51:15.266 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteStripeUnitUnaligned 2024-09-16T16:51:15.266 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:51:15.475 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteStripeUnitUnaligned (210 ms) 2024-09-16T16:51:15.476 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteTooLarge 2024-09-16T16:51:15.476 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:51:15.702 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.TestCompareAndWriteTooLarge (226 ms) 2024-09-16T16:51:15.702 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteTooLarge 2024-09-16T16:51:15.702 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:51:15.902 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteTooLarge (200 ms) 2024-09-16T16:51:15.902 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteStripeUnitSuccess 2024-09-16T16:51:15.902 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:51:18.320 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.TestCompareAndWriteStripeUnitSuccess (2418 ms) 2024-09-16T16:51:18.320 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteStripeUnitSuccess 2024-09-16T16:51:18.321 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:51:20.563 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteStripeUnitSuccess (2244 ms) 2024-09-16T16:51:20.564 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteVIovecLenDiffers 2024-09-16T16:51:20.564 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:51:20.680 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteVIovecLenDiffers (116 ms) 2024-09-16T16:51:20.680 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteVMismatch 2024-09-16T16:51:20.680 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:51:20.853 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteVMismatch (173 ms) 2024-09-16T16:51:20.853 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteVSuccess 2024-09-16T16:51:20.853 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:51:20.990 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteVSuccess (137 ms) 2024-09-16T16:51:20.990 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.TestScatterGatherIO 2024-09-16T16:51:20.990 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:51:21.129 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.TestScatterGatherIO (140 ms) 2024-09-16T16:51:21.130 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.TestEmptyDiscard 2024-09-16T16:51:21.130 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:51:21.237 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:51:21.237 INFO:tasks.workunit.client.0.smithi172.stdout:aio discard: 0~1048576 = 0 2024-09-16T16:51:21.237 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:51:21.237 INFO:tasks.workunit.client.0.smithi172.stdout:aio discard: 0~4194304 = 0 2024-09-16T16:51:21.237 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:51:21.237 INFO:tasks.workunit.client.0.smithi172.stdout:aio discard: 3145728~1048576 = 0 2024-09-16T16:51:21.237 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.TestEmptyDiscard (107 ms) 2024-09-16T16:51:21.237 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.TestFUA 2024-09-16T16:51:21.237 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:51:21.674 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 512 2024-09-16T16:51:21.674 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 512 2024-09-16T16:51:21.674 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 512 2024-09-16T16:51:21.674 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 512 2024-09-16T16:51:21.674 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 512 2024-09-16T16:51:21.675 INFO:tasks.workunit.client.0.smithi172.stdout:read: 512 2024-09-16T16:51:21.675 INFO:tasks.workunit.client.0.smithi172.stdout:read: 512 2024-09-16T16:51:21.675 INFO:tasks.workunit.client.0.smithi172.stdout:read: 512 2024-09-16T16:51:21.675 INFO:tasks.workunit.client.0.smithi172.stdout:read: 512 2024-09-16T16:51:21.675 INFO:tasks.workunit.client.0.smithi172.stdout:read: 512 2024-09-16T16:51:21.675 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:21.675 INFO:tasks.workunit.client.0.smithi172.stdout:started write 2024-09-16T16:51:21.675 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:51:21.675 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:51:21.675 INFO:tasks.workunit.client.0.smithi172.stdout:finished write 2024-09-16T16:51:21.675 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:21.675 INFO:tasks.workunit.client.0.smithi172.stdout:started write 2024-09-16T16:51:21.675 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:51:21.675 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:51:21.676 INFO:tasks.workunit.client.0.smithi172.stdout:finished write 2024-09-16T16:51:21.676 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:21.676 INFO:tasks.workunit.client.0.smithi172.stdout:started write 2024-09-16T16:51:21.676 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:51:21.676 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:51:21.676 INFO:tasks.workunit.client.0.smithi172.stdout:finished write 2024-09-16T16:51:21.676 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:21.676 INFO:tasks.workunit.client.0.smithi172.stdout:started write 2024-09-16T16:51:21.676 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:51:21.676 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:51:21.676 INFO:tasks.workunit.client.0.smithi172.stdout:finished write 2024-09-16T16:51:21.676 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:21.676 INFO:tasks.workunit.client.0.smithi172.stdout:started write 2024-09-16T16:51:21.677 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:51:21.677 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:51:21.677 INFO:tasks.workunit.client.0.smithi172.stdout:finished write 2024-09-16T16:51:21.677 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:21.677 INFO:tasks.workunit.client.0.smithi172.stdout:started read 2024-09-16T16:51:21.677 INFO:tasks.workunit.client.0.smithi172.stdout:read completion cb called! 2024-09-16T16:51:21.677 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 512 2024-09-16T16:51:21.677 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:21.677 INFO:tasks.workunit.client.0.smithi172.stdout:started read 2024-09-16T16:51:21.677 INFO:tasks.workunit.client.0.smithi172.stdout:read completion cb called! 2024-09-16T16:51:21.677 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 512 2024-09-16T16:51:21.677 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:21.677 INFO:tasks.workunit.client.0.smithi172.stdout:started read 2024-09-16T16:51:21.678 INFO:tasks.workunit.client.0.smithi172.stdout:read completion cb called! 2024-09-16T16:51:21.678 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 512 2024-09-16T16:51:21.678 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:21.678 INFO:tasks.workunit.client.0.smithi172.stdout:started read 2024-09-16T16:51:21.678 INFO:tasks.workunit.client.0.smithi172.stdout:read completion cb called! 2024-09-16T16:51:21.678 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 512 2024-09-16T16:51:21.678 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:21.678 INFO:tasks.workunit.client.0.smithi172.stdout:started read 2024-09-16T16:51:21.678 INFO:tasks.workunit.client.0.smithi172.stdout:read completion cb called! 2024-09-16T16:51:21.679 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 512 2024-09-16T16:51:21.679 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.TestFUA (437 ms) 2024-09-16T16:51:21.679 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.TestIOPP 2024-09-16T16:51:21.679 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:51:21.786 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 512 2024-09-16T16:51:21.786 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 512 2024-09-16T16:51:21.786 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 512 2024-09-16T16:51:21.786 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 512 2024-09-16T16:51:21.786 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 512 2024-09-16T16:51:21.786 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:21.786 INFO:tasks.workunit.client.0.smithi172.stdout:started write 2024-09-16T16:51:21.786 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:51:21.786 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:51:21.786 INFO:tasks.workunit.client.0.smithi172.stdout:finished write 2024-09-16T16:51:21.786 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:21.786 INFO:tasks.workunit.client.0.smithi172.stdout:started write 2024-09-16T16:51:21.786 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:51:21.787 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:51:21.787 INFO:tasks.workunit.client.0.smithi172.stdout:finished write 2024-09-16T16:51:21.787 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:21.787 INFO:tasks.workunit.client.0.smithi172.stdout:started write 2024-09-16T16:51:21.787 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:51:21.787 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:51:21.787 INFO:tasks.workunit.client.0.smithi172.stdout:finished write 2024-09-16T16:51:21.787 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:21.787 INFO:tasks.workunit.client.0.smithi172.stdout:started write 2024-09-16T16:51:21.787 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:51:21.787 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:51:21.787 INFO:tasks.workunit.client.0.smithi172.stdout:finished write 2024-09-16T16:51:21.787 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:21.788 INFO:tasks.workunit.client.0.smithi172.stdout:started write 2024-09-16T16:51:21.788 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:51:21.976 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:51:21.976 INFO:tasks.workunit.client.0.smithi172.stdout:finished write 2024-09-16T16:51:21.976 INFO:tasks.workunit.client.0.smithi172.stdout:start compare and write 2024-09-16T16:51:21.976 INFO:tasks.workunit.client.0.smithi172.stdout:compare and wrote: 512 2024-09-16T16:51:21.976 INFO:tasks.workunit.client.0.smithi172.stdout:start compare and write 2024-09-16T16:51:21.976 INFO:tasks.workunit.client.0.smithi172.stdout:compare and wrote: 512 2024-09-16T16:51:21.976 INFO:tasks.workunit.client.0.smithi172.stdout:start compare and write 2024-09-16T16:51:21.976 INFO:tasks.workunit.client.0.smithi172.stdout:compare and wrote: 512 2024-09-16T16:51:21.976 INFO:tasks.workunit.client.0.smithi172.stdout:start compare and write 2024-09-16T16:51:21.976 INFO:tasks.workunit.client.0.smithi172.stdout:compare and wrote: 512 2024-09-16T16:51:21.976 INFO:tasks.workunit.client.0.smithi172.stdout:start compare and write 2024-09-16T16:51:21.976 INFO:tasks.workunit.client.0.smithi172.stdout:compare and wrote: 512 2024-09-16T16:51:21.977 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:21.977 INFO:tasks.workunit.client.0.smithi172.stdout:started aio compare and write 2024-09-16T16:51:21.977 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:51:21.998 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:51:21.998 INFO:tasks.workunit.client.0.smithi172.stdout:finished aio compare and write 2024-09-16T16:51:21.998 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:21.998 INFO:tasks.workunit.client.0.smithi172.stdout:started aio compare and write 2024-09-16T16:51:21.998 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:51:22.025 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:51:22.025 INFO:tasks.workunit.client.0.smithi172.stdout:finished aio compare and write 2024-09-16T16:51:22.025 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:22.025 INFO:tasks.workunit.client.0.smithi172.stdout:started aio compare and write 2024-09-16T16:51:22.026 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:51:22.046 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:51:22.046 INFO:tasks.workunit.client.0.smithi172.stdout:finished aio compare and write 2024-09-16T16:51:22.046 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:22.046 INFO:tasks.workunit.client.0.smithi172.stdout:started aio compare and write 2024-09-16T16:51:22.046 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:51:22.060 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:51:22.060 INFO:tasks.workunit.client.0.smithi172.stdout:finished aio compare and write 2024-09-16T16:51:22.060 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:22.060 INFO:tasks.workunit.client.0.smithi172.stdout:started aio compare and write 2024-09-16T16:51:22.060 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:51:22.106 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:51:22.107 INFO:tasks.workunit.client.0.smithi172.stdout:finished aio compare and write 2024-09-16T16:51:22.107 INFO:tasks.workunit.client.0.smithi172.stdout:read: 512 2024-09-16T16:51:22.107 INFO:tasks.workunit.client.0.smithi172.stdout:read: 512 2024-09-16T16:51:22.107 INFO:tasks.workunit.client.0.smithi172.stdout:read: 512 2024-09-16T16:51:22.107 INFO:tasks.workunit.client.0.smithi172.stdout:read: 512 2024-09-16T16:51:22.107 INFO:tasks.workunit.client.0.smithi172.stdout:read: 512 2024-09-16T16:51:22.107 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:22.107 INFO:tasks.workunit.client.0.smithi172.stdout:started read 2024-09-16T16:51:22.107 INFO:tasks.workunit.client.0.smithi172.stdout:read completion cb called! 2024-09-16T16:51:22.112 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 512 2024-09-16T16:51:22.112 INFO:tasks.workunit.client.0.smithi172.stdout:finished read 2024-09-16T16:51:22.112 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:22.112 INFO:tasks.workunit.client.0.smithi172.stdout:started read 2024-09-16T16:51:22.112 INFO:tasks.workunit.client.0.smithi172.stdout:read completion cb called! 2024-09-16T16:51:22.116 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 512 2024-09-16T16:51:22.117 INFO:tasks.workunit.client.0.smithi172.stdout:finished read 2024-09-16T16:51:22.117 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:22.117 INFO:tasks.workunit.client.0.smithi172.stdout:started read 2024-09-16T16:51:22.117 INFO:tasks.workunit.client.0.smithi172.stdout:read completion cb called! 2024-09-16T16:51:22.121 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 512 2024-09-16T16:51:22.121 INFO:tasks.workunit.client.0.smithi172.stdout:finished read 2024-09-16T16:51:22.121 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:22.121 INFO:tasks.workunit.client.0.smithi172.stdout:started read 2024-09-16T16:51:22.121 INFO:tasks.workunit.client.0.smithi172.stdout:read completion cb called! 2024-09-16T16:51:22.127 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 512 2024-09-16T16:51:22.127 INFO:tasks.workunit.client.0.smithi172.stdout:finished read 2024-09-16T16:51:22.127 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:22.127 INFO:tasks.workunit.client.0.smithi172.stdout:started read 2024-09-16T16:51:22.127 INFO:tasks.workunit.client.0.smithi172.stdout:read completion cb called! 2024-09-16T16:51:22.127 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 512 2024-09-16T16:51:22.127 INFO:tasks.workunit.client.0.smithi172.stdout:finished read 2024-09-16T16:51:22.127 INFO:tasks.workunit.client.0.smithi172.stdout:discard: 512~512 2024-09-16T16:51:22.127 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:51:42.914 INFO:tasks.workunit.client.0.smithi172.stdout:read: 512 2024-09-16T16:51:42.914 INFO:tasks.workunit.client.0.smithi172.stdout:read: 512 2024-09-16T16:51:42.914 INFO:tasks.workunit.client.0.smithi172.stdout:read: 512 2024-09-16T16:51:42.914 INFO:tasks.workunit.client.0.smithi172.stdout:read: 512 2024-09-16T16:51:42.914 INFO:tasks.workunit.client.0.smithi172.stdout:read: 512 2024-09-16T16:51:42.914 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 0 2024-09-16T16:51:42.914 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:51:42.914 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:51:42.914 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 0 2024-09-16T16:51:42.914 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:51:42.915 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:51:42.915 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 16384 2024-09-16T16:51:42.915 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:51:42.915 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:51:42.915 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 16384 2024-09-16T16:51:42.915 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:51:42.915 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:51:42.915 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:51:42.915 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:51:42.915 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 49152 2024-09-16T16:51:42.915 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:51:42.915 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:51:42.915 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 49152 2024-09-16T16:51:42.915 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:51:42.916 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:51:42.916 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 65536 2024-09-16T16:51:42.916 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:51:42.916 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:51:42.916 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 65536 2024-09-16T16:51:42.916 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:51:42.916 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:51:42.916 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:51:42.916 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:51:42.916 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 98304 2024-09-16T16:51:42.916 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:51:42.916 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:51:42.916 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 98304 2024-09-16T16:51:42.917 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:51:42.917 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:51:42.917 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 114688 2024-09-16T16:51:42.917 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:51:42.917 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:51:42.917 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 114688 2024-09-16T16:51:42.917 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:51:42.917 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:51:42.917 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:51:42.917 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:51:42.917 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 147456 2024-09-16T16:51:42.917 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:51:42.917 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:51:42.917 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 147456 2024-09-16T16:51:42.917 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:51:42.917 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:51:42.918 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 163840 2024-09-16T16:51:42.918 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:51:42.918 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:51:42.918 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 163840 2024-09-16T16:51:42.918 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:51:42.918 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:51:42.918 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:51:42.918 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:51:42.918 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 196608 2024-09-16T16:51:42.918 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:51:42.918 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:51:42.918 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 196608 2024-09-16T16:51:42.918 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:51:42.918 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:51:42.919 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 212992 2024-09-16T16:51:42.919 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:51:42.919 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:51:42.919 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 212992 2024-09-16T16:51:42.919 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:51:42.919 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:51:42.919 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:51:42.919 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:51:42.919 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:42.919 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:51:42.919 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:51:42.919 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:51:42.919 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:51:42.920 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:51:42.920 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:51:42.920 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:42.920 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:51:42.920 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:51:42.920 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:51:42.920 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:51:42.920 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:51:42.920 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:51:42.920 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:42.920 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:51:42.920 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:51:43.085 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:51:43.085 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:51:43.085 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:51:43.085 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:51:43.085 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:43.085 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:51:43.086 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:51:43.239 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:51:43.239 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:51:43.239 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:51:43.239 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:51:43.239 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:43.239 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:51:43.239 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:51:43.239 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:43.240 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:51:43.240 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:51:43.240 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:43.240 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:51:43.240 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:51:43.731 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:51:43.731 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:51:43.732 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:51:43.732 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:51:43.732 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:43.732 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:51:43.732 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:51:44.158 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:51:44.159 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:51:44.159 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:51:44.159 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:51:44.159 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:44.159 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:51:44.159 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:51:44.838 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:51:44.839 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:51:44.839 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:51:44.839 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:51:44.839 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:44.839 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:51:44.839 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:51:45.413 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:51:45.413 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:51:45.413 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:51:45.413 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:51:45.413 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:45.413 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:51:45.413 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:51:45.414 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:45.414 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:51:45.414 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:51:45.414 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:45.414 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:51:45.414 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:51:46.458 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:51:46.458 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:51:46.458 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:51:46.458 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:51:46.458 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:46.459 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:51:46.459 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:51:47.304 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:51:47.304 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:51:47.304 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:51:47.305 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:51:47.305 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:47.305 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:51:47.305 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:51:48.435 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:51:48.506 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:51:48.506 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:51:48.506 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:51:48.506 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:48.507 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:51:48.507 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:51:49.414 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:51:49.415 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:51:49.415 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:51:49.415 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:51:49.415 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:49.415 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:51:49.415 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:51:49.415 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:49.415 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:51:49.415 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:51:49.415 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:49.415 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:51:49.415 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:51:51.112 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:51:51.112 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:51:51.112 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:51:51.113 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:51:51.113 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:51.113 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:51:51.113 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:51:52.390 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:51:52.390 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:51:52.390 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:51:52.390 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:51:52.391 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:52.391 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:51:52.391 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:51:54.100 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:51:54.101 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:51:54.101 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:51:54.101 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:51:54.101 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:54.101 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:51:54.101 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:51:55.525 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:51:55.525 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:51:55.525 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:51:55.525 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:51:55.525 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:55.525 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:51:55.526 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:51:55.526 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:55.526 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:51:55.526 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:51:55.526 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:55.526 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:51:55.526 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:51:57.538 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:51:57.538 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:51:57.538 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:51:57.538 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:51:57.539 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:57.539 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:51:57.539 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:51:59.432 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:51:59.433 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:51:59.433 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:51:59.433 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:51:59.433 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:51:59.433 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:51:59.433 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:52:01.539 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:52:01.539 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:52:01.539 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:52:01.539 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:52:01.539 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:52:01.540 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:52:01.540 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:52:03.479 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:52:03.479 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:52:03.479 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:52:03.479 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:52:03.479 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:52:03.479 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:52:03.479 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:52:03.479 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:52:03.480 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:52:03.480 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:52:03.480 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.TestIOPP (41805 ms) 2024-09-16T16:52:03.480 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteCompareTooSmallPP 2024-09-16T16:52:03.480 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:52:03.583 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.TestCompareAndWriteCompareTooSmallPP (104 ms) 2024-09-16T16:52:03.583 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteCompareTooSmallPP 2024-09-16T16:52:03.583 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:52:03.696 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteCompareTooSmallPP (113 ms) 2024-09-16T16:52:03.696 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteWriteTooSmallPP 2024-09-16T16:52:03.696 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:52:03.802 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.TestCompareAndWriteWriteTooSmallPP (106 ms) 2024-09-16T16:52:03.802 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteWriteTooSmallPP 2024-09-16T16:52:03.802 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:52:03.913 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteWriteTooSmallPP (111 ms) 2024-09-16T16:52:03.913 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteMismatchPP 2024-09-16T16:52:03.913 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:52:04.042 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.TestCompareAndWriteMismatchPP (130 ms) 2024-09-16T16:52:04.042 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteMismatchPP 2024-09-16T16:52:04.043 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:52:04.157 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:52:04.195 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteMismatchPP (152 ms) 2024-09-16T16:52:04.195 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteMismatchBufferlistGreaterLenPP 2024-09-16T16:52:04.195 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:52:04.326 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.TestCompareAndWriteMismatchBufferlistGreaterLenPP (131 ms) 2024-09-16T16:52:04.326 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteMismatchBufferlistGreaterLenPP 2024-09-16T16:52:04.326 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:52:04.426 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:52:04.455 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteMismatchBufferlistGreaterLenPP (129 ms) 2024-09-16T16:52:04.455 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteSuccessPP 2024-09-16T16:52:04.455 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:52:04.594 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.TestCompareAndWriteSuccessPP (139 ms) 2024-09-16T16:52:04.594 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteSuccessPP 2024-09-16T16:52:04.594 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:52:04.696 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:52:04.722 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteSuccessPP (128 ms) 2024-09-16T16:52:04.722 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteSuccessBufferlistGreaterLenPP 2024-09-16T16:52:04.723 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:52:04.865 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.TestCompareAndWriteSuccessBufferlistGreaterLenPP (143 ms) 2024-09-16T16:52:04.865 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteSuccessBufferlistGreaterLenPP 2024-09-16T16:52:04.865 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:52:04.991 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:52:05.020 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteSuccessBufferlistGreaterLenPP (156 ms) 2024-09-16T16:52:05.021 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteStripeUnitUnalignedPP 2024-09-16T16:52:05.021 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:52:05.239 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.TestCompareAndWriteStripeUnitUnalignedPP (218 ms) 2024-09-16T16:52:05.239 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteStripeUnitUnalignedPP 2024-09-16T16:52:05.239 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:52:05.403 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:52:05.450 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteStripeUnitUnalignedPP (211 ms) 2024-09-16T16:52:05.450 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteTooLargePP 2024-09-16T16:52:05.450 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:52:05.666 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.TestCompareAndWriteTooLargePP (216 ms) 2024-09-16T16:52:05.666 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteTooLargePP 2024-09-16T16:52:05.666 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:52:05.898 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:52:05.950 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteTooLargePP (284 ms) 2024-09-16T16:52:05.950 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteStripeUnitSuccessPP 2024-09-16T16:52:05.950 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:52:08.329 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.TestCompareAndWriteStripeUnitSuccessPP (2379 ms) 2024-09-16T16:52:08.329 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteStripeUnitSuccessPP 2024-09-16T16:52:08.329 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:52:10.613 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:52:10.712 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteStripeUnitSuccessPP (2384 ms) 2024-09-16T16:52:10.713 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.TestIOPPWithIOHint 2024-09-16T16:52:10.713 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:52:10.875 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 512 2024-09-16T16:52:10.875 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 512 2024-09-16T16:52:10.875 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 512 2024-09-16T16:52:10.875 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 512 2024-09-16T16:52:10.875 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 512 2024-09-16T16:52:10.875 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:52:10.875 INFO:tasks.workunit.client.0.smithi172.stdout:started write 2024-09-16T16:52:10.875 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:52:10.887 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:52:10.887 INFO:tasks.workunit.client.0.smithi172.stdout:finished write 2024-09-16T16:52:10.887 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:52:10.888 INFO:tasks.workunit.client.0.smithi172.stdout:started write 2024-09-16T16:52:10.888 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:52:10.900 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:52:10.900 INFO:tasks.workunit.client.0.smithi172.stdout:finished write 2024-09-16T16:52:10.900 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:52:10.900 INFO:tasks.workunit.client.0.smithi172.stdout:started write 2024-09-16T16:52:10.900 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:52:10.913 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:52:10.913 INFO:tasks.workunit.client.0.smithi172.stdout:finished write 2024-09-16T16:52:10.913 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:52:10.913 INFO:tasks.workunit.client.0.smithi172.stdout:started write 2024-09-16T16:52:10.913 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:52:10.926 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:52:10.926 INFO:tasks.workunit.client.0.smithi172.stdout:finished write 2024-09-16T16:52:10.926 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:52:10.926 INFO:tasks.workunit.client.0.smithi172.stdout:started write 2024-09-16T16:52:10.926 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:52:10.937 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:52:10.937 INFO:tasks.workunit.client.0.smithi172.stdout:finished write 2024-09-16T16:52:10.937 INFO:tasks.workunit.client.0.smithi172.stdout:read: 512 2024-09-16T16:52:10.937 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:52:10.938 INFO:tasks.workunit.client.0.smithi172.stdout:started read 2024-09-16T16:52:10.938 INFO:tasks.workunit.client.0.smithi172.stdout:read completion cb called! 2024-09-16T16:52:10.942 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 512 2024-09-16T16:52:10.942 INFO:tasks.workunit.client.0.smithi172.stdout:finished read 2024-09-16T16:52:10.942 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:52:10.942 INFO:tasks.workunit.client.0.smithi172.stdout:started read 2024-09-16T16:52:10.942 INFO:tasks.workunit.client.0.smithi172.stdout:read completion cb called! 2024-09-16T16:52:10.947 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 512 2024-09-16T16:52:10.947 INFO:tasks.workunit.client.0.smithi172.stdout:finished read 2024-09-16T16:52:10.947 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:52:10.947 INFO:tasks.workunit.client.0.smithi172.stdout:started read 2024-09-16T16:52:10.947 INFO:tasks.workunit.client.0.smithi172.stdout:read completion cb called! 2024-09-16T16:52:10.951 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 512 2024-09-16T16:52:10.951 INFO:tasks.workunit.client.0.smithi172.stdout:finished read 2024-09-16T16:52:10.951 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:52:10.951 INFO:tasks.workunit.client.0.smithi172.stdout:started read 2024-09-16T16:52:10.951 INFO:tasks.workunit.client.0.smithi172.stdout:read completion cb called! 2024-09-16T16:52:10.955 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 512 2024-09-16T16:52:10.955 INFO:tasks.workunit.client.0.smithi172.stdout:finished read 2024-09-16T16:52:10.955 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:52:10.955 INFO:tasks.workunit.client.0.smithi172.stdout:started read 2024-09-16T16:52:10.955 INFO:tasks.workunit.client.0.smithi172.stdout:read completion cb called! 2024-09-16T16:52:29.131 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 512 2024-09-16T16:52:29.131 INFO:tasks.workunit.client.0.smithi172.stdout:finished read 2024-09-16T16:52:29.131 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 0 2024-09-16T16:52:29.132 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:52:29.132 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:52:29.132 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 0 2024-09-16T16:52:29.132 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:52:29.132 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:52:29.132 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 16384 2024-09-16T16:52:29.132 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:52:29.132 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:52:29.132 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 16384 2024-09-16T16:52:29.132 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:52:29.132 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:52:29.132 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:52:29.132 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:52:29.132 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 49152 2024-09-16T16:52:29.132 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:52:29.133 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:52:29.133 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 49152 2024-09-16T16:52:29.133 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:52:29.133 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:52:29.133 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 65536 2024-09-16T16:52:29.133 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:52:29.133 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:52:29.133 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 65536 2024-09-16T16:52:29.133 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:52:29.133 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:52:29.133 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:52:29.133 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:52:29.133 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 98304 2024-09-16T16:52:29.133 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:52:29.133 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:52:29.133 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 98304 2024-09-16T16:52:29.134 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:52:29.134 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:52:29.134 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 114688 2024-09-16T16:52:29.134 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:52:29.134 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:52:29.134 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 114688 2024-09-16T16:52:29.134 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:52:29.134 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:52:29.134 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:52:29.134 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:52:29.134 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 147456 2024-09-16T16:52:29.135 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:52:29.135 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:52:29.135 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 147456 2024-09-16T16:52:29.135 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:52:29.135 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:52:29.135 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 163840 2024-09-16T16:52:29.135 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:52:29.135 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:52:29.135 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 163840 2024-09-16T16:52:29.135 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:52:29.135 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:52:29.135 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:52:29.135 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:52:29.135 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 196608 2024-09-16T16:52:29.136 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:52:29.136 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:52:29.136 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 196608 2024-09-16T16:52:29.136 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:52:29.136 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:52:29.136 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 212992 2024-09-16T16:52:29.136 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:52:29.136 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:52:29.136 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 212992 2024-09-16T16:52:29.136 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:52:29.136 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:52:29.136 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:52:29.136 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:52:29.136 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:52:29.136 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:52:29.137 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:52:29.137 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:52:29.137 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:52:29.137 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:52:29.137 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:52:29.137 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:52:29.137 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:52:29.137 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:52:29.145 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:52:29.145 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:52:29.145 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:52:29.145 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:52:29.145 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:52:29.145 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:52:29.145 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:52:29.293 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:52:29.293 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:52:29.294 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:52:29.294 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:52:29.294 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:52:29.294 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:52:29.294 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:52:29.423 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:52:29.423 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:52:29.423 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:52:29.424 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:52:29.424 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:52:29.424 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:52:29.424 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:52:29.424 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:52:29.424 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:52:29.424 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:52:29.424 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:52:29.424 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:52:29.424 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:52:29.933 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:52:29.933 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:52:29.933 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:52:29.933 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:52:29.933 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:52:29.933 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:52:29.934 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:52:30.410 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:52:30.410 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:52:30.410 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:52:30.410 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:52:30.410 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:52:30.410 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:52:30.410 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:52:31.013 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:52:31.013 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:52:31.013 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:52:31.013 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:52:31.013 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:52:31.013 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:52:31.013 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:52:31.494 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:52:31.494 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:52:31.494 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:52:31.495 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:52:31.495 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:52:31.495 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:52:31.495 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:52:31.495 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:52:31.495 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:52:31.495 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:52:31.495 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:52:31.495 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:52:31.495 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:52:32.335 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:52:32.335 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:52:32.335 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:52:32.335 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:52:32.335 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:52:32.335 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:52:32.335 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:52:33.129 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:52:33.129 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:52:33.129 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:52:33.129 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:52:33.129 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:52:33.129 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:52:33.129 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:52:34.206 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:52:34.206 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:52:34.206 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:52:34.206 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:52:34.206 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:52:34.206 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:52:34.206 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:52:35.084 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:52:35.084 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:52:35.084 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:52:35.084 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:52:35.084 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:52:35.084 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:52:35.084 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:52:35.084 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:52:35.084 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:52:35.084 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:52:35.085 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:52:35.085 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:52:35.085 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:52:36.443 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:52:36.443 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:52:36.443 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:52:36.443 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:52:36.443 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:52:36.443 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:52:36.443 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:52:37.520 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:52:37.520 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:52:37.520 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:52:37.520 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:52:37.520 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:52:37.520 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:52:37.520 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:52:39.131 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:52:39.131 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:52:39.131 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:52:39.131 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:52:39.131 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:52:39.131 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:52:39.131 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:52:40.352 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:52:40.352 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:52:40.352 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:52:40.352 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:52:40.352 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:52:40.352 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:52:40.352 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:52:40.352 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:52:40.352 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:52:40.352 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:52:40.352 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:52:40.353 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:52:40.353 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:52:42.326 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:52:42.326 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:52:42.326 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:52:42.326 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:52:42.326 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:52:42.326 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:52:42.326 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:52:43.781 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:52:43.781 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:52:43.781 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:52:43.781 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:52:43.781 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:52:43.781 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:52:43.781 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:52:45.574 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:52:45.574 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:52:45.574 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:52:45.574 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:52:45.574 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:52:45.575 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:52:45.575 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:52:47.379 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:52:47.379 INFO:tasks.workunit.client.0.smithi172.stdout:finished writesame 2024-09-16T16:52:47.379 INFO:tasks.workunit.client.0.smithi172.stdout:to verify the data 2024-09-16T16:52:47.379 INFO:tasks.workunit.client.0.smithi172.stdout:verified 2024-09-16T16:52:47.379 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:52:47.379 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:52:47.379 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:52:47.379 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:52:47.379 INFO:tasks.workunit.client.0.smithi172.stdout:started writesame 2024-09-16T16:52:47.379 INFO:tasks.workunit.client.0.smithi172.stdout:expected fail, finished writesame 2024-09-16T16:52:47.379 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.TestIOPPWithIOHint (36666 ms) 2024-09-16T16:52:47.380 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.TestIOToSnapshot 2024-09-16T16:52:47.380 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:52:48.723 INFO:tasks.workunit.client.0.smithi172.stdout:num snaps is: 0 2024-09-16T16:52:48.723 INFO:tasks.workunit.client.0.smithi172.stdout:expected: 0 2024-09-16T16:52:48.723 INFO:tasks.workunit.client.0.smithi172.stdout:num snaps is: 1 2024-09-16T16:52:48.723 INFO:tasks.workunit.client.0.smithi172.stdout:expected: 1 2024-09-16T16:52:48.723 INFO:tasks.workunit.client.0.smithi172.stdout:snap: orig 2024-09-16T16:52:48.723 INFO:tasks.workunit.client.0.smithi172.stdout:found orig with size 2097152 2024-09-16T16:52:48.723 INFO:tasks.workunit.client.0.smithi172.stdout:read: 80 2024-09-16T16:52:48.723 INFO:tasks.workunit.client.0.smithi172.stdout:write test data! 2024-09-16T16:52:48.724 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 80 2024-09-16T16:52:48.724 INFO:tasks.workunit.client.0.smithi172.stdout:num snaps is: 2 2024-09-16T16:52:48.724 INFO:tasks.workunit.client.0.smithi172.stdout:expected: 2 2024-09-16T16:52:48.724 INFO:tasks.workunit.client.0.smithi172.stdout:snap: orig 2024-09-16T16:52:48.724 INFO:tasks.workunit.client.0.smithi172.stdout:snap: written 2024-09-16T16:52:48.724 INFO:tasks.workunit.client.0.smithi172.stdout:found orig with size 2097152 2024-09-16T16:52:48.724 INFO:tasks.workunit.client.0.smithi172.stdout:found written with size 2097152 2024-09-16T16:52:48.724 INFO:tasks.workunit.client.0.smithi172.stdout:read: 80 2024-09-16T16:52:48.724 INFO:tasks.workunit.client.0.smithi172.stdout:read: 80 2024-09-16T16:52:48.724 INFO:tasks.workunit.client.0.smithi172.stdout:read: 80 2024-09-16T16:52:48.724 INFO:tasks.workunit.client.0.smithi172.stdout:write to snapshot returned -30 2024-09-16T16:52:48.724 INFO:tasks.workunit.client.0.smithi172.stdout:Read-only file system 2024-09-16T16:52:48.868 INFO:tasks.workunit.client.0.smithi172.stdout:read: 80 2024-09-16T16:52:48.868 INFO:tasks.workunit.client.0.smithi172.stdout:read: 80 2024-09-16T16:52:48.868 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 80 2024-09-16T16:52:48.869 INFO:tasks.workunit.client.0.smithi172.stdout:opening testimg@orig 2024-09-16T16:52:48.869 INFO:tasks.workunit.client.0.smithi172.stdout:read: 80 2024-09-16T16:52:48.869 INFO:tasks.workunit.client.0.smithi172.stdout:write to snapshot returned -30 2024-09-16T16:52:48.869 INFO:tasks.workunit.client.0.smithi172.stdout:Read-only file system 2024-09-16T16:52:50.729 INFO:tasks.workunit.client.0.smithi172.stdout:num snaps is: 2 2024-09-16T16:52:50.729 INFO:tasks.workunit.client.0.smithi172.stdout:expected: 2 2024-09-16T16:52:50.729 INFO:tasks.workunit.client.0.smithi172.stdout:snap: orig 2024-09-16T16:52:50.729 INFO:tasks.workunit.client.0.smithi172.stdout:snap: written 2024-09-16T16:52:50.729 INFO:tasks.workunit.client.0.smithi172.stdout:found orig with size 2097152 2024-09-16T16:52:50.729 INFO:tasks.workunit.client.0.smithi172.stdout:found written with size 2097152 2024-09-16T16:52:50.729 INFO:tasks.workunit.client.0.smithi172.stdout:num snaps is: 1 2024-09-16T16:52:50.729 INFO:tasks.workunit.client.0.smithi172.stdout:expected: 1 2024-09-16T16:52:50.729 INFO:tasks.workunit.client.0.smithi172.stdout:snap: orig 2024-09-16T16:52:50.729 INFO:tasks.workunit.client.0.smithi172.stdout:found orig with size 2097152 2024-09-16T16:52:50.729 INFO:tasks.workunit.client.0.smithi172.stdout:num snaps is: 0 2024-09-16T16:52:50.730 INFO:tasks.workunit.client.0.smithi172.stdout:expected: 0 2024-09-16T16:52:50.730 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.TestIOToSnapshot (3350 ms) 2024-09-16T16:52:50.730 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.TestSnapshotDeletedIo 2024-09-16T16:52:50.730 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:52:52.730 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.TestSnapshotDeletedIo (2000 ms) 2024-09-16T16:52:52.730 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.TestClone 2024-09-16T16:52:52.730 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:6444: Skipped 2024-09-16T16:52:52.730 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:52:52.730 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.TestClone (0 ms) 2024-09-16T16:52:52.730 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.TestClone2 2024-09-16T16:52:52.730 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:6608: Skipped 2024-09-16T16:52:52.730 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:52:52.730 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.TestClone2 (0 ms) 2024-09-16T16:52:52.730 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.ListChildren 2024-09-16T16:52:52.730 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:6841: Skipped 2024-09-16T16:52:52.730 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:52:52.731 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.ListChildren (0 ms) 2024-09-16T16:52:52.731 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.ListChildrenTiered 2024-09-16T16:52:52.731 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:6995: Skipped 2024-09-16T16:52:52.731 INFO:tasks.workunit.client.0.smithi172.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:52.731 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.ListChildrenTiered (0 ms) 2024-09-16T16:52:52.731 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.LockingPP 2024-09-16T16:52:52.731 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:52:53.097 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.LockingPP (368 ms) 2024-09-16T16:52:53.097 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.FlushAio 2024-09-16T16:52:53.098 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:52:56.001 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.FlushAio (2904 ms) 2024-09-16T16:52:56.001 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.FlushAioPP 2024-09-16T16:52:56.001 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:52:58.743 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.FlushAioPP (2742 ms) 2024-09-16T16:52:58.743 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.ZeroLengthWrite 2024-09-16T16:52:58.743 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:52:58.852 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.ZeroLengthWrite (109 ms) 2024-09-16T16:52:58.852 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.ZeroLengthDiscard 2024-09-16T16:52:58.852 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:52:58.982 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.ZeroLengthDiscard (131 ms) 2024-09-16T16:52:58.982 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.ZeroLengthRead 2024-09-16T16:52:58.983 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:52:59.084 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.ZeroLengthRead (101 ms) 2024-09-16T16:52:59.084 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.LargeCacheRead 2024-09-16T16:52:59.084 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:52:59.230 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.LargeCacheRead (146 ms) 2024-09-16T16:52:59.230 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.TestPendingAio 2024-09-16T16:52:59.230 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:9152: Skipped 2024-09-16T16:52:59.230 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:52:59.230 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.TestPendingAio (0 ms) 2024-09-16T16:52:59.230 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.CompareAndWriteCopyup 2024-09-16T16:52:59.230 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:9264: Skipped 2024-09-16T16:52:59.230 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:52:59.230 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.CompareAndWriteCopyup (0 ms) 2024-09-16T16:52:59.231 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.CompareAndWriteCopyupMismatch 2024-09-16T16:52:59.231 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:9325: Skipped 2024-09-16T16:52:59.231 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:52:59.231 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.CompareAndWriteCopyupMismatch (0 ms) 2024-09-16T16:52:59.231 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.Flatten 2024-09-16T16:52:59.231 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:9336: Skipped 2024-09-16T16:52:59.231 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:52:59.231 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.Flatten (0 ms) 2024-09-16T16:52:59.231 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.Sparsify 2024-09-16T16:52:59.231 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:52:59.394 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 32768 2024-09-16T16:52:59.394 INFO:tasks.workunit.client.0.smithi172.stdout:read: 32768 2024-09-16T16:52:59.394 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.Sparsify (164 ms) 2024-09-16T16:52:59.394 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.SparsifyPP 2024-09-16T16:52:59.394 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:52:59.554 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.SparsifyPP (160 ms) 2024-09-16T16:52:59.554 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.SnapshotLimit 2024-09-16T16:52:59.554 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:53:04.768 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.SnapshotLimit (5214 ms) 2024-09-16T16:53:04.768 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.SnapshotLimitPP 2024-09-16T16:53:04.768 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:53:09.834 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.SnapshotLimitPP (5064 ms) 2024-09-16T16:53:09.834 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.RebuildObjectMapViaLockOwner 2024-09-16T16:53:09.834 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:9523: Skipped 2024-09-16T16:53:09.834 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:53:09.834 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.RebuildObjectMapViaLockOwner (0 ms) 2024-09-16T16:53:09.834 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.RenameViaLockOwner 2024-09-16T16:53:09.834 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:9575: Skipped 2024-09-16T16:53:09.834 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:53:09.835 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.RenameViaLockOwner (0 ms) 2024-09-16T16:53:09.835 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.SnapCreateViaLockOwner 2024-09-16T16:53:09.835 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:9615: Skipped 2024-09-16T16:53:09.835 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:53:09.835 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.SnapCreateViaLockOwner (0 ms) 2024-09-16T16:53:09.835 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.SnapRemoveViaLockOwner 2024-09-16T16:53:09.835 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:9659: Skipped 2024-09-16T16:53:09.835 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:53:09.835 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.SnapRemoveViaLockOwner (0 ms) 2024-09-16T16:53:09.835 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.UpdateFeaturesViaLockOwner 2024-09-16T16:53:09.835 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:9699: Skipped 2024-09-16T16:53:09.835 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:53:09.835 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.UpdateFeaturesViaLockOwner (0 ms) 2024-09-16T16:53:09.836 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.EnableJournalingViaLockOwner 2024-09-16T16:53:09.836 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:9736: Skipped 2024-09-16T16:53:09.836 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:53:09.836 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.EnableJournalingViaLockOwner (0 ms) 2024-09-16T16:53:09.836 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.SnapRemove2 2024-09-16T16:53:09.836 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:9777: Skipped 2024-09-16T16:53:09.836 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:53:09.836 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.SnapRemove2 (0 ms) 2024-09-16T16:53:09.836 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.SnapRenameViaLockOwner 2024-09-16T16:53:09.836 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:9823: Skipped 2024-09-16T16:53:09.836 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:53:09.836 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.SnapRenameViaLockOwner (0 ms) 2024-09-16T16:53:09.836 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.SnapProtectViaLockOwner 2024-09-16T16:53:09.836 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:9864: Skipped 2024-09-16T16:53:09.837 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:53:09.837 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.SnapProtectViaLockOwner (0 ms) 2024-09-16T16:53:09.837 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.SnapUnprotectViaLockOwner 2024-09-16T16:53:09.837 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:9905: Skipped 2024-09-16T16:53:09.837 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:53:09.837 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.SnapUnprotectViaLockOwner (0 ms) 2024-09-16T16:53:09.837 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.FlattenViaLockOwner 2024-09-16T16:53:09.837 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:9949: Skipped 2024-09-16T16:53:09.837 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:53:09.837 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.FlattenViaLockOwner (0 ms) 2024-09-16T16:53:09.837 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.ResizeViaLockOwner 2024-09-16T16:53:09.837 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:9997: Skipped 2024-09-16T16:53:09.837 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:53:09.837 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.ResizeViaLockOwner (0 ms) 2024-09-16T16:53:09.838 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.SparsifyViaLockOwner 2024-09-16T16:53:09.838 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:10033: Skipped 2024-09-16T16:53:09.838 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:53:09.838 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.SparsifyViaLockOwner (0 ms) 2024-09-16T16:53:09.838 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.ObjectMapConsistentSnap 2024-09-16T16:53:09.838 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:10069: Skipped 2024-09-16T16:53:09.838 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:53:09.838 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.ObjectMapConsistentSnap (0 ms) 2024-09-16T16:53:09.838 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.Metadata 2024-09-16T16:53:09.838 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:10121: Skipped 2024-09-16T16:53:09.838 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:53:09.838 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.Metadata (0 ms) 2024-09-16T16:53:09.838 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.MetadataPP 2024-09-16T16:53:09.839 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:10310: Skipped 2024-09-16T16:53:09.839 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:53:09.839 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.MetadataPP (0 ms) 2024-09-16T16:53:09.839 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.UpdateFeatures 2024-09-16T16:53:09.839 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:10391: Skipped 2024-09-16T16:53:09.839 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:53:09.839 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.UpdateFeatures (0 ms) 2024-09-16T16:53:09.839 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.FeaturesBitmaskString 2024-09-16T16:53:09.839 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.FeaturesBitmaskString (1 ms) 2024-09-16T16:53:09.839 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.RebuildObjectMap 2024-09-16T16:53:09.839 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:53:09.934 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.RebuildObjectMap (101 ms) 2024-09-16T16:53:09.934 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.RebuildNewObjectMap 2024-09-16T16:53:09.934 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:10584: Skipped 2024-09-16T16:53:09.934 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:53:09.934 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.RebuildNewObjectMap (0 ms) 2024-09-16T16:53:09.934 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.CheckObjectMap 2024-09-16T16:53:09.934 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:10609: Skipped 2024-09-16T16:53:09.934 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:53:09.934 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.CheckObjectMap (0 ms) 2024-09-16T16:53:09.934 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.BlockingAIO 2024-09-16T16:53:09.934 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:53:10.083 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.BlockingAIO (149 ms) 2024-09-16T16:53:10.083 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.ExclusiveLockTransition 2024-09-16T16:53:10.083 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:10737: Skipped 2024-09-16T16:53:10.084 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:53:10.084 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.ExclusiveLockTransition (0 ms) 2024-09-16T16:53:10.084 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.ExclusiveLockReadTransition 2024-09-16T16:53:10.084 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:10793: Skipped 2024-09-16T16:53:10.084 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:53:10.084 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.ExclusiveLockReadTransition (0 ms) 2024-09-16T16:53:10.084 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.CacheMayCopyOnWrite 2024-09-16T16:53:10.084 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:10846: Skipped 2024-09-16T16:53:10.084 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:53:10.084 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.CacheMayCopyOnWrite (0 ms) 2024-09-16T16:53:10.084 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.FlushEmptyOpsOnExternalSnapshot 2024-09-16T16:53:10.084 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:53:10.847 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.FlushEmptyOpsOnExternalSnapshot (764 ms) 2024-09-16T16:53:10.847 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.TestImageOptions 2024-09-16T16:53:15.086 INFO:tasks.workunit.client.0.smithi172.stdout:0.00% done 2024-09-16T16:53:15.086 INFO:tasks.workunit.client.0.smithi172.stdout:100.00% done 2024-09-16T16:53:15.086 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.TestImageOptions (4239 ms) 2024-09-16T16:53:15.087 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.TestImageOptionsPP 2024-09-16T16:53:16.755 INFO:tasks.workunit.client.0.smithi172.stdout:0.00% done 2024-09-16T16:53:16.756 INFO:tasks.workunit.client.0.smithi172.stdout:100.00% done 2024-09-16T16:53:16.756 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.TestImageOptionsPP (1669 ms) 2024-09-16T16:53:16.756 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.EventSocketPipe 2024-09-16T16:53:16.756 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.EventSocketPipe (0 ms) 2024-09-16T16:53:16.756 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.EventSocketEventfd 2024-09-16T16:53:16.756 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.EventSocketEventfd (0 ms) 2024-09-16T16:53:16.756 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.ImagePollIO 2024-09-16T16:53:16.756 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:53:17.019 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 512 2024-09-16T16:53:17.019 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 512 2024-09-16T16:53:17.019 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 512 2024-09-16T16:53:17.020 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 512 2024-09-16T16:53:17.020 INFO:tasks.workunit.client.0.smithi172.stdout:wrote: 512 2024-09-16T16:53:17.020 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:53:17.020 INFO:tasks.workunit.client.0.smithi172.stdout:started write 2024-09-16T16:53:17.020 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:53:17.020 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:53:17.020 INFO:tasks.workunit.client.0.smithi172.stdout:finished write 2024-09-16T16:53:17.020 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:53:17.020 INFO:tasks.workunit.client.0.smithi172.stdout:started write 2024-09-16T16:53:17.020 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:53:17.020 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:53:17.020 INFO:tasks.workunit.client.0.smithi172.stdout:finished write 2024-09-16T16:53:17.020 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:53:17.020 INFO:tasks.workunit.client.0.smithi172.stdout:started write 2024-09-16T16:53:17.020 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:53:17.021 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:53:17.021 INFO:tasks.workunit.client.0.smithi172.stdout:finished write 2024-09-16T16:53:17.021 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:53:17.021 INFO:tasks.workunit.client.0.smithi172.stdout:started write 2024-09-16T16:53:17.021 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:53:17.021 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:53:17.021 INFO:tasks.workunit.client.0.smithi172.stdout:finished write 2024-09-16T16:53:17.021 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:53:17.021 INFO:tasks.workunit.client.0.smithi172.stdout:started write 2024-09-16T16:53:17.021 INFO:tasks.workunit.client.0.smithi172.stdout:write completion cb called! 2024-09-16T16:53:17.021 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 0 2024-09-16T16:53:17.021 INFO:tasks.workunit.client.0.smithi172.stdout:finished write 2024-09-16T16:53:17.021 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:53:17.021 INFO:tasks.workunit.client.0.smithi172.stdout:started read 2024-09-16T16:53:17.021 INFO:tasks.workunit.client.0.smithi172.stdout:read completion cb called! 2024-09-16T16:53:17.022 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 512 2024-09-16T16:53:17.022 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:53:17.022 INFO:tasks.workunit.client.0.smithi172.stdout:started read 2024-09-16T16:53:17.022 INFO:tasks.workunit.client.0.smithi172.stdout:read completion cb called! 2024-09-16T16:53:17.022 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 512 2024-09-16T16:53:17.022 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:53:17.022 INFO:tasks.workunit.client.0.smithi172.stdout:started read 2024-09-16T16:53:17.022 INFO:tasks.workunit.client.0.smithi172.stdout:read completion cb called! 2024-09-16T16:53:17.022 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 512 2024-09-16T16:53:17.022 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:53:17.022 INFO:tasks.workunit.client.0.smithi172.stdout:started read 2024-09-16T16:53:17.022 INFO:tasks.workunit.client.0.smithi172.stdout:read completion cb called! 2024-09-16T16:53:17.022 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 512 2024-09-16T16:53:17.022 INFO:tasks.workunit.client.0.smithi172.stdout:created completion 2024-09-16T16:53:17.022 INFO:tasks.workunit.client.0.smithi172.stdout:started read 2024-09-16T16:53:17.023 INFO:tasks.workunit.client.0.smithi172.stdout:read completion cb called! 2024-09-16T16:53:17.023 INFO:tasks.workunit.client.0.smithi172.stdout:return value is: 512 2024-09-16T16:53:17.023 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.ImagePollIO (264 ms) 2024-09-16T16:53:17.023 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.Mirror 2024-09-16T16:53:17.073 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:53:17.130 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:53:17.472 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.Mirror (453 ms) 2024-09-16T16:53:17.472 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.MirrorPeerAttributes 2024-09-16T16:53:17.591 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.MirrorPeerAttributes (119 ms) 2024-09-16T16:53:17.591 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.CreateWithMirrorEnabled 2024-09-16T16:53:17.591 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:11322: Skipped 2024-09-16T16:53:17.591 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:53:17.591 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.CreateWithMirrorEnabled (0 ms) 2024-09-16T16:53:17.591 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.FlushCacheWithCopyupOnExternalSnapshot 2024-09-16T16:53:17.591 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:11364: Skipped 2024-09-16T16:53:17.591 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:53:17.591 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.FlushCacheWithCopyupOnExternalSnapshot (0 ms) 2024-09-16T16:53:17.591 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.ExclusiveLock 2024-09-16T16:53:17.591 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:11410: Skipped 2024-09-16T16:53:17.592 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:53:17.592 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.ExclusiveLock (0 ms) 2024-09-16T16:53:17.592 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.BreakLock 2024-09-16T16:53:17.592 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:11553: Skipped 2024-09-16T16:53:17.592 INFO:tasks.workunit.client.0.smithi172.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:17.592 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.BreakLock (0 ms) 2024-09-16T16:53:17.592 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.DiscardAfterWrite 2024-09-16T16:53:17.592 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:53:17.683 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.DiscardAfterWrite (91 ms) 2024-09-16T16:53:17.683 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.DefaultFeatures 2024-09-16T16:53:17.683 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.DefaultFeatures (0 ms) 2024-09-16T16:53:17.683 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.TestTrashMoveAndPurge 2024-09-16T16:53:17.683 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:11676: Skipped 2024-09-16T16:53:17.683 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:53:17.683 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.TestTrashMoveAndPurge (0 ms) 2024-09-16T16:53:17.683 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.TestTrashMoveAndPurgeNonExpiredDelay 2024-09-16T16:53:17.683 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:11722: Skipped 2024-09-16T16:53:17.683 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:53:17.683 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.TestTrashMoveAndPurgeNonExpiredDelay (0 ms) 2024-09-16T16:53:17.683 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.TestTrashPurge 2024-09-16T16:53:17.684 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:11753: Skipped 2024-09-16T16:53:17.684 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:53:17.684 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.TestTrashPurge (0 ms) 2024-09-16T16:53:17.684 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.TestTrashMoveAndRestore 2024-09-16T16:53:17.684 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:11810: Skipped 2024-09-16T16:53:17.684 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:53:17.684 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.TestTrashMoveAndRestore (0 ms) 2024-09-16T16:53:17.684 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.TestListWatchers 2024-09-16T16:53:17.684 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:53:17.936 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.TestListWatchers (254 ms) 2024-09-16T16:53:17.936 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.TestSetSnapById 2024-09-16T16:53:17.936 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:53:18.845 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.TestSetSnapById (909 ms) 2024-09-16T16:53:18.846 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.Namespaces 2024-09-16T16:53:19.102 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.Namespaces (257 ms) 2024-09-16T16:53:19.102 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.NamespacesPP 2024-09-16T16:53:19.431 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:53:19.444 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.NamespacesPP (342 ms) 2024-09-16T16:53:19.444 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.Migration 2024-09-16T16:53:19.444 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:53:19.444 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:53:22.962 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.Migration (3518 ms) 2024-09-16T16:53:22.962 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.MigrationPP 2024-09-16T16:53:22.962 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:53:22.962 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:53:26.449 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.MigrationPP (3486 ms) 2024-09-16T16:53:26.449 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.TestGetAccessTimestamp 2024-09-16T16:53:26.449 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:12177: Skipped 2024-09-16T16:53:26.450 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:53:26.450 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.TestGetAccessTimestamp (0 ms) 2024-09-16T16:53:26.450 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.TestGetModifyTimestamp 2024-09-16T16:53:26.450 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:12202: Skipped 2024-09-16T16:53:26.450 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:53:26.450 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.TestGetModifyTimestamp (0 ms) 2024-09-16T16:53:26.450 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.ZeroOverlapFlatten 2024-09-16T16:53:26.450 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:12225: Skipped 2024-09-16T16:53:26.450 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:53:26.450 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.ZeroOverlapFlatten (0 ms) 2024-09-16T16:53:26.450 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.PoolMetadata 2024-09-16T16:53:26.450 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:12258: Skipped 2024-09-16T16:53:26.450 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:53:26.450 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.PoolMetadata (0 ms) 2024-09-16T16:53:26.451 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.PoolMetadataPP 2024-09-16T16:53:26.451 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:12370: Skipped 2024-09-16T16:53:26.451 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:53:26.451 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.PoolMetadataPP (0 ms) 2024-09-16T16:53:26.451 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.Config 2024-09-16T16:53:26.451 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:12422: Skipped 2024-09-16T16:53:26.451 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:53:26.451 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.Config (0 ms) 2024-09-16T16:53:26.451 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.ConfigPP 2024-09-16T16:53:26.451 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:12506: Skipped 2024-09-16T16:53:26.451 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:53:26.451 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.ConfigPP (0 ms) 2024-09-16T16:53:26.451 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.PoolStatsPP 2024-09-16T16:53:26.451 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:12583: Skipped 2024-09-16T16:53:26.451 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:53:26.452 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.PoolStatsPP (0 ms) 2024-09-16T16:53:26.452 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.ImageSpec 2024-09-16T16:53:26.452 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:12658: Skipped 2024-09-16T16:53:26.452 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:53:26.452 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.ImageSpec (0 ms) 2024-09-16T16:53:26.452 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.SnapRemoveWithChildMissing 2024-09-16T16:53:26.452 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:12853: Skipped 2024-09-16T16:53:26.452 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:53:26.452 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.SnapRemoveWithChildMissing (0 ms) 2024-09-16T16:53:26.452 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.QuiesceWatch 2024-09-16T16:53:26.452 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:53:32.716 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.QuiesceWatch (6268 ms) 2024-09-16T16:53:32.716 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.QuiesceWatchPP 2024-09-16T16:53:32.716 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:53:38.771 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.QuiesceWatchPP (6054 ms) 2024-09-16T16:53:38.771 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.QuiesceWatchError 2024-09-16T16:53:38.771 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:13115: Skipped 2024-09-16T16:53:38.771 INFO:tasks.workunit.client.0.smithi172.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:38.771 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.QuiesceWatchError (0 ms) 2024-09-16T16:53:38.771 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.QuiesceWatchTimeout 2024-09-16T16:53:38.771 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:53:38.848 INFO:tasks.workunit.client.0.smithi172.stderr:test quiesce is not long enough to time out 2024-09-16T16:53:47.620 INFO:tasks.workunit.client.0.smithi172.stderr:test quiesce is timed out 2024-09-16T16:53:47.638 INFO:tasks.workunit.client.0.smithi172.stderr:waiting for timed out ... 0 2024-09-16T16:53:48.638 INFO:tasks.workunit.client.0.smithi172.stderr:waiting for timed out ... 1 2024-09-16T16:53:49.639 INFO:tasks.workunit.client.0.smithi172.stderr:waiting for timed out ... 2 2024-09-16T16:53:50.639 INFO:tasks.workunit.client.0.smithi172.stderr:waiting for timed out ... 3 2024-09-16T16:53:51.639 INFO:tasks.workunit.client.0.smithi172.stderr:waiting for timed out ... 4 2024-09-16T16:53:52.639 INFO:tasks.workunit.client.0.smithi172.stderr:waiting for timed out ... 5 2024-09-16T16:53:53.639 INFO:tasks.workunit.client.0.smithi172.stderr:waiting for timed out ... 6 2024-09-16T16:53:54.639 INFO:tasks.workunit.client.0.smithi172.stderr:waiting for timed out ... 7 2024-09-16T16:53:55.639 INFO:tasks.workunit.client.0.smithi172.stderr:waiting for timed out ... 8 2024-09-16T16:53:56.639 INFO:tasks.workunit.client.0.smithi172.stderr:waiting for timed out ... 9 2024-09-16T16:53:57.639 INFO:tasks.workunit.client.0.smithi172.stderr:waiting for timed out ... 10 2024-09-16T16:54:08.640 INFO:tasks.workunit.client.0.smithi172.stderr:test retry succeeds 2024-09-16T16:54:11.799 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.QuiesceWatchTimeout (33028 ms) 2024-09-16T16:54:11.813 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.WriteZeroes 2024-09-16T16:54:11.813 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:54:11.997 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.WriteZeroes (199 ms) 2024-09-16T16:54:11.997 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.WriteZeroesThickProvision 2024-09-16T16:54:11.997 INFO:tasks.workunit.client.0.smithi172.stdout:using old format 2024-09-16T16:54:12.268 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestLibRBD.WriteZeroesThickProvision (271 ms) 2024-09-16T16:54:12.268 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.ConcurrentOperations 2024-09-16T16:54:12.268 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:13474: Skipped 2024-09-16T16:54:12.268 INFO:tasks.workunit.client.0.smithi172.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:54:12.268 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.ConcurrentOperations (0 ms) 2024-09-16T16:54:12.268 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestLibRBD.FormatAndCloneFormatOptions 2024-09-16T16:54:12.268 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:13630: Skipped 2024-09-16T16:54:12.268 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:12.268 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.FormatAndCloneFormatOptions (0 ms) 2024-09-16T16:54:18.485 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] 171 tests from TestLibRBD (525388 ms total) 2024-09-16T16:54:18.486 INFO:tasks.workunit.client.0.smithi172.stdout: 2024-09-16T16:54:18.486 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] Global test environment tear-down 2024-09-16T16:54:18.486 INFO:tasks.workunit.client.0.smithi172.stdout:[==========] 171 tests from 1 test suite ran. (531652 ms total) 2024-09-16T16:54:18.486 INFO:tasks.workunit.client.0.smithi172.stdout:[ PASSED ] 104 tests. 2024-09-16T16:54:18.486 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] 67 tests, listed below: 2024-09-16T16:54:18.486 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.CreateWithSameDataPool 2024-09-16T16:54:18.486 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.TestGetCreateTimestamp 2024-09-16T16:54:18.486 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.GetCreateTimestampPP 2024-09-16T16:54:18.486 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.TestDeepCopy 2024-09-16T16:54:18.486 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.TestDeepCopyPP 2024-09-16T16:54:18.486 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.TestGetSnapShotTimeStamp 2024-09-16T16:54:18.486 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.RemoveFullTryDataPool 2024-09-16T16:54:18.487 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.RemoveFullTryNamespace 2024-09-16T16:54:18.487 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.RemoveFullTryNamespaceDataPool 2024-09-16T16:54:18.487 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.TestCloneEncryption 2024-09-16T16:54:18.487 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.LUKS1UnderLUKS2WithoutResize 2024-09-16T16:54:18.487 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.LUKS2UnderLUKS1WithoutResize 2024-09-16T16:54:18.487 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.EncryptionLoadBadStripePattern 2024-09-16T16:54:18.487 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.EncryptionLoadFormatMismatch 2024-09-16T16:54:18.487 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.EncryptedFlattenSmallData 2024-09-16T16:54:18.487 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.TestDataPoolIO 2024-09-16T16:54:18.487 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.TestClone 2024-09-16T16:54:18.487 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.TestClone2 2024-09-16T16:54:18.487 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.ListChildren 2024-09-16T16:54:18.487 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.ListChildrenTiered 2024-09-16T16:54:18.487 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.TestPendingAio 2024-09-16T16:54:18.487 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.CompareAndWriteCopyup 2024-09-16T16:54:18.488 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.CompareAndWriteCopyupMismatch 2024-09-16T16:54:18.488 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.Flatten 2024-09-16T16:54:18.488 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.RebuildObjectMapViaLockOwner 2024-09-16T16:54:18.488 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.RenameViaLockOwner 2024-09-16T16:54:18.488 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.SnapCreateViaLockOwner 2024-09-16T16:54:18.488 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.SnapRemoveViaLockOwner 2024-09-16T16:54:18.488 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.UpdateFeaturesViaLockOwner 2024-09-16T16:54:18.488 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.EnableJournalingViaLockOwner 2024-09-16T16:54:18.488 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.SnapRemove2 2024-09-16T16:54:18.488 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.SnapRenameViaLockOwner 2024-09-16T16:54:18.488 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.SnapProtectViaLockOwner 2024-09-16T16:54:18.488 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.SnapUnprotectViaLockOwner 2024-09-16T16:54:18.488 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.FlattenViaLockOwner 2024-09-16T16:54:18.488 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.ResizeViaLockOwner 2024-09-16T16:54:18.489 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.SparsifyViaLockOwner 2024-09-16T16:54:18.489 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.ObjectMapConsistentSnap 2024-09-16T16:54:18.489 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.Metadata 2024-09-16T16:54:18.489 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.MetadataPP 2024-09-16T16:54:18.489 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.UpdateFeatures 2024-09-16T16:54:18.489 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.RebuildNewObjectMap 2024-09-16T16:54:18.489 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.CheckObjectMap 2024-09-16T16:54:18.489 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.ExclusiveLockTransition 2024-09-16T16:54:18.489 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.ExclusiveLockReadTransition 2024-09-16T16:54:18.489 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.CacheMayCopyOnWrite 2024-09-16T16:54:18.489 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.CreateWithMirrorEnabled 2024-09-16T16:54:18.489 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.FlushCacheWithCopyupOnExternalSnapshot 2024-09-16T16:54:18.490 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.ExclusiveLock 2024-09-16T16:54:18.490 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.BreakLock 2024-09-16T16:54:18.490 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.TestTrashMoveAndPurge 2024-09-16T16:54:18.490 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.TestTrashMoveAndPurgeNonExpiredDelay 2024-09-16T16:54:18.490 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.TestTrashPurge 2024-09-16T16:54:18.490 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.TestTrashMoveAndRestore 2024-09-16T16:54:18.490 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.TestGetAccessTimestamp 2024-09-16T16:54:18.490 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.TestGetModifyTimestamp 2024-09-16T16:54:18.490 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.ZeroOverlapFlatten 2024-09-16T16:54:18.490 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.PoolMetadata 2024-09-16T16:54:18.490 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.PoolMetadataPP 2024-09-16T16:54:18.490 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.Config 2024-09-16T16:54:18.490 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.ConfigPP 2024-09-16T16:54:18.490 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.PoolStatsPP 2024-09-16T16:54:18.491 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.ImageSpec 2024-09-16T16:54:18.491 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.SnapRemoveWithChildMissing 2024-09-16T16:54:18.491 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.QuiesceWatchError 2024-09-16T16:54:18.491 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.ConcurrentOperations 2024-09-16T16:54:18.491 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestLibRBD.FormatAndCloneFormatOptions 2024-09-16T16:54:18.491 INFO:tasks.workunit.client.0.smithi172.stdout: 2024-09-16T16:54:18.491 INFO:tasks.workunit.client.0.smithi172.stdout: YOU HAVE 1 DISABLED TEST 2024-09-16T16:54:18.491 INFO:tasks.workunit.client.0.smithi172.stdout: 2024-09-16T16:54:18.556 INFO:tasks.workunit.client.0.smithi172.stdout:seed 32178 2024-09-16T16:54:18.556 INFO:tasks.workunit.client.0.smithi172.stdout:Note: Google Test filter = EncryptedFlattenTest/0.* 2024-09-16T16:54:18.556 INFO:tasks.workunit.client.0.smithi172.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-16T16:54:18.556 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] Global test environment set-up. 2024-09-16T16:54:18.557 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] 7 tests from EncryptedFlattenTest/0, where TypeParam = PlaintextUnderLUKS1 2024-09-16T16:54:18.649 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] EncryptedFlattenTest/0.Simple 2024-09-16T16:54:20.502 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3591: Skipped 2024-09-16T16:54:20.503 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:20.503 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/0.Simple (1853 ms) 2024-09-16T16:54:20.503 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] EncryptedFlattenTest/0.Grow 2024-09-16T16:54:20.503 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3619: Skipped 2024-09-16T16:54:20.503 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:20.503 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/0.Grow (0 ms) 2024-09-16T16:54:20.503 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] EncryptedFlattenTest/0.Shrink 2024-09-16T16:54:20.503 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3650: Skipped 2024-09-16T16:54:20.503 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:20.503 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/0.Shrink (0 ms) 2024-09-16T16:54:20.503 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] EncryptedFlattenTest/0.ShrinkToOne 2024-09-16T16:54:20.503 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3680: Skipped 2024-09-16T16:54:20.504 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:20.504 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/0.ShrinkToOne (0 ms) 2024-09-16T16:54:20.504 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] EncryptedFlattenTest/0.ShrinkToOneAfterSnapshot 2024-09-16T16:54:20.504 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3709: Skipped 2024-09-16T16:54:20.504 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:20.504 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/0.ShrinkToOneAfterSnapshot (0 ms) 2024-09-16T16:54:20.504 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] EncryptedFlattenTest/0.MinOverlap 2024-09-16T16:54:20.504 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3739: Skipped 2024-09-16T16:54:20.504 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:20.504 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/0.MinOverlap (0 ms) 2024-09-16T16:54:20.504 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] EncryptedFlattenTest/0.ZeroOverlap 2024-09-16T16:54:20.504 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3770: Skipped 2024-09-16T16:54:20.504 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:20.504 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/0.ZeroOverlap (0 ms) 2024-09-16T16:54:21.516 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] 7 tests from EncryptedFlattenTest/0 (1853 ms total) 2024-09-16T16:54:21.516 INFO:tasks.workunit.client.0.smithi172.stdout: 2024-09-16T16:54:21.516 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] Global test environment tear-down 2024-09-16T16:54:21.516 INFO:tasks.workunit.client.0.smithi172.stdout:[==========] 7 tests from 1 test suite ran. (2960 ms total) 2024-09-16T16:54:21.516 INFO:tasks.workunit.client.0.smithi172.stdout:[ PASSED ] 0 tests. 2024-09-16T16:54:21.516 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] 7 tests, listed below: 2024-09-16T16:54:21.516 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/0.Simple 2024-09-16T16:54:21.516 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/0.Grow 2024-09-16T16:54:21.517 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/0.Shrink 2024-09-16T16:54:21.517 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/0.ShrinkToOne 2024-09-16T16:54:21.517 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/0.ShrinkToOneAfterSnapshot 2024-09-16T16:54:21.517 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/0.MinOverlap 2024-09-16T16:54:21.517 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/0.ZeroOverlap 2024-09-16T16:54:21.591 INFO:tasks.workunit.client.0.smithi172.stdout:seed 32242 2024-09-16T16:54:21.592 INFO:tasks.workunit.client.0.smithi172.stdout:Note: Google Test filter = EncryptedFlattenTest/1.* 2024-09-16T16:54:21.592 INFO:tasks.workunit.client.0.smithi172.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-16T16:54:21.592 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] Global test environment set-up. 2024-09-16T16:54:21.592 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] 7 tests from EncryptedFlattenTest/1, where TypeParam = PlaintextUnderLUKS2 2024-09-16T16:54:21.700 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] EncryptedFlattenTest/1.Simple 2024-09-16T16:54:23.528 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3591: Skipped 2024-09-16T16:54:23.528 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:23.528 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/1.Simple (1827 ms) 2024-09-16T16:54:23.528 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] EncryptedFlattenTest/1.Grow 2024-09-16T16:54:23.528 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3619: Skipped 2024-09-16T16:54:23.529 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:23.529 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/1.Grow (0 ms) 2024-09-16T16:54:23.529 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] EncryptedFlattenTest/1.Shrink 2024-09-16T16:54:23.529 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3650: Skipped 2024-09-16T16:54:23.529 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:23.529 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/1.Shrink (0 ms) 2024-09-16T16:54:23.529 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] EncryptedFlattenTest/1.ShrinkToOne 2024-09-16T16:54:23.529 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3680: Skipped 2024-09-16T16:54:23.529 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:23.531 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/1.ShrinkToOne (0 ms) 2024-09-16T16:54:23.531 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] EncryptedFlattenTest/1.ShrinkToOneAfterSnapshot 2024-09-16T16:54:23.532 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3709: Skipped 2024-09-16T16:54:23.532 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:23.532 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/1.ShrinkToOneAfterSnapshot (0 ms) 2024-09-16T16:54:23.532 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] EncryptedFlattenTest/1.MinOverlap 2024-09-16T16:54:23.532 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3739: Skipped 2024-09-16T16:54:23.532 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:23.532 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/1.MinOverlap (0 ms) 2024-09-16T16:54:23.532 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] EncryptedFlattenTest/1.ZeroOverlap 2024-09-16T16:54:23.532 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3770: Skipped 2024-09-16T16:54:23.532 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:23.532 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/1.ZeroOverlap (0 ms) 2024-09-16T16:54:24.529 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] 7 tests from EncryptedFlattenTest/1 (1828 ms total) 2024-09-16T16:54:24.529 INFO:tasks.workunit.client.0.smithi172.stdout: 2024-09-16T16:54:24.530 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] Global test environment tear-down 2024-09-16T16:54:24.530 INFO:tasks.workunit.client.0.smithi172.stdout:[==========] 7 tests from 1 test suite ran. (2937 ms total) 2024-09-16T16:54:24.530 INFO:tasks.workunit.client.0.smithi172.stdout:[ PASSED ] 0 tests. 2024-09-16T16:54:24.530 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] 7 tests, listed below: 2024-09-16T16:54:24.530 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/1.Simple 2024-09-16T16:54:24.530 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/1.Grow 2024-09-16T16:54:24.530 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/1.Shrink 2024-09-16T16:54:24.530 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/1.ShrinkToOne 2024-09-16T16:54:24.530 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/1.ShrinkToOneAfterSnapshot 2024-09-16T16:54:24.530 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/1.MinOverlap 2024-09-16T16:54:24.530 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/1.ZeroOverlap 2024-09-16T16:54:24.638 INFO:tasks.workunit.client.0.smithi172.stdout:seed 32306 2024-09-16T16:54:24.641 INFO:tasks.workunit.client.0.smithi172.stdout:Note: Google Test filter = EncryptedFlattenTest/2.* 2024-09-16T16:54:24.642 INFO:tasks.workunit.client.0.smithi172.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-16T16:54:24.642 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] Global test environment set-up. 2024-09-16T16:54:24.642 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] 7 tests from EncryptedFlattenTest/2, where TypeParam = UnformattedLUKS1 2024-09-16T16:54:24.719 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] EncryptedFlattenTest/2.Simple 2024-09-16T16:54:26.382 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3591: Skipped 2024-09-16T16:54:26.382 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:26.382 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/2.Simple (1662 ms) 2024-09-16T16:54:26.382 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] EncryptedFlattenTest/2.Grow 2024-09-16T16:54:26.382 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3619: Skipped 2024-09-16T16:54:26.382 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:26.382 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/2.Grow (0 ms) 2024-09-16T16:54:26.382 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] EncryptedFlattenTest/2.Shrink 2024-09-16T16:54:26.383 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3650: Skipped 2024-09-16T16:54:26.383 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:26.383 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/2.Shrink (0 ms) 2024-09-16T16:54:26.383 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] EncryptedFlattenTest/2.ShrinkToOne 2024-09-16T16:54:26.383 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3680: Skipped 2024-09-16T16:54:26.383 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:26.383 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/2.ShrinkToOne (0 ms) 2024-09-16T16:54:26.383 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] EncryptedFlattenTest/2.ShrinkToOneAfterSnapshot 2024-09-16T16:54:26.383 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3709: Skipped 2024-09-16T16:54:26.383 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:26.383 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/2.ShrinkToOneAfterSnapshot (0 ms) 2024-09-16T16:54:26.383 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] EncryptedFlattenTest/2.MinOverlap 2024-09-16T16:54:26.383 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3739: Skipped 2024-09-16T16:54:26.383 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:26.383 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/2.MinOverlap (0 ms) 2024-09-16T16:54:26.384 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] EncryptedFlattenTest/2.ZeroOverlap 2024-09-16T16:54:26.384 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3770: Skipped 2024-09-16T16:54:26.384 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:26.384 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/2.ZeroOverlap (0 ms) 2024-09-16T16:54:27.385 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] 7 tests from EncryptedFlattenTest/2 (1662 ms total) 2024-09-16T16:54:27.385 INFO:tasks.workunit.client.0.smithi172.stdout: 2024-09-16T16:54:27.385 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] Global test environment tear-down 2024-09-16T16:54:27.386 INFO:tasks.workunit.client.0.smithi172.stdout:[==========] 7 tests from 1 test suite ran. (2743 ms total) 2024-09-16T16:54:27.386 INFO:tasks.workunit.client.0.smithi172.stdout:[ PASSED ] 0 tests. 2024-09-16T16:54:27.386 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] 7 tests, listed below: 2024-09-16T16:54:27.386 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/2.Simple 2024-09-16T16:54:27.386 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/2.Grow 2024-09-16T16:54:27.386 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/2.Shrink 2024-09-16T16:54:27.387 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/2.ShrinkToOne 2024-09-16T16:54:27.387 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/2.ShrinkToOneAfterSnapshot 2024-09-16T16:54:27.387 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/2.MinOverlap 2024-09-16T16:54:27.387 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/2.ZeroOverlap 2024-09-16T16:54:27.473 INFO:tasks.workunit.client.0.smithi172.stdout:seed 32370 2024-09-16T16:54:27.474 INFO:tasks.workunit.client.0.smithi172.stdout:Note: Google Test filter = EncryptedFlattenTest/3.* 2024-09-16T16:54:27.474 INFO:tasks.workunit.client.0.smithi172.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-16T16:54:27.474 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] Global test environment set-up. 2024-09-16T16:54:27.474 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] 7 tests from EncryptedFlattenTest/3, where TypeParam = LUKS1UnderLUKS1 2024-09-16T16:54:27.562 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] EncryptedFlattenTest/3.Simple 2024-09-16T16:54:29.546 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3591: Skipped 2024-09-16T16:54:29.546 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:29.547 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/3.Simple (1984 ms) 2024-09-16T16:54:29.547 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] EncryptedFlattenTest/3.Grow 2024-09-16T16:54:29.547 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3619: Skipped 2024-09-16T16:54:29.547 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:29.547 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/3.Grow (0 ms) 2024-09-16T16:54:29.547 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] EncryptedFlattenTest/3.Shrink 2024-09-16T16:54:29.547 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3650: Skipped 2024-09-16T16:54:29.547 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:29.547 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/3.Shrink (0 ms) 2024-09-16T16:54:29.547 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] EncryptedFlattenTest/3.ShrinkToOne 2024-09-16T16:54:29.547 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3680: Skipped 2024-09-16T16:54:29.547 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:29.547 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/3.ShrinkToOne (0 ms) 2024-09-16T16:54:29.548 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] EncryptedFlattenTest/3.ShrinkToOneAfterSnapshot 2024-09-16T16:54:29.548 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3709: Skipped 2024-09-16T16:54:29.548 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:29.548 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/3.ShrinkToOneAfterSnapshot (0 ms) 2024-09-16T16:54:29.548 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] EncryptedFlattenTest/3.MinOverlap 2024-09-16T16:54:29.548 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3739: Skipped 2024-09-16T16:54:29.548 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:29.548 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/3.MinOverlap (0 ms) 2024-09-16T16:54:29.548 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] EncryptedFlattenTest/3.ZeroOverlap 2024-09-16T16:54:29.548 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3770: Skipped 2024-09-16T16:54:29.548 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:29.548 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/3.ZeroOverlap (0 ms) 2024-09-16T16:54:30.545 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] 7 tests from EncryptedFlattenTest/3 (1984 ms total) 2024-09-16T16:54:30.545 INFO:tasks.workunit.client.0.smithi172.stdout: 2024-09-16T16:54:30.545 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] Global test environment tear-down 2024-09-16T16:54:30.545 INFO:tasks.workunit.client.0.smithi172.stdout:[==========] 7 tests from 1 test suite ran. (3071 ms total) 2024-09-16T16:54:30.546 INFO:tasks.workunit.client.0.smithi172.stdout:[ PASSED ] 0 tests. 2024-09-16T16:54:30.546 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] 7 tests, listed below: 2024-09-16T16:54:30.546 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/3.Simple 2024-09-16T16:54:30.546 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/3.Grow 2024-09-16T16:54:30.546 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/3.Shrink 2024-09-16T16:54:30.546 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/3.ShrinkToOne 2024-09-16T16:54:30.546 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/3.ShrinkToOneAfterSnapshot 2024-09-16T16:54:30.546 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/3.MinOverlap 2024-09-16T16:54:30.546 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/3.ZeroOverlap 2024-09-16T16:54:30.648 INFO:tasks.workunit.client.0.smithi172.stdout:seed 32434 2024-09-16T16:54:30.648 INFO:tasks.workunit.client.0.smithi172.stdout:Note: Google Test filter = EncryptedFlattenTest/4.* 2024-09-16T16:54:30.648 INFO:tasks.workunit.client.0.smithi172.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-16T16:54:30.648 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] Global test environment set-up. 2024-09-16T16:54:30.648 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] 7 tests from EncryptedFlattenTest/4, where TypeParam = LUKS1UnderLUKS2 2024-09-16T16:54:30.728 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] EncryptedFlattenTest/4.Simple 2024-09-16T16:54:32.557 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3591: Skipped 2024-09-16T16:54:32.557 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:32.557 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/4.Simple (1827 ms) 2024-09-16T16:54:32.557 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] EncryptedFlattenTest/4.Grow 2024-09-16T16:54:32.557 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3619: Skipped 2024-09-16T16:54:32.558 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:32.558 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/4.Grow (0 ms) 2024-09-16T16:54:32.558 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] EncryptedFlattenTest/4.Shrink 2024-09-16T16:54:32.558 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3650: Skipped 2024-09-16T16:54:32.558 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:32.558 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/4.Shrink (0 ms) 2024-09-16T16:54:32.558 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] EncryptedFlattenTest/4.ShrinkToOne 2024-09-16T16:54:32.558 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3680: Skipped 2024-09-16T16:54:32.558 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:32.558 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/4.ShrinkToOne (0 ms) 2024-09-16T16:54:32.558 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] EncryptedFlattenTest/4.ShrinkToOneAfterSnapshot 2024-09-16T16:54:32.558 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3709: Skipped 2024-09-16T16:54:32.558 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:32.558 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/4.ShrinkToOneAfterSnapshot (0 ms) 2024-09-16T16:54:32.559 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] EncryptedFlattenTest/4.MinOverlap 2024-09-16T16:54:32.559 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3739: Skipped 2024-09-16T16:54:32.559 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:32.559 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/4.MinOverlap (0 ms) 2024-09-16T16:54:32.559 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] EncryptedFlattenTest/4.ZeroOverlap 2024-09-16T16:54:32.559 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3770: Skipped 2024-09-16T16:54:32.559 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:32.559 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/4.ZeroOverlap (0 ms) 2024-09-16T16:54:33.560 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] 7 tests from EncryptedFlattenTest/4 (1827 ms total) 2024-09-16T16:54:33.560 INFO:tasks.workunit.client.0.smithi172.stdout: 2024-09-16T16:54:33.560 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] Global test environment tear-down 2024-09-16T16:54:33.560 INFO:tasks.workunit.client.0.smithi172.stdout:[==========] 7 tests from 1 test suite ran. (2912 ms total) 2024-09-16T16:54:33.560 INFO:tasks.workunit.client.0.smithi172.stdout:[ PASSED ] 0 tests. 2024-09-16T16:54:33.560 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] 7 tests, listed below: 2024-09-16T16:54:33.561 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/4.Simple 2024-09-16T16:54:33.561 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/4.Grow 2024-09-16T16:54:33.561 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/4.Shrink 2024-09-16T16:54:33.561 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/4.ShrinkToOne 2024-09-16T16:54:33.561 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/4.ShrinkToOneAfterSnapshot 2024-09-16T16:54:33.561 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/4.MinOverlap 2024-09-16T16:54:33.561 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/4.ZeroOverlap 2024-09-16T16:54:33.667 INFO:tasks.workunit.client.0.smithi172.stdout:seed 32498 2024-09-16T16:54:33.667 INFO:tasks.workunit.client.0.smithi172.stdout:Note: Google Test filter = EncryptedFlattenTest/5.* 2024-09-16T16:54:33.667 INFO:tasks.workunit.client.0.smithi172.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-16T16:54:33.668 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] Global test environment set-up. 2024-09-16T16:54:33.668 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] 7 tests from EncryptedFlattenTest/5, where TypeParam = UnformattedLUKS2 2024-09-16T16:54:33.742 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] EncryptedFlattenTest/5.Simple 2024-09-16T16:54:35.576 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3591: Skipped 2024-09-16T16:54:35.576 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:35.577 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/5.Simple (1833 ms) 2024-09-16T16:54:35.577 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] EncryptedFlattenTest/5.Grow 2024-09-16T16:54:35.577 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3619: Skipped 2024-09-16T16:54:35.577 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:35.577 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/5.Grow (0 ms) 2024-09-16T16:54:35.577 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] EncryptedFlattenTest/5.Shrink 2024-09-16T16:54:35.577 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3650: Skipped 2024-09-16T16:54:35.577 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:35.577 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/5.Shrink (0 ms) 2024-09-16T16:54:35.577 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] EncryptedFlattenTest/5.ShrinkToOne 2024-09-16T16:54:35.577 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3680: Skipped 2024-09-16T16:54:35.577 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:35.577 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/5.ShrinkToOne (0 ms) 2024-09-16T16:54:35.578 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] EncryptedFlattenTest/5.ShrinkToOneAfterSnapshot 2024-09-16T16:54:35.578 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3709: Skipped 2024-09-16T16:54:35.578 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:35.578 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/5.ShrinkToOneAfterSnapshot (0 ms) 2024-09-16T16:54:35.578 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] EncryptedFlattenTest/5.MinOverlap 2024-09-16T16:54:35.578 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3739: Skipped 2024-09-16T16:54:35.578 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:35.578 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/5.MinOverlap (0 ms) 2024-09-16T16:54:35.578 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] EncryptedFlattenTest/5.ZeroOverlap 2024-09-16T16:54:35.578 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3770: Skipped 2024-09-16T16:54:35.578 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:35.578 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/5.ZeroOverlap (0 ms) 2024-09-16T16:54:36.574 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] 7 tests from EncryptedFlattenTest/5 (1833 ms total) 2024-09-16T16:54:36.574 INFO:tasks.workunit.client.0.smithi172.stdout: 2024-09-16T16:54:36.574 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] Global test environment tear-down 2024-09-16T16:54:36.574 INFO:tasks.workunit.client.0.smithi172.stdout:[==========] 7 tests from 1 test suite ran. (2906 ms total) 2024-09-16T16:54:36.574 INFO:tasks.workunit.client.0.smithi172.stdout:[ PASSED ] 0 tests. 2024-09-16T16:54:36.574 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] 7 tests, listed below: 2024-09-16T16:54:36.574 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/5.Simple 2024-09-16T16:54:36.574 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/5.Grow 2024-09-16T16:54:36.575 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/5.Shrink 2024-09-16T16:54:36.575 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/5.ShrinkToOne 2024-09-16T16:54:36.575 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/5.ShrinkToOneAfterSnapshot 2024-09-16T16:54:36.575 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/5.MinOverlap 2024-09-16T16:54:36.575 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/5.ZeroOverlap 2024-09-16T16:54:36.654 INFO:tasks.workunit.client.0.smithi172.stdout:seed 32562 2024-09-16T16:54:36.654 INFO:tasks.workunit.client.0.smithi172.stdout:Note: Google Test filter = EncryptedFlattenTest/6.* 2024-09-16T16:54:36.654 INFO:tasks.workunit.client.0.smithi172.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-16T16:54:36.655 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] Global test environment set-up. 2024-09-16T16:54:36.655 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] 7 tests from EncryptedFlattenTest/6, where TypeParam = LUKS2UnderLUKS2 2024-09-16T16:54:36.739 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] EncryptedFlattenTest/6.Simple 2024-09-16T16:54:38.585 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3591: Skipped 2024-09-16T16:54:38.585 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:38.585 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/6.Simple (1846 ms) 2024-09-16T16:54:38.586 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] EncryptedFlattenTest/6.Grow 2024-09-16T16:54:38.586 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3619: Skipped 2024-09-16T16:54:38.586 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:38.586 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/6.Grow (0 ms) 2024-09-16T16:54:38.586 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] EncryptedFlattenTest/6.Shrink 2024-09-16T16:54:38.586 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3650: Skipped 2024-09-16T16:54:38.586 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:38.586 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/6.Shrink (0 ms) 2024-09-16T16:54:38.586 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] EncryptedFlattenTest/6.ShrinkToOne 2024-09-16T16:54:38.586 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3680: Skipped 2024-09-16T16:54:38.586 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:38.586 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/6.ShrinkToOne (0 ms) 2024-09-16T16:54:38.587 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] EncryptedFlattenTest/6.ShrinkToOneAfterSnapshot 2024-09-16T16:54:38.587 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3709: Skipped 2024-09-16T16:54:38.587 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:38.587 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/6.ShrinkToOneAfterSnapshot (0 ms) 2024-09-16T16:54:38.587 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] EncryptedFlattenTest/6.MinOverlap 2024-09-16T16:54:38.587 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3739: Skipped 2024-09-16T16:54:38.587 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:38.587 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/6.MinOverlap (0 ms) 2024-09-16T16:54:38.587 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] EncryptedFlattenTest/6.ZeroOverlap 2024-09-16T16:54:38.587 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3770: Skipped 2024-09-16T16:54:38.587 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:38.587 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/6.ZeroOverlap (0 ms) 2024-09-16T16:54:39.589 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] 7 tests from EncryptedFlattenTest/6 (1846 ms total) 2024-09-16T16:54:39.590 INFO:tasks.workunit.client.0.smithi172.stdout: 2024-09-16T16:54:39.590 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] Global test environment tear-down 2024-09-16T16:54:39.590 INFO:tasks.workunit.client.0.smithi172.stdout:[==========] 7 tests from 1 test suite ran. (2937 ms total) 2024-09-16T16:54:39.590 INFO:tasks.workunit.client.0.smithi172.stdout:[ PASSED ] 0 tests. 2024-09-16T16:54:39.590 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] 7 tests, listed below: 2024-09-16T16:54:39.590 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/6.Simple 2024-09-16T16:54:39.590 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/6.Grow 2024-09-16T16:54:39.590 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/6.Shrink 2024-09-16T16:54:39.590 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/6.ShrinkToOne 2024-09-16T16:54:39.590 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/6.ShrinkToOneAfterSnapshot 2024-09-16T16:54:39.590 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/6.MinOverlap 2024-09-16T16:54:39.590 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/6.ZeroOverlap 2024-09-16T16:54:39.691 INFO:tasks.workunit.client.0.smithi172.stdout:seed 32626 2024-09-16T16:54:39.691 INFO:tasks.workunit.client.0.smithi172.stdout:Note: Google Test filter = EncryptedFlattenTest/7.* 2024-09-16T16:54:39.691 INFO:tasks.workunit.client.0.smithi172.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-16T16:54:39.691 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] Global test environment set-up. 2024-09-16T16:54:39.691 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] 7 tests from EncryptedFlattenTest/7, where TypeParam = LUKS2UnderLUKS1 2024-09-16T16:54:39.765 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] EncryptedFlattenTest/7.Simple 2024-09-16T16:54:41.591 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3591: Skipped 2024-09-16T16:54:41.591 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:41.591 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/7.Simple (1825 ms) 2024-09-16T16:54:41.591 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] EncryptedFlattenTest/7.Grow 2024-09-16T16:54:41.591 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3619: Skipped 2024-09-16T16:54:41.591 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:41.591 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/7.Grow (0 ms) 2024-09-16T16:54:41.591 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] EncryptedFlattenTest/7.Shrink 2024-09-16T16:54:41.592 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3650: Skipped 2024-09-16T16:54:41.592 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:41.592 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/7.Shrink (0 ms) 2024-09-16T16:54:41.592 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] EncryptedFlattenTest/7.ShrinkToOne 2024-09-16T16:54:41.592 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3680: Skipped 2024-09-16T16:54:41.592 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:41.592 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/7.ShrinkToOne (0 ms) 2024-09-16T16:54:41.592 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] EncryptedFlattenTest/7.ShrinkToOneAfterSnapshot 2024-09-16T16:54:41.592 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3709: Skipped 2024-09-16T16:54:41.592 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:41.592 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/7.ShrinkToOneAfterSnapshot (0 ms) 2024-09-16T16:54:41.592 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] EncryptedFlattenTest/7.MinOverlap 2024-09-16T16:54:41.592 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3739: Skipped 2024-09-16T16:54:41.592 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:41.593 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/7.MinOverlap (0 ms) 2024-09-16T16:54:41.593 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] EncryptedFlattenTest/7.ZeroOverlap 2024-09-16T16:54:41.593 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_librbd.cc:3770: Skipped 2024-09-16T16:54:41.593 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:41.593 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/7.ZeroOverlap (0 ms) 2024-09-16T16:54:42.593 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] 7 tests from EncryptedFlattenTest/7 (1825 ms total) 2024-09-16T16:54:42.594 INFO:tasks.workunit.client.0.smithi172.stdout: 2024-09-16T16:54:42.594 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] Global test environment tear-down 2024-09-16T16:54:42.594 INFO:tasks.workunit.client.0.smithi172.stdout:[==========] 7 tests from 1 test suite ran. (2902 ms total) 2024-09-16T16:54:42.594 INFO:tasks.workunit.client.0.smithi172.stdout:[ PASSED ] 0 tests. 2024-09-16T16:54:42.594 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] 7 tests, listed below: 2024-09-16T16:54:42.594 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/7.Simple 2024-09-16T16:54:42.594 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/7.Grow 2024-09-16T16:54:42.594 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/7.Shrink 2024-09-16T16:54:42.594 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/7.ShrinkToOne 2024-09-16T16:54:42.594 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/7.ShrinkToOneAfterSnapshot 2024-09-16T16:54:42.594 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/7.MinOverlap 2024-09-16T16:54:42.594 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] EncryptedFlattenTest/7.ZeroOverlap 2024-09-16T16:54:42.683 INFO:tasks.workunit.client.0.smithi172.stdout:seed 32690 2024-09-16T16:54:42.686 INFO:tasks.workunit.client.0.smithi172.stdout:Note: Google Test filter = TestImageWatcher.* 2024-09-16T16:54:42.686 INFO:tasks.workunit.client.0.smithi172.stdout:[==========] Running 17 tests from 1 test suite. 2024-09-16T16:54:42.686 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] Global test environment set-up. 2024-09-16T16:54:42.686 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] 17 tests from TestImageWatcher 2024-09-16T16:54:44.611 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestImageWatcher.NotifyHeaderUpdate 2024-09-16T16:54:46.456 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ImageWatcher.cc:460: Skipped 2024-09-16T16:54:46.457 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:46.457 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestImageWatcher.NotifyHeaderUpdate (1845 ms) 2024-09-16T16:54:46.457 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestImageWatcher.NotifyFlatten 2024-09-16T16:54:46.493 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ImageWatcher.cc:478: Skipped 2024-09-16T16:54:46.494 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:46.494 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestImageWatcher.NotifyFlatten (38 ms) 2024-09-16T16:54:46.494 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestImageWatcher.NotifyResize 2024-09-16T16:54:46.530 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ImageWatcher.cc:512: Skipped 2024-09-16T16:54:46.530 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:46.530 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestImageWatcher.NotifyResize (36 ms) 2024-09-16T16:54:46.530 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestImageWatcher.NotifyRebuildObjectMap 2024-09-16T16:54:46.567 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ImageWatcher.cc:546: Skipped 2024-09-16T16:54:46.568 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:46.568 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestImageWatcher.NotifyRebuildObjectMap (37 ms) 2024-09-16T16:54:46.568 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestImageWatcher.NotifyUpdateFeatures 2024-09-16T16:54:46.606 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ImageWatcher.cc:581: Skipped 2024-09-16T16:54:46.606 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:46.606 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestImageWatcher.NotifyUpdateFeatures (39 ms) 2024-09-16T16:54:46.606 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestImageWatcher.NotifySnapCreate 2024-09-16T16:54:46.643 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ImageWatcher.cc:611: Skipped 2024-09-16T16:54:46.643 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:46.643 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapCreate (37 ms) 2024-09-16T16:54:46.644 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestImageWatcher.NotifySnapCreateError 2024-09-16T16:54:46.684 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ImageWatcher.cc:646: Skipped 2024-09-16T16:54:46.684 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:46.684 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapCreateError (41 ms) 2024-09-16T16:54:46.685 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestImageWatcher.NotifySnapRename 2024-09-16T16:54:46.723 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ImageWatcher.cc:670: Skipped 2024-09-16T16:54:46.723 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:46.723 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapRename (39 ms) 2024-09-16T16:54:46.723 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestImageWatcher.NotifySnapRenameError 2024-09-16T16:54:46.760 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ImageWatcher.cc:701: Skipped 2024-09-16T16:54:46.760 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:46.761 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapRenameError (38 ms) 2024-09-16T16:54:46.761 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestImageWatcher.NotifySnapRemove 2024-09-16T16:54:46.800 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ImageWatcher.cc:723: Skipped 2024-09-16T16:54:46.800 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:46.800 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapRemove (39 ms) 2024-09-16T16:54:46.800 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestImageWatcher.NotifySnapProtect 2024-09-16T16:54:46.839 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ImageWatcher.cc:754: Skipped 2024-09-16T16:54:46.839 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:46.839 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapProtect (39 ms) 2024-09-16T16:54:46.839 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestImageWatcher.NotifySnapUnprotect 2024-09-16T16:54:46.877 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ImageWatcher.cc:785: Skipped 2024-09-16T16:54:46.877 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:46.877 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapUnprotect (38 ms) 2024-09-16T16:54:46.877 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestImageWatcher.NotifyRename 2024-09-16T16:54:46.915 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ImageWatcher.cc:816: Skipped 2024-09-16T16:54:46.915 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:46.915 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestImageWatcher.NotifyRename (38 ms) 2024-09-16T16:54:46.915 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestImageWatcher.NotifyAsyncTimedOut 2024-09-16T16:54:46.955 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ImageWatcher.cc:847: Skipped 2024-09-16T16:54:46.955 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:46.955 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestImageWatcher.NotifyAsyncTimedOut (40 ms) 2024-09-16T16:54:46.955 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestImageWatcher.NotifyAsyncError 2024-09-16T16:54:46.997 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ImageWatcher.cc:867: Skipped 2024-09-16T16:54:46.998 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:46.998 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestImageWatcher.NotifyAsyncError (43 ms) 2024-09-16T16:54:46.998 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestImageWatcher.NotifyAsyncCompleteError 2024-09-16T16:54:47.038 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ImageWatcher.cc:887: Skipped 2024-09-16T16:54:47.038 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:47.038 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestImageWatcher.NotifyAsyncCompleteError (40 ms) 2024-09-16T16:54:47.038 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestImageWatcher.NotifyAsyncRequestTimedOut 2024-09-16T16:54:47.076 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ImageWatcher.cc:918: Skipped 2024-09-16T16:54:47.076 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:47.077 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestImageWatcher.NotifyAsyncRequestTimedOut (38 ms) 2024-09-16T16:54:47.631 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] 17 tests from TestImageWatcher (2465 ms total) 2024-09-16T16:54:47.631 INFO:tasks.workunit.client.0.smithi172.stdout: 2024-09-16T16:54:47.631 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] Global test environment tear-down 2024-09-16T16:54:47.631 INFO:tasks.workunit.client.0.smithi172.stdout:[==========] 17 tests from 1 test suite ran. (4945 ms total) 2024-09-16T16:54:47.631 INFO:tasks.workunit.client.0.smithi172.stdout:[ PASSED ] 0 tests. 2024-09-16T16:54:47.631 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] 17 tests, listed below: 2024-09-16T16:54:47.631 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestImageWatcher.NotifyHeaderUpdate 2024-09-16T16:54:47.632 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestImageWatcher.NotifyFlatten 2024-09-16T16:54:47.632 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestImageWatcher.NotifyResize 2024-09-16T16:54:47.632 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestImageWatcher.NotifyRebuildObjectMap 2024-09-16T16:54:47.632 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestImageWatcher.NotifyUpdateFeatures 2024-09-16T16:54:47.632 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapCreate 2024-09-16T16:54:47.632 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapCreateError 2024-09-16T16:54:47.632 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapRename 2024-09-16T16:54:47.632 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapRenameError 2024-09-16T16:54:47.632 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapRemove 2024-09-16T16:54:47.632 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapProtect 2024-09-16T16:54:47.632 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestImageWatcher.NotifySnapUnprotect 2024-09-16T16:54:47.632 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestImageWatcher.NotifyRename 2024-09-16T16:54:47.632 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestImageWatcher.NotifyAsyncTimedOut 2024-09-16T16:54:47.633 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestImageWatcher.NotifyAsyncError 2024-09-16T16:54:47.633 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestImageWatcher.NotifyAsyncCompleteError 2024-09-16T16:54:47.633 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestImageWatcher.NotifyAsyncRequestTimedOut 2024-09-16T16:54:47.709 INFO:tasks.workunit.client.0.smithi172.stdout:seed 32739 2024-09-16T16:54:47.710 INFO:tasks.workunit.client.0.smithi172.stdout:Note: Google Test filter = TestInternal.* 2024-09-16T16:54:47.711 INFO:tasks.workunit.client.0.smithi172.stdout:[==========] Running 34 tests from 1 test suite. 2024-09-16T16:54:47.711 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] Global test environment set-up. 2024-09-16T16:54:47.711 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] 34 tests from TestInternal 2024-09-16T16:54:49.639 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestInternal.OpenByID 2024-09-16T16:54:51.457 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:176: Skipped 2024-09-16T16:54:51.457 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:51.457 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestInternal.OpenByID (1818 ms) 2024-09-16T16:54:51.457 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestInternal.OpenSnapDNE 2024-09-16T16:54:51.579 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestInternal.OpenSnapDNE (122 ms) 2024-09-16T16:54:51.579 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestInternal.IsExclusiveLockOwner 2024-09-16T16:54:51.626 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:198: Skipped 2024-09-16T16:54:51.626 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:51.626 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestInternal.IsExclusiveLockOwner (47 ms) 2024-09-16T16:54:51.626 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestInternal.ResizeLocksImage 2024-09-16T16:54:51.667 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:218: Skipped 2024-09-16T16:54:51.667 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:51.667 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestInternal.ResizeLocksImage (41 ms) 2024-09-16T16:54:51.667 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestInternal.ResizeFailsToLockImage 2024-09-16T16:54:51.704 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:232: Skipped 2024-09-16T16:54:51.704 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:51.705 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestInternal.ResizeFailsToLockImage (37 ms) 2024-09-16T16:54:51.705 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestInternal.SnapCreateLocksImage 2024-09-16T16:54:51.740 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:243: Skipped 2024-09-16T16:54:51.740 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:51.740 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestInternal.SnapCreateLocksImage (36 ms) 2024-09-16T16:54:51.740 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestInternal.SnapCreateFailsToLockImage 2024-09-16T16:54:51.778 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:261: Skipped 2024-09-16T16:54:51.778 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:51.778 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestInternal.SnapCreateFailsToLockImage (38 ms) 2024-09-16T16:54:51.778 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestInternal.SnapRollbackLocksImage 2024-09-16T16:54:51.818 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:271: Skipped 2024-09-16T16:54:51.818 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:51.818 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestInternal.SnapRollbackLocksImage (40 ms) 2024-09-16T16:54:51.818 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestInternal.SnapRollbackFailsToLockImage 2024-09-16T16:54:51.857 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:289: Skipped 2024-09-16T16:54:51.858 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:51.858 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestInternal.SnapRollbackFailsToLockImage (40 ms) 2024-09-16T16:54:51.858 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestInternal.SnapSetReleasesLock 2024-09-16T16:54:51.897 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:306: Skipped 2024-09-16T16:54:51.897 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:51.897 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestInternal.SnapSetReleasesLock (39 ms) 2024-09-16T16:54:51.897 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestInternal.FlattenLocksImage 2024-09-16T16:54:51.934 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:321: Skipped 2024-09-16T16:54:51.934 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:51.934 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestInternal.FlattenLocksImage (37 ms) 2024-09-16T16:54:51.934 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestInternal.FlattenFailsToLockImage 2024-09-16T16:54:51.972 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:348: Skipped 2024-09-16T16:54:51.972 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:51.972 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestInternal.FlattenFailsToLockImage (38 ms) 2024-09-16T16:54:51.972 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestInternal.WriteFailsToLockImageBlocklisted 2024-09-16T16:54:52.012 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:382: Skipped 2024-09-16T16:54:52.012 INFO:tasks.workunit.client.0.smithi172.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:54:52.012 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestInternal.WriteFailsToLockImageBlocklisted (40 ms) 2024-09-16T16:54:52.012 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestInternal.WriteFailsToLockImageBlocklistedWatch 2024-09-16T16:54:52.050 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:416: Skipped 2024-09-16T16:54:52.050 INFO:tasks.workunit.client.0.smithi172.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:54:52.050 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestInternal.WriteFailsToLockImageBlocklistedWatch (38 ms) 2024-09-16T16:54:52.050 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestInternal.AioWriteRequestsLock 2024-09-16T16:54:52.093 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:455: Skipped 2024-09-16T16:54:52.093 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:52.093 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestInternal.AioWriteRequestsLock (43 ms) 2024-09-16T16:54:52.093 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestInternal.AioDiscardRequestsLock 2024-09-16T16:54:52.141 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:481: Skipped 2024-09-16T16:54:52.141 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:52.141 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestInternal.AioDiscardRequestsLock (48 ms) 2024-09-16T16:54:52.141 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestInternal.CancelAsyncResize 2024-09-16T16:54:52.182 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:503: Skipped 2024-09-16T16:54:52.182 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:52.182 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestInternal.CancelAsyncResize (41 ms) 2024-09-16T16:54:52.182 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestInternal.MultipleResize 2024-09-16T16:54:52.596 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestInternal.MultipleResize (414 ms) 2024-09-16T16:54:52.596 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestInternal.Metadata 2024-09-16T16:54:52.634 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:592: Skipped 2024-09-16T16:54:52.634 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:52.634 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestInternal.Metadata (38 ms) 2024-09-16T16:54:52.635 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestInternal.MetadataConfApply 2024-09-16T16:54:52.674 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:639: Skipped 2024-09-16T16:54:52.674 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:52.674 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestInternal.MetadataConfApply (40 ms) 2024-09-16T16:54:52.674 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestInternal.SnapshotCopyup 2024-09-16T16:54:52.713 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:662: Skipped 2024-09-16T16:54:52.713 INFO:tasks.workunit.client.0.smithi172.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:54:52.713 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestInternal.SnapshotCopyup (39 ms) 2024-09-16T16:54:52.713 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestInternal.SnapshotCopyupZeros 2024-09-16T16:54:52.752 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:814: Skipped 2024-09-16T16:54:52.752 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:52.752 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestInternal.SnapshotCopyupZeros (39 ms) 2024-09-16T16:54:52.752 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestInternal.SnapshotCopyupZerosMigration 2024-09-16T16:54:52.791 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:902: Skipped 2024-09-16T16:54:52.791 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:52.791 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestInternal.SnapshotCopyupZerosMigration (39 ms) 2024-09-16T16:54:52.791 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestInternal.ResizeCopyup 2024-09-16T16:54:52.831 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:987: Skipped 2024-09-16T16:54:52.831 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:52.831 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestInternal.ResizeCopyup (40 ms) 2024-09-16T16:54:52.831 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestInternal.DiscardCopyup 2024-09-16T16:54:52.869 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:1052: Skipped 2024-09-16T16:54:52.869 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:52.869 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestInternal.DiscardCopyup (38 ms) 2024-09-16T16:54:52.869 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestInternal.ImageOptions 2024-09-16T16:54:52.909 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestInternal.ImageOptions (40 ms) 2024-09-16T16:54:52.909 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestInternal.WriteFullCopyup 2024-09-16T16:54:52.948 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:1183: Skipped 2024-09-16T16:54:52.948 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:52.948 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestInternal.WriteFullCopyup (39 ms) 2024-09-16T16:54:52.948 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestInternal.DiffIterateCloneOverwrite 2024-09-16T16:54:52.987 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:1257: Skipped 2024-09-16T16:54:52.988 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:52.988 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestInternal.DiffIterateCloneOverwrite (39 ms) 2024-09-16T16:54:52.988 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestInternal.TestCoR 2024-09-16T16:54:53.026 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:1307: Skipped 2024-09-16T16:54:53.026 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:53.026 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestInternal.TestCoR (39 ms) 2024-09-16T16:54:53.027 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestInternal.FlattenNoEmptyObjects 2024-09-16T16:54:53.064 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:1455: Skipped 2024-09-16T16:54:53.064 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:53.065 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestInternal.FlattenNoEmptyObjects (39 ms) 2024-09-16T16:54:53.065 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestInternal.PoolMetadataConfApply 2024-09-16T16:54:53.102 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:1574: Skipped 2024-09-16T16:54:53.103 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:53.103 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestInternal.PoolMetadataConfApply (38 ms) 2024-09-16T16:54:53.103 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestInternal.Sparsify 2024-09-16T16:54:53.272 INFO:tasks.workunit.client.0.smithi172.stdout:sparsify_supported=1 2024-09-16T16:54:53.272 INFO:tasks.workunit.client.0.smithi172.stdout:sparse_read_supported=1 2024-09-16T16:54:53.508 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestInternal.Sparsify (405 ms) 2024-09-16T16:54:53.508 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestInternal.SparsifyClone 2024-09-16T16:54:53.547 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:1737: Skipped 2024-09-16T16:54:53.548 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:53.548 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestInternal.SparsifyClone (40 ms) 2024-09-16T16:54:53.548 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestInternal.MissingDataPool 2024-09-16T16:54:53.584 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_internal.cc:1800: Skipped 2024-09-16T16:54:53.584 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:54:53.584 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestInternal.MissingDataPool (36 ms) 2024-09-16T16:54:53.651 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] 34 tests from TestInternal (3945 ms total) 2024-09-16T16:54:53.652 INFO:tasks.workunit.client.0.smithi172.stdout: 2024-09-16T16:54:53.652 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] Global test environment tear-down 2024-09-16T16:54:53.652 INFO:tasks.workunit.client.0.smithi172.stdout:[==========] 34 tests from 1 test suite ran. (5940 ms total) 2024-09-16T16:54:53.652 INFO:tasks.workunit.client.0.smithi172.stdout:[ PASSED ] 4 tests. 2024-09-16T16:54:53.652 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] 30 tests, listed below: 2024-09-16T16:54:53.652 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestInternal.OpenByID 2024-09-16T16:54:53.652 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestInternal.IsExclusiveLockOwner 2024-09-16T16:54:53.652 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestInternal.ResizeLocksImage 2024-09-16T16:54:53.652 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestInternal.ResizeFailsToLockImage 2024-09-16T16:54:53.652 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestInternal.SnapCreateLocksImage 2024-09-16T16:54:53.652 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestInternal.SnapCreateFailsToLockImage 2024-09-16T16:54:53.652 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestInternal.SnapRollbackLocksImage 2024-09-16T16:54:53.652 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestInternal.SnapRollbackFailsToLockImage 2024-09-16T16:54:53.652 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestInternal.SnapSetReleasesLock 2024-09-16T16:54:53.652 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestInternal.FlattenLocksImage 2024-09-16T16:54:53.653 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestInternal.FlattenFailsToLockImage 2024-09-16T16:54:53.653 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestInternal.WriteFailsToLockImageBlocklisted 2024-09-16T16:54:53.653 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestInternal.WriteFailsToLockImageBlocklistedWatch 2024-09-16T16:54:53.653 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestInternal.AioWriteRequestsLock 2024-09-16T16:54:53.653 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestInternal.AioDiscardRequestsLock 2024-09-16T16:54:53.653 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestInternal.CancelAsyncResize 2024-09-16T16:54:53.653 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestInternal.Metadata 2024-09-16T16:54:53.653 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestInternal.MetadataConfApply 2024-09-16T16:54:53.653 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestInternal.SnapshotCopyup 2024-09-16T16:54:53.653 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestInternal.SnapshotCopyupZeros 2024-09-16T16:54:53.653 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestInternal.SnapshotCopyupZerosMigration 2024-09-16T16:54:53.653 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestInternal.ResizeCopyup 2024-09-16T16:54:53.653 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestInternal.DiscardCopyup 2024-09-16T16:54:53.653 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestInternal.WriteFullCopyup 2024-09-16T16:54:53.653 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestInternal.DiffIterateCloneOverwrite 2024-09-16T16:54:53.653 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestInternal.TestCoR 2024-09-16T16:54:53.654 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestInternal.FlattenNoEmptyObjects 2024-09-16T16:54:53.654 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestInternal.PoolMetadataConfApply 2024-09-16T16:54:53.654 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestInternal.SparsifyClone 2024-09-16T16:54:53.654 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestInternal.MissingDataPool 2024-09-16T16:54:53.760 INFO:tasks.workunit.client.0.smithi172.stdout:seed 32791 2024-09-16T16:54:53.760 INFO:tasks.workunit.client.0.smithi172.stdout:Note: Google Test filter = TestMirroring.* 2024-09-16T16:54:53.760 INFO:tasks.workunit.client.0.smithi172.stdout:[==========] Running 51 tests from 1 test suite. 2024-09-16T16:54:53.760 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] Global test environment set-up. 2024-09-16T16:54:53.761 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] 51 tests from TestMirroring 2024-09-16T16:54:55.664 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModeImage 2024-09-16T16:54:58.671 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModeImage (3008 ms) 2024-09-16T16:54:58.672 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModePool 2024-09-16T16:55:00.072 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModePool (1400 ms) 2024-09-16T16:55:00.073 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModeDisabled 2024-09-16T16:55:01.122 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModeDisabled (1050 ms) 2024-09-16T16:55:01.122 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestMirroring.DisableImageMirror_In_MirrorModeImage 2024-09-16T16:55:02.518 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestMirroring.DisableImageMirror_In_MirrorModeImage (1396 ms) 2024-09-16T16:55:02.518 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestMirroring.DisableImageMirror_In_MirrorModeImage_NoObjectMap 2024-09-16T16:55:03.736 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestMirroring.DisableImageMirror_In_MirrorModeImage_NoObjectMap (1218 ms) 2024-09-16T16:55:03.736 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestMirroring.DisableImageMirror_In_MirrorModePool 2024-09-16T16:55:05.043 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestMirroring.DisableImageMirror_In_MirrorModePool (1308 ms) 2024-09-16T16:55:05.044 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestMirroring.DisableImageMirror_In_MirrorModeDisabled 2024-09-16T16:55:06.553 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestMirroring.DisableImageMirror_In_MirrorModeDisabled (1509 ms) 2024-09-16T16:55:06.553 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestMirroring.DisableImageMirrorWithPeer 2024-09-16T16:55:06.553 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_mirroring.cc:482: Skipped 2024-09-16T16:55:06.554 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:55:06.554 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestMirroring.DisableImageMirrorWithPeer (0 ms) 2024-09-16T16:55:06.554 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestMirroring.DisableJournalingWithPeer 2024-09-16T16:55:06.554 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_mirroring.cc:520: Skipped 2024-09-16T16:55:06.554 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:55:06.554 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestMirroring.DisableJournalingWithPeer (0 ms) 2024-09-16T16:55:06.554 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModeDisabled_WithoutJournaling 2024-09-16T16:55:07.492 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModeDisabled_WithoutJournaling (939 ms) 2024-09-16T16:55:07.492 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModePool_WithoutJournaling 2024-09-16T16:55:08.521 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModePool_WithoutJournaling (1029 ms) 2024-09-16T16:55:08.521 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModeImage_WithoutJournaling 2024-09-16T16:55:10.904 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModeImage_WithoutJournaling (2383 ms) 2024-09-16T16:55:10.904 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModeImage_WithoutExclusiveLock 2024-09-16T16:55:12.792 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModeImage_WithoutExclusiveLock (1887 ms) 2024-09-16T16:55:12.792 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestMirroring.CreateImage_In_MirrorModeDisabled 2024-09-16T16:55:13.990 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestMirroring.CreateImage_In_MirrorModeDisabled (1198 ms) 2024-09-16T16:55:13.990 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestMirroring.CreateImage_In_MirrorModeImage 2024-09-16T16:55:15.132 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestMirroring.CreateImage_In_MirrorModeImage (1142 ms) 2024-09-16T16:55:15.132 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestMirroring.CreateImage_In_MirrorModePool 2024-09-16T16:55:16.483 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestMirroring.CreateImage_In_MirrorModePool (1351 ms) 2024-09-16T16:55:16.483 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestMirroring.CreateImage_In_MirrorModePool_WithoutJournaling 2024-09-16T16:55:17.565 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestMirroring.CreateImage_In_MirrorModePool_WithoutJournaling (1082 ms) 2024-09-16T16:55:17.565 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestMirroring.CreateImage_In_MirrorModeImage_WithoutJournaling 2024-09-16T16:55:18.557 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestMirroring.CreateImage_In_MirrorModeImage_WithoutJournaling (992 ms) 2024-09-16T16:55:18.557 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestMirroring.EnableJournaling_In_MirrorModeDisabled 2024-09-16T16:55:19.757 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestMirroring.EnableJournaling_In_MirrorModeDisabled (1200 ms) 2024-09-16T16:55:19.757 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestMirroring.EnableJournaling_In_MirrorModeImage 2024-09-16T16:55:21.091 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestMirroring.EnableJournaling_In_MirrorModeImage (1334 ms) 2024-09-16T16:55:21.091 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestMirroring.EnableJournaling_In_MirrorModeImage_SnapshotMirroringEnabled 2024-09-16T16:55:23.074 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestMirroring.EnableJournaling_In_MirrorModeImage_SnapshotMirroringEnabled (1983 ms) 2024-09-16T16:55:23.074 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestMirroring.EnableJournaling_In_MirrorModePool 2024-09-16T16:55:24.552 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestMirroring.EnableJournaling_In_MirrorModePool (1478 ms) 2024-09-16T16:55:24.552 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestMirroring.DisableJournaling_In_MirrorModePool 2024-09-16T16:55:25.890 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestMirroring.DisableJournaling_In_MirrorModePool (1338 ms) 2024-09-16T16:55:25.890 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestMirroring.DisableJournaling_In_MirrorModeImage 2024-09-16T16:55:27.196 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestMirroring.DisableJournaling_In_MirrorModeImage (1306 ms) 2024-09-16T16:55:27.196 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestMirroring.MirrorModeSet_DisabledMode_To_PoolMode 2024-09-16T16:55:29.215 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestMirroring.MirrorModeSet_DisabledMode_To_PoolMode (2020 ms) 2024-09-16T16:55:29.216 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestMirroring.MirrorModeSet_PoolMode_To_DisabledMode 2024-09-16T16:55:31.249 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestMirroring.MirrorModeSet_PoolMode_To_DisabledMode (2033 ms) 2024-09-16T16:55:31.249 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestMirroring.MirrorModeSet_DisabledMode_To_ImageMode 2024-09-16T16:55:32.985 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestMirroring.MirrorModeSet_DisabledMode_To_ImageMode (1736 ms) 2024-09-16T16:55:32.985 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestMirroring.MirrorModeSet_PoolMode_To_ImageMode 2024-09-16T16:55:34.862 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestMirroring.MirrorModeSet_PoolMode_To_ImageMode (1877 ms) 2024-09-16T16:55:34.862 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestMirroring.MirrorModeSet_ImageMode_To_PoolMode 2024-09-16T16:55:36.886 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestMirroring.MirrorModeSet_ImageMode_To_PoolMode (2024 ms) 2024-09-16T16:55:36.886 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestMirroring.MirrorModeSet_ImageMode_To_DisabledMode 2024-09-16T16:55:39.065 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestMirroring.MirrorModeSet_ImageMode_To_DisabledMode (2179 ms) 2024-09-16T16:55:39.065 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestMirroring.RemoveImage_With_MirrorImageEnabled 2024-09-16T16:55:40.166 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestMirroring.RemoveImage_With_MirrorImageEnabled (1101 ms) 2024-09-16T16:55:40.166 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestMirroring.RemoveImage_With_MirrorImageDisabled 2024-09-16T16:55:41.144 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestMirroring.RemoveImage_With_MirrorImageDisabled (978 ms) 2024-09-16T16:55:41.144 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestMirroring.RemoveImage_With_ImageWithoutJournal 2024-09-16T16:55:41.951 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestMirroring.RemoveImage_With_ImageWithoutJournal (807 ms) 2024-09-16T16:55:41.951 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestMirroring.RemoveImage_With_MirrorImageDemoted 2024-09-16T16:55:43.611 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestMirroring.RemoveImage_With_MirrorImageDemoted (1660 ms) 2024-09-16T16:55:43.611 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestMirroring.TrashMoveRestore_PoolMode 2024-09-16T16:55:45.313 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestMirroring.TrashMoveRestore_PoolMode (1702 ms) 2024-09-16T16:55:45.313 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestMirroring.TrashMoveRestore_ImageMode_MirroringDisabled 2024-09-16T16:55:46.706 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestMirroring.TrashMoveRestore_ImageMode_MirroringDisabled (1393 ms) 2024-09-16T16:55:46.706 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestMirroring.TrashMoveRestore_ImageMode_MirroringEnabled 2024-09-16T16:55:48.175 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestMirroring.TrashMoveRestore_ImageMode_MirroringEnabled (1469 ms) 2024-09-16T16:55:48.175 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestMirroring.MirrorStatusList 2024-09-16T16:55:49.112 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestMirroring.MirrorStatusList (937 ms) 2024-09-16T16:55:49.131 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestMirroring.RemoveBootstrapped 2024-09-16T16:55:50.333 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestMirroring.RemoveBootstrapped (1221 ms) 2024-09-16T16:55:50.333 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestMirroring.AioPromoteDemote 2024-09-16T16:55:56.276 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestMirroring.AioPromoteDemote (5943 ms) 2024-09-16T16:55:56.276 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestMirroring.AioGetInfo 2024-09-16T16:56:00.900 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestMirroring.AioGetInfo (4624 ms) 2024-09-16T16:56:00.900 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestMirroring.AioGetStatus 2024-09-16T16:56:03.768 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestMirroring.AioGetStatus (2868 ms) 2024-09-16T16:56:03.769 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestMirroring.SiteName 2024-09-16T16:56:03.777 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestMirroring.SiteName (10 ms) 2024-09-16T16:56:03.777 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestMirroring.Bootstrap 2024-09-16T16:56:15.824 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestMirroring.Bootstrap (12046 ms) 2024-09-16T16:56:15.824 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestMirroring.PeerDirection 2024-09-16T16:56:15.939 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestMirroring.PeerDirection (114 ms) 2024-09-16T16:56:15.939 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestMirroring.Snapshot 2024-09-16T16:56:15.939 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_mirroring.cc:1109: Skipped 2024-09-16T16:56:15.939 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:56:15.939 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestMirroring.Snapshot (0 ms) 2024-09-16T16:56:15.939 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestMirroring.SnapshotRemoveOnDisable 2024-09-16T16:56:15.939 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_mirroring.cc:1188: Skipped 2024-09-16T16:56:15.939 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:56:15.940 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestMirroring.SnapshotRemoveOnDisable (0 ms) 2024-09-16T16:56:15.940 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestMirroring.SnapshotUnlinkPeer 2024-09-16T16:56:15.940 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_mirroring.cc:1226: Skipped 2024-09-16T16:56:15.940 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:56:15.940 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestMirroring.SnapshotUnlinkPeer (0 ms) 2024-09-16T16:56:15.940 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestMirroring.SnapshotImageState 2024-09-16T16:56:15.940 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_mirroring.cc:1339: Skipped 2024-09-16T16:56:15.940 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:56:15.940 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestMirroring.SnapshotImageState (1 ms) 2024-09-16T16:56:15.940 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestMirroring.SnapshotPromoteDemote 2024-09-16T16:56:15.940 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_mirroring.cc:1449: Skipped 2024-09-16T16:56:15.940 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:56:15.940 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestMirroring.SnapshotPromoteDemote (0 ms) 2024-09-16T16:56:15.940 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestMirroring.AioSnapshotCreate 2024-09-16T16:56:15.941 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_mirroring.cc:1484: Skipped 2024-09-16T16:56:15.941 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:56:15.941 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestMirroring.AioSnapshotCreate (0 ms) 2024-09-16T16:56:16.897 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] 51 tests from TestMirroring (80275 ms total) 2024-09-16T16:56:16.897 INFO:tasks.workunit.client.0.smithi172.stdout: 2024-09-16T16:56:16.897 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] Global test environment tear-down 2024-09-16T16:56:16.897 INFO:tasks.workunit.client.0.smithi172.stdout:[==========] 51 tests from 1 test suite ran. (83134 ms total) 2024-09-16T16:56:16.897 INFO:tasks.workunit.client.0.smithi172.stdout:[ PASSED ] 43 tests. 2024-09-16T16:56:16.897 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] 8 tests, listed below: 2024-09-16T16:56:16.897 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestMirroring.DisableImageMirrorWithPeer 2024-09-16T16:56:16.897 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestMirroring.DisableJournalingWithPeer 2024-09-16T16:56:16.897 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestMirroring.Snapshot 2024-09-16T16:56:16.897 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestMirroring.SnapshotRemoveOnDisable 2024-09-16T16:56:16.898 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestMirroring.SnapshotUnlinkPeer 2024-09-16T16:56:16.898 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestMirroring.SnapshotImageState 2024-09-16T16:56:16.898 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestMirroring.SnapshotPromoteDemote 2024-09-16T16:56:16.898 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestMirroring.AioSnapshotCreate 2024-09-16T16:56:17.012 INFO:tasks.workunit.client.0.smithi172.stdout:seed 33295 2024-09-16T16:56:17.012 INFO:tasks.workunit.client.0.smithi172.stdout:Note: Google Test filter = TestGroup.* 2024-09-16T16:56:17.012 INFO:tasks.workunit.client.0.smithi172.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-16T16:56:17.012 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] Global test environment set-up. 2024-09-16T16:56:17.012 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] 13 tests from TestGroup 2024-09-16T16:56:18.896 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestGroup.group_create 2024-09-16T16:56:21.077 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestGroup.group_create (2181 ms) 2024-09-16T16:56:21.077 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestGroup.group_createPP 2024-09-16T16:56:21.227 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestGroup.group_createPP (151 ms) 2024-09-16T16:56:21.228 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestGroup.group_get_id 2024-09-16T16:56:21.346 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestGroup.group_get_id (118 ms) 2024-09-16T16:56:21.346 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestGroup.group_get_idPP 2024-09-16T16:56:21.487 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestGroup.group_get_idPP (141 ms) 2024-09-16T16:56:21.487 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestGroup.add_image 2024-09-16T16:56:21.525 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_Groups.cc:113: Skipped 2024-09-16T16:56:21.525 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:56:21.525 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestGroup.add_image (38 ms) 2024-09-16T16:56:21.525 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestGroup.add_imagePP 2024-09-16T16:56:21.563 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_Groups.cc:195: Skipped 2024-09-16T16:56:21.563 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:56:21.563 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestGroup.add_imagePP (38 ms) 2024-09-16T16:56:21.563 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestGroup.add_snapshot 2024-09-16T16:56:21.600 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_Groups.cc:260: Skipped 2024-09-16T16:56:21.600 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:56:21.600 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestGroup.add_snapshot (37 ms) 2024-09-16T16:56:21.600 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestGroup.add_snapshotPP 2024-09-16T16:56:21.636 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_Groups.cc:413: Skipped 2024-09-16T16:56:21.637 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:56:21.637 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestGroup.add_snapshotPP (37 ms) 2024-09-16T16:56:21.637 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestGroup.snap_get_info 2024-09-16T16:56:21.674 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_Groups.cc:498: Skipped 2024-09-16T16:56:21.674 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:56:21.674 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestGroup.snap_get_info (37 ms) 2024-09-16T16:56:21.674 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestGroup.snap_get_infoPP 2024-09-16T16:56:21.711 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_Groups.cc:553: Skipped 2024-09-16T16:56:21.711 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:56:21.711 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestGroup.snap_get_infoPP (37 ms) 2024-09-16T16:56:21.711 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestGroup.snap_list2 2024-09-16T16:56:21.749 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_Groups.cc:601: Skipped 2024-09-16T16:56:21.749 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:56:21.749 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestGroup.snap_list2 (38 ms) 2024-09-16T16:56:21.749 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestGroup.snap_list2PP 2024-09-16T16:56:21.786 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_Groups.cc:700: Skipped 2024-09-16T16:56:21.786 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:56:21.786 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestGroup.snap_list2PP (37 ms) 2024-09-16T16:56:21.787 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestGroup.snap_list_internal 2024-09-16T16:56:21.830 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_Groups.cc:781: Skipped 2024-09-16T16:56:21.830 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:56:21.830 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestGroup.snap_list_internal (44 ms) 2024-09-16T16:56:22.398 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] 13 tests from TestGroup (2934 ms total) 2024-09-16T16:56:22.398 INFO:tasks.workunit.client.0.smithi172.stdout: 2024-09-16T16:56:22.398 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] Global test environment tear-down 2024-09-16T16:56:22.398 INFO:tasks.workunit.client.0.smithi172.stdout:[==========] 13 tests from 1 test suite ran. (5386 ms total) 2024-09-16T16:56:22.398 INFO:tasks.workunit.client.0.smithi172.stdout:[ PASSED ] 4 tests. 2024-09-16T16:56:22.399 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] 9 tests, listed below: 2024-09-16T16:56:22.399 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestGroup.add_image 2024-09-16T16:56:22.399 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestGroup.add_imagePP 2024-09-16T16:56:22.399 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestGroup.add_snapshot 2024-09-16T16:56:22.399 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestGroup.add_snapshotPP 2024-09-16T16:56:22.399 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestGroup.snap_get_info 2024-09-16T16:56:22.399 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestGroup.snap_get_infoPP 2024-09-16T16:56:22.399 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestGroup.snap_list2 2024-09-16T16:56:22.399 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestGroup.snap_list2PP 2024-09-16T16:56:22.399 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestGroup.snap_list_internal 2024-09-16T16:56:22.487 INFO:tasks.workunit.client.0.smithi172.stdout:seed 33344 2024-09-16T16:56:22.487 INFO:tasks.workunit.client.0.smithi172.stdout:Note: Google Test filter = TestMirroringWatcher.* 2024-09-16T16:56:22.487 INFO:tasks.workunit.client.0.smithi172.stdout:[==========] Running 2 tests from 1 test suite. 2024-09-16T16:56:22.487 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] Global test environment set-up. 2024-09-16T16:56:22.488 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] 2 tests from TestMirroringWatcher 2024-09-16T16:56:24.401 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestMirroringWatcher.ModeUpdated 2024-09-16T16:56:26.594 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestMirroringWatcher.ModeUpdated (2193 ms) 2024-09-16T16:56:26.594 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestMirroringWatcher.ImageStatusUpdated 2024-09-16T16:56:26.712 INFO:tasks.workunit.client.0.smithi172.stdout:[ OK ] TestMirroringWatcher.ImageStatusUpdated (118 ms) 2024-09-16T16:56:27.431 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] 2 tests from TestMirroringWatcher (2311 ms total) 2024-09-16T16:56:27.431 INFO:tasks.workunit.client.0.smithi172.stdout: 2024-09-16T16:56:27.431 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] Global test environment tear-down 2024-09-16T16:56:27.431 INFO:tasks.workunit.client.0.smithi172.stdout:[==========] 2 tests from 1 test suite ran. (4944 ms total) 2024-09-16T16:56:27.431 INFO:tasks.workunit.client.0.smithi172.stdout:[ PASSED ] 2 tests. 2024-09-16T16:56:27.512 INFO:tasks.workunit.client.0.smithi172.stdout:seed 33396 2024-09-16T16:56:27.513 INFO:tasks.workunit.client.0.smithi172.stdout:Note: Google Test filter = TestObjectMap.* 2024-09-16T16:56:27.513 INFO:tasks.workunit.client.0.smithi172.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-16T16:56:27.513 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] Global test environment set-up. 2024-09-16T16:56:27.513 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] 4 tests from TestObjectMap 2024-09-16T16:56:29.425 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestObjectMap.RefreshInvalidatesWhenCorrupt 2024-09-16T16:56:31.488 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ObjectMap.cc:38: Skipped 2024-09-16T16:56:31.488 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:56:31.489 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestObjectMap.RefreshInvalidatesWhenCorrupt (2063 ms) 2024-09-16T16:56:31.489 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestObjectMap.RefreshInvalidatesWhenTooSmall 2024-09-16T16:56:31.528 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ObjectMap.cc:66: Skipped 2024-09-16T16:56:31.528 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:56:31.528 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestObjectMap.RefreshInvalidatesWhenTooSmall (40 ms) 2024-09-16T16:56:31.528 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestObjectMap.InvalidateFlagOnDisk 2024-09-16T16:56:31.566 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ObjectMap.cc:95: Skipped 2024-09-16T16:56:31.566 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:56:31.566 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestObjectMap.InvalidateFlagOnDisk (38 ms) 2024-09-16T16:56:31.566 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestObjectMap.AcquireLockInvalidatesWhenTooSmall 2024-09-16T16:56:31.603 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_ObjectMap.cc:128: Skipped 2024-09-16T16:56:31.603 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:56:31.604 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestObjectMap.AcquireLockInvalidatesWhenTooSmall (37 ms) 2024-09-16T16:56:32.451 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] 4 tests from TestObjectMap (2178 ms total) 2024-09-16T16:56:32.452 INFO:tasks.workunit.client.0.smithi172.stdout: 2024-09-16T16:56:32.452 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] Global test environment tear-down 2024-09-16T16:56:32.452 INFO:tasks.workunit.client.0.smithi172.stdout:[==========] 4 tests from 1 test suite ran. (4938 ms total) 2024-09-16T16:56:32.452 INFO:tasks.workunit.client.0.smithi172.stdout:[ PASSED ] 0 tests. 2024-09-16T16:56:32.452 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] 4 tests, listed below: 2024-09-16T16:56:32.452 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestObjectMap.RefreshInvalidatesWhenCorrupt 2024-09-16T16:56:32.452 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestObjectMap.RefreshInvalidatesWhenTooSmall 2024-09-16T16:56:32.452 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestObjectMap.InvalidateFlagOnDisk 2024-09-16T16:56:32.452 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestObjectMap.AcquireLockInvalidatesWhenTooSmall 2024-09-16T16:56:32.452 INFO:tasks.workunit.client.0.smithi172.stdout: 2024-09-16T16:56:32.452 INFO:tasks.workunit.client.0.smithi172.stdout: YOU HAVE 1 DISABLED TEST 2024-09-16T16:56:32.453 INFO:tasks.workunit.client.0.smithi172.stdout: 2024-09-16T16:56:32.535 INFO:tasks.workunit.client.0.smithi172.stdout:seed 33445 2024-09-16T16:56:32.536 INFO:tasks.workunit.client.0.smithi172.stdout:Note: Google Test filter = TestOperations.* 2024-09-16T16:56:32.537 INFO:tasks.workunit.client.0.smithi172.stdout:[==========] Running 1 test from 1 test suite. 2024-09-16T16:56:32.537 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] Global test environment set-up. 2024-09-16T16:56:32.537 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] 1 test from TestOperations 2024-09-16T16:56:34.460 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestOperations.DisableJournalingCorrupt 2024-09-16T16:56:36.555 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_Operations.cc:18: Skipped 2024-09-16T16:56:36.555 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:56:36.555 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestOperations.DisableJournalingCorrupt (2095 ms) 2024-09-16T16:56:37.491 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] 1 test from TestOperations (2095 ms total) 2024-09-16T16:56:37.492 INFO:tasks.workunit.client.0.smithi172.stdout: 2024-09-16T16:56:37.492 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] Global test environment tear-down 2024-09-16T16:56:37.492 INFO:tasks.workunit.client.0.smithi172.stdout:[==========] 1 test from 1 test suite ran. (4954 ms total) 2024-09-16T16:56:37.492 INFO:tasks.workunit.client.0.smithi172.stdout:[ PASSED ] 0 tests. 2024-09-16T16:56:37.492 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] 1 test, listed below: 2024-09-16T16:56:37.492 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestOperations.DisableJournalingCorrupt 2024-09-16T16:56:37.584 INFO:tasks.workunit.client.0.smithi172.stdout:seed 33494 2024-09-16T16:56:37.584 INFO:tasks.workunit.client.0.smithi172.stdout:Note: Google Test filter = TestTrash.* 2024-09-16T16:56:37.584 INFO:tasks.workunit.client.0.smithi172.stdout:[==========] Running 2 tests from 1 test suite. 2024-09-16T16:56:37.584 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] Global test environment set-up. 2024-09-16T16:56:37.584 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] 2 tests from TestTrash 2024-09-16T16:56:39.485 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestTrash.UserRemovingSource 2024-09-16T16:56:41.467 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_Trash.cc:36: Skipped 2024-09-16T16:56:41.467 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:56:41.467 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestTrash.UserRemovingSource (1982 ms) 2024-09-16T16:56:41.467 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestTrash.RestoreMirroringSource 2024-09-16T16:56:41.505 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/test_Trash.cc:93: Skipped 2024-09-16T16:56:41.505 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:56:41.505 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestTrash.RestoreMirroringSource (38 ms) 2024-09-16T16:56:42.516 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] 2 tests from TestTrash (2020 ms total) 2024-09-16T16:56:42.516 INFO:tasks.workunit.client.0.smithi172.stdout: 2024-09-16T16:56:42.516 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] Global test environment tear-down 2024-09-16T16:56:42.516 INFO:tasks.workunit.client.0.smithi172.stdout:[==========] 2 tests from 1 test suite ran. (4931 ms total) 2024-09-16T16:56:42.516 INFO:tasks.workunit.client.0.smithi172.stdout:[ PASSED ] 0 tests. 2024-09-16T16:56:42.516 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] 2 tests, listed below: 2024-09-16T16:56:42.516 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestTrash.UserRemovingSource 2024-09-16T16:56:42.516 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestTrash.RestoreMirroringSource 2024-09-16T16:56:42.614 INFO:tasks.workunit.client.0.smithi172.stdout:seed 33543 2024-09-16T16:56:42.615 INFO:tasks.workunit.client.0.smithi172.stdout:Note: Google Test filter = TestJournalEntries.* 2024-09-16T16:56:42.615 INFO:tasks.workunit.client.0.smithi172.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-16T16:56:42.615 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] Global test environment set-up. 2024-09-16T16:56:42.615 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] 4 tests from TestJournalEntries 2024-09-16T16:56:44.526 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestJournalEntries.AioWrite 2024-09-16T16:56:46.622 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Entries.cc:118: Skipped 2024-09-16T16:56:46.622 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:56:46.623 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestJournalEntries.AioWrite (2096 ms) 2024-09-16T16:56:46.623 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestJournalEntries.AioDiscard 2024-09-16T16:56:46.659 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Entries.cc:163: Skipped 2024-09-16T16:56:46.659 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:56:46.659 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestJournalEntries.AioDiscard (36 ms) 2024-09-16T16:56:46.659 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestJournalEntries.AioDiscardWithPrune 2024-09-16T16:56:46.698 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Entries.cc:200: Skipped 2024-09-16T16:56:46.698 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:56:46.698 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestJournalEntries.AioDiscardWithPrune (40 ms) 2024-09-16T16:56:46.698 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestJournalEntries.AioFlush 2024-09-16T16:56:46.734 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Entries.cc:263: Skipped 2024-09-16T16:56:46.735 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:56:46.735 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestJournalEntries.AioFlush (37 ms) 2024-09-16T16:56:47.556 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] 4 tests from TestJournalEntries (2209 ms total) 2024-09-16T16:56:47.556 INFO:tasks.workunit.client.0.smithi172.stdout: 2024-09-16T16:56:47.557 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] Global test environment tear-down 2024-09-16T16:56:47.557 INFO:tasks.workunit.client.0.smithi172.stdout:[==========] 4 tests from 1 test suite ran. (4941 ms total) 2024-09-16T16:56:47.557 INFO:tasks.workunit.client.0.smithi172.stdout:[ PASSED ] 0 tests. 2024-09-16T16:56:47.557 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] 4 tests, listed below: 2024-09-16T16:56:47.557 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestJournalEntries.AioWrite 2024-09-16T16:56:47.557 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestJournalEntries.AioDiscard 2024-09-16T16:56:47.557 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestJournalEntries.AioDiscardWithPrune 2024-09-16T16:56:47.557 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestJournalEntries.AioFlush 2024-09-16T16:56:47.644 INFO:tasks.workunit.client.0.smithi172.stdout:seed 33592 2024-09-16T16:56:47.647 INFO:tasks.workunit.client.0.smithi172.stdout:Note: Google Test filter = TestJournalReplay.* 2024-09-16T16:56:47.647 INFO:tasks.workunit.client.0.smithi172.stdout:[==========] Running 16 tests from 1 test suite. 2024-09-16T16:56:47.647 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] Global test environment set-up. 2024-09-16T16:56:47.647 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] 16 tests from TestJournalReplay 2024-09-16T16:56:49.553 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestJournalReplay.AioDiscardEvent 2024-09-16T16:56:51.483 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:109: Skipped 2024-09-16T16:56:51.483 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:56:51.483 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestJournalReplay.AioDiscardEvent (1930 ms) 2024-09-16T16:56:51.483 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestJournalReplay.AioWriteEvent 2024-09-16T16:56:51.520 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:200: Skipped 2024-09-16T16:56:51.520 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:56:51.520 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestJournalReplay.AioWriteEvent (37 ms) 2024-09-16T16:56:51.520 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestJournalReplay.AioFlushEvent 2024-09-16T16:56:51.558 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:261: Skipped 2024-09-16T16:56:51.558 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:56:51.558 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestJournalReplay.AioFlushEvent (38 ms) 2024-09-16T16:56:51.558 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestJournalReplay.SnapCreate 2024-09-16T16:56:51.598 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:307: Skipped 2024-09-16T16:56:51.598 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:56:51.598 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestJournalReplay.SnapCreate (40 ms) 2024-09-16T16:56:51.598 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestJournalReplay.SnapProtect 2024-09-16T16:56:51.635 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:348: Skipped 2024-09-16T16:56:51.635 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:56:51.636 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestJournalReplay.SnapProtect (37 ms) 2024-09-16T16:56:51.636 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestJournalReplay.SnapUnprotect 2024-09-16T16:56:51.671 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:394: Skipped 2024-09-16T16:56:51.671 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:56:51.671 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestJournalReplay.SnapUnprotect (36 ms) 2024-09-16T16:56:51.671 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestJournalReplay.SnapRename 2024-09-16T16:56:51.708 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:450: Skipped 2024-09-16T16:56:51.709 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:56:51.709 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestJournalReplay.SnapRename (38 ms) 2024-09-16T16:56:51.709 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestJournalReplay.SnapRollback 2024-09-16T16:56:51.745 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:500: Skipped 2024-09-16T16:56:51.745 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:56:51.745 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestJournalReplay.SnapRollback (37 ms) 2024-09-16T16:56:51.746 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestJournalReplay.SnapRemove 2024-09-16T16:56:51.782 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:541: Skipped 2024-09-16T16:56:51.782 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:56:51.782 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestJournalReplay.SnapRemove (36 ms) 2024-09-16T16:56:51.782 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestJournalReplay.Rename 2024-09-16T16:56:51.819 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:590: Skipped 2024-09-16T16:56:51.819 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:56:51.819 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestJournalReplay.Rename (37 ms) 2024-09-16T16:56:51.819 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestJournalReplay.Resize 2024-09-16T16:56:51.857 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:624: Skipped 2024-09-16T16:56:51.857 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:56:51.857 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestJournalReplay.Resize (38 ms) 2024-09-16T16:56:51.857 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestJournalReplay.Flatten 2024-09-16T16:56:51.895 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:657: Skipped 2024-09-16T16:56:51.895 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:56:51.895 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestJournalReplay.Flatten (38 ms) 2024-09-16T16:56:51.895 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestJournalReplay.UpdateFeatures 2024-09-16T16:56:51.931 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:704: Skipped 2024-09-16T16:56:51.931 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:56:51.931 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestJournalReplay.UpdateFeatures (36 ms) 2024-09-16T16:56:51.931 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestJournalReplay.MetadataSet 2024-09-16T16:56:51.969 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:741: Skipped 2024-09-16T16:56:51.969 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:56:51.969 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestJournalReplay.MetadataSet (38 ms) 2024-09-16T16:56:51.969 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestJournalReplay.MetadataRemove 2024-09-16T16:56:52.006 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:781: Skipped 2024-09-16T16:56:52.006 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:56:52.006 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestJournalReplay.MetadataRemove (37 ms) 2024-09-16T16:56:52.006 INFO:tasks.workunit.client.0.smithi172.stdout:[ RUN ] TestJournalReplay.ObjectPosition 2024-09-16T16:56:52.044 INFO:tasks.workunit.client.0.smithi172.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librbd/journal/test_Replay.cc:824: Skipped 2024-09-16T16:56:52.044 INFO:tasks.workunit.client.0.smithi172.stdout:Skipping due to unmet REQUIRE 2024-09-16T16:56:52.045 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestJournalReplay.ObjectPosition (38 ms) 2024-09-16T16:56:52.585 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] 16 tests from TestJournalReplay (2491 ms total) 2024-09-16T16:56:52.585 INFO:tasks.workunit.client.0.smithi172.stdout: 2024-09-16T16:56:52.585 INFO:tasks.workunit.client.0.smithi172.stdout:[----------] Global test environment tear-down 2024-09-16T16:56:52.585 INFO:tasks.workunit.client.0.smithi172.stdout:[==========] 16 tests from 1 test suite ran. (4938 ms total) 2024-09-16T16:56:52.585 INFO:tasks.workunit.client.0.smithi172.stdout:[ PASSED ] 0 tests. 2024-09-16T16:56:52.586 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] 16 tests, listed below: 2024-09-16T16:56:52.586 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestJournalReplay.AioDiscardEvent 2024-09-16T16:56:52.586 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestJournalReplay.AioWriteEvent 2024-09-16T16:56:52.586 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestJournalReplay.AioFlushEvent 2024-09-16T16:56:52.586 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestJournalReplay.SnapCreate 2024-09-16T16:56:52.586 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestJournalReplay.SnapProtect 2024-09-16T16:56:52.586 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestJournalReplay.SnapUnprotect 2024-09-16T16:56:52.586 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestJournalReplay.SnapRename 2024-09-16T16:56:52.586 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestJournalReplay.SnapRollback 2024-09-16T16:56:52.586 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestJournalReplay.SnapRemove 2024-09-16T16:56:52.586 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestJournalReplay.Rename 2024-09-16T16:56:52.586 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestJournalReplay.Resize 2024-09-16T16:56:52.586 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestJournalReplay.Flatten 2024-09-16T16:56:52.586 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestJournalReplay.UpdateFeatures 2024-09-16T16:56:52.586 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestJournalReplay.MetadataSet 2024-09-16T16:56:52.587 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestJournalReplay.MetadataRemove 2024-09-16T16:56:52.587 INFO:tasks.workunit.client.0.smithi172.stdout:[ SKIPPED ] TestJournalReplay.ObjectPosition 2024-09-16T16:56:52.591 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-16T16:56:52.591 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-16T16:56:52.623 INFO:tasks.workunit:Stopping ['rbd/crimson/test_crimson_librbd.sh'] on client.0... 2024-09-16T16:56:52.623 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-16T16:56:53.073 DEBUG:teuthology.parallel:result is None 2024-09-16T16:56:53.074 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-16T16:56:53.100 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-16T16:56:53.100 DEBUG:teuthology.orchestra.run.smithi172:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-16T16:56:53.162 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-16T16:56:53.162 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-16T16:56:53.175 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T16:56:53.175 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:56:53.311 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:56:53.307+0000 7fa6ea697640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:53.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:56:53.314+0000 7fa6ea697640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:53.497 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:56:53.497 INFO:teuthology.orchestra.run.smithi172.stderr:dumped all 2024-09-16T16:56:53.510 INFO:teuthology.orchestra.run.smithi172.stdout:{"pg_ready":true,"pg_map":{"version":571,"stamp":"2024-09-16T16:56:53.111346+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":283115520,"kb_used":125100,"kb_used_data":2996,"kb_used_omap":0,"kb_used_meta":122048,"kb_avail":282990420,"statfs":{"total":289910292480,"available":289782190080,"internally_reserved":0,"allocated":3067904,"data_stored":2397214,"data_compressed":60108,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":124977152},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000882"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":495,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-16T16:56:23.412049+0000","last_change":"2024-09-16T16:44:30.023111+0000","last_active":"2024-09-16T16:56:23.412049+0000","last_peered":"2024-09-16T16:56:23.412049+0000","last_clean":"2024-09-16T16:56:23.412049+0000","last_became_active":"2024-09-16T16:44:28.082969+0000","last_became_peered":"2024-09-16T16:44:28.082969+0000","last_unstale":"2024-09-16T16:56:23.412049+0000","last_undegraded":"2024-09-16T16:56:23.412049+0000","last_fullsized":"2024-09-16T16:56:23.412049+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_clean_scrub_stamp":"2024-09-16T16:44:26.972784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":495,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-16T16:56:23.418477+0000","last_change":"2024-09-16T16:44:30.026831+0000","last_active":"2024-09-16T16:56:23.418477+0000","last_peered":"2024-09-16T16:56:23.418477+0000","last_clean":"2024-09-16T16:56:23.418477+0000","last_became_active":"2024-09-16T16:44:28.115763+0000","last_became_peered":"2024-09-16T16:44:28.115763+0000","last_unstale":"2024-09-16T16:56:23.418477+0000","last_undegraded":"2024-09-16T16:56:23.418477+0000","last_fullsized":"2024-09-16T16:56:23.418477+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_clean_scrub_stamp":"2024-09-16T16:44:26.972784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":495,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-16T16:56:23.413124+0000","last_change":"2024-09-16T16:44:30.023390+0000","last_active":"2024-09-16T16:56:23.413124+0000","last_peered":"2024-09-16T16:56:23.413124+0000","last_clean":"2024-09-16T16:56:23.413124+0000","last_became_active":"2024-09-16T16:44:28.042234+0000","last_became_peered":"2024-09-16T16:44:28.042234+0000","last_unstale":"2024-09-16T16:56:23.413124+0000","last_undegraded":"2024-09-16T16:56:23.413124+0000","last_fullsized":"2024-09-16T16:56:23.413124+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_clean_scrub_stamp":"2024-09-16T16:44:26.972784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":495,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-16T16:56:23.411577+0000","last_change":"2024-09-16T16:44:30.022526+0000","last_active":"2024-09-16T16:56:23.411577+0000","last_peered":"2024-09-16T16:56:23.411577+0000","last_clean":"2024-09-16T16:56:23.411577+0000","last_became_active":"2024-09-16T16:44:28.065454+0000","last_became_peered":"2024-09-16T16:44:28.065454+0000","last_unstale":"2024-09-16T16:56:23.411577+0000","last_undegraded":"2024-09-16T16:56:23.411577+0000","last_fullsized":"2024-09-16T16:56:23.411577+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_clean_scrub_stamp":"2024-09-16T16:44:26.972784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":497,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-16T16:56:23.418234+0000","last_change":"2024-09-16T16:44:30.021241+0000","last_active":"2024-09-16T16:56:23.418234+0000","last_peered":"2024-09-16T16:56:23.418234+0000","last_clean":"2024-09-16T16:56:23.418234+0000","last_became_active":"2024-09-16T16:44:28.094925+0000","last_became_peered":"2024-09-16T16:44:28.094925+0000","last_unstale":"2024-09-16T16:56:23.418234+0000","last_undegraded":"2024-09-16T16:56:23.418234+0000","last_fullsized":"2024-09-16T16:56:23.418234+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_clean_scrub_stamp":"2024-09-16T16:44:26.972784+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":498,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-16T16:56:24.433479+0000","last_change":"2024-09-16T16:44:30.017303+0000","last_active":"2024-09-16T16:56:24.433479+0000","last_peered":"2024-09-16T16:56:24.433479+0000","last_clean":"2024-09-16T16:56:24.433479+0000","last_became_active":"2024-09-16T16:44:28.113269+0000","last_became_peered":"2024-09-16T16:44:28.113269+0000","last_unstale":"2024-09-16T16:56:24.433479+0000","last_undegraded":"2024-09-16T16:56:24.433479+0000","last_fullsized":"2024-09-16T16:56:24.433479+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_clean_scrub_stamp":"2024-09-16T16:44:26.972784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":498,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-16T16:56:24.429046+0000","last_change":"2024-09-16T16:44:30.015664+0000","last_active":"2024-09-16T16:56:24.429046+0000","last_peered":"2024-09-16T16:56:24.429046+0000","last_clean":"2024-09-16T16:56:24.429046+0000","last_became_active":"2024-09-16T16:44:28.100077+0000","last_became_peered":"2024-09-16T16:44:28.100077+0000","last_unstale":"2024-09-16T16:56:24.429046+0000","last_undegraded":"2024-09-16T16:56:24.429046+0000","last_fullsized":"2024-09-16T16:56:24.429046+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_clean_scrub_stamp":"2024-09-16T16:44:26.972784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":496,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-16T16:56:23.418033+0000","last_change":"2024-09-16T16:44:30.027539+0000","last_active":"2024-09-16T16:56:23.418033+0000","last_peered":"2024-09-16T16:56:23.418033+0000","last_clean":"2024-09-16T16:56:23.418033+0000","last_became_active":"2024-09-16T16:44:28.095919+0000","last_became_peered":"2024-09-16T16:44:28.095919+0000","last_unstale":"2024-09-16T16:56:23.418033+0000","last_undegraded":"2024-09-16T16:56:23.418033+0000","last_fullsized":"2024-09-16T16:56:23.418033+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_clean_scrub_stamp":"2024-09-16T16:44:26.972784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'52","reported_seq":567,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-16T16:56:23.409361+0000","last_change":"2024-09-16T16:44:26.004647+0000","last_active":"2024-09-16T16:56:23.409361+0000","last_peered":"2024-09-16T16:56:23.409361+0000","last_clean":"2024-09-16T16:56:23.409361+0000","last_became_active":"2024-09-16T16:44:25.997426+0000","last_became_peered":"2024-09-16T16:44:25.997426+0000","last_unstale":"2024-09-16T16:56:23.409361+0000","last_undegraded":"2024-09-16T16:56:23.409361+0000","last_fullsized":"2024-09-16T16:56:23.409361+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:44:24.961212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:44:24.961212+0000","last_clean_scrub_stamp":"2024-09-16T16:44:24.961212+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30054,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654706382,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40276,"kb_used_data":964,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94331564,"statfs":{"total":96636764160,"available":96595521536,"internally_reserved":0,"allocated":987136,"data_stored":409177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359739083,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":44492,"kb_used_data":1012,"kb_used_omap":0,"kb_used_meta":43456,"kb_avail":94327348,"statfs":{"total":96636764160,"available":96591204352,"internally_reserved":0,"allocated":1036288,"data_stored":992173,"data_compressed":30054,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":44498944},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359739084,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40332,"kb_used_data":1020,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94331508,"statfs":{"total":96636764160,"available":96595464192,"internally_reserved":0,"allocated":1044480,"data_stored":995864,"data_compressed":30054,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30054,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:56:53.511 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:56:53.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:56:53.616+0000 7fa028311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:53.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:56:53.623+0000 7fa028311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:53.807 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:56:53.807 INFO:teuthology.orchestra.run.smithi172.stderr:dumped all 2024-09-16T16:56:53.820 INFO:teuthology.orchestra.run.smithi172.stdout:{"pg_ready":true,"pg_map":{"version":571,"stamp":"2024-09-16T16:56:53.111346+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":283115520,"kb_used":125100,"kb_used_data":2996,"kb_used_omap":0,"kb_used_meta":122048,"kb_avail":282990420,"statfs":{"total":289910292480,"available":289782190080,"internally_reserved":0,"allocated":3067904,"data_stored":2397214,"data_compressed":60108,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":124977152},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000882"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":495,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-16T16:56:23.412049+0000","last_change":"2024-09-16T16:44:30.023111+0000","last_active":"2024-09-16T16:56:23.412049+0000","last_peered":"2024-09-16T16:56:23.412049+0000","last_clean":"2024-09-16T16:56:23.412049+0000","last_became_active":"2024-09-16T16:44:28.082969+0000","last_became_peered":"2024-09-16T16:44:28.082969+0000","last_unstale":"2024-09-16T16:56:23.412049+0000","last_undegraded":"2024-09-16T16:56:23.412049+0000","last_fullsized":"2024-09-16T16:56:23.412049+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_clean_scrub_stamp":"2024-09-16T16:44:26.972784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":495,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-16T16:56:23.418477+0000","last_change":"2024-09-16T16:44:30.026831+0000","last_active":"2024-09-16T16:56:23.418477+0000","last_peered":"2024-09-16T16:56:23.418477+0000","last_clean":"2024-09-16T16:56:23.418477+0000","last_became_active":"2024-09-16T16:44:28.115763+0000","last_became_peered":"2024-09-16T16:44:28.115763+0000","last_unstale":"2024-09-16T16:56:23.418477+0000","last_undegraded":"2024-09-16T16:56:23.418477+0000","last_fullsized":"2024-09-16T16:56:23.418477+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_clean_scrub_stamp":"2024-09-16T16:44:26.972784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":495,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-16T16:56:23.413124+0000","last_change":"2024-09-16T16:44:30.023390+0000","last_active":"2024-09-16T16:56:23.413124+0000","last_peered":"2024-09-16T16:56:23.413124+0000","last_clean":"2024-09-16T16:56:23.413124+0000","last_became_active":"2024-09-16T16:44:28.042234+0000","last_became_peered":"2024-09-16T16:44:28.042234+0000","last_unstale":"2024-09-16T16:56:23.413124+0000","last_undegraded":"2024-09-16T16:56:23.413124+0000","last_fullsized":"2024-09-16T16:56:23.413124+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_clean_scrub_stamp":"2024-09-16T16:44:26.972784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":495,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-16T16:56:23.411577+0000","last_change":"2024-09-16T16:44:30.022526+0000","last_active":"2024-09-16T16:56:23.411577+0000","last_peered":"2024-09-16T16:56:23.411577+0000","last_clean":"2024-09-16T16:56:23.411577+0000","last_became_active":"2024-09-16T16:44:28.065454+0000","last_became_peered":"2024-09-16T16:44:28.065454+0000","last_unstale":"2024-09-16T16:56:23.411577+0000","last_undegraded":"2024-09-16T16:56:23.411577+0000","last_fullsized":"2024-09-16T16:56:23.411577+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_clean_scrub_stamp":"2024-09-16T16:44:26.972784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":497,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-16T16:56:23.418234+0000","last_change":"2024-09-16T16:44:30.021241+0000","last_active":"2024-09-16T16:56:23.418234+0000","last_peered":"2024-09-16T16:56:23.418234+0000","last_clean":"2024-09-16T16:56:23.418234+0000","last_became_active":"2024-09-16T16:44:28.094925+0000","last_became_peered":"2024-09-16T16:44:28.094925+0000","last_unstale":"2024-09-16T16:56:23.418234+0000","last_undegraded":"2024-09-16T16:56:23.418234+0000","last_fullsized":"2024-09-16T16:56:23.418234+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_clean_scrub_stamp":"2024-09-16T16:44:26.972784+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":498,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-16T16:56:24.433479+0000","last_change":"2024-09-16T16:44:30.017303+0000","last_active":"2024-09-16T16:56:24.433479+0000","last_peered":"2024-09-16T16:56:24.433479+0000","last_clean":"2024-09-16T16:56:24.433479+0000","last_became_active":"2024-09-16T16:44:28.113269+0000","last_became_peered":"2024-09-16T16:44:28.113269+0000","last_unstale":"2024-09-16T16:56:24.433479+0000","last_undegraded":"2024-09-16T16:56:24.433479+0000","last_fullsized":"2024-09-16T16:56:24.433479+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_clean_scrub_stamp":"2024-09-16T16:44:26.972784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":498,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-16T16:56:24.429046+0000","last_change":"2024-09-16T16:44:30.015664+0000","last_active":"2024-09-16T16:56:24.429046+0000","last_peered":"2024-09-16T16:56:24.429046+0000","last_clean":"2024-09-16T16:56:24.429046+0000","last_became_active":"2024-09-16T16:44:28.100077+0000","last_became_peered":"2024-09-16T16:44:28.100077+0000","last_unstale":"2024-09-16T16:56:24.429046+0000","last_undegraded":"2024-09-16T16:56:24.429046+0000","last_fullsized":"2024-09-16T16:56:24.429046+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_clean_scrub_stamp":"2024-09-16T16:44:26.972784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":496,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-16T16:56:23.418033+0000","last_change":"2024-09-16T16:44:30.027539+0000","last_active":"2024-09-16T16:56:23.418033+0000","last_peered":"2024-09-16T16:56:23.418033+0000","last_clean":"2024-09-16T16:56:23.418033+0000","last_became_active":"2024-09-16T16:44:28.095919+0000","last_became_peered":"2024-09-16T16:44:28.095919+0000","last_unstale":"2024-09-16T16:56:23.418033+0000","last_undegraded":"2024-09-16T16:56:23.418033+0000","last_fullsized":"2024-09-16T16:56:23.418033+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_clean_scrub_stamp":"2024-09-16T16:44:26.972784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'52","reported_seq":567,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-16T16:56:23.409361+0000","last_change":"2024-09-16T16:44:26.004647+0000","last_active":"2024-09-16T16:56:23.409361+0000","last_peered":"2024-09-16T16:56:23.409361+0000","last_clean":"2024-09-16T16:56:23.409361+0000","last_became_active":"2024-09-16T16:44:25.997426+0000","last_became_peered":"2024-09-16T16:44:25.997426+0000","last_unstale":"2024-09-16T16:56:23.409361+0000","last_undegraded":"2024-09-16T16:56:23.409361+0000","last_fullsized":"2024-09-16T16:56:23.409361+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:44:24.961212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:44:24.961212+0000","last_clean_scrub_stamp":"2024-09-16T16:44:24.961212+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30054,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654706382,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40276,"kb_used_data":964,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94331564,"statfs":{"total":96636764160,"available":96595521536,"internally_reserved":0,"allocated":987136,"data_stored":409177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359739083,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":44492,"kb_used_data":1012,"kb_used_omap":0,"kb_used_meta":43456,"kb_avail":94327348,"statfs":{"total":96636764160,"available":96591204352,"internally_reserved":0,"allocated":1036288,"data_stored":992173,"data_compressed":30054,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":44498944},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359739084,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40332,"kb_used_data":1020,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94331508,"statfs":{"total":96636764160,"available":96595464192,"internally_reserved":0,"allocated":1044480,"data_stored":995864,"data_compressed":30054,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30054,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:56:53.821 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T16:56:53.821 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:56:53.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:56:53.927+0000 7fa616b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:53.934 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:56:53.934+0000 7fa616b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:54.117 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:56:54.117 INFO:teuthology.orchestra.run.smithi172.stderr:dumped all 2024-09-16T16:56:54.130 INFO:teuthology.orchestra.run.smithi172.stdout:{"pg_ready":true,"pg_map":{"version":571,"stamp":"2024-09-16T16:56:53.111346+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":283115520,"kb_used":125100,"kb_used_data":2996,"kb_used_omap":0,"kb_used_meta":122048,"kb_avail":282990420,"statfs":{"total":289910292480,"available":289782190080,"internally_reserved":0,"allocated":3067904,"data_stored":2397214,"data_compressed":60108,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":124977152},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000882"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":495,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-16T16:56:23.412049+0000","last_change":"2024-09-16T16:44:30.023111+0000","last_active":"2024-09-16T16:56:23.412049+0000","last_peered":"2024-09-16T16:56:23.412049+0000","last_clean":"2024-09-16T16:56:23.412049+0000","last_became_active":"2024-09-16T16:44:28.082969+0000","last_became_peered":"2024-09-16T16:44:28.082969+0000","last_unstale":"2024-09-16T16:56:23.412049+0000","last_undegraded":"2024-09-16T16:56:23.412049+0000","last_fullsized":"2024-09-16T16:56:23.412049+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_clean_scrub_stamp":"2024-09-16T16:44:26.972784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":495,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-16T16:56:23.418477+0000","last_change":"2024-09-16T16:44:30.026831+0000","last_active":"2024-09-16T16:56:23.418477+0000","last_peered":"2024-09-16T16:56:23.418477+0000","last_clean":"2024-09-16T16:56:23.418477+0000","last_became_active":"2024-09-16T16:44:28.115763+0000","last_became_peered":"2024-09-16T16:44:28.115763+0000","last_unstale":"2024-09-16T16:56:23.418477+0000","last_undegraded":"2024-09-16T16:56:23.418477+0000","last_fullsized":"2024-09-16T16:56:23.418477+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_clean_scrub_stamp":"2024-09-16T16:44:26.972784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":495,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-16T16:56:23.413124+0000","last_change":"2024-09-16T16:44:30.023390+0000","last_active":"2024-09-16T16:56:23.413124+0000","last_peered":"2024-09-16T16:56:23.413124+0000","last_clean":"2024-09-16T16:56:23.413124+0000","last_became_active":"2024-09-16T16:44:28.042234+0000","last_became_peered":"2024-09-16T16:44:28.042234+0000","last_unstale":"2024-09-16T16:56:23.413124+0000","last_undegraded":"2024-09-16T16:56:23.413124+0000","last_fullsized":"2024-09-16T16:56:23.413124+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_clean_scrub_stamp":"2024-09-16T16:44:26.972784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":495,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-16T16:56:23.411577+0000","last_change":"2024-09-16T16:44:30.022526+0000","last_active":"2024-09-16T16:56:23.411577+0000","last_peered":"2024-09-16T16:56:23.411577+0000","last_clean":"2024-09-16T16:56:23.411577+0000","last_became_active":"2024-09-16T16:44:28.065454+0000","last_became_peered":"2024-09-16T16:44:28.065454+0000","last_unstale":"2024-09-16T16:56:23.411577+0000","last_undegraded":"2024-09-16T16:56:23.411577+0000","last_fullsized":"2024-09-16T16:56:23.411577+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_clean_scrub_stamp":"2024-09-16T16:44:26.972784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":497,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-16T16:56:23.418234+0000","last_change":"2024-09-16T16:44:30.021241+0000","last_active":"2024-09-16T16:56:23.418234+0000","last_peered":"2024-09-16T16:56:23.418234+0000","last_clean":"2024-09-16T16:56:23.418234+0000","last_became_active":"2024-09-16T16:44:28.094925+0000","last_became_peered":"2024-09-16T16:44:28.094925+0000","last_unstale":"2024-09-16T16:56:23.418234+0000","last_undegraded":"2024-09-16T16:56:23.418234+0000","last_fullsized":"2024-09-16T16:56:23.418234+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_clean_scrub_stamp":"2024-09-16T16:44:26.972784+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":498,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-16T16:56:24.433479+0000","last_change":"2024-09-16T16:44:30.017303+0000","last_active":"2024-09-16T16:56:24.433479+0000","last_peered":"2024-09-16T16:56:24.433479+0000","last_clean":"2024-09-16T16:56:24.433479+0000","last_became_active":"2024-09-16T16:44:28.113269+0000","last_became_peered":"2024-09-16T16:44:28.113269+0000","last_unstale":"2024-09-16T16:56:24.433479+0000","last_undegraded":"2024-09-16T16:56:24.433479+0000","last_fullsized":"2024-09-16T16:56:24.433479+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_clean_scrub_stamp":"2024-09-16T16:44:26.972784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":498,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-16T16:56:24.429046+0000","last_change":"2024-09-16T16:44:30.015664+0000","last_active":"2024-09-16T16:56:24.429046+0000","last_peered":"2024-09-16T16:56:24.429046+0000","last_clean":"2024-09-16T16:56:24.429046+0000","last_became_active":"2024-09-16T16:44:28.100077+0000","last_became_peered":"2024-09-16T16:44:28.100077+0000","last_unstale":"2024-09-16T16:56:24.429046+0000","last_undegraded":"2024-09-16T16:56:24.429046+0000","last_fullsized":"2024-09-16T16:56:24.429046+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_clean_scrub_stamp":"2024-09-16T16:44:26.972784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":496,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-16T16:56:23.418033+0000","last_change":"2024-09-16T16:44:30.027539+0000","last_active":"2024-09-16T16:56:23.418033+0000","last_peered":"2024-09-16T16:56:23.418033+0000","last_clean":"2024-09-16T16:56:23.418033+0000","last_became_active":"2024-09-16T16:44:28.095919+0000","last_became_peered":"2024-09-16T16:44:28.095919+0000","last_unstale":"2024-09-16T16:56:23.418033+0000","last_undegraded":"2024-09-16T16:56:23.418033+0000","last_fullsized":"2024-09-16T16:56:23.418033+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_clean_scrub_stamp":"2024-09-16T16:44:26.972784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'52","reported_seq":567,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-16T16:56:23.409361+0000","last_change":"2024-09-16T16:44:26.004647+0000","last_active":"2024-09-16T16:56:23.409361+0000","last_peered":"2024-09-16T16:56:23.409361+0000","last_clean":"2024-09-16T16:56:23.409361+0000","last_became_active":"2024-09-16T16:44:25.997426+0000","last_became_peered":"2024-09-16T16:44:25.997426+0000","last_unstale":"2024-09-16T16:56:23.409361+0000","last_undegraded":"2024-09-16T16:56:23.409361+0000","last_fullsized":"2024-09-16T16:56:23.409361+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:44:24.961212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:44:24.961212+0000","last_clean_scrub_stamp":"2024-09-16T16:44:24.961212+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30054,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654706382,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40276,"kb_used_data":964,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94331564,"statfs":{"total":96636764160,"available":96595521536,"internally_reserved":0,"allocated":987136,"data_stored":409177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359739083,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":44492,"kb_used_data":1012,"kb_used_omap":0,"kb_used_meta":43456,"kb_avail":94327348,"statfs":{"total":96636764160,"available":96591204352,"internally_reserved":0,"allocated":1036288,"data_stored":992173,"data_compressed":30054,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":44498944},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359739084,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40332,"kb_used_data":1020,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94331508,"statfs":{"total":96636764160,"available":96595464192,"internally_reserved":0,"allocated":1044480,"data_stored":995864,"data_compressed":30054,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30054,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:56:54.131 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T16:56:54.240 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:56:54.236+0000 7f8d4ced1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:54.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:56:54.243+0000 7f8d4ced1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:54.429 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:56:54.429 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":203,"fsid":"b37952f5-be5e-4143-b02a-8a862025ace7","created":"2024-09-16T16:44:16.297687+0000","modified":"2024-09-16T16:56:52.569760+0000","last_up_change":"2024-09-16T16:44:24.961212+0000","last_in_change":"2024-09-16T16:44:18.188516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T16:44:24.961123+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-16T16:44:26.043950+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":14,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a0d1e13b-881e-4468-8a85-2287def18a29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6803","nonce":3999995245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3999995245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3999995245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":3999995245}]},"public_addr":"172.21.15.172:6803/3999995245","cluster_addr":"172.21.15.172:6806/3999995245","heartbeat_back_addr":"172.21.15.172:6808/3999995245","heartbeat_front_addr":"172.21.15.172:6809/3999995245","state":["exists","up"]},{"osd":1,"uuid":"8a3815ab-c40e-4af9-8454-fd1430d0a3b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":1268064620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1268064620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1268064620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6807","nonce":1268064620}]},"public_addr":"172.21.15.172:6805/1268064620","cluster_addr":"172.21.15.172:6804/1268064620","heartbeat_back_addr":"172.21.15.172:6802/1268064620","heartbeat_front_addr":"172.21.15.172:6807/1268064620","state":["exists","up"]},{"osd":2,"uuid":"8e992d53-ac88-41dd-a522-8052ee8469d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":2451117477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6811","nonce":2451117477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2451117477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6815","nonce":2451117477}]},"public_addr":"172.21.15.172:6810/2451117477","cluster_addr":"172.21.15.172:6811/2451117477","heartbeat_back_addr":"172.21.15.172:6814/2451117477","heartbeat_front_addr":"172.21.15.172:6815/2451117477","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]},{"pool":3,"snaps":[{"begin":2,"length":13},{"begin":17,"length":1},{"begin":21,"length":1},{"begin":24,"length":1},{"begin":28,"length":8}]},{"pool":4,"snaps":[{"begin":2,"length":1}]},{"pool":5,"snaps":[{"begin":2,"length":1}]},{"pool":6,"snaps":[{"begin":2,"length":2}]},{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":2,"length":1}]},{"pool":19,"snaps":[{"begin":2,"length":1}]},{"pool":20,"snaps":[{"begin":2,"length":4}]},{"pool":21,"snaps":[{"begin":2,"length":1}]},{"pool":22,"snaps":[{"begin":2,"length":1}]},{"pool":23,"snaps":[{"begin":2,"length":1}]},{"pool":24,"snaps":[{"begin":2,"length":1}]},{"pool":25,"snaps":[{"begin":2,"length":1}]},{"pool":26,"snaps":[{"begin":2,"length":1}]},{"pool":27,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T16:56:55.444 INFO:tasks.ceph:Scrubbing osd.0 2024-09-16T16:56:55.444 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-16T16:56:55.566 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:56:55.556+0000 7f8c97c88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:55.570 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:56:55.569+0000 7f8c97c88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:55.595 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-09-16T16:56:55.595 INFO:teuthology.orchestra.run.smithi172.stdout: "success": "" 2024-09-16T16:56:55.595 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-09-16T16:56:55.606 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-16T16:56:55.717 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:56:55.711+0000 7f2195308640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:55.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:56:55.719+0000 7f2195308640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:55.907 INFO:teuthology.orchestra.run.smithi172.stderr:instructed osd(s) 0 to deep-scrub 2024-09-16T16:56:55.925 INFO:tasks.ceph:Scrubbing osd.1 2024-09-16T16:56:55.925 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-16T16:56:56.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:56:56.028+0000 7fd7df911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:56.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:56:56.041+0000 7fd7df911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:56.057 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-09-16T16:56:56.057 INFO:teuthology.orchestra.run.smithi172.stdout: "success": "" 2024-09-16T16:56:56.057 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-09-16T16:56:56.069 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-16T16:56:56.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:56:56.172+0000 7fbb9c111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:56.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:56:56.181+0000 7fbb9c111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:56.367 INFO:teuthology.orchestra.run.smithi172.stderr:instructed osd(s) 1 to deep-scrub 2024-09-16T16:56:56.388 INFO:tasks.ceph:Scrubbing osd.2 2024-09-16T16:56:56.388 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-16T16:56:56.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:56:56.498+0000 7f1c0f391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:56.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:56:56.510+0000 7f1c0f391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:56.527 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-09-16T16:56:56.527 INFO:teuthology.orchestra.run.smithi172.stdout: "success": "" 2024-09-16T16:56:56.527 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-09-16T16:56:56.539 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-16T16:56:56.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:56:56.645+0000 7fa25fb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:56.655 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:56:56.654+0000 7fa25fb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:56.841 INFO:teuthology.orchestra.run.smithi172.stderr:instructed osd(s) 2 to deep-scrub 2024-09-16T16:56:56.858 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:56:56.967 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:56:56.962+0000 7fefb2cbd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:56.971 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:56:56.969+0000 7fefb2cbd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:57.156 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:56:57.157 INFO:teuthology.orchestra.run.smithi172.stderr:dumped all 2024-09-16T16:56:57.170 INFO:teuthology.orchestra.run.smithi172.stdout:{"pg_ready":true,"pg_map":{"version":574,"stamp":"2024-09-16T16:56:57.112200+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":283115520,"kb_used":105060,"kb_used_data":3764,"kb_used_omap":0,"kb_used_meta":101248,"kb_avail":283010460,"statfs":{"total":289910292480,"available":289802711040,"internally_reserved":0,"allocated":3854336,"data_stored":2719798,"data_compressed":60108,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":103677952},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001290"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":582,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-16T16:56:52.604569+0000","last_change":"2024-09-16T16:44:30.023111+0000","last_active":"2024-09-16T16:56:52.604569+0000","last_peered":"2024-09-16T16:56:52.604569+0000","last_clean":"2024-09-16T16:56:52.604569+0000","last_became_active":"2024-09-16T16:44:28.082969+0000","last_became_peered":"2024-09-16T16:44:28.082969+0000","last_unstale":"2024-09-16T16:56:52.604569+0000","last_undegraded":"2024-09-16T16:56:52.604569+0000","last_fullsized":"2024-09-16T16:56:52.604569+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_clean_scrub_stamp":"2024-09-16T16:44:26.972784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":582,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-16T16:56:52.650125+0000","last_change":"2024-09-16T16:44:30.026831+0000","last_active":"2024-09-16T16:56:52.650125+0000","last_peered":"2024-09-16T16:56:52.650125+0000","last_clean":"2024-09-16T16:56:52.650125+0000","last_became_active":"2024-09-16T16:44:28.115763+0000","last_became_peered":"2024-09-16T16:44:28.115763+0000","last_unstale":"2024-09-16T16:56:52.650125+0000","last_undegraded":"2024-09-16T16:56:52.650125+0000","last_fullsized":"2024-09-16T16:56:52.650125+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_clean_scrub_stamp":"2024-09-16T16:44:26.972784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":582,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-16T16:56:52.609939+0000","last_change":"2024-09-16T16:44:30.023390+0000","last_active":"2024-09-16T16:56:52.609939+0000","last_peered":"2024-09-16T16:56:52.609939+0000","last_clean":"2024-09-16T16:56:52.609939+0000","last_became_active":"2024-09-16T16:44:28.042234+0000","last_became_peered":"2024-09-16T16:44:28.042234+0000","last_unstale":"2024-09-16T16:56:52.609939+0000","last_undegraded":"2024-09-16T16:56:52.609939+0000","last_fullsized":"2024-09-16T16:56:52.609939+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_clean_scrub_stamp":"2024-09-16T16:44:26.972784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":582,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-16T16:56:52.645692+0000","last_change":"2024-09-16T16:44:30.022526+0000","last_active":"2024-09-16T16:56:52.645692+0000","last_peered":"2024-09-16T16:56:52.645692+0000","last_clean":"2024-09-16T16:56:52.645692+0000","last_became_active":"2024-09-16T16:44:28.065454+0000","last_became_peered":"2024-09-16T16:44:28.065454+0000","last_unstale":"2024-09-16T16:56:52.645692+0000","last_undegraded":"2024-09-16T16:56:52.645692+0000","last_fullsized":"2024-09-16T16:56:52.645692+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_clean_scrub_stamp":"2024-09-16T16:44:26.972784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":584,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-16T16:56:52.693480+0000","last_change":"2024-09-16T16:44:30.021241+0000","last_active":"2024-09-16T16:56:52.693480+0000","last_peered":"2024-09-16T16:56:52.693480+0000","last_clean":"2024-09-16T16:56:52.693480+0000","last_became_active":"2024-09-16T16:44:28.094925+0000","last_became_peered":"2024-09-16T16:44:28.094925+0000","last_unstale":"2024-09-16T16:56:52.693480+0000","last_undegraded":"2024-09-16T16:56:52.693480+0000","last_fullsized":"2024-09-16T16:56:52.693480+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_clean_scrub_stamp":"2024-09-16T16:44:26.972784+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":582,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-16T16:56:52.654512+0000","last_change":"2024-09-16T16:44:30.017303+0000","last_active":"2024-09-16T16:56:52.654512+0000","last_peered":"2024-09-16T16:56:52.654512+0000","last_clean":"2024-09-16T16:56:52.654512+0000","last_became_active":"2024-09-16T16:44:28.113269+0000","last_became_peered":"2024-09-16T16:44:28.113269+0000","last_unstale":"2024-09-16T16:56:52.654512+0000","last_undegraded":"2024-09-16T16:56:52.654512+0000","last_fullsized":"2024-09-16T16:56:52.654512+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_clean_scrub_stamp":"2024-09-16T16:44:26.972784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":582,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-16T16:56:52.634656+0000","last_change":"2024-09-16T16:44:30.015664+0000","last_active":"2024-09-16T16:56:52.634656+0000","last_peered":"2024-09-16T16:56:52.634656+0000","last_clean":"2024-09-16T16:56:52.634656+0000","last_became_active":"2024-09-16T16:44:28.100077+0000","last_became_peered":"2024-09-16T16:44:28.100077+0000","last_unstale":"2024-09-16T16:56:52.634656+0000","last_undegraded":"2024-09-16T16:56:52.634656+0000","last_fullsized":"2024-09-16T16:56:52.634656+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_clean_scrub_stamp":"2024-09-16T16:44:26.972784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":583,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-16T16:56:52.636648+0000","last_change":"2024-09-16T16:44:30.027539+0000","last_active":"2024-09-16T16:56:52.636648+0000","last_peered":"2024-09-16T16:56:52.636648+0000","last_clean":"2024-09-16T16:56:52.636648+0000","last_became_active":"2024-09-16T16:44:28.095919+0000","last_became_peered":"2024-09-16T16:44:28.095919+0000","last_unstale":"2024-09-16T16:56:52.636648+0000","last_undegraded":"2024-09-16T16:56:52.636648+0000","last_fullsized":"2024-09-16T16:56:52.636648+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_clean_scrub_stamp":"2024-09-16T16:44:26.972784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'52","reported_seq":654,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-16T16:56:52.600454+0000","last_change":"2024-09-16T16:44:26.004647+0000","last_active":"2024-09-16T16:56:52.600454+0000","last_peered":"2024-09-16T16:56:52.600454+0000","last_clean":"2024-09-16T16:56:52.600454+0000","last_became_active":"2024-09-16T16:44:25.997426+0000","last_became_peered":"2024-09-16T16:44:25.997426+0000","last_unstale":"2024-09-16T16:56:52.600454+0000","last_undegraded":"2024-09-16T16:56:52.600454+0000","last_fullsized":"2024-09-16T16:56:52.600454+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:44:24.961212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:44:24.961212+0000","last_clean_scrub_stamp":"2024-09-16T16:44:24.961212+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30054,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654706412,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28044,"kb_used_data":1212,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94343796,"statfs":{"total":96636764160,"available":96608047104,"internally_reserved":0,"allocated":1241088,"data_stored":513008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359739113,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32268,"kb_used_data":1276,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94339572,"statfs":{"total":96636764160,"available":96603721728,"internally_reserved":0,"allocated":1306624,"data_stored":1103395,"data_compressed":30054,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359739114,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":44748,"kb_used_data":1276,"kb_used_omap":0,"kb_used_meta":43456,"kb_avail":94327092,"statfs":{"total":96636764160,"available":96590942208,"internally_reserved":0,"allocated":1306624,"data_stored":1103395,"data_compressed":30054,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":44498944},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30054,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:56:57.173 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-16T16:44:26.972784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=44, tm_sec=26, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=56, tm_sec=54, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T16:56:57.174 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-16T16:44:26.972784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=44, tm_sec=26, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=56, tm_sec=54, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T16:56:57.174 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-16T16:44:26.972784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=44, tm_sec=26, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=56, tm_sec=54, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T16:56:57.174 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-16T16:44:26.972784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=44, tm_sec=26, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=56, tm_sec=54, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T16:56:57.174 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-16T16:44:26.972784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=44, tm_sec=26, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=56, tm_sec=54, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T16:56:57.174 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-16T16:44:26.972784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=44, tm_sec=26, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=56, tm_sec=54, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T16:56:57.174 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-16T16:44:26.972784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=44, tm_sec=26, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=56, tm_sec=54, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T16:56:57.174 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-16T16:44:26.972784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=44, tm_sec=26, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=56, tm_sec=54, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T16:56:57.174 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-16T16:44:24.961212+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=44, tm_sec=24, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=56, tm_sec=54, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T16:56:57.174 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T16:57:17.175 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:57:17.297 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:57:17.292+0000 7f92cf791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:17.301 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:57:17.300+0000 7f92cf791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:17.483 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:57:17.483 INFO:teuthology.orchestra.run.smithi172.stderr:dumped all 2024-09-16T16:57:17.497 INFO:teuthology.orchestra.run.smithi172.stdout:{"pg_ready":true,"pg_map":{"version":584,"stamp":"2024-09-16T16:57:17.116838+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":283115520,"kb_used":105060,"kb_used_data":3764,"kb_used_omap":0,"kb_used_meta":101248,"kb_avail":283010460,"statfs":{"total":289910292480,"available":289802711040,"internally_reserved":0,"allocated":3854336,"data_stored":2719798,"data_compressed":60108,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":103677952},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002729"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":582,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-16T16:56:52.604569+0000","last_change":"2024-09-16T16:44:30.023111+0000","last_active":"2024-09-16T16:56:52.604569+0000","last_peered":"2024-09-16T16:56:52.604569+0000","last_clean":"2024-09-16T16:56:52.604569+0000","last_became_active":"2024-09-16T16:44:28.082969+0000","last_became_peered":"2024-09-16T16:44:28.082969+0000","last_unstale":"2024-09-16T16:56:52.604569+0000","last_undegraded":"2024-09-16T16:56:52.604569+0000","last_fullsized":"2024-09-16T16:56:52.604569+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_clean_scrub_stamp":"2024-09-16T16:44:26.972784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":582,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-16T16:56:52.650125+0000","last_change":"2024-09-16T16:44:30.026831+0000","last_active":"2024-09-16T16:56:52.650125+0000","last_peered":"2024-09-16T16:56:52.650125+0000","last_clean":"2024-09-16T16:56:52.650125+0000","last_became_active":"2024-09-16T16:44:28.115763+0000","last_became_peered":"2024-09-16T16:44:28.115763+0000","last_unstale":"2024-09-16T16:56:52.650125+0000","last_undegraded":"2024-09-16T16:56:52.650125+0000","last_fullsized":"2024-09-16T16:56:52.650125+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_clean_scrub_stamp":"2024-09-16T16:44:26.972784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":582,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-16T16:56:52.609939+0000","last_change":"2024-09-16T16:44:30.023390+0000","last_active":"2024-09-16T16:56:52.609939+0000","last_peered":"2024-09-16T16:56:52.609939+0000","last_clean":"2024-09-16T16:56:52.609939+0000","last_became_active":"2024-09-16T16:44:28.042234+0000","last_became_peered":"2024-09-16T16:44:28.042234+0000","last_unstale":"2024-09-16T16:56:52.609939+0000","last_undegraded":"2024-09-16T16:56:52.609939+0000","last_fullsized":"2024-09-16T16:56:52.609939+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_clean_scrub_stamp":"2024-09-16T16:44:26.972784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":582,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-16T16:56:52.645692+0000","last_change":"2024-09-16T16:44:30.022526+0000","last_active":"2024-09-16T16:56:52.645692+0000","last_peered":"2024-09-16T16:56:52.645692+0000","last_clean":"2024-09-16T16:56:52.645692+0000","last_became_active":"2024-09-16T16:44:28.065454+0000","last_became_peered":"2024-09-16T16:44:28.065454+0000","last_unstale":"2024-09-16T16:56:52.645692+0000","last_undegraded":"2024-09-16T16:56:52.645692+0000","last_fullsized":"2024-09-16T16:56:52.645692+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_clean_scrub_stamp":"2024-09-16T16:44:26.972784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":584,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-16T16:56:52.693480+0000","last_change":"2024-09-16T16:44:30.021241+0000","last_active":"2024-09-16T16:56:52.693480+0000","last_peered":"2024-09-16T16:56:52.693480+0000","last_clean":"2024-09-16T16:56:52.693480+0000","last_became_active":"2024-09-16T16:44:28.094925+0000","last_became_peered":"2024-09-16T16:44:28.094925+0000","last_unstale":"2024-09-16T16:56:52.693480+0000","last_undegraded":"2024-09-16T16:56:52.693480+0000","last_fullsized":"2024-09-16T16:56:52.693480+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_clean_scrub_stamp":"2024-09-16T16:44:26.972784+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":582,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-16T16:56:52.654512+0000","last_change":"2024-09-16T16:44:30.017303+0000","last_active":"2024-09-16T16:56:52.654512+0000","last_peered":"2024-09-16T16:56:52.654512+0000","last_clean":"2024-09-16T16:56:52.654512+0000","last_became_active":"2024-09-16T16:44:28.113269+0000","last_became_peered":"2024-09-16T16:44:28.113269+0000","last_unstale":"2024-09-16T16:56:52.654512+0000","last_undegraded":"2024-09-16T16:56:52.654512+0000","last_fullsized":"2024-09-16T16:56:52.654512+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_clean_scrub_stamp":"2024-09-16T16:44:26.972784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":582,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-16T16:56:52.634656+0000","last_change":"2024-09-16T16:44:30.015664+0000","last_active":"2024-09-16T16:56:52.634656+0000","last_peered":"2024-09-16T16:56:52.634656+0000","last_clean":"2024-09-16T16:56:52.634656+0000","last_became_active":"2024-09-16T16:44:28.100077+0000","last_became_peered":"2024-09-16T16:44:28.100077+0000","last_unstale":"2024-09-16T16:56:52.634656+0000","last_undegraded":"2024-09-16T16:56:52.634656+0000","last_fullsized":"2024-09-16T16:56:52.634656+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_clean_scrub_stamp":"2024-09-16T16:44:26.972784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":583,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-16T16:56:52.636648+0000","last_change":"2024-09-16T16:44:30.027539+0000","last_active":"2024-09-16T16:56:52.636648+0000","last_peered":"2024-09-16T16:56:52.636648+0000","last_clean":"2024-09-16T16:56:52.636648+0000","last_became_active":"2024-09-16T16:44:28.095919+0000","last_became_peered":"2024-09-16T16:44:28.095919+0000","last_unstale":"2024-09-16T16:56:52.636648+0000","last_undegraded":"2024-09-16T16:56:52.636648+0000","last_fullsized":"2024-09-16T16:56:52.636648+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:44:26.972784+0000","last_clean_scrub_stamp":"2024-09-16T16:44:26.972784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'52","reported_seq":654,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-16T16:56:52.600454+0000","last_change":"2024-09-16T16:44:26.004647+0000","last_active":"2024-09-16T16:56:52.600454+0000","last_peered":"2024-09-16T16:56:52.600454+0000","last_clean":"2024-09-16T16:56:52.600454+0000","last_became_active":"2024-09-16T16:44:25.997426+0000","last_became_peered":"2024-09-16T16:44:25.997426+0000","last_unstale":"2024-09-16T16:56:52.600454+0000","last_undegraded":"2024-09-16T16:56:52.600454+0000","last_fullsized":"2024-09-16T16:56:52.600454+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:44:24.961212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:44:24.961212+0000","last_clean_scrub_stamp":"2024-09-16T16:44:24.961212+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30054,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654706412,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28044,"kb_used_data":1212,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94343796,"statfs":{"total":96636764160,"available":96608047104,"internally_reserved":0,"allocated":1241088,"data_stored":513008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359739113,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32268,"kb_used_data":1276,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94339572,"statfs":{"total":96636764160,"available":96603721728,"internally_reserved":0,"allocated":1306624,"data_stored":1103395,"data_compressed":30054,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359739114,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":44748,"kb_used_data":1276,"kb_used_omap":0,"kb_used_meta":43456,"kb_avail":94327092,"statfs":{"total":96636764160,"available":96590942208,"internally_reserved":0,"allocated":1306624,"data_stored":1103395,"data_compressed":30054,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":44498944},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30054,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:57:17.498 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-16T16:44:26.972784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=44, tm_sec=26, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=56, tm_sec=54, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T16:57:17.498 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-16T16:44:26.972784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=44, tm_sec=26, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=56, tm_sec=54, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T16:57:17.498 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-16T16:44:26.972784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=44, tm_sec=26, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=56, tm_sec=54, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T16:57:17.498 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-16T16:44:26.972784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=44, tm_sec=26, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=56, tm_sec=54, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T16:57:17.498 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-16T16:44:26.972784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=44, tm_sec=26, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=56, tm_sec=54, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T16:57:17.498 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-16T16:44:26.972784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=44, tm_sec=26, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=56, tm_sec=54, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T16:57:17.498 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-16T16:44:26.972784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=44, tm_sec=26, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=56, tm_sec=54, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T16:57:17.499 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-16T16:44:26.972784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=44, tm_sec=26, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=56, tm_sec=54, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T16:57:17.499 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-16T16:44:24.961212+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=44, tm_sec=24, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=56, tm_sec=54, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T16:57:17.499 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T16:57:37.500 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:57:37.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:57:37.619+0000 7fb158151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:37.628 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:57:37.627+0000 7fb158151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:37.810 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T16:57:37.810 INFO:teuthology.orchestra.run.smithi172.stderr:dumped all 2024-09-16T16:57:37.823 INFO:teuthology.orchestra.run.smithi172.stdout:{"pg_ready":true,"pg_map":{"version":594,"stamp":"2024-09-16T16:57:37.121375+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":283115520,"kb_used":105084,"kb_used_data":3788,"kb_used_omap":0,"kb_used_meta":101248,"kb_avail":283010436,"statfs":{"total":289910292480,"available":289802686464,"internally_reserved":0,"allocated":3878912,"data_stored":2729167,"data_compressed":60108,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":103677952},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002683"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":587,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-16T16:56:56.419736+0000","last_change":"2024-09-16T16:56:56.401919+0000","last_active":"2024-09-16T16:56:56.419736+0000","last_peered":"2024-09-16T16:56:56.419736+0000","last_clean":"2024-09-16T16:56:56.419736+0000","last_became_active":"2024-09-16T16:44:28.082969+0000","last_became_peered":"2024-09-16T16:44:28.082969+0000","last_unstale":"2024-09-16T16:56:56.419736+0000","last_undegraded":"2024-09-16T16:56:56.419736+0000","last_fullsized":"2024-09-16T16:56:56.419736+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:56.401747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:56.401747+0000","last_clean_scrub_stamp":"2024-09-16T16:44:26.972784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":587,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-16T16:56:56.424486+0000","last_change":"2024-09-16T16:56:56.397517+0000","last_active":"2024-09-16T16:56:56.424486+0000","last_peered":"2024-09-16T16:56:56.424486+0000","last_clean":"2024-09-16T16:56:56.424486+0000","last_became_active":"2024-09-16T16:44:28.115763+0000","last_became_peered":"2024-09-16T16:44:28.115763+0000","last_unstale":"2024-09-16T16:56:56.424486+0000","last_undegraded":"2024-09-16T16:56:56.424486+0000","last_fullsized":"2024-09-16T16:56:56.424486+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:56.397240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:56.397240+0000","last_clean_scrub_stamp":"2024-09-16T16:44:26.972784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":587,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-16T16:56:56.417920+0000","last_change":"2024-09-16T16:56:56.398484+0000","last_active":"2024-09-16T16:56:56.417920+0000","last_peered":"2024-09-16T16:56:56.417920+0000","last_clean":"2024-09-16T16:56:56.417920+0000","last_became_active":"2024-09-16T16:44:28.042234+0000","last_became_peered":"2024-09-16T16:44:28.042234+0000","last_unstale":"2024-09-16T16:56:56.417920+0000","last_undegraded":"2024-09-16T16:56:56.417920+0000","last_fullsized":"2024-09-16T16:56:56.417920+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:56.398214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:56.398214+0000","last_clean_scrub_stamp":"2024-09-16T16:44:26.972784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":587,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-16T16:56:56.421385+0000","last_change":"2024-09-16T16:56:56.391955+0000","last_active":"2024-09-16T16:56:56.421385+0000","last_peered":"2024-09-16T16:56:56.421385+0000","last_clean":"2024-09-16T16:56:56.421385+0000","last_became_active":"2024-09-16T16:44:28.065454+0000","last_became_peered":"2024-09-16T16:44:28.065454+0000","last_unstale":"2024-09-16T16:56:56.421385+0000","last_undegraded":"2024-09-16T16:56:56.421385+0000","last_fullsized":"2024-09-16T16:56:56.421385+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:56.391694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:56.391694+0000","last_clean_scrub_stamp":"2024-09-16T16:44:26.972784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":589,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-16T16:56:56.418655+0000","last_change":"2024-09-16T16:56:55.921059+0000","last_active":"2024-09-16T16:56:56.418655+0000","last_peered":"2024-09-16T16:56:56.418655+0000","last_clean":"2024-09-16T16:56:56.418655+0000","last_became_active":"2024-09-16T16:44:28.094925+0000","last_became_peered":"2024-09-16T16:44:28.094925+0000","last_unstale":"2024-09-16T16:56:56.418655+0000","last_undegraded":"2024-09-16T16:56:56.418655+0000","last_fullsized":"2024-09-16T16:56:56.418655+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'2","last_scrub_stamp":"2024-09-16T16:56:55.920844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:55.920844+0000","last_clean_scrub_stamp":"2024-09-16T16:44:26.972784+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":587,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-16T16:56:56.844469+0000","last_change":"2024-09-16T16:56:56.853370+0000","last_active":"2024-09-16T16:56:56.844469+0000","last_peered":"2024-09-16T16:56:56.844469+0000","last_clean":"2024-09-16T16:56:56.844469+0000","last_became_active":"2024-09-16T16:44:28.113269+0000","last_became_peered":"2024-09-16T16:44:28.113269+0000","last_unstale":"2024-09-16T16:56:56.844469+0000","last_undegraded":"2024-09-16T16:56:56.844469+0000","last_fullsized":"2024-09-16T16:56:56.844469+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:56.853097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:56.853097+0000","last_clean_scrub_stamp":"2024-09-16T16:44:26.972784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":587,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-16T16:56:56.843207+0000","last_change":"2024-09-16T16:56:56.850988+0000","last_active":"2024-09-16T16:56:56.843207+0000","last_peered":"2024-09-16T16:56:56.843207+0000","last_clean":"2024-09-16T16:56:56.843207+0000","last_became_active":"2024-09-16T16:44:28.100077+0000","last_became_peered":"2024-09-16T16:44:28.100077+0000","last_unstale":"2024-09-16T16:56:56.843207+0000","last_undegraded":"2024-09-16T16:56:56.843207+0000","last_fullsized":"2024-09-16T16:56:56.843207+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:56.850812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:56.850812+0000","last_clean_scrub_stamp":"2024-09-16T16:44:26.972784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":588,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-16T16:56:56.423465+0000","last_change":"2024-09-16T16:56:56.395558+0000","last_active":"2024-09-16T16:56:56.423465+0000","last_peered":"2024-09-16T16:56:56.423465+0000","last_clean":"2024-09-16T16:56:56.423465+0000","last_became_active":"2024-09-16T16:44:28.095919+0000","last_became_peered":"2024-09-16T16:44:28.095919+0000","last_unstale":"2024-09-16T16:56:56.423465+0000","last_undegraded":"2024-09-16T16:56:56.423465+0000","last_fullsized":"2024-09-16T16:56:56.423465+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"12'1","last_scrub_stamp":"2024-09-16T16:56:56.395250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:56.395250+0000","last_clean_scrub_stamp":"2024-09-16T16:44:26.972784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'52","reported_seq":659,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-16T16:56:56.418364+0000","last_change":"2024-09-16T16:56:56.413028+0000","last_active":"2024-09-16T16:56:56.418364+0000","last_peered":"2024-09-16T16:56:56.418364+0000","last_clean":"2024-09-16T16:56:56.418364+0000","last_became_active":"2024-09-16T16:44:25.997426+0000","last_became_peered":"2024-09-16T16:44:25.997426+0000","last_unstale":"2024-09-16T16:56:56.418364+0000","last_undegraded":"2024-09-16T16:56:56.418364+0000","last_fullsized":"2024-09-16T16:56:56.418364+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"10'52","last_scrub_stamp":"2024-09-16T16:56:56.412817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:56.412817+0000","last_clean_scrub_stamp":"2024-09-16T16:44:24.961212+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30054,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654706442,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28052,"kb_used_data":1220,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94343788,"statfs":{"total":96636764160,"available":96608038912,"internally_reserved":0,"allocated":1249280,"data_stored":516131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359739143,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32276,"kb_used_data":1284,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94339564,"statfs":{"total":96636764160,"available":96603713536,"internally_reserved":0,"allocated":1314816,"data_stored":1106518,"data_compressed":30054,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359739144,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":44756,"kb_used_data":1284,"kb_used_omap":0,"kb_used_meta":43456,"kb_avail":94327084,"statfs":{"total":96636764160,"available":96590934016,"internally_reserved":0,"allocated":1314816,"data_stored":1106518,"data_compressed":30054,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":44498944},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30054,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:57:37.824 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-16T16:57:37.933 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:57:37.926+0000 7f3f63311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:37.937 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T16:57:37.937+0000 7f3f63311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:38.145 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-16T16:57:38.145 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-16T16:57:38.145 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-16T16:57:38.145 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T16:57:38.238 INFO:tasks.ceph.osd.0:Stopped 2024-09-16T16:57:38.238 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-16T16:57:38.238 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T16:57:38.319 INFO:tasks.ceph.osd.1:Stopped 2024-09-16T16:57:38.319 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-16T16:57:38.319 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T16:57:38.398 INFO:tasks.ceph.osd.2:Stopped 2024-09-16T16:57:38.399 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-16T16:57:38.399 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-16T16:57:38.399 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T16:57:38.428 INFO:tasks.ceph.mgr.x:Stopped 2024-09-16T16:57:38.429 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-16T16:57:38.429 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-16T16:57:38.429 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T16:57:38.480 INFO:tasks.ceph.mon.a:Stopped 2024-09-16T16:57:38.481 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-16T16:57:38.481 DEBUG:teuthology.orchestra.run.smithi172:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'is full \(reached quota' | egrep -v '\(POOL_FULL\)' | head -n 1 2024-09-16T16:57:38.557 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi172.front.sepia.ceph.com 2024-09-16T16:57:38.557 DEBUG:teuthology.orchestra.run.smithi172:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-16T16:57:38.745 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi172.front.sepia.ceph.com 2024-09-16T16:57:38.745 DEBUG:teuthology.orchestra.run.smithi172:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-16T16:57:38.844 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi172.front.sepia.ceph.com 2024-09-16T16:57:38.844 DEBUG:teuthology.orchestra.run.smithi172:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-16T16:57:38.900 INFO:tasks.ceph:Archiving mon data... 2024-09-16T16:57:38.901 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7907393/data/mon.a.tgz 2024-09-16T16:57:38.901 DEBUG:teuthology.orchestra.run.smithi172:> mktemp 2024-09-16T16:57:38.916 INFO:teuthology.orchestra.run.smithi172.stdout:/tmp/tmp.7QQIAUMlzv 2024-09-16T16:57:38.916 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.7QQIAUMlzv 2024-09-16T16:57:39.049 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 0666 /tmp/tmp.7QQIAUMlzv 2024-09-16T16:57:39.132 DEBUG:teuthology.orchestra.remote:smithi172:/tmp/tmp.7QQIAUMlzv is 242KB 2024-09-16T16:57:39.226 DEBUG:teuthology.orchestra.run.smithi172:> rm -fr /tmp/tmp.7QQIAUMlzv 2024-09-16T16:57:39.241 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-16T16:57:39.241 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-16T16:57:39.360 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-16T16:57:39.360 INFO:tasks.ceph:Archiving crash dumps... 2024-09-16T16:57:39.361 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/lib/ceph/crash to /home/teuthworker/archive/matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7907393/remote/smithi172/crash 2024-09-16T16:57:39.362 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-16T16:57:39.424 INFO:tasks.ceph:Compressing logs... 2024-09-16T16:57:39.424 DEBUG:teuthology.orchestra.run.smithi172:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-16T16:57:39.495 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-16T16:57:39.495 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33982.log 2024-09-16T16:57:39.495 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34024.log 2024-09-16T16:57:39.495 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.33982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32626.log 2024-09-16T16:57:39.495 INFO:teuthology.orchestra.run.smithi172.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.33982.log.gz 2024-09-16T16:57:39.495 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.34024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29555.log 2024-09-16T16:57:39.495 INFO:teuthology.orchestra.run.smithi172.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.34024.log.gz 2024-09-16T16:57:39.495 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.32626.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27165.log 2024-09-16T16:57:39.495 INFO:teuthology.orchestra.run.smithi172.stderr: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.32626.log.gz 2024-09-16T16:57:39.496 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.29555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33396.log 2024-09-16T16:57:39.496 INFO:teuthology.orchestra.run.smithi172.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29555.log.gz 2024-09-16T16:57:39.496 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph.tmp-client.admin.27165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29889.log 2024-09-16T16:57:39.496 INFO:teuthology.orchestra.run.smithi172.stderr: 66.9% -- replaced with /var/log/ceph/ceph.tmp-client.admin.27165.log.gz 2024-09-16T16:57:39.496 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.33396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29504.log 2024-09-16T16:57:39.496 INFO:teuthology.orchestra.run.smithi172.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.33396.log.gz 2024-09-16T16:57:39.496 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.29889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33856.log 2024-09-16T16:57:39.496 INFO:teuthology.orchestra.run.smithi172.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29889.log.gz 2024-09-16T16:57:39.496 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.29504.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-16T16:57:39.496 INFO:teuthology.orchestra.run.smithi172.stderr: 65.3% -- replaced with /var/log/ceph/ceph-client.admin.29504.log.gz 2024-09-16T16:57:39.497 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.33856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29849.log 2024-09-16T16:57:39.497 INFO:teuthology.orchestra.run.smithi172.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.33856.log.gz 2024-09-16T16:57:39.497 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28768.log 2024-09-16T16:57:39.497 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.29849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28728.log 2024-09-16T16:57:39.497 INFO:teuthology.orchestra.run.smithi172.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29849.log.gz 2024-09-16T16:57:39.497 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.28768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33494.log 2024-09-16T16:57:39.497 INFO:teuthology.orchestra.run.smithi172.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28768.log.gz 2024-09-16T16:57:39.497 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.28728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28618.log 2024-09-16T16:57:39.497 INFO:teuthology.orchestra.run.smithi172.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.28728.log.gz 2024-09-16T16:57:39.497 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.33494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32498.log 2024-09-16T16:57:39.497 INFO:teuthology.orchestra.run.smithi172.stderr: 76.7% -- replaced with /var/log/ceph/ceph-client.admin.33494.log.gz 2024-09-16T16:57:39.497 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.28618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28977.log 2024-09-16T16:57:39.497 INFO:teuthology.orchestra.run.smithi172.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.28618.log.gz 2024-09-16T16:57:39.498 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.32498.log: gzip -5 --verbose 82.3% -- -- replaced with /var/log/ceph/ceph-client.admin.32498.log.gz /var/log/ceph/ceph-client.admin.33940.log 2024-09-16T16:57:39.498 INFO:teuthology.orchestra.run.smithi172.stderr: 2024-09-16T16:57:39.498 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.28977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33592.log 2024-09-16T16:57:39.498 INFO:teuthology.orchestra.run.smithi172.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28977.log.gz 2024-09-16T16:57:39.498 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.33940.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.33940.log.gz 2024-09-16T16:57:39.498 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33344.log 2024-09-16T16:57:39.498 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.33592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29639.log 2024-09-16T16:57:39.498 INFO:teuthology.orchestra.run.smithi172.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.33592.log.gz 2024-09-16T16:57:39.498 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.33344.log: 76.9% -- replaced with /var/log/ceph/ceph-client.admin.33344.log.gz 2024-09-16T16:57:39.498 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32434.log 2024-09-16T16:57:39.516 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-16T16:57:39.516 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.29639.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29639.log.gz 2024-09-16T16:57:39.516 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.32434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34234.log 2024-09-16T16:57:39.516 INFO:teuthology.orchestra.run.smithi172.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.32434.log.gz 2024-09-16T16:57:39.516 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33772.log 2024-09-16T16:57:39.516 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.34234.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34234.log.gz 2024-09-16T16:57:39.517 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29404.log 2024-09-16T16:57:39.517 INFO:teuthology.orchestra.run.smithi172.stderr: 88.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-16T16:57:39.517 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32791.log 2024-09-16T16:57:39.517 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.33772.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.33772.log.gz 2024-09-16T16:57:39.517 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.29404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29888.log 2024-09-16T16:57:39.517 INFO:teuthology.orchestra.run.smithi172.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29404.log.gz 2024-09-16T16:57:39.517 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.32791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32370.log 2024-09-16T16:57:39.517 INFO:teuthology.orchestra.run.smithi172.stderr: 79.6% -- replaced with /var/log/ceph/ceph-client.admin.32791.log.gz 2024-09-16T16:57:39.517 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.29888.log: gzip 50.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.29888.log.gz 2024-09-16T16:57:39.517 INFO:teuthology.orchestra.run.smithi172.stderr: -- /var/log/ceph/ceph-client.admin.32739.log 2024-09-16T16:57:39.517 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.32370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33898.log 2024-09-16T16:57:39.517 INFO:teuthology.orchestra.run.smithi172.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.32370.log.gz 2024-09-16T16:57:39.517 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.32739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28530.log 2024-09-16T16:57:39.518 INFO:teuthology.orchestra.run.smithi172.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.32739.log.gz 2024-09-16T16:57:39.518 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.33898.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33898.log.gz 2024-09-16T16:57:39.518 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34192.log 2024-09-16T16:57:39.518 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.28530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30017.log 2024-09-16T16:57:39.518 INFO:teuthology.orchestra.run.smithi172.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28530.log.gz 2024-09-16T16:57:39.518 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.34192.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34192.log.gz 2024-09-16T16:57:39.518 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30059.log 2024-09-16T16:57:39.518 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.30017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33543.log 2024-09-16T16:57:39.518 INFO:teuthology.orchestra.run.smithi172.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30017.log.gz 2024-09-16T16:57:39.518 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.30059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33814.log 2024-09-16T16:57:39.518 INFO:teuthology.orchestra.run.smithi172.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30059.log.gz 2024-09-16T16:57:39.518 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.33543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34150.log 2024-09-16T16:57:39.518 INFO:teuthology.orchestra.run.smithi172.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.33543.log.gz 2024-09-16T16:57:39.518 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.33814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33730.log 2024-09-16T16:57:39.518 INFO:teuthology.orchestra.run.smithi172.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33814.log.gz 2024-09-16T16:57:39.519 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.34150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29763.log 2024-09-16T16:57:39.519 INFO:teuthology.orchestra.run.smithi172.stderr: 50.8% -- replaced with /var/log/ceph/ceph-client.admin.34150.log.gz 2024-09-16T16:57:39.519 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.33730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29681.log 2024-09-16T16:57:39.519 INFO:teuthology.orchestra.run.smithi172.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.33730.log.gz 2024-09-16T16:57:39.519 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.29763.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-16T16:57:39.519 INFO:teuthology.orchestra.run.smithi172.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29763.log.gz 2024-09-16T16:57:39.519 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.29681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29007.log 2024-09-16T16:57:39.519 INFO:teuthology.orchestra.run.smithi172.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29681.log.gz 2024-09-16T16:57:39.519 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29762.log 2024-09-16T16:57:39.519 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.29007.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29007.log.gz 2024-09-16T16:57:39.519 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32242.log 2024-09-16T16:57:39.519 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34274.log 2024-09-16T16:57:39.519 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.29762.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29762.log.gz 2024-09-16T16:57:39.519 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.32242.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.32242.log.gz 2024-09-16T16:57:39.520 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-16T16:57:39.520 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32178.log 2024-09-16T16:57:39.520 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.34274.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34274.log.gz 2024-09-16T16:57:39.520 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-16T16:57:39.520 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.32178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29761.log 2024-09-16T16:57:39.520 INFO:teuthology.orchestra.run.smithi172.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.32178.log.gz 2024-09-16T16:57:39.520 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-16T16:57:39.520 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.29761.log: 50.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29460.log 2024-09-16T16:57:39.520 INFO:teuthology.orchestra.run.smithi172.stderr: -- replaced with /var/log/ceph/ceph-client.admin.29761.log.gz 2024-09-16T16:57:39.520 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32562.log 2024-09-16T16:57:39.520 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34108.log 2024-09-16T16:57:39.520 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.29460.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29460.log.gz 2024-09-16T16:57:39.520 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.32562.log: 88.1% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-16T16:57:39.520 INFO:teuthology.orchestra.run.smithi172.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.32562.log.gz 2024-09-16T16:57:39.521 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33445.log 2024-09-16T16:57:39.521 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.34108.log: /var/log/ceph/ceph-client.admin.29597.log 2024-09-16T16:57:39.521 INFO:teuthology.orchestra.run.smithi172.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.34108.log.gz 2024-09-16T16:57:39.521 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.33445.log: gzip 75.9% -- replaced with /var/log/ceph/ceph-client.admin.33445.log.gz 2024-09-16T16:57:39.521 INFO:teuthology.orchestra.run.smithi172.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.28819.log 2024-09-16T16:57:39.521 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.29597.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29597.log.gz 2024-09-16T16:57:39.521 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33295.log 2024-09-16T16:57:39.521 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.28819.log: gzip -5 49.6% -- replaced with /var/log/ceph/ceph-client.admin.28819.log.gz 2024-09-16T16:57:39.521 INFO:teuthology.orchestra.run.smithi172.stderr: --verbose -- /var/log/ceph/ceph-client.admin.32306.log 2024-09-16T16:57:39.521 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.33295.log: gzip 83.3% -- replaced with /var/log/ceph/ceph-client.admin.33295.log.gz 2024-09-16T16:57:39.521 INFO:teuthology.orchestra.run.smithi172.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.29975.log 2024-09-16T16:57:39.521 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.32306.log: gzip 82.0% -- replaced with /var/log/ceph/ceph-client.admin.32306.log.gz 2024-09-16T16:57:39.521 INFO:teuthology.orchestra.run.smithi172.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.34066.log 2024-09-16T16:57:39.521 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.29975.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29975.log.gz 2024-09-16T16:57:39.522 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32690.log 2024-09-16T16:57:39.522 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.34066.log: gzip -5 50.0% --verbose -- /var/log/ceph/ceph-client.admin.30277.log 2024-09-16T16:57:39.522 INFO:teuthology.orchestra.run.smithi172.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34066.log.gz 2024-09-16T16:57:39.522 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.32690.log: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.32690.log.gz 2024-09-16T16:57:39.522 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.30277.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.30277.log.gz 2024-09-16T16:57:39.583 INFO:teuthology.orchestra.run.smithi172.stderr: 93.0% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-16T16:57:39.811 INFO:teuthology.orchestra.run.smithi172.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-16T16:57:44.714 INFO:teuthology.orchestra.run.smithi172.stderr: 95.2% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-16T16:57:44.940 INFO:teuthology.orchestra.run.smithi172.stderr: 95.3% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-16T16:57:45.224 INFO:teuthology.orchestra.run.smithi172.stderr: 95.1% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-16T16:57:45.226 INFO:teuthology.orchestra.run.smithi172.stderr: 2024-09-16T16:57:45.226 INFO:teuthology.orchestra.run.smithi172.stderr:real 0m5.747s 2024-09-16T16:57:45.226 INFO:teuthology.orchestra.run.smithi172.stderr:user 0m16.088s 2024-09-16T16:57:45.226 INFO:teuthology.orchestra.run.smithi172.stderr:sys 0m0.727s 2024-09-16T16:57:45.226 INFO:tasks.ceph:Archiving logs... 2024-09-16T16:57:45.227 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/log/ceph to /home/teuthworker/archive/matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7907393/remote/smithi172/log 2024-09-16T16:57:45.228 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-16T16:57:47.354 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-16T16:57:47.365 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-16T16:57:47.365 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-16T16:57:47.417 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-16T16:57:47.431 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-16T16:57:47.431 DEBUG:teuthology.orchestra.run.smithi172:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T16:57:47.445 INFO:teuthology.orchestra.run.smithi172.stderr:bash: line 1: ntpq: command not found 2024-09-16T16:57:47.449 INFO:teuthology.orchestra.run.smithi172.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T16:57:47.449 INFO:teuthology.orchestra.run.smithi172.stdout:=============================================================================== 2024-09-16T16:57:47.449 INFO:teuthology.orchestra.run.smithi172.stdout:^* hv01.front.sepia.ceph.com 3 6 377 5 -335us[ -335us] +/- 50ms 2024-09-16T16:57:47.450 INFO:teuthology.orchestra.run.smithi172.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 5 +47us[ +46us] +/- 67ms 2024-09-16T16:57:47.450 INFO:teuthology.orchestra.run.smithi172.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 7 +594us[ +594us] +/- 87ms 2024-09-16T16:57:47.450 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T16:57:47.450 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-16T16:57:47.463 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-16T16:57:47.464 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-16T16:57:47.476 DEBUG:teuthology.orchestra.run.smithi172:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-16T16:57:47.551 DEBUG:teuthology.orchestra.run.smithi172:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T16:57:47.577 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T16:57:47.578 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-16T16:57:47.588 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-16T16:57:47.601 INFO:teuthology.task.internal:Duration was 1371.110223 seconds 2024-09-16T16:57:47.601 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-16T16:57:47.692 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-16T16:57:47.693 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-16T16:57:47.732 INFO:teuthology.orchestra.run.smithi172.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T16:57:48.054 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-16T16:57:48.055 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi172.front.sepia.ceph.com 2024-09-16T16:57:48.055 DEBUG:teuthology.orchestra.run.smithi172:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-16T16:57:48.115 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-16T16:57:48.115 DEBUG:teuthology.orchestra.run.smithi172:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-16T16:57:48.182 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-16T16:57:48.182 DEBUG:teuthology.orchestra.run.smithi172:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-16T16:57:48.321 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-16T16:57:48.330 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-16T16:57:48.330 DEBUG:teuthology.orchestra.run.smithi172:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-16T16:57:48.355 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-16T16:57:48.524 DEBUG:teuthology.orchestra.run.smithi172:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-16T16:57:48.548 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern = core 2024-09-16T16:57:48.561 DEBUG:teuthology.orchestra.run.smithi172:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-16T16:57:48.620 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T16:57:48.620 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-16T16:57:48.631 INFO:teuthology.task.internal:Transferring archived files... 2024-09-16T16:57:48.632 DEBUG:teuthology.misc:Transferring archived files from smithi172:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7907393/remote/smithi172 2024-09-16T16:57:48.632 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-16T16:57:48.694 INFO:teuthology.task.internal:Removing archive directory... 2024-09-16T16:57:48.694 DEBUG:teuthology.orchestra.run.smithi172:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-16T16:57:48.743 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-16T16:57:48.754 INFO:teuthology.task.internal:Not uploading archives. 2024-09-16T16:57:48.754 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-16T16:57:48.765 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-16T16:57:48.765 DEBUG:teuthology.orchestra.run.smithi172:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-16T16:57:48.798 INFO:teuthology.orchestra.run.smithi172.stdout: 266061 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 16 16:57 /home/ubuntu/cephtest 2024-09-16T16:57:48.799 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-16T16:57:48.847 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-16T16:57:48.873 INFO:teuthology.run:Summary data: description: crimson-rados/rbd/{clusters/fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore tasks/rbd_api_tests_old_format} duration: 1371.1102228164673 flavor: crimson owner: scheduled_matan@teuthology success: true 2024-09-16T16:57:48.873 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-16T16:57:48.940 INFO:teuthology.run:pass