2024-09-10T19:01:24.858 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-10T19:01:24.870 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T19:01:24.946 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/skanta-2024-09-10_15:30:27-rados-wip-bharath7-testing-2024-09-10-1409-distro-default-smithi/7899459 branch: wip-bharath7-testing-2024-09-10-1409 description: rados/standalone/{supported-random-distro$/{centos_latest} workloads/mon} email: skanta@redhat.com first_in_suite: false job_id: '7899459' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: skanta-2024-09-10_15:30:27-rados-wip-bharath7-testing-2024-09-10-1409-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-bharath7-testing-2024-09-10-1409 ceph: conf: mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: bad1f558c327094897e4a32e99dd5cb4ae6ccd46 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: bad1f558c327094897e4a32e99dd5cb4ae6ccd46 workunit: branch: wip-bharath7-testing-2024-09-10-1409 sha1: bad1f558c327094897e4a32e99dd5cb4ae6ccd46 owner: scheduled_skanta@teuthology priority: 99 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 seed: 5245 sha1: bad1f558c327094897e4a32e99dd5cb4ae6ccd46 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-bharath7-testing-2024-09-10-1409 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_bad1f558c327094897e4a32e99dd5cb4ae6ccd46/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: bad1f558c327094897e4a32e99dd5cb4ae6ccd46 targets: smithi038.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMt6hjh0zCcUGkEdmfbGQX8nFFTuOWLTzfpGxgEOtgocUz0BmOncP8DMzKMaWIDn1Emm/ZuqeEAAqXGp9ScjOtM= tasks: - install: null - workunit: basedir: qa/standalone clients: all: - mon teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-10_15:30:27 tube: smithi user: skanta verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-10T19:01:24.947 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_bad1f558c327094897e4a32e99dd5cb4ae6ccd46/qa; will attempt to use it 2024-09-10T19:01:24.947 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_bad1f558c327094897e4a32e99dd5cb4ae6ccd46/qa/tasks 2024-09-10T19:01:24.947 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-10T19:01:24.949 INFO:teuthology.task.internal:Checking packages... 2024-09-10T19:01:24.969 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'bad1f558c327094897e4a32e99dd5cb4ae6ccd46' 2024-09-10T19:01:24.969 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-10T19:01:24.970 INFO:teuthology.packaging:ref: None 2024-09-10T19:01:24.970 INFO:teuthology.packaging:tag: None 2024-09-10T19:01:24.970 INFO:teuthology.packaging:branch: wip-bharath7-testing-2024-09-10-1409 2024-09-10T19:01:24.970 INFO:teuthology.packaging:sha1: bad1f558c327094897e4a32e99dd5cb4ae6ccd46 2024-09-10T19:01:24.970 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-bharath7-testing-2024-09-10-1409 2024-09-10T19:01:25.111 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4858.gbad1f558 2024-09-10T19:01:25.113 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-10T19:01:25.119 INFO:teuthology.task.internal:no buildpackages task found 2024-09-10T19:01:25.119 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-10T19:01:25.182 INFO:teuthology.task.internal:Saving configuration 2024-09-10T19:01:25.190 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-10T19:01:25.207 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-10T19:01:25.232 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi038.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/skanta-2024-09-10_15:30:27-rados-wip-bharath7-testing-2024-09-10-1409-distro-default-smithi/7899459', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 18:56:36.784532', 'locked_by': 'scheduled_skanta@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMt6hjh0zCcUGkEdmfbGQX8nFFTuOWLTzfpGxgEOtgocUz0BmOncP8DMzKMaWIDn1Emm/ZuqeEAAqXGp9ScjOtM='} 2024-09-10T19:01:25.232 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-10T19:01:25.238 INFO:teuthology.task.internal:roles: ubuntu@smithi038.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2024-09-10T19:01:25.238 INFO:teuthology.run_tasks:Running task console_log... 2024-09-10T19:01:25.295 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd4d1de3be0>, signals=[15]) 2024-09-10T19:01:25.297 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-10T19:01:25.303 INFO:teuthology.task.internal:Opening connections... 2024-09-10T19:01:25.303 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi038.front.sepia.ceph.com 2024-09-10T19:01:25.304 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T19:01:25.379 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-10T19:01:25.385 DEBUG:teuthology.orchestra.run.smithi038:> uname -m 2024-09-10T19:01:25.462 INFO:teuthology.orchestra.run.smithi038.stdout:x86_64 2024-09-10T19:01:25.462 DEBUG:teuthology.orchestra.run.smithi038:> cat /etc/os-release 2024-09-10T19:01:25.519 INFO:teuthology.orchestra.run.smithi038.stdout:NAME="CentOS Stream" 2024-09-10T19:01:25.520 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION="9" 2024-09-10T19:01:25.520 INFO:teuthology.orchestra.run.smithi038.stdout:ID="centos" 2024-09-10T19:01:25.520 INFO:teuthology.orchestra.run.smithi038.stdout:ID_LIKE="rhel fedora" 2024-09-10T19:01:25.520 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_ID="9" 2024-09-10T19:01:25.520 INFO:teuthology.orchestra.run.smithi038.stdout:PLATFORM_ID="platform:el9" 2024-09-10T19:01:25.520 INFO:teuthology.orchestra.run.smithi038.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T19:01:25.520 INFO:teuthology.orchestra.run.smithi038.stdout:ANSI_COLOR="0;31" 2024-09-10T19:01:25.520 INFO:teuthology.orchestra.run.smithi038.stdout:LOGO="fedora-logo-icon" 2024-09-10T19:01:25.520 INFO:teuthology.orchestra.run.smithi038.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T19:01:25.520 INFO:teuthology.orchestra.run.smithi038.stdout:HOME_URL="https://centos.org/" 2024-09-10T19:01:25.520 INFO:teuthology.orchestra.run.smithi038.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T19:01:25.520 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T19:01:25.521 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T19:01:25.521 INFO:teuthology.lock.ops:Updating smithi038.front.sepia.ceph.com on lock server 2024-09-10T19:01:25.536 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-10T19:01:25.546 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-10T19:01:25.564 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-10T19:01:25.565 DEBUG:teuthology.orchestra.run.smithi038:> test '!' -e /home/ubuntu/cephtest 2024-09-10T19:01:25.581 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-10T19:01:25.589 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-10T19:01:25.589 DEBUG:teuthology.orchestra.run.smithi038:> test -z $(ls -A /var/lib/ceph) 2024-09-10T19:01:25.644 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-10T19:01:25.673 INFO:teuthology.run_tasks:Running task kernel... 2024-09-10T19:01:25.687 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-10T19:01:25.687 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-10T19:01:25.687 DEBUG:teuthology.orchestra.run.smithi038:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T19:01:25.703 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T19:01:25.703 DEBUG:teuthology.orchestra.run.smithi038:> uname -r 2024-09-10T19:01:25.759 INFO:teuthology.orchestra.run.smithi038.stdout:5.14.0-503.el9.x86_64 2024-09-10T19:01:25.759 INFO:teuthology.task.kernel:Running kernel on smithi038: 5.14.0-503.el9.x86_64 2024-09-10T19:01:25.759 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum install -y kernel 2024-09-10T19:01:31.808 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - BaseOS 1.9 MB/s | 8.2 MB 00:04 2024-09-10T19:01:33.650 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - AppStream 30 MB/s | 20 MB 00:00 2024-09-10T19:01:39.060 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - CRB 4.4 MB/s | 6.5 MB 00:01 2024-09-10T19:01:40.769 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - Extras packages 40 kB/s | 19 kB 00:00 2024-09-10T19:01:41.698 INFO:teuthology.orchestra.run.smithi038.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-10T19:01:47.354 INFO:teuthology.orchestra.run.smithi038.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-10T19:01:49.452 INFO:teuthology.orchestra.run.smithi038.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-10T19:01:49.452 INFO:teuthology.orchestra.run.smithi038.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-10T19:01:49.547 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-09-10T19:01:49.563 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-10T19:01:49.563 INFO:teuthology.orchestra.run.smithi038.stdout: Package Architecture Version Repository Size 2024-09-10T19:01:49.563 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-10T19:01:49.563 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-09-10T19:01:49.563 INFO:teuthology.orchestra.run.smithi038.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-10T19:01:49.563 INFO:teuthology.orchestra.run.smithi038.stdout:Installing dependencies: 2024-09-10T19:01:49.563 INFO:teuthology.orchestra.run.smithi038.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-10T19:01:49.563 INFO:teuthology.orchestra.run.smithi038.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-10T19:01:49.563 INFO:teuthology.orchestra.run.smithi038.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-10T19:01:49.563 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:01:49.563 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-09-10T19:01:49.564 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-10T19:01:49.564 INFO:teuthology.orchestra.run.smithi038.stdout:Install 4 Packages 2024-09-10T19:01:49.564 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:01:49.564 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 79 M 2024-09-10T19:01:49.564 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 126 M 2024-09-10T19:01:49.564 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-09-10T19:01:50.106 INFO:teuthology.orchestra.run.smithi038.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 79 kB/s | 23 kB 00:00 2024-09-10T19:01:55.256 INFO:teuthology.orchestra.run.smithi038.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 2.9 MB/s | 16 MB 00:05 2024-09-10T19:01:56.756 INFO:teuthology.orchestra.run.smithi038.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 4.3 MB/s | 29 MB 00:06 2024-09-10T19:01:58.639 INFO:teuthology.orchestra.run.smithi038.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 3.9 MB/s | 35 MB 00:08 2024-09-10T19:01:58.639 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-09-10T19:01:58.639 INFO:teuthology.orchestra.run.smithi038.stdout:Total 8.7 MB/s | 79 MB 00:09 2024-09-10T19:01:59.347 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-09-10T19:01:59.745 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-09-10T19:01:59.745 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-09-10T19:02:00.713 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-09-10T19:02:00.714 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-09-10T19:02:03.330 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-09-10T19:02:04.018 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-10T19:02:04.109 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T19:02:06.886 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T19:02:07.012 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T19:02:12.135 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T19:02:12.180 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-10T19:02:17.329 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T19:02:56.371 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T19:02:56.411 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-10T19:02:56.774 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-10T19:02:56.774 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-10T19:02:56.775 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T19:02:56.775 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T19:02:57.665 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T19:02:57.665 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:02:57.665 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-09-10T19:02:57.665 INFO:teuthology.orchestra.run.smithi038.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-10T19:02:57.665 INFO:teuthology.orchestra.run.smithi038.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-10T19:02:57.665 INFO:teuthology.orchestra.run.smithi038.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-10T19:02:57.665 INFO:teuthology.orchestra.run.smithi038.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-10T19:02:57.665 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:02:57.665 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-09-10T19:02:58.023 DEBUG:teuthology.orchestra.run.smithi038:> rpm -q kernel | sort -rV | head -n 1 2024-09-10T19:02:58.113 INFO:teuthology.orchestra.run.smithi038.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-10T19:02:58.114 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-10T19:02:58.114 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-10T19:02:58.114 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-10T19:02:58.114 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-10T19:02:58.114 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-10T19:02:58.114 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi038.front.sepia.ceph.com, path=None, version=distro) 2024-09-10T19:02:58.115 DEBUG:teuthology.orchestra.run.smithi038:> rpm -q kernel | sort -rV | head -n 1 2024-09-10T19:02:58.174 INFO:teuthology.orchestra.run.smithi038.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-10T19:02:58.174 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-10T19:02:58.174 DEBUG:teuthology.orchestra.run.smithi038:> sudo rpm -qi grub2-tools 2024-09-10T19:02:58.205 INFO:teuthology.orchestra.run.smithi038.stdout:Name : grub2-tools 2024-09-10T19:02:58.205 INFO:teuthology.orchestra.run.smithi038.stdout:Epoch : 1 2024-09-10T19:02:58.205 INFO:teuthology.orchestra.run.smithi038.stdout:Version : 2.06 2024-09-10T19:02:58.205 INFO:teuthology.orchestra.run.smithi038.stdout:Release : 82.el9 2024-09-10T19:02:58.205 INFO:teuthology.orchestra.run.smithi038.stdout:Architecture: x86_64 2024-09-10T19:02:58.205 INFO:teuthology.orchestra.run.smithi038.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-10T19:02:58.205 INFO:teuthology.orchestra.run.smithi038.stdout:Group : Unspecified 2024-09-10T19:02:58.206 INFO:teuthology.orchestra.run.smithi038.stdout:Size : 8274670 2024-09-10T19:02:58.206 INFO:teuthology.orchestra.run.smithi038.stdout:License : GPLv3+ 2024-09-10T19:02:58.206 INFO:teuthology.orchestra.run.smithi038.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-10T19:02:58.206 INFO:teuthology.orchestra.run.smithi038.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-10T19:02:58.206 INFO:teuthology.orchestra.run.smithi038.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-10T19:02:58.206 INFO:teuthology.orchestra.run.smithi038.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-10T19:02:58.206 INFO:teuthology.orchestra.run.smithi038.stdout:Packager : builder@centos.org 2024-09-10T19:02:58.206 INFO:teuthology.orchestra.run.smithi038.stdout:Vendor : CentOS 2024-09-10T19:02:58.206 INFO:teuthology.orchestra.run.smithi038.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-10T19:02:58.206 INFO:teuthology.orchestra.run.smithi038.stdout:Summary : Support tools for GRUB. 2024-09-10T19:02:58.206 INFO:teuthology.orchestra.run.smithi038.stdout:Description : 2024-09-10T19:02:58.206 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:02:58.206 INFO:teuthology.orchestra.run.smithi038.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-10T19:02:58.206 INFO:teuthology.orchestra.run.smithi038.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-10T19:02:58.207 INFO:teuthology.orchestra.run.smithi038.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-10T19:02:58.207 INFO:teuthology.orchestra.run.smithi038.stdout:hardware devices. 2024-09-10T19:02:58.207 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:02:58.207 INFO:teuthology.orchestra.run.smithi038.stdout:This subpackage provides tools for support of all platforms. 2024-09-10T19:02:58.207 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-10T19:02:58.207 INFO:teuthology.task.kernel:Updating grub on smithi038 to boot 5.14.0-505.el9.x86_64 2024-09-10T19:02:58.208 DEBUG:teuthology.orchestra.run.smithi038:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-10T19:02:59.038 INFO:teuthology.orchestra.run.smithi038.stderr:Generating grub configuration file ... 2024-09-10T19:03:00.356 INFO:teuthology.orchestra.run.smithi038.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-10T19:03:00.402 INFO:teuthology.orchestra.run.smithi038.stderr:done 2024-09-10T19:03:00.405 DEBUG:teuthology.orchestra.run.smithi038:> mktemp 2024-09-10T19:03:00.460 INFO:teuthology.orchestra.run.smithi038.stdout:/tmp/tmp.pAsEKzPG1Q 2024-09-10T19:03:00.461 DEBUG:teuthology.orchestra.run.smithi038:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.pAsEKzPG1Q 2024-09-10T19:03:00.527 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 0666 /tmp/tmp.pAsEKzPG1Q 2024-09-10T19:03:00.698 DEBUG:teuthology.orchestra.remote:smithi038:/tmp/tmp.pAsEKzPG1Q is 6KB 2024-09-10T19:03:00.747 DEBUG:teuthology.orchestra.run.smithi038:> rm -fr /tmp/tmp.pAsEKzPG1Q 2024-09-10T19:03:00.762 DEBUG:teuthology.orchestra.run.smithi038:> sudo /bin/ls /boot/loader/entries || true 2024-09-10T19:03:00.823 INFO:teuthology.orchestra.run.smithi038.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-10T19:03:00.824 INFO:teuthology.orchestra.run.smithi038.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-10T19:03:00.824 INFO:teuthology.orchestra.run.smithi038.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-10T19:03:00.824 INFO:teuthology.orchestra.run.smithi038.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-10T19:03:00.825 DEBUG:teuthology.orchestra.run.smithi038:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-10T19:03:00.982 DEBUG:teuthology.orchestra.run.smithi038:> sudo shutdown -r now 2024-09-10T19:03:31.011 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-10T19:03:31.012 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2024-09-10T19:03:31.013 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T19:04:31.073 DEBUG:teuthology.orchestra.remote:timed out 2024-09-10T19:04:40.083 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2024-09-10T19:04:40.085 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T19:04:47.719 DEBUG:teuthology.orchestra.run.smithi038:> true 2024-09-10T19:04:48.153 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi038.front.sepia.ceph.com' 2024-09-10T19:04:48.153 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-10T19:04:48.153 DEBUG:teuthology.orchestra.run.smithi038:> uname -r 2024-09-10T19:04:48.169 INFO:teuthology.orchestra.run.smithi038.stdout:5.14.0-505.el9.x86_64 2024-09-10T19:04:48.169 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-10T19:04:48.169 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T19:04:48.169 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-10T19:04:49.170 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-10T19:04:49.170 DEBUG:teuthology.orchestra.run.smithi038:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-10T19:04:49.264 INFO:teuthology.orchestra.run.smithi038.stdout:ttyS1 2024-09-10T19:04:49.293 DEBUG:teuthology.parallel:result is None 2024-09-10T19:04:49.293 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-10T19:04:49.301 INFO:teuthology.task.internal:Creating test directory... 2024-09-10T19:04:49.301 DEBUG:teuthology.orchestra.run.smithi038:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T19:04:49.317 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-10T19:04:49.340 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-10T19:04:49.374 INFO:teuthology.task.internal:Creating archive directory... 2024-09-10T19:04:49.374 DEBUG:teuthology.orchestra.run.smithi038:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T19:04:49.396 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-10T19:04:49.407 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-10T19:04:49.407 DEBUG:teuthology.orchestra.run.smithi038:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T19:04:49.466 INFO:teuthology.orchestra.run.smithi038.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T19:04:49.477 INFO:teuthology.orchestra.run.smithi038.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T19:04:49.479 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-10T19:04:49.486 INFO:teuthology.task.internal:Configuring sudo... 2024-09-10T19:04:49.487 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T19:04:49.549 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-10T19:04:49.559 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-10T19:04:49.559 DEBUG:teuthology.orchestra.run.smithi038:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T19:04:49.609 DEBUG:teuthology.orchestra.run.smithi038:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T19:04:49.700 DEBUG:teuthology.orchestra.run.smithi038:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T19:04:49.744 DEBUG:teuthology.orchestra.run.smithi038:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T19:04:49.834 DEBUG:teuthology.orchestra.run.smithi038:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T19:04:49.876 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-10T19:04:49.876 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T19:04:49.945 DEBUG:teuthology.orchestra.run.smithi038:> sudo service rsyslog restart 2024-09-10T19:04:50.059 INFO:teuthology.orchestra.run.smithi038.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T19:04:50.282 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-10T19:04:50.290 INFO:teuthology.task.internal:Starting timer... 2024-09-10T19:04:50.290 INFO:teuthology.run_tasks:Running task pcp... 2024-09-10T19:04:50.336 INFO:teuthology.run_tasks:Running task selinux... 2024-09-10T19:04:50.368 DEBUG:teuthology.orchestra.run.smithi038:> sudo service auditd rotate 2024-09-10T19:04:50.413 INFO:teuthology.orchestra.run.smithi038.stdout:Rotating logs: 2024-09-10T19:04:50.415 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-10T19:04:50.415 DEBUG:teuthology.orchestra.run.smithi038:> /usr/sbin/getenforce 2024-09-10T19:04:50.489 INFO:teuthology.orchestra.run.smithi038.stdout:Permissive 2024-09-10T19:04:50.489 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi038.front.sepia.ceph.com': 'permissive'} 2024-09-10T19:04:50.490 DEBUG:teuthology.orchestra.run.smithi038:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-10T19:04:50.559 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T19:04:50.559 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-10T19:04:50.559 DEBUG:teuthology.orchestra.run.smithi038:> sudo /usr/sbin/setenforce permissive 2024-09-10T19:04:50.637 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-10T19:04:50.646 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-10T19:04:50.658 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-10T19:04:50.659 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi038.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-10T19:08:38.347 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi038.front.sepia.ceph.com')] 2024-09-10T19:08:38.349 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2024-09-10T19:08:38.350 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T19:08:38.425 DEBUG:teuthology.orchestra.run.smithi038:> true 2024-09-10T19:08:38.500 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi038.front.sepia.ceph.com' 2024-09-10T19:08:38.501 INFO:teuthology.run_tasks:Running task clock... 2024-09-10T19:08:38.517 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-10T19:08:38.518 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T19:08:38.518 DEBUG:teuthology.orchestra.run.smithi038:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T19:08:38.570 INFO:teuthology.orchestra.run.smithi038.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T19:08:38.585 INFO:teuthology.orchestra.run.smithi038.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T19:08:38.610 INFO:teuthology.orchestra.run.smithi038.stderr:sudo: ntpd: command not found 2024-09-10T19:08:38.621 INFO:teuthology.orchestra.run.smithi038.stdout:506 Cannot talk to daemon 2024-09-10T19:08:38.636 INFO:teuthology.orchestra.run.smithi038.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T19:08:38.650 INFO:teuthology.orchestra.run.smithi038.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T19:08:38.706 INFO:teuthology.orchestra.run.smithi038.stderr:bash: line 1: ntpq: command not found 2024-09-10T19:08:38.710 INFO:teuthology.orchestra.run.smithi038.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T19:08:38.710 INFO:teuthology.orchestra.run.smithi038.stdout:=============================================================================== 2024-09-10T19:08:38.710 INFO:teuthology.orchestra.run.smithi038.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T19:08:38.710 INFO:teuthology.orchestra.run.smithi038.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T19:08:38.710 INFO:teuthology.orchestra.run.smithi038.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T19:08:38.710 INFO:teuthology.orchestra.run.smithi038.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T19:08:38.711 INFO:teuthology.run_tasks:Running task install... 2024-09-10T19:08:38.719 DEBUG:teuthology.task.install:project ceph 2024-09-10T19:08:38.719 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'bad1f558c327094897e4a32e99dd5cb4ae6ccd46'}} 2024-09-10T19:08:38.719 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'bad1f558c327094897e4a32e99dd5cb4ae6ccd46'} 2024-09-10T19:08:38.719 INFO:teuthology.task.install:Using flavor: default 2024-09-10T19:08:38.724 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-10T19:08:38.725 INFO:teuthology.task.install:extra packages: [] 2024-09-10T19:08:38.725 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bad1f558c327094897e4a32e99dd5cb4ae6ccd46', 'tag': None, 'wait_for_package': False} 2024-09-10T19:08:38.725 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bad1f558c327094897e4a32e99dd5cb4ae6ccd46 2024-09-10T19:08:38.871 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/centos/9/flavors/default/ 2024-09-10T19:08:38.872 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4858.gbad1f558 2024-09-10T19:08:38.983 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T19:08:38.983 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-10T19:08:38.983 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T19:08:39.011 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-10T19:08:39.011 DEBUG:teuthology.orchestra.run.smithi038:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T19:08:39.079 DEBUG:teuthology.orchestra.run.smithi038:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T19:08:39.157 DEBUG:teuthology.orchestra.run.smithi038:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T19:08:39.223 INFO:teuthology.orchestra.run.smithi038.stdout:check_obsoletes = 1 2024-09-10T19:08:39.224 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum clean all 2024-09-10T19:08:39.464 INFO:teuthology.orchestra.run.smithi038.stdout:45 files removed 2024-09-10T19:08:39.491 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-radosgw 2024-09-10T19:08:40.048 INFO:teuthology.orchestra.run.smithi038.stdout:ceph packages for x86_64 325 kB/s | 84 kB 00:00 2024-09-10T19:08:40.357 INFO:teuthology.orchestra.run.smithi038.stdout:ceph noarch packages 92 kB/s | 24 kB 00:00 2024-09-10T19:08:40.624 INFO:teuthology.orchestra.run.smithi038.stdout:ceph source packages 8.5 kB/s | 1.9 kB 00:00 2024-09-10T19:08:42.532 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - BaseOS 4.4 MB/s | 8.2 MB 00:01 2024-09-10T19:09:00.899 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - AppStream 1.2 MB/s | 20 MB 00:17 2024-09-10T19:09:05.841 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - CRB 6.8 MB/s | 6.5 MB 00:00 2024-09-10T19:09:08.175 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 19 kB 00:01 2024-09-10T19:09:09.596 INFO:teuthology.orchestra.run.smithi038.stdout:Extra Packages for Enterprise Linux 18 MB/s | 23 MB 00:01 2024-09-10T19:09:15.244 INFO:teuthology.orchestra.run.smithi038.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-10T19:09:17.733 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-09-10T19:09:17.745 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-10T19:09:17.745 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repository Size 2024-09-10T19:09:17.745 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-10T19:09:17.745 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-09-10T19:09:17.745 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-radosgw x86_64 2:19.3.0-4858.gbad1f558.el9 ceph 11 M 2024-09-10T19:09:17.745 INFO:teuthology.orchestra.run.smithi038.stdout:Upgrading: 2024-09-10T19:09:17.745 INFO:teuthology.orchestra.run.smithi038.stdout: librados2 x86_64 2:19.3.0-4858.gbad1f558.el9 ceph 3.5 M 2024-09-10T19:09:17.746 INFO:teuthology.orchestra.run.smithi038.stdout: librbd1 x86_64 2:19.3.0-4858.gbad1f558.el9 ceph 3.2 M 2024-09-10T19:09:17.746 INFO:teuthology.orchestra.run.smithi038.stdout:Installing dependencies: 2024-09-10T19:09:17.746 INFO:teuthology.orchestra.run.smithi038.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T19:09:17.746 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-base x86_64 2:19.3.0-4858.gbad1f558.el9 ceph 5.5 M 2024-09-10T19:09:17.746 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-common x86_64 2:19.3.0-4858.gbad1f558.el9 ceph 22 M 2024-09-10T19:09:17.746 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-selinux x86_64 2:19.3.0-4858.gbad1f558.el9 ceph 25 k 2024-09-10T19:09:17.746 INFO:teuthology.orchestra.run.smithi038.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T19:09:17.746 INFO:teuthology.orchestra.run.smithi038.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T19:09:17.746 INFO:teuthology.orchestra.run.smithi038.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T19:09:17.746 INFO:teuthology.orchestra.run.smithi038.stdout: libcephfs2 x86_64 2:19.3.0-4858.gbad1f558.el9 ceph 755 k 2024-09-10T19:09:17.746 INFO:teuthology.orchestra.run.smithi038.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-10T19:09:17.746 INFO:teuthology.orchestra.run.smithi038.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T19:09:17.747 INFO:teuthology.orchestra.run.smithi038.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T19:09:17.747 INFO:teuthology.orchestra.run.smithi038.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T19:09:17.747 INFO:teuthology.orchestra.run.smithi038.stdout: libradosstriper1 x86_64 2:19.3.0-4858.gbad1f558.el9 ceph 509 k 2024-09-10T19:09:17.747 INFO:teuthology.orchestra.run.smithi038.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T19:09:17.747 INFO:teuthology.orchestra.run.smithi038.stdout: librgw2 x86_64 2:19.3.0-4858.gbad1f558.el9 ceph 5.5 M 2024-09-10T19:09:17.747 INFO:teuthology.orchestra.run.smithi038.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T19:09:17.747 INFO:teuthology.orchestra.run.smithi038.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T19:09:17.747 INFO:teuthology.orchestra.run.smithi038.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T19:09:17.747 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ceph-argparse x86_64 2:19.3.0-4858.gbad1f558.el9 ceph 45 k 2024-09-10T19:09:17.747 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ceph-common x86_64 2:19.3.0-4858.gbad1f558.el9 ceph 143 k 2024-09-10T19:09:17.747 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cephfs x86_64 2:19.3.0-4858.gbad1f558.el9 ceph 161 k 2024-09-10T19:09:17.747 INFO:teuthology.orchestra.run.smithi038.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T19:09:17.747 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rados x86_64 2:19.3.0-4858.gbad1f558.el9 ceph 321 k 2024-09-10T19:09:17.747 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rbd x86_64 2:19.3.0-4858.gbad1f558.el9 ceph 306 k 2024-09-10T19:09:17.748 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rgw x86_64 2:19.3.0-4858.gbad1f558.el9 ceph 99 k 2024-09-10T19:09:17.748 INFO:teuthology.orchestra.run.smithi038.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T19:09:17.748 INFO:teuthology.orchestra.run.smithi038.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T19:09:17.748 INFO:teuthology.orchestra.run.smithi038.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T19:09:17.748 INFO:teuthology.orchestra.run.smithi038.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T19:09:17.748 INFO:teuthology.orchestra.run.smithi038.stdout:Installing weak dependencies: 2024-09-10T19:09:17.748 INFO:teuthology.orchestra.run.smithi038.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T19:09:17.748 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:09:17.748 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-09-10T19:09:17.748 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-10T19:09:17.748 INFO:teuthology.orchestra.run.smithi038.stdout:Install 31 Packages 2024-09-10T19:09:17.748 INFO:teuthology.orchestra.run.smithi038.stdout:Upgrade 2 Packages 2024-09-10T19:09:17.748 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:09:17.749 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 62 M 2024-09-10T19:09:17.749 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-09-10T19:09:18.545 INFO:teuthology.orchestra.run.smithi038.stdout:(1/33): ceph-base-19.3.0-4858.gbad1f558.el9.x86 9.5 MB/s | 5.5 MB 00:00 2024-09-10T19:09:18.587 INFO:teuthology.orchestra.run.smithi038.stdout:(2/33): ceph-selinux-19.3.0-4858.gbad1f558.el9. 608 kB/s | 25 kB 00:00 2024-09-10T19:09:18.687 INFO:teuthology.orchestra.run.smithi038.stdout:(3/33): libcephfs2-19.3.0-4858.gbad1f558.el9.x8 7.4 MB/s | 755 kB 00:00 2024-09-10T19:09:18.754 INFO:teuthology.orchestra.run.smithi038.stdout:(4/33): libradosstriper1-19.3.0-4858.gbad1f558. 7.5 MB/s | 509 kB 00:00 2024-09-10T19:09:18.938 INFO:teuthology.orchestra.run.smithi038.stdout:(5/33): ceph-radosgw-19.3.0-4858.gbad1f558.el9. 11 MB/s | 11 MB 00:00 2024-09-10T19:09:18.988 INFO:teuthology.orchestra.run.smithi038.stdout:(6/33): python3-ceph-argparse-19.3.0-4858.gbad1 909 kB/s | 45 kB 00:00 2024-09-10T19:09:19.055 INFO:teuthology.orchestra.run.smithi038.stdout:(7/33): python3-ceph-common-19.3.0-4858.gbad1f5 2.1 MB/s | 143 kB 00:00 2024-09-10T19:09:19.122 INFO:teuthology.orchestra.run.smithi038.stdout:(8/33): python3-cephfs-19.3.0-4858.gbad1f558.el 2.4 MB/s | 161 kB 00:00 2024-09-10T19:09:19.205 INFO:teuthology.orchestra.run.smithi038.stdout:(9/33): librgw2-19.3.0-4858.gbad1f558.el9.x86_6 12 MB/s | 5.5 MB 00:00 2024-09-10T19:09:19.231 INFO:teuthology.orchestra.run.smithi038.stdout:(10/33): python3-rados-19.3.0-4858.gbad1f558.el 2.9 MB/s | 321 kB 00:00 2024-09-10T19:09:19.256 INFO:teuthology.orchestra.run.smithi038.stdout:(11/33): python3-rbd-19.3.0-4858.gbad1f558.el9. 5.9 MB/s | 306 kB 00:00 2024-09-10T19:09:19.290 INFO:teuthology.orchestra.run.smithi038.stdout:(12/33): python3-rgw-19.3.0-4858.gbad1f558.el9. 1.7 MB/s | 99 kB 00:00 2024-09-10T19:09:19.498 INFO:teuthology.orchestra.run.smithi038.stdout:(13/33): ceph-common-19.3.0-4858.gbad1f558.el9. 14 MB/s | 22 MB 00:01 2024-09-10T19:09:19.824 INFO:teuthology.orchestra.run.smithi038.stdout:(14/33): boost-program-options-1.75.0-8.el9.x86 188 kB/s | 107 kB 00:00 2024-09-10T19:09:19.916 INFO:teuthology.orchestra.run.smithi038.stdout:(15/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 384 kB/s | 160 kB 00:00 2024-09-10T19:09:19.941 INFO:teuthology.orchestra.run.smithi038.stdout:(16/33): libnbd-1.20.2-2.el9.x86_64.rpm 262 kB/s | 171 kB 00:00 2024-09-10T19:09:20.183 INFO:teuthology.orchestra.run.smithi038.stdout:(17/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 126 kB/s | 45 kB 00:00 2024-09-10T19:09:20.583 INFO:teuthology.orchestra.run.smithi038.stdout:(18/33): python3-prettytable-0.7.2-27.el9.noarc 106 kB/s | 42 kB 00:00 2024-09-10T19:09:20.608 INFO:teuthology.orchestra.run.smithi038.stdout:(19/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 438 kB/s | 292 kB 00:00 2024-09-10T19:09:20.634 INFO:teuthology.orchestra.run.smithi038.stdout:(20/33): librdkafka-1.6.1-102.el9.x86_64.rpm 923 kB/s | 662 kB 00:00 2024-09-10T19:09:20.892 INFO:teuthology.orchestra.run.smithi038.stdout:(21/33): qatlib-service-24.02.0-1.el9.x86_64.rp 126 kB/s | 36 kB 00:00 2024-09-10T19:09:20.943 INFO:teuthology.orchestra.run.smithi038.stdout:(22/33): gperftools-libs-2.9.1-2.el9.x86_64.rpm 6.0 MB/s | 309 kB 00:00 2024-09-10T19:09:20.985 INFO:teuthology.orchestra.run.smithi038.stdout:(23/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 135 kB/s | 47 kB 00:00 2024-09-10T19:09:21.035 INFO:teuthology.orchestra.run.smithi038.stdout:(24/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 523 kB/s | 26 kB 00:00 2024-09-10T19:09:21.069 INFO:teuthology.orchestra.run.smithi038.stdout:(25/33): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2024-09-10T19:09:21.102 INFO:teuthology.orchestra.run.smithi038.stdout:(26/33): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-10T19:09:21.177 INFO:teuthology.orchestra.run.smithi038.stdout:(27/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-09-10T19:09:21.202 INFO:teuthology.orchestra.run.smithi038.stdout:(28/33): qatlib-24.02.0-1.el9.x86_64.rpm 356 kB/s | 221 kB 00:00 2024-09-10T19:09:21.272 INFO:teuthology.orchestra.run.smithi038.stdout:(29/33): libarrow-9.0.0-11.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2024-09-10T19:09:21.303 INFO:teuthology.orchestra.run.smithi038.stdout:(30/33): re2-20211101-20.el9.x86_64.rpm 1.5 MB/s | 191 kB 00:00 2024-09-10T19:09:21.378 INFO:teuthology.orchestra.run.smithi038.stdout:(31/33): thrift-0.15.0-2.el9.x86_64.rpm 9.0 MB/s | 1.6 MB 00:00 2024-09-10T19:09:21.562 INFO:teuthology.orchestra.run.smithi038.stdout:(32/33): librbd1-19.3.0-4858.gbad1f558.el9.x86_ 13 MB/s | 3.2 MB 00:00 2024-09-10T19:09:21.621 INFO:teuthology.orchestra.run.smithi038.stdout:(33/33): librados2-19.3.0-4858.gbad1f558.el9.x8 10 MB/s | 3.5 MB 00:00 2024-09-10T19:09:21.626 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-09-10T19:09:21.626 INFO:teuthology.orchestra.run.smithi038.stdout:Total 16 MB/s | 62 MB 00:03 2024-09-10T19:09:21.746 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-09-10T19:09:21.789 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-09-10T19:09:21.789 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-09-10T19:09:22.514 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-09-10T19:09:22.515 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-09-10T19:09:24.092 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-09-10T19:09:24.181 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-10T19:09:24.209 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/35 2024-09-10T19:09:24.234 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/35 2024-09-10T19:09:24.257 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-10T19:09:24.278 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-10T19:09:24.469 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-10T19:09:24.521 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-10T19:09:24.950 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/35 2024-09-10T19:09:25.011 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : librados2-2:19.3.0-4858.gbad1f558.el9.x86_64 7/35 2024-09-10T19:09:25.104 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librados2-2:19.3.0-4858.gbad1f558.el9.x86_64 7/35 2024-09-10T19:09:25.195 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-rados-2:19.3.0-4858.gbad1f558.el9.x86_64 8/35 2024-09-10T19:09:25.221 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libcephfs2-2:19.3.0-4858.gbad1f558.el9.x86_64 9/35 2024-09-10T19:09:25.284 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libcephfs2-2:19.3.0-4858.gbad1f558.el9.x86_64 9/35 2024-09-10T19:09:25.321 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/35 2024-09-10T19:09:25.365 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-ceph-argparse-2:19.3.0-4858.gbad1f558.el9. 11/35 2024-09-10T19:09:25.435 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cephfs-2:19.3.0-4858.gbad1f558.el9.x86_64 12/35 2024-09-10T19:09:25.465 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libradosstriper1-2:19.3.0-4858.gbad1f558.el9.x86_6 13/35 2024-09-10T19:09:25.529 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4858.gbad1f558.el9.x86_6 13/35 2024-09-10T19:09:25.563 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/35 2024-09-10T19:09:25.674 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/35 2024-09-10T19:09:25.714 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/35 2024-09-10T19:09:25.756 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/35 2024-09-10T19:09:25.788 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/35 2024-09-10T19:09:25.817 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/35 2024-09-10T19:09:25.850 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-10T19:09:25.896 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/35 2024-09-10T19:09:26.238 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-10T19:09:26.289 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : librbd1-2:19.3.0-4858.gbad1f558.el9.x86_64 23/35 2024-09-10T19:09:26.381 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librbd1-2:19.3.0-4858.gbad1f558.el9.x86_64 23/35 2024-09-10T19:09:26.552 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-rbd-2:19.3.0-4858.gbad1f558.el9.x86_64 24/35 2024-09-10T19:09:26.588 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-10T19:09:27.105 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-10T19:09:27.141 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : librgw2-2:19.3.0-4858.gbad1f558.el9.x86_64 27/35 2024-09-10T19:09:27.217 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librgw2-2:19.3.0-4858.gbad1f558.el9.x86_64 27/35 2024-09-10T19:09:27.293 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-rgw-2:19.3.0-4858.gbad1f558.el9.x86_64 28/35 2024-09-10T19:09:27.327 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-ceph-common-2:19.3.0-4858.gbad1f558.el9.x8 29/35 2024-09-10T19:09:29.804 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-common-2:19.3.0-4858.gbad1f558.el9.x86_64 30/35 2024-09-10T19:09:29.840 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-common-2:19.3.0-4858.gbad1f558.el9.x86_64 30/35 2024-09-10T19:09:30.440 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-common-2:19.3.0-4858.gbad1f558.el9.x86_64 30/35 2024-09-10T19:09:30.485 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-base-2:19.3.0-4858.gbad1f558.el9.x86_64 31/35 2024-09-10T19:09:30.600 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-base-2:19.3.0-4858.gbad1f558.el9.x86_64 31/35 2024-09-10T19:09:30.600 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T19:09:30.600 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T19:09:30.600 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:09:30.636 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-selinux-2:19.3.0-4858.gbad1f558.el9.x86_64 32/35 2024-09-10T19:09:41.206 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4858.gbad1f558.el9.x86_64 32/35 2024-09-10T19:09:41.206 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /sys 2024-09-10T19:09:41.206 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /proc 2024-09-10T19:09:41.206 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /mnt 2024-09-10T19:09:41.206 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /var/tmp 2024-09-10T19:09:41.206 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /home 2024-09-10T19:09:41.206 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /root 2024-09-10T19:09:41.206 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /tmp 2024-09-10T19:09:41.206 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:09:42.245 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-radosgw-2:19.3.0-4858.gbad1f558.el9.x86_64 33/35 2024-09-10T19:09:42.272 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4858.gbad1f558.el9.x86_64 33/35 2024-09-10T19:09:42.272 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T19:09:42.273 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T19:09:42.273 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T19:09:42.273 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T19:09:42.273 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:09:42.274 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-10T19:09:42.356 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-10T19:09:42.357 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-10T19:09:43.627 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-10T19:09:43.628 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-base-2:19.3.0-4858.gbad1f558.el9.x86_64 1/35 2024-09-10T19:09:43.628 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-common-2:19.3.0-4858.gbad1f558.el9.x86_64 2/35 2024-09-10T19:09:43.628 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-radosgw-2:19.3.0-4858.gbad1f558.el9.x86_64 3/35 2024-09-10T19:09:43.628 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-selinux-2:19.3.0-4858.gbad1f558.el9.x86_64 4/35 2024-09-10T19:09:43.628 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libcephfs2-2:19.3.0-4858.gbad1f558.el9.x86_64 5/35 2024-09-10T19:09:43.628 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libradosstriper1-2:19.3.0-4858.gbad1f558.el9.x86_6 6/35 2024-09-10T19:09:43.628 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librgw2-2:19.3.0-4858.gbad1f558.el9.x86_64 7/35 2024-09-10T19:09:43.628 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4858.gbad1f558.el9. 8/35 2024-09-10T19:09:43.628 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-ceph-common-2:19.3.0-4858.gbad1f558.el9.x8 9/35 2024-09-10T19:09:43.628 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cephfs-2:19.3.0-4858.gbad1f558.el9.x86_64 10/35 2024-09-10T19:09:43.628 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-rados-2:19.3.0-4858.gbad1f558.el9.x86_64 11/35 2024-09-10T19:09:43.628 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-rbd-2:19.3.0-4858.gbad1f558.el9.x86_64 12/35 2024-09-10T19:09:43.628 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-rgw-2:19.3.0-4858.gbad1f558.el9.x86_64 13/35 2024-09-10T19:09:43.629 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-10T19:09:43.629 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-10T19:09:43.629 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-10T19:09:43.629 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-10T19:09:43.629 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-10T19:09:43.629 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-10T19:09:43.629 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-10T19:09:43.629 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-10T19:09:43.629 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-10T19:09:43.629 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-10T19:09:43.629 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 24/35 2024-09-10T19:09:43.629 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-10T19:09:43.629 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-10T19:09:43.629 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-10T19:09:43.629 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-10T19:09:43.630 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-10T19:09:43.630 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-10T19:09:43.630 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-10T19:09:43.630 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librados2-2:19.3.0-4858.gbad1f558.el9.x86_64 32/35 2024-09-10T19:09:43.631 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-10T19:09:43.631 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librbd1-2:19.3.0-4858.gbad1f558.el9.x86_64 34/35 2024-09-10T19:09:44.564 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-10T19:09:44.564 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:09:44.564 INFO:teuthology.orchestra.run.smithi038.stdout:Upgraded: 2024-09-10T19:09:44.564 INFO:teuthology.orchestra.run.smithi038.stdout: librados2-2:19.3.0-4858.gbad1f558.el9.x86_64 2024-09-10T19:09:44.564 INFO:teuthology.orchestra.run.smithi038.stdout: librbd1-2:19.3.0-4858.gbad1f558.el9.x86_64 2024-09-10T19:09:44.564 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-09-10T19:09:44.564 INFO:teuthology.orchestra.run.smithi038.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T19:09:44.564 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-base-2:19.3.0-4858.gbad1f558.el9.x86_64 2024-09-10T19:09:44.565 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-common-2:19.3.0-4858.gbad1f558.el9.x86_64 2024-09-10T19:09:44.565 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-radosgw-2:19.3.0-4858.gbad1f558.el9.x86_64 2024-09-10T19:09:44.565 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-selinux-2:19.3.0-4858.gbad1f558.el9.x86_64 2024-09-10T19:09:44.565 INFO:teuthology.orchestra.run.smithi038.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T19:09:44.565 INFO:teuthology.orchestra.run.smithi038.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T19:09:44.565 INFO:teuthology.orchestra.run.smithi038.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T19:09:44.565 INFO:teuthology.orchestra.run.smithi038.stdout: libcephfs2-2:19.3.0-4858.gbad1f558.el9.x86_64 2024-09-10T19:09:44.565 INFO:teuthology.orchestra.run.smithi038.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-10T19:09:44.565 INFO:teuthology.orchestra.run.smithi038.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T19:09:44.565 INFO:teuthology.orchestra.run.smithi038.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T19:09:44.565 INFO:teuthology.orchestra.run.smithi038.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T19:09:44.565 INFO:teuthology.orchestra.run.smithi038.stdout: libradosstriper1-2:19.3.0-4858.gbad1f558.el9.x86_64 2024-09-10T19:09:44.565 INFO:teuthology.orchestra.run.smithi038.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T19:09:44.566 INFO:teuthology.orchestra.run.smithi038.stdout: librgw2-2:19.3.0-4858.gbad1f558.el9.x86_64 2024-09-10T19:09:44.566 INFO:teuthology.orchestra.run.smithi038.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T19:09:44.566 INFO:teuthology.orchestra.run.smithi038.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T19:09:44.566 INFO:teuthology.orchestra.run.smithi038.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T19:09:44.566 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ceph-argparse-2:19.3.0-4858.gbad1f558.el9.x86_64 2024-09-10T19:09:44.566 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ceph-common-2:19.3.0-4858.gbad1f558.el9.x86_64 2024-09-10T19:09:44.566 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cephfs-2:19.3.0-4858.gbad1f558.el9.x86_64 2024-09-10T19:09:44.566 INFO:teuthology.orchestra.run.smithi038.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T19:09:44.566 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rados-2:19.3.0-4858.gbad1f558.el9.x86_64 2024-09-10T19:09:44.567 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rbd-2:19.3.0-4858.gbad1f558.el9.x86_64 2024-09-10T19:09:44.567 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rgw-2:19.3.0-4858.gbad1f558.el9.x86_64 2024-09-10T19:09:44.567 INFO:teuthology.orchestra.run.smithi038.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T19:09:44.567 INFO:teuthology.orchestra.run.smithi038.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T19:09:44.567 INFO:teuthology.orchestra.run.smithi038.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T19:09:44.567 INFO:teuthology.orchestra.run.smithi038.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T19:09:44.567 INFO:teuthology.orchestra.run.smithi038.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T19:09:44.567 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:09:44.567 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-09-10T19:09:44.950 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-test 2024-09-10T19:09:45.540 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:00:30 ago on Tue 10 Sep 2024 07:09:15 PM UTC. 2024-09-10T19:09:45.678 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-09-10T19:09:45.679 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-10T19:09:45.679 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repository Size 2024-09-10T19:09:45.679 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-10T19:09:45.679 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-09-10T19:09:45.679 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-test x86_64 2:19.3.0-4858.gbad1f558.el9 ceph 50 M 2024-09-10T19:09:45.679 INFO:teuthology.orchestra.run.smithi038.stdout:Installing dependencies: 2024-09-10T19:09:45.679 INFO:teuthology.orchestra.run.smithi038.stdout: libcephsqlite x86_64 2:19.3.0-4858.gbad1f558.el9 ceph 161 k 2024-09-10T19:09:45.679 INFO:teuthology.orchestra.run.smithi038.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T19:09:45.679 INFO:teuthology.orchestra.run.smithi038.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T19:09:45.679 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:09:45.679 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-09-10T19:09:45.679 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-10T19:09:45.680 INFO:teuthology.orchestra.run.smithi038.stdout:Install 4 Packages 2024-09-10T19:09:45.680 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:09:45.680 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 50 M 2024-09-10T19:09:45.680 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 215 M 2024-09-10T19:09:45.680 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-09-10T19:09:46.020 INFO:teuthology.orchestra.run.smithi038.stdout:(1/4): libcephsqlite-19.3.0-4858.gbad1f558.el9. 744 kB/s | 161 kB 00:00 2024-09-10T19:09:46.688 INFO:teuthology.orchestra.run.smithi038.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 95 kB/s | 64 kB 00:00 2024-09-10T19:09:46.796 INFO:teuthology.orchestra.run.smithi038.stdout:(3/4): socat-1.7.4.1-6.el9.x86_64.rpm 306 kB/s | 304 kB 00:00 2024-09-10T19:09:47.338 INFO:teuthology.orchestra.run.smithi038.stdout:(4/4): ceph-test-19.3.0-4858.gbad1f558.el9.x86_ 32 MB/s | 50 MB 00:01 2024-09-10T19:09:47.340 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-09-10T19:09:47.340 INFO:teuthology.orchestra.run.smithi038.stdout:Total 30 MB/s | 50 MB 00:01 2024-09-10T19:09:47.369 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-09-10T19:09:47.392 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-09-10T19:09:47.392 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-09-10T19:09:47.788 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-09-10T19:09:47.788 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-09-10T19:09:48.360 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-09-10T19:09:48.448 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-10T19:09:48.487 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-10T19:09:48.515 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libcephsqlite-2:19.3.0-4858.gbad1f558.el9.x86_64 3/4 2024-09-10T19:09:53.468 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4858.gbad1f558.el9.x86_64 3/4 2024-09-10T19:09:53.550 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-test-2:19.3.0-4858.gbad1f558.el9.x86_64 4/4 2024-09-10T19:09:55.991 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-test-2:19.3.0-4858.gbad1f558.el9.x86_64 4/4 2024-09-10T19:09:55.991 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-test-2:19.3.0-4858.gbad1f558.el9.x86_64 1/4 2024-09-10T19:09:55.991 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libcephsqlite-2:19.3.0-4858.gbad1f558.el9.x86_64 2/4 2024-09-10T19:09:55.991 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-10T19:09:56.340 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-10T19:09:56.340 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:09:56.340 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-09-10T19:09:56.340 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-test-2:19.3.0-4858.gbad1f558.el9.x86_64 2024-09-10T19:09:56.340 INFO:teuthology.orchestra.run.smithi038.stdout: libcephsqlite-2:19.3.0-4858.gbad1f558.el9.x86_64 2024-09-10T19:09:56.340 INFO:teuthology.orchestra.run.smithi038.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T19:09:56.340 INFO:teuthology.orchestra.run.smithi038.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T19:09:56.340 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:09:56.341 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-09-10T19:09:56.664 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph 2024-09-10T19:09:57.262 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:00:42 ago on Tue 10 Sep 2024 07:09:15 PM UTC. 2024-09-10T19:09:57.407 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-09-10T19:09:57.409 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-10T19:09:57.409 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repository Size 2024-09-10T19:09:57.409 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-10T19:09:57.409 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-09-10T19:09:57.410 INFO:teuthology.orchestra.run.smithi038.stdout: ceph x86_64 2:19.3.0-4858.gbad1f558.el9 ceph 6.6 k 2024-09-10T19:09:57.410 INFO:teuthology.orchestra.run.smithi038.stdout:Installing dependencies: 2024-09-10T19:09:57.410 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mds x86_64 2:19.3.0-4858.gbad1f558.el9 ceph 2.4 M 2024-09-10T19:09:57.410 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr x86_64 2:19.3.0-4858.gbad1f558.el9 ceph 1.5 M 2024-09-10T19:09:57.410 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4858.gbad1f558.el9 ceph-noarch 291 k 2024-09-10T19:09:57.410 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mon x86_64 2:19.3.0-4858.gbad1f558.el9 ceph 4.8 M 2024-09-10T19:09:57.410 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-osd x86_64 2:19.3.0-4858.gbad1f558.el9 ceph 17 M 2024-09-10T19:09:57.410 INFO:teuthology.orchestra.run.smithi038.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T19:09:57.410 INFO:teuthology.orchestra.run.smithi038.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T19:09:57.410 INFO:teuthology.orchestra.run.smithi038.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T19:09:57.410 INFO:teuthology.orchestra.run.smithi038.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T19:09:57.410 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T19:09:57.410 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T19:09:57.410 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T19:09:57.411 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T19:09:57.411 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T19:09:57.411 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T19:09:57.411 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-collections 2024-09-10T19:09:57.411 INFO:teuthology.orchestra.run.smithi038.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-10T19:09:57.411 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T19:09:57.411 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T19:09:57.411 INFO:teuthology.orchestra.run.smithi038.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T19:09:57.411 INFO:teuthology.orchestra.run.smithi038.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T19:09:57.411 INFO:teuthology.orchestra.run.smithi038.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T19:09:57.411 INFO:teuthology.orchestra.run.smithi038.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T19:09:57.411 INFO:teuthology.orchestra.run.smithi038.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T19:09:57.411 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T19:09:57.412 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T19:09:57.412 INFO:teuthology.orchestra.run.smithi038.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T19:09:57.412 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T19:09:57.412 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T19:09:57.412 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T19:09:57.412 INFO:teuthology.orchestra.run.smithi038.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T19:09:57.412 INFO:teuthology.orchestra.run.smithi038.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T19:09:57.412 INFO:teuthology.orchestra.run.smithi038.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T19:09:57.412 INFO:teuthology.orchestra.run.smithi038.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T19:09:57.412 INFO:teuthology.orchestra.run.smithi038.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T19:09:57.412 INFO:teuthology.orchestra.run.smithi038.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T19:09:57.412 INFO:teuthology.orchestra.run.smithi038.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T19:09:57.412 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:09:57.412 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-09-10T19:09:57.413 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-10T19:09:57.413 INFO:teuthology.orchestra.run.smithi038.stdout:Install 37 Packages 2024-09-10T19:09:57.413 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:09:57.413 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 31 M 2024-09-10T19:09:57.413 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 109 M 2024-09-10T19:09:57.413 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-09-10T19:09:57.731 INFO:teuthology.orchestra.run.smithi038.stdout:(1/37): ceph-19.3.0-4858.gbad1f558.el9.x86_64.r 42 kB/s | 6.6 kB 00:00 2024-09-10T19:09:57.906 INFO:teuthology.orchestra.run.smithi038.stdout:(2/37): ceph-mds-19.3.0-4858.gbad1f558.el9.x86_ 7.2 MB/s | 2.4 MB 00:00 2024-09-10T19:09:57.956 INFO:teuthology.orchestra.run.smithi038.stdout:(3/37): ceph-mgr-19.3.0-4858.gbad1f558.el9.x86_ 4.0 MB/s | 1.5 MB 00:00 2024-09-10T19:09:58.057 INFO:teuthology.orchestra.run.smithi038.stdout:(4/37): ceph-mgr-modules-core-19.3.0-4858.gbad1 2.8 MB/s | 291 kB 00:00 2024-09-10T19:09:58.157 INFO:teuthology.orchestra.run.smithi038.stdout:(5/37): ceph-mon-19.3.0-4858.gbad1f558.el9.x86_ 11 MB/s | 4.8 MB 00:00 2024-09-10T19:09:58.291 INFO:teuthology.orchestra.run.smithi038.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.1 MB/s | 253 kB 00:00 2024-09-10T19:09:58.483 INFO:teuthology.orchestra.run.smithi038.stdout:(7/37): ceph-osd-19.3.0-4858.gbad1f558.el9.x86_ 30 MB/s | 17 MB 00:00 2024-09-10T19:09:58.508 INFO:teuthology.orchestra.run.smithi038.stdout:(8/37): python3-ply-3.11-14.el9.noarch.rpm 491 kB/s | 106 kB 00:00 2024-09-10T19:09:58.558 INFO:teuthology.orchestra.run.smithi038.stdout:(9/37): python3-requests-2.25.1-8.el9.noarch.rp 2.4 MB/s | 125 kB 00:00 2024-09-10T19:09:58.617 INFO:teuthology.orchestra.run.smithi038.stdout:(10/37): python3-urllib3-1.26.5-6.el9.noarch.rp 3.6 MB/s | 215 kB 00:00 2024-09-10T19:09:58.659 INFO:teuthology.orchestra.run.smithi038.stdout:(11/37): python3-cryptography-36.0.1-4.el9.x86_ 2.4 MB/s | 1.2 MB 00:00 2024-09-10T19:09:58.684 INFO:teuthology.orchestra.run.smithi038.stdout:(12/37): python3-pycparser-2.20-6.el9.noarch.rp 673 kB/s | 135 kB 00:00 2024-09-10T19:09:58.793 INFO:teuthology.orchestra.run.smithi038.stdout:(13/37): python3-markupsafe-1.1.1-12.el9.x86_64 321 kB/s | 35 kB 00:00 2024-09-10T19:09:58.860 INFO:teuthology.orchestra.run.smithi038.stdout:(14/37): python3-mako-1.1.4-6.el9.noarch.rpm 859 kB/s | 172 kB 00:00 2024-09-10T19:09:58.885 INFO:teuthology.orchestra.run.smithi038.stdout:(15/37): lua-5.4.4-4.el9.x86_64.rpm 704 kB/s | 188 kB 00:00 2024-09-10T19:09:58.910 INFO:teuthology.orchestra.run.smithi038.stdout:(16/37): python3-packaging-20.9-5.el9.noarch.rp 658 kB/s | 77 kB 00:00 2024-09-10T19:09:58.927 INFO:teuthology.orchestra.run.smithi038.stdout:(17/37): python3-pytz-2021.1-5.el9.noarch.rpm 758 kB/s | 51 kB 00:00 2024-09-10T19:09:58.944 INFO:teuthology.orchestra.run.smithi038.stdout:(18/37): python3-toml-0.10.2-6.el9.noarch.rpm 709 kB/s | 42 kB 00:00 2024-09-10T19:09:58.994 INFO:teuthology.orchestra.run.smithi038.stdout:(19/37): luarocks-3.9.2-5.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-09-10T19:09:59.020 INFO:teuthology.orchestra.run.smithi038.stdout:(20/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 577 kB/s | 43 kB 00:00 2024-09-10T19:09:59.053 INFO:teuthology.orchestra.run.smithi038.stdout:(21/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 3.0 MB/s | 172 kB 00:00 2024-09-10T19:09:59.078 INFO:teuthology.orchestra.run.smithi038.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 429 kB/s | 11 kB 00:00 2024-09-10T19:09:59.104 INFO:teuthology.orchestra.run.smithi038.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 705 kB/s | 18 kB 00:00 2024-09-10T19:09:59.129 INFO:teuthology.orchestra.run.smithi038.stdout:(24/37): python3-cherrypy-18.6.1-2.el9.noarch.r 3.2 MB/s | 358 kB 00:00 2024-09-10T19:09:59.154 INFO:teuthology.orchestra.run.smithi038.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 462 kB/s | 23 kB 00:00 2024-09-10T19:09:59.188 INFO:teuthology.orchestra.run.smithi038.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 755 kB/s | 19 kB 00:00 2024-09-10T19:09:59.213 INFO:teuthology.orchestra.run.smithi038.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 387 kB/s | 20 kB 00:00 2024-09-10T19:09:59.238 INFO:teuthology.orchestra.run.smithi038.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 1.8 MB/s | 46 kB 00:00 2024-09-10T19:09:59.264 INFO:teuthology.orchestra.run.smithi038.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-10T19:09:59.289 INFO:teuthology.orchestra.run.smithi038.stdout:(30/37): python3-portend-3.1.0-2.el9.noarch.rpm 662 kB/s | 16 kB 00:00 2024-09-10T19:09:59.314 INFO:teuthology.orchestra.run.smithi038.stdout:(31/37): python3-pecan-1.4.2-3.el9.noarch.rpm 3.6 MB/s | 272 kB 00:00 2024-09-10T19:09:59.351 INFO:teuthology.orchestra.run.smithi038.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.4 MB/s | 90 kB 00:00 2024-09-10T19:09:59.368 INFO:teuthology.orchestra.run.smithi038.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 667 kB/s | 36 kB 00:00 2024-09-10T19:09:59.394 INFO:teuthology.orchestra.run.smithi038.stdout:(34/37): python3-webob-1.8.8-2.el9.noarch.rpm 5.4 MB/s | 230 kB 00:00 2024-09-10T19:09:59.410 INFO:teuthology.orchestra.run.smithi038.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 1.2 MB/s | 20 kB 00:00 2024-09-10T19:09:59.444 INFO:teuthology.orchestra.run.smithi038.stdout:(36/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 5.5 MB/s | 427 kB 00:00 2024-09-10T19:09:59.477 INFO:teuthology.orchestra.run.smithi038.stdout:(37/37): lua-devel-5.4.4-4.el9.x86_64.rpm 39 kB/s | 22 kB 00:00 2024-09-10T19:09:59.482 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-09-10T19:09:59.482 INFO:teuthology.orchestra.run.smithi038.stdout:Total 15 MB/s | 31 MB 00:02 2024-09-10T19:09:59.637 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-09-10T19:09:59.681 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-09-10T19:09:59.681 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-09-10T19:10:00.154 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-09-10T19:10:00.155 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-09-10T19:10:01.585 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-09-10T19:10:01.647 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-10T19:10:01.689 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-10T19:10:01.725 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-10T19:10:01.801 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-10T19:10:01.857 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-10T19:10:01.890 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-10T19:10:01.986 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-10T19:10:02.081 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-10T19:10:02.135 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-10T19:10:02.170 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-10T19:10:02.200 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-10T19:10:02.234 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-10T19:10:02.267 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-10T19:10:02.309 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-10T19:10:02.352 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-10T19:10:02.385 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-10T19:10:02.444 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-10T19:10:02.483 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-10T19:10:02.569 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-10T19:10:02.722 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-10T19:10:02.804 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-10T19:10:02.862 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-10T19:10:02.900 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-10T19:10:02.968 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-10T19:10:03.031 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-10T19:10:03.228 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-10T19:10:03.288 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-10T19:10:03.369 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-10T19:10:03.459 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-10T19:10:03.501 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-10T19:10:03.642 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-10T19:10:03.810 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4858.gbad1f558.el9. 32/37 2024-09-10T19:10:03.840 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-2:19.3.0-4858.gbad1f558.el9.x86_64 33/37 2024-09-10T19:10:03.882 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4858.gbad1f558.el9.x86_64 33/37 2024-09-10T19:10:03.883 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T19:10:03.883 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T19:10:03.883 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T19:10:03.883 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T19:10:03.883 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:10:05.441 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-osd-2:19.3.0-4858.gbad1f558.el9.x86_64 34/37 2024-09-10T19:10:05.471 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-osd-2:19.3.0-4858.gbad1f558.el9.x86_64 34/37 2024-09-10T19:10:05.471 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T19:10:05.471 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T19:10:05.471 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T19:10:05.471 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T19:10:05.471 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:10:05.942 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mon-2:19.3.0-4858.gbad1f558.el9.x86_64 35/37 2024-09-10T19:10:05.967 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mon-2:19.3.0-4858.gbad1f558.el9.x86_64 35/37 2024-09-10T19:10:05.967 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T19:10:05.967 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T19:10:05.967 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T19:10:05.968 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T19:10:05.968 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:10:06.209 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mds-2:19.3.0-4858.gbad1f558.el9.x86_64 36/37 2024-09-10T19:10:06.234 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mds-2:19.3.0-4858.gbad1f558.el9.x86_64 36/37 2024-09-10T19:10:06.234 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T19:10:06.234 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T19:10:06.234 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T19:10:06.234 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T19:10:06.234 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:10:06.309 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-2:19.3.0-4858.gbad1f558.el9.x86_64 37/37 2024-09-10T19:10:08.086 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-2:19.3.0-4858.gbad1f558.el9.x86_64 37/37 2024-09-10T19:10:08.086 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-2:19.3.0-4858.gbad1f558.el9.x86_64 1/37 2024-09-10T19:10:08.086 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mds-2:19.3.0-4858.gbad1f558.el9.x86_64 2/37 2024-09-10T19:10:08.087 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-2:19.3.0-4858.gbad1f558.el9.x86_64 3/37 2024-09-10T19:10:08.087 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mon-2:19.3.0-4858.gbad1f558.el9.x86_64 4/37 2024-09-10T19:10:08.087 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-osd-2:19.3.0-4858.gbad1f558.el9.x86_64 5/37 2024-09-10T19:10:08.087 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4858.gbad1f558.el9. 6/37 2024-09-10T19:10:08.087 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-10T19:10:08.087 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-10T19:10:08.087 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-10T19:10:08.088 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-10T19:10:08.088 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-10T19:10:08.088 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-10T19:10:08.088 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-10T19:10:08.088 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-10T19:10:08.088 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-10T19:10:08.089 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-10T19:10:08.089 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-10T19:10:08.089 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-10T19:10:08.089 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-10T19:10:08.089 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-10T19:10:08.089 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-10T19:10:08.090 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-10T19:10:08.090 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-10T19:10:08.090 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-10T19:10:08.090 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-10T19:10:08.090 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-10T19:10:08.091 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-10T19:10:08.091 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-10T19:10:08.091 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-10T19:10:08.091 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-10T19:10:08.092 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-10T19:10:08.092 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-10T19:10:08.092 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-10T19:10:08.092 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-10T19:10:08.092 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-10T19:10:08.092 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-10T19:10:09.221 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-10T19:10:09.221 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:10:09.221 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-09-10T19:10:09.221 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-2:19.3.0-4858.gbad1f558.el9.x86_64 2024-09-10T19:10:09.221 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mds-2:19.3.0-4858.gbad1f558.el9.x86_64 2024-09-10T19:10:09.221 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-2:19.3.0-4858.gbad1f558.el9.x86_64 2024-09-10T19:10:09.221 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-modules-core-2:19.3.0-4858.gbad1f558.el9.noarch 2024-09-10T19:10:09.221 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mon-2:19.3.0-4858.gbad1f558.el9.x86_64 2024-09-10T19:10:09.221 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-osd-2:19.3.0-4858.gbad1f558.el9.x86_64 2024-09-10T19:10:09.221 INFO:teuthology.orchestra.run.smithi038.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T19:10:09.221 INFO:teuthology.orchestra.run.smithi038.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T19:10:09.222 INFO:teuthology.orchestra.run.smithi038.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T19:10:09.222 INFO:teuthology.orchestra.run.smithi038.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T19:10:09.222 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T19:10:09.222 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T19:10:09.222 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T19:10:09.222 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T19:10:09.222 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T19:10:09.222 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T19:10:09.222 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T19:10:09.222 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T19:10:09.222 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T19:10:09.222 INFO:teuthology.orchestra.run.smithi038.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T19:10:09.222 INFO:teuthology.orchestra.run.smithi038.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T19:10:09.222 INFO:teuthology.orchestra.run.smithi038.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T19:10:09.222 INFO:teuthology.orchestra.run.smithi038.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T19:10:09.222 INFO:teuthology.orchestra.run.smithi038.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T19:10:09.223 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T19:10:09.223 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T19:10:09.223 INFO:teuthology.orchestra.run.smithi038.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T19:10:09.223 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T19:10:09.223 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T19:10:09.223 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T19:10:09.223 INFO:teuthology.orchestra.run.smithi038.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T19:10:09.223 INFO:teuthology.orchestra.run.smithi038.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T19:10:09.223 INFO:teuthology.orchestra.run.smithi038.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T19:10:09.223 INFO:teuthology.orchestra.run.smithi038.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T19:10:09.223 INFO:teuthology.orchestra.run.smithi038.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T19:10:09.223 INFO:teuthology.orchestra.run.smithi038.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T19:10:09.223 INFO:teuthology.orchestra.run.smithi038.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T19:10:09.223 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:10:09.223 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-09-10T19:10:09.620 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-base 2024-09-10T19:10:10.205 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:00:55 ago on Tue 10 Sep 2024 07:09:15 PM UTC. 2024-09-10T19:10:10.298 INFO:teuthology.orchestra.run.smithi038.stdout:Package ceph-base-2:19.3.0-4858.gbad1f558.el9.x86_64 is already installed. 2024-09-10T19:10:10.342 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-09-10T19:10:10.343 INFO:teuthology.orchestra.run.smithi038.stdout:Nothing to do. 2024-09-10T19:10:10.343 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-09-10T19:10:10.419 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install cephadm 2024-09-10T19:10:11.004 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:00:56 ago on Tue 10 Sep 2024 07:09:15 PM UTC. 2024-09-10T19:10:11.144 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-09-10T19:10:11.145 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-10T19:10:11.145 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repository Size 2024-09-10T19:10:11.145 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-10T19:10:11.145 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-09-10T19:10:11.145 INFO:teuthology.orchestra.run.smithi038.stdout: cephadm noarch 2:19.3.0-4858.gbad1f558.el9 ceph-noarch 784 k 2024-09-10T19:10:11.146 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:10:11.146 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-09-10T19:10:11.146 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-10T19:10:11.146 INFO:teuthology.orchestra.run.smithi038.stdout:Install 1 Package 2024-09-10T19:10:11.146 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:10:11.146 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 784 k 2024-09-10T19:10:11.146 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 790 k 2024-09-10T19:10:11.146 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-09-10T19:10:11.416 INFO:teuthology.orchestra.run.smithi038.stdout:cephadm-19.3.0-4858.gbad1f558.el9.noarch.rpm 2.8 MB/s | 784 kB 00:00 2024-09-10T19:10:11.417 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-09-10T19:10:11.417 INFO:teuthology.orchestra.run.smithi038.stdout:Total 2.8 MB/s | 784 kB 00:00 2024-09-10T19:10:11.417 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-09-10T19:10:11.423 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-09-10T19:10:11.423 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-09-10T19:10:11.429 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-09-10T19:10:11.429 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-09-10T19:10:11.508 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-09-10T19:10:11.922 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: cephadm-2:19.3.0-4858.gbad1f558.el9.noarch 1/1 2024-09-10T19:10:12.007 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : cephadm-2:19.3.0-4858.gbad1f558.el9.noarch 1/1 2024-09-10T19:10:12.392 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: cephadm-2:19.3.0-4858.gbad1f558.el9.noarch 1/1 2024-09-10T19:10:12.640 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : cephadm-2:19.3.0-4858.gbad1f558.el9.noarch 1/1 2024-09-10T19:10:12.640 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:10:12.640 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-09-10T19:10:12.640 INFO:teuthology.orchestra.run.smithi038.stdout: cephadm-2:19.3.0-4858.gbad1f558.el9.noarch 2024-09-10T19:10:12.641 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:10:12.641 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-09-10T19:10:12.862 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-immutable-object-cache 2024-09-10T19:10:13.454 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:00:58 ago on Tue 10 Sep 2024 07:09:15 PM UTC. 2024-09-10T19:10:13.593 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-09-10T19:10:13.593 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-10T19:10:13.594 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repo Size 2024-09-10T19:10:13.594 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-10T19:10:13.594 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-09-10T19:10:13.594 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4858.gbad1f558.el9 ceph 145 k 2024-09-10T19:10:13.594 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:10:13.594 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-09-10T19:10:13.594 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-10T19:10:13.594 INFO:teuthology.orchestra.run.smithi038.stdout:Install 1 Package 2024-09-10T19:10:13.594 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:10:13.594 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 145 k 2024-09-10T19:10:13.594 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 432 k 2024-09-10T19:10:13.594 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-09-10T19:10:13.798 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-immutable-object-cache-19.3.0-4858.gbad1f5 715 kB/s | 145 kB 00:00 2024-09-10T19:10:13.798 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-09-10T19:10:13.799 INFO:teuthology.orchestra.run.smithi038.stdout:Total 710 kB/s | 145 kB 00:00 2024-09-10T19:10:13.799 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-09-10T19:10:13.807 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-09-10T19:10:13.807 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-09-10T19:10:13.867 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-09-10T19:10:13.867 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-09-10T19:10:14.033 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-09-10T19:10:14.115 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4858.gbad1f558. 1/1 2024-09-10T19:10:14.141 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4858.gbad1f558. 1/1 2024-09-10T19:10:14.141 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T19:10:14.142 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T19:10:14.142 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:10:15.096 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4858.gbad1f558. 1/1 2024-09-10T19:10:15.096 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:10:15.096 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-09-10T19:10:15.097 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-immutable-object-cache-2:19.3.0-4858.gbad1f558.el9.x86_64 2024-09-10T19:10:15.097 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:10:15.097 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-09-10T19:10:15.339 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-mgr 2024-09-10T19:10:15.932 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:00 ago on Tue 10 Sep 2024 07:09:15 PM UTC. 2024-09-10T19:10:16.025 INFO:teuthology.orchestra.run.smithi038.stdout:Package ceph-mgr-2:19.3.0-4858.gbad1f558.el9.x86_64 is already installed. 2024-09-10T19:10:16.069 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-09-10T19:10:16.070 INFO:teuthology.orchestra.run.smithi038.stdout:Nothing to do. 2024-09-10T19:10:16.070 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-09-10T19:10:16.148 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-mgr-dashboard 2024-09-10T19:10:16.735 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:01 ago on Tue 10 Sep 2024 07:09:15 PM UTC. 2024-09-10T19:10:16.874 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-09-10T19:10:16.875 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-10T19:10:16.875 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repository Size 2024-09-10T19:10:16.875 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-10T19:10:16.875 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-09-10T19:10:16.875 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4858.gbad1f558.el9 ceph-noarch 14 M 2024-09-10T19:10:16.875 INFO:teuthology.orchestra.run.smithi038.stdout:Installing dependencies: 2024-09-10T19:10:16.876 INFO:teuthology.orchestra.run.smithi038.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T19:10:16.876 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4858.gbad1f558.el9 ceph-noarch 34 k 2024-09-10T19:10:16.876 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4858.gbad1f558.el9 ceph-noarch 16 k 2024-09-10T19:10:16.876 INFO:teuthology.orchestra.run.smithi038.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T19:10:16.876 INFO:teuthology.orchestra.run.smithi038.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T19:10:16.876 INFO:teuthology.orchestra.run.smithi038.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T19:10:16.876 INFO:teuthology.orchestra.run.smithi038.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T19:10:16.876 INFO:teuthology.orchestra.run.smithi038.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T19:10:16.877 INFO:teuthology.orchestra.run.smithi038.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T19:10:16.877 INFO:teuthology.orchestra.run.smithi038.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T19:10:16.877 INFO:teuthology.orchestra.run.smithi038.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T19:10:16.877 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:10:16.877 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-09-10T19:10:16.877 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-10T19:10:16.877 INFO:teuthology.orchestra.run.smithi038.stdout:Install 12 Packages 2024-09-10T19:10:16.877 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:10:16.878 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 19 M 2024-09-10T19:10:16.878 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 159 M 2024-09-10T19:10:16.878 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-09-10T19:10:17.601 INFO:teuthology.orchestra.run.smithi038.stdout:(1/12): ceph-prometheus-alerts-19.3.0-4858.gbad 101 kB/s | 16 kB 00:00 2024-09-10T19:10:17.627 INFO:teuthology.orchestra.run.smithi038.stdout:(2/12): ceph-grafana-dashboards-19.3.0-4858.gba 182 kB/s | 34 kB 00:00 2024-09-10T19:10:17.794 INFO:teuthology.orchestra.run.smithi038.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.6 MB/s | 269 kB 00:00 2024-09-10T19:10:17.853 INFO:teuthology.orchestra.run.smithi038.stdout:(4/12): protobuf-3.14.0-13.el9.x86_64.rpm 4.0 MB/s | 1.0 MB 00:00 2024-09-10T19:10:17.945 INFO:teuthology.orchestra.run.smithi038.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 5.9 MB/s | 548 kB 00:00 2024-09-10T19:10:17.970 INFO:teuthology.orchestra.run.smithi038.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 788 kB/s | 19 kB 00:00 2024-09-10T19:10:18.120 INFO:teuthology.orchestra.run.smithi038.stdout:(7/12): ceph-mgr-dashboard-19.3.0-4858.gbad1f55 21 MB/s | 14 MB 00:00 2024-09-10T19:10:18.154 INFO:teuthology.orchestra.run.smithi038.stdout:(8/12): protobuf-compiler-3.14.0-13.el9.x86_64. 2.3 MB/s | 863 kB 00:00 2024-09-10T19:10:18.212 INFO:teuthology.orchestra.run.smithi038.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 618 kB/s | 31 kB 00:00 2024-09-10T19:10:18.237 INFO:teuthology.orchestra.run.smithi038.stdout:(10/12): python3-grpcio-tools-1.46.7-10.el9.x86 1.2 MB/s | 144 kB 00:00 2024-09-10T19:10:18.280 INFO:teuthology.orchestra.run.smithi038.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 2.8 MB/s | 188 kB 00:00 2024-09-10T19:10:18.330 INFO:teuthology.orchestra.run.smithi038.stdout:(12/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 5.7 MB/s | 2.0 MB 00:00 2024-09-10T19:10:18.334 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-09-10T19:10:18.334 INFO:teuthology.orchestra.run.smithi038.stdout:Total 13 MB/s | 19 MB 00:01 2024-09-10T19:10:18.386 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-09-10T19:10:18.407 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-09-10T19:10:18.407 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-09-10T19:10:18.709 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-09-10T19:10:18.709 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-09-10T19:10:19.328 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-09-10T19:10:19.415 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-10T19:10:19.450 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-10T19:10:19.498 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-10T19:10:19.526 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-10T19:10:19.623 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-10T19:10:19.759 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-10T19:10:19.858 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-10T19:10:19.923 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-10T19:10:19.951 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-10T19:10:19.984 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4858.gbad1f558.el9 10/12 2024-09-10T19:10:23.375 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4858.gbad1f558.el 11/12 2024-09-10T19:10:23.429 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4858.gbad1f558.el9.noa 12/12 2024-09-10T19:10:25.381 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4858.gbad1f558.el9.noa 12/12 2024-09-10T19:10:25.381 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4858.gbad1f558.el 1/12 2024-09-10T19:10:25.382 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4858.gbad1f558.el9.noa 2/12 2024-09-10T19:10:25.382 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4858.gbad1f558.el9 3/12 2024-09-10T19:10:25.382 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-10T19:10:25.382 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-10T19:10:25.382 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-10T19:10:25.382 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-10T19:10:25.382 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-10T19:10:25.382 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-10T19:10:25.382 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-10T19:10:25.382 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-10T19:10:25.712 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-10T19:10:25.713 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:10:25.713 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-09-10T19:10:25.713 INFO:teuthology.orchestra.run.smithi038.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T19:10:25.713 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-grafana-dashboards-2:19.3.0-4858.gbad1f558.el9.noarch 2024-09-10T19:10:25.713 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-dashboard-2:19.3.0-4858.gbad1f558.el9.noarch 2024-09-10T19:10:25.713 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-prometheus-alerts-2:19.3.0-4858.gbad1f558.el9.noarch 2024-09-10T19:10:25.713 INFO:teuthology.orchestra.run.smithi038.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T19:10:25.713 INFO:teuthology.orchestra.run.smithi038.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T19:10:25.713 INFO:teuthology.orchestra.run.smithi038.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T19:10:25.713 INFO:teuthology.orchestra.run.smithi038.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T19:10:25.713 INFO:teuthology.orchestra.run.smithi038.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T19:10:25.713 INFO:teuthology.orchestra.run.smithi038.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T19:10:25.714 INFO:teuthology.orchestra.run.smithi038.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T19:10:25.714 INFO:teuthology.orchestra.run.smithi038.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T19:10:25.714 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:10:25.714 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-09-10T19:10:25.985 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-10T19:10:26.573 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:11 ago on Tue 10 Sep 2024 07:09:15 PM UTC. 2024-09-10T19:10:26.715 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-09-10T19:10:26.716 INFO:teuthology.orchestra.run.smithi038.stdout:======================================================================================= 2024-09-10T19:10:26.717 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repository Size 2024-09-10T19:10:26.717 INFO:teuthology.orchestra.run.smithi038.stdout:======================================================================================= 2024-09-10T19:10:26.717 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-09-10T19:10:26.717 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4858.gbad1f558.el9 ceph-noarch 7.4 M 2024-09-10T19:10:26.717 INFO:teuthology.orchestra.run.smithi038.stdout:Installing dependencies: 2024-09-10T19:10:26.717 INFO:teuthology.orchestra.run.smithi038.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T19:10:26.717 INFO:teuthology.orchestra.run.smithi038.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T19:10:26.717 INFO:teuthology.orchestra.run.smithi038.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T19:10:26.717 INFO:teuthology.orchestra.run.smithi038.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T19:10:26.717 INFO:teuthology.orchestra.run.smithi038.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T19:10:26.717 INFO:teuthology.orchestra.run.smithi038.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T19:10:26.717 INFO:teuthology.orchestra.run.smithi038.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T19:10:26.718 INFO:teuthology.orchestra.run.smithi038.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T19:10:26.718 INFO:teuthology.orchestra.run.smithi038.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T19:10:26.718 INFO:teuthology.orchestra.run.smithi038.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T19:10:26.718 INFO:teuthology.orchestra.run.smithi038.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T19:10:26.718 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:10:26.718 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-09-10T19:10:26.718 INFO:teuthology.orchestra.run.smithi038.stdout:======================================================================================= 2024-09-10T19:10:26.718 INFO:teuthology.orchestra.run.smithi038.stdout:Install 12 Packages 2024-09-10T19:10:26.718 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:10:26.719 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 38 M 2024-09-10T19:10:26.719 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 212 M 2024-09-10T19:10:26.719 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-09-10T19:10:27.253 INFO:teuthology.orchestra.run.smithi038.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.3 MB/s | 191 kB 00:00 2024-09-10T19:10:27.287 INFO:teuthology.orchestra.run.smithi038.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 4.3 MB/s | 801 kB 00:00 2024-09-10T19:10:27.387 INFO:teuthology.orchestra.run.smithi038.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 245 kB/s | 33 kB 00:00 2024-09-10T19:10:27.429 INFO:teuthology.orchestra.run.smithi038.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 438 kB/s | 18 kB 00:00 2024-09-10T19:10:27.479 INFO:teuthology.orchestra.run.smithi038.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 771 kB/s | 38 kB 00:00 2024-09-10T19:10:27.588 INFO:teuthology.orchestra.run.smithi038.stdout:(6/12): ceph-mgr-diskprediction-local-19.3.0-48 15 MB/s | 7.4 MB 00:00 2024-09-10T19:10:27.780 INFO:teuthology.orchestra.run.smithi038.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 6.1 MB/s | 3.0 MB 00:00 2024-09-10T19:10:27.855 INFO:teuthology.orchestra.run.smithi038.stdout:(8/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 13 MB/s | 4.9 MB 00:00 2024-09-10T19:10:27.880 INFO:teuthology.orchestra.run.smithi038.stdout:(9/12): python3-devel-3.9.19-8.el9.x86_64.rpm 838 kB/s | 245 kB 00:00 2024-09-10T19:10:27.931 INFO:teuthology.orchestra.run.smithi038.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 3.2 MB/s | 250 kB 00:00 2024-09-10T19:10:28.031 INFO:teuthology.orchestra.run.smithi038.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 20 MB/s | 5.1 MB 00:00 2024-09-10T19:10:29.456 INFO:teuthology.orchestra.run.smithi038.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 10 MB/s | 16 MB 00:01 2024-09-10T19:10:29.457 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-09-10T19:10:29.457 INFO:teuthology.orchestra.run.smithi038.stdout:Total 14 MB/s | 38 MB 00:02 2024-09-10T19:10:29.822 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-09-10T19:10:29.848 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-09-10T19:10:29.849 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-09-10T19:10:30.296 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-09-10T19:10:30.296 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-09-10T19:10:31.083 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-09-10T19:10:31.153 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-10T19:10:31.213 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-10T19:10:31.325 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-10T19:10:31.372 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-10T19:10:31.564 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-10T19:10:31.596 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-10T19:10:31.675 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-10T19:10:32.369 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-10T19:10:32.488 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-10T19:10:33.809 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-10T19:10:34.899 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-10T19:10:34.921 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4858.gbad1f 12/12 2024-09-10T19:10:37.616 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4858.gbad1f 12/12 2024-09-10T19:10:37.616 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4858.gbad1f 1/12 2024-09-10T19:10:37.616 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-10T19:10:37.616 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-10T19:10:37.617 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-10T19:10:37.617 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-10T19:10:37.617 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-10T19:10:37.617 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-10T19:10:37.617 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-10T19:10:37.617 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-10T19:10:37.617 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-10T19:10:37.617 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-10T19:10:38.046 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-10T19:10:38.046 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:10:38.047 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-09-10T19:10:38.047 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4858.gbad1f558.el9.noarch 2024-09-10T19:10:38.047 INFO:teuthology.orchestra.run.smithi038.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T19:10:38.047 INFO:teuthology.orchestra.run.smithi038.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T19:10:38.047 INFO:teuthology.orchestra.run.smithi038.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T19:10:38.047 INFO:teuthology.orchestra.run.smithi038.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T19:10:38.047 INFO:teuthology.orchestra.run.smithi038.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T19:10:38.047 INFO:teuthology.orchestra.run.smithi038.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T19:10:38.047 INFO:teuthology.orchestra.run.smithi038.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T19:10:38.047 INFO:teuthology.orchestra.run.smithi038.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T19:10:38.047 INFO:teuthology.orchestra.run.smithi038.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T19:10:38.047 INFO:teuthology.orchestra.run.smithi038.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T19:10:38.047 INFO:teuthology.orchestra.run.smithi038.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T19:10:38.048 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:10:38.048 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-09-10T19:10:38.437 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-mgr-rook 2024-09-10T19:10:39.032 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:24 ago on Tue 10 Sep 2024 07:09:15 PM UTC. 2024-09-10T19:10:39.172 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-09-10T19:10:39.173 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-10T19:10:39.173 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repository Size 2024-09-10T19:10:39.174 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-10T19:10:39.174 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-09-10T19:10:39.174 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-rook noarch 2:19.3.0-4858.gbad1f558.el9 ceph-noarch 49 k 2024-09-10T19:10:39.174 INFO:teuthology.orchestra.run.smithi038.stdout:Installing dependencies: 2024-09-10T19:10:39.174 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T19:10:39.174 INFO:teuthology.orchestra.run.smithi038.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T19:10:39.174 INFO:teuthology.orchestra.run.smithi038.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T19:10:39.174 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T19:10:39.174 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T19:10:39.174 INFO:teuthology.orchestra.run.smithi038.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T19:10:39.174 INFO:teuthology.orchestra.run.smithi038.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T19:10:39.174 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T19:10:39.174 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T19:10:39.175 INFO:teuthology.orchestra.run.smithi038.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T19:10:39.175 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T19:10:39.175 INFO:teuthology.orchestra.run.smithi038.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T19:10:39.175 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:10:39.175 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-09-10T19:10:39.175 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-10T19:10:39.175 INFO:teuthology.orchestra.run.smithi038.stdout:Install 13 Packages 2024-09-10T19:10:39.175 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:10:39.176 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 2.2 M 2024-09-10T19:10:39.176 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 26 M 2024-09-10T19:10:39.176 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-09-10T19:10:39.621 INFO:teuthology.orchestra.run.smithi038.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 207 kB/s | 26 kB 00:00 2024-09-10T19:10:39.646 INFO:teuthology.orchestra.run.smithi038.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 129 kB/s | 19 kB 00:00 2024-09-10T19:10:39.671 INFO:teuthology.orchestra.run.smithi038.stdout:(3/13): ceph-mgr-rook-19.3.0-4858.gbad1f558.el9 283 kB/s | 49 kB 00:00 2024-09-10T19:10:39.788 INFO:teuthology.orchestra.run.smithi038.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.1 MB/s | 159 kB 00:00 2024-09-10T19:10:39.813 INFO:teuthology.orchestra.run.smithi038.stdout:(5/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.3 MB/s | 222 kB 00:00 2024-09-10T19:10:39.847 INFO:teuthology.orchestra.run.smithi038.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 915 kB/s | 54 kB 00:00 2024-09-10T19:10:39.881 INFO:teuthology.orchestra.run.smithi038.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 481 kB/s | 32 kB 00:00 2024-09-10T19:10:39.906 INFO:teuthology.orchestra.run.smithi038.stdout:(8/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.2 MB/s | 279 kB 00:00 2024-09-10T19:10:39.931 INFO:teuthology.orchestra.run.smithi038.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 172 kB/s | 14 kB 00:00 2024-09-10T19:10:39.965 INFO:teuthology.orchestra.run.smithi038.stdout:(10/13): python3-google-auth-2.34.0-1.el9.noarc 2.6 MB/s | 220 kB 00:00 2024-09-10T19:10:39.990 INFO:teuthology.orchestra.run.smithi038.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-10T19:10:40.015 INFO:teuthology.orchestra.run.smithi038.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.8 MB/s | 90 kB 00:00 2024-09-10T19:10:40.082 INFO:teuthology.orchestra.run.smithi038.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 5.8 MB/s | 1.0 MB 00:00 2024-09-10T19:10:40.085 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-09-10T19:10:40.085 INFO:teuthology.orchestra.run.smithi038.stdout:Total 2.4 MB/s | 2.2 MB 00:00 2024-09-10T19:10:40.153 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-09-10T19:10:40.169 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-09-10T19:10:40.169 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-09-10T19:10:40.266 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-09-10T19:10:40.267 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-09-10T19:10:40.905 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-09-10T19:10:41.080 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-10T19:10:41.212 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-10T19:10:41.274 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-10T19:10:41.318 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-10T19:10:41.361 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-10T19:10:41.467 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-10T19:10:41.578 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-10T19:10:41.637 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-10T19:10:42.398 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-10T19:10:42.459 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-10T19:10:42.492 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-10T19:10:42.541 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-10T19:10:42.570 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-rook-2:19.3.0-4858.gbad1f558.el9.noarch 13/13 2024-09-10T19:10:43.365 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4858.gbad1f558.el9.noarch 13/13 2024-09-10T19:10:43.366 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4858.gbad1f558.el9.noarch 1/13 2024-09-10T19:10:43.366 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-10T19:10:43.366 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-10T19:10:43.366 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-10T19:10:43.366 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-10T19:10:43.366 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-10T19:10:43.366 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-10T19:10:43.366 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-10T19:10:43.366 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-10T19:10:43.366 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-10T19:10:43.366 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-10T19:10:43.366 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-10T19:10:43.702 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-10T19:10:43.702 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:10:43.702 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-09-10T19:10:43.703 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-rook-2:19.3.0-4858.gbad1f558.el9.noarch 2024-09-10T19:10:43.703 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T19:10:43.703 INFO:teuthology.orchestra.run.smithi038.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T19:10:43.703 INFO:teuthology.orchestra.run.smithi038.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T19:10:43.703 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T19:10:43.703 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T19:10:43.704 INFO:teuthology.orchestra.run.smithi038.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T19:10:43.704 INFO:teuthology.orchestra.run.smithi038.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T19:10:43.704 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T19:10:43.704 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T19:10:43.704 INFO:teuthology.orchestra.run.smithi038.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T19:10:43.704 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T19:10:43.705 INFO:teuthology.orchestra.run.smithi038.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T19:10:43.705 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:10:43.705 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-09-10T19:10:43.951 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-mgr-cephadm 2024-09-10T19:10:44.547 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:29 ago on Tue 10 Sep 2024 07:09:15 PM UTC. 2024-09-10T19:10:44.689 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-09-10T19:10:44.689 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-10T19:10:44.689 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repository Size 2024-09-10T19:10:44.689 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-10T19:10:44.690 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-09-10T19:10:44.690 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4858.gbad1f558.el9 ceph-noarch 154 k 2024-09-10T19:10:44.690 INFO:teuthology.orchestra.run.smithi038.stdout:Installing dependencies: 2024-09-10T19:10:44.690 INFO:teuthology.orchestra.run.smithi038.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T19:10:44.690 INFO:teuthology.orchestra.run.smithi038.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T19:10:44.690 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T19:10:44.690 INFO:teuthology.orchestra.run.smithi038.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T19:10:44.690 INFO:teuthology.orchestra.run.smithi038.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T19:10:44.690 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:10:44.690 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-09-10T19:10:44.690 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-10T19:10:44.691 INFO:teuthology.orchestra.run.smithi038.stdout:Install 6 Packages 2024-09-10T19:10:44.691 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:10:44.691 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 7.0 M 2024-09-10T19:10:44.691 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 33 M 2024-09-10T19:10:44.691 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-09-10T19:10:45.059 INFO:teuthology.orchestra.run.smithi038.stdout:(1/6): ceph-mgr-cephadm-19.3.0-4858.gbad1f558.e 712 kB/s | 154 kB 00:00 2024-09-10T19:10:45.134 INFO:teuthology.orchestra.run.smithi038.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 8.0 MB/s | 548 kB 00:00 2024-09-10T19:10:45.160 INFO:teuthology.orchestra.run.smithi038.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.3 MB/s | 58 kB 00:00 2024-09-10T19:10:45.194 INFO:teuthology.orchestra.run.smithi038.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.2 MB/s | 74 kB 00:00 2024-09-10T19:10:45.736 INFO:teuthology.orchestra.run.smithi038.stdout:(5/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 278 kB/s | 248 kB 00:00 2024-09-10T19:10:46.436 INFO:teuthology.orchestra.run.smithi038.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 3.7 MB/s | 6.0 MB 00:01 2024-09-10T19:10:46.438 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-09-10T19:10:46.438 INFO:teuthology.orchestra.run.smithi038.stdout:Total 4.0 MB/s | 7.0 MB 00:01 2024-09-10T19:10:46.515 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-09-10T19:10:46.528 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-09-10T19:10:46.528 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-09-10T19:10:46.636 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-09-10T19:10:46.637 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-09-10T19:10:46.947 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-09-10T19:10:47.134 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-10T19:10:47.180 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-10T19:10:47.734 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-10T19:10:47.834 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-10T19:10:47.920 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-10T19:10:47.949 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4858.gbad1f558.el9.noarch 6/6 2024-09-10T19:10:48.708 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4858.gbad1f558.el9.noarch 6/6 2024-09-10T19:10:48.708 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4858.gbad1f558.el9.noarch 1/6 2024-09-10T19:10:48.708 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-10T19:10:48.709 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-10T19:10:48.709 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-10T19:10:48.709 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-10T19:10:48.984 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-10T19:10:48.984 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:10:48.984 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-09-10T19:10:48.984 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-cephadm-2:19.3.0-4858.gbad1f558.el9.noarch 2024-09-10T19:10:48.984 INFO:teuthology.orchestra.run.smithi038.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T19:10:48.984 INFO:teuthology.orchestra.run.smithi038.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T19:10:48.984 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T19:10:48.984 INFO:teuthology.orchestra.run.smithi038.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T19:10:48.984 INFO:teuthology.orchestra.run.smithi038.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T19:10:48.985 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:10:48.985 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-09-10T19:10:49.238 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-fuse 2024-09-10T19:10:49.832 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:34 ago on Tue 10 Sep 2024 07:09:15 PM UTC. 2024-09-10T19:10:49.971 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-09-10T19:10:49.972 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-10T19:10:49.972 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repository Size 2024-09-10T19:10:49.972 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-10T19:10:49.972 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-09-10T19:10:49.972 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-fuse x86_64 2:19.3.0-4858.gbad1f558.el9 ceph 901 k 2024-09-10T19:10:49.972 INFO:teuthology.orchestra.run.smithi038.stdout:Installing dependencies: 2024-09-10T19:10:49.972 INFO:teuthology.orchestra.run.smithi038.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T19:10:49.972 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:10:49.972 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-09-10T19:10:49.973 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-10T19:10:49.973 INFO:teuthology.orchestra.run.smithi038.stdout:Install 2 Packages 2024-09-10T19:10:49.973 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:10:49.973 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 981 k 2024-09-10T19:10:49.973 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 2.9 M 2024-09-10T19:10:49.973 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-09-10T19:10:50.179 INFO:teuthology.orchestra.run.smithi038.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 538 kB/s | 80 kB 00:00 2024-09-10T19:10:50.321 INFO:teuthology.orchestra.run.smithi038.stdout:(2/2): ceph-fuse-19.3.0-4858.gbad1f558.el9.x86_ 3.0 MB/s | 901 kB 00:00 2024-09-10T19:10:50.321 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-09-10T19:10:50.322 INFO:teuthology.orchestra.run.smithi038.stdout:Total 2.7 MB/s | 981 kB 00:00 2024-09-10T19:10:50.334 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-09-10T19:10:50.356 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-09-10T19:10:50.356 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-09-10T19:10:50.442 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-09-10T19:10:50.443 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-09-10T19:10:50.636 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-09-10T19:10:50.787 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-10T19:10:50.864 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-fuse-2:19.3.0-4858.gbad1f558.el9.x86_64 2/2 2024-09-10T19:10:51.565 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4858.gbad1f558.el9.x86_64 2/2 2024-09-10T19:10:51.566 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-fuse-2:19.3.0-4858.gbad1f558.el9.x86_64 1/2 2024-09-10T19:10:51.829 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-10T19:10:51.829 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:10:51.829 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-09-10T19:10:51.829 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-fuse-2:19.3.0-4858.gbad1f558.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-10T19:10:51.829 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:10:51.830 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-09-10T19:10:52.094 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-volume 2024-09-10T19:10:52.690 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:37 ago on Tue 10 Sep 2024 07:09:15 PM UTC. 2024-09-10T19:10:52.830 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-09-10T19:10:52.830 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-10T19:10:52.830 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repository Size 2024-09-10T19:10:52.831 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-10T19:10:52.831 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-09-10T19:10:52.831 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-volume noarch 2:19.3.0-4858.gbad1f558.el9 ceph-noarch 285 k 2024-09-10T19:10:52.831 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:10:52.831 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-09-10T19:10:52.831 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-10T19:10:52.831 INFO:teuthology.orchestra.run.smithi038.stdout:Install 1 Package 2024-09-10T19:10:52.831 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:10:52.831 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 285 k 2024-09-10T19:10:52.831 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 1.3 M 2024-09-10T19:10:52.831 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-09-10T19:10:53.034 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-volume-19.3.0-4858.gbad1f558.el9.noarch.rp 1.4 MB/s | 285 kB 00:00 2024-09-10T19:10:53.034 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-09-10T19:10:53.035 INFO:teuthology.orchestra.run.smithi038.stdout:Total 1.4 MB/s | 285 kB 00:00 2024-09-10T19:10:53.035 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-09-10T19:10:53.044 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-09-10T19:10:53.044 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-09-10T19:10:53.076 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-09-10T19:10:53.077 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-09-10T19:10:53.336 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-09-10T19:10:53.403 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-volume-2:19.3.0-4858.gbad1f558.el9.noarch 1/1 2024-09-10T19:10:53.420 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-volume-2:19.3.0-4858.gbad1f558.el9.noarch 1/1 2024-09-10T19:10:53.420 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T19:10:53.420 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T19:10:53.420 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:10:54.441 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-volume-2:19.3.0-4858.gbad1f558.el9.noarch 1/1 2024-09-10T19:10:54.441 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:10:54.441 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-09-10T19:10:54.442 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-volume-2:19.3.0-4858.gbad1f558.el9.noarch 2024-09-10T19:10:54.442 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:10:54.442 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-09-10T19:10:54.774 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install librados-devel 2024-09-10T19:10:55.371 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:40 ago on Tue 10 Sep 2024 07:09:15 PM UTC. 2024-09-10T19:10:55.511 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-09-10T19:10:55.511 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-10T19:10:55.512 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repo Size 2024-09-10T19:10:55.512 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-10T19:10:55.512 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-09-10T19:10:55.512 INFO:teuthology.orchestra.run.smithi038.stdout: librados-devel x86_64 2:19.3.0-4858.gbad1f558.el9 ceph 126 k 2024-09-10T19:10:55.512 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:10:55.512 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-09-10T19:10:55.512 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-10T19:10:55.512 INFO:teuthology.orchestra.run.smithi038.stdout:Install 1 Package 2024-09-10T19:10:55.512 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:10:55.512 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 126 k 2024-09-10T19:10:55.513 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 456 k 2024-09-10T19:10:55.513 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-09-10T19:10:55.697 INFO:teuthology.orchestra.run.smithi038.stdout:librados-devel-19.3.0-4858.gbad1f558.el9.x86_64 684 kB/s | 126 kB 00:00 2024-09-10T19:10:55.698 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-09-10T19:10:55.698 INFO:teuthology.orchestra.run.smithi038.stdout:Total 679 kB/s | 126 kB 00:00 2024-09-10T19:10:55.698 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-09-10T19:10:55.704 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-09-10T19:10:55.704 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-09-10T19:10:55.776 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-09-10T19:10:55.776 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-09-10T19:10:55.937 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-09-10T19:10:56.023 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : librados-devel-2:19.3.0-4858.gbad1f558.el9.x86_64 1/1 2024-09-10T19:10:56.465 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librados-devel-2:19.3.0-4858.gbad1f558.el9.x86_64 1/1 2024-09-10T19:10:56.735 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librados-devel-2:19.3.0-4858.gbad1f558.el9.x86_64 1/1 2024-09-10T19:10:56.735 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:10:56.735 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-09-10T19:10:56.735 INFO:teuthology.orchestra.run.smithi038.stdout: librados-devel-2:19.3.0-4858.gbad1f558.el9.x86_64 2024-09-10T19:10:56.736 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:10:56.736 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-09-10T19:10:57.013 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install libcephfs2 2024-09-10T19:10:57.614 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:42 ago on Tue 10 Sep 2024 07:09:15 PM UTC. 2024-09-10T19:10:57.709 INFO:teuthology.orchestra.run.smithi038.stdout:Package libcephfs2-2:19.3.0-4858.gbad1f558.el9.x86_64 is already installed. 2024-09-10T19:10:57.756 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-09-10T19:10:57.757 INFO:teuthology.orchestra.run.smithi038.stdout:Nothing to do. 2024-09-10T19:10:57.757 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-09-10T19:10:57.828 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install libcephfs-devel 2024-09-10T19:10:58.423 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:43 ago on Tue 10 Sep 2024 07:09:15 PM UTC. 2024-09-10T19:10:58.564 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-09-10T19:10:58.565 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-10T19:10:58.565 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repo Size 2024-09-10T19:10:58.565 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-10T19:10:58.565 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-09-10T19:10:58.565 INFO:teuthology.orchestra.run.smithi038.stdout: libcephfs-devel x86_64 2:19.3.0-4858.gbad1f558.el9 ceph 32 k 2024-09-10T19:10:58.565 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:10:58.565 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-09-10T19:10:58.566 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-10T19:10:58.566 INFO:teuthology.orchestra.run.smithi038.stdout:Install 1 Package 2024-09-10T19:10:58.566 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:10:58.566 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 32 k 2024-09-10T19:10:58.566 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 142 k 2024-09-10T19:10:58.566 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-09-10T19:10:58.735 INFO:teuthology.orchestra.run.smithi038.stdout:libcephfs-devel-19.3.0-4858.gbad1f558.el9.x86_6 188 kB/s | 32 kB 00:00 2024-09-10T19:10:58.736 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-09-10T19:10:58.736 INFO:teuthology.orchestra.run.smithi038.stdout:Total 186 kB/s | 32 kB 00:00 2024-09-10T19:10:58.736 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-09-10T19:10:58.739 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-09-10T19:10:58.740 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-09-10T19:10:58.759 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-09-10T19:10:58.759 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-09-10T19:10:58.855 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-09-10T19:10:58.969 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libcephfs-devel-2:19.3.0-4858.gbad1f558.el9.x86_64 1/1 2024-09-10T19:10:59.378 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4858.gbad1f558.el9.x86_64 1/1 2024-09-10T19:10:59.607 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libcephfs-devel-2:19.3.0-4858.gbad1f558.el9.x86_64 1/1 2024-09-10T19:10:59.607 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:10:59.607 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-09-10T19:10:59.607 INFO:teuthology.orchestra.run.smithi038.stdout: libcephfs-devel-2:19.3.0-4858.gbad1f558.el9.x86_64 2024-09-10T19:10:59.607 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:10:59.607 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-09-10T19:10:59.807 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install librados2 2024-09-10T19:11:00.401 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:45 ago on Tue 10 Sep 2024 07:09:15 PM UTC. 2024-09-10T19:11:00.493 INFO:teuthology.orchestra.run.smithi038.stdout:Package librados2-2:19.3.0-4858.gbad1f558.el9.x86_64 is already installed. 2024-09-10T19:11:00.539 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-09-10T19:11:00.540 INFO:teuthology.orchestra.run.smithi038.stdout:Nothing to do. 2024-09-10T19:11:00.540 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-09-10T19:11:00.607 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install librbd1 2024-09-10T19:11:01.200 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:46 ago on Tue 10 Sep 2024 07:09:15 PM UTC. 2024-09-10T19:11:01.292 INFO:teuthology.orchestra.run.smithi038.stdout:Package librbd1-2:19.3.0-4858.gbad1f558.el9.x86_64 is already installed. 2024-09-10T19:11:01.339 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-09-10T19:11:01.340 INFO:teuthology.orchestra.run.smithi038.stdout:Nothing to do. 2024-09-10T19:11:01.340 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-09-10T19:11:01.420 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install python3-rados 2024-09-10T19:11:02.014 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:47 ago on Tue 10 Sep 2024 07:09:15 PM UTC. 2024-09-10T19:11:02.107 INFO:teuthology.orchestra.run.smithi038.stdout:Package python3-rados-2:19.3.0-4858.gbad1f558.el9.x86_64 is already installed. 2024-09-10T19:11:02.156 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-09-10T19:11:02.156 INFO:teuthology.orchestra.run.smithi038.stdout:Nothing to do. 2024-09-10T19:11:02.157 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-09-10T19:11:02.224 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install python3-rgw 2024-09-10T19:11:02.810 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:47 ago on Tue 10 Sep 2024 07:09:15 PM UTC. 2024-09-10T19:11:02.904 INFO:teuthology.orchestra.run.smithi038.stdout:Package python3-rgw-2:19.3.0-4858.gbad1f558.el9.x86_64 is already installed. 2024-09-10T19:11:02.949 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-09-10T19:11:02.951 INFO:teuthology.orchestra.run.smithi038.stdout:Nothing to do. 2024-09-10T19:11:02.951 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-09-10T19:11:03.015 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install python3-cephfs 2024-09-10T19:11:03.603 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:48 ago on Tue 10 Sep 2024 07:09:15 PM UTC. 2024-09-10T19:11:03.696 INFO:teuthology.orchestra.run.smithi038.stdout:Package python3-cephfs-2:19.3.0-4858.gbad1f558.el9.x86_64 is already installed. 2024-09-10T19:11:03.742 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-09-10T19:11:03.743 INFO:teuthology.orchestra.run.smithi038.stdout:Nothing to do. 2024-09-10T19:11:03.743 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-09-10T19:11:03.818 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install python3-rbd 2024-09-10T19:11:04.407 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:49 ago on Tue 10 Sep 2024 07:09:15 PM UTC. 2024-09-10T19:11:04.501 INFO:teuthology.orchestra.run.smithi038.stdout:Package python3-rbd-2:19.3.0-4858.gbad1f558.el9.x86_64 is already installed. 2024-09-10T19:11:04.547 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-09-10T19:11:04.548 INFO:teuthology.orchestra.run.smithi038.stdout:Nothing to do. 2024-09-10T19:11:04.548 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-09-10T19:11:04.619 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install rbd-fuse 2024-09-10T19:11:05.210 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:50 ago on Tue 10 Sep 2024 07:09:15 PM UTC. 2024-09-10T19:11:05.348 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-09-10T19:11:05.348 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-10T19:11:05.349 INFO:teuthology.orchestra.run.smithi038.stdout: Package Architecture Version Repository Size 2024-09-10T19:11:05.349 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-10T19:11:05.349 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-09-10T19:11:05.349 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-fuse x86_64 2:19.3.0-4858.gbad1f558.el9 ceph 85 k 2024-09-10T19:11:05.349 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:11:05.349 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-09-10T19:11:05.349 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-10T19:11:05.349 INFO:teuthology.orchestra.run.smithi038.stdout:Install 1 Package 2024-09-10T19:11:05.349 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:11:05.349 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 85 k 2024-09-10T19:11:05.349 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 231 k 2024-09-10T19:11:05.349 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-09-10T19:11:05.563 INFO:teuthology.orchestra.run.smithi038.stdout:rbd-fuse-19.3.0-4858.gbad1f558.el9.x86_64.rpm 399 kB/s | 85 kB 00:00 2024-09-10T19:11:05.564 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-09-10T19:11:05.564 INFO:teuthology.orchestra.run.smithi038.stdout:Total 396 kB/s | 85 kB 00:00 2024-09-10T19:11:05.564 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-09-10T19:11:05.572 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-09-10T19:11:05.572 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-09-10T19:11:05.640 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-09-10T19:11:05.640 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-09-10T19:11:05.795 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-09-10T19:11:05.897 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : rbd-fuse-2:19.3.0-4858.gbad1f558.el9.x86_64 1/1 2024-09-10T19:11:06.265 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4858.gbad1f558.el9.x86_64 1/1 2024-09-10T19:11:06.531 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : rbd-fuse-2:19.3.0-4858.gbad1f558.el9.x86_64 1/1 2024-09-10T19:11:06.532 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:11:06.532 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-09-10T19:11:06.532 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-fuse-2:19.3.0-4858.gbad1f558.el9.x86_64 2024-09-10T19:11:06.532 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:11:06.532 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-09-10T19:11:06.818 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install rbd-mirror 2024-09-10T19:11:07.427 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:52 ago on Tue 10 Sep 2024 07:09:15 PM UTC. 2024-09-10T19:11:07.566 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-09-10T19:11:07.567 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-10T19:11:07.567 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repo Size 2024-09-10T19:11:07.567 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-10T19:11:07.567 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-09-10T19:11:07.567 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-mirror x86_64 2:19.3.0-4858.gbad1f558.el9 ceph 3.2 M 2024-09-10T19:11:07.567 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:11:07.567 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-09-10T19:11:07.568 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-10T19:11:07.568 INFO:teuthology.orchestra.run.smithi038.stdout:Install 1 Package 2024-09-10T19:11:07.568 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:11:07.568 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 3.2 M 2024-09-10T19:11:07.568 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 14 M 2024-09-10T19:11:07.568 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-09-10T19:11:07.908 INFO:teuthology.orchestra.run.smithi038.stdout:rbd-mirror-19.3.0-4858.gbad1f558.el9.x86_64.rpm 9.4 MB/s | 3.2 MB 00:00 2024-09-10T19:11:07.908 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-09-10T19:11:07.909 INFO:teuthology.orchestra.run.smithi038.stdout:Total 9.3 MB/s | 3.2 MB 00:00 2024-09-10T19:11:07.909 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-09-10T19:11:07.919 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-09-10T19:11:07.919 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-09-10T19:11:08.012 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-09-10T19:11:08.013 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-09-10T19:11:08.480 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-09-10T19:11:08.542 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : rbd-mirror-2:19.3.0-4858.gbad1f558.el9.x86_64 1/1 2024-09-10T19:11:08.568 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4858.gbad1f558.el9.x86_64 1/1 2024-09-10T19:11:08.568 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T19:11:08.568 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T19:11:08.569 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T19:11:08.569 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T19:11:08.569 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:11:09.740 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : rbd-mirror-2:19.3.0-4858.gbad1f558.el9.x86_64 1/1 2024-09-10T19:11:09.741 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:11:09.741 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-09-10T19:11:09.741 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-mirror-2:19.3.0-4858.gbad1f558.el9.x86_64 2024-09-10T19:11:09.741 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:11:09.741 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-09-10T19:11:10.002 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install rbd-nbd 2024-09-10T19:11:10.602 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:55 ago on Tue 10 Sep 2024 07:09:15 PM UTC. 2024-09-10T19:11:10.742 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-09-10T19:11:10.743 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-10T19:11:10.743 INFO:teuthology.orchestra.run.smithi038.stdout: Package Architecture Version Repository Size 2024-09-10T19:11:10.743 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-10T19:11:10.743 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-09-10T19:11:10.743 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-nbd x86_64 2:19.3.0-4858.gbad1f558.el9 ceph 170 k 2024-09-10T19:11:10.743 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:11:10.743 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-09-10T19:11:10.743 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-10T19:11:10.743 INFO:teuthology.orchestra.run.smithi038.stdout:Install 1 Package 2024-09-10T19:11:10.743 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:11:10.743 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 170 k 2024-09-10T19:11:10.744 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 490 k 2024-09-10T19:11:10.744 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-09-10T19:11:10.962 INFO:teuthology.orchestra.run.smithi038.stdout:rbd-nbd-19.3.0-4858.gbad1f558.el9.x86_64.rpm 782 kB/s | 170 kB 00:00 2024-09-10T19:11:10.962 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-09-10T19:11:10.962 INFO:teuthology.orchestra.run.smithi038.stdout:Total 777 kB/s | 170 kB 00:00 2024-09-10T19:11:10.963 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-09-10T19:11:10.971 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-09-10T19:11:10.971 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-09-10T19:11:11.040 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-09-10T19:11:11.040 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-09-10T19:11:11.197 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-09-10T19:11:11.305 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : rbd-nbd-2:19.3.0-4858.gbad1f558.el9.x86_64 1/1 2024-09-10T19:11:11.746 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4858.gbad1f558.el9.x86_64 1/1 2024-09-10T19:11:12.023 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : rbd-nbd-2:19.3.0-4858.gbad1f558.el9.x86_64 1/1 2024-09-10T19:11:12.023 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:11:12.023 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-09-10T19:11:12.023 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-nbd-2:19.3.0-4858.gbad1f558.el9.x86_64 2024-09-10T19:11:12.024 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T19:11:12.024 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-09-10T19:11:12.250 DEBUG:teuthology.parallel:result is None 2024-09-10T19:11:12.251 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bad1f558c327094897e4a32e99dd5cb4ae6ccd46 2024-09-10T19:11:12.398 DEBUG:teuthology.orchestra.run.smithi038:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T19:11:12.420 INFO:teuthology.orchestra.run.smithi038.stdout:19.3.0-4858.gbad1f558.el9 2024-09-10T19:11:12.421 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4858.gbad1f558.el9 2024-09-10T19:11:12.421 INFO:teuthology.task.install:The correct ceph version 19.3.0-4858.gbad1f558 is installed. 2024-09-10T19:11:12.423 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-10T19:11:12.423 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-10T19:11:12.423 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T19:11:12.489 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-10T19:11:12.489 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-10T19:11:12.489 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T19:11:12.555 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T19:11:12.620 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-10T19:11:12.620 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-10T19:11:12.620 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T19:11:12.685 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T19:11:12.751 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-10T19:11:12.751 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-10T19:11:12.751 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T19:11:12.817 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T19:11:12.884 INFO:teuthology.run_tasks:Running task workunit... 2024-09-10T19:11:12.907 INFO:tasks.workunit:Pulling workunits from ref bad1f558c327094897e4a32e99dd5cb4ae6ccd46 2024-09-10T19:11:12.908 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-10T19:11:12.908 INFO:tasks.workunit:timeout=3h 2024-09-10T19:11:12.908 INFO:tasks.workunit:cleanup=True 2024-09-10T19:11:12.909 DEBUG:teuthology.orchestra.run.smithi038:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-10T19:11:12.939 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T19:11:12.939 INFO:teuthology.orchestra.run.smithi038.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-10T19:11:12.940 DEBUG:teuthology.orchestra.run.smithi038:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-10T19:11:12.995 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-10T19:11:12.995 DEBUG:teuthology.orchestra.run.smithi038:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-10T19:11:13.051 DEBUG:teuthology.orchestra.run.smithi038:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bad1f558c327094897e4a32e99dd5cb4ae6ccd46 2024-09-10T19:11:13.108 INFO:tasks.workunit.client.0.smithi038.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-10T19:12:03.279 INFO:tasks.workunit.client.0.smithi038.stderr:Updating files: 98% (11947/12088) Updating files: 99% (11968/12088) Updating files: 100% (12088/12088) Updating files: 100% (12088/12088), done. 2024-09-10T19:12:04.035 INFO:tasks.workunit.client.0.smithi038.stderr:Note: switching to 'bad1f558c327094897e4a32e99dd5cb4ae6ccd46'. 2024-09-10T19:12:04.035 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-10T19:12:04.035 INFO:tasks.workunit.client.0.smithi038.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-10T19:12:04.035 INFO:tasks.workunit.client.0.smithi038.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-10T19:12:04.035 INFO:tasks.workunit.client.0.smithi038.stderr:state without impacting any branches by switching back to a branch. 2024-09-10T19:12:04.035 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-10T19:12:04.035 INFO:tasks.workunit.client.0.smithi038.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-10T19:12:04.035 INFO:tasks.workunit.client.0.smithi038.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-10T19:12:04.035 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-10T19:12:04.036 INFO:tasks.workunit.client.0.smithi038.stderr: git switch -c 2024-09-10T19:12:04.036 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-10T19:12:04.036 INFO:tasks.workunit.client.0.smithi038.stderr:Or undo this operation with: 2024-09-10T19:12:04.036 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-10T19:12:04.036 INFO:tasks.workunit.client.0.smithi038.stderr: git switch - 2024-09-10T19:12:04.036 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-10T19:12:04.036 INFO:tasks.workunit.client.0.smithi038.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-10T19:12:04.036 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-10T19:12:04.036 INFO:tasks.workunit.client.0.smithi038.stderr:HEAD is now at bad1f558c32 Merge branch 'wip-ifed-bluestore-tool-really-really' of https://github.com/ifed01/ceph into wip-bharath7-testing-2024-09-10-1409 2024-09-10T19:12:04.040 DEBUG:teuthology.orchestra.run.smithi038:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/standalone && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-10T19:12:04.096 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-10T19:12:04.096 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-10T19:12:04.152 INFO:tasks.workunit:Running workunits matching mon on client.0... 2024-09-10T19:12:04.153 INFO:tasks.workunit:Running workunit mon/health-mute.sh... 2024-09-10T19:12:04.153 DEBUG:teuthology.orchestra.run.smithi038:workunit test mon/health-mute.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad1f558c327094897e4a32e99dd5cb4ae6ccd46 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh 2024-09-10T19:12:04.225 INFO:tasks.workunit.client.0.smithi038.stderr:stty: 'standard input': Inappropriate ioctl for device 2024-09-10T19:12:04.231 INFO:tasks.workunit.client.0.smithi038.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2024-09-10T19:12:04.231 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2315: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-10T19:12:04.231 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2315: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-10T19:12:04.231 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2316: main: export PYTHONWARNINGS=ignore 2024-09-10T19:12:04.231 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2316: main: PYTHONWARNINGS=ignore 2024-09-10T19:12:04.231 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2317: main: export CEPH_CONF=/dev/null 2024-09-10T19:12:04.231 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2317: main: CEPH_CONF=/dev/null 2024-09-10T19:12:04.231 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2318: main: unset CEPH_ARGS 2024-09-10T19:12:04.232 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2320: main: local code 2024-09-10T19:12:04.232 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2321: main: run td/health-mute 2024-09-10T19:12:04.232 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:6: run: local dir=td/health-mute 2024-09-10T19:12:04.232 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:7: run: shift 2024-09-10T19:12:04.232 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:9: run: export CEPH_MON=127.0.0.1:7143 2024-09-10T19:12:04.232 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:9: run: CEPH_MON=127.0.0.1:7143 2024-09-10T19:12:04.232 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:10: run: export CEPH_ARGS 2024-09-10T19:12:04.232 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:11: run: uuidgen 2024-09-10T19:12:04.241 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:11: run: CEPH_ARGS+='--fsid=2277e988-dfa0-4c6f-811d-ff8d20dca830 --auth-supported=none --mon-pg-warn-min-per-osd 0 --mon-max-pg-per-osd 1000 ' 2024-09-10T19:12:04.241 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:12: run: CEPH_ARGS+='--mon-host=127.0.0.1:7143 ' 2024-09-10T19:12:04.241 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:14: run: set 2024-09-10T19:12:04.241 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:14: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2024-09-10T19:12:04.244 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:14: run: local funcs=TEST_mute 2024-09-10T19:12:04.244 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:15: run: for func in $funcs 2024-09-10T19:12:04.244 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:16: run: setup td/health-mute 2024-09-10T19:12:04.244 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/health-mute 2024-09-10T19:12:04.244 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/health-mute 2024-09-10T19:12:04.244 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/health-mute 2024-09-10T19:12:04.244 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-10T19:12:04.244 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/health-mute KILL 2024-09-10T19:12:04.244 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-10T19:12:04.244 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-10T19:12:04.244 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-10T19:12:04.245 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-10T19:12:04.245 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-10T19:12:04.245 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-10T19:12:04.245 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-10T19:12:04.246 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-10T19:12:04.246 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-10T19:12:04.247 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-10T19:12:04.247 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-10T19:12:04.247 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-10T19:12:04.248 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T19:12:04.248 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-10T19:12:04.248 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-10T19:12:04.248 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T19:12:04.249 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-10T19:12:04.250 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-10T19:12:04.250 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/health-mute 2024-09-10T19:12:04.251 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-10T19:12:04.251 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:12:04.251 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.27297 2024-09-10T19:12:04.251 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.27297 2024-09-10T19:12:04.252 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-10T19:12:04.252 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-10T19:12:04.252 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/health-mute 2024-09-10T19:12:04.253 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-10T19:12:04.253 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:12:04.254 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.27297 2024-09-10T19:12:04.254 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.27297 2024-09-10T19:12:04.256 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-10T19:12:04.256 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2024-09-10T19:12:04.256 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2024-09-10T19:12:04.256 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-10T19:12:04.256 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/health-mute 1' TERM HUP INT 2024-09-10T19:12:04.257 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:17: run: TEST_mute td/health-mute 2024-09-10T19:12:04.257 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:23: TEST_mute: local dir=td/health-mute 2024-09-10T19:12:04.257 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:24: TEST_mute: setup td/health-mute 2024-09-10T19:12:04.257 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/health-mute 2024-09-10T19:12:04.257 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/health-mute 2024-09-10T19:12:04.257 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/health-mute 2024-09-10T19:12:04.257 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-10T19:12:04.257 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/health-mute KILL 2024-09-10T19:12:04.257 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-10T19:12:04.257 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-10T19:12:04.257 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-10T19:12:04.257 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-10T19:12:04.257 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-10T19:12:04.258 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-10T19:12:04.258 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-10T19:12:04.258 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-10T19:12:04.258 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-10T19:12:04.259 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-10T19:12:04.259 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-10T19:12:04.259 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-10T19:12:04.260 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T19:12:04.260 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-10T19:12:04.261 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-10T19:12:04.261 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T19:12:04.261 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-10T19:12:04.262 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-10T19:12:04.262 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/health-mute 2024-09-10T19:12:04.263 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-10T19:12:04.264 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:12:04.264 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.27297 2024-09-10T19:12:04.264 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.27297 2024-09-10T19:12:04.264 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-10T19:12:04.264 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-10T19:12:04.265 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/health-mute 2024-09-10T19:12:04.266 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-10T19:12:04.266 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:12:04.266 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.27297 2024-09-10T19:12:04.266 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.27297 2024-09-10T19:12:04.268 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-10T19:12:04.268 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-10T19:12:04.268 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-10T19:12:04.268 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/health-mute 1' TERM HUP INT 2024-09-10T19:12:04.268 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:26: TEST_mute: set -o pipefail 2024-09-10T19:12:04.268 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:28: TEST_mute: run_mon td/health-mute a 2024-09-10T19:12:04.268 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/health-mute 2024-09-10T19:12:04.268 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-10T19:12:04.268 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-10T19:12:04.269 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-10T19:12:04.269 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/health-mute/a 2024-09-10T19:12:04.269 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/health-mute/a --run-dir=td/health-mute 2024-09-10T19:12:04.800 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-10T19:12:04.800 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-10T19:12:04.800 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-10T19:12:04.800 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-10T19:12:04.801 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:12:04.801 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.27297 2024-09-10T19:12:04.801 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.27297/$cluster-$name.asok' 2024-09-10T19:12:04.801 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/health-mute/a '--log-file=td/health-mute/$name.log' '--admin-socket=/tmp/ceph-asok.27297/$cluster-$name.asok' --mon-cluster-log-file=td/health-mute/log --run-dir=td/health-mute '--pid-file=td/health-mute/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-10T19:12:05.001 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-10T19:12:05.002 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-10T19:12:05.003 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-10T19:12:05.003 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-10T19:12:05.003 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-10T19:12:05.003 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-10T19:12:05.003 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-10T19:12:05.003 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-10T19:12:05.003 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-10T19:12:05.004 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-10T19:12:05.004 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:12:05.004 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.27297 2024-09-10T19:12:05.004 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.27297/ceph-mon.a.asok 2024-09-10T19:12:05.004 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-10T19:12:05.004 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.27297/ceph-mon.a.asok config get fsid 2024-09-10T19:12:05.094 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-10T19:12:05.094 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-10T19:12:05.094 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-10T19:12:05.094 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-10T19:12:05.094 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-10T19:12:05.094 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-10T19:12:05.094 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-10T19:12:05.095 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-10T19:12:05.095 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-10T19:12:05.095 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:12:05.095 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.27297 2024-09-10T19:12:05.095 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.27297/ceph-mon.a.asok 2024-09-10T19:12:05.095 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-10T19:12:05.095 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.27297/ceph-mon.a.asok config get mon_host 2024-09-10T19:12:05.176 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:29: TEST_mute: run_mgr td/health-mute x 2024-09-10T19:12:05.176 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/health-mute 2024-09-10T19:12:05.176 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2024-09-10T19:12:05.176 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2024-09-10T19:12:05.176 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2024-09-10T19:12:05.176 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/health-mute/x 2024-09-10T19:12:05.176 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2024-09-10T19:12:06.033 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2024-09-10T19:12:06.033 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-10T19:12:06.033 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-10T19:12:06.033 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-10T19:12:06.034 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:12:06.034 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.27297 2024-09-10T19:12:06.034 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.27297/$cluster-$name.asok' 2024-09-10T19:12:06.034 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-10T19:12:06.034 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/health-mute/x '--log-file=td/health-mute/$name.log' '--admin-socket=/tmp/ceph-asok.27297/$cluster-$name.asok' --run-dir=td/health-mute '--pid-file=td/health-mute/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-10T19:12:06.065 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:30: TEST_mute: run_osd td/health-mute 0 2024-09-10T19:12:06.065 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/health-mute 2024-09-10T19:12:06.065 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-10T19:12:06.066 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2024-09-10T19:12:06.066 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-10T19:12:06.066 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/health-mute/0 2024-09-10T19:12:06.066 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=2277e988-dfa0-4c6f-811d-ff8d20dca830 --auth-supported=none --mon-pg-warn-min-per-osd 0 --mon-max-pg-per-osd 1000 --mon-host=127.0.0.1:7143 ' 2024-09-10T19:12:06.066 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-10T19:12:06.066 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-10T19:12:06.066 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-10T19:12:06.066 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/health-mute/0' 2024-09-10T19:12:06.066 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/health-mute/0/journal' 2024-09-10T19:12:06.066 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-10T19:12:06.066 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-10T19:12:06.067 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/health-mute' 2024-09-10T19:12:06.067 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-10T19:12:06.067 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-10T19:12:06.067 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-10T19:12:06.067 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-10T19:12:06.067 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:12:06.067 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.27297 2024-09-10T19:12:06.067 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.27297/$cluster-$name.asok' 2024-09-10T19:12:06.067 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.27297/$cluster-$name.asok' 2024-09-10T19:12:06.067 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-10T19:12:06.067 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-10T19:12:06.067 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-10T19:12:06.067 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/health-mute/$name.log' 2024-09-10T19:12:06.067 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/health-mute/$name.pid' 2024-09-10T19:12:06.067 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-10T19:12:06.068 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-10T19:12:06.068 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-10T19:12:06.068 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-10T19:12:06.068 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-10T19:12:06.068 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-10T19:12:06.068 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/health-mute/0 2024-09-10T19:12:06.068 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-10T19:12:06.068 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=63708371-60fe-461f-b938-76298ac26a79 2024-09-10T19:12:06.069 INFO:tasks.workunit.client.0.smithi038.stdout:add osd0 63708371-60fe-461f-b938-76298ac26a79 2024-09-10T19:12:06.069 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 63708371-60fe-461f-b938-76298ac26a79' 2024-09-10T19:12:06.069 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-10T19:12:06.086 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAGmuBmSiwHBRAALPKxgLbPt3cHVVnRs4PjOw== 2024-09-10T19:12:06.086 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAGmuBmSiwHBRAALPKxgLbPt3cHVVnRs4PjOw=="}' 2024-09-10T19:12:06.086 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 63708371-60fe-461f-b938-76298ac26a79 -i td/health-mute/0/new.json 2024-09-10T19:12:06.369 INFO:tasks.workunit.client.0.smithi038.stdout:0 2024-09-10T19:12:06.378 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/health-mute/0/new.json 2024-09-10T19:12:06.379 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=2277e988-dfa0-4c6f-811d-ff8d20dca830 --auth-supported=none --mon-pg-warn-min-per-osd 0 --mon-max-pg-per-osd 1000 --mon-host=127.0.0.1:7143 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/health-mute/0 --osd-journal=td/health-mute/0/journal --chdir= --run-dir=td/health-mute '--admin-socket=/tmp/ceph-asok.27297/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/health-mute/$name.log' '--pid-file=td/health-mute/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAGmuBmSiwHBRAALPKxgLbPt3cHVVnRs4PjOw== --osd-uuid 63708371-60fe-461f-b938-76298ac26a79 2024-09-10T19:12:06.443 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:12:06.442+0000 7f7297a64640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-10T19:12:06.446 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:12:06.444+0000 7f7297a64640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-10T19:12:06.447 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:12:06.445+0000 7f7297a64640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-10T19:12:06.447 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:12:06.446+0000 7f7297a64640 -1 bdev(0x563d609c7c00 td/health-mute/0/block) open stat got: (1) Operation not permitted 2024-09-10T19:12:06.447 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:12:06.446+0000 7f7297a64640 -1 bluestore(td/health-mute/0) _read_fsid unparsable uuid 2024-09-10T19:12:12.368 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/health-mute/0/keyring 2024-09-10T19:12:12.368 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-10T19:12:12.369 INFO:tasks.workunit.client.0.smithi038.stdout:adding osd0 key to auth repository 2024-09-10T19:12:12.369 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2024-09-10T19:12:12.369 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/health-mute/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-10T19:12:12.939 INFO:tasks.workunit.client.0.smithi038.stdout:start osd.0 2024-09-10T19:12:12.939 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2024-09-10T19:12:12.939 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=2277e988-dfa0-4c6f-811d-ff8d20dca830 --auth-supported=none --mon-pg-warn-min-per-osd 0 --mon-max-pg-per-osd 1000 --mon-host=127.0.0.1:7143 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/health-mute/0 --osd-journal=td/health-mute/0/journal --chdir= --run-dir=td/health-mute '--admin-socket=/tmp/ceph-asok.27297/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/health-mute/$name.log' '--pid-file=td/health-mute/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-10T19:12:12.940 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-10T19:12:12.940 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-10T19:12:12.940 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-10T19:12:12.967 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:12:12.966+0000 7f3bc7a1a640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-10T19:12:12.969 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:12:12.968+0000 7f3bc7a1a640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-10T19:12:12.970 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:12:12.969+0000 7f3bc7a1a640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-10T19:12:13.380 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2024-09-10T19:12:13.380 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-10T19:12:13.380 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2024-09-10T19:12:13.380 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-10T19:12:13.380 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-10T19:12:13.380 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:12:13.380 INFO:tasks.workunit.client.0.smithi038.stdout:0 2024-09-10T19:12:13.381 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-10T19:12:13.381 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:12:13.381 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-10T19:12:13.814 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:12:14.551 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:12:14.549+0000 7f3bc7a1a640 -1 Falling back to public interface 2024-09-10T19:12:14.815 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:12:14.816 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:12:14.816 INFO:tasks.workunit.client.0.smithi038.stdout:1 2024-09-10T19:12:14.816 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-10T19:12:14.816 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:12:14.817 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-10T19:12:15.257 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:12:16.146 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:12:16.144+0000 7f3bc7a1a640 -1 osd.0 0 log_to_monitors true 2024-09-10T19:12:16.258 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:12:16.259 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:12:16.259 INFO:tasks.workunit.client.0.smithi038.stdout:2 2024-09-10T19:12:16.259 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-10T19:12:16.259 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:12:16.260 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-10T19:12:16.772 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:12:17.773 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:12:17.774 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:12:17.774 INFO:tasks.workunit.client.0.smithi038.stdout:3 2024-09-10T19:12:17.774 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-10T19:12:17.774 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:12:17.775 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-10T19:12:18.200 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:12:19.201 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:12:19.202 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:12:19.202 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-10T19:12:19.202 INFO:tasks.workunit.client.0.smithi038.stdout:4 2024-09-10T19:12:19.202 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:12:19.202 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-10T19:12:19.649 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:12:20.651 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:12:20.651 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:12:20.651 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-10T19:12:20.651 INFO:tasks.workunit.client.0.smithi038.stdout:5 2024-09-10T19:12:20.652 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:12:20.652 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-10T19:12:21.066 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:12:22.067 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:12:22.068 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:12:22.068 INFO:tasks.workunit.client.0.smithi038.stdout:6 2024-09-10T19:12:22.068 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-10T19:12:22.069 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:12:22.069 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-10T19:12:22.495 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:12:23.496 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:12:23.496 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:12:23.496 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-10T19:12:23.496 INFO:tasks.workunit.client.0.smithi038.stdout:7 2024-09-10T19:12:23.497 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:12:23.497 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-10T19:12:23.919 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:12:24.920 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:12:24.920 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:12:24.921 INFO:tasks.workunit.client.0.smithi038.stdout:8 2024-09-10T19:12:24.921 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-10T19:12:24.921 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:12:24.921 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-10T19:12:25.339 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:12:26.341 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:12:26.341 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:12:26.341 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-10T19:12:26.341 INFO:tasks.workunit.client.0.smithi038.stdout:9 2024-09-10T19:12:26.342 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:12:26.342 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-10T19:12:26.914 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:12:27.915 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:12:27.915 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:12:27.916 INFO:tasks.workunit.client.0.smithi038.stdout:10 2024-09-10T19:12:27.916 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-10T19:12:27.916 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:12:27.916 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-10T19:12:28.717 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:12:29.719 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:12:29.719 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:12:29.719 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-10T19:12:29.719 INFO:tasks.workunit.client.0.smithi038.stdout:11 2024-09-10T19:12:29.720 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:12:29.720 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-10T19:12:30.242 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:12:31.244 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:12:31.244 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:12:31.244 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-10T19:12:31.244 INFO:tasks.workunit.client.0.smithi038.stdout:12 2024-09-10T19:12:31.245 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:12:31.245 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-10T19:12:31.839 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:12:32.841 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:12:32.841 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:12:32.841 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-10T19:12:32.841 INFO:tasks.workunit.client.0.smithi038.stdout:13 2024-09-10T19:12:32.842 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:12:32.842 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-10T19:12:33.367 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:12:34.368 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:12:34.368 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:12:34.369 INFO:tasks.workunit.client.0.smithi038.stdout:14 2024-09-10T19:12:34.369 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-10T19:12:34.369 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:12:34.369 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-10T19:12:35.173 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:12:36.175 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:12:36.175 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:12:36.175 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-10T19:12:36.175 INFO:tasks.workunit.client.0.smithi038.stdout:15 2024-09-10T19:12:36.175 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:12:36.175 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-10T19:12:36.958 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:12:37.959 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:12:37.960 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:12:37.960 INFO:tasks.workunit.client.0.smithi038.stdout:16 2024-09-10T19:12:37.960 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-10T19:12:37.960 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:12:37.960 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-10T19:12:38.771 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:12:39.772 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:12:39.773 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:12:39.773 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-10T19:12:39.773 INFO:tasks.workunit.client.0.smithi038.stdout:17 2024-09-10T19:12:39.773 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:12:39.774 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-10T19:12:40.541 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:12:41.542 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:12:41.542 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:12:41.543 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 18 2024-09-10T19:12:41.543 INFO:tasks.workunit.client.0.smithi038.stdout:18 2024-09-10T19:12:41.543 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:12:41.543 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-10T19:12:41.997 INFO:tasks.workunit.client.0.smithi038.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/3151026257,v1:127.0.0.1:6803/3151026257] [v2:127.0.0.1:6804/3151026257,v1:127.0.0.1:6805/3151026257] exists,up 63708371-60fe-461f-b938-76298ac26a79 2024-09-10T19:12:42.001 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-10T19:12:42.001 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-10T19:12:42.001 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-10T19:12:42.002 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:31: TEST_mute: run_osd td/health-mute 1 2024-09-10T19:12:42.002 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/health-mute 2024-09-10T19:12:42.002 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-10T19:12:42.002 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2024-09-10T19:12:42.002 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-10T19:12:42.002 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/health-mute/1 2024-09-10T19:12:42.002 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=2277e988-dfa0-4c6f-811d-ff8d20dca830 --auth-supported=none --mon-pg-warn-min-per-osd 0 --mon-max-pg-per-osd 1000 --mon-host=127.0.0.1:7143 ' 2024-09-10T19:12:42.002 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-10T19:12:42.002 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-10T19:12:42.002 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-10T19:12:42.002 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/health-mute/1' 2024-09-10T19:12:42.002 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/health-mute/1/journal' 2024-09-10T19:12:42.002 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-10T19:12:42.003 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-10T19:12:42.003 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/health-mute' 2024-09-10T19:12:42.003 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-10T19:12:42.003 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-10T19:12:42.003 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-10T19:12:42.003 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-10T19:12:42.003 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:12:42.003 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.27297 2024-09-10T19:12:42.003 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.27297/$cluster-$name.asok' 2024-09-10T19:12:42.003 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.27297/$cluster-$name.asok' 2024-09-10T19:12:42.003 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-10T19:12:42.003 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-10T19:12:42.004 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-10T19:12:42.004 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/health-mute/$name.log' 2024-09-10T19:12:42.004 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/health-mute/$name.pid' 2024-09-10T19:12:42.004 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-10T19:12:42.004 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-10T19:12:42.004 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-10T19:12:42.004 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-10T19:12:42.004 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-10T19:12:42.005 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-10T19:12:42.005 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/health-mute/1 2024-09-10T19:12:42.005 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-10T19:12:42.005 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=78051085-0402-4da6-96e3-c9728f3404d6 2024-09-10T19:12:42.005 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 78051085-0402-4da6-96e3-c9728f3404d6' 2024-09-10T19:12:42.005 INFO:tasks.workunit.client.0.smithi038.stdout:add osd1 78051085-0402-4da6-96e3-c9728f3404d6 2024-09-10T19:12:42.005 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-10T19:12:42.020 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAqmuBmnVwfARAA+ZbOwofKpPJxOJC1wYT8Ag== 2024-09-10T19:12:42.020 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAqmuBmnVwfARAA+ZbOwofKpPJxOJC1wYT8Ag=="}' 2024-09-10T19:12:42.020 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 78051085-0402-4da6-96e3-c9728f3404d6 -i td/health-mute/1/new.json 2024-09-10T19:12:42.536 INFO:tasks.workunit.client.0.smithi038.stdout:1 2024-09-10T19:12:42.547 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/health-mute/1/new.json 2024-09-10T19:12:42.548 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=2277e988-dfa0-4c6f-811d-ff8d20dca830 --auth-supported=none --mon-pg-warn-min-per-osd 0 --mon-max-pg-per-osd 1000 --mon-host=127.0.0.1:7143 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/health-mute/1 --osd-journal=td/health-mute/1/journal --chdir= --run-dir=td/health-mute '--admin-socket=/tmp/ceph-asok.27297/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/health-mute/$name.log' '--pid-file=td/health-mute/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAqmuBmnVwfARAA+ZbOwofKpPJxOJC1wYT8Ag== --osd-uuid 78051085-0402-4da6-96e3-c9728f3404d6 2024-09-10T19:12:42.579 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:12:42.578+0000 7f8e41c0b640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-10T19:12:42.582 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:12:42.580+0000 7f8e41c0b640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-10T19:12:42.583 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:12:42.581+0000 7f8e41c0b640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-10T19:12:42.583 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:12:42.582+0000 7f8e41c0b640 -1 bdev(0x55a068a95c00 td/health-mute/1/block) open stat got: (1) Operation not permitted 2024-09-10T19:12:42.583 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:12:42.582+0000 7f8e41c0b640 -1 bluestore(td/health-mute/1) _read_fsid unparsable uuid 2024-09-10T19:12:48.021 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/health-mute/1/keyring 2024-09-10T19:12:48.021 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-10T19:12:48.022 INFO:tasks.workunit.client.0.smithi038.stdout:adding osd1 key to auth repository 2024-09-10T19:12:48.022 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2024-09-10T19:12:48.023 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/health-mute/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-10T19:12:48.584 INFO:tasks.workunit.client.0.smithi038.stdout:start osd.1 2024-09-10T19:12:48.585 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2024-09-10T19:12:48.585 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=2277e988-dfa0-4c6f-811d-ff8d20dca830 --auth-supported=none --mon-pg-warn-min-per-osd 0 --mon-max-pg-per-osd 1000 --mon-host=127.0.0.1:7143 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/health-mute/1 --osd-journal=td/health-mute/1/journal --chdir= --run-dir=td/health-mute '--admin-socket=/tmp/ceph-asok.27297/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/health-mute/$name.log' '--pid-file=td/health-mute/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-10T19:12:48.585 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-10T19:12:48.585 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-10T19:12:48.585 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-10T19:12:48.613 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:12:48.611+0000 7fccea1b2640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-10T19:12:48.614 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:12:48.613+0000 7fccea1b2640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-10T19:12:48.616 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:12:48.614+0000 7fccea1b2640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-10T19:12:49.032 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2024-09-10T19:12:49.033 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-10T19:12:49.033 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2024-09-10T19:12:49.033 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-10T19:12:49.033 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-10T19:12:49.033 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:12:49.033 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-10T19:12:49.033 INFO:tasks.workunit.client.0.smithi038.stdout:0 2024-09-10T19:12:49.034 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:12:49.034 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-10T19:12:49.449 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:12:50.202 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:12:50.200+0000 7fccea1b2640 -1 Falling back to public interface 2024-09-10T19:12:50.451 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:12:50.451 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:12:50.452 INFO:tasks.workunit.client.0.smithi038.stdout:1 2024-09-10T19:12:50.452 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-10T19:12:50.452 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:12:50.452 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-10T19:12:50.902 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:12:51.903 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:12:51.903 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:12:51.903 INFO:tasks.workunit.client.0.smithi038.stdout:2 2024-09-10T19:12:51.904 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-10T19:12:51.904 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:12:51.904 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-10T19:12:52.071 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:12:52.069+0000 7fccea1b2640 -1 osd.1 0 log_to_monitors true 2024-09-10T19:12:52.380 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:12:53.382 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:12:53.382 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:12:53.382 INFO:tasks.workunit.client.0.smithi038.stdout:3 2024-09-10T19:12:53.383 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-10T19:12:53.383 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:12:53.383 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-10T19:12:53.800 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:12:54.801 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:12:54.801 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:12:54.802 INFO:tasks.workunit.client.0.smithi038.stdout:4 2024-09-10T19:12:54.802 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-10T19:12:54.802 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:12:54.802 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-10T19:12:55.303 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:12:56.304 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:12:56.304 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:12:56.305 INFO:tasks.workunit.client.0.smithi038.stdout:5 2024-09-10T19:12:56.305 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-10T19:12:56.305 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:12:56.305 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-10T19:12:56.824 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:12:57.825 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:12:57.825 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:12:57.825 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-10T19:12:57.825 INFO:tasks.workunit.client.0.smithi038.stdout:6 2024-09-10T19:12:57.826 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:12:57.826 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-10T19:12:58.363 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:12:59.364 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:12:59.364 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:12:59.365 INFO:tasks.workunit.client.0.smithi038.stdout:7 2024-09-10T19:12:59.365 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-10T19:12:59.365 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:12:59.365 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-10T19:12:59.781 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:13:00.782 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:13:00.782 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:13:00.782 INFO:tasks.workunit.client.0.smithi038.stdout:8 2024-09-10T19:13:00.783 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-10T19:13:00.783 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:13:00.783 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-10T19:13:01.262 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:13:02.264 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:13:02.264 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:13:02.264 INFO:tasks.workunit.client.0.smithi038.stdout:9 2024-09-10T19:13:02.265 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-10T19:13:02.265 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:13:02.265 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-10T19:13:02.753 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:13:03.754 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:13:03.754 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:13:03.754 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-10T19:13:03.756 INFO:tasks.workunit.client.0.smithi038.stdout:10 2024-09-10T19:13:03.756 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:13:03.756 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-10T19:13:04.192 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:13:05.194 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:13:05.194 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:13:05.194 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-10T19:13:05.194 INFO:tasks.workunit.client.0.smithi038.stdout:11 2024-09-10T19:13:05.194 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:13:05.195 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-10T19:13:05.905 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:13:06.907 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:13:06.907 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:13:06.907 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-10T19:13:06.907 INFO:tasks.workunit.client.0.smithi038.stdout:12 2024-09-10T19:13:06.907 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:13:06.908 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-10T19:13:07.658 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:13:08.659 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:13:08.660 INFO:tasks.workunit.client.0.smithi038.stdout:13 2024-09-10T19:13:08.660 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:13:08.660 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-10T19:13:08.661 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:13:08.661 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-10T19:13:09.822 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:13:10.823 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:13:10.824 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:13:10.824 INFO:tasks.workunit.client.0.smithi038.stdout:14 2024-09-10T19:13:10.824 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-10T19:13:10.824 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:13:10.825 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-10T19:13:11.534 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:13:12.535 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:13:12.536 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:13:12.536 INFO:tasks.workunit.client.0.smithi038.stdout:15 2024-09-10T19:13:12.536 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-10T19:13:12.536 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:13:12.537 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-10T19:13:13.879 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:13:14.881 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:13:14.881 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:13:14.881 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-10T19:13:14.881 INFO:tasks.workunit.client.0.smithi038.stdout:16 2024-09-10T19:13:14.881 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:13:14.882 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-10T19:13:15.360 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:13:16.361 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:13:16.361 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:13:16.362 INFO:tasks.workunit.client.0.smithi038.stdout:17 2024-09-10T19:13:16.362 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-10T19:13:16.362 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:13:16.362 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-10T19:13:16.813 INFO:tasks.workunit.client.0.smithi038.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/2727984328,v1:127.0.0.1:6811/2727984328] [v2:127.0.0.1:6812/2727984328,v1:127.0.0.1:6813/2727984328] exists,up 78051085-0402-4da6-96e3-c9728f3404d6 2024-09-10T19:13:16.816 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-10T19:13:16.816 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-10T19:13:16.816 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-10T19:13:16.816 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:32: TEST_mute: run_osd td/health-mute 2 2024-09-10T19:13:16.816 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/health-mute 2024-09-10T19:13:16.817 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-10T19:13:16.817 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2024-09-10T19:13:16.817 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-10T19:13:16.817 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/health-mute/2 2024-09-10T19:13:16.817 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=2277e988-dfa0-4c6f-811d-ff8d20dca830 --auth-supported=none --mon-pg-warn-min-per-osd 0 --mon-max-pg-per-osd 1000 --mon-host=127.0.0.1:7143 ' 2024-09-10T19:13:16.817 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-10T19:13:16.817 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-10T19:13:16.817 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-10T19:13:16.817 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/health-mute/2' 2024-09-10T19:13:16.817 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/health-mute/2/journal' 2024-09-10T19:13:16.817 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-10T19:13:16.817 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-10T19:13:16.817 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/health-mute' 2024-09-10T19:13:16.818 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-10T19:13:16.818 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-10T19:13:16.818 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-10T19:13:16.818 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-10T19:13:16.818 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:13:16.818 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.27297 2024-09-10T19:13:16.818 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.27297/$cluster-$name.asok' 2024-09-10T19:13:16.818 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.27297/$cluster-$name.asok' 2024-09-10T19:13:16.819 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-10T19:13:16.819 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-10T19:13:16.819 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-10T19:13:16.819 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/health-mute/$name.log' 2024-09-10T19:13:16.819 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/health-mute/$name.pid' 2024-09-10T19:13:16.819 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-10T19:13:16.819 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-10T19:13:16.819 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-10T19:13:16.819 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-10T19:13:16.819 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-10T19:13:16.819 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-10T19:13:16.819 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/health-mute/2 2024-09-10T19:13:16.819 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-10T19:13:16.820 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=19db6325-aecf-464e-bdc2-1720af8291c4 2024-09-10T19:13:16.820 INFO:tasks.workunit.client.0.smithi038.stdout:add osd2 19db6325-aecf-464e-bdc2-1720af8291c4 2024-09-10T19:13:16.820 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 19db6325-aecf-464e-bdc2-1720af8291c4' 2024-09-10T19:13:16.821 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-10T19:13:16.836 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBMmuBm7TrAMRAAihq/6LZ1utqRODr+Qnh3PQ== 2024-09-10T19:13:16.836 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBMmuBm7TrAMRAAihq/6LZ1utqRODr+Qnh3PQ=="}' 2024-09-10T19:13:16.836 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 19db6325-aecf-464e-bdc2-1720af8291c4 -i td/health-mute/2/new.json 2024-09-10T19:13:17.334 INFO:tasks.workunit.client.0.smithi038.stdout:2 2024-09-10T19:13:17.345 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/health-mute/2/new.json 2024-09-10T19:13:17.346 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=2277e988-dfa0-4c6f-811d-ff8d20dca830 --auth-supported=none --mon-pg-warn-min-per-osd 0 --mon-max-pg-per-osd 1000 --mon-host=127.0.0.1:7143 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/health-mute/2 --osd-journal=td/health-mute/2/journal --chdir= --run-dir=td/health-mute '--admin-socket=/tmp/ceph-asok.27297/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/health-mute/$name.log' '--pid-file=td/health-mute/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBMmuBm7TrAMRAAihq/6LZ1utqRODr+Qnh3PQ== --osd-uuid 19db6325-aecf-464e-bdc2-1720af8291c4 2024-09-10T19:13:17.376 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:13:17.375+0000 7f50d05ae640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-10T19:13:17.379 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:13:17.378+0000 7f50d05ae640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-10T19:13:17.380 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:13:17.379+0000 7f50d05ae640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-10T19:13:17.381 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:13:17.379+0000 7f50d05ae640 -1 bdev(0x5614bec13c00 td/health-mute/2/block) open stat got: (1) Operation not permitted 2024-09-10T19:13:17.381 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:13:17.379+0000 7f50d05ae640 -1 bluestore(td/health-mute/2) _read_fsid unparsable uuid 2024-09-10T19:13:23.179 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/health-mute/2/keyring 2024-09-10T19:13:23.179 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-10T19:13:23.180 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2024-09-10T19:13:23.180 INFO:tasks.workunit.client.0.smithi038.stdout:adding osd2 key to auth repository 2024-09-10T19:13:23.181 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/health-mute/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-10T19:13:23.747 INFO:tasks.workunit.client.0.smithi038.stdout:start osd.2 2024-09-10T19:13:23.748 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2024-09-10T19:13:23.748 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=2277e988-dfa0-4c6f-811d-ff8d20dca830 --auth-supported=none --mon-pg-warn-min-per-osd 0 --mon-max-pg-per-osd 1000 --mon-host=127.0.0.1:7143 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/health-mute/2 --osd-journal=td/health-mute/2/journal --chdir= --run-dir=td/health-mute '--admin-socket=/tmp/ceph-asok.27297/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/health-mute/$name.log' '--pid-file=td/health-mute/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-10T19:13:23.748 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-10T19:13:23.748 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-10T19:13:23.748 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-10T19:13:23.776 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:13:23.774+0000 7f6b655a8640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-10T19:13:23.778 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:13:23.776+0000 7f6b655a8640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-10T19:13:23.779 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:13:23.777+0000 7f6b655a8640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-10T19:13:24.199 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2024-09-10T19:13:24.199 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-10T19:13:24.199 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2024-09-10T19:13:24.199 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-10T19:13:24.199 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-10T19:13:24.199 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:13:24.199 INFO:tasks.workunit.client.0.smithi038.stdout:0 2024-09-10T19:13:24.200 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-10T19:13:24.200 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:13:24.200 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-10T19:13:24.633 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:13:24.643 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:13:24.642+0000 7f6b655a8640 -1 Falling back to public interface 2024-09-10T19:13:25.635 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:13:25.635 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:13:25.635 INFO:tasks.workunit.client.0.smithi038.stdout:1 2024-09-10T19:13:25.636 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-10T19:13:25.636 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:13:25.636 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-10T19:13:26.051 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:13:26.447 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:13:26.445+0000 7f6b655a8640 -1 osd.2 0 log_to_monitors true 2024-09-10T19:13:27.053 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:13:27.053 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:13:27.053 INFO:tasks.workunit.client.0.smithi038.stdout:2 2024-09-10T19:13:27.054 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-10T19:13:27.054 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:13:27.054 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-10T19:13:27.559 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:13:28.560 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:13:28.560 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:13:28.561 INFO:tasks.workunit.client.0.smithi038.stdout:3 2024-09-10T19:13:28.561 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-10T19:13:28.561 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:13:28.561 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-10T19:13:28.977 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:13:29.978 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:13:29.978 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:13:29.978 INFO:tasks.workunit.client.0.smithi038.stdout:4 2024-09-10T19:13:29.979 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-10T19:13:29.979 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:13:29.979 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-10T19:13:30.430 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:13:31.432 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:13:31.432 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:13:31.432 INFO:tasks.workunit.client.0.smithi038.stdout:5 2024-09-10T19:13:31.433 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-10T19:13:31.433 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:13:31.433 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-10T19:13:31.875 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:13:32.876 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:13:32.876 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:13:32.876 INFO:tasks.workunit.client.0.smithi038.stdout:6 2024-09-10T19:13:32.877 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-10T19:13:32.877 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:13:32.877 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-10T19:13:33.353 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:13:34.354 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:13:34.355 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:13:34.355 INFO:tasks.workunit.client.0.smithi038.stdout:7 2024-09-10T19:13:34.355 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-10T19:13:34.355 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:13:34.355 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-10T19:13:34.785 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:13:35.786 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:13:35.786 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:13:35.787 INFO:tasks.workunit.client.0.smithi038.stdout:8 2024-09-10T19:13:35.788 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-10T19:13:35.788 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:13:35.788 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-10T19:13:36.292 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:13:37.294 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:13:37.294 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:13:37.294 INFO:tasks.workunit.client.0.smithi038.stdout:9 2024-09-10T19:13:37.295 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-10T19:13:37.295 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:13:37.295 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-10T19:13:37.723 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:13:38.725 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:13:38.725 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:13:38.725 INFO:tasks.workunit.client.0.smithi038.stdout:10 2024-09-10T19:13:38.726 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-10T19:13:38.726 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:13:38.726 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-10T19:13:39.654 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:13:40.655 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:13:40.656 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:13:40.656 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-10T19:13:40.656 INFO:tasks.workunit.client.0.smithi038.stdout:11 2024-09-10T19:13:40.657 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:13:40.657 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-10T19:13:41.684 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:13:42.685 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:13:42.685 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:13:42.685 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-10T19:13:42.686 INFO:tasks.workunit.client.0.smithi038.stdout:12 2024-09-10T19:13:42.686 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:13:42.686 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-10T19:13:43.435 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:13:44.437 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:13:44.437 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:13:44.437 INFO:tasks.workunit.client.0.smithi038.stdout:13 2024-09-10T19:13:44.437 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-10T19:13:44.438 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:13:44.438 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-10T19:13:45.500 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:13:46.501 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:13:46.501 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:13:46.501 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-10T19:13:46.502 INFO:tasks.workunit.client.0.smithi038.stdout:14 2024-09-10T19:13:46.502 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:13:46.502 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-10T19:13:47.517 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:13:48.519 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:13:48.519 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:13:48.519 INFO:tasks.workunit.client.0.smithi038.stdout:15 2024-09-10T19:13:48.520 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-10T19:13:48.520 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:13:48.520 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-10T19:13:49.065 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:13:50.066 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:13:50.066 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:13:50.066 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-10T19:13:50.067 INFO:tasks.workunit.client.0.smithi038.stdout:16 2024-09-10T19:13:50.067 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:13:50.067 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-10T19:13:50.537 INFO:tasks.workunit.client.0.smithi038.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/3546449722,v1:127.0.0.1:6819/3546449722] [v2:127.0.0.1:6820/3546449722,v1:127.0.0.1:6821/3546449722] exists,up 19db6325-aecf-464e-bdc2-1720af8291c4 2024-09-10T19:13:50.538 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-10T19:13:50.539 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-10T19:13:50.539 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-10T19:13:50.539 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:34: TEST_mute: ceph osd pool create foo 8 2024-09-10T19:13:51.041 INFO:tasks.workunit.client.0.smithi038.stderr:pool 'foo' already exists 2024-09-10T19:13:51.056 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:35: TEST_mute: ceph osd pool application enable foo rbd --yes-i-really-mean-it 2024-09-10T19:13:52.553 INFO:tasks.workunit.client.0.smithi038.stderr:enabled application 'rbd' on pool 'foo' 2024-09-10T19:13:52.566 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:36: TEST_mute: wait_for_clean 2024-09-10T19:13:52.567 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1633: wait_for_clean: local cmd= 2024-09-10T19:13:52.567 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1634: wait_for_clean: local num_active_clean=-1 2024-09-10T19:13:52.567 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1635: wait_for_clean: local cur_active_clean 2024-09-10T19:13:52.568 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: get_timeout_delays 90 .1 2024-09-10T19:13:52.568 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-10T19:13:52.568 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-10T19:13:52.568 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-10T19:13:52.568 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-10T19:13:52.568 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-10T19:13:52.663 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-09-10T19:13:52.663 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: local -a delays 2024-09-10T19:13:52.663 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1637: wait_for_clean: local -i loop=0 2024-09-10T19:13:52.663 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1639: wait_for_clean: flush_pg_stats 2024-09-10T19:13:52.663 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-10T19:13:52.663 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-10T19:13:53.084 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-10T19:13:53.084 INFO:tasks.workunit.client.0.smithi038.stderr:1 2024-09-10T19:13:53.084 INFO:tasks.workunit.client.0.smithi038.stderr:2' 2024-09-10T19:13:53.084 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-10T19:13:53.084 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-10T19:13:53.085 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-10T19:13:53.261 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836501 2024-09-10T19:13:53.261 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836501 2024-09-10T19:13:53.261 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836501' 2024-09-10T19:13:53.261 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-10T19:13:53.261 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-10T19:13:53.405 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=42949672971 2024-09-10T19:13:53.405 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 42949672971 2024-09-10T19:13:53.406 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836501 1-42949672971' 2024-09-10T19:13:53.406 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-10T19:13:53.406 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-10T19:13:53.522 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=64424509445 2024-09-10T19:13:53.522 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 64424509445 2024-09-10T19:13:53.522 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836501 1-42949672971 2-64424509445' 2024-09-10T19:13:53.522 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-10T19:13:53.522 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836501 2024-09-10T19:13:53.522 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-10T19:13:53.523 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-10T19:13:53.524 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836501 2024-09-10T19:13:53.524 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-10T19:13:53.525 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836501 2024-09-10T19:13:53.525 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836501' 2024-09-10T19:13:53.525 INFO:tasks.workunit.client.0.smithi038.stdout:waiting osd.0 seq 21474836501 2024-09-10T19:13:53.525 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-10T19:13:53.974 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836499 -lt 21474836501 2024-09-10T19:13:53.974 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: flush_pg_stats: sleep 1 2024-09-10T19:13:54.975 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2224: flush_pg_stats: '[' 300 -eq 0 ']' 2024-09-10T19:13:54.976 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-10T19:13:55.435 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836501 -lt 21474836501 2024-09-10T19:13:55.436 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-10T19:13:55.436 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-42949672971 2024-09-10T19:13:55.436 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-10T19:13:55.437 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-10T19:13:55.438 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-42949672971 2024-09-10T19:13:55.438 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-10T19:13:55.439 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=42949672971 2024-09-10T19:13:55.439 INFO:tasks.workunit.client.0.smithi038.stdout:waiting osd.1 seq 42949672971 2024-09-10T19:13:55.439 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 42949672971' 2024-09-10T19:13:55.439 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-10T19:13:55.913 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 42949672971 -lt 42949672971 2024-09-10T19:13:55.913 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-10T19:13:55.914 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 2-64424509445 2024-09-10T19:13:55.914 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-10T19:13:55.914 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=2 2024-09-10T19:13:55.915 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 2-64424509445 2024-09-10T19:13:55.915 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-10T19:13:55.916 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=64424509445 2024-09-10T19:13:55.916 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.2 seq 64424509445' 2024-09-10T19:13:55.916 INFO:tasks.workunit.client.0.smithi038.stdout:waiting osd.2 seq 64424509445 2024-09-10T19:13:55.917 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 2 2024-09-10T19:13:56.354 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 64424509446 -lt 64424509445 2024-09-10T19:13:56.355 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: get_num_pgs 2024-09-10T19:13:56.355 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-10T19:13:56.355 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-10T19:13:56.906 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: test 8 == 0 2024-09-10T19:13:56.906 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-10T19:13:56.907 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-10T19:13:56.907 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-10T19:13:56.907 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-10T19:13:56.907 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-10T19:13:56.907 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-10T19:13:56.907 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-10T19:13:57.304 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=8 2024-09-10T19:13:57.305 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-10T19:13:57.305 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-10T19:13:57.305 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-10T19:13:57.865 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 8 = 8 2024-09-10T19:13:57.865 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: break 2024-09-10T19:13:57.865 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: return 0 2024-09-10T19:13:57.865 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:38: TEST_mute: ceph -s 2024-09-10T19:13:58.424 INFO:tasks.workunit.client.0.smithi038.stdout: cluster: 2024-09-10T19:13:58.424 INFO:tasks.workunit.client.0.smithi038.stdout: id: 2277e988-dfa0-4c6f-811d-ff8d20dca830 2024-09-10T19:13:58.424 INFO:tasks.workunit.client.0.smithi038.stdout: health: HEALTH_OK 2024-09-10T19:13:58.424 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-10T19:13:58.425 INFO:tasks.workunit.client.0.smithi038.stdout: services: 2024-09-10T19:13:58.425 INFO:tasks.workunit.client.0.smithi038.stdout: mon: 1 daemons, quorum a (age 113s) 2024-09-10T19:13:58.425 INFO:tasks.workunit.client.0.smithi038.stdout: mgr: x(active, since 106s) 2024-09-10T19:13:58.425 INFO:tasks.workunit.client.0.smithi038.stdout: osd: 3 osds: 3 up (since 9s), 3 in (since 41s) 2024-09-10T19:13:58.425 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-10T19:13:58.425 INFO:tasks.workunit.client.0.smithi038.stdout: data: 2024-09-10T19:13:58.425 INFO:tasks.workunit.client.0.smithi038.stdout: pools: 1 pools, 8 pgs 2024-09-10T19:13:58.425 INFO:tasks.workunit.client.0.smithi038.stdout: objects: 0 objects, 0 B 2024-09-10T19:13:58.425 INFO:tasks.workunit.client.0.smithi038.stdout: usage: 79 MiB used, 300 GiB / 300 GiB avail 2024-09-10T19:13:58.425 INFO:tasks.workunit.client.0.smithi038.stdout: pgs: 8 active+clean 2024-09-10T19:13:58.425 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-10T19:13:58.435 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:39: TEST_mute: ceph health 2024-09-10T19:13:58.436 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:39: TEST_mute: grep HEALTH_OK 2024-09-10T19:13:58.926 INFO:tasks.workunit.client.0.smithi038.stdout:HEALTH_OK 2024-09-10T19:13:58.927 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:41: TEST_mute: ceph osd pool set foo size 1 --yes-i-really-mean-it 2024-09-10T19:13:59.781 INFO:tasks.workunit.client.0.smithi038.stderr:set pool 1 size to 1 2024-09-10T19:13:59.793 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:42: TEST_mute: ceph -s 2024-09-10T19:14:00.435 INFO:tasks.workunit.client.0.smithi038.stdout: cluster: 2024-09-10T19:14:00.436 INFO:tasks.workunit.client.0.smithi038.stdout: id: 2277e988-dfa0-4c6f-811d-ff8d20dca830 2024-09-10T19:14:00.436 INFO:tasks.workunit.client.0.smithi038.stdout: health: HEALTH_WARN 2024-09-10T19:14:00.436 INFO:tasks.workunit.client.0.smithi038.stdout: 1 pool(s) have no replicas configured 2024-09-10T19:14:00.436 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-10T19:14:00.436 INFO:tasks.workunit.client.0.smithi038.stdout: services: 2024-09-10T19:14:00.436 INFO:tasks.workunit.client.0.smithi038.stdout: mon: 1 daemons, quorum a (age 115s) 2024-09-10T19:14:00.436 INFO:tasks.workunit.client.0.smithi038.stdout: mgr: x(active, since 108s) 2024-09-10T19:14:00.436 INFO:tasks.workunit.client.0.smithi038.stdout: osd: 3 osds: 3 up (since 11s), 3 in (since 43s) 2024-09-10T19:14:00.436 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-10T19:14:00.436 INFO:tasks.workunit.client.0.smithi038.stdout: data: 2024-09-10T19:14:00.436 INFO:tasks.workunit.client.0.smithi038.stdout: pools: 1 pools, 8 pgs 2024-09-10T19:14:00.436 INFO:tasks.workunit.client.0.smithi038.stdout: objects: 0 objects, 0 B 2024-09-10T19:14:00.436 INFO:tasks.workunit.client.0.smithi038.stdout: usage: 79 MiB used, 300 GiB / 300 GiB avail 2024-09-10T19:14:00.436 INFO:tasks.workunit.client.0.smithi038.stdout: pgs: 25.000% pgs not active 2024-09-10T19:14:00.437 INFO:tasks.workunit.client.0.smithi038.stdout: 6 active+clean 2024-09-10T19:14:00.437 INFO:tasks.workunit.client.0.smithi038.stdout: 2 peering 2024-09-10T19:14:00.437 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-10T19:14:00.447 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:43: TEST_mute: ceph health 2024-09-10T19:14:00.447 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:43: TEST_mute: grep HEALTH_WARN 2024-09-10T19:14:01.067 INFO:tasks.workunit.client.0.smithi038.stdout:HEALTH_WARN 1 pool(s) have no replicas configured 2024-09-10T19:14:01.068 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:44: TEST_mute: ceph health detail 2024-09-10T19:14:01.068 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:44: TEST_mute: grep POOL_NO_REDUNDANCY 2024-09-10T19:14:01.616 INFO:tasks.workunit.client.0.smithi038.stdout:[WRN] POOL_NO_REDUNDANCY: 1 pool(s) have no replicas configured 2024-09-10T19:14:01.616 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:45: TEST_mute: ceph health mute POOL_NO_REDUNDANCY 2024-09-10T19:14:02.304 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:46: TEST_mute: ceph -s 2024-09-10T19:14:02.840 INFO:tasks.workunit.client.0.smithi038.stdout: cluster: 2024-09-10T19:14:02.840 INFO:tasks.workunit.client.0.smithi038.stdout: id: 2277e988-dfa0-4c6f-811d-ff8d20dca830 2024-09-10T19:14:02.840 INFO:tasks.workunit.client.0.smithi038.stdout: health: HEALTH_OK 2024-09-10T19:14:02.840 INFO:tasks.workunit.client.0.smithi038.stdout: (muted: POOL_NO_REDUNDANCY) 2024-09-10T19:14:02.840 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-10T19:14:02.840 INFO:tasks.workunit.client.0.smithi038.stdout: services: 2024-09-10T19:14:02.840 INFO:tasks.workunit.client.0.smithi038.stdout: mon: 1 daemons, quorum a (age 117s) 2024-09-10T19:14:02.840 INFO:tasks.workunit.client.0.smithi038.stdout: mgr: x(active, since 110s) 2024-09-10T19:14:02.840 INFO:tasks.workunit.client.0.smithi038.stdout: osd: 3 osds: 3 up (since 13s), 3 in (since 45s) 2024-09-10T19:14:02.841 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-10T19:14:02.841 INFO:tasks.workunit.client.0.smithi038.stdout: data: 2024-09-10T19:14:02.841 INFO:tasks.workunit.client.0.smithi038.stdout: pools: 1 pools, 8 pgs 2024-09-10T19:14:02.841 INFO:tasks.workunit.client.0.smithi038.stdout: objects: 0 objects, 0 B 2024-09-10T19:14:02.841 INFO:tasks.workunit.client.0.smithi038.stdout: usage: 79 MiB used, 300 GiB / 300 GiB avail 2024-09-10T19:14:02.841 INFO:tasks.workunit.client.0.smithi038.stdout: pgs: 25.000% pgs not active 2024-09-10T19:14:02.841 INFO:tasks.workunit.client.0.smithi038.stdout: 6 active+clean 2024-09-10T19:14:02.841 INFO:tasks.workunit.client.0.smithi038.stdout: 2 peering 2024-09-10T19:14:02.841 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-10T19:14:02.851 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:47: TEST_mute: ceph health 2024-09-10T19:14:02.851 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:47: TEST_mute: grep HEALTH_OK 2024-09-10T19:14:02.851 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:47: TEST_mute: grep POOL_NO_REDUNDANCY 2024-09-10T19:14:03.377 INFO:tasks.workunit.client.0.smithi038.stdout:HEALTH_OK (muted: POOL_NO_REDUNDANCY) 2024-09-10T19:14:03.377 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:48: TEST_mute: ceph health unmute POOL_NO_REDUNDANCY 2024-09-10T19:14:04.255 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:49: TEST_mute: ceph -s 2024-09-10T19:14:04.802 INFO:tasks.workunit.client.0.smithi038.stdout: cluster: 2024-09-10T19:14:04.803 INFO:tasks.workunit.client.0.smithi038.stdout: id: 2277e988-dfa0-4c6f-811d-ff8d20dca830 2024-09-10T19:14:04.803 INFO:tasks.workunit.client.0.smithi038.stdout: health: HEALTH_WARN 2024-09-10T19:14:04.803 INFO:tasks.workunit.client.0.smithi038.stdout: 1 pool(s) have no replicas configured 2024-09-10T19:14:04.803 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-10T19:14:04.803 INFO:tasks.workunit.client.0.smithi038.stdout: services: 2024-09-10T19:14:04.803 INFO:tasks.workunit.client.0.smithi038.stdout: mon: 1 daemons, quorum a (age 119s) 2024-09-10T19:14:04.803 INFO:tasks.workunit.client.0.smithi038.stdout: mgr: x(active, since 112s) 2024-09-10T19:14:04.803 INFO:tasks.workunit.client.0.smithi038.stdout: osd: 3 osds: 3 up (since 15s), 3 in (since 47s) 2024-09-10T19:14:04.803 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-10T19:14:04.803 INFO:tasks.workunit.client.0.smithi038.stdout: data: 2024-09-10T19:14:04.803 INFO:tasks.workunit.client.0.smithi038.stdout: pools: 1 pools, 8 pgs 2024-09-10T19:14:04.803 INFO:tasks.workunit.client.0.smithi038.stdout: objects: 0 objects, 0 B 2024-09-10T19:14:04.803 INFO:tasks.workunit.client.0.smithi038.stdout: usage: 79 MiB used, 300 GiB / 300 GiB avail 2024-09-10T19:14:04.803 INFO:tasks.workunit.client.0.smithi038.stdout: pgs: 25.000% pgs not active 2024-09-10T19:14:04.804 INFO:tasks.workunit.client.0.smithi038.stdout: 6 active+clean 2024-09-10T19:14:04.804 INFO:tasks.workunit.client.0.smithi038.stdout: 2 peering 2024-09-10T19:14:04.804 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-10T19:14:04.814 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:50: TEST_mute: ceph health 2024-09-10T19:14:04.814 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:50: TEST_mute: grep HEALTH_WARN 2024-09-10T19:14:05.327 INFO:tasks.workunit.client.0.smithi038.stdout:HEALTH_WARN 1 pool(s) have no replicas configured 2024-09-10T19:14:05.328 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:52: TEST_mute: ceph osd pool set foo size 3 2024-09-10T19:14:06.129 INFO:tasks.workunit.client.0.smithi038.stderr:set pool 1 size to 3 2024-09-10T19:14:06.140 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:53: TEST_mute: ceph -s 2024-09-10T19:14:06.731 INFO:tasks.workunit.client.0.smithi038.stdout: cluster: 2024-09-10T19:14:06.731 INFO:tasks.workunit.client.0.smithi038.stdout: id: 2277e988-dfa0-4c6f-811d-ff8d20dca830 2024-09-10T19:14:06.731 INFO:tasks.workunit.client.0.smithi038.stdout: health: HEALTH_OK 2024-09-10T19:14:06.731 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-10T19:14:06.732 INFO:tasks.workunit.client.0.smithi038.stdout: services: 2024-09-10T19:14:06.732 INFO:tasks.workunit.client.0.smithi038.stdout: mon: 1 daemons, quorum a (age 2m) 2024-09-10T19:14:06.732 INFO:tasks.workunit.client.0.smithi038.stdout: mgr: x(active, since 114s) 2024-09-10T19:14:06.732 INFO:tasks.workunit.client.0.smithi038.stdout: osd: 3 osds: 3 up (since 17s), 3 in (since 49s) 2024-09-10T19:14:06.732 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-10T19:14:06.732 INFO:tasks.workunit.client.0.smithi038.stdout: data: 2024-09-10T19:14:06.732 INFO:tasks.workunit.client.0.smithi038.stdout: pools: 1 pools, 8 pgs 2024-09-10T19:14:06.732 INFO:tasks.workunit.client.0.smithi038.stdout: objects: 0 objects, 0 B 2024-09-10T19:14:06.732 INFO:tasks.workunit.client.0.smithi038.stdout: usage: 79 MiB used, 300 GiB / 300 GiB avail 2024-09-10T19:14:06.732 INFO:tasks.workunit.client.0.smithi038.stdout: pgs: 8 active+clean 2024-09-10T19:14:06.732 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-10T19:14:06.743 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:54: TEST_mute: ceph health 2024-09-10T19:14:06.743 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:54: TEST_mute: grep HEALTH_OK 2024-09-10T19:14:07.261 INFO:tasks.workunit.client.0.smithi038.stdout:HEALTH_OK 2024-09-10T19:14:07.262 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:55: TEST_mute: ceph osd set noup 2024-09-10T19:14:08.107 INFO:tasks.workunit.client.0.smithi038.stderr:noup is set 2024-09-10T19:14:08.120 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:56: TEST_mute: ceph -s 2024-09-10T19:14:08.661 INFO:tasks.workunit.client.0.smithi038.stdout: cluster: 2024-09-10T19:14:08.661 INFO:tasks.workunit.client.0.smithi038.stdout: id: 2277e988-dfa0-4c6f-811d-ff8d20dca830 2024-09-10T19:14:08.661 INFO:tasks.workunit.client.0.smithi038.stdout: health: HEALTH_WARN 2024-09-10T19:14:08.661 INFO:tasks.workunit.client.0.smithi038.stdout: noup flag(s) set 2024-09-10T19:14:08.661 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-10T19:14:08.661 INFO:tasks.workunit.client.0.smithi038.stdout: services: 2024-09-10T19:14:08.661 INFO:tasks.workunit.client.0.smithi038.stdout: mon: 1 daemons, quorum a (age 2m) 2024-09-10T19:14:08.661 INFO:tasks.workunit.client.0.smithi038.stdout: mgr: x(active, since 116s) 2024-09-10T19:14:08.661 INFO:tasks.workunit.client.0.smithi038.stdout: osd: 3 osds: 3 up (since 19s), 3 in (since 51s) 2024-09-10T19:14:08.662 INFO:tasks.workunit.client.0.smithi038.stdout: flags noup 2024-09-10T19:14:08.662 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-10T19:14:08.662 INFO:tasks.workunit.client.0.smithi038.stdout: data: 2024-09-10T19:14:08.662 INFO:tasks.workunit.client.0.smithi038.stdout: pools: 1 pools, 8 pgs 2024-09-10T19:14:08.662 INFO:tasks.workunit.client.0.smithi038.stdout: objects: 0 objects, 0 B 2024-09-10T19:14:08.662 INFO:tasks.workunit.client.0.smithi038.stdout: usage: 79 MiB used, 300 GiB / 300 GiB avail 2024-09-10T19:14:08.662 INFO:tasks.workunit.client.0.smithi038.stdout: pgs: 8 active+clean 2024-09-10T19:14:08.662 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-10T19:14:08.673 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:57: TEST_mute: ceph health detail 2024-09-10T19:14:08.673 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:57: TEST_mute: grep OSDMAP_FLAGS 2024-09-10T19:14:09.238 INFO:tasks.workunit.client.0.smithi038.stdout:[WRN] OSDMAP_FLAGS: noup flag(s) set 2024-09-10T19:14:09.238 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:58: TEST_mute: ceph osd down 0 2024-09-10T19:14:09.768 INFO:tasks.workunit.client.0.smithi038.stderr:osd.0 is already down. 2024-09-10T19:14:09.779 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:59: TEST_mute: ceph -s 2024-09-10T19:14:10.679 INFO:tasks.workunit.client.0.smithi038.stdout: cluster: 2024-09-10T19:14:10.680 INFO:tasks.workunit.client.0.smithi038.stdout: id: 2277e988-dfa0-4c6f-811d-ff8d20dca830 2024-09-10T19:14:10.680 INFO:tasks.workunit.client.0.smithi038.stdout: health: HEALTH_WARN 2024-09-10T19:14:10.680 INFO:tasks.workunit.client.0.smithi038.stdout: noup flag(s) set 2024-09-10T19:14:10.680 INFO:tasks.workunit.client.0.smithi038.stdout: 1 osds down 2024-09-10T19:14:10.680 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-10T19:14:10.680 INFO:tasks.workunit.client.0.smithi038.stdout: services: 2024-09-10T19:14:10.680 INFO:tasks.workunit.client.0.smithi038.stdout: mon: 1 daemons, quorum a (age 2m) 2024-09-10T19:14:10.680 INFO:tasks.workunit.client.0.smithi038.stdout: mgr: x(active, since 118s) 2024-09-10T19:14:10.680 INFO:tasks.workunit.client.0.smithi038.stdout: osd: 3 osds: 2 up (since 1.08399s), 3 in (since 53s) 2024-09-10T19:14:10.680 INFO:tasks.workunit.client.0.smithi038.stdout: flags noup 2024-09-10T19:14:10.680 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-10T19:14:10.680 INFO:tasks.workunit.client.0.smithi038.stdout: data: 2024-09-10T19:14:10.681 INFO:tasks.workunit.client.0.smithi038.stdout: pools: 1 pools, 8 pgs 2024-09-10T19:14:10.681 INFO:tasks.workunit.client.0.smithi038.stdout: objects: 0 objects, 0 B 2024-09-10T19:14:10.681 INFO:tasks.workunit.client.0.smithi038.stdout: usage: 79 MiB used, 300 GiB / 300 GiB avail 2024-09-10T19:14:10.681 INFO:tasks.workunit.client.0.smithi038.stdout: pgs: 25.000% pgs not active 2024-09-10T19:14:10.681 INFO:tasks.workunit.client.0.smithi038.stdout: 5 active+clean 2024-09-10T19:14:10.681 INFO:tasks.workunit.client.0.smithi038.stdout: 2 peering 2024-09-10T19:14:10.681 INFO:tasks.workunit.client.0.smithi038.stdout: 1 stale+active+clean 2024-09-10T19:14:10.681 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-10T19:14:10.691 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:60: TEST_mute: ceph health detail 2024-09-10T19:14:10.691 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:60: TEST_mute: grep OSD_DOWN 2024-09-10T19:14:11.345 INFO:tasks.workunit.client.0.smithi038.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-10T19:14:11.346 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:61: TEST_mute: ceph health detail 2024-09-10T19:14:11.346 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:61: TEST_mute: grep HEALTH_WARN 2024-09-10T19:14:11.901 INFO:tasks.workunit.client.0.smithi038.stdout:HEALTH_WARN noup flag(s) set; 1 osds down 2024-09-10T19:14:11.902 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:63: TEST_mute: ceph health mute OSD_DOWN 2024-09-10T19:14:12.859 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:64: TEST_mute: ceph health mute OSDMAP_FLAGS 2024-09-10T19:14:13.850 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:65: TEST_mute: ceph -s 2024-09-10T19:14:14.410 INFO:tasks.workunit.client.0.smithi038.stdout: cluster: 2024-09-10T19:14:14.410 INFO:tasks.workunit.client.0.smithi038.stdout: id: 2277e988-dfa0-4c6f-811d-ff8d20dca830 2024-09-10T19:14:14.410 INFO:tasks.workunit.client.0.smithi038.stdout: health: HEALTH_OK 2024-09-10T19:14:14.410 INFO:tasks.workunit.client.0.smithi038.stdout: (muted: OSDMAP_FLAGS OSD_DOWN) 2024-09-10T19:14:14.410 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-10T19:14:14.411 INFO:tasks.workunit.client.0.smithi038.stdout: services: 2024-09-10T19:14:14.411 INFO:tasks.workunit.client.0.smithi038.stdout: mon: 1 daemons, quorum a (age 2m) 2024-09-10T19:14:14.411 INFO:tasks.workunit.client.0.smithi038.stdout: mgr: x(active, since 2m) 2024-09-10T19:14:14.411 INFO:tasks.workunit.client.0.smithi038.stdout: osd: 3 osds: 2 up (since 4s), 3 in (since 57s) 2024-09-10T19:14:14.411 INFO:tasks.workunit.client.0.smithi038.stdout: flags noup 2024-09-10T19:14:14.411 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-10T19:14:14.411 INFO:tasks.workunit.client.0.smithi038.stdout: data: 2024-09-10T19:14:14.411 INFO:tasks.workunit.client.0.smithi038.stdout: pools: 1 pools, 8 pgs 2024-09-10T19:14:14.411 INFO:tasks.workunit.client.0.smithi038.stdout: objects: 0 objects, 0 B 2024-09-10T19:14:14.411 INFO:tasks.workunit.client.0.smithi038.stdout: usage: 79 MiB used, 300 GiB / 300 GiB avail 2024-09-10T19:14:14.411 INFO:tasks.workunit.client.0.smithi038.stdout: pgs: 25.000% pgs not active 2024-09-10T19:14:14.411 INFO:tasks.workunit.client.0.smithi038.stdout: 5 active+undersized+wait 2024-09-10T19:14:14.411 INFO:tasks.workunit.client.0.smithi038.stdout: 2 peering 2024-09-10T19:14:14.411 INFO:tasks.workunit.client.0.smithi038.stdout: 1 stale+active+clean 2024-09-10T19:14:14.412 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-10T19:14:14.422 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:66: TEST_mute: ceph health 2024-09-10T19:14:14.422 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:66: TEST_mute: grep HEALTH_OK 2024-09-10T19:14:14.422 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:66: TEST_mute: grep OSD_DOWN 2024-09-10T19:14:14.422 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:66: TEST_mute: grep OSDMAP_FLAGS 2024-09-10T19:14:14.934 INFO:tasks.workunit.client.0.smithi038.stdout:HEALTH_OK (muted: OSDMAP_FLAGS OSD_DOWN) 2024-09-10T19:14:14.934 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:67: TEST_mute: ceph health unmute OSD_DOWN 2024-09-10T19:14:15.698 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:68: TEST_mute: ceph -s 2024-09-10T19:14:16.233 INFO:tasks.workunit.client.0.smithi038.stdout: cluster: 2024-09-10T19:14:16.233 INFO:tasks.workunit.client.0.smithi038.stdout: id: 2277e988-dfa0-4c6f-811d-ff8d20dca830 2024-09-10T19:14:16.233 INFO:tasks.workunit.client.0.smithi038.stdout: health: HEALTH_WARN 2024-09-10T19:14:16.234 INFO:tasks.workunit.client.0.smithi038.stdout: 1 osds down 2024-09-10T19:14:16.234 INFO:tasks.workunit.client.0.smithi038.stdout: (muted: OSDMAP_FLAGS) 2024-09-10T19:14:16.234 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-10T19:14:16.234 INFO:tasks.workunit.client.0.smithi038.stdout: services: 2024-09-10T19:14:16.234 INFO:tasks.workunit.client.0.smithi038.stdout: mon: 1 daemons, quorum a (age 2m) 2024-09-10T19:14:16.234 INFO:tasks.workunit.client.0.smithi038.stdout: mgr: x(active, since 2m) 2024-09-10T19:14:16.234 INFO:tasks.workunit.client.0.smithi038.stdout: osd: 3 osds: 2 up (since 6s), 3 in (since 59s) 2024-09-10T19:14:16.234 INFO:tasks.workunit.client.0.smithi038.stdout: flags noup 2024-09-10T19:14:16.234 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-10T19:14:16.234 INFO:tasks.workunit.client.0.smithi038.stdout: data: 2024-09-10T19:14:16.234 INFO:tasks.workunit.client.0.smithi038.stdout: pools: 1 pools, 8 pgs 2024-09-10T19:14:16.234 INFO:tasks.workunit.client.0.smithi038.stdout: objects: 0 objects, 0 B 2024-09-10T19:14:16.234 INFO:tasks.workunit.client.0.smithi038.stdout: usage: 79 MiB used, 300 GiB / 300 GiB avail 2024-09-10T19:14:16.234 INFO:tasks.workunit.client.0.smithi038.stdout: pgs: 8 active+undersized 2024-09-10T19:14:16.234 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-10T19:14:16.245 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:69: TEST_mute: ceph health 2024-09-10T19:14:16.245 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:69: TEST_mute: grep HEALTH_WARN 2024-09-10T19:14:16.747 INFO:tasks.workunit.client.0.smithi038.stdout:HEALTH_WARN 1 osds down; (muted: OSDMAP_FLAGS) 2024-09-10T19:14:16.748 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:72: TEST_mute: ceph health mute OSD_DOWN 10s 2024-09-10T19:14:17.545 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:73: TEST_mute: ceph -s 2024-09-10T19:14:18.092 INFO:tasks.workunit.client.0.smithi038.stdout: cluster: 2024-09-10T19:14:18.092 INFO:tasks.workunit.client.0.smithi038.stdout: id: 2277e988-dfa0-4c6f-811d-ff8d20dca830 2024-09-10T19:14:18.093 INFO:tasks.workunit.client.0.smithi038.stdout: health: HEALTH_OK 2024-09-10T19:14:18.093 INFO:tasks.workunit.client.0.smithi038.stdout: (muted: OSDMAP_FLAGS OSD_DOWN(9s)) 2024-09-10T19:14:18.093 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-10T19:14:18.093 INFO:tasks.workunit.client.0.smithi038.stdout: services: 2024-09-10T19:14:18.093 INFO:tasks.workunit.client.0.smithi038.stdout: mon: 1 daemons, quorum a (age 2m) 2024-09-10T19:14:18.093 INFO:tasks.workunit.client.0.smithi038.stdout: mgr: x(active, since 2m) 2024-09-10T19:14:18.093 INFO:tasks.workunit.client.0.smithi038.stdout: osd: 3 osds: 2 up (since 8s), 3 in (since 60s) 2024-09-10T19:14:18.093 INFO:tasks.workunit.client.0.smithi038.stdout: flags noup 2024-09-10T19:14:18.093 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-10T19:14:18.093 INFO:tasks.workunit.client.0.smithi038.stdout: data: 2024-09-10T19:14:18.093 INFO:tasks.workunit.client.0.smithi038.stdout: pools: 1 pools, 8 pgs 2024-09-10T19:14:18.093 INFO:tasks.workunit.client.0.smithi038.stdout: objects: 0 objects, 0 B 2024-09-10T19:14:18.094 INFO:tasks.workunit.client.0.smithi038.stdout: usage: 79 MiB used, 300 GiB / 300 GiB avail 2024-09-10T19:14:18.094 INFO:tasks.workunit.client.0.smithi038.stdout: pgs: 8 active+undersized 2024-09-10T19:14:18.094 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-10T19:14:18.104 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:74: TEST_mute: ceph health 2024-09-10T19:14:18.104 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:74: TEST_mute: grep HEALTH_OK 2024-09-10T19:14:18.628 INFO:tasks.workunit.client.0.smithi038.stdout:HEALTH_OK (muted: OSDMAP_FLAGS OSD_DOWN(8s)) 2024-09-10T19:14:18.628 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:75: TEST_mute: sleep 15 2024-09-10T19:14:33.629 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:76: TEST_mute: ceph -s 2024-09-10T19:14:34.177 INFO:tasks.workunit.client.0.smithi038.stdout: cluster: 2024-09-10T19:14:34.177 INFO:tasks.workunit.client.0.smithi038.stdout: id: 2277e988-dfa0-4c6f-811d-ff8d20dca830 2024-09-10T19:14:34.178 INFO:tasks.workunit.client.0.smithi038.stdout: health: HEALTH_WARN 2024-09-10T19:14:34.178 INFO:tasks.workunit.client.0.smithi038.stdout: 1 osds down 2024-09-10T19:14:34.178 INFO:tasks.workunit.client.0.smithi038.stdout: (muted: OSDMAP_FLAGS) 2024-09-10T19:14:34.178 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-10T19:14:34.178 INFO:tasks.workunit.client.0.smithi038.stdout: services: 2024-09-10T19:14:34.179 INFO:tasks.workunit.client.0.smithi038.stdout: mon: 1 daemons, quorum a (age 2m) 2024-09-10T19:14:34.179 INFO:tasks.workunit.client.0.smithi038.stdout: mgr: x(active, since 2m) 2024-09-10T19:14:34.179 INFO:tasks.workunit.client.0.smithi038.stdout: osd: 3 osds: 2 up (since 24s), 3 in (since 77s) 2024-09-10T19:14:34.179 INFO:tasks.workunit.client.0.smithi038.stdout: flags noup 2024-09-10T19:14:34.179 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-10T19:14:34.179 INFO:tasks.workunit.client.0.smithi038.stdout: data: 2024-09-10T19:14:34.179 INFO:tasks.workunit.client.0.smithi038.stdout: pools: 1 pools, 8 pgs 2024-09-10T19:14:34.179 INFO:tasks.workunit.client.0.smithi038.stdout: objects: 0 objects, 0 B 2024-09-10T19:14:34.180 INFO:tasks.workunit.client.0.smithi038.stdout: usage: 80 MiB used, 300 GiB / 300 GiB avail 2024-09-10T19:14:34.180 INFO:tasks.workunit.client.0.smithi038.stdout: pgs: 8 active+undersized 2024-09-10T19:14:34.180 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-10T19:14:34.189 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:77: TEST_mute: ceph health 2024-09-10T19:14:34.189 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:77: TEST_mute: grep HEALTH_WARN 2024-09-10T19:14:34.718 INFO:tasks.workunit.client.0.smithi038.stdout:HEALTH_WARN 1 osds down; (muted: OSDMAP_FLAGS) 2024-09-10T19:14:34.718 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:80: TEST_mute: ceph health mute OSDMAP_FLAGS --sticky 2024-09-10T19:14:35.518 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:81: TEST_mute: ceph osd unset noup 2024-09-10T19:14:36.225 INFO:tasks.workunit.client.0.smithi038.stderr:noup is unset 2024-09-10T19:14:36.237 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:82: TEST_mute: sleep 5 2024-09-10T19:14:41.238 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:83: TEST_mute: ceph -s 2024-09-10T19:14:41.784 INFO:tasks.workunit.client.0.smithi038.stdout: cluster: 2024-09-10T19:14:41.784 INFO:tasks.workunit.client.0.smithi038.stdout: id: 2277e988-dfa0-4c6f-811d-ff8d20dca830 2024-09-10T19:14:41.784 INFO:tasks.workunit.client.0.smithi038.stdout: health: HEALTH_OK 2024-09-10T19:14:41.784 INFO:tasks.workunit.client.0.smithi038.stdout: (muted: OSDMAP_FLAGS) 2024-09-10T19:14:41.784 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-10T19:14:41.784 INFO:tasks.workunit.client.0.smithi038.stdout: services: 2024-09-10T19:14:41.785 INFO:tasks.workunit.client.0.smithi038.stdout: mon: 1 daemons, quorum a (age 2m) 2024-09-10T19:14:41.785 INFO:tasks.workunit.client.0.smithi038.stdout: mgr: x(active, since 2m) 2024-09-10T19:14:41.785 INFO:tasks.workunit.client.0.smithi038.stdout: osd: 3 osds: 3 up (since 5s), 3 in (since 84s) 2024-09-10T19:14:41.785 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-10T19:14:41.785 INFO:tasks.workunit.client.0.smithi038.stdout: data: 2024-09-10T19:14:41.785 INFO:tasks.workunit.client.0.smithi038.stdout: pools: 1 pools, 8 pgs 2024-09-10T19:14:41.785 INFO:tasks.workunit.client.0.smithi038.stdout: objects: 0 objects, 0 B 2024-09-10T19:14:41.785 INFO:tasks.workunit.client.0.smithi038.stdout: usage: 80 MiB used, 300 GiB / 300 GiB avail 2024-09-10T19:14:41.785 INFO:tasks.workunit.client.0.smithi038.stdout: pgs: 12.500% pgs not active 2024-09-10T19:14:41.785 INFO:tasks.workunit.client.0.smithi038.stdout: 5 active+undersized 2024-09-10T19:14:41.785 INFO:tasks.workunit.client.0.smithi038.stdout: 2 active+clean 2024-09-10T19:14:41.785 INFO:tasks.workunit.client.0.smithi038.stdout: 1 peering 2024-09-10T19:14:41.785 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-10T19:14:41.796 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:84: TEST_mute: ceph health 2024-09-10T19:14:41.796 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:84: TEST_mute: grep OSDMAP_FLAGS 2024-09-10T19:14:42.290 INFO:tasks.workunit.client.0.smithi038.stdout:HEALTH_OK (muted: OSDMAP_FLAGS) 2024-09-10T19:14:42.291 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:85: TEST_mute: ceph osd set noup 2024-09-10T19:14:42.944 INFO:tasks.workunit.client.0.smithi038.stderr:noup is set 2024-09-10T19:14:42.955 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:86: TEST_mute: ceph -s 2024-09-10T19:14:43.491 INFO:tasks.workunit.client.0.smithi038.stdout: cluster: 2024-09-10T19:14:43.492 INFO:tasks.workunit.client.0.smithi038.stdout: id: 2277e988-dfa0-4c6f-811d-ff8d20dca830 2024-09-10T19:14:43.492 INFO:tasks.workunit.client.0.smithi038.stdout: health: HEALTH_OK 2024-09-10T19:14:43.492 INFO:tasks.workunit.client.0.smithi038.stdout: (muted: OSDMAP_FLAGS) 2024-09-10T19:14:43.492 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-10T19:14:43.492 INFO:tasks.workunit.client.0.smithi038.stdout: services: 2024-09-10T19:14:43.492 INFO:tasks.workunit.client.0.smithi038.stdout: mon: 1 daemons, quorum a (age 2m) 2024-09-10T19:14:43.493 INFO:tasks.workunit.client.0.smithi038.stdout: mgr: x(active, since 2m) 2024-09-10T19:14:43.493 INFO:tasks.workunit.client.0.smithi038.stdout: osd: 3 osds: 3 up (since 7s), 3 in (since 86s) 2024-09-10T19:14:43.493 INFO:tasks.workunit.client.0.smithi038.stdout: flags noup 2024-09-10T19:14:43.493 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-10T19:14:43.493 INFO:tasks.workunit.client.0.smithi038.stdout: data: 2024-09-10T19:14:43.493 INFO:tasks.workunit.client.0.smithi038.stdout: pools: 1 pools, 8 pgs 2024-09-10T19:14:43.494 INFO:tasks.workunit.client.0.smithi038.stdout: objects: 0 objects, 0 B 2024-09-10T19:14:43.494 INFO:tasks.workunit.client.0.smithi038.stdout: usage: 80 MiB used, 300 GiB / 300 GiB avail 2024-09-10T19:14:43.494 INFO:tasks.workunit.client.0.smithi038.stdout: pgs: 8 active+clean 2024-09-10T19:14:43.494 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-10T19:14:43.503 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:87: TEST_mute: ceph health 2024-09-10T19:14:43.503 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:87: TEST_mute: grep HEALTH_OK 2024-09-10T19:14:43.995 INFO:tasks.workunit.client.0.smithi038.stdout:HEALTH_OK (muted: OSDMAP_FLAGS) 2024-09-10T19:14:43.995 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:90: TEST_mute: ceph osd down 0 1 2024-09-10T19:14:44.614 INFO:tasks.workunit.client.0.smithi038.stderr:osd.0 is already down. osd.1 is already down. 2024-09-10T19:14:44.626 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:91: TEST_mute: ceph -s 2024-09-10T19:14:45.280 INFO:tasks.workunit.client.0.smithi038.stdout: cluster: 2024-09-10T19:14:45.281 INFO:tasks.workunit.client.0.smithi038.stdout: id: 2277e988-dfa0-4c6f-811d-ff8d20dca830 2024-09-10T19:14:45.281 INFO:tasks.workunit.client.0.smithi038.stdout: health: HEALTH_WARN 2024-09-10T19:14:45.281 INFO:tasks.workunit.client.0.smithi038.stdout: 2 osds down 2024-09-10T19:14:45.281 INFO:tasks.workunit.client.0.smithi038.stdout: (muted: OSDMAP_FLAGS) 2024-09-10T19:14:45.281 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-10T19:14:45.281 INFO:tasks.workunit.client.0.smithi038.stdout: services: 2024-09-10T19:14:45.281 INFO:tasks.workunit.client.0.smithi038.stdout: mon: 1 daemons, quorum a (age 2m) 2024-09-10T19:14:45.281 INFO:tasks.workunit.client.0.smithi038.stdout: mgr: x(active, since 2m) 2024-09-10T19:14:45.281 INFO:tasks.workunit.client.0.smithi038.stdout: osd: 3 osds: 1 up (since 0.897543s), 3 in (since 88s) 2024-09-10T19:14:45.281 INFO:tasks.workunit.client.0.smithi038.stdout: flags noup 2024-09-10T19:14:45.281 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-10T19:14:45.281 INFO:tasks.workunit.client.0.smithi038.stdout: data: 2024-09-10T19:14:45.282 INFO:tasks.workunit.client.0.smithi038.stdout: pools: 1 pools, 8 pgs 2024-09-10T19:14:45.282 INFO:tasks.workunit.client.0.smithi038.stdout: objects: 0 objects, 0 B 2024-09-10T19:14:45.282 INFO:tasks.workunit.client.0.smithi038.stdout: usage: 80 MiB used, 300 GiB / 300 GiB avail 2024-09-10T19:14:45.282 INFO:tasks.workunit.client.0.smithi038.stdout: pgs: 8 active+clean 2024-09-10T19:14:45.282 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-10T19:14:45.292 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:92: TEST_mute: ceph health detail 2024-09-10T19:14:45.292 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:92: TEST_mute: grep OSD_DOWN 2024-09-10T19:14:45.845 INFO:tasks.workunit.client.0.smithi038.stdout:[WRN] OSD_DOWN: 2 osds down 2024-09-10T19:14:45.845 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:94: TEST_mute: ceph health mute OSD_DOWN 2024-09-10T19:14:46.710 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:95: TEST_mute: kill_daemons td/health-mute TERM osd.0 2024-09-10T19:14:46.711 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-10T19:14:46.711 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-10T19:14:46.711 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-10T19:14:46.711 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-10T19:14:46.711 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-10T19:14:46.817 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-10T19:14:46.817 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:96: TEST_mute: ceph osd unset noup 2024-09-10T19:14:47.426 INFO:tasks.workunit.client.0.smithi038.stderr:noup is unset 2024-09-10T19:14:47.437 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:97: TEST_mute: sleep 10 2024-09-10T19:14:57.439 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:98: TEST_mute: ceph -s 2024-09-10T19:14:57.993 INFO:tasks.workunit.client.0.smithi038.stdout: cluster: 2024-09-10T19:14:57.993 INFO:tasks.workunit.client.0.smithi038.stdout: id: 2277e988-dfa0-4c6f-811d-ff8d20dca830 2024-09-10T19:14:57.993 INFO:tasks.workunit.client.0.smithi038.stdout: health: HEALTH_OK 2024-09-10T19:14:57.993 INFO:tasks.workunit.client.0.smithi038.stdout: (muted: OSDMAP_FLAGS OSD_DOWN) 2024-09-10T19:14:57.993 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-10T19:14:57.993 INFO:tasks.workunit.client.0.smithi038.stdout: services: 2024-09-10T19:14:57.993 INFO:tasks.workunit.client.0.smithi038.stdout: mon: 1 daemons, quorum a (age 2m) 2024-09-10T19:14:57.994 INFO:tasks.workunit.client.0.smithi038.stdout: mgr: x(active, since 2m) 2024-09-10T19:14:57.994 INFO:tasks.workunit.client.0.smithi038.stdout: osd: 3 osds: 2 up (since 10s), 3 in (since 100s) 2024-09-10T19:14:57.994 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-10T19:14:57.994 INFO:tasks.workunit.client.0.smithi038.stdout: data: 2024-09-10T19:14:57.994 INFO:tasks.workunit.client.0.smithi038.stdout: pools: 1 pools, 8 pgs 2024-09-10T19:14:57.994 INFO:tasks.workunit.client.0.smithi038.stdout: objects: 0 objects, 0 B 2024-09-10T19:14:57.994 INFO:tasks.workunit.client.0.smithi038.stdout: usage: 80 MiB used, 300 GiB / 300 GiB avail 2024-09-10T19:14:57.994 INFO:tasks.workunit.client.0.smithi038.stdout: pgs: 8 active+undersized 2024-09-10T19:14:57.994 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-10T19:14:58.005 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:99: TEST_mute: ceph health detail 2024-09-10T19:14:58.005 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:99: TEST_mute: grep OSD_DOWN 2024-09-10T19:14:58.553 INFO:tasks.workunit.client.0.smithi038.stdout:HEALTH_OK (muted: OSDMAP_FLAGS OSD_DOWN) 2024-09-10T19:14:58.554 INFO:tasks.workunit.client.0.smithi038.stdout:(MUTED) [WRN] OSD_DOWN: 1 osds down 2024-09-10T19:14:58.554 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:100: TEST_mute: ceph health detail 2024-09-10T19:14:58.554 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:100: TEST_mute: grep '1 osds down' 2024-09-10T19:14:59.127 INFO:tasks.workunit.client.0.smithi038.stdout:(MUTED) [WRN] OSD_DOWN: 1 osds down 2024-09-10T19:14:59.127 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:101: TEST_mute: ceph health 2024-09-10T19:14:59.127 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:101: TEST_mute: grep HEALTH_OK 2024-09-10T19:14:59.628 INFO:tasks.workunit.client.0.smithi038.stdout:HEALTH_OK (muted: OSDMAP_FLAGS OSD_DOWN) 2024-09-10T19:14:59.628 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:103: TEST_mute: sleep 10 2024-09-10T19:15:09.630 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:104: TEST_mute: ceph osd set noup 2024-09-10T19:15:10.242 INFO:tasks.workunit.client.0.smithi038.stderr:noup is set 2024-09-10T19:15:10.254 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:105: TEST_mute: ceph health mute OSDMAP_FLAGS 2024-09-10T19:15:11.160 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:106: TEST_mute: ceph -s 2024-09-10T19:15:11.697 INFO:tasks.workunit.client.0.smithi038.stdout: cluster: 2024-09-10T19:15:11.697 INFO:tasks.workunit.client.0.smithi038.stdout: id: 2277e988-dfa0-4c6f-811d-ff8d20dca830 2024-09-10T19:15:11.697 INFO:tasks.workunit.client.0.smithi038.stdout: health: HEALTH_OK 2024-09-10T19:15:11.697 INFO:tasks.workunit.client.0.smithi038.stdout: (muted: OSDMAP_FLAGS OSD_DOWN) 2024-09-10T19:15:11.697 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-10T19:15:11.697 INFO:tasks.workunit.client.0.smithi038.stdout: services: 2024-09-10T19:15:11.697 INFO:tasks.workunit.client.0.smithi038.stdout: mon: 1 daemons, quorum a (age 3m) 2024-09-10T19:15:11.698 INFO:tasks.workunit.client.0.smithi038.stdout: mgr: x(active, since 2m) 2024-09-10T19:15:11.698 INFO:tasks.workunit.client.0.smithi038.stdout: osd: 3 osds: 2 up (since 24s), 3 in (since 114s) 2024-09-10T19:15:11.698 INFO:tasks.workunit.client.0.smithi038.stdout: flags noup 2024-09-10T19:15:11.698 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-10T19:15:11.698 INFO:tasks.workunit.client.0.smithi038.stdout: data: 2024-09-10T19:15:11.698 INFO:tasks.workunit.client.0.smithi038.stdout: pools: 1 pools, 8 pgs 2024-09-10T19:15:11.698 INFO:tasks.workunit.client.0.smithi038.stdout: objects: 0 objects, 0 B 2024-09-10T19:15:11.698 INFO:tasks.workunit.client.0.smithi038.stdout: usage: 80 MiB used, 300 GiB / 300 GiB avail 2024-09-10T19:15:11.698 INFO:tasks.workunit.client.0.smithi038.stdout: pgs: 8 active+undersized 2024-09-10T19:15:11.698 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-10T19:15:11.708 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:107: TEST_mute: ceph health detail 2024-09-10T19:15:12.262 INFO:tasks.workunit.client.0.smithi038.stdout:HEALTH_OK (muted: OSDMAP_FLAGS OSD_DOWN) 2024-09-10T19:15:12.262 INFO:tasks.workunit.client.0.smithi038.stdout:(MUTED) [WRN] OSDMAP_FLAGS: noup flag(s) set 2024-09-10T19:15:12.262 INFO:tasks.workunit.client.0.smithi038.stdout:(MUTED) [WRN] OSD_DOWN: 1 osds down 2024-09-10T19:15:12.262 INFO:tasks.workunit.client.0.smithi038.stdout: osd.0 (root=default,host=smithi038) is down 2024-09-10T19:15:12.273 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:108: TEST_mute: ceph health 2024-09-10T19:15:12.274 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:108: TEST_mute: grep HEALTH_OK 2024-09-10T19:15:12.766 INFO:tasks.workunit.client.0.smithi038.stdout:HEALTH_OK (muted: OSDMAP_FLAGS OSD_DOWN) 2024-09-10T19:15:12.766 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:110: TEST_mute: ceph osd down 1 2024-09-10T19:15:13.283 INFO:tasks.workunit.client.0.smithi038.stderr:osd.1 is already down. 2024-09-10T19:15:13.295 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:111: TEST_mute: ceph -s 2024-09-10T19:15:13.942 INFO:tasks.workunit.client.0.smithi038.stdout: cluster: 2024-09-10T19:15:13.942 INFO:tasks.workunit.client.0.smithi038.stdout: id: 2277e988-dfa0-4c6f-811d-ff8d20dca830 2024-09-10T19:15:13.942 INFO:tasks.workunit.client.0.smithi038.stdout: health: HEALTH_OK 2024-09-10T19:15:13.942 INFO:tasks.workunit.client.0.smithi038.stdout: (muted: OSDMAP_FLAGS OSD_DOWN) 2024-09-10T19:15:13.942 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-10T19:15:13.942 INFO:tasks.workunit.client.0.smithi038.stdout: services: 2024-09-10T19:15:13.942 INFO:tasks.workunit.client.0.smithi038.stdout: mon: 1 daemons, quorum a (age 3m) 2024-09-10T19:15:13.942 INFO:tasks.workunit.client.0.smithi038.stdout: mgr: x(active, since 3m) 2024-09-10T19:15:13.942 INFO:tasks.workunit.client.0.smithi038.stdout: osd: 3 osds: 1 up (since 0.840666s), 3 in (since 116s) 2024-09-10T19:15:13.942 INFO:tasks.workunit.client.0.smithi038.stdout: flags noup 2024-09-10T19:15:13.942 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-10T19:15:13.943 INFO:tasks.workunit.client.0.smithi038.stdout: data: 2024-09-10T19:15:13.943 INFO:tasks.workunit.client.0.smithi038.stdout: pools: 1 pools, 8 pgs 2024-09-10T19:15:13.943 INFO:tasks.workunit.client.0.smithi038.stdout: objects: 0 objects, 0 B 2024-09-10T19:15:13.943 INFO:tasks.workunit.client.0.smithi038.stdout: usage: 80 MiB used, 300 GiB / 300 GiB avail 2024-09-10T19:15:13.943 INFO:tasks.workunit.client.0.smithi038.stdout: pgs: 8 active+undersized 2024-09-10T19:15:13.943 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-10T19:15:13.956 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:112: TEST_mute: ceph health detail 2024-09-10T19:15:14.543 INFO:tasks.workunit.client.0.smithi038.stdout:HEALTH_OK (muted: OSDMAP_FLAGS OSD_DOWN) 2024-09-10T19:15:14.543 INFO:tasks.workunit.client.0.smithi038.stdout:(MUTED) [WRN] OSDMAP_FLAGS: noup flag(s) set 2024-09-10T19:15:14.543 INFO:tasks.workunit.client.0.smithi038.stdout:(MUTED) [WRN] OSD_DOWN: 2 osds down 2024-09-10T19:15:14.544 INFO:tasks.workunit.client.0.smithi038.stdout: osd.0 (root=default,host=smithi038) is down 2024-09-10T19:15:14.544 INFO:tasks.workunit.client.0.smithi038.stdout: osd.1 (root=default,host=smithi038) is down 2024-09-10T19:15:14.555 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:113: TEST_mute: ceph health detail 2024-09-10T19:15:14.556 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:113: TEST_mute: grep '2 osds down' 2024-09-10T19:15:15.150 INFO:tasks.workunit.client.0.smithi038.stdout:(MUTED) [WRN] OSD_DOWN: 2 osds down 2024-09-10T19:15:15.150 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:115: TEST_mute: sleep 10 2024-09-10T19:15:25.151 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:116: TEST_mute: ceph -s 2024-09-10T19:15:25.695 INFO:tasks.workunit.client.0.smithi038.stdout: cluster: 2024-09-10T19:15:25.695 INFO:tasks.workunit.client.0.smithi038.stdout: id: 2277e988-dfa0-4c6f-811d-ff8d20dca830 2024-09-10T19:15:25.695 INFO:tasks.workunit.client.0.smithi038.stdout: health: HEALTH_WARN 2024-09-10T19:15:25.695 INFO:tasks.workunit.client.0.smithi038.stdout: 2 osds down 2024-09-10T19:15:25.695 INFO:tasks.workunit.client.0.smithi038.stdout: (muted: OSDMAP_FLAGS) 2024-09-10T19:15:25.695 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-10T19:15:25.695 INFO:tasks.workunit.client.0.smithi038.stdout: services: 2024-09-10T19:15:25.696 INFO:tasks.workunit.client.0.smithi038.stdout: mon: 1 daemons, quorum a (age 3m) 2024-09-10T19:15:25.696 INFO:tasks.workunit.client.0.smithi038.stdout: mgr: x(active, since 3m) 2024-09-10T19:15:25.696 INFO:tasks.workunit.client.0.smithi038.stdout: osd: 3 osds: 1 up (since 12s), 3 in (since 2m) 2024-09-10T19:15:25.696 INFO:tasks.workunit.client.0.smithi038.stdout: flags noup 2024-09-10T19:15:25.696 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-10T19:15:25.696 INFO:tasks.workunit.client.0.smithi038.stdout: data: 2024-09-10T19:15:25.696 INFO:tasks.workunit.client.0.smithi038.stdout: pools: 1 pools, 8 pgs 2024-09-10T19:15:25.696 INFO:tasks.workunit.client.0.smithi038.stdout: objects: 0 objects, 0 B 2024-09-10T19:15:25.696 INFO:tasks.workunit.client.0.smithi038.stdout: usage: 80 MiB used, 300 GiB / 300 GiB avail 2024-09-10T19:15:25.696 INFO:tasks.workunit.client.0.smithi038.stdout: pgs: 100.000% pgs not active 2024-09-10T19:15:25.696 INFO:tasks.workunit.client.0.smithi038.stdout: 8 undersized+peered 2024-09-10T19:15:25.696 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-10T19:15:25.706 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:117: TEST_mute: ceph health detail 2024-09-10T19:15:26.253 INFO:tasks.workunit.client.0.smithi038.stdout:HEALTH_WARN 2 osds down; (muted: OSDMAP_FLAGS) 2024-09-10T19:15:26.253 INFO:tasks.workunit.client.0.smithi038.stdout:(MUTED) [WRN] OSDMAP_FLAGS: noup flag(s) set 2024-09-10T19:15:26.253 INFO:tasks.workunit.client.0.smithi038.stdout:[WRN] OSD_DOWN: 2 osds down 2024-09-10T19:15:26.253 INFO:tasks.workunit.client.0.smithi038.stdout: osd.0 (root=default,host=smithi038) is down 2024-09-10T19:15:26.253 INFO:tasks.workunit.client.0.smithi038.stdout: osd.1 (root=default,host=smithi038) is down 2024-09-10T19:15:26.264 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:118: TEST_mute: ceph health 2024-09-10T19:15:26.264 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:118: TEST_mute: grep HEALTH_WARN 2024-09-10T19:15:26.765 INFO:tasks.workunit.client.0.smithi038.stdout:HEALTH_WARN 2 osds down; (muted: OSDMAP_FLAGS) 2024-09-10T19:15:26.766 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:119: TEST_mute: ceph health detail 2024-09-10T19:15:26.766 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:119: TEST_mute: grep '2 osds down' 2024-09-10T19:15:27.313 INFO:tasks.workunit.client.0.smithi038.stdout:HEALTH_WARN 2 osds down; (muted: OSDMAP_FLAGS) 2024-09-10T19:15:27.313 INFO:tasks.workunit.client.0.smithi038.stdout:[WRN] OSD_DOWN: 2 osds down 2024-09-10T19:15:27.314 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:121: TEST_mute: teardown td/health-mute 2024-09-10T19:15:27.314 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/health-mute 2024-09-10T19:15:27.314 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-10T19:15:27.314 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/health-mute KILL 2024-09-10T19:15:27.315 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-10T19:15:27.315 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-10T19:15:27.315 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-10T19:15:27.315 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-10T19:15:27.315 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-10T19:15:27.422 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-10T19:15:27.422 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-10T19:15:27.423 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-10T19:15:27.423 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-10T19:15:27.424 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-10T19:15:27.425 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-10T19:15:27.425 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-10T19:15:27.425 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T19:15:27.426 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-10T19:15:27.426 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-10T19:15:27.426 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T19:15:27.426 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-10T19:15:27.427 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-10T19:15:27.427 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/health-mute 2024-09-10T19:15:27.444 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-10T19:15:27.444 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:15:27.444 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.27297 2024-09-10T19:15:27.444 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.27297 2024-09-10T19:15:27.446 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-10T19:15:27.446 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-10T19:15:27.446 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:18: run: teardown td/health-mute 2024-09-10T19:15:27.446 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/health-mute 2024-09-10T19:15:27.446 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-10T19:15:27.446 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/health-mute KILL 2024-09-10T19:15:27.446 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-10T19:15:27.446 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-10T19:15:27.446 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-10T19:15:27.446 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-10T19:15:27.447 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-10T19:15:27.447 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-10T19:15:27.448 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-10T19:15:27.448 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-10T19:15:27.449 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-10T19:15:27.450 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-10T19:15:27.450 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-10T19:15:27.450 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-10T19:15:27.451 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T19:15:27.451 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-10T19:15:27.451 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-10T19:15:27.451 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T19:15:27.452 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-10T19:15:27.453 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-10T19:15:27.453 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/health-mute 2024-09-10T19:15:27.454 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-10T19:15:27.455 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:15:27.455 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.27297 2024-09-10T19:15:27.455 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.27297 2024-09-10T19:15:27.456 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-10T19:15:27.456 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-10T19:15:27.456 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2322: main: code=0 2024-09-10T19:15:27.456 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2326: main: teardown td/health-mute 0 2024-09-10T19:15:27.457 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/health-mute 2024-09-10T19:15:27.457 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2024-09-10T19:15:27.457 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/health-mute KILL 2024-09-10T19:15:27.457 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-10T19:15:27.457 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-10T19:15:27.457 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-10T19:15:27.457 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-10T19:15:27.457 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-10T19:15:27.458 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-10T19:15:27.458 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-10T19:15:27.459 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-10T19:15:27.459 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-10T19:15:27.460 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-10T19:15:27.460 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-10T19:15:27.460 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-10T19:15:27.461 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T19:15:27.461 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-10T19:15:27.462 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-10T19:15:27.462 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T19:15:27.462 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-10T19:15:27.463 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2024-09-10T19:15:27.463 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/health-mute 2024-09-10T19:15:27.465 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-10T19:15:27.465 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:15:27.465 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.27297 2024-09-10T19:15:27.465 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.27297 2024-09-10T19:15:27.466 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-10T19:15:27.466 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-10T19:15:27.466 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2327: main: return 0 2024-09-10T19:15:27.467 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-10T19:15:27.467 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-10T19:15:27.532 INFO:tasks.workunit:Running workunit mon/misc.sh... 2024-09-10T19:15:27.533 DEBUG:teuthology.orchestra.run.smithi038:workunit test mon/misc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad1f558c327094897e4a32e99dd5cb4ae6ccd46 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh 2024-09-10T19:15:27.595 INFO:tasks.workunit.client.0.smithi038.stderr:stty: 'standard input': Inappropriate ioctl for device 2024-09-10T19:15:27.601 INFO:tasks.workunit.client.0.smithi038.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2024-09-10T19:15:27.601 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2315: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-10T19:15:27.601 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2315: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-10T19:15:27.601 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2316: main: export PYTHONWARNINGS=ignore 2024-09-10T19:15:27.601 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2316: main: PYTHONWARNINGS=ignore 2024-09-10T19:15:27.601 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2317: main: export CEPH_CONF=/dev/null 2024-09-10T19:15:27.601 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2317: main: CEPH_CONF=/dev/null 2024-09-10T19:15:27.601 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2318: main: unset CEPH_ARGS 2024-09-10T19:15:27.601 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2320: main: local code 2024-09-10T19:15:27.601 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2321: main: run td/misc 2024-09-10T19:15:27.601 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:21: run: local dir=td/misc 2024-09-10T19:15:27.602 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:22: run: shift 2024-09-10T19:15:27.602 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:24: run: export CEPH_MON=127.0.0.1:7102 2024-09-10T19:15:27.602 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:24: run: CEPH_MON=127.0.0.1:7102 2024-09-10T19:15:27.602 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:25: run: export CEPH_ARGS 2024-09-10T19:15:27.602 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:26: run: uuidgen 2024-09-10T19:15:27.602 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:26: run: CEPH_ARGS+='--fsid=739e6d7e-7176-49ef-a7fb-e0c6ca46bee8 --auth-supported=none ' 2024-09-10T19:15:27.602 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:27: run: CEPH_ARGS+='--mon-host=127.0.0.1:7102 ' 2024-09-10T19:15:27.603 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:29: run: set 2024-09-10T19:15:27.603 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:29: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2024-09-10T19:15:27.603 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:29: run: local 'funcs=TEST_mon_add_to_single_mon 2024-09-10T19:15:27.604 INFO:tasks.workunit.client.0.smithi038.stderr:TEST_mon_features 2024-09-10T19:15:27.604 INFO:tasks.workunit.client.0.smithi038.stderr:TEST_no_segfault_for_bad_keyring 2024-09-10T19:15:27.604 INFO:tasks.workunit.client.0.smithi038.stderr:TEST_osd_pool_get_set' 2024-09-10T19:15:27.604 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:30: run: for func in $funcs 2024-09-10T19:15:27.604 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:31: run: TEST_mon_add_to_single_mon td/misc 2024-09-10T19:15:27.604 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:105: TEST_mon_add_to_single_mon: local dir=td/misc 2024-09-10T19:15:27.604 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:107: TEST_mon_add_to_single_mon: uuidgen 2024-09-10T19:15:27.606 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:107: TEST_mon_add_to_single_mon: fsid=4bcb290d-a536-42b9-96b2-d16eb66370b9 2024-09-10T19:15:27.606 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:108: TEST_mon_add_to_single_mon: MONA=127.0.0.1:7117 2024-09-10T19:15:27.606 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:109: TEST_mon_add_to_single_mon: MONB=127.0.0.1:7118 2024-09-10T19:15:27.606 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:110: TEST_mon_add_to_single_mon: CEPH_ARGS_orig='--fsid=739e6d7e-7176-49ef-a7fb-e0c6ca46bee8 --auth-supported=none --mon-host=127.0.0.1:7102 ' 2024-09-10T19:15:27.606 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:111: TEST_mon_add_to_single_mon: CEPH_ARGS='--fsid=4bcb290d-a536-42b9-96b2-d16eb66370b9 --auth-supported=none ' 2024-09-10T19:15:27.606 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:112: TEST_mon_add_to_single_mon: CEPH_ARGS+='--mon-initial-members=a ' 2024-09-10T19:15:27.606 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:113: TEST_mon_add_to_single_mon: CEPH_ARGS+='--mon-host=127.0.0.1:7117 ' 2024-09-10T19:15:27.606 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:115: TEST_mon_add_to_single_mon: setup td/misc 2024-09-10T19:15:27.606 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/misc 2024-09-10T19:15:27.607 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/misc 2024-09-10T19:15:27.607 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/misc 2024-09-10T19:15:27.607 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-10T19:15:27.607 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/misc KILL 2024-09-10T19:15:27.607 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-10T19:15:27.607 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-10T19:15:27.607 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-10T19:15:27.607 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-10T19:15:27.607 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-10T19:15:27.608 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-10T19:15:27.608 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-10T19:15:27.608 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-10T19:15:27.608 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-10T19:15:27.609 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-10T19:15:27.609 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-10T19:15:27.609 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-10T19:15:27.609 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T19:15:27.610 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-10T19:15:27.610 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-10T19:15:27.610 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T19:15:27.610 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-10T19:15:27.611 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-10T19:15:27.612 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/misc 2024-09-10T19:15:27.614 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-10T19:15:27.614 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:15:27.614 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.34782 2024-09-10T19:15:27.614 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.34782 2024-09-10T19:15:27.614 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-10T19:15:27.614 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-10T19:15:27.614 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/misc 2024-09-10T19:15:27.615 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-10T19:15:27.615 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:15:27.615 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.34782 2024-09-10T19:15:27.615 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.34782 2024-09-10T19:15:27.617 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-10T19:15:27.617 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2024-09-10T19:15:27.617 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2024-09-10T19:15:27.617 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-10T19:15:27.617 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/misc 1' TERM HUP INT 2024-09-10T19:15:27.618 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:116: TEST_mon_add_to_single_mon: run_mon td/misc a --public-addr 127.0.0.1:7117 2024-09-10T19:15:27.618 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/misc 2024-09-10T19:15:27.618 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-10T19:15:27.618 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-10T19:15:27.618 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-10T19:15:27.618 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/misc/a 2024-09-10T19:15:27.618 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/misc/a --run-dir=td/misc --public-addr 127.0.0.1:7117 2024-09-10T19:15:28.067 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-10T19:15:28.067 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-10T19:15:28.067 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-10T19:15:28.067 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-10T19:15:28.067 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:15:28.068 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.34782 2024-09-10T19:15:28.068 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.34782/$cluster-$name.asok' 2024-09-10T19:15:28.068 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/misc/a '--log-file=td/misc/$name.log' '--admin-socket=/tmp/ceph-asok.34782/$cluster-$name.asok' --mon-cluster-log-file=td/misc/log --run-dir=td/misc '--pid-file=td/misc/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr 127.0.0.1:7117 2024-09-10T19:15:28.269 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-10T19:15:28.272 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-10T19:15:28.273 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-10T19:15:28.273 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-10T19:15:28.273 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-10T19:15:28.273 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-10T19:15:28.273 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-10T19:15:28.273 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-10T19:15:28.273 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-10T19:15:28.273 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-10T19:15:28.273 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:15:28.273 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.34782 2024-09-10T19:15:28.273 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.34782/ceph-mon.a.asok 2024-09-10T19:15:28.274 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-10T19:15:28.274 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.34782/ceph-mon.a.asok config get fsid 2024-09-10T19:15:28.354 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-10T19:15:28.355 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-10T19:15:28.355 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-10T19:15:28.355 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-10T19:15:28.355 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-10T19:15:28.355 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-10T19:15:28.355 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-10T19:15:28.355 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-10T19:15:28.355 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-10T19:15:28.355 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:15:28.355 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.34782 2024-09-10T19:15:28.355 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.34782/ceph-mon.a.asok 2024-09-10T19:15:28.355 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-10T19:15:28.355 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.34782/ceph-mon.a.asok config get mon_host 2024-09-10T19:15:28.436 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:118: TEST_mon_add_to_single_mon: timeout 120 ceph -s 2024-09-10T19:15:29.236 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:119: TEST_mon_add_to_single_mon: run_mon td/misc b --public-addr 127.0.0.1:7118 2024-09-10T19:15:29.236 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/misc 2024-09-10T19:15:29.236 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-10T19:15:29.236 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=b 2024-09-10T19:15:29.236 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-10T19:15:29.236 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/misc/b 2024-09-10T19:15:29.236 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id b --mkfs --mon-data=td/misc/b --run-dir=td/misc --public-addr 127.0.0.1:7118 2024-09-10T19:15:29.775 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-10T19:15:29.775 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-10T19:15:29.775 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-10T19:15:29.775 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-10T19:15:29.775 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:15:29.775 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.34782 2024-09-10T19:15:29.776 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.34782/$cluster-$name.asok' 2024-09-10T19:15:29.776 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id b --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/misc/b '--log-file=td/misc/$name.log' '--admin-socket=/tmp/ceph-asok.34782/$cluster-$name.asok' --mon-cluster-log-file=td/misc/log --run-dir=td/misc '--pid-file=td/misc/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr 127.0.0.1:7118 2024-09-10T19:15:29.968 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-10T19:15:29.970 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon b fsid 2024-09-10T19:15:29.970 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-10T19:15:29.970 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=b 2024-09-10T19:15:29.970 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-10T19:15:29.970 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-10T19:15:29.970 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.b 2024-09-10T19:15:29.970 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.b 2024-09-10T19:15:29.970 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.b ']' 2024-09-10T19:15:29.970 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-10T19:15:29.970 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:15:29.970 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.34782 2024-09-10T19:15:29.970 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.34782/ceph-mon.b.asok 2024-09-10T19:15:29.971 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-10T19:15:29.971 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.34782/ceph-mon.b.asok config get fsid 2024-09-10T19:15:30.055 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon b mon_host 2024-09-10T19:15:30.055 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-10T19:15:30.055 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=b 2024-09-10T19:15:30.055 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-10T19:15:30.055 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-10T19:15:30.056 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.b 2024-09-10T19:15:30.056 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.b 2024-09-10T19:15:30.056 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.b ']' 2024-09-10T19:15:30.056 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-10T19:15:30.056 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:15:30.056 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.34782 2024-09-10T19:15:30.056 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.34782/ceph-mon.b.asok 2024-09-10T19:15:30.056 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-10T19:15:30.056 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.34782/ceph-mon.b.asok config get mon_host 2024-09-10T19:15:30.137 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:120: TEST_mon_add_to_single_mon: teardown td/misc 2024-09-10T19:15:30.137 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/misc 2024-09-10T19:15:30.137 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-10T19:15:30.137 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/misc KILL 2024-09-10T19:15:30.137 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-10T19:15:30.137 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-10T19:15:30.137 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-10T19:15:30.137 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-10T19:15:30.137 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-10T19:15:30.242 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-10T19:15:30.242 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-10T19:15:30.243 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-10T19:15:30.243 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-10T19:15:30.244 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-10T19:15:30.244 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-10T19:15:30.244 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-10T19:15:30.245 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T19:15:30.245 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-10T19:15:30.245 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-10T19:15:30.246 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T19:15:30.246 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-10T19:15:30.247 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-10T19:15:30.247 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/misc 2024-09-10T19:15:30.249 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-10T19:15:30.249 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:15:30.249 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.34782 2024-09-10T19:15:30.250 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.34782 2024-09-10T19:15:30.251 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-10T19:15:30.251 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-10T19:15:30.251 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:122: TEST_mon_add_to_single_mon: setup td/misc 2024-09-10T19:15:30.251 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/misc 2024-09-10T19:15:30.251 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/misc 2024-09-10T19:15:30.251 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/misc 2024-09-10T19:15:30.251 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-10T19:15:30.251 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/misc KILL 2024-09-10T19:15:30.251 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-10T19:15:30.252 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-10T19:15:30.252 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-10T19:15:30.252 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-10T19:15:30.252 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-10T19:15:30.252 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-10T19:15:30.252 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-10T19:15:30.253 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-10T19:15:30.253 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-10T19:15:30.255 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-10T19:15:30.255 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-10T19:15:30.255 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-10T19:15:30.255 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T19:15:30.255 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-10T19:15:30.256 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-10T19:15:30.256 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T19:15:30.257 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-10T19:15:30.258 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-10T19:15:30.258 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/misc 2024-09-10T19:15:30.259 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-10T19:15:30.259 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:15:30.259 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.34782 2024-09-10T19:15:30.259 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.34782 2024-09-10T19:15:30.260 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-10T19:15:30.260 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-10T19:15:30.260 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/misc 2024-09-10T19:15:30.261 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-10T19:15:30.261 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:15:30.261 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.34782 2024-09-10T19:15:30.261 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.34782 2024-09-10T19:15:30.263 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-10T19:15:30.263 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-10T19:15:30.264 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-10T19:15:30.264 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/misc 1' TERM HUP INT 2024-09-10T19:15:30.264 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:123: TEST_mon_add_to_single_mon: run_mon td/misc a --public-addr 127.0.0.1:7117 2024-09-10T19:15:30.264 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/misc 2024-09-10T19:15:30.264 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-10T19:15:30.264 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-10T19:15:30.264 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-10T19:15:30.264 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/misc/a 2024-09-10T19:15:30.264 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/misc/a --run-dir=td/misc --public-addr 127.0.0.1:7117 2024-09-10T19:15:30.722 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-10T19:15:30.722 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-10T19:15:30.722 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-10T19:15:30.722 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-10T19:15:30.722 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:15:30.722 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.34782 2024-09-10T19:15:30.722 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.34782/$cluster-$name.asok' 2024-09-10T19:15:30.722 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/misc/a '--log-file=td/misc/$name.log' '--admin-socket=/tmp/ceph-asok.34782/$cluster-$name.asok' --mon-cluster-log-file=td/misc/log --run-dir=td/misc '--pid-file=td/misc/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr 127.0.0.1:7117 2024-09-10T19:15:30.889 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-10T19:15:30.890 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-10T19:15:30.890 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-10T19:15:30.891 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-10T19:15:30.891 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-10T19:15:30.891 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-10T19:15:30.891 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-10T19:15:30.891 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-10T19:15:30.891 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-10T19:15:30.892 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-10T19:15:30.892 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:15:30.892 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.34782 2024-09-10T19:15:30.892 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.34782/ceph-mon.a.asok 2024-09-10T19:15:30.892 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-10T19:15:30.892 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.34782/ceph-mon.a.asok config get fsid 2024-09-10T19:15:30.976 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-10T19:15:30.976 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-10T19:15:30.976 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-10T19:15:30.977 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-10T19:15:30.977 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-10T19:15:30.977 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-10T19:15:30.977 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-10T19:15:30.977 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-10T19:15:30.977 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-10T19:15:30.977 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:15:30.977 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.34782 2024-09-10T19:15:30.977 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.34782/ceph-mon.a.asok 2024-09-10T19:15:30.978 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-10T19:15:30.978 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.34782/ceph-mon.a.asok config get mon_host 2024-09-10T19:15:31.058 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:126: TEST_mon_add_to_single_mon: run_mon td/misc b --public-addr 127.0.0.1:7118 2024-09-10T19:15:31.058 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/misc 2024-09-10T19:15:31.058 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-10T19:15:31.058 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=b 2024-09-10T19:15:31.058 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-10T19:15:31.058 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/misc/b 2024-09-10T19:15:31.058 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id b --mkfs --mon-data=td/misc/b --run-dir=td/misc --public-addr 127.0.0.1:7118 2024-09-10T19:15:31.912 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-10T19:15:31.913 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-10T19:15:31.913 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-10T19:15:31.913 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-10T19:15:31.913 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:15:31.913 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.34782 2024-09-10T19:15:31.913 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.34782/$cluster-$name.asok' 2024-09-10T19:15:31.913 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id b --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/misc/b '--log-file=td/misc/$name.log' '--admin-socket=/tmp/ceph-asok.34782/$cluster-$name.asok' --mon-cluster-log-file=td/misc/log --run-dir=td/misc '--pid-file=td/misc/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr 127.0.0.1:7118 2024-09-10T19:15:32.098 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-10T19:15:32.099 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon b fsid 2024-09-10T19:15:32.099 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-10T19:15:32.099 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=b 2024-09-10T19:15:32.099 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-10T19:15:32.100 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-10T19:15:32.100 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.b 2024-09-10T19:15:32.100 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.b 2024-09-10T19:15:32.101 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.b ']' 2024-09-10T19:15:32.101 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-10T19:15:32.101 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:15:32.101 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.34782 2024-09-10T19:15:32.101 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.34782/ceph-mon.b.asok 2024-09-10T19:15:32.101 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-10T19:15:32.101 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.34782/ceph-mon.b.asok config get fsid 2024-09-10T19:15:32.192 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon b mon_host 2024-09-10T19:15:32.192 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-10T19:15:32.193 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=b 2024-09-10T19:15:32.193 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-10T19:15:32.193 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-10T19:15:32.193 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.b 2024-09-10T19:15:32.193 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.b 2024-09-10T19:15:32.193 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.b ']' 2024-09-10T19:15:32.193 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-10T19:15:32.193 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:15:32.193 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.34782 2024-09-10T19:15:32.193 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.34782/ceph-mon.b.asok 2024-09-10T19:15:32.194 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-10T19:15:32.194 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.34782/ceph-mon.b.asok config get mon_host 2024-09-10T19:15:32.276 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:128: TEST_mon_add_to_single_mon: sleep 2 2024-09-10T19:15:34.277 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:130: TEST_mon_add_to_single_mon: timeout 120 ceph -s 2024-09-10T19:15:37.520 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:131: TEST_mon_add_to_single_mon: ceph mon dump 2024-09-10T19:15:37.763 INFO:tasks.workunit.client.0.smithi038.stdout:epoch 2 2024-09-10T19:15:37.763 INFO:tasks.workunit.client.0.smithi038.stdout:fsid 4bcb290d-a536-42b9-96b2-d16eb66370b9 2024-09-10T19:15:37.763 INFO:tasks.workunit.client.0.smithi038.stdout:last_changed 2024-09-10T19:15:32.098027+0000 2024-09-10T19:15:37.763 INFO:tasks.workunit.client.0.smithi038.stdout:created 2024-09-10T19:15:30.283654+0000 2024-09-10T19:15:37.763 INFO:tasks.workunit.client.0.smithi038.stdout:min_mon_release 19 (squid) 2024-09-10T19:15:37.763 INFO:tasks.workunit.client.0.smithi038.stdout:election_strategy: 1 2024-09-10T19:15:37.763 INFO:tasks.workunit.client.0.smithi038.stdout:0: v2:127.0.0.1:7117/0 mon.a 2024-09-10T19:15:37.763 INFO:tasks.workunit.client.0.smithi038.stdout:1: v2:127.0.0.1:7118/0 mon.b 2024-09-10T19:15:37.763 INFO:tasks.workunit.client.0.smithi038.stderr:dumped monmap epoch 2 2024-09-10T19:15:37.772 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:132: TEST_mon_add_to_single_mon: ceph mon dump -f json-pretty 2024-09-10T19:15:37.964 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-10T19:15:37.965 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-10T19:15:37.965 INFO:tasks.workunit.client.0.smithi038.stdout: "epoch": 2, 2024-09-10T19:15:37.965 INFO:tasks.workunit.client.0.smithi038.stdout: "fsid": "4bcb290d-a536-42b9-96b2-d16eb66370b9", 2024-09-10T19:15:37.965 INFO:tasks.workunit.client.0.smithi038.stdout: "modified": "2024-09-10T19:15:32.098027Z", 2024-09-10T19:15:37.965 INFO:tasks.workunit.client.0.smithi038.stdout: "created": "2024-09-10T19:15:30.283654Z", 2024-09-10T19:15:37.965 INFO:tasks.workunit.client.0.smithi038.stdout: "min_mon_release": 19, 2024-09-10T19:15:37.965 INFO:tasks.workunit.client.0.smithi038.stdout: "min_mon_release_name": "squid", 2024-09-10T19:15:37.965 INFO:tasks.workunit.client.0.smithi038.stdout: "election_strategy": 1, 2024-09-10T19:15:37.965 INFO:tasks.workunit.client.0.smithi038.stdout: "disallowed_leaders: ": "", 2024-09-10T19:15:37.965 INFO:tasks.workunit.client.0.smithi038.stdout: "stretch_mode": false, 2024-09-10T19:15:37.965 INFO:tasks.workunit.client.0.smithi038.stdout: "tiebreaker_mon": "", 2024-09-10T19:15:37.965 INFO:tasks.workunit.client.0.smithi038.stdout: "removed_ranks: ": "", 2024-09-10T19:15:37.966 INFO:tasks.workunit.client.0.smithi038.stdout: "features": { 2024-09-10T19:15:37.966 INFO:tasks.workunit.client.0.smithi038.stdout: "persistent": [ 2024-09-10T19:15:37.966 INFO:tasks.workunit.client.0.smithi038.stdout: "kraken", 2024-09-10T19:15:37.966 INFO:tasks.workunit.client.0.smithi038.stdout: "luminous", 2024-09-10T19:15:37.966 INFO:tasks.workunit.client.0.smithi038.stdout: "mimic", 2024-09-10T19:15:37.966 INFO:tasks.workunit.client.0.smithi038.stdout: "osdmap-prune", 2024-09-10T19:15:37.966 INFO:tasks.workunit.client.0.smithi038.stdout: "nautilus", 2024-09-10T19:15:37.966 INFO:tasks.workunit.client.0.smithi038.stdout: "octopus", 2024-09-10T19:15:37.966 INFO:tasks.workunit.client.0.smithi038.stdout: "pacific", 2024-09-10T19:15:37.966 INFO:tasks.workunit.client.0.smithi038.stdout: "elector-pinging", 2024-09-10T19:15:37.966 INFO:tasks.workunit.client.0.smithi038.stdout: "quincy", 2024-09-10T19:15:37.966 INFO:tasks.workunit.client.0.smithi038.stdout: "reef", 2024-09-10T19:15:37.966 INFO:tasks.workunit.client.0.smithi038.stdout: "squid" 2024-09-10T19:15:37.966 INFO:tasks.workunit.client.0.smithi038.stdout: ], 2024-09-10T19:15:37.967 INFO:tasks.workunit.client.0.smithi038.stdout: "optional": [] 2024-09-10T19:15:37.967 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-10T19:15:37.967 INFO:tasks.workunit.client.0.smithi038.stdout: "mons": [ 2024-09-10T19:15:37.967 INFO:tasks.workunit.client.0.smithi038.stdout: { 2024-09-10T19:15:37.967 INFO:tasks.workunit.client.0.smithi038.stdout: "rank": 0, 2024-09-10T19:15:37.967 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "a", 2024-09-10T19:15:37.967 INFO:tasks.workunit.client.0.smithi038.stdout: "public_addrs": { 2024-09-10T19:15:37.967 INFO:tasks.workunit.client.0.smithi038.stdout: "addrvec": [ 2024-09-10T19:15:37.967 INFO:tasks.workunit.client.0.smithi038.stdout: { 2024-09-10T19:15:37.967 INFO:tasks.workunit.client.0.smithi038.stdout: "type": "v2", 2024-09-10T19:15:37.967 INFO:tasks.workunit.client.0.smithi038.stdout: "addr": "127.0.0.1:7117", 2024-09-10T19:15:37.967 INFO:tasks.workunit.client.0.smithi038.stdout: "nonce": 0 2024-09-10T19:15:37.967 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-10T19:15:37.967 INFO:tasks.workunit.client.0.smithi038.stdout: ] 2024-09-10T19:15:37.968 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-10T19:15:37.968 INFO:tasks.workunit.client.0.smithi038.stdout: "addr": "127.0.0.1:7117/0", 2024-09-10T19:15:37.968 INFO:tasks.workunit.client.0.smithi038.stdout: "public_addr": "127.0.0.1:7117/0", 2024-09-10T19:15:37.968 INFO:tasks.workunit.client.0.smithi038.stdout: "priority": 0, 2024-09-10T19:15:37.968 INFO:tasks.workunit.client.0.smithi038.stdout: "weight": 0, 2024-09-10T19:15:37.968 INFO:tasks.workunit.client.0.smithi038.stdout: "crush_location": "{}" 2024-09-10T19:15:37.968 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-10T19:15:37.968 INFO:tasks.workunit.client.0.smithi038.stdout: { 2024-09-10T19:15:37.968 INFO:tasks.workunit.client.0.smithi038.stdout: "rank": 1, 2024-09-10T19:15:37.968 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "b", 2024-09-10T19:15:37.968 INFO:tasks.workunit.client.0.smithi038.stdout: "public_addrs": { 2024-09-10T19:15:37.968 INFO:tasks.workunit.client.0.smithi038.stdout: "addrvec": [ 2024-09-10T19:15:37.968 INFO:tasks.workunit.client.0.smithi038.stdout: { 2024-09-10T19:15:37.968 INFO:tasks.workunit.client.0.smithi038.stdout: "type": "v2", 2024-09-10T19:15:37.969 INFO:tasks.workunit.client.0.smithi038.stdout: "addr": "127.0.0.1:7118", 2024-09-10T19:15:37.969 INFO:tasks.workunit.client.0.smithi038.stdout: "nonce": 0 2024-09-10T19:15:37.969 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-10T19:15:37.969 INFO:tasks.workunit.client.0.smithi038.stdout: ] 2024-09-10T19:15:37.969 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-10T19:15:37.969 INFO:tasks.workunit.client.0.smithi038.stdout: "addr": "127.0.0.1:7118/0", 2024-09-10T19:15:37.969 INFO:tasks.workunit.client.0.smithi038.stdout: "public_addr": "127.0.0.1:7118/0", 2024-09-10T19:15:37.969 INFO:tasks.workunit.client.0.smithi038.stdout: "priority": 0, 2024-09-10T19:15:37.969 INFO:tasks.workunit.client.0.smithi038.stdout: "weight": 0, 2024-09-10T19:15:37.969 INFO:tasks.workunit.client.0.smithi038.stdout: "crush_location": "{}" 2024-09-10T19:15:37.969 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-10T19:15:37.969 INFO:tasks.workunit.client.0.smithi038.stdout: ], 2024-09-10T19:15:37.969 INFO:tasks.workunit.client.0.smithi038.stdout: "quorum": [ 2024-09-10T19:15:37.969 INFO:tasks.workunit.client.0.smithi038.stdout: 0, 2024-09-10T19:15:37.970 INFO:tasks.workunit.client.0.smithi038.stdout: 1 2024-09-10T19:15:37.970 INFO:tasks.workunit.client.0.smithi038.stdout: ] 2024-09-10T19:15:37.970 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-10T19:15:37.970 INFO:tasks.workunit.client.0.smithi038.stderr:dumped monmap epoch 2 2024-09-10T19:15:37.974 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:133: TEST_mon_add_to_single_mon: local num_mons 2024-09-10T19:15:37.974 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:134: TEST_mon_add_to_single_mon: ceph mon dump --format=json 2024-09-10T19:15:37.975 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:134: TEST_mon_add_to_single_mon: jq '.mons | length' 2024-09-10T19:15:38.232 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:134: TEST_mon_add_to_single_mon: num_mons=2 2024-09-10T19:15:38.233 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:135: TEST_mon_add_to_single_mon: '[' 2 == 2 ']' 2024-09-10T19:15:38.233 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:137: TEST_mon_add_to_single_mon: timeout 120 ceph mon add b 127.0.0.1:7118 2024-09-10T19:15:38.541 INFO:tasks.workunit.client.0.smithi038.stderr:mon.b at v2:127.0.0.1:7118/0 already exists 2024-09-10T19:15:38.551 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:138: TEST_mon_add_to_single_mon: teardown td/misc 2024-09-10T19:15:38.551 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/misc 2024-09-10T19:15:38.551 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-10T19:15:38.551 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/misc KILL 2024-09-10T19:15:38.552 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-10T19:15:38.552 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-10T19:15:38.552 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-10T19:15:38.552 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-10T19:15:38.552 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-10T19:15:38.657 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-10T19:15:38.657 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-10T19:15:38.657 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-10T19:15:38.658 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-10T19:15:38.659 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-10T19:15:38.659 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-10T19:15:38.659 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-10T19:15:38.660 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T19:15:38.660 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-10T19:15:38.660 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-10T19:15:38.661 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T19:15:38.661 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-10T19:15:38.662 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-10T19:15:38.662 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/misc 2024-09-10T19:15:38.664 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-10T19:15:38.664 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:15:38.664 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.34782 2024-09-10T19:15:38.665 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.34782 2024-09-10T19:15:38.666 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-10T19:15:38.666 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-10T19:15:38.666 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:30: run: for func in $funcs 2024-09-10T19:15:38.667 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:31: run: TEST_mon_features td/misc 2024-09-10T19:15:38.667 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:163: TEST_mon_features: local dir=td/misc 2024-09-10T19:15:38.667 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:164: TEST_mon_features: setup td/misc 2024-09-10T19:15:38.667 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/misc 2024-09-10T19:15:38.667 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/misc 2024-09-10T19:15:38.667 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/misc 2024-09-10T19:15:38.667 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-10T19:15:38.667 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/misc KILL 2024-09-10T19:15:38.667 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-10T19:15:38.667 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-10T19:15:38.667 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-10T19:15:38.667 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-10T19:15:38.667 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-10T19:15:38.668 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-10T19:15:38.668 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-10T19:15:38.668 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-10T19:15:38.669 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-10T19:15:38.670 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-10T19:15:38.670 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-10T19:15:38.670 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-10T19:15:38.671 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T19:15:38.671 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-10T19:15:38.671 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-10T19:15:38.671 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T19:15:38.672 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-10T19:15:38.673 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-10T19:15:38.673 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/misc 2024-09-10T19:15:38.674 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-10T19:15:38.674 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:15:38.674 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.34782 2024-09-10T19:15:38.675 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.34782 2024-09-10T19:15:38.675 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-10T19:15:38.675 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-10T19:15:38.676 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/misc 2024-09-10T19:15:38.677 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-10T19:15:38.677 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:15:38.677 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.34782 2024-09-10T19:15:38.677 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.34782 2024-09-10T19:15:38.678 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-10T19:15:38.679 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-10T19:15:38.679 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-10T19:15:38.679 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/misc 1' TERM HUP INT 2024-09-10T19:15:38.679 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:166: TEST_mon_features: uuidgen 2024-09-10T19:15:38.682 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:166: TEST_mon_features: fsid=05aa0188-6640-4b22-90a8-6474e6dff87e 2024-09-10T19:15:38.682 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:167: TEST_mon_features: MONA=127.0.0.1:7127 2024-09-10T19:15:38.682 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:168: TEST_mon_features: MONB=127.0.0.1:7128 2024-09-10T19:15:38.682 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:169: TEST_mon_features: MONC=127.0.0.1:7129 2024-09-10T19:15:38.682 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:170: TEST_mon_features: CEPH_ARGS_orig='--fsid=4bcb290d-a536-42b9-96b2-d16eb66370b9 --auth-supported=none --mon-initial-members=a --mon-host=127.0.0.1:7117 ' 2024-09-10T19:15:38.682 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:171: TEST_mon_features: CEPH_ARGS='--fsid=05aa0188-6640-4b22-90a8-6474e6dff87e --auth-supported=none ' 2024-09-10T19:15:38.682 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:172: TEST_mon_features: CEPH_ARGS+='--mon-host=127.0.0.1:7127,127.0.0.1:7128,127.0.0.1:7129 ' 2024-09-10T19:15:38.682 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:173: TEST_mon_features: CEPH_ARGS+='--mon-debug-no-initial-persistent-features ' 2024-09-10T19:15:38.683 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:174: TEST_mon_features: CEPH_ARGS+='--mon-debug-no-require-squid ' 2024-09-10T19:15:38.683 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:176: TEST_mon_features: run_mon td/misc a --public-addr 127.0.0.1:7127 2024-09-10T19:15:38.683 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/misc 2024-09-10T19:15:38.683 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-10T19:15:38.683 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-10T19:15:38.683 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-10T19:15:38.683 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/misc/a 2024-09-10T19:15:38.684 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/misc/a --run-dir=td/misc --public-addr 127.0.0.1:7127 2024-09-10T19:15:39.099 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-10T19:15:39.099 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-10T19:15:39.099 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-10T19:15:39.099 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-10T19:15:39.099 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:15:39.099 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.34782 2024-09-10T19:15:39.099 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.34782/$cluster-$name.asok' 2024-09-10T19:15:39.099 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/misc/a '--log-file=td/misc/$name.log' '--admin-socket=/tmp/ceph-asok.34782/$cluster-$name.asok' --mon-cluster-log-file=td/misc/log --run-dir=td/misc '--pid-file=td/misc/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr 127.0.0.1:7127 2024-09-10T19:15:39.291 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-10T19:15:39.293 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-10T19:15:39.293 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-10T19:15:39.293 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-10T19:15:39.293 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-10T19:15:39.293 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-10T19:15:39.293 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-10T19:15:39.293 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-10T19:15:39.293 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-10T19:15:39.294 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-10T19:15:39.294 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:15:39.294 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.34782 2024-09-10T19:15:39.294 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.34782/ceph-mon.a.asok 2024-09-10T19:15:39.294 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-10T19:15:39.295 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.34782/ceph-mon.a.asok config get fsid 2024-09-10T19:15:39.376 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-10T19:15:39.376 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-10T19:15:39.376 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-10T19:15:39.376 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-10T19:15:39.376 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-10T19:15:39.377 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-10T19:15:39.377 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-10T19:15:39.377 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-10T19:15:39.377 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-10T19:15:39.377 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:15:39.377 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.34782 2024-09-10T19:15:39.377 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.34782/ceph-mon.a.asok 2024-09-10T19:15:39.377 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-10T19:15:39.377 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.34782/ceph-mon.a.asok config get mon_host 2024-09-10T19:15:39.459 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:177: TEST_mon_features: run_mon td/misc b --public-addr 127.0.0.1:7128 2024-09-10T19:15:39.459 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/misc 2024-09-10T19:15:39.459 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-10T19:15:39.459 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=b 2024-09-10T19:15:39.460 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-10T19:15:39.460 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/misc/b 2024-09-10T19:15:39.460 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id b --mkfs --mon-data=td/misc/b --run-dir=td/misc --public-addr 127.0.0.1:7128 2024-09-10T19:15:39.928 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-10T19:15:39.929 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-10T19:15:39.929 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-10T19:15:39.929 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-10T19:15:39.929 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:15:39.929 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.34782 2024-09-10T19:15:39.929 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.34782/$cluster-$name.asok' 2024-09-10T19:15:39.929 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id b --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/misc/b '--log-file=td/misc/$name.log' '--admin-socket=/tmp/ceph-asok.34782/$cluster-$name.asok' --mon-cluster-log-file=td/misc/log --run-dir=td/misc '--pid-file=td/misc/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr 127.0.0.1:7128 2024-09-10T19:15:40.121 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-10T19:15:40.122 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon b fsid 2024-09-10T19:15:40.123 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-10T19:15:40.123 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=b 2024-09-10T19:15:40.123 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-10T19:15:40.123 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-10T19:15:40.123 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.b 2024-09-10T19:15:40.123 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.b 2024-09-10T19:15:40.123 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.b ']' 2024-09-10T19:15:40.123 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-10T19:15:40.123 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:15:40.123 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.34782 2024-09-10T19:15:40.123 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.34782/ceph-mon.b.asok 2024-09-10T19:15:40.124 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-10T19:15:40.124 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.34782/ceph-mon.b.asok config get fsid 2024-09-10T19:15:40.209 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon b mon_host 2024-09-10T19:15:40.209 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-10T19:15:40.209 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=b 2024-09-10T19:15:40.209 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-10T19:15:40.209 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-10T19:15:40.209 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.b 2024-09-10T19:15:40.209 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.b 2024-09-10T19:15:40.210 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.b ']' 2024-09-10T19:15:40.210 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-10T19:15:40.210 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:15:40.210 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.34782 2024-09-10T19:15:40.210 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.34782/ceph-mon.b.asok 2024-09-10T19:15:40.210 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-10T19:15:40.210 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.34782/ceph-mon.b.asok config get mon_host 2024-09-10T19:15:40.290 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:178: TEST_mon_features: timeout 120 ceph -s 2024-09-10T19:15:55.494 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:181: TEST_mon_features: ceph quorum_status --format=json 2024-09-10T19:15:58.702 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:181: TEST_mon_features: jqinput=' 2024-09-10T19:15:58.702 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:15:58.702 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:182: TEST_mon_features: jq_success ' 2024-09-10T19:15:58.702 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' '.monmap.mons | length == 3' 2024-09-10T19:15:58.702 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-10T19:15:58.703 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:15:58.703 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.monmap.mons | length == 3' 2024-09-10T19:15:58.703 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='""' 2024-09-10T19:15:58.703 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-10T19:15:58.703 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:15:58.703 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:15:58.703 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-10T19:15:58.704 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:15:58.704 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.monmap.mons | length == 3' 2024-09-10T19:15:58.704 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:15:58.705 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.monmap.mons | length == 3' 2024-09-10T19:15:58.705 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-10T19:15:58.705 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:15:58.705 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.monmap.mons | length == 3' 2024-09-10T19:15:58.709 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret=true 2024-09-10T19:15:58.709 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ true == \t\r\u\e ]] 2024-09-10T19:15:58.709 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2381: jq_success: return 0 2024-09-10T19:15:58.709 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:184: TEST_mon_features: jq_success ' 2024-09-10T19:15:58.709 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' '.quorum | length == 2' 2024-09-10T19:15:58.709 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-10T19:15:58.709 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:15:58.709 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.quorum | length == 2' 2024-09-10T19:15:58.709 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='""' 2024-09-10T19:15:58.709 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-10T19:15:58.709 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:15:58.709 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:15:58.710 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-10T19:15:58.710 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:15:58.710 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.quorum | length == 2' 2024-09-10T19:15:58.710 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:15:58.711 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.quorum | length == 2' 2024-09-10T19:15:58.712 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-10T19:15:58.712 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:15:58.712 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.quorum | length == 2' 2024-09-10T19:15:58.715 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret=true 2024-09-10T19:15:58.715 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ true == \t\r\u\e ]] 2024-09-10T19:15:58.716 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2381: jq_success: return 0 2024-09-10T19:15:58.716 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:187: TEST_mon_features: jqfilter='.features.quorum_mon[]|select(. == "kraken")' 2024-09-10T19:15:58.716 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:188: TEST_mon_features: jq_success ' 2024-09-10T19:15:58.716 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' '.features.quorum_mon[]|select(. == "kraken")' kraken 2024-09-10T19:15:58.716 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-10T19:15:58.716 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:15:58.716 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.features.quorum_mon[]|select(. == "kraken")' 2024-09-10T19:15:58.716 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='"kraken"' 2024-09-10T19:15:58.716 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-10T19:15:58.716 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:15:58.716 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:15:58.717 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-10T19:15:58.717 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:15:58.717 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.features.quorum_mon[]|select(. == "kraken")' 2024-09-10T19:15:58.717 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:15:58.718 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.features.quorum_mon[]|select(. == "kraken")' 2024-09-10T19:15:58.719 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-10T19:15:58.719 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:15:58.719 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.features.quorum_mon[]|select(. == "kraken")' 2024-09-10T19:15:58.722 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret='"kraken"' 2024-09-10T19:15:58.722 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ "kraken" == \t\r\u\e ]] 2024-09-10T19:15:58.722 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: jq_success: [[ -n "kraken" ]] 2024-09-10T19:15:58.722 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2383: jq_success: [[ "kraken" == \"\k\r\a\k\e\n\" ]] 2024-09-10T19:15:58.722 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2384: jq_success: return 0 2024-09-10T19:15:58.723 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:189: TEST_mon_features: jqfilter='.features.quorum_mon[]|select(. == "luminous")' 2024-09-10T19:15:58.723 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:190: TEST_mon_features: jq_success ' 2024-09-10T19:15:58.723 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' '.features.quorum_mon[]|select(. == "luminous")' luminous 2024-09-10T19:15:58.723 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-10T19:15:58.723 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:15:58.723 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.features.quorum_mon[]|select(. == "luminous")' 2024-09-10T19:15:58.723 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='"luminous"' 2024-09-10T19:15:58.723 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-10T19:15:58.723 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:15:58.723 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:15:58.724 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-10T19:15:58.724 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:15:58.724 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.features.quorum_mon[]|select(. == "luminous")' 2024-09-10T19:15:58.724 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:15:58.725 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.features.quorum_mon[]|select(. == "luminous")' 2024-09-10T19:15:58.725 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-10T19:15:58.725 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:15:58.725 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.features.quorum_mon[]|select(. == "luminous")' 2024-09-10T19:15:58.729 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret='"luminous"' 2024-09-10T19:15:58.729 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ "luminous" == \t\r\u\e ]] 2024-09-10T19:15:58.729 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: jq_success: [[ -n "luminous" ]] 2024-09-10T19:15:58.729 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2383: jq_success: [[ "luminous" == \"\l\u\m\i\n\o\u\s\" ]] 2024-09-10T19:15:58.730 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2384: jq_success: return 0 2024-09-10T19:15:58.730 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:191: TEST_mon_features: jqfilter='.features.quorum_mon[]|select(. == "mimic")' 2024-09-10T19:15:58.730 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:192: TEST_mon_features: jq_success ' 2024-09-10T19:15:58.730 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' '.features.quorum_mon[]|select(. == "mimic")' mimic 2024-09-10T19:15:58.730 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-10T19:15:58.730 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:15:58.730 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.features.quorum_mon[]|select(. == "mimic")' 2024-09-10T19:15:58.730 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='"mimic"' 2024-09-10T19:15:58.730 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-10T19:15:58.730 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:15:58.730 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:15:58.731 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-10T19:15:58.732 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:15:58.732 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.features.quorum_mon[]|select(. == "mimic")' 2024-09-10T19:15:58.732 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:15:58.732 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.features.quorum_mon[]|select(. == "mimic")' 2024-09-10T19:15:58.733 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-10T19:15:58.733 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:15:58.733 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.features.quorum_mon[]|select(. == "mimic")' 2024-09-10T19:15:58.736 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret='"mimic"' 2024-09-10T19:15:58.736 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ "mimic" == \t\r\u\e ]] 2024-09-10T19:15:58.736 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: jq_success: [[ -n "mimic" ]] 2024-09-10T19:15:58.736 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2383: jq_success: [[ "mimic" == \"\m\i\m\i\c\" ]] 2024-09-10T19:15:58.736 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2384: jq_success: return 0 2024-09-10T19:15:58.736 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:193: TEST_mon_features: jqfilter='.features.quorum_mon[]|select(. == "nautilus")' 2024-09-10T19:15:58.736 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:194: TEST_mon_features: jq_success ' 2024-09-10T19:15:58.736 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' '.features.quorum_mon[]|select(. == "nautilus")' nautilus 2024-09-10T19:15:58.736 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-10T19:15:58.737 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:15:58.737 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.features.quorum_mon[]|select(. == "nautilus")' 2024-09-10T19:15:58.737 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='"nautilus"' 2024-09-10T19:15:58.737 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-10T19:15:58.737 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:15:58.737 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:15:58.738 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-10T19:15:58.738 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:15:58.738 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.features.quorum_mon[]|select(. == "nautilus")' 2024-09-10T19:15:58.738 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:15:58.739 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.features.quorum_mon[]|select(. == "nautilus")' 2024-09-10T19:15:58.739 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-10T19:15:58.739 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:15:58.739 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.features.quorum_mon[]|select(. == "nautilus")' 2024-09-10T19:15:58.742 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret='"nautilus"' 2024-09-10T19:15:58.742 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ "nautilus" == \t\r\u\e ]] 2024-09-10T19:15:58.743 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: jq_success: [[ -n "nautilus" ]] 2024-09-10T19:15:58.743 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2383: jq_success: [[ "nautilus" == \"\n\a\u\t\i\l\u\s\" ]] 2024-09-10T19:15:58.743 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2384: jq_success: return 0 2024-09-10T19:15:58.743 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:195: TEST_mon_features: jqfilter='.features.quorum_mon[]|select(. == "octopus")' 2024-09-10T19:15:58.743 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:196: TEST_mon_features: jq_success ' 2024-09-10T19:15:58.743 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' '.features.quorum_mon[]|select(. == "octopus")' octopus 2024-09-10T19:15:58.743 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-10T19:15:58.743 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:15:58.743 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.features.quorum_mon[]|select(. == "octopus")' 2024-09-10T19:15:58.743 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='"octopus"' 2024-09-10T19:15:58.743 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-10T19:15:58.744 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:15:58.744 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:15:58.744 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-10T19:15:58.744 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:15:58.744 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.features.quorum_mon[]|select(. == "octopus")' 2024-09-10T19:15:58.745 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:15:58.745 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.features.quorum_mon[]|select(. == "octopus")' 2024-09-10T19:15:58.745 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-10T19:15:58.745 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:15:58.746 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.features.quorum_mon[]|select(. == "octopus")' 2024-09-10T19:15:58.749 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret='"octopus"' 2024-09-10T19:15:58.749 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ "octopus" == \t\r\u\e ]] 2024-09-10T19:15:58.749 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: jq_success: [[ -n "octopus" ]] 2024-09-10T19:15:58.749 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2383: jq_success: [[ "octopus" == \"\o\c\t\o\p\u\s\" ]] 2024-09-10T19:15:58.749 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2384: jq_success: return 0 2024-09-10T19:15:58.749 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:197: TEST_mon_features: jqfilter='.features.quorum_mon[]|select(. == "pacific")' 2024-09-10T19:15:58.749 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:198: TEST_mon_features: jq_success ' 2024-09-10T19:15:58.750 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' '.features.quorum_mon[]|select(. == "pacific")' pacific 2024-09-10T19:15:58.750 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-10T19:15:58.750 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:15:58.750 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.features.quorum_mon[]|select(. == "pacific")' 2024-09-10T19:15:58.750 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='"pacific"' 2024-09-10T19:15:58.750 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-10T19:15:58.750 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:15:58.751 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:15:58.752 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-10T19:15:58.752 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:15:58.752 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.features.quorum_mon[]|select(. == "pacific")' 2024-09-10T19:15:58.752 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:15:58.753 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.features.quorum_mon[]|select(. == "pacific")' 2024-09-10T19:15:58.753 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-10T19:15:58.753 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:15:58.753 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.features.quorum_mon[]|select(. == "pacific")' 2024-09-10T19:15:58.756 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret='"pacific"' 2024-09-10T19:15:58.756 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ "pacific" == \t\r\u\e ]] 2024-09-10T19:15:58.756 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: jq_success: [[ -n "pacific" ]] 2024-09-10T19:15:58.756 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2383: jq_success: [[ "pacific" == \"\p\a\c\i\f\i\c\" ]] 2024-09-10T19:15:58.756 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2384: jq_success: return 0 2024-09-10T19:15:58.756 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:199: TEST_mon_features: jqfilter='.features.quorum_mon[]|select(. == "quincy")' 2024-09-10T19:15:58.756 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:200: TEST_mon_features: jq_success ' 2024-09-10T19:15:58.756 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' '.features.quorum_mon[]|select(. == "quincy")' quincy 2024-09-10T19:15:58.756 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-10T19:15:58.757 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:15:58.757 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.features.quorum_mon[]|select(. == "quincy")' 2024-09-10T19:15:58.757 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='"quincy"' 2024-09-10T19:15:58.757 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-10T19:15:58.757 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:15:58.757 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:15:58.758 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-10T19:15:58.758 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:15:58.758 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.features.quorum_mon[]|select(. == "quincy")' 2024-09-10T19:15:58.758 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:15:58.758 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.features.quorum_mon[]|select(. == "quincy")' 2024-09-10T19:15:58.759 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-10T19:15:58.759 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:15:58.759 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.features.quorum_mon[]|select(. == "quincy")' 2024-09-10T19:15:58.762 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret='"quincy"' 2024-09-10T19:15:58.762 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ "quincy" == \t\r\u\e ]] 2024-09-10T19:15:58.763 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: jq_success: [[ -n "quincy" ]] 2024-09-10T19:15:58.763 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2383: jq_success: [[ "quincy" == \"\q\u\i\n\c\y\" ]] 2024-09-10T19:15:58.763 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2384: jq_success: return 0 2024-09-10T19:15:58.763 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:201: TEST_mon_features: jqfilter='.features.quorum_mon[]|select(. == "reef")' 2024-09-10T19:15:58.763 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:202: TEST_mon_features: jq_success ' 2024-09-10T19:15:58.763 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' '.features.quorum_mon[]|select(. == "reef")' reef 2024-09-10T19:15:58.763 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-10T19:15:58.763 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:15:58.763 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.features.quorum_mon[]|select(. == "reef")' 2024-09-10T19:15:58.763 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='"reef"' 2024-09-10T19:15:58.764 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-10T19:15:58.764 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:15:58.764 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:15:58.765 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-10T19:15:58.765 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:15:58.765 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.features.quorum_mon[]|select(. == "reef")' 2024-09-10T19:15:58.765 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:15:58.765 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.features.quorum_mon[]|select(. == "reef")' 2024-09-10T19:15:58.765 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-10T19:15:58.766 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:15:58.766 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.features.quorum_mon[]|select(. == "reef")' 2024-09-10T19:15:58.769 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret='"reef"' 2024-09-10T19:15:58.769 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ "reef" == \t\r\u\e ]] 2024-09-10T19:15:58.769 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: jq_success: [[ -n "reef" ]] 2024-09-10T19:15:58.769 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2383: jq_success: [[ "reef" == \"\r\e\e\f\" ]] 2024-09-10T19:15:58.769 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2384: jq_success: return 0 2024-09-10T19:15:58.769 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:203: TEST_mon_features: jqfilter='.features.quorum_mon[]|select(. == "squid")' 2024-09-10T19:15:58.769 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:204: TEST_mon_features: jq_success ' 2024-09-10T19:15:58.769 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' '.features.quorum_mon[]|select(. == "squid")' squid 2024-09-10T19:15:58.769 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-10T19:15:58.770 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:15:58.770 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.features.quorum_mon[]|select(. == "squid")' 2024-09-10T19:15:58.770 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='"squid"' 2024-09-10T19:15:58.770 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-10T19:15:58.770 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:15:58.770 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:15:58.771 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-10T19:15:58.771 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:15:58.771 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.features.quorum_mon[]|select(. == "squid")' 2024-09-10T19:15:58.771 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:15:58.772 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.features.quorum_mon[]|select(. == "squid")' 2024-09-10T19:15:58.772 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-10T19:15:58.772 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:15:58.772 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.features.quorum_mon[]|select(. == "squid")' 2024-09-10T19:15:58.776 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret='"squid"' 2024-09-10T19:15:58.776 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ "squid" == \t\r\u\e ]] 2024-09-10T19:15:58.776 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: jq_success: [[ -n "squid" ]] 2024-09-10T19:15:58.776 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2383: jq_success: [[ "squid" == \"\s\q\u\i\d\" ]] 2024-09-10T19:15:58.776 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2384: jq_success: return 0 2024-09-10T19:15:58.776 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:209: TEST_mon_features: jqfilter='.monmap.features.persistent | length == 0' 2024-09-10T19:15:58.776 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:210: TEST_mon_features: jq_success ' 2024-09-10T19:15:58.777 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' '.monmap.features.persistent | length == 0' 2024-09-10T19:15:58.777 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-10T19:15:58.777 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:15:58.777 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.monmap.features.persistent | length == 0' 2024-09-10T19:15:58.777 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='""' 2024-09-10T19:15:58.777 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-10T19:15:58.777 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:15:58.777 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:15:58.778 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-10T19:15:58.778 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:15:58.779 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.monmap.features.persistent | length == 0' 2024-09-10T19:15:58.779 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:15:58.779 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.monmap.features.persistent | length == 0' 2024-09-10T19:15:58.779 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-10T19:15:58.779 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:15:58.780 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.monmap.features.persistent | length == 0' 2024-09-10T19:15:58.782 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret=true 2024-09-10T19:15:58.782 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ true == \t\r\u\e ]] 2024-09-10T19:15:58.782 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2381: jq_success: return 0 2024-09-10T19:15:58.782 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:213: TEST_mon_features: jqfilter='.monmap.features.optional | length == 0' 2024-09-10T19:15:58.782 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:214: TEST_mon_features: jq_success ' 2024-09-10T19:15:58.782 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' '.monmap.features.optional | length == 0' 2024-09-10T19:15:58.783 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-10T19:15:58.783 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:15:58.783 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.monmap.features.optional | length == 0' 2024-09-10T19:15:58.783 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='""' 2024-09-10T19:15:58.783 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-10T19:15:58.783 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:15:58.783 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:15:58.785 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-10T19:15:58.785 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:15:58.785 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.monmap.features.optional | length == 0' 2024-09-10T19:15:58.785 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:15:58.785 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.monmap.features.optional | length == 0' 2024-09-10T19:15:58.785 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-10T19:15:58.785 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:15:58.785 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.monmap.features.optional | length == 0' 2024-09-10T19:15:58.787 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret=true 2024-09-10T19:15:58.787 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ true == \t\r\u\e ]] 2024-09-10T19:15:58.787 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2381: jq_success: return 0 2024-09-10T19:15:58.788 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:218: TEST_mon_features: ceph mon feature ls --format=json 2024-09-10T19:15:58.992 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:218: TEST_mon_features: jqinput=' 2024-09-10T19:15:58.992 INFO:tasks.workunit.client.0.smithi038.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-10T19:15:58.992 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:220: TEST_mon_features: jqfilter='.all.supported[] | select(. == "kraken")' 2024-09-10T19:15:58.993 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:221: TEST_mon_features: jq_success ' 2024-09-10T19:15:58.993 INFO:tasks.workunit.client.0.smithi038.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' '.all.supported[] | select(. == "kraken")' kraken 2024-09-10T19:15:58.993 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-10T19:15:58.993 INFO:tasks.workunit.client.0.smithi038.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-10T19:15:58.993 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.all.supported[] | select(. == "kraken")' 2024-09-10T19:15:58.993 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='"kraken"' 2024-09-10T19:15:58.993 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-10T19:15:58.993 INFO:tasks.workunit.client.0.smithi038.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-10T19:15:58.993 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:15:58.994 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-10T19:15:58.994 INFO:tasks.workunit.client.0.smithi038.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-10T19:15:58.994 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.all.supported[] | select(. == "kraken")' 2024-09-10T19:15:58.994 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:15:58.995 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.all.supported[] | select(. == "kraken")' 2024-09-10T19:15:58.995 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-10T19:15:58.995 INFO:tasks.workunit.client.0.smithi038.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-10T19:15:58.996 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.all.supported[] | select(. == "kraken")' 2024-09-10T19:15:58.999 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret='"kraken"' 2024-09-10T19:15:58.999 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ "kraken" == \t\r\u\e ]] 2024-09-10T19:15:58.999 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: jq_success: [[ -n "kraken" ]] 2024-09-10T19:15:58.999 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2383: jq_success: [[ "kraken" == \"\k\r\a\k\e\n\" ]] 2024-09-10T19:15:58.999 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2384: jq_success: return 0 2024-09-10T19:15:58.999 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:222: TEST_mon_features: jqfilter='.all.supported[] | select(. == "luminous")' 2024-09-10T19:15:58.999 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:223: TEST_mon_features: jq_success ' 2024-09-10T19:15:58.999 INFO:tasks.workunit.client.0.smithi038.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' '.all.supported[] | select(. == "luminous")' luminous 2024-09-10T19:15:58.999 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-10T19:15:59.000 INFO:tasks.workunit.client.0.smithi038.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-10T19:15:59.000 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.all.supported[] | select(. == "luminous")' 2024-09-10T19:15:59.000 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='"luminous"' 2024-09-10T19:15:59.000 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-10T19:15:59.000 INFO:tasks.workunit.client.0.smithi038.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-10T19:15:59.000 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:15:59.000 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-10T19:15:59.001 INFO:tasks.workunit.client.0.smithi038.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-10T19:15:59.001 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.all.supported[] | select(. == "luminous")' 2024-09-10T19:15:59.001 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:15:59.001 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.all.supported[] | select(. == "luminous")' 2024-09-10T19:15:59.002 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-10T19:15:59.002 INFO:tasks.workunit.client.0.smithi038.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-10T19:15:59.002 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.all.supported[] | select(. == "luminous")' 2024-09-10T19:15:59.006 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret='"luminous"' 2024-09-10T19:15:59.006 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ "luminous" == \t\r\u\e ]] 2024-09-10T19:15:59.006 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: jq_success: [[ -n "luminous" ]] 2024-09-10T19:15:59.006 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2383: jq_success: [[ "luminous" == \"\l\u\m\i\n\o\u\s\" ]] 2024-09-10T19:15:59.006 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2384: jq_success: return 0 2024-09-10T19:15:59.006 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:224: TEST_mon_features: jqfilter='.all.supported[] | select(. == "mimic")' 2024-09-10T19:15:59.006 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:225: TEST_mon_features: jq_success ' 2024-09-10T19:15:59.006 INFO:tasks.workunit.client.0.smithi038.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' '.all.supported[] | select(. == "mimic")' mimic 2024-09-10T19:15:59.006 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-10T19:15:59.006 INFO:tasks.workunit.client.0.smithi038.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-10T19:15:59.006 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.all.supported[] | select(. == "mimic")' 2024-09-10T19:15:59.006 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='"mimic"' 2024-09-10T19:15:59.007 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-10T19:15:59.007 INFO:tasks.workunit.client.0.smithi038.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-10T19:15:59.007 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:15:59.008 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-10T19:15:59.008 INFO:tasks.workunit.client.0.smithi038.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-10T19:15:59.008 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.all.supported[] | select(. == "mimic")' 2024-09-10T19:15:59.008 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:15:59.008 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.all.supported[] | select(. == "mimic")' 2024-09-10T19:15:59.008 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-10T19:15:59.009 INFO:tasks.workunit.client.0.smithi038.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-10T19:15:59.009 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.all.supported[] | select(. == "mimic")' 2024-09-10T19:15:59.012 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret='"mimic"' 2024-09-10T19:15:59.012 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ "mimic" == \t\r\u\e ]] 2024-09-10T19:15:59.012 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: jq_success: [[ -n "mimic" ]] 2024-09-10T19:15:59.012 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2383: jq_success: [[ "mimic" == \"\m\i\m\i\c\" ]] 2024-09-10T19:15:59.012 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2384: jq_success: return 0 2024-09-10T19:15:59.012 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:226: TEST_mon_features: jqfilter='.all.supported[] | select(. == "nautilus")' 2024-09-10T19:15:59.012 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:227: TEST_mon_features: jq_success ' 2024-09-10T19:15:59.012 INFO:tasks.workunit.client.0.smithi038.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' '.all.supported[] | select(. == "nautilus")' nautilus 2024-09-10T19:15:59.012 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-10T19:15:59.013 INFO:tasks.workunit.client.0.smithi038.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-10T19:15:59.013 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.all.supported[] | select(. == "nautilus")' 2024-09-10T19:15:59.013 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='"nautilus"' 2024-09-10T19:15:59.013 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-10T19:15:59.013 INFO:tasks.workunit.client.0.smithi038.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-10T19:15:59.013 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:15:59.013 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-10T19:15:59.013 INFO:tasks.workunit.client.0.smithi038.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-10T19:15:59.014 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.all.supported[] | select(. == "nautilus")' 2024-09-10T19:15:59.014 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:15:59.014 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.all.supported[] | select(. == "nautilus")' 2024-09-10T19:15:59.015 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-10T19:15:59.015 INFO:tasks.workunit.client.0.smithi038.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-10T19:15:59.015 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.all.supported[] | select(. == "nautilus")' 2024-09-10T19:15:59.019 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret='"nautilus"' 2024-09-10T19:15:59.019 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ "nautilus" == \t\r\u\e ]] 2024-09-10T19:15:59.019 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: jq_success: [[ -n "nautilus" ]] 2024-09-10T19:15:59.019 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2383: jq_success: [[ "nautilus" == \"\n\a\u\t\i\l\u\s\" ]] 2024-09-10T19:15:59.019 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2384: jq_success: return 0 2024-09-10T19:15:59.019 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:228: TEST_mon_features: jqfilter='.all.supported[] | select(. == "octopus")' 2024-09-10T19:15:59.019 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:229: TEST_mon_features: jq_success ' 2024-09-10T19:15:59.019 INFO:tasks.workunit.client.0.smithi038.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' '.all.supported[] | select(. == "octopus")' octopus 2024-09-10T19:15:59.019 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-10T19:15:59.019 INFO:tasks.workunit.client.0.smithi038.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-10T19:15:59.019 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.all.supported[] | select(. == "octopus")' 2024-09-10T19:15:59.019 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='"octopus"' 2024-09-10T19:15:59.019 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-10T19:15:59.020 INFO:tasks.workunit.client.0.smithi038.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-10T19:15:59.020 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:15:59.020 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-10T19:15:59.020 INFO:tasks.workunit.client.0.smithi038.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-10T19:15:59.020 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.all.supported[] | select(. == "octopus")' 2024-09-10T19:15:59.020 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:15:59.021 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.all.supported[] | select(. == "octopus")' 2024-09-10T19:15:59.021 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-10T19:15:59.022 INFO:tasks.workunit.client.0.smithi038.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-10T19:15:59.022 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.all.supported[] | select(. == "octopus")' 2024-09-10T19:15:59.025 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret='"octopus"' 2024-09-10T19:15:59.025 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ "octopus" == \t\r\u\e ]] 2024-09-10T19:15:59.025 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: jq_success: [[ -n "octopus" ]] 2024-09-10T19:15:59.025 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2383: jq_success: [[ "octopus" == \"\o\c\t\o\p\u\s\" ]] 2024-09-10T19:15:59.025 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2384: jq_success: return 0 2024-09-10T19:15:59.025 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:230: TEST_mon_features: jqfilter='.all.supported[] | select(. == "pacific")' 2024-09-10T19:15:59.025 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:231: TEST_mon_features: jq_success ' 2024-09-10T19:15:59.025 INFO:tasks.workunit.client.0.smithi038.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' '.all.supported[] | select(. == "pacific")' pacific 2024-09-10T19:15:59.025 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-10T19:15:59.026 INFO:tasks.workunit.client.0.smithi038.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-10T19:15:59.026 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.all.supported[] | select(. == "pacific")' 2024-09-10T19:15:59.026 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='"pacific"' 2024-09-10T19:15:59.026 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-10T19:15:59.026 INFO:tasks.workunit.client.0.smithi038.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-10T19:15:59.026 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:15:59.026 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-10T19:15:59.026 INFO:tasks.workunit.client.0.smithi038.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-10T19:15:59.027 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.all.supported[] | select(. == "pacific")' 2024-09-10T19:15:59.027 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:15:59.027 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.all.supported[] | select(. == "pacific")' 2024-09-10T19:15:59.028 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-10T19:15:59.028 INFO:tasks.workunit.client.0.smithi038.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-10T19:15:59.029 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.all.supported[] | select(. == "pacific")' 2024-09-10T19:15:59.031 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret='"pacific"' 2024-09-10T19:15:59.032 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ "pacific" == \t\r\u\e ]] 2024-09-10T19:15:59.032 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: jq_success: [[ -n "pacific" ]] 2024-09-10T19:15:59.032 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2383: jq_success: [[ "pacific" == \"\p\a\c\i\f\i\c\" ]] 2024-09-10T19:15:59.032 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2384: jq_success: return 0 2024-09-10T19:15:59.032 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:232: TEST_mon_features: jqfilter='.all.supported[] | select(. == "quincy")' 2024-09-10T19:15:59.032 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:233: TEST_mon_features: jq_success ' 2024-09-10T19:15:59.032 INFO:tasks.workunit.client.0.smithi038.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' '.all.supported[] | select(. == "quincy")' quincy 2024-09-10T19:15:59.032 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-10T19:15:59.032 INFO:tasks.workunit.client.0.smithi038.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-10T19:15:59.032 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.all.supported[] | select(. == "quincy")' 2024-09-10T19:15:59.033 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='"quincy"' 2024-09-10T19:15:59.033 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-10T19:15:59.033 INFO:tasks.workunit.client.0.smithi038.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-10T19:15:59.033 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:15:59.033 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-10T19:15:59.033 INFO:tasks.workunit.client.0.smithi038.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-10T19:15:59.033 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.all.supported[] | select(. == "quincy")' 2024-09-10T19:15:59.034 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:15:59.034 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.all.supported[] | select(. == "quincy")' 2024-09-10T19:15:59.034 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-10T19:15:59.035 INFO:tasks.workunit.client.0.smithi038.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-10T19:15:59.035 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.all.supported[] | select(. == "quincy")' 2024-09-10T19:15:59.038 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret='"quincy"' 2024-09-10T19:15:59.038 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ "quincy" == \t\r\u\e ]] 2024-09-10T19:15:59.038 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: jq_success: [[ -n "quincy" ]] 2024-09-10T19:15:59.038 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2383: jq_success: [[ "quincy" == \"\q\u\i\n\c\y\" ]] 2024-09-10T19:15:59.038 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2384: jq_success: return 0 2024-09-10T19:15:59.038 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:234: TEST_mon_features: jqfilter='.all.supported[] | select(. == "reef")' 2024-09-10T19:15:59.039 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:235: TEST_mon_features: jq_success ' 2024-09-10T19:15:59.039 INFO:tasks.workunit.client.0.smithi038.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' '.all.supported[] | select(. == "reef")' reef 2024-09-10T19:15:59.039 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-10T19:15:59.039 INFO:tasks.workunit.client.0.smithi038.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-10T19:15:59.039 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.all.supported[] | select(. == "reef")' 2024-09-10T19:15:59.039 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='"reef"' 2024-09-10T19:15:59.039 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-10T19:15:59.039 INFO:tasks.workunit.client.0.smithi038.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-10T19:15:59.039 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:15:59.040 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-10T19:15:59.040 INFO:tasks.workunit.client.0.smithi038.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-10T19:15:59.040 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.all.supported[] | select(. == "reef")' 2024-09-10T19:15:59.040 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:15:59.041 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.all.supported[] | select(. == "reef")' 2024-09-10T19:15:59.041 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-10T19:15:59.041 INFO:tasks.workunit.client.0.smithi038.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-10T19:15:59.041 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.all.supported[] | select(. == "reef")' 2024-09-10T19:15:59.044 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret='"reef"' 2024-09-10T19:15:59.044 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ "reef" == \t\r\u\e ]] 2024-09-10T19:15:59.045 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: jq_success: [[ -n "reef" ]] 2024-09-10T19:15:59.045 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2383: jq_success: [[ "reef" == \"\r\e\e\f\" ]] 2024-09-10T19:15:59.045 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2384: jq_success: return 0 2024-09-10T19:15:59.045 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:236: TEST_mon_features: jqfilter='.all.supported[] | select(. == "squid")' 2024-09-10T19:15:59.045 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:237: TEST_mon_features: jq_success ' 2024-09-10T19:15:59.045 INFO:tasks.workunit.client.0.smithi038.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' '.all.supported[] | select(. == "squid")' squid 2024-09-10T19:15:59.045 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-10T19:15:59.045 INFO:tasks.workunit.client.0.smithi038.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-10T19:15:59.045 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.all.supported[] | select(. == "squid")' 2024-09-10T19:15:59.045 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='"squid"' 2024-09-10T19:15:59.045 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-10T19:15:59.045 INFO:tasks.workunit.client.0.smithi038.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-10T19:15:59.046 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:15:59.046 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-10T19:15:59.046 INFO:tasks.workunit.client.0.smithi038.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-10T19:15:59.046 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.all.supported[] | select(. == "squid")' 2024-09-10T19:15:59.046 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:15:59.047 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.all.supported[] | select(. == "squid")' 2024-09-10T19:15:59.047 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-10T19:15:59.048 INFO:tasks.workunit.client.0.smithi038.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-10T19:15:59.048 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.all.supported[] | select(. == "squid")' 2024-09-10T19:15:59.051 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret='"squid"' 2024-09-10T19:15:59.051 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ "squid" == \t\r\u\e ]] 2024-09-10T19:15:59.051 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: jq_success: [[ -n "squid" ]] 2024-09-10T19:15:59.051 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2383: jq_success: [[ "squid" == \"\s\q\u\i\d\" ]] 2024-09-10T19:15:59.051 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2384: jq_success: return 0 2024-09-10T19:15:59.051 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:240: TEST_mon_features: run_mon td/misc c --public-addr 127.0.0.1:7129 2024-09-10T19:15:59.051 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/misc 2024-09-10T19:15:59.051 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-10T19:15:59.052 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=c 2024-09-10T19:15:59.052 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-10T19:15:59.052 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/misc/c 2024-09-10T19:15:59.052 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id c --mkfs --mon-data=td/misc/c --run-dir=td/misc --public-addr 127.0.0.1:7129 2024-09-10T19:15:59.607 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-10T19:15:59.608 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-10T19:15:59.608 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-10T19:15:59.608 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-10T19:15:59.608 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:15:59.608 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.34782 2024-09-10T19:15:59.608 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.34782/$cluster-$name.asok' 2024-09-10T19:15:59.608 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id c --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/misc/c '--log-file=td/misc/$name.log' '--admin-socket=/tmp/ceph-asok.34782/$cluster-$name.asok' --mon-cluster-log-file=td/misc/log --run-dir=td/misc '--pid-file=td/misc/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr 127.0.0.1:7129 2024-09-10T19:15:59.801 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-10T19:15:59.802 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon c fsid 2024-09-10T19:15:59.802 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-10T19:15:59.802 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=c 2024-09-10T19:15:59.803 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-10T19:15:59.803 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-10T19:15:59.803 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.c 2024-09-10T19:15:59.803 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.c 2024-09-10T19:15:59.803 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.c ']' 2024-09-10T19:15:59.804 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-10T19:15:59.804 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:15:59.804 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.34782 2024-09-10T19:15:59.804 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.34782/ceph-mon.c.asok 2024-09-10T19:15:59.805 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-10T19:15:59.805 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.34782/ceph-mon.c.asok config get fsid 2024-09-10T19:15:59.893 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon c mon_host 2024-09-10T19:15:59.893 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-10T19:15:59.893 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=c 2024-09-10T19:15:59.893 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-10T19:15:59.893 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-10T19:15:59.893 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.c 2024-09-10T19:15:59.893 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.c 2024-09-10T19:15:59.893 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.c ']' 2024-09-10T19:15:59.893 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-10T19:15:59.893 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:15:59.893 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.34782 2024-09-10T19:15:59.893 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.34782/ceph-mon.c.asok 2024-09-10T19:15:59.894 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-10T19:15:59.894 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.34782/ceph-mon.c.asok config get mon_host 2024-09-10T19:15:59.974 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:242: TEST_mon_features: wait_for_quorum 300 3 2024-09-10T19:15:59.975 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1046: wait_for_quorum: local timeout=300 2024-09-10T19:15:59.975 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1047: wait_for_quorum: local quorumsize=3 2024-09-10T19:15:59.975 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1049: wait_for_quorum: [[ -z 300 ]] 2024-09-10T19:15:59.975 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1053: wait_for_quorum: [[ -z 3 ]] 2024-09-10T19:15:59.975 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1058: wait_for_quorum: no_quorum=1 2024-09-10T19:15:59.975 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1059: wait_for_quorum: date +%s 2024-09-10T19:15:59.976 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1059: wait_for_quorum: wait_until=1725996059 2024-09-10T19:15:59.976 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2024-09-10T19:15:59.976 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1725995759 -lt 1725996059 ]] 2024-09-10T19:15:59.976 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 3' 2024-09-10T19:15:59.977 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 300 ceph quorum_status --format=json 2024-09-10T19:16:00.180 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2024-09-10T19:16:00.180 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":8,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:16:00.180 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":8,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders:' '":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks:' '":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:16:00.181 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 3' 2024-09-10T19:16:00.183 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2024-09-10T19:16:00.183 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2024-09-10T19:16:00.183 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2024-09-10T19:16:00.184 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1725995760 -lt 1725996059 ]] 2024-09-10T19:16:00.184 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 3' 2024-09-10T19:16:00.184 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 300 ceph quorum_status --format=json 2024-09-10T19:16:03.389 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2024-09-10T19:16:03.390 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:16:03.390 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders:' '":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks:' '":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:16:03.390 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 3' 2024-09-10T19:16:03.392 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2024-09-10T19:16:03.392 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2024-09-10T19:16:03.393 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2024-09-10T19:16:03.393 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1725995763 -lt 1725996059 ]] 2024-09-10T19:16:03.394 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 3' 2024-09-10T19:16:03.394 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 300 ceph quorum_status --format=json 2024-09-10T19:16:03.687 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2024-09-10T19:16:03.687 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:16:03.687 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:15:38.702008Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders:' '":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks:' '":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:16:03.687 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 3' 2024-09-10T19:16:03.690 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2024-09-10T19:16:03.690 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2024-09-10T19:16:03.690 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2024-09-10T19:16:03.691 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1725995763 -lt 1725996059 ]] 2024-09-10T19:16:03.691 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 3' 2024-09-10T19:16:03.691 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 300 ceph quorum_status --format=json 2024-09-10T19:16:15.902 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2024-09-10T19:16:15.902 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:16:15.903 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders:' '":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks:' '":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:16:15.903 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 3' 2024-09-10T19:16:15.906 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=true 2024-09-10T19:16:15.906 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ true == \t\r\u\e ]] 2024-09-10T19:16:15.906 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: wait_for_quorum: no_quorum=0 2024-09-10T19:16:15.906 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1066: wait_for_quorum: break 2024-09-10T19:16:15.906 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: return 0 2024-09-10T19:16:15.906 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:244: TEST_mon_features: timeout 300 ceph -s 2024-09-10T19:16:19.120 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:246: TEST_mon_features: ceph quorum_status --format=json 2024-09-10T19:16:20.731 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:246: TEST_mon_features: jqinput=' 2024-09-10T19:16:20.731 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:16:20.732 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:248: TEST_mon_features: jqfilter='.quorum | length == 3' 2024-09-10T19:16:20.732 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:249: TEST_mon_features: jq_success ' 2024-09-10T19:16:20.732 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' '.quorum | length == 3' 2024-09-10T19:16:20.732 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-10T19:16:20.732 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:16:20.732 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.quorum | length == 3' 2024-09-10T19:16:20.732 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='""' 2024-09-10T19:16:20.732 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-10T19:16:20.732 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:16:20.732 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:16:20.733 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-10T19:16:20.733 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:16:20.733 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.quorum | length == 3' 2024-09-10T19:16:20.733 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:16:20.734 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.quorum | length == 3' 2024-09-10T19:16:20.735 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-10T19:16:20.735 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:16:20.735 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.quorum | length == 3' 2024-09-10T19:16:20.738 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret=true 2024-09-10T19:16:20.738 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ true == \t\r\u\e ]] 2024-09-10T19:16:20.738 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2381: jq_success: return 0 2024-09-10T19:16:20.738 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:252: TEST_mon_features: jqfilter='.features.quorum_mon[]|select(. == "pacific")' 2024-09-10T19:16:20.738 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:253: TEST_mon_features: jq_success ' 2024-09-10T19:16:20.739 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' '.features.quorum_mon[]|select(. == "pacific")' pacific 2024-09-10T19:16:20.739 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-10T19:16:20.739 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:16:20.739 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.features.quorum_mon[]|select(. == "pacific")' 2024-09-10T19:16:20.739 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='"pacific"' 2024-09-10T19:16:20.739 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-10T19:16:20.739 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:16:20.739 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:16:20.740 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-10T19:16:20.740 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:16:20.740 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.features.quorum_mon[]|select(. == "pacific")' 2024-09-10T19:16:20.740 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:16:20.741 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.features.quorum_mon[]|select(. == "pacific")' 2024-09-10T19:16:20.741 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-10T19:16:20.742 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:16:20.742 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.features.quorum_mon[]|select(. == "pacific")' 2024-09-10T19:16:20.745 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret='"pacific"' 2024-09-10T19:16:20.745 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ "pacific" == \t\r\u\e ]] 2024-09-10T19:16:20.745 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: jq_success: [[ -n "pacific" ]] 2024-09-10T19:16:20.745 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2383: jq_success: [[ "pacific" == \"\p\a\c\i\f\i\c\" ]] 2024-09-10T19:16:20.746 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2384: jq_success: return 0 2024-09-10T19:16:20.746 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:256: TEST_mon_features: jqfilter='.monmap.features.persistent[]|select(. == "kraken")' 2024-09-10T19:16:20.746 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:257: TEST_mon_features: jq_success ' 2024-09-10T19:16:20.746 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' '.monmap.features.persistent[]|select(. == "kraken")' kraken 2024-09-10T19:16:20.746 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-10T19:16:20.746 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:16:20.746 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.monmap.features.persistent[]|select(. == "kraken")' 2024-09-10T19:16:20.746 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='"kraken"' 2024-09-10T19:16:20.746 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-10T19:16:20.746 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:16:20.746 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:16:20.747 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-10T19:16:20.747 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:16:20.747 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.monmap.features.persistent[]|select(. == "kraken")' 2024-09-10T19:16:20.747 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:16:20.748 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.monmap.features.persistent[]|select(. == "kraken")' 2024-09-10T19:16:20.748 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-10T19:16:20.748 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:16:20.748 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.monmap.features.persistent[]|select(. == "kraken")' 2024-09-10T19:16:20.752 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret='"kraken"' 2024-09-10T19:16:20.752 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ "kraken" == \t\r\u\e ]] 2024-09-10T19:16:20.752 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: jq_success: [[ -n "kraken" ]] 2024-09-10T19:16:20.752 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2383: jq_success: [[ "kraken" == \"\k\r\a\k\e\n\" ]] 2024-09-10T19:16:20.752 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2384: jq_success: return 0 2024-09-10T19:16:20.752 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:258: TEST_mon_features: jqfilter='.monmap.features.persistent[]|select(. == "luminous")' 2024-09-10T19:16:20.752 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:259: TEST_mon_features: jq_success ' 2024-09-10T19:16:20.753 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' '.monmap.features.persistent[]|select(. == "luminous")' luminous 2024-09-10T19:16:20.753 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-10T19:16:20.753 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:16:20.753 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.monmap.features.persistent[]|select(. == "luminous")' 2024-09-10T19:16:20.753 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='"luminous"' 2024-09-10T19:16:20.753 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-10T19:16:20.753 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:16:20.753 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:16:20.754 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-10T19:16:20.754 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:16:20.754 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.monmap.features.persistent[]|select(. == "luminous")' 2024-09-10T19:16:20.754 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:16:20.754 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.monmap.features.persistent[]|select(. == "luminous")' 2024-09-10T19:16:20.755 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-10T19:16:20.755 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:16:20.755 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.monmap.features.persistent[]|select(. == "luminous")' 2024-09-10T19:16:20.759 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret='"luminous"' 2024-09-10T19:16:20.759 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ "luminous" == \t\r\u\e ]] 2024-09-10T19:16:20.759 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: jq_success: [[ -n "luminous" ]] 2024-09-10T19:16:20.759 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2383: jq_success: [[ "luminous" == \"\l\u\m\i\n\o\u\s\" ]] 2024-09-10T19:16:20.759 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2384: jq_success: return 0 2024-09-10T19:16:20.759 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:260: TEST_mon_features: jqfilter='.monmap.features.persistent[]|select(. == "mimic")' 2024-09-10T19:16:20.759 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:261: TEST_mon_features: jq_success ' 2024-09-10T19:16:20.759 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' '.monmap.features.persistent[]|select(. == "mimic")' mimic 2024-09-10T19:16:20.759 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-10T19:16:20.759 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:16:20.759 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.monmap.features.persistent[]|select(. == "mimic")' 2024-09-10T19:16:20.759 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='"mimic"' 2024-09-10T19:16:20.759 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-10T19:16:20.760 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:16:20.760 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:16:20.760 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-10T19:16:20.760 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:16:20.760 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.monmap.features.persistent[]|select(. == "mimic")' 2024-09-10T19:16:20.760 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:16:20.761 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.monmap.features.persistent[]|select(. == "mimic")' 2024-09-10T19:16:20.762 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-10T19:16:20.762 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:16:20.762 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.monmap.features.persistent[]|select(. == "mimic")' 2024-09-10T19:16:20.765 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret='"mimic"' 2024-09-10T19:16:20.765 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ "mimic" == \t\r\u\e ]] 2024-09-10T19:16:20.765 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: jq_success: [[ -n "mimic" ]] 2024-09-10T19:16:20.766 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2383: jq_success: [[ "mimic" == \"\m\i\m\i\c\" ]] 2024-09-10T19:16:20.766 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2384: jq_success: return 0 2024-09-10T19:16:20.766 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:262: TEST_mon_features: jqfilter='.monmap.features.persistent[]|select(. == "osdmap-prune")' 2024-09-10T19:16:20.766 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:263: TEST_mon_features: jq_success ' 2024-09-10T19:16:20.766 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' '.monmap.features.persistent[]|select(. == "osdmap-prune")' osdmap-prune 2024-09-10T19:16:20.766 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-10T19:16:20.766 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:16:20.766 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.monmap.features.persistent[]|select(. == "osdmap-prune")' 2024-09-10T19:16:20.766 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='"osdmap-prune"' 2024-09-10T19:16:20.766 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-10T19:16:20.766 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:16:20.766 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:16:20.767 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-10T19:16:20.767 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:16:20.767 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.monmap.features.persistent[]|select(. == "osdmap-prune")' 2024-09-10T19:16:20.767 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:16:20.768 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.monmap.features.persistent[]|select(. == "osdmap-prune")' 2024-09-10T19:16:20.769 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-10T19:16:20.769 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:16:20.770 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.monmap.features.persistent[]|select(. == "osdmap-prune")' 2024-09-10T19:16:20.772 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret='"osdmap-prune"' 2024-09-10T19:16:20.772 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ "osdmap-prune" == \t\r\u\e ]] 2024-09-10T19:16:20.772 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: jq_success: [[ -n "osdmap-prune" ]] 2024-09-10T19:16:20.772 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2383: jq_success: [[ "osdmap-prune" == \"\o\s\d\m\a\p\-\p\r\u\n\e\" ]] 2024-09-10T19:16:20.772 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2384: jq_success: return 0 2024-09-10T19:16:20.772 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:264: TEST_mon_features: jqfilter='.monmap.features.persistent[]|select(. == "nautilus")' 2024-09-10T19:16:20.772 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:265: TEST_mon_features: jq_success ' 2024-09-10T19:16:20.772 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' '.monmap.features.persistent[]|select(. == "nautilus")' nautilus 2024-09-10T19:16:20.773 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-10T19:16:20.773 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:16:20.773 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.monmap.features.persistent[]|select(. == "nautilus")' 2024-09-10T19:16:20.773 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='"nautilus"' 2024-09-10T19:16:20.773 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-10T19:16:20.773 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:16:20.773 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:16:20.774 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-10T19:16:20.774 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:16:20.774 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.monmap.features.persistent[]|select(. == "nautilus")' 2024-09-10T19:16:20.774 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:16:20.774 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.monmap.features.persistent[]|select(. == "nautilus")' 2024-09-10T19:16:20.775 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-10T19:16:20.775 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:16:20.775 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.monmap.features.persistent[]|select(. == "nautilus")' 2024-09-10T19:16:20.778 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret='"nautilus"' 2024-09-10T19:16:20.779 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ "nautilus" == \t\r\u\e ]] 2024-09-10T19:16:20.779 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: jq_success: [[ -n "nautilus" ]] 2024-09-10T19:16:20.779 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2383: jq_success: [[ "nautilus" == \"\n\a\u\t\i\l\u\s\" ]] 2024-09-10T19:16:20.779 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2384: jq_success: return 0 2024-09-10T19:16:20.779 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:266: TEST_mon_features: jqfilter='.monmap.features.persistent[]|select(. == "octopus")' 2024-09-10T19:16:20.779 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:267: TEST_mon_features: jq_success ' 2024-09-10T19:16:20.779 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' '.monmap.features.persistent[]|select(. == "octopus")' octopus 2024-09-10T19:16:20.779 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-10T19:16:20.779 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:16:20.779 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.monmap.features.persistent[]|select(. == "octopus")' 2024-09-10T19:16:20.779 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='"octopus"' 2024-09-10T19:16:20.779 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-10T19:16:20.779 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:16:20.780 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:16:20.780 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-10T19:16:20.780 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:16:20.780 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.monmap.features.persistent[]|select(. == "octopus")' 2024-09-10T19:16:20.780 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:16:20.781 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.monmap.features.persistent[]|select(. == "octopus")' 2024-09-10T19:16:20.782 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-10T19:16:20.782 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:16:20.782 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.monmap.features.persistent[]|select(. == "octopus")' 2024-09-10T19:16:20.786 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret='"octopus"' 2024-09-10T19:16:20.786 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ "octopus" == \t\r\u\e ]] 2024-09-10T19:16:20.786 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: jq_success: [[ -n "octopus" ]] 2024-09-10T19:16:20.786 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2383: jq_success: [[ "octopus" == \"\o\c\t\o\p\u\s\" ]] 2024-09-10T19:16:20.786 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2384: jq_success: return 0 2024-09-10T19:16:20.786 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:268: TEST_mon_features: jqfilter='.monmap.features.persistent[]|select(. == "pacific")' 2024-09-10T19:16:20.786 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:269: TEST_mon_features: jq_success ' 2024-09-10T19:16:20.786 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' '.monmap.features.persistent[]|select(. == "pacific")' pacific 2024-09-10T19:16:20.786 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-10T19:16:20.786 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:16:20.786 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.monmap.features.persistent[]|select(. == "pacific")' 2024-09-10T19:16:20.787 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='"pacific"' 2024-09-10T19:16:20.787 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-10T19:16:20.787 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:16:20.787 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:16:20.787 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-10T19:16:20.787 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:16:20.788 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.monmap.features.persistent[]|select(. == "pacific")' 2024-09-10T19:16:20.788 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:16:20.788 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.monmap.features.persistent[]|select(. == "pacific")' 2024-09-10T19:16:20.789 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-10T19:16:20.789 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:16:20.789 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.monmap.features.persistent[]|select(. == "pacific")' 2024-09-10T19:16:20.792 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret='"pacific"' 2024-09-10T19:16:20.792 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ "pacific" == \t\r\u\e ]] 2024-09-10T19:16:20.792 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: jq_success: [[ -n "pacific" ]] 2024-09-10T19:16:20.792 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2383: jq_success: [[ "pacific" == \"\p\a\c\i\f\i\c\" ]] 2024-09-10T19:16:20.792 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2384: jq_success: return 0 2024-09-10T19:16:20.792 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:270: TEST_mon_features: jqfilter='.monmap.features.persistent[]|select(. == "elector-pinging")' 2024-09-10T19:16:20.792 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:271: TEST_mon_features: jq_success ' 2024-09-10T19:16:20.792 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' '.monmap.features.persistent[]|select(. == "elector-pinging")' elector-pinging 2024-09-10T19:16:20.793 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-10T19:16:20.793 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:16:20.793 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.monmap.features.persistent[]|select(. == "elector-pinging")' 2024-09-10T19:16:20.793 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='"elector-pinging"' 2024-09-10T19:16:20.793 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-10T19:16:20.793 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:16:20.793 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:16:20.793 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-10T19:16:20.794 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:16:20.794 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.monmap.features.persistent[]|select(. == "elector-pinging")' 2024-09-10T19:16:20.794 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:16:20.794 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.monmap.features.persistent[]|select(. == "elector-pinging")' 2024-09-10T19:16:20.795 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-10T19:16:20.795 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:16:20.795 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.monmap.features.persistent[]|select(. == "elector-pinging")' 2024-09-10T19:16:20.798 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret='"elector-pinging"' 2024-09-10T19:16:20.799 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ "elector-pinging" == \t\r\u\e ]] 2024-09-10T19:16:20.799 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: jq_success: [[ -n "elector-pinging" ]] 2024-09-10T19:16:20.799 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2383: jq_success: [[ "elector-pinging" == \"\e\l\e\c\t\o\r\-\p\i\n\g\i\n\g\" ]] 2024-09-10T19:16:20.799 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2384: jq_success: return 0 2024-09-10T19:16:20.799 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:272: TEST_mon_features: jqfilter='.monmap.features.persistent | length == 11' 2024-09-10T19:16:20.799 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:273: TEST_mon_features: jq_success ' 2024-09-10T19:16:20.799 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' '.monmap.features.persistent | length == 11' 2024-09-10T19:16:20.799 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-10T19:16:20.799 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:16:20.799 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.monmap.features.persistent | length == 11' 2024-09-10T19:16:20.799 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='""' 2024-09-10T19:16:20.799 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-10T19:16:20.800 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:16:20.800 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:16:20.800 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-10T19:16:20.800 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:16:20.800 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.monmap.features.persistent | length == 11' 2024-09-10T19:16:20.800 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:16:20.801 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.monmap.features.persistent | length == 11' 2024-09-10T19:16:20.801 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-10T19:16:20.802 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:16:20.802 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.monmap.features.persistent | length == 11' 2024-09-10T19:16:20.805 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret=true 2024-09-10T19:16:20.805 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ true == \t\r\u\e ]] 2024-09-10T19:16:20.805 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2381: jq_success: return 0 2024-09-10T19:16:20.805 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:274: TEST_mon_features: jqfilter='.monmap.features.persistent[]|select(. == "quincy")' 2024-09-10T19:16:20.805 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:275: TEST_mon_features: jq_success ' 2024-09-10T19:16:20.805 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' '.monmap.features.persistent[]|select(. == "quincy")' quincy 2024-09-10T19:16:20.805 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-10T19:16:20.806 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:16:20.806 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.monmap.features.persistent[]|select(. == "quincy")' 2024-09-10T19:16:20.806 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='"quincy"' 2024-09-10T19:16:20.806 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-10T19:16:20.806 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:16:20.806 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:16:20.806 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-10T19:16:20.807 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:16:20.807 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.monmap.features.persistent[]|select(. == "quincy")' 2024-09-10T19:16:20.807 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:16:20.808 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.monmap.features.persistent[]|select(. == "quincy")' 2024-09-10T19:16:20.808 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-10T19:16:20.808 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:16:20.808 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.monmap.features.persistent[]|select(. == "quincy")' 2024-09-10T19:16:20.812 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret='"quincy"' 2024-09-10T19:16:20.812 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ "quincy" == \t\r\u\e ]] 2024-09-10T19:16:20.812 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: jq_success: [[ -n "quincy" ]] 2024-09-10T19:16:20.812 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2383: jq_success: [[ "quincy" == \"\q\u\i\n\c\y\" ]] 2024-09-10T19:16:20.812 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2384: jq_success: return 0 2024-09-10T19:16:20.812 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:276: TEST_mon_features: jqfilter='.monmap.features.persistent[]|select(. == "reef")' 2024-09-10T19:16:20.813 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:277: TEST_mon_features: jq_success ' 2024-09-10T19:16:20.813 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' '.monmap.features.persistent[]|select(. == "reef")' reef 2024-09-10T19:16:20.813 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-10T19:16:20.813 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:16:20.813 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.monmap.features.persistent[]|select(. == "reef")' 2024-09-10T19:16:20.813 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='"reef"' 2024-09-10T19:16:20.813 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-10T19:16:20.813 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:16:20.813 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:16:20.814 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-10T19:16:20.814 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:16:20.814 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.monmap.features.persistent[]|select(. == "reef")' 2024-09-10T19:16:20.814 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:16:20.815 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.monmap.features.persistent[]|select(. == "reef")' 2024-09-10T19:16:20.815 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-10T19:16:20.815 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:16:20.815 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.monmap.features.persistent[]|select(. == "reef")' 2024-09-10T19:16:20.819 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret='"reef"' 2024-09-10T19:16:20.819 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ "reef" == \t\r\u\e ]] 2024-09-10T19:16:20.819 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: jq_success: [[ -n "reef" ]] 2024-09-10T19:16:20.819 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2383: jq_success: [[ "reef" == \"\r\e\e\f\" ]] 2024-09-10T19:16:20.819 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2384: jq_success: return 0 2024-09-10T19:16:20.819 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:278: TEST_mon_features: jqfilter='.monmap.features.persistent[]|select(. == "squid")' 2024-09-10T19:16:20.819 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:279: TEST_mon_features: jq_success ' 2024-09-10T19:16:20.820 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' '.monmap.features.persistent[]|select(. == "squid")' squid 2024-09-10T19:16:20.820 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-10T19:16:20.820 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:16:20.820 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.monmap.features.persistent[]|select(. == "squid")' 2024-09-10T19:16:20.820 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='"squid"' 2024-09-10T19:16:20.820 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-10T19:16:20.820 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:16:20.820 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:16:20.821 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-10T19:16:20.821 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:16:20.821 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.monmap.features.persistent[]|select(. == "squid")' 2024-09-10T19:16:20.821 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:16:20.822 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.monmap.features.persistent[]|select(. == "squid")' 2024-09-10T19:16:20.822 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-10T19:16:20.822 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"05aa0188-6640-4b22-90a8-6474e6dff87e","modified":"2024-09-10T19:16:10.227369Z","created":"2024-09-10T19:15:38.702008Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:16:20.822 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.monmap.features.persistent[]|select(. == "squid")' 2024-09-10T19:16:20.825 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret='"squid"' 2024-09-10T19:16:20.826 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ "squid" == \t\r\u\e ]] 2024-09-10T19:16:20.826 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: jq_success: [[ -n "squid" ]] 2024-09-10T19:16:20.826 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2383: jq_success: [[ "squid" == \"\s\q\u\i\d\" ]] 2024-09-10T19:16:20.826 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2384: jq_success: return 0 2024-09-10T19:16:20.826 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:281: TEST_mon_features: CEPH_ARGS='--fsid=4bcb290d-a536-42b9-96b2-d16eb66370b9 --auth-supported=none --mon-initial-members=a --mon-host=127.0.0.1:7117 ' 2024-09-10T19:16:20.826 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:283: TEST_mon_features: teardown td/misc 2024-09-10T19:16:20.826 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/misc 2024-09-10T19:16:20.826 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-10T19:16:20.826 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/misc KILL 2024-09-10T19:16:20.826 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-10T19:16:20.826 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-10T19:16:20.826 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-10T19:16:20.826 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-10T19:16:20.827 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-10T19:16:20.931 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-10T19:16:20.931 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-10T19:16:20.931 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-10T19:16:20.932 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-10T19:16:20.933 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-10T19:16:20.933 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-10T19:16:20.933 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-10T19:16:20.934 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T19:16:20.934 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-10T19:16:20.934 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-10T19:16:20.934 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T19:16:20.935 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-10T19:16:20.936 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-10T19:16:20.936 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/misc 2024-09-10T19:16:20.940 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-10T19:16:20.940 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:16:20.940 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.34782 2024-09-10T19:16:20.940 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.34782 2024-09-10T19:16:20.942 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-10T19:16:20.942 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-10T19:16:20.942 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:30: run: for func in $funcs 2024-09-10T19:16:20.942 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:31: run: TEST_no_segfault_for_bad_keyring td/misc 2024-09-10T19:16:20.942 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:142: TEST_no_segfault_for_bad_keyring: local dir=td/misc 2024-09-10T19:16:20.942 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:143: TEST_no_segfault_for_bad_keyring: setup td/misc 2024-09-10T19:16:20.942 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/misc 2024-09-10T19:16:20.942 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/misc 2024-09-10T19:16:20.942 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/misc 2024-09-10T19:16:20.942 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-10T19:16:20.943 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/misc KILL 2024-09-10T19:16:20.943 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-10T19:16:20.943 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-10T19:16:20.943 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-10T19:16:20.943 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-10T19:16:20.943 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-10T19:16:20.943 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-10T19:16:20.943 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-10T19:16:20.944 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-10T19:16:20.944 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-10T19:16:20.945 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-10T19:16:20.946 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-10T19:16:20.946 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-10T19:16:20.947 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T19:16:20.947 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-10T19:16:20.947 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-10T19:16:20.947 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T19:16:20.948 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-10T19:16:20.949 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-10T19:16:20.949 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/misc 2024-09-10T19:16:20.950 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-10T19:16:20.950 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:16:20.950 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.34782 2024-09-10T19:16:20.950 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.34782 2024-09-10T19:16:20.951 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-10T19:16:20.951 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-10T19:16:20.951 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/misc 2024-09-10T19:16:20.952 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-10T19:16:20.953 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:16:20.953 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.34782 2024-09-10T19:16:20.953 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.34782 2024-09-10T19:16:20.953 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-10T19:16:20.954 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-10T19:16:20.954 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-10T19:16:20.954 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/misc 1' TERM HUP INT 2024-09-10T19:16:20.954 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:145: TEST_no_segfault_for_bad_keyring: ceph-authtool --create-keyring td/misc/ceph.mon.keyring --gen-key -n mon. --cap mon 'allow *' 2024-09-10T19:16:20.976 INFO:tasks.workunit.client.0.smithi038.stdout:creating td/misc/ceph.mon.keyring 2024-09-10T19:16:20.977 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:146: TEST_no_segfault_for_bad_keyring: ceph-authtool --create-keyring td/misc/ceph.client.admin.keyring --gen-key -n client.admin --cap mon 'allow *' 2024-09-10T19:16:21.000 INFO:tasks.workunit.client.0.smithi038.stdout:creating td/misc/ceph.client.admin.keyring 2024-09-10T19:16:21.001 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:147: TEST_no_segfault_for_bad_keyring: ceph-authtool td/misc/ceph.mon.keyring --import-keyring td/misc/ceph.client.admin.keyring 2024-09-10T19:16:21.020 INFO:tasks.workunit.client.0.smithi038.stdout:importing contents of td/misc/ceph.client.admin.keyring into td/misc/ceph.mon.keyring 2024-09-10T19:16:21.021 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:148: TEST_no_segfault_for_bad_keyring: uuidgen 2024-09-10T19:16:21.023 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:148: TEST_no_segfault_for_bad_keyring: CEPH_ARGS_TMP='--fsid=ccc5a9ba-adfa-4959-b3d6-bc4ef99f8b88 --mon-host=127.0.0.1:7102 --auth-supported=cephx ' 2024-09-10T19:16:21.023 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:149: TEST_no_segfault_for_bad_keyring: CEPH_ARGS_orig='--fsid=4bcb290d-a536-42b9-96b2-d16eb66370b9 --auth-supported=none --mon-initial-members=a --mon-host=127.0.0.1:7117 ' 2024-09-10T19:16:21.023 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:150: TEST_no_segfault_for_bad_keyring: CEPH_ARGS='--fsid=ccc5a9ba-adfa-4959-b3d6-bc4ef99f8b88 --mon-host=127.0.0.1:7102 --auth-supported=cephx --keyring=td/misc/ceph.mon.keyring ' 2024-09-10T19:16:21.023 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:151: TEST_no_segfault_for_bad_keyring: run_mon td/misc a 2024-09-10T19:16:21.023 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/misc 2024-09-10T19:16:21.023 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-10T19:16:21.023 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-10T19:16:21.023 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-10T19:16:21.023 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/misc/a 2024-09-10T19:16:21.024 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/misc/a --run-dir=td/misc 2024-09-10T19:16:21.477 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-10T19:16:21.478 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-10T19:16:21.478 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-10T19:16:21.478 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-10T19:16:21.478 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:16:21.478 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.34782 2024-09-10T19:16:21.478 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.34782/$cluster-$name.asok' 2024-09-10T19:16:21.478 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/misc/a '--log-file=td/misc/$name.log' '--admin-socket=/tmp/ceph-asok.34782/$cluster-$name.asok' --mon-cluster-log-file=td/misc/log --run-dir=td/misc '--pid-file=td/misc/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-10T19:16:21.679 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-10T19:16:21.680 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-10T19:16:21.680 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-10T19:16:21.680 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-10T19:16:21.680 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-10T19:16:21.681 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-10T19:16:21.681 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-10T19:16:21.681 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-10T19:16:21.681 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-10T19:16:21.681 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-10T19:16:21.681 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:16:21.681 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.34782 2024-09-10T19:16:21.682 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.34782/ceph-mon.a.asok 2024-09-10T19:16:21.682 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-10T19:16:21.682 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.34782/ceph-mon.a.asok config get fsid 2024-09-10T19:16:21.770 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-10T19:16:21.770 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-10T19:16:21.771 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-10T19:16:21.771 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-10T19:16:21.771 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-10T19:16:21.771 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-10T19:16:21.771 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-10T19:16:21.771 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-10T19:16:21.772 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-10T19:16:21.772 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:16:21.772 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.34782 2024-09-10T19:16:21.772 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.34782/ceph-mon.a.asok 2024-09-10T19:16:21.772 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-10T19:16:21.772 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.34782/ceph-mon.a.asok config get mon_host 2024-09-10T19:16:21.854 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:153: TEST_no_segfault_for_bad_keyring: echo -e '[client.admin]\nkey = BQAUlgtWoFePIxAAQ9YLzJSVgJX5V1lh5gyctg==' 2024-09-10T19:16:21.854 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:154: TEST_no_segfault_for_bad_keyring: CEPH_ARGS='--fsid=ccc5a9ba-adfa-4959-b3d6-bc4ef99f8b88 --mon-host=127.0.0.1:7102 --auth-supported=cephx --keyring=td/misc/bad.keyring' 2024-09-10T19:16:21.854 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:155: TEST_no_segfault_for_bad_keyring: ceph osd dump 2024-09-10T19:16:21.932 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:157: TEST_no_segfault_for_bad_keyring: '[' 1 -eq 139 ']' 2024-09-10T19:16:21.932 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:158: TEST_no_segfault_for_bad_keyring: CEPH_ARGS='--fsid=4bcb290d-a536-42b9-96b2-d16eb66370b9 --auth-supported=none --mon-initial-members=a --mon-host=127.0.0.1:7117 ' 2024-09-10T19:16:21.932 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:159: TEST_no_segfault_for_bad_keyring: teardown td/misc 2024-09-10T19:16:21.932 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/misc 2024-09-10T19:16:21.932 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-10T19:16:21.932 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/misc KILL 2024-09-10T19:16:21.932 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-10T19:16:21.933 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-10T19:16:21.933 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-10T19:16:21.933 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-10T19:16:21.933 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-10T19:16:22.037 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-10T19:16:22.037 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-10T19:16:22.038 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-10T19:16:22.038 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-10T19:16:22.039 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-10T19:16:22.039 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-10T19:16:22.039 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-10T19:16:22.040 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T19:16:22.040 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-10T19:16:22.041 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-10T19:16:22.041 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T19:16:22.041 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-10T19:16:22.043 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-10T19:16:22.043 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/misc 2024-09-10T19:16:22.044 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-10T19:16:22.044 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:16:22.044 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.34782 2024-09-10T19:16:22.044 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.34782 2024-09-10T19:16:22.046 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-10T19:16:22.046 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-10T19:16:22.046 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:30: run: for func in $funcs 2024-09-10T19:16:22.047 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:31: run: TEST_osd_pool_get_set td/misc 2024-09-10T19:16:22.047 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:38: TEST_osd_pool_get_set: local dir=td/misc 2024-09-10T19:16:22.047 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:40: TEST_osd_pool_get_set: setup td/misc 2024-09-10T19:16:22.047 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/misc 2024-09-10T19:16:22.047 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/misc 2024-09-10T19:16:22.047 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/misc 2024-09-10T19:16:22.047 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-10T19:16:22.047 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/misc KILL 2024-09-10T19:16:22.047 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-10T19:16:22.047 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-10T19:16:22.047 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-10T19:16:22.047 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-10T19:16:22.047 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-10T19:16:22.048 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-10T19:16:22.048 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-10T19:16:22.048 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-10T19:16:22.049 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-10T19:16:22.050 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-10T19:16:22.050 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-10T19:16:22.050 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-10T19:16:22.051 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T19:16:22.051 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-10T19:16:22.052 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-10T19:16:22.052 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T19:16:22.052 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-10T19:16:22.053 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-10T19:16:22.053 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/misc 2024-09-10T19:16:22.054 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-10T19:16:22.054 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:16:22.055 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.34782 2024-09-10T19:16:22.055 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.34782 2024-09-10T19:16:22.055 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-10T19:16:22.055 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-10T19:16:22.055 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/misc 2024-09-10T19:16:22.057 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-10T19:16:22.057 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:16:22.057 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.34782 2024-09-10T19:16:22.057 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.34782 2024-09-10T19:16:22.059 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-10T19:16:22.059 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-10T19:16:22.059 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-10T19:16:22.059 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/misc 1' TERM HUP INT 2024-09-10T19:16:22.059 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:41: TEST_osd_pool_get_set: run_mon td/misc a 2024-09-10T19:16:22.059 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/misc 2024-09-10T19:16:22.059 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-10T19:16:22.059 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-10T19:16:22.059 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-10T19:16:22.059 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/misc/a 2024-09-10T19:16:22.060 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/misc/a --run-dir=td/misc 2024-09-10T19:16:22.525 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-10T19:16:22.525 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-10T19:16:22.525 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-10T19:16:22.525 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-10T19:16:22.525 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:16:22.525 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.34782 2024-09-10T19:16:22.525 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.34782/$cluster-$name.asok' 2024-09-10T19:16:22.525 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/misc/a '--log-file=td/misc/$name.log' '--admin-socket=/tmp/ceph-asok.34782/$cluster-$name.asok' --mon-cluster-log-file=td/misc/log --run-dir=td/misc '--pid-file=td/misc/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-10T19:16:22.708 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-10T19:16:22.709 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-10T19:16:22.710 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-10T19:16:22.710 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-10T19:16:22.710 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-10T19:16:22.710 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-10T19:16:22.710 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-10T19:16:22.710 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-10T19:16:22.710 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-10T19:16:22.711 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-10T19:16:22.711 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:16:22.711 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.34782 2024-09-10T19:16:22.711 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.34782/ceph-mon.a.asok 2024-09-10T19:16:22.711 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-10T19:16:22.711 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.34782/ceph-mon.a.asok config get fsid 2024-09-10T19:16:22.796 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-10T19:16:22.796 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-10T19:16:22.796 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-10T19:16:22.796 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-10T19:16:22.796 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-10T19:16:22.796 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-10T19:16:22.796 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-10T19:16:22.796 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-10T19:16:22.796 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-10T19:16:22.796 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:16:22.796 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.34782 2024-09-10T19:16:22.796 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.34782/ceph-mon.a.asok 2024-09-10T19:16:22.796 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-10T19:16:22.796 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.34782/ceph-mon.a.asok config get mon_host 2024-09-10T19:16:22.876 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:42: TEST_osd_pool_get_set: create_pool rbd 8 2024-09-10T19:16:22.876 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 8 2024-09-10T19:16:23.733 INFO:tasks.workunit.client.0.smithi038.stderr:pool 'rbd' already exists 2024-09-10T19:16:23.743 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2024-09-10T19:16:24.745 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:44: TEST_osd_pool_get_set: local flag 2024-09-10T19:16:24.745 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:45: TEST_osd_pool_get_set: for flag in nodelete nopgchange nosizechange write_fadvise_dontneed noscrub nodeep-scrub 2024-09-10T19:16:24.745 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:46: TEST_osd_pool_get_set: ceph osd pool set rbd nodelete 0 2024-09-10T19:16:25.168 INFO:tasks.workunit.client.0.smithi038.stderr:set pool 1 nodelete to 0 2024-09-10T19:16:25.178 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:47: TEST_osd_pool_get_set: ceph osd dump 2024-09-10T19:16:25.178 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:47: TEST_osd_pool_get_set: grep 'pool ' 2024-09-10T19:16:25.178 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:47: TEST_osd_pool_get_set: grep nodelete 2024-09-10T19:16:25.463 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:48: TEST_osd_pool_get_set: ceph osd pool set rbd nodelete 1 2024-09-10T19:16:25.921 INFO:tasks.workunit.client.0.smithi038.stderr:set pool 1 nodelete to 1 2024-09-10T19:16:25.931 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:49: TEST_osd_pool_get_set: ceph osd dump 2024-09-10T19:16:25.931 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:49: TEST_osd_pool_get_set: grep 'pool ' 2024-09-10T19:16:25.931 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:49: TEST_osd_pool_get_set: grep nodelete 2024-09-10T19:16:26.199 INFO:tasks.workunit.client.0.smithi038.stdout:pool 1 'rbd' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 6 flags hashpspool,nodelete,creating stripe_width 0 2024-09-10T19:16:26.199 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:50: TEST_osd_pool_get_set: ceph osd pool set rbd nodelete false 2024-09-10T19:16:26.724 INFO:tasks.workunit.client.0.smithi038.stderr:set pool 1 nodelete to false 2024-09-10T19:16:26.734 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:51: TEST_osd_pool_get_set: ceph osd dump 2024-09-10T19:16:26.734 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:51: TEST_osd_pool_get_set: grep 'pool ' 2024-09-10T19:16:26.734 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:51: TEST_osd_pool_get_set: grep nodelete 2024-09-10T19:16:27.011 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:52: TEST_osd_pool_get_set: ceph osd pool set rbd nodelete false 2024-09-10T19:16:27.502 INFO:tasks.workunit.client.0.smithi038.stderr:set pool 1 nodelete to false 2024-09-10T19:16:27.511 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:54: TEST_osd_pool_get_set: ceph osd dump 2024-09-10T19:16:27.511 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:54: TEST_osd_pool_get_set: grep 'pool ' 2024-09-10T19:16:27.512 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:54: TEST_osd_pool_get_set: grep nodelete 2024-09-10T19:16:27.781 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:55: TEST_osd_pool_get_set: ceph osd pool set rbd nodelete true 2024-09-10T19:16:28.271 INFO:tasks.workunit.client.0.smithi038.stderr:set pool 1 nodelete to true 2024-09-10T19:16:28.281 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:56: TEST_osd_pool_get_set: ceph osd dump 2024-09-10T19:16:28.282 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:56: TEST_osd_pool_get_set: grep 'pool ' 2024-09-10T19:16:28.282 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:56: TEST_osd_pool_get_set: grep nodelete 2024-09-10T19:16:28.549 INFO:tasks.workunit.client.0.smithi038.stdout:pool 1 'rbd' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 12 flags hashpspool,nodelete,creating stripe_width 0 2024-09-10T19:16:28.550 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:58: TEST_osd_pool_get_set: ceph osd pool set rbd nodelete 0 2024-09-10T19:16:29.036 INFO:tasks.workunit.client.0.smithi038.stderr:set pool 1 nodelete to 0 2024-09-10T19:16:29.046 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:45: TEST_osd_pool_get_set: for flag in nodelete nopgchange nosizechange write_fadvise_dontneed noscrub nodeep-scrub 2024-09-10T19:16:29.046 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:46: TEST_osd_pool_get_set: ceph osd pool set rbd nopgchange 0 2024-09-10T19:16:29.521 INFO:tasks.workunit.client.0.smithi038.stderr:set pool 1 nopgchange to 0 2024-09-10T19:16:29.531 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:47: TEST_osd_pool_get_set: ceph osd dump 2024-09-10T19:16:29.531 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:47: TEST_osd_pool_get_set: grep 'pool ' 2024-09-10T19:16:29.531 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:47: TEST_osd_pool_get_set: grep nopgchange 2024-09-10T19:16:29.799 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:48: TEST_osd_pool_get_set: ceph osd pool set rbd nopgchange 1 2024-09-10T19:16:30.307 INFO:tasks.workunit.client.0.smithi038.stderr:set pool 1 nopgchange to 1 2024-09-10T19:16:30.317 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:49: TEST_osd_pool_get_set: ceph osd dump 2024-09-10T19:16:30.318 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:49: TEST_osd_pool_get_set: grep 'pool ' 2024-09-10T19:16:30.318 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:49: TEST_osd_pool_get_set: grep nopgchange 2024-09-10T19:16:30.585 INFO:tasks.workunit.client.0.smithi038.stdout:pool 1 'rbd' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 18 flags hashpspool,nopgchange,creating stripe_width 0 2024-09-10T19:16:30.585 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:50: TEST_osd_pool_get_set: ceph osd pool set rbd nopgchange false 2024-09-10T19:16:31.085 INFO:tasks.workunit.client.0.smithi038.stderr:set pool 1 nopgchange to false 2024-09-10T19:16:31.096 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:51: TEST_osd_pool_get_set: ceph osd dump 2024-09-10T19:16:31.096 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:51: TEST_osd_pool_get_set: grep 'pool ' 2024-09-10T19:16:31.096 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:51: TEST_osd_pool_get_set: grep nopgchange 2024-09-10T19:16:31.363 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:52: TEST_osd_pool_get_set: ceph osd pool set rbd nopgchange false 2024-09-10T19:16:31.854 INFO:tasks.workunit.client.0.smithi038.stderr:set pool 1 nopgchange to false 2024-09-10T19:16:31.864 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:54: TEST_osd_pool_get_set: ceph osd dump 2024-09-10T19:16:31.864 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:54: TEST_osd_pool_get_set: grep 'pool ' 2024-09-10T19:16:31.864 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:54: TEST_osd_pool_get_set: grep nopgchange 2024-09-10T19:16:32.132 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:55: TEST_osd_pool_get_set: ceph osd pool set rbd nopgchange true 2024-09-10T19:16:32.623 INFO:tasks.workunit.client.0.smithi038.stderr:set pool 1 nopgchange to true 2024-09-10T19:16:32.633 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:56: TEST_osd_pool_get_set: ceph osd dump 2024-09-10T19:16:32.633 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:56: TEST_osd_pool_get_set: grep 'pool ' 2024-09-10T19:16:32.633 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:56: TEST_osd_pool_get_set: grep nopgchange 2024-09-10T19:16:32.901 INFO:tasks.workunit.client.0.smithi038.stdout:pool 1 'rbd' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 24 flags hashpspool,nopgchange,creating stripe_width 0 2024-09-10T19:16:32.902 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:58: TEST_osd_pool_get_set: ceph osd pool set rbd nopgchange 0 2024-09-10T19:16:33.393 INFO:tasks.workunit.client.0.smithi038.stderr:set pool 1 nopgchange to 0 2024-09-10T19:16:33.402 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:45: TEST_osd_pool_get_set: for flag in nodelete nopgchange nosizechange write_fadvise_dontneed noscrub nodeep-scrub 2024-09-10T19:16:33.402 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:46: TEST_osd_pool_get_set: ceph osd pool set rbd nosizechange 0 2024-09-10T19:16:33.879 INFO:tasks.workunit.client.0.smithi038.stderr:set pool 1 nosizechange to 0 2024-09-10T19:16:33.889 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:47: TEST_osd_pool_get_set: ceph osd dump 2024-09-10T19:16:33.889 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:47: TEST_osd_pool_get_set: grep 'pool ' 2024-09-10T19:16:33.889 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:47: TEST_osd_pool_get_set: grep nosizechange 2024-09-10T19:16:34.165 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:48: TEST_osd_pool_get_set: ceph osd pool set rbd nosizechange 1 2024-09-10T19:16:34.656 INFO:tasks.workunit.client.0.smithi038.stderr:set pool 1 nosizechange to 1 2024-09-10T19:16:34.665 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:49: TEST_osd_pool_get_set: ceph osd dump 2024-09-10T19:16:34.666 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:49: TEST_osd_pool_get_set: grep 'pool ' 2024-09-10T19:16:34.666 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:49: TEST_osd_pool_get_set: grep nosizechange 2024-09-10T19:16:34.934 INFO:tasks.workunit.client.0.smithi038.stdout:pool 1 'rbd' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 30 flags hashpspool,nosizechange,creating stripe_width 0 2024-09-10T19:16:34.934 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:50: TEST_osd_pool_get_set: ceph osd pool set rbd nosizechange false 2024-09-10T19:16:35.425 INFO:tasks.workunit.client.0.smithi038.stderr:set pool 1 nosizechange to false 2024-09-10T19:16:35.435 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:51: TEST_osd_pool_get_set: ceph osd dump 2024-09-10T19:16:35.435 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:51: TEST_osd_pool_get_set: grep 'pool ' 2024-09-10T19:16:35.436 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:51: TEST_osd_pool_get_set: grep nosizechange 2024-09-10T19:16:35.657 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:52: TEST_osd_pool_get_set: ceph osd pool set rbd nosizechange false 2024-09-10T19:16:36.070 INFO:tasks.workunit.client.0.smithi038.stderr:set pool 1 nosizechange to false 2024-09-10T19:16:36.080 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:54: TEST_osd_pool_get_set: ceph osd dump 2024-09-10T19:16:36.080 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:54: TEST_osd_pool_get_set: grep 'pool ' 2024-09-10T19:16:36.080 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:54: TEST_osd_pool_get_set: grep nosizechange 2024-09-10T19:16:36.348 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:55: TEST_osd_pool_get_set: ceph osd pool set rbd nosizechange true 2024-09-10T19:16:36.872 INFO:tasks.workunit.client.0.smithi038.stderr:set pool 1 nosizechange to true 2024-09-10T19:16:36.883 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:56: TEST_osd_pool_get_set: ceph osd dump 2024-09-10T19:16:36.884 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:56: TEST_osd_pool_get_set: grep 'pool ' 2024-09-10T19:16:36.884 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:56: TEST_osd_pool_get_set: grep nosizechange 2024-09-10T19:16:37.150 INFO:tasks.workunit.client.0.smithi038.stdout:pool 1 'rbd' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 36 flags hashpspool,nosizechange,creating stripe_width 0 2024-09-10T19:16:37.150 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:58: TEST_osd_pool_get_set: ceph osd pool set rbd nosizechange 0 2024-09-10T19:16:37.734 INFO:tasks.workunit.client.0.smithi038.stderr:set pool 1 nosizechange to 0 2024-09-10T19:16:37.744 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:45: TEST_osd_pool_get_set: for flag in nodelete nopgchange nosizechange write_fadvise_dontneed noscrub nodeep-scrub 2024-09-10T19:16:37.744 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:46: TEST_osd_pool_get_set: ceph osd pool set rbd write_fadvise_dontneed 0 2024-09-10T19:16:38.353 INFO:tasks.workunit.client.0.smithi038.stderr:set pool 1 write_fadvise_dontneed to 0 2024-09-10T19:16:38.363 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:47: TEST_osd_pool_get_set: ceph osd dump 2024-09-10T19:16:38.363 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:47: TEST_osd_pool_get_set: grep 'pool ' 2024-09-10T19:16:38.363 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:47: TEST_osd_pool_get_set: grep write_fadvise_dontneed 2024-09-10T19:16:38.594 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:48: TEST_osd_pool_get_set: ceph osd pool set rbd write_fadvise_dontneed 1 2024-09-10T19:16:39.030 INFO:tasks.workunit.client.0.smithi038.stderr:set pool 1 write_fadvise_dontneed to 1 2024-09-10T19:16:39.039 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:49: TEST_osd_pool_get_set: ceph osd dump 2024-09-10T19:16:39.040 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:49: TEST_osd_pool_get_set: grep 'pool ' 2024-09-10T19:16:39.040 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:49: TEST_osd_pool_get_set: grep write_fadvise_dontneed 2024-09-10T19:16:39.308 INFO:tasks.workunit.client.0.smithi038.stdout:pool 1 'rbd' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 42 flags hashpspool,write_fadvise_dontneed,creating stripe_width 0 2024-09-10T19:16:39.308 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:50: TEST_osd_pool_get_set: ceph osd pool set rbd write_fadvise_dontneed false 2024-09-10T19:16:39.799 INFO:tasks.workunit.client.0.smithi038.stderr:set pool 1 write_fadvise_dontneed to false 2024-09-10T19:16:39.809 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:51: TEST_osd_pool_get_set: ceph osd dump 2024-09-10T19:16:39.809 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:51: TEST_osd_pool_get_set: grep 'pool ' 2024-09-10T19:16:39.809 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:51: TEST_osd_pool_get_set: grep write_fadvise_dontneed 2024-09-10T19:16:40.077 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:52: TEST_osd_pool_get_set: ceph osd pool set rbd write_fadvise_dontneed false 2024-09-10T19:16:40.576 INFO:tasks.workunit.client.0.smithi038.stderr:set pool 1 write_fadvise_dontneed to false 2024-09-10T19:16:40.587 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:54: TEST_osd_pool_get_set: ceph osd dump 2024-09-10T19:16:40.587 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:54: TEST_osd_pool_get_set: grep 'pool ' 2024-09-10T19:16:40.587 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:54: TEST_osd_pool_get_set: grep write_fadvise_dontneed 2024-09-10T19:16:40.854 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:55: TEST_osd_pool_get_set: ceph osd pool set rbd write_fadvise_dontneed true 2024-09-10T19:16:41.346 INFO:tasks.workunit.client.0.smithi038.stderr:set pool 1 write_fadvise_dontneed to true 2024-09-10T19:16:41.356 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:56: TEST_osd_pool_get_set: ceph osd dump 2024-09-10T19:16:41.356 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:56: TEST_osd_pool_get_set: grep 'pool ' 2024-09-10T19:16:41.356 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:56: TEST_osd_pool_get_set: grep write_fadvise_dontneed 2024-09-10T19:16:41.624 INFO:tasks.workunit.client.0.smithi038.stdout:pool 1 'rbd' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 48 flags hashpspool,write_fadvise_dontneed,creating stripe_width 0 2024-09-10T19:16:41.624 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:58: TEST_osd_pool_get_set: ceph osd pool set rbd write_fadvise_dontneed 0 2024-09-10T19:16:42.115 INFO:tasks.workunit.client.0.smithi038.stderr:set pool 1 write_fadvise_dontneed to 0 2024-09-10T19:16:42.124 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:45: TEST_osd_pool_get_set: for flag in nodelete nopgchange nosizechange write_fadvise_dontneed noscrub nodeep-scrub 2024-09-10T19:16:42.125 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:46: TEST_osd_pool_get_set: ceph osd pool set rbd noscrub 0 2024-09-10T19:16:42.617 INFO:tasks.workunit.client.0.smithi038.stderr:set pool 1 noscrub to 0 2024-09-10T19:16:42.626 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:47: TEST_osd_pool_get_set: ceph osd dump 2024-09-10T19:16:42.626 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:47: TEST_osd_pool_get_set: grep 'pool ' 2024-09-10T19:16:42.627 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:47: TEST_osd_pool_get_set: grep noscrub 2024-09-10T19:16:42.904 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:48: TEST_osd_pool_get_set: ceph osd pool set rbd noscrub 1 2024-09-10T19:16:43.411 INFO:tasks.workunit.client.0.smithi038.stderr:set pool 1 noscrub to 1 2024-09-10T19:16:43.422 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:49: TEST_osd_pool_get_set: ceph osd dump 2024-09-10T19:16:43.422 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:49: TEST_osd_pool_get_set: grep 'pool ' 2024-09-10T19:16:43.422 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:49: TEST_osd_pool_get_set: grep noscrub 2024-09-10T19:16:43.690 INFO:tasks.workunit.client.0.smithi038.stdout:pool 1 'rbd' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 54 flags hashpspool,noscrub,creating stripe_width 0 2024-09-10T19:16:43.690 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:50: TEST_osd_pool_get_set: ceph osd pool set rbd noscrub false 2024-09-10T19:16:44.198 INFO:tasks.workunit.client.0.smithi038.stderr:set pool 1 noscrub to false 2024-09-10T19:16:44.208 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:51: TEST_osd_pool_get_set: ceph osd dump 2024-09-10T19:16:44.208 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:51: TEST_osd_pool_get_set: grep 'pool ' 2024-09-10T19:16:44.208 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:51: TEST_osd_pool_get_set: grep noscrub 2024-09-10T19:16:44.476 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:52: TEST_osd_pool_get_set: ceph osd pool set rbd noscrub false 2024-09-10T19:16:45.001 INFO:tasks.workunit.client.0.smithi038.stderr:set pool 1 noscrub to false 2024-09-10T19:16:45.011 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:54: TEST_osd_pool_get_set: ceph osd dump 2024-09-10T19:16:45.011 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:54: TEST_osd_pool_get_set: grep 'pool ' 2024-09-10T19:16:45.011 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:54: TEST_osd_pool_get_set: grep noscrub 2024-09-10T19:16:45.279 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:55: TEST_osd_pool_get_set: ceph osd pool set rbd noscrub true 2024-09-10T19:16:45.812 INFO:tasks.workunit.client.0.smithi038.stderr:set pool 1 noscrub to true 2024-09-10T19:16:45.823 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:56: TEST_osd_pool_get_set: ceph osd dump 2024-09-10T19:16:45.823 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:56: TEST_osd_pool_get_set: grep 'pool ' 2024-09-10T19:16:45.823 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:56: TEST_osd_pool_get_set: grep noscrub 2024-09-10T19:16:46.107 INFO:tasks.workunit.client.0.smithi038.stdout:pool 1 'rbd' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 60 flags hashpspool,noscrub,creating stripe_width 0 2024-09-10T19:16:46.107 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:58: TEST_osd_pool_get_set: ceph osd pool set rbd noscrub 0 2024-09-10T19:16:46.615 INFO:tasks.workunit.client.0.smithi038.stderr:set pool 1 noscrub to 0 2024-09-10T19:16:46.625 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:45: TEST_osd_pool_get_set: for flag in nodelete nopgchange nosizechange write_fadvise_dontneed noscrub nodeep-scrub 2024-09-10T19:16:46.625 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:46: TEST_osd_pool_get_set: ceph osd pool set rbd nodeep-scrub 0 2024-09-10T19:16:47.101 INFO:tasks.workunit.client.0.smithi038.stderr:set pool 1 nodeep-scrub to 0 2024-09-10T19:16:47.111 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:47: TEST_osd_pool_get_set: ceph osd dump 2024-09-10T19:16:47.111 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:47: TEST_osd_pool_get_set: grep 'pool ' 2024-09-10T19:16:47.111 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:47: TEST_osd_pool_get_set: grep nodeep-scrub 2024-09-10T19:16:47.379 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:48: TEST_osd_pool_get_set: ceph osd pool set rbd nodeep-scrub 1 2024-09-10T19:16:47.887 INFO:tasks.workunit.client.0.smithi038.stderr:set pool 1 nodeep-scrub to 1 2024-09-10T19:16:47.898 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:49: TEST_osd_pool_get_set: ceph osd dump 2024-09-10T19:16:47.898 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:49: TEST_osd_pool_get_set: grep 'pool ' 2024-09-10T19:16:47.898 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:49: TEST_osd_pool_get_set: grep nodeep-scrub 2024-09-10T19:16:48.165 INFO:tasks.workunit.client.0.smithi038.stdout:pool 1 'rbd' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 66 flags hashpspool,nodeep-scrub,creating stripe_width 0 2024-09-10T19:16:48.166 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:50: TEST_osd_pool_get_set: ceph osd pool set rbd nodeep-scrub false 2024-09-10T19:16:48.673 INFO:tasks.workunit.client.0.smithi038.stderr:set pool 1 nodeep-scrub to false 2024-09-10T19:16:48.684 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:51: TEST_osd_pool_get_set: ceph osd dump 2024-09-10T19:16:48.684 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:51: TEST_osd_pool_get_set: grep 'pool ' 2024-09-10T19:16:48.684 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:51: TEST_osd_pool_get_set: grep nodeep-scrub 2024-09-10T19:16:48.944 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:52: TEST_osd_pool_get_set: ceph osd pool set rbd nodeep-scrub false 2024-09-10T19:16:49.460 INFO:tasks.workunit.client.0.smithi038.stderr:set pool 1 nodeep-scrub to false 2024-09-10T19:16:49.470 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:54: TEST_osd_pool_get_set: ceph osd dump 2024-09-10T19:16:49.470 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:54: TEST_osd_pool_get_set: grep 'pool ' 2024-09-10T19:16:49.470 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:54: TEST_osd_pool_get_set: grep nodeep-scrub 2024-09-10T19:16:49.738 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:55: TEST_osd_pool_get_set: ceph osd pool set rbd nodeep-scrub true 2024-09-10T19:16:50.246 INFO:tasks.workunit.client.0.smithi038.stderr:set pool 1 nodeep-scrub to true 2024-09-10T19:16:50.256 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:56: TEST_osd_pool_get_set: ceph osd dump 2024-09-10T19:16:50.256 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:56: TEST_osd_pool_get_set: grep 'pool ' 2024-09-10T19:16:50.256 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:56: TEST_osd_pool_get_set: grep nodeep-scrub 2024-09-10T19:16:50.524 INFO:tasks.workunit.client.0.smithi038.stdout:pool 1 'rbd' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 72 flags hashpspool,nodeep-scrub,creating stripe_width 0 2024-09-10T19:16:50.524 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:58: TEST_osd_pool_get_set: ceph osd pool set rbd nodeep-scrub 0 2024-09-10T19:16:51.024 INFO:tasks.workunit.client.0.smithi038.stderr:set pool 1 nodeep-scrub to 0 2024-09-10T19:16:51.034 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:61: TEST_osd_pool_get_set: ceph osd pool get rbd size 2024-09-10T19:16:51.034 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:61: TEST_osd_pool_get_set: awk '{print $2}' 2024-09-10T19:16:51.303 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:61: TEST_osd_pool_get_set: local size=3 2024-09-10T19:16:51.303 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:62: TEST_osd_pool_get_set: ceph osd pool get rbd min_size 2024-09-10T19:16:51.303 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:62: TEST_osd_pool_get_set: awk '{print $2}' 2024-09-10T19:16:51.501 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:62: TEST_osd_pool_get_set: local min_size=2 2024-09-10T19:16:51.501 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:63: TEST_osd_pool_get_set: expr 3 - 3 / 2 2024-09-10T19:16:51.502 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:63: TEST_osd_pool_get_set: local expected_min_size=2 2024-09-10T19:16:51.503 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:64: TEST_osd_pool_get_set: '[' 2 -ne 2 ']' 2024-09-10T19:16:51.503 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:69: TEST_osd_pool_get_set: ceph osd pool set rbd scrub_min_interval 123456 2024-09-10T19:16:51.936 INFO:tasks.workunit.client.0.smithi038.stderr:set pool 1 scrub_min_interval to 123456 2024-09-10T19:16:51.946 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:70: TEST_osd_pool_get_set: ceph osd dump 2024-09-10T19:16:51.946 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:70: TEST_osd_pool_get_set: grep 'pool ' 2024-09-10T19:16:51.946 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:70: TEST_osd_pool_get_set: grep 'scrub_min_interval 123456' 2024-09-10T19:16:52.213 INFO:tasks.workunit.client.0.smithi038.stdout:pool 1 'rbd' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 76 flags hashpspool,creating stripe_width 0 scrub_min_interval 123456 2024-09-10T19:16:52.214 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:71: TEST_osd_pool_get_set: ceph osd pool set rbd scrub_min_interval 0 2024-09-10T19:16:52.805 INFO:tasks.workunit.client.0.smithi038.stderr:set pool 1 scrub_min_interval to 0 2024-09-10T19:16:52.816 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:72: TEST_osd_pool_get_set: ceph osd dump 2024-09-10T19:16:52.816 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:72: TEST_osd_pool_get_set: grep 'pool ' 2024-09-10T19:16:52.816 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:72: TEST_osd_pool_get_set: grep scrub_min_interval 2024-09-10T19:16:53.047 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:73: TEST_osd_pool_get_set: ceph osd pool set rbd scrub_max_interval 123456 2024-09-10T19:16:53.474 INFO:tasks.workunit.client.0.smithi038.stderr:set pool 1 scrub_max_interval to 123456 2024-09-10T19:16:53.484 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:74: TEST_osd_pool_get_set: ceph osd dump 2024-09-10T19:16:53.484 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:74: TEST_osd_pool_get_set: grep 'pool ' 2024-09-10T19:16:53.484 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:74: TEST_osd_pool_get_set: grep 'scrub_max_interval 123456' 2024-09-10T19:16:53.753 INFO:tasks.workunit.client.0.smithi038.stdout:pool 1 'rbd' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 80 flags hashpspool,creating stripe_width 0 scrub_max_interval 123456 2024-09-10T19:16:53.753 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:75: TEST_osd_pool_get_set: ceph osd pool set rbd scrub_max_interval 0 2024-09-10T19:16:54.244 INFO:tasks.workunit.client.0.smithi038.stderr:set pool 1 scrub_max_interval to 0 2024-09-10T19:16:54.253 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:76: TEST_osd_pool_get_set: ceph osd dump 2024-09-10T19:16:54.253 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:76: TEST_osd_pool_get_set: grep 'pool ' 2024-09-10T19:16:54.253 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:76: TEST_osd_pool_get_set: grep scrub_max_interval 2024-09-10T19:16:54.522 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:77: TEST_osd_pool_get_set: ceph osd pool set rbd deep_scrub_interval 123456 2024-09-10T19:16:55.021 INFO:tasks.workunit.client.0.smithi038.stderr:set pool 1 deep_scrub_interval to 123456 2024-09-10T19:16:55.031 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:78: TEST_osd_pool_get_set: ceph osd dump 2024-09-10T19:16:55.031 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:78: TEST_osd_pool_get_set: grep 'pool ' 2024-09-10T19:16:55.031 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:78: TEST_osd_pool_get_set: grep 'deep_scrub_interval 123456' 2024-09-10T19:16:55.307 INFO:tasks.workunit.client.0.smithi038.stdout:pool 1 'rbd' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 84 flags hashpspool,creating stripe_width 0 deep_scrub_interval 123456 2024-09-10T19:16:55.308 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:79: TEST_osd_pool_get_set: ceph osd pool set rbd deep_scrub_interval 0 2024-09-10T19:16:55.790 INFO:tasks.workunit.client.0.smithi038.stderr:set pool 1 deep_scrub_interval to 0 2024-09-10T19:16:55.800 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:80: TEST_osd_pool_get_set: ceph osd dump 2024-09-10T19:16:55.800 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:80: TEST_osd_pool_get_set: grep 'pool ' 2024-09-10T19:16:55.800 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:80: TEST_osd_pool_get_set: grep deep_scrub_interval 2024-09-10T19:16:56.069 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:83: TEST_osd_pool_get_set: ceph osd pool set rbd 11 2024-09-10T19:16:56.224 INFO:tasks.workunit.client.0.smithi038.stderr:Invalid command: 11 not in size|min_size|pg_num|pgp_num|pgp_num_actual|crush_rule|hashpspool|nodelete|nopgchange|nosizechange|write_fadvise_dontneed|noscrub|nodeep-scrub|hit_set_type|hit_set_period|hit_set_count|hit_set_fpp|use_gmt_hitset|target_max_bytes|target_max_objects|cache_target_dirty_ratio|cache_target_dirty_high_ratio|cache_target_full_ratio|cache_min_flush_age|cache_min_evict_age|min_read_recency_for_promote|min_write_recency_for_promote|fast_read|hit_set_grade_decay_rate|hit_set_search_last_n|scrub_min_interval|scrub_max_interval|deep_scrub_interval|recovery_priority|recovery_op_priority|scrub_priority|compression_mode|compression_algorithm|compression_required_ratio|compression_max_blob_size|compression_min_blob_size|csum_type|csum_min_block|csum_max_block|allow_ec_overwrites|fingerprint_algorithm|pg_autoscale_mode|pg_autoscale_bias|pg_num_min|pg_num_max|target_size_bytes|target_size_ratio|dedup_tier|dedup_chunk_algorithm|dedup_cdc_chunk_size|eio|bulk|read_ratio 2024-09-10T19:16:56.224 INFO:tasks.workunit.client.0.smithi038.stderr:osd pool set [--yes-i-really-mean-it] : set pool parameter to 2024-09-10T19:16:56.225 INFO:tasks.workunit.client.0.smithi038.stderr:Error EINVAL: invalid command 2024-09-10T19:16:56.226 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:85: TEST_osd_pool_get_set: expr 3 + 1 2024-09-10T19:16:56.227 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:85: TEST_osd_pool_get_set: ceph osd pool set rbd min_size 4 2024-09-10T19:16:56.409 INFO:tasks.workunit.client.0.smithi038.stderr:Error EINVAL: pool min_size must be between 1 and size, which is set to 3 2024-09-10T19:16:56.411 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:86: TEST_osd_pool_get_set: ceph osd pool set rbd min_size 0 2024-09-10T19:16:56.560 INFO:tasks.workunit.client.0.smithi038.stderr:Error EINVAL: pool min_size must be between 1 and size, which is set to 3 2024-09-10T19:16:56.562 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:88: TEST_osd_pool_get_set: local ecpool=erasepool 2024-09-10T19:16:56.562 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:89: TEST_osd_pool_get_set: create_pool erasepool 12 12 erasure default 2024-09-10T19:16:56.563 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create erasepool 12 12 erasure default 2024-09-10T19:16:57.120 INFO:tasks.workunit.client.0.smithi038.stderr:pool 'erasepool' already exists 2024-09-10T19:16:57.130 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2024-09-10T19:16:58.132 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:91: TEST_osd_pool_get_set: ceph osd pool get erasepool size 2024-09-10T19:16:58.132 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:91: TEST_osd_pool_get_set: awk '{print $2}' 2024-09-10T19:16:58.339 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:91: TEST_osd_pool_get_set: local size=4 2024-09-10T19:16:58.339 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:92: TEST_osd_pool_get_set: ceph osd pool get erasepool min_size 2024-09-10T19:16:58.339 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:92: TEST_osd_pool_get_set: awk '{print $2}' 2024-09-10T19:16:58.552 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:92: TEST_osd_pool_get_set: local min_size=3 2024-09-10T19:16:58.552 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:93: TEST_osd_pool_get_set: expr 3 - 1 2024-09-10T19:16:58.553 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:93: TEST_osd_pool_get_set: local k=2 2024-09-10T19:16:58.553 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:95: TEST_osd_pool_get_set: expr 4 + 1 2024-09-10T19:16:58.554 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:95: TEST_osd_pool_get_set: ceph osd pool set erasepool size 5 2024-09-10T19:16:58.722 INFO:tasks.workunit.client.0.smithi038.stderr:Error ENOTSUP: can not change the size of an erasure-coded pool 2024-09-10T19:16:58.724 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:97: TEST_osd_pool_get_set: expr 2 + 1 2024-09-10T19:16:58.728 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:97: TEST_osd_pool_get_set: ceph osd pool set erasepool min_size 3 2024-09-10T19:16:59.215 INFO:tasks.workunit.client.0.smithi038.stderr:set pool 2 min_size to 3 2024-09-10T19:16:59.224 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:98: TEST_osd_pool_get_set: expr 2 - 1 2024-09-10T19:16:59.225 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:98: TEST_osd_pool_get_set: ceph osd pool set erasepool min_size 1 2024-09-10T19:16:59.390 INFO:tasks.workunit.client.0.smithi038.stderr:Error EINVAL: pool min_size must be between 2 and size, which is set to 4 2024-09-10T19:16:59.392 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:99: TEST_osd_pool_get_set: expr 4 + 1 2024-09-10T19:16:59.393 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:99: TEST_osd_pool_get_set: ceph osd pool set erasepool min_size 5 2024-09-10T19:16:59.540 INFO:tasks.workunit.client.0.smithi038.stderr:Error EINVAL: pool min_size must be between 2 and size, which is set to 4 2024-09-10T19:16:59.543 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:101: TEST_osd_pool_get_set: teardown td/misc 2024-09-10T19:16:59.543 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/misc 2024-09-10T19:16:59.543 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-10T19:16:59.543 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/misc KILL 2024-09-10T19:16:59.543 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-10T19:16:59.543 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-10T19:16:59.544 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-10T19:16:59.544 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-10T19:16:59.544 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-10T19:16:59.648 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-10T19:16:59.648 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-10T19:16:59.649 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-10T19:16:59.649 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-10T19:16:59.651 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-10T19:16:59.651 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-10T19:16:59.651 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-10T19:16:59.651 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T19:16:59.651 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-10T19:16:59.652 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-10T19:16:59.652 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T19:16:59.652 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-10T19:16:59.654 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-10T19:16:59.654 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/misc 2024-09-10T19:16:59.657 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-10T19:16:59.658 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:16:59.658 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.34782 2024-09-10T19:16:59.658 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.34782 2024-09-10T19:16:59.659 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-10T19:16:59.659 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-10T19:16:59.659 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2322: main: code=0 2024-09-10T19:16:59.659 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2326: main: teardown td/misc 0 2024-09-10T19:16:59.659 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/misc 2024-09-10T19:16:59.660 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2024-09-10T19:16:59.660 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/misc KILL 2024-09-10T19:16:59.660 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-10T19:16:59.660 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-10T19:16:59.660 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-10T19:16:59.660 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-10T19:16:59.660 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-10T19:16:59.661 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-10T19:16:59.661 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-10T19:16:59.662 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-10T19:16:59.662 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-10T19:16:59.663 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-10T19:16:59.663 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-10T19:16:59.663 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-10T19:16:59.664 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T19:16:59.664 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-10T19:16:59.665 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-10T19:16:59.665 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T19:16:59.665 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-10T19:16:59.666 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2024-09-10T19:16:59.666 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/misc 2024-09-10T19:16:59.668 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-10T19:16:59.668 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:16:59.668 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.34782 2024-09-10T19:16:59.668 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.34782 2024-09-10T19:16:59.669 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-10T19:16:59.669 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-10T19:16:59.670 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2327: main: return 0 2024-09-10T19:16:59.670 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-10T19:16:59.670 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-10T19:16:59.696 INFO:tasks.workunit:Running workunit mon/mkfs.sh... 2024-09-10T19:16:59.696 DEBUG:teuthology.orchestra.run.smithi038:workunit test mon/mkfs.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad1f558c327094897e4a32e99dd5cb4ae6ccd46 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh 2024-09-10T19:16:59.759 INFO:tasks.workunit.client.0.smithi038.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2024-09-10T19:16:59.759 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:22: : DIR=mkfs 2024-09-10T19:16:59.759 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:23: : export CEPH_CONF=/dev/null 2024-09-10T19:16:59.759 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:23: : CEPH_CONF=/dev/null 2024-09-10T19:16:59.759 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:24: : unset CEPH_ARGS 2024-09-10T19:16:59.759 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:25: : MON_ID=a 2024-09-10T19:16:59.759 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:26: : MON_DIR=mkfs/a 2024-09-10T19:16:59.759 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:27: : CEPH_MON=127.0.0.1:7110 2024-09-10T19:16:59.760 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:28: : TIMEOUT=360 2024-09-10T19:16:59.760 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:30: : EXTRAOPTS= 2024-09-10T19:16:59.760 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:188: : run 2024-09-10T19:16:59.760 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:175: run: local actions 2024-09-10T19:16:59.760 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:176: run: actions+='makedir ' 2024-09-10T19:16:59.760 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:177: run: actions+='idempotent ' 2024-09-10T19:16:59.760 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:178: run: actions+='auth_cephx_key ' 2024-09-10T19:16:59.760 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:179: run: actions+='auth_cephx_keyring ' 2024-09-10T19:16:59.760 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:180: run: actions+='auth_none ' 2024-09-10T19:16:59.760 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:181: run: for action in $actions 2024-09-10T19:16:59.760 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:182: run: setup 2024-09-10T19:16:59.760 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:33: setup: teardown 2024-09-10T19:16:59.761 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:38: teardown: kill_daemons 2024-09-10T19:16:59.761 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:73: kill_daemons: find mkfs -name pidfile 2024-09-10T19:16:59.761 INFO:tasks.workunit.client.0.smithi038.stderr:find: ‘mkfs’: No such file or directory 2024-09-10T19:16:59.761 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:39: teardown: rm -fr mkfs 2024-09-10T19:16:59.761 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:34: setup: mkdir mkfs 2024-09-10T19:16:59.761 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:183: run: makedir 2024-09-10T19:16:59.762 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:149: makedir: local toodeep=mkfs/a/toodeep 2024-09-10T19:16:59.762 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:153: makedir: ceph-mon --id a --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mkfs --mon-data=mkfs/a/toodeep 2024-09-10T19:16:59.762 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:158: makedir: tee mkfs/makedir.log 2024-09-10T19:16:59.779 INFO:tasks.workunit.client.0.smithi038.stdout:2024-09-10T19:16:59.778+0000 7f1dcbd20c80 -1 mkdir(mkfs/a/toodeep) : (2) No such file or directory 2024-09-10T19:16:59.781 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:159: makedir: grep 'toodeep.*No such file' mkfs/makedir.log 2024-09-10T19:16:59.782 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:160: makedir: rm mkfs/makedir.log 2024-09-10T19:16:59.783 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:163: makedir: mkdir mkfs/a 2024-09-10T19:16:59.784 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:164: makedir: mon_mkfs --auth-supported=none 2024-09-10T19:16:59.784 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:164: makedir: tee mkfs/makedir.log 2024-09-10T19:16:59.784 INFO:tasks.workunit.client.0.smithi038.stdout://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:43: mon_mkfs: uuidgen 2024-09-10T19:16:59.785 INFO:tasks.workunit.client.0.smithi038.stdout:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:43: mon_mkfs: local fsid=ab5865b4-3a1b-4ef1-8961-f3d6fc572e5a 2024-09-10T19:16:59.785 INFO:tasks.workunit.client.0.smithi038.stdout:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:46: mon_mkfs: ceph-mon --id a --fsid ab5865b4-3a1b-4ef1-8961-f3d6fc572e5a --mkfs --mon-data=mkfs/a --mon-initial-members=a --mon-host=127.0.0.1:7110 --auth-supported=none 2024-09-10T19:17:00.256 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:165: makedir: grep 'mkfs/a already exists' mkfs/makedir.log 2024-09-10T19:17:00.257 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:184: run: teardown 2024-09-10T19:17:00.258 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:38: teardown: kill_daemons 2024-09-10T19:17:00.258 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:73: kill_daemons: find mkfs -name pidfile 2024-09-10T19:17:00.258 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:39: teardown: rm -fr mkfs 2024-09-10T19:17:00.260 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:181: run: for action in $actions 2024-09-10T19:17:00.260 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:182: run: setup 2024-09-10T19:17:00.260 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:33: setup: teardown 2024-09-10T19:17:00.260 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:38: teardown: kill_daemons 2024-09-10T19:17:00.260 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:73: kill_daemons: find mkfs -name pidfile 2024-09-10T19:17:00.261 INFO:tasks.workunit.client.0.smithi038.stderr:find: ‘mkfs’: No such file or directory 2024-09-10T19:17:00.261 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:39: teardown: rm -fr mkfs 2024-09-10T19:17:00.261 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:34: setup: mkdir mkfs 2024-09-10T19:17:00.263 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:183: run: idempotent 2024-09-10T19:17:00.263 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:169: idempotent: mon_mkfs --auth-supported=none 2024-09-10T19:17:00.263 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:43: mon_mkfs: uuidgen 2024-09-10T19:17:00.263 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:43: mon_mkfs: local fsid=f28be996-02c6-42c7-88ea-0e35ccb7010c 2024-09-10T19:17:00.264 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:46: mon_mkfs: ceph-mon --id a --fsid f28be996-02c6-42c7-88ea-0e35ccb7010c --mkfs --mon-data=mkfs/a --mon-initial-members=a --mon-host=127.0.0.1:7110 --auth-supported=none 2024-09-10T19:17:00.718 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:170: idempotent: mon_mkfs --auth-supported=none 2024-09-10T19:17:00.718 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:170: idempotent: tee mkfs/makedir.log 2024-09-10T19:17:00.718 INFO:tasks.workunit.client.0.smithi038.stdout://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:43: mon_mkfs: uuidgen 2024-09-10T19:17:00.718 INFO:tasks.workunit.client.0.smithi038.stdout:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:43: mon_mkfs: local fsid=7ac89dd3-aef9-4ec1-8f79-405afb668ff4 2024-09-10T19:17:00.718 INFO:tasks.workunit.client.0.smithi038.stdout:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:46: mon_mkfs: ceph-mon --id a --fsid 7ac89dd3-aef9-4ec1-8f79-405afb668ff4 --mkfs --mon-data=mkfs/a --mon-initial-members=a --mon-host=127.0.0.1:7110 --auth-supported=none 2024-09-10T19:17:00.737 INFO:tasks.workunit.client.0.smithi038.stdout:2024-09-10T19:17:00.735+0000 7f8bdfa1ac80 -1 'mkfs/a' already exists and is not empty: monitor may already exist 2024-09-10T19:17:00.738 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:171: idempotent: grep ''\''mkfs/a'\'' already exists' mkfs/makedir.log 2024-09-10T19:17:00.740 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:184: run: teardown 2024-09-10T19:17:00.740 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:38: teardown: kill_daemons 2024-09-10T19:17:00.740 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:73: kill_daemons: find mkfs -name pidfile 2024-09-10T19:17:00.741 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:39: teardown: rm -fr mkfs 2024-09-10T19:17:00.742 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:181: run: for action in $actions 2024-09-10T19:17:00.742 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:182: run: setup 2024-09-10T19:17:00.742 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:33: setup: teardown 2024-09-10T19:17:00.742 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:38: teardown: kill_daemons 2024-09-10T19:17:00.742 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:73: kill_daemons: find mkfs -name pidfile 2024-09-10T19:17:00.743 INFO:tasks.workunit.client.0.smithi038.stderr:find: ‘mkfs’: No such file or directory 2024-09-10T19:17:00.743 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:39: teardown: rm -fr mkfs 2024-09-10T19:17:00.743 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:34: setup: mkdir mkfs 2024-09-10T19:17:00.745 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:183: run: auth_cephx_key 2024-09-10T19:17:00.745 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:122: auth_cephx_key: '[' -f /etc/ceph/keyring ']' 2024-09-10T19:17:00.745 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:127: auth_cephx_key: ceph-authtool --gen-print-key 2024-09-10T19:17:00.761 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:127: auth_cephx_key: local key=AQAsm+Bm3mdELRAAvIKzcdMLgdtCiKm8otPesg== 2024-09-10T19:17:00.761 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:129: auth_cephx_key: mon_mkfs '--key=corrupted key' 2024-09-10T19:17:00.761 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:43: mon_mkfs: uuidgen 2024-09-10T19:17:00.762 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:43: mon_mkfs: local fsid=c560a6d5-fcd7-45c2-a713-8acfad9ce1aa 2024-09-10T19:17:00.762 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:46: mon_mkfs: ceph-mon --id a --fsid c560a6d5-fcd7-45c2-a713-8acfad9ce1aa --mkfs --mon-data=mkfs/a --mon-initial-members=a --mon-host=127.0.0.1:7110 '--key=corrupted key' 2024-09-10T19:17:01.142 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:17:01.140+0000 7f28f160dc80 -1 mon.a@-1(???) e0 error decoding keyring [mon.] 2024-09-10T19:17:01.142 INFO:tasks.workunit.client.0.smithi038.stderr: key = corrupted key 2024-09-10T19:17:01.142 INFO:tasks.workunit.client.0.smithi038.stderr: caps mon = "allow *" 2024-09-10T19:17:01.142 INFO:tasks.workunit.client.0.smithi038.stderr:: error setting modifier for [mon.] type=key val=corrupted key: Malformed input [buffer:3] 2024-09-10T19:17:01.142 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:17:01.140+0000 7f28f160dc80 -1 ceph-mon: error creating monfs: (22) Invalid argument 2024-09-10T19:17:01.143 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:132: auth_cephx_key: rm -fr mkfs/a 2024-09-10T19:17:01.144 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:135: auth_cephx_key: mon_mkfs --key=AQAsm+Bm3mdELRAAvIKzcdMLgdtCiKm8otPesg== 2024-09-10T19:17:01.144 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:43: mon_mkfs: uuidgen 2024-09-10T19:17:01.145 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:43: mon_mkfs: local fsid=2f9afb61-6061-4bd6-9638-2098c0e404b0 2024-09-10T19:17:01.145 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:46: mon_mkfs: ceph-mon --id a --fsid 2f9afb61-6061-4bd6-9638-2098c0e404b0 --mkfs --mon-data=mkfs/a --mon-initial-members=a --mon-host=127.0.0.1:7110 --key=AQAsm+Bm3mdELRAAvIKzcdMLgdtCiKm8otPesg== 2024-09-10T19:17:01.622 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:137: auth_cephx_key: '[' -f mkfs/a/keyring ']' 2024-09-10T19:17:01.623 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:138: auth_cephx_key: grep AQAsm+Bm3mdELRAAvIKzcdMLgdtCiKm8otPesg== mkfs/a/keyring 2024-09-10T19:17:01.623 INFO:tasks.workunit.client.0.smithi038.stdout: key = AQAsm+Bm3mdELRAAvIKzcdMLgdtCiKm8otPesg== 2024-09-10T19:17:01.624 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:140: auth_cephx_key: mon_run 2024-09-10T19:17:01.624 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:58: mon_run: ceph-mon --id a --chdir= --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data=mkfs/a --log-file=mkfs/a/log --mon-cluster-log-file=mkfs/a/log --run-dir=mkfs/a --pid-file=mkfs/a/pidfile --public-addr 127.0.0.1:7110 2024-09-10T19:17:01.800 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:142: auth_cephx_key: timeout 360 ceph --name mon. --keyring mkfs/a/keyring --mon-host 127.0.0.1:7110 mon stat 2024-09-10T19:17:02.611 INFO:tasks.workunit.client.0.smithi038.stdout:e1: 1 mons at {a=v2:127.0.0.1:7110/0} removed_ranks: {} disallowed_leaders: {}, election epoch 3, leader 0 a, quorum 0 a 2024-09-10T19:17:02.620 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:184: run: teardown 2024-09-10T19:17:02.621 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:38: teardown: kill_daemons 2024-09-10T19:17:02.621 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:73: kill_daemons: find mkfs -name pidfile 2024-09-10T19:17:02.622 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:73: kill_daemons: for pidfile in $(find $DIR -name pidfile) 2024-09-10T19:17:02.622 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:74: kill_daemons: cat mkfs/a/pidfile 2024-09-10T19:17:02.623 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:74: kill_daemons: pid=38775 2024-09-10T19:17:02.623 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:75: kill_daemons: for try in 0 1 1 1 2 3 2024-09-10T19:17:02.623 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:76: kill_daemons: kill 38775 2024-09-10T19:17:02.623 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:77: kill_daemons: sleep 0 2024-09-10T19:17:02.624 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:75: kill_daemons: for try in 0 1 1 1 2 3 2024-09-10T19:17:02.624 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:76: kill_daemons: kill 38775 2024-09-10T19:17:02.624 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:77: kill_daemons: sleep 1 2024-09-10T19:17:03.625 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:75: kill_daemons: for try in 0 1 1 1 2 3 2024-09-10T19:17:03.626 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:76: kill_daemons: kill 38775 2024-09-10T19:17:03.626 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh: line 76: kill: (38775) - No such process 2024-09-10T19:17:03.626 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:76: kill_daemons: break 2024-09-10T19:17:03.626 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:39: teardown: rm -fr mkfs 2024-09-10T19:17:03.627 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:181: run: for action in $actions 2024-09-10T19:17:03.627 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:182: run: setup 2024-09-10T19:17:03.627 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:33: setup: teardown 2024-09-10T19:17:03.627 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:38: teardown: kill_daemons 2024-09-10T19:17:03.627 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:73: kill_daemons: find mkfs -name pidfile 2024-09-10T19:17:03.628 INFO:tasks.workunit.client.0.smithi038.stderr:find: ‘mkfs’: No such file or directory 2024-09-10T19:17:03.628 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:39: teardown: rm -fr mkfs 2024-09-10T19:17:03.629 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:34: setup: mkdir mkfs 2024-09-10T19:17:03.630 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:183: run: auth_cephx_keyring 2024-09-10T19:17:03.630 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:103: auth_cephx_keyring: cat 2024-09-10T19:17:03.631 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:109: auth_cephx_keyring: mon_mkfs --keyring=mkfs/keyring 2024-09-10T19:17:03.631 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:43: mon_mkfs: uuidgen 2024-09-10T19:17:03.632 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:43: mon_mkfs: local fsid=40b930e4-97bf-4e65-aec1-fe0646be5c1b 2024-09-10T19:17:03.633 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:46: mon_mkfs: ceph-mon --id a --fsid 40b930e4-97bf-4e65-aec1-fe0646be5c1b --mkfs --mon-data=mkfs/a --mon-initial-members=a --mon-host=127.0.0.1:7110 --keyring=mkfs/keyring 2024-09-10T19:17:04.096 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:111: auth_cephx_keyring: '[' -f mkfs/a/keyring ']' 2024-09-10T19:17:04.096 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:113: auth_cephx_keyring: mon_run 2024-09-10T19:17:04.096 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:58: mon_run: ceph-mon --id a --chdir= --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data=mkfs/a --log-file=mkfs/a/log --mon-cluster-log-file=mkfs/a/log --run-dir=mkfs/a --pid-file=mkfs/a/pidfile --public-addr 127.0.0.1:7110 2024-09-10T19:17:04.282 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:115: auth_cephx_keyring: timeout 360 ceph --name mon. --keyring mkfs/a/keyring --mon-host 127.0.0.1:7110 mon stat 2024-09-10T19:17:05.091 INFO:tasks.workunit.client.0.smithi038.stdout:e1: 1 mons at {a=v2:127.0.0.1:7110/0} removed_ranks: {} disallowed_leaders: {}, election epoch 3, leader 0 a, quorum 0 a 2024-09-10T19:17:05.101 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:184: run: teardown 2024-09-10T19:17:05.101 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:38: teardown: kill_daemons 2024-09-10T19:17:05.101 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:73: kill_daemons: find mkfs -name pidfile 2024-09-10T19:17:05.102 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:73: kill_daemons: for pidfile in $(find $DIR -name pidfile) 2024-09-10T19:17:05.102 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:74: kill_daemons: cat mkfs/a/pidfile 2024-09-10T19:17:05.103 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:74: kill_daemons: pid=38872 2024-09-10T19:17:05.103 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:75: kill_daemons: for try in 0 1 1 1 2 3 2024-09-10T19:17:05.103 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:76: kill_daemons: kill 38872 2024-09-10T19:17:05.103 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:77: kill_daemons: sleep 0 2024-09-10T19:17:05.104 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:75: kill_daemons: for try in 0 1 1 1 2 3 2024-09-10T19:17:05.104 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:76: kill_daemons: kill 38872 2024-09-10T19:17:05.104 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:77: kill_daemons: sleep 1 2024-09-10T19:17:06.105 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:75: kill_daemons: for try in 0 1 1 1 2 3 2024-09-10T19:17:06.106 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:76: kill_daemons: kill 38872 2024-09-10T19:17:06.106 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh: line 76: kill: (38872) - No such process 2024-09-10T19:17:06.106 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:76: kill_daemons: break 2024-09-10T19:17:06.106 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:39: teardown: rm -fr mkfs 2024-09-10T19:17:06.107 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:181: run: for action in $actions 2024-09-10T19:17:06.107 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:182: run: setup 2024-09-10T19:17:06.107 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:33: setup: teardown 2024-09-10T19:17:06.107 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:38: teardown: kill_daemons 2024-09-10T19:17:06.107 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:73: kill_daemons: find mkfs -name pidfile 2024-09-10T19:17:06.108 INFO:tasks.workunit.client.0.smithi038.stderr:find: ‘mkfs’: No such file or directory 2024-09-10T19:17:06.108 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:39: teardown: rm -fr mkfs 2024-09-10T19:17:06.109 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:34: setup: mkdir mkfs 2024-09-10T19:17:06.110 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:183: run: auth_none 2024-09-10T19:17:06.111 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:83: auth_none: mon_mkfs --auth-supported=none 2024-09-10T19:17:06.111 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:43: mon_mkfs: uuidgen 2024-09-10T19:17:06.112 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:43: mon_mkfs: local fsid=290ad2ed-bf95-42dc-bc12-7e305c7b0c29 2024-09-10T19:17:06.112 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:46: mon_mkfs: ceph-mon --id a --fsid 290ad2ed-bf95-42dc-bc12-7e305c7b0c29 --mkfs --mon-data=mkfs/a --mon-initial-members=a --mon-host=127.0.0.1:7110 --auth-supported=none 2024-09-10T19:17:06.577 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:86: auth_none: ceph-mon --id a --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data=mkfs/a --extract-monmap mkfs/a/monmap 2024-09-10T19:17:06.740 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:17:06.739+0000 7f5d77a12c80 -1 wrote monmap to mkfs/a/monmap 2024-09-10T19:17:06.743 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:93: auth_none: '[' -f mkfs/a/monmap ']' 2024-09-10T19:17:06.743 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:95: auth_none: '[' '!' -f mkfs/a/keyring ']' 2024-09-10T19:17:06.743 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:97: auth_none: mon_run --auth-supported=none 2024-09-10T19:17:06.743 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:58: mon_run: ceph-mon --id a --chdir= --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data=mkfs/a --log-file=mkfs/a/log --mon-cluster-log-file=mkfs/a/log --run-dir=mkfs/a --pid-file=mkfs/a/pidfile --public-addr 127.0.0.1:7110 --auth-supported=none 2024-09-10T19:17:06.888 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:99: auth_none: timeout 360 ceph --mon-host 127.0.0.1:7110 mon stat 2024-09-10T19:17:06.972 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:17:06.971+0000 7f60479c2640 -1 auth: unable to find a keyring on /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin: (2) No such file or directory 2024-09-10T19:17:06.973 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:17:06.971+0000 7f60479c2640 -1 AuthRegistry(0x7f60400692d0) no keyring found at /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin, disabling cephx 2024-09-10T19:17:06.973 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:17:06.971+0000 7f60479c2640 -1 auth: unable to find a keyring on /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin: (2) No such file or directory 2024-09-10T19:17:06.973 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:17:06.971+0000 7f60479c2640 -1 AuthRegistry(0x7f60479c0fe0) no keyring found at /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin, disabling cephx 2024-09-10T19:17:07.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:17:07.575+0000 7f60479c2640 -1 auth: unable to find a keyring on /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin: (2) No such file or directory 2024-09-10T19:17:07.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:17:07.575+0000 7f60479c2640 -1 AuthRegistry(0x7f6040066ab0) no keyring found at /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin, disabling cephx 2024-09-10T19:17:07.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:17:07.575+0000 7f60479c2640 -1 auth: unable to find a keyring on /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin: (2) No such file or directory 2024-09-10T19:17:07.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:17:07.575+0000 7f60479c2640 -1 AuthRegistry(0x7f6040102e80) no keyring found at /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin, disabling cephx 2024-09-10T19:17:07.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:17:07.575+0000 7f60479c2640 -1 auth: unable to find a keyring on /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin: (2) No such file or directory 2024-09-10T19:17:07.577 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:17:07.575+0000 7f60479c2640 -1 AuthRegistry(0x7f6040066ab0) no keyring found at /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin, disabling cephx 2024-09-10T19:17:07.692 INFO:tasks.workunit.client.0.smithi038.stdout:e1: 1 mons at {a=v2:127.0.0.1:7110/0} removed_ranks: {} disallowed_leaders: {}, election epoch 3, leader 0 a, quorum 0 a 2024-09-10T19:17:07.701 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:184: run: teardown 2024-09-10T19:17:07.702 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:38: teardown: kill_daemons 2024-09-10T19:17:07.702 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:73: kill_daemons: find mkfs -name pidfile 2024-09-10T19:17:07.703 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:73: kill_daemons: for pidfile in $(find $DIR -name pidfile) 2024-09-10T19:17:07.703 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:74: kill_daemons: cat mkfs/a/pidfile 2024-09-10T19:17:07.704 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:74: kill_daemons: pid=38990 2024-09-10T19:17:07.704 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:75: kill_daemons: for try in 0 1 1 1 2 3 2024-09-10T19:17:07.704 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:76: kill_daemons: kill 38990 2024-09-10T19:17:07.704 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:77: kill_daemons: sleep 0 2024-09-10T19:17:07.705 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:75: kill_daemons: for try in 0 1 1 1 2 3 2024-09-10T19:17:07.705 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:76: kill_daemons: kill 38990 2024-09-10T19:17:07.705 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:77: kill_daemons: sleep 1 2024-09-10T19:17:08.707 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:75: kill_daemons: for try in 0 1 1 1 2 3 2024-09-10T19:17:08.707 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:76: kill_daemons: kill 38990 2024-09-10T19:17:08.707 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh: line 76: kill: (38990) - No such process 2024-09-10T19:17:08.707 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:76: kill_daemons: break 2024-09-10T19:17:08.707 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:39: teardown: rm -fr mkfs 2024-09-10T19:17:08.708 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-10T19:17:08.709 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-10T19:17:08.780 INFO:tasks.workunit:Running workunit mon/mon-bind.sh... 2024-09-10T19:17:08.780 DEBUG:teuthology.orchestra.run.smithi038:workunit test mon/mon-bind.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad1f558c327094897e4a32e99dd5cb4ae6ccd46 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh 2024-09-10T19:17:08.846 INFO:tasks.workunit.client.0.smithi038.stderr:stty: 'standard input': Inappropriate ioctl for device 2024-09-10T19:17:08.852 INFO:tasks.workunit.client.0.smithi038.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2024-09-10T19:17:08.852 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2315: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-10T19:17:08.852 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2315: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-10T19:17:08.852 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2316: main: export PYTHONWARNINGS=ignore 2024-09-10T19:17:08.853 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2316: main: PYTHONWARNINGS=ignore 2024-09-10T19:17:08.853 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2317: main: export CEPH_CONF=/dev/null 2024-09-10T19:17:08.853 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2317: main: CEPH_CONF=/dev/null 2024-09-10T19:17:08.853 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2318: main: unset CEPH_ARGS 2024-09-10T19:17:08.853 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2320: main: local code 2024-09-10T19:17:08.853 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2321: main: run td/mon-bind 2024-09-10T19:17:08.853 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:37: run: local dir=td/mon-bind 2024-09-10T19:17:08.853 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:38: run: shift 2024-09-10T19:17:08.853 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:40: run: export MON_IP=127.0.0.1 2024-09-10T19:17:08.853 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:40: run: MON_IP=127.0.0.1 2024-09-10T19:17:08.854 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:41: run: export MONA_PUBLIC=7132 2024-09-10T19:17:08.854 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:41: run: MONA_PUBLIC=7132 2024-09-10T19:17:08.854 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:42: run: export MONB_PUBLIC=7133 2024-09-10T19:17:08.854 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:42: run: MONB_PUBLIC=7133 2024-09-10T19:17:08.854 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:43: run: export MONC_PUBLIC=7134 2024-09-10T19:17:08.854 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:43: run: MONC_PUBLIC=7134 2024-09-10T19:17:08.854 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:44: run: export MONA_BIND=7135 2024-09-10T19:17:08.854 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:44: run: MONA_BIND=7135 2024-09-10T19:17:08.854 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:45: run: export MONB_BIND=7136 2024-09-10T19:17:08.854 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:45: run: MONB_BIND=7136 2024-09-10T19:17:08.854 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:46: run: export MONC_BIND=7137 2024-09-10T19:17:08.854 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:46: run: MONC_BIND=7137 2024-09-10T19:17:08.854 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:47: run: export CEPH_ARGS 2024-09-10T19:17:08.854 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:48: run: uuidgen 2024-09-10T19:17:08.854 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:48: run: CEPH_ARGS+='--fsid=4175a07f-e315-4f73-82a9-ae0d4fd12748 --auth-supported=none ' 2024-09-10T19:17:08.855 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:50: run: set 2024-09-10T19:17:08.855 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:50: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2024-09-10T19:17:08.856 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:50: run: local 'funcs=TEST_mon_client_connect 2024-09-10T19:17:08.856 INFO:tasks.workunit.client.0.smithi038.stderr:TEST_mon_client_connect_fails 2024-09-10T19:17:08.856 INFO:tasks.workunit.client.0.smithi038.stderr:TEST_mon_quorum 2024-09-10T19:17:08.856 INFO:tasks.workunit.client.0.smithi038.stderr:TEST_put_get' 2024-09-10T19:17:08.856 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:51: run: for func in $funcs 2024-09-10T19:17:08.856 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:52: run: setup td/mon-bind 2024-09-10T19:17:08.857 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/mon-bind 2024-09-10T19:17:08.857 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/mon-bind 2024-09-10T19:17:08.857 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mon-bind 2024-09-10T19:17:08.857 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-10T19:17:08.857 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mon-bind KILL 2024-09-10T19:17:08.857 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-10T19:17:08.857 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-10T19:17:08.857 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-10T19:17:08.857 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-10T19:17:08.857 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-10T19:17:08.857 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-10T19:17:08.858 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-10T19:17:08.858 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-10T19:17:08.858 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-10T19:17:08.859 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-10T19:17:08.859 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-10T19:17:08.859 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-10T19:17:08.860 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T19:17:08.860 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-10T19:17:08.860 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-10T19:17:08.861 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T19:17:08.861 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-10T19:17:08.862 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-10T19:17:08.862 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mon-bind 2024-09-10T19:17:08.864 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-10T19:17:08.864 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:17:08.864 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.39094 2024-09-10T19:17:08.864 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.39094 2024-09-10T19:17:08.865 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-10T19:17:08.865 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-10T19:17:08.865 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/mon-bind 2024-09-10T19:17:08.866 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-10T19:17:08.866 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:17:08.866 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.39094 2024-09-10T19:17:08.867 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.39094 2024-09-10T19:17:08.868 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-10T19:17:08.869 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2024-09-10T19:17:08.869 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2024-09-10T19:17:08.869 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-10T19:17:08.869 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/mon-bind 1' TERM HUP INT 2024-09-10T19:17:08.869 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:53: run: TEST_mon_client_connect td/mon-bind 2024-09-10T19:17:08.869 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:72: TEST_mon_client_connect: local dir=td/mon-bind 2024-09-10T19:17:08.869 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:76: TEST_mon_client_connect: CEPH_ARGS+='--mon-host=127.0.0.1:7132 ' 2024-09-10T19:17:08.869 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:77: TEST_mon_client_connect: run_mon td/mon-bind a --mon-host=127.0.0.1:7132 --public-bind-addr=127.0.0.1:7135 2024-09-10T19:17:08.869 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/mon-bind 2024-09-10T19:17:08.869 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-10T19:17:08.869 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-10T19:17:08.869 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-10T19:17:08.869 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/mon-bind/a 2024-09-10T19:17:08.869 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/mon-bind/a --run-dir=td/mon-bind --mon-host=127.0.0.1:7132 --public-bind-addr=127.0.0.1:7135 2024-09-10T19:17:09.294 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-10T19:17:09.294 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-10T19:17:09.294 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-10T19:17:09.294 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-10T19:17:09.295 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:17:09.295 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.39094 2024-09-10T19:17:09.295 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.39094/$cluster-$name.asok' 2024-09-10T19:17:09.295 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/mon-bind/a '--log-file=td/mon-bind/$name.log' '--admin-socket=/tmp/ceph-asok.39094/$cluster-$name.asok' --mon-cluster-log-file=td/mon-bind/log --run-dir=td/mon-bind '--pid-file=td/mon-bind/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --mon-host=127.0.0.1:7132 --public-bind-addr=127.0.0.1:7135 2024-09-10T19:17:09.486 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-10T19:17:09.487 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-10T19:17:09.487 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-10T19:17:09.487 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-10T19:17:09.488 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-10T19:17:09.489 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-10T19:17:09.489 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-10T19:17:09.489 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-10T19:17:09.489 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-10T19:17:09.489 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-10T19:17:09.490 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:17:09.490 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.39094 2024-09-10T19:17:09.490 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.39094/ceph-mon.a.asok 2024-09-10T19:17:09.490 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-10T19:17:09.490 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.39094/ceph-mon.a.asok config get fsid 2024-09-10T19:17:09.578 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-10T19:17:09.578 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-10T19:17:09.578 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-10T19:17:09.578 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-10T19:17:09.578 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-10T19:17:09.579 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-10T19:17:09.579 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-10T19:17:09.579 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-10T19:17:09.579 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-10T19:17:09.579 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:17:09.579 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.39094 2024-09-10T19:17:09.579 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.39094/ceph-mon.a.asok 2024-09-10T19:17:09.579 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-10T19:17:09.579 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.39094/ceph-mon.a.asok config get mon_host 2024-09-10T19:17:09.661 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:80: TEST_mon_client_connect: port_forward 7132 7135 2024-09-10T19:17:09.661 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:20: port_forward: local source_port=7132 2024-09-10T19:17:09.661 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:21: port_forward: local target_port=7135 2024-09-10T19:17:09.661 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:24: port_forward: SOCAT_PIDS+=($!) 2024-09-10T19:17:09.661 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:83: TEST_mon_client_connect: ceph ping mon.a 2024-09-10T19:17:09.661 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:23: port_forward: socat TCP-LISTEN:7132,fork,reuseaddr TCP:localhost:7135 2024-09-10T19:17:10.544 INFO:tasks.workunit.client.0.smithi038.stdout:{ 2024-09-10T19:17:10.544 INFO:tasks.workunit.client.0.smithi038.stdout: "health": { 2024-09-10T19:17:10.544 INFO:tasks.workunit.client.0.smithi038.stdout: "status": "HEALTH_OK", 2024-09-10T19:17:10.544 INFO:tasks.workunit.client.0.smithi038.stdout: "checks": {}, 2024-09-10T19:17:10.544 INFO:tasks.workunit.client.0.smithi038.stdout: "mutes": [] 2024-09-10T19:17:10.544 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-10T19:17:10.544 INFO:tasks.workunit.client.0.smithi038.stdout: "mon_status": { 2024-09-10T19:17:10.545 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "a", 2024-09-10T19:17:10.545 INFO:tasks.workunit.client.0.smithi038.stdout: "rank": 0, 2024-09-10T19:17:10.545 INFO:tasks.workunit.client.0.smithi038.stdout: "state": "leader", 2024-09-10T19:17:10.545 INFO:tasks.workunit.client.0.smithi038.stdout: "election_epoch": 3, 2024-09-10T19:17:10.545 INFO:tasks.workunit.client.0.smithi038.stdout: "uptime": 1019, 2024-09-10T19:17:10.545 INFO:tasks.workunit.client.0.smithi038.stdout: "quorum": [ 2024-09-10T19:17:10.545 INFO:tasks.workunit.client.0.smithi038.stdout: 0 2024-09-10T19:17:10.545 INFO:tasks.workunit.client.0.smithi038.stdout: ], 2024-09-10T19:17:10.545 INFO:tasks.workunit.client.0.smithi038.stdout: "quorum_age": 0, 2024-09-10T19:17:10.545 INFO:tasks.workunit.client.0.smithi038.stdout: "features": { 2024-09-10T19:17:10.545 INFO:tasks.workunit.client.0.smithi038.stdout: "required_con": "2450521708007866372", 2024-09-10T19:17:10.545 INFO:tasks.workunit.client.0.smithi038.stdout: "required_mon": [ 2024-09-10T19:17:10.545 INFO:tasks.workunit.client.0.smithi038.stdout: "kraken", 2024-09-10T19:17:10.545 INFO:tasks.workunit.client.0.smithi038.stdout: "luminous", 2024-09-10T19:17:10.546 INFO:tasks.workunit.client.0.smithi038.stdout: "mimic", 2024-09-10T19:17:10.546 INFO:tasks.workunit.client.0.smithi038.stdout: "osdmap-prune", 2024-09-10T19:17:10.546 INFO:tasks.workunit.client.0.smithi038.stdout: "nautilus", 2024-09-10T19:17:10.546 INFO:tasks.workunit.client.0.smithi038.stdout: "octopus", 2024-09-10T19:17:10.546 INFO:tasks.workunit.client.0.smithi038.stdout: "pacific", 2024-09-10T19:17:10.546 INFO:tasks.workunit.client.0.smithi038.stdout: "elector-pinging", 2024-09-10T19:17:10.546 INFO:tasks.workunit.client.0.smithi038.stdout: "quincy", 2024-09-10T19:17:10.546 INFO:tasks.workunit.client.0.smithi038.stdout: "reef", 2024-09-10T19:17:10.546 INFO:tasks.workunit.client.0.smithi038.stdout: "squid" 2024-09-10T19:17:10.546 INFO:tasks.workunit.client.0.smithi038.stdout: ], 2024-09-10T19:17:10.546 INFO:tasks.workunit.client.0.smithi038.stdout: "quorum_con": "4540719139924082687", 2024-09-10T19:17:10.547 INFO:tasks.workunit.client.0.smithi038.stdout: "quorum_mon": [ 2024-09-10T19:17:10.547 INFO:tasks.workunit.client.0.smithi038.stdout: "kraken", 2024-09-10T19:17:10.547 INFO:tasks.workunit.client.0.smithi038.stdout: "luminous", 2024-09-10T19:17:10.547 INFO:tasks.workunit.client.0.smithi038.stdout: "mimic", 2024-09-10T19:17:10.547 INFO:tasks.workunit.client.0.smithi038.stdout: "osdmap-prune", 2024-09-10T19:17:10.547 INFO:tasks.workunit.client.0.smithi038.stdout: "nautilus", 2024-09-10T19:17:10.547 INFO:tasks.workunit.client.0.smithi038.stdout: "octopus", 2024-09-10T19:17:10.547 INFO:tasks.workunit.client.0.smithi038.stdout: "pacific", 2024-09-10T19:17:10.547 INFO:tasks.workunit.client.0.smithi038.stdout: "elector-pinging", 2024-09-10T19:17:10.547 INFO:tasks.workunit.client.0.smithi038.stdout: "quincy", 2024-09-10T19:17:10.547 INFO:tasks.workunit.client.0.smithi038.stdout: "reef", 2024-09-10T19:17:10.547 INFO:tasks.workunit.client.0.smithi038.stdout: "squid" 2024-09-10T19:17:10.547 INFO:tasks.workunit.client.0.smithi038.stdout: ] 2024-09-10T19:17:10.547 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-10T19:17:10.547 INFO:tasks.workunit.client.0.smithi038.stdout: "outside_quorum": [], 2024-09-10T19:17:10.548 INFO:tasks.workunit.client.0.smithi038.stdout: "extra_probe_peers": [], 2024-09-10T19:17:10.548 INFO:tasks.workunit.client.0.smithi038.stdout: "sync_provider": [], 2024-09-10T19:17:10.548 INFO:tasks.workunit.client.0.smithi038.stdout: "monmap": { 2024-09-10T19:17:10.548 INFO:tasks.workunit.client.0.smithi038.stdout: "epoch": 1, 2024-09-10T19:17:10.548 INFO:tasks.workunit.client.0.smithi038.stdout: "fsid": "4175a07f-e315-4f73-82a9-ae0d4fd12748", 2024-09-10T19:17:10.548 INFO:tasks.workunit.client.0.smithi038.stdout: "modified": "2024-09-10T19:17:08.889692Z", 2024-09-10T19:17:10.548 INFO:tasks.workunit.client.0.smithi038.stdout: "created": "2024-09-10T19:17:08.889692Z", 2024-09-10T19:17:10.548 INFO:tasks.workunit.client.0.smithi038.stdout: "min_mon_release": 19, 2024-09-10T19:17:10.548 INFO:tasks.workunit.client.0.smithi038.stdout: "min_mon_release_name": "squid", 2024-09-10T19:17:10.548 INFO:tasks.workunit.client.0.smithi038.stdout: "election_strategy": 1, 2024-09-10T19:17:10.548 INFO:tasks.workunit.client.0.smithi038.stdout: "disallowed_leaders: ": "", 2024-09-10T19:17:10.548 INFO:tasks.workunit.client.0.smithi038.stdout: "stretch_mode": false, 2024-09-10T19:17:10.548 INFO:tasks.workunit.client.0.smithi038.stdout: "tiebreaker_mon": "", 2024-09-10T19:17:10.548 INFO:tasks.workunit.client.0.smithi038.stdout: "removed_ranks: ": "", 2024-09-10T19:17:10.549 INFO:tasks.workunit.client.0.smithi038.stdout: "features": { 2024-09-10T19:17:10.549 INFO:tasks.workunit.client.0.smithi038.stdout: "persistent": [ 2024-09-10T19:17:10.549 INFO:tasks.workunit.client.0.smithi038.stdout: "kraken", 2024-09-10T19:17:10.549 INFO:tasks.workunit.client.0.smithi038.stdout: "luminous", 2024-09-10T19:17:10.549 INFO:tasks.workunit.client.0.smithi038.stdout: "mimic", 2024-09-10T19:17:10.549 INFO:tasks.workunit.client.0.smithi038.stdout: "osdmap-prune", 2024-09-10T19:17:10.549 INFO:tasks.workunit.client.0.smithi038.stdout: "nautilus", 2024-09-10T19:17:10.549 INFO:tasks.workunit.client.0.smithi038.stdout: "octopus", 2024-09-10T19:17:10.549 INFO:tasks.workunit.client.0.smithi038.stdout: "pacific", 2024-09-10T19:17:10.549 INFO:tasks.workunit.client.0.smithi038.stdout: "elector-pinging", 2024-09-10T19:17:10.549 INFO:tasks.workunit.client.0.smithi038.stdout: "quincy", 2024-09-10T19:17:10.549 INFO:tasks.workunit.client.0.smithi038.stdout: "reef", 2024-09-10T19:17:10.549 INFO:tasks.workunit.client.0.smithi038.stdout: "squid" 2024-09-10T19:17:10.550 INFO:tasks.workunit.client.0.smithi038.stdout: ], 2024-09-10T19:17:10.550 INFO:tasks.workunit.client.0.smithi038.stdout: "optional": [] 2024-09-10T19:17:10.550 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-10T19:17:10.550 INFO:tasks.workunit.client.0.smithi038.stdout: "mons": [ 2024-09-10T19:17:10.550 INFO:tasks.workunit.client.0.smithi038.stdout: { 2024-09-10T19:17:10.550 INFO:tasks.workunit.client.0.smithi038.stdout: "rank": 0, 2024-09-10T19:17:10.550 INFO:tasks.workunit.client.0.smithi038.stdout: "name": "a", 2024-09-10T19:17:10.550 INFO:tasks.workunit.client.0.smithi038.stdout: "public_addrs": { 2024-09-10T19:17:10.550 INFO:tasks.workunit.client.0.smithi038.stdout: "addrvec": [ 2024-09-10T19:17:10.550 INFO:tasks.workunit.client.0.smithi038.stdout: { 2024-09-10T19:17:10.550 INFO:tasks.workunit.client.0.smithi038.stdout: "type": "v2", 2024-09-10T19:17:10.551 INFO:tasks.workunit.client.0.smithi038.stdout: "addr": "127.0.0.1:7132", 2024-09-10T19:17:10.551 INFO:tasks.workunit.client.0.smithi038.stdout: "nonce": 0 2024-09-10T19:17:10.551 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-10T19:17:10.551 INFO:tasks.workunit.client.0.smithi038.stdout: ] 2024-09-10T19:17:10.551 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-10T19:17:10.551 INFO:tasks.workunit.client.0.smithi038.stdout: "addr": "127.0.0.1:7132/0", 2024-09-10T19:17:10.551 INFO:tasks.workunit.client.0.smithi038.stdout: "public_addr": "127.0.0.1:7132/0", 2024-09-10T19:17:10.551 INFO:tasks.workunit.client.0.smithi038.stdout: "priority": 0, 2024-09-10T19:17:10.551 INFO:tasks.workunit.client.0.smithi038.stdout: "weight": 0, 2024-09-10T19:17:10.551 INFO:tasks.workunit.client.0.smithi038.stdout: "crush_location": "{}" 2024-09-10T19:17:10.551 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-10T19:17:10.552 INFO:tasks.workunit.client.0.smithi038.stdout: ] 2024-09-10T19:17:10.552 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-10T19:17:10.552 INFO:tasks.workunit.client.0.smithi038.stdout: "feature_map": { 2024-09-10T19:17:10.552 INFO:tasks.workunit.client.0.smithi038.stdout: "mon": [ 2024-09-10T19:17:10.552 INFO:tasks.workunit.client.0.smithi038.stdout: { 2024-09-10T19:17:10.552 INFO:tasks.workunit.client.0.smithi038.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T19:17:10.552 INFO:tasks.workunit.client.0.smithi038.stdout: "release": "squid", 2024-09-10T19:17:10.552 INFO:tasks.workunit.client.0.smithi038.stdout: "num": 1 2024-09-10T19:17:10.552 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-10T19:17:10.552 INFO:tasks.workunit.client.0.smithi038.stdout: ], 2024-09-10T19:17:10.552 INFO:tasks.workunit.client.0.smithi038.stdout: "client": [ 2024-09-10T19:17:10.552 INFO:tasks.workunit.client.0.smithi038.stdout: { 2024-09-10T19:17:10.552 INFO:tasks.workunit.client.0.smithi038.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T19:17:10.552 INFO:tasks.workunit.client.0.smithi038.stdout: "release": "squid", 2024-09-10T19:17:10.552 INFO:tasks.workunit.client.0.smithi038.stdout: "num": 1 2024-09-10T19:17:10.553 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-10T19:17:10.553 INFO:tasks.workunit.client.0.smithi038.stdout: ] 2024-09-10T19:17:10.553 INFO:tasks.workunit.client.0.smithi038.stdout: }, 2024-09-10T19:17:10.553 INFO:tasks.workunit.client.0.smithi038.stdout: "stretch_mode": false 2024-09-10T19:17:10.553 INFO:tasks.workunit.client.0.smithi038.stdout: } 2024-09-10T19:17:10.553 INFO:tasks.workunit.client.0.smithi038.stdout:} 2024-09-10T19:17:10.553 INFO:tasks.workunit.client.0.smithi038.stdout: 2024-09-10T19:17:10.554 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:53: run: cleanup 2024-09-10T19:17:10.555 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:28: cleanup: for p in "${SOCAT_PIDS[@]}" 2024-09-10T19:17:10.555 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:29: cleanup: kill 39197 2024-09-10T19:17:10.555 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:31: cleanup: SOCAT_PIDS=() 2024-09-10T19:17:10.555 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:54: run: teardown td/mon-bind 2024-09-10T19:17:10.555 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mon-bind 2024-09-10T19:17:10.555 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-10T19:17:10.555 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mon-bind KILL 2024-09-10T19:17:10.555 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-10T19:17:10.555 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-10T19:17:10.555 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-10T19:17:10.555 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-10T19:17:10.556 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-10T19:17:10.660 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-10T19:17:10.660 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-10T19:17:10.661 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-10T19:17:10.661 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-10T19:17:10.662 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-10T19:17:10.662 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-10T19:17:10.662 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-10T19:17:10.664 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T19:17:10.664 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-10T19:17:10.664 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-10T19:17:10.664 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T19:17:10.665 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-10T19:17:10.666 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-10T19:17:10.666 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mon-bind 2024-09-10T19:17:10.668 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-10T19:17:10.668 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:17:10.668 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.39094 2024-09-10T19:17:10.668 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.39094 2024-09-10T19:17:10.670 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-10T19:17:10.670 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-10T19:17:10.670 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:51: run: for func in $funcs 2024-09-10T19:17:10.670 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:52: run: setup td/mon-bind 2024-09-10T19:17:10.670 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/mon-bind 2024-09-10T19:17:10.670 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/mon-bind 2024-09-10T19:17:10.670 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mon-bind 2024-09-10T19:17:10.670 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-10T19:17:10.670 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mon-bind KILL 2024-09-10T19:17:10.670 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-10T19:17:10.671 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-10T19:17:10.671 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-10T19:17:10.671 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-10T19:17:10.671 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-10T19:17:10.672 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-10T19:17:10.672 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-10T19:17:10.673 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-10T19:17:10.673 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-10T19:17:10.674 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-10T19:17:10.674 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-10T19:17:10.674 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-10T19:17:10.675 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T19:17:10.675 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-10T19:17:10.676 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-10T19:17:10.676 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T19:17:10.676 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-10T19:17:10.677 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-10T19:17:10.678 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mon-bind 2024-09-10T19:17:10.679 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-10T19:17:10.679 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:17:10.679 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.39094 2024-09-10T19:17:10.679 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.39094 2024-09-10T19:17:10.680 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-10T19:17:10.680 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-10T19:17:10.680 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/mon-bind 2024-09-10T19:17:10.682 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-10T19:17:10.682 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:17:10.682 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.39094 2024-09-10T19:17:10.682 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.39094 2024-09-10T19:17:10.684 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-10T19:17:10.684 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-10T19:17:10.684 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-10T19:17:10.685 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/mon-bind 1' TERM HUP INT 2024-09-10T19:17:10.685 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:53: run: TEST_mon_client_connect_fails td/mon-bind 2024-09-10T19:17:10.685 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:59: TEST_mon_client_connect_fails: local dir=td/mon-bind 2024-09-10T19:17:10.685 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:63: TEST_mon_client_connect_fails: CEPH_ARGS+='--mon-host=127.0.0.1:7132 ' 2024-09-10T19:17:10.685 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:64: TEST_mon_client_connect_fails: run_mon td/mon-bind a --mon-host=127.0.0.1:7132 --public-bind-addr=127.0.0.1:7135 2024-09-10T19:17:10.685 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/mon-bind 2024-09-10T19:17:10.685 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-10T19:17:10.685 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-10T19:17:10.685 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-10T19:17:10.685 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/mon-bind/a 2024-09-10T19:17:10.685 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/mon-bind/a --run-dir=td/mon-bind --mon-host=127.0.0.1:7132 --public-bind-addr=127.0.0.1:7135 2024-09-10T19:17:11.151 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-10T19:17:11.151 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-10T19:17:11.151 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-10T19:17:11.151 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-10T19:17:11.151 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:17:11.151 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.39094 2024-09-10T19:17:11.151 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.39094/$cluster-$name.asok' 2024-09-10T19:17:11.151 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/mon-bind/a '--log-file=td/mon-bind/$name.log' '--admin-socket=/tmp/ceph-asok.39094/$cluster-$name.asok' --mon-cluster-log-file=td/mon-bind/log --run-dir=td/mon-bind '--pid-file=td/mon-bind/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --mon-host=127.0.0.1:7132 --public-bind-addr=127.0.0.1:7135 2024-09-10T19:17:11.343 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-10T19:17:11.344 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-10T19:17:11.344 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-10T19:17:11.344 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-10T19:17:11.344 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-10T19:17:11.345 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-10T19:17:11.345 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-10T19:17:11.345 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-10T19:17:11.345 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-10T19:17:11.346 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-10T19:17:11.346 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:17:11.346 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.39094 2024-09-10T19:17:11.346 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.39094/ceph-mon.a.asok 2024-09-10T19:17:11.346 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-10T19:17:11.346 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.39094/ceph-mon.a.asok config get fsid 2024-09-10T19:17:11.430 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-10T19:17:11.430 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-10T19:17:11.430 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-10T19:17:11.430 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-10T19:17:11.431 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-10T19:17:11.431 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-10T19:17:11.431 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-10T19:17:11.431 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-10T19:17:11.431 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-10T19:17:11.431 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:17:11.431 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.39094 2024-09-10T19:17:11.431 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.39094/ceph-mon.a.asok 2024-09-10T19:17:11.431 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-10T19:17:11.431 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.39094/ceph-mon.a.asok config get mon_host 2024-09-10T19:17:11.512 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:67: TEST_mon_client_connect_fails: timeout 3 ceph ping mon.a 2024-09-10T19:17:14.516 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:67: TEST_mon_client_connect_fails: return 0 2024-09-10T19:17:14.517 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:53: run: cleanup 2024-09-10T19:17:14.517 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:31: cleanup: SOCAT_PIDS=() 2024-09-10T19:17:14.517 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:54: run: teardown td/mon-bind 2024-09-10T19:17:14.517 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mon-bind 2024-09-10T19:17:14.517 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-10T19:17:14.517 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mon-bind KILL 2024-09-10T19:17:14.517 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-10T19:17:14.517 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-10T19:17:14.517 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-10T19:17:14.517 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-10T19:17:14.517 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-10T19:17:14.623 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-10T19:17:14.623 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-10T19:17:14.624 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-10T19:17:14.624 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-10T19:17:14.625 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-10T19:17:14.625 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-10T19:17:14.625 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-10T19:17:14.627 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T19:17:14.627 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-10T19:17:14.627 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-10T19:17:14.627 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T19:17:14.628 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-10T19:17:14.629 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-10T19:17:14.629 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mon-bind 2024-09-10T19:17:14.631 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-10T19:17:14.631 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:17:14.631 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.39094 2024-09-10T19:17:14.631 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.39094 2024-09-10T19:17:14.634 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-10T19:17:14.634 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-10T19:17:14.634 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:51: run: for func in $funcs 2024-09-10T19:17:14.634 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:52: run: setup td/mon-bind 2024-09-10T19:17:14.634 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/mon-bind 2024-09-10T19:17:14.634 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/mon-bind 2024-09-10T19:17:14.634 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mon-bind 2024-09-10T19:17:14.635 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-10T19:17:14.635 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mon-bind KILL 2024-09-10T19:17:14.635 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-10T19:17:14.635 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-10T19:17:14.635 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-10T19:17:14.635 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-10T19:17:14.635 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-10T19:17:14.636 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-10T19:17:14.636 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-10T19:17:14.636 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-10T19:17:14.637 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-10T19:17:14.638 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-10T19:17:14.638 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-10T19:17:14.638 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-10T19:17:14.639 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T19:17:14.639 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-10T19:17:14.640 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-10T19:17:14.640 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T19:17:14.641 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-10T19:17:14.642 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-10T19:17:14.642 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mon-bind 2024-09-10T19:17:14.643 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-10T19:17:14.643 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:17:14.644 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.39094 2024-09-10T19:17:14.644 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.39094 2024-09-10T19:17:14.644 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-10T19:17:14.645 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-10T19:17:14.645 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/mon-bind 2024-09-10T19:17:14.646 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-10T19:17:14.647 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:17:14.647 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.39094 2024-09-10T19:17:14.647 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.39094 2024-09-10T19:17:14.650 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-10T19:17:14.650 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-10T19:17:14.650 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-10T19:17:14.650 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/mon-bind 1' TERM HUP INT 2024-09-10T19:17:14.650 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:53: run: TEST_mon_quorum td/mon-bind 2024-09-10T19:17:14.650 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:87: TEST_mon_quorum: local dir=td/mon-bind 2024-09-10T19:17:14.650 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:91: TEST_mon_quorum: CEPH_ARGS+='--mon-host=127.0.0.1:7132,127.0.0.1:7133,127.0.0.1:7134 ' 2024-09-10T19:17:14.650 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:92: TEST_mon_quorum: run_mon td/mon-bind a --public-addr=127.0.0.1:7132 --public-bind-addr=127.0.0.1:7135 2024-09-10T19:17:14.650 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/mon-bind 2024-09-10T19:17:14.650 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-10T19:17:14.650 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-10T19:17:14.650 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-10T19:17:14.651 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/mon-bind/a 2024-09-10T19:17:14.651 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/mon-bind/a --run-dir=td/mon-bind --public-addr=127.0.0.1:7132 --public-bind-addr=127.0.0.1:7135 2024-09-10T19:17:15.107 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-10T19:17:15.108 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-10T19:17:15.108 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-10T19:17:15.108 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-10T19:17:15.108 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:17:15.108 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.39094 2024-09-10T19:17:15.108 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.39094/$cluster-$name.asok' 2024-09-10T19:17:15.108 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/mon-bind/a '--log-file=td/mon-bind/$name.log' '--admin-socket=/tmp/ceph-asok.39094/$cluster-$name.asok' --mon-cluster-log-file=td/mon-bind/log --run-dir=td/mon-bind '--pid-file=td/mon-bind/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7132 --public-bind-addr=127.0.0.1:7135 2024-09-10T19:17:15.292 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-10T19:17:15.293 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-10T19:17:15.293 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-10T19:17:15.293 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-10T19:17:15.294 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-10T19:17:15.295 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-10T19:17:15.295 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-10T19:17:15.295 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-10T19:17:15.295 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-10T19:17:15.295 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-10T19:17:15.295 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:17:15.295 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.39094 2024-09-10T19:17:15.295 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.39094/ceph-mon.a.asok 2024-09-10T19:17:15.295 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-10T19:17:15.295 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.39094/ceph-mon.a.asok config get fsid 2024-09-10T19:17:15.386 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-10T19:17:15.386 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-10T19:17:15.386 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-10T19:17:15.386 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-10T19:17:15.386 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-10T19:17:15.386 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-10T19:17:15.386 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-10T19:17:15.386 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-10T19:17:15.387 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-10T19:17:15.387 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:17:15.387 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.39094 2024-09-10T19:17:15.387 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.39094/ceph-mon.a.asok 2024-09-10T19:17:15.387 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-10T19:17:15.387 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.39094/ceph-mon.a.asok config get mon_host 2024-09-10T19:17:15.470 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:93: TEST_mon_quorum: run_mon td/mon-bind b --public-addr=127.0.0.1:7133 --public-bind-addr=127.0.0.1:7136 2024-09-10T19:17:15.470 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/mon-bind 2024-09-10T19:17:15.470 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-10T19:17:15.470 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=b 2024-09-10T19:17:15.470 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-10T19:17:15.470 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/mon-bind/b 2024-09-10T19:17:15.470 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id b --mkfs --mon-data=td/mon-bind/b --run-dir=td/mon-bind --public-addr=127.0.0.1:7133 --public-bind-addr=127.0.0.1:7136 2024-09-10T19:17:15.919 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-10T19:17:15.919 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-10T19:17:15.919 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-10T19:17:15.920 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-10T19:17:15.920 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:17:15.920 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.39094 2024-09-10T19:17:15.920 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.39094/$cluster-$name.asok' 2024-09-10T19:17:15.920 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id b --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/mon-bind/b '--log-file=td/mon-bind/$name.log' '--admin-socket=/tmp/ceph-asok.39094/$cluster-$name.asok' --mon-cluster-log-file=td/mon-bind/log --run-dir=td/mon-bind '--pid-file=td/mon-bind/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7133 --public-bind-addr=127.0.0.1:7136 2024-09-10T19:17:16.112 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-10T19:17:16.113 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon b fsid 2024-09-10T19:17:16.113 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-10T19:17:16.113 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=b 2024-09-10T19:17:16.113 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-10T19:17:16.113 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-10T19:17:16.114 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.b 2024-09-10T19:17:16.114 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.b 2024-09-10T19:17:16.114 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.b ']' 2024-09-10T19:17:16.115 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-10T19:17:16.115 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:17:16.115 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.39094 2024-09-10T19:17:16.115 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.39094/ceph-mon.b.asok 2024-09-10T19:17:16.115 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-10T19:17:16.115 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.39094/ceph-mon.b.asok config get fsid 2024-09-10T19:17:16.202 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon b mon_host 2024-09-10T19:17:16.202 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-10T19:17:16.202 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=b 2024-09-10T19:17:16.202 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-10T19:17:16.202 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-10T19:17:16.202 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.b 2024-09-10T19:17:16.202 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.b 2024-09-10T19:17:16.202 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.b ']' 2024-09-10T19:17:16.202 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-10T19:17:16.202 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:17:16.202 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.39094 2024-09-10T19:17:16.203 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.39094/ceph-mon.b.asok 2024-09-10T19:17:16.203 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-10T19:17:16.203 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.39094/ceph-mon.b.asok config get mon_host 2024-09-10T19:17:16.286 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:94: TEST_mon_quorum: run_mon td/mon-bind c --public-addr=127.0.0.1:7134 --public-bind-addr=127.0.0.1:7137 2024-09-10T19:17:16.286 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/mon-bind 2024-09-10T19:17:16.287 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-10T19:17:16.287 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=c 2024-09-10T19:17:16.287 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-10T19:17:16.287 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/mon-bind/c 2024-09-10T19:17:16.287 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id c --mkfs --mon-data=td/mon-bind/c --run-dir=td/mon-bind --public-addr=127.0.0.1:7134 --public-bind-addr=127.0.0.1:7137 2024-09-10T19:17:16.823 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-10T19:17:16.823 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-10T19:17:16.824 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-10T19:17:16.824 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-10T19:17:16.824 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:17:16.824 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.39094 2024-09-10T19:17:16.824 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.39094/$cluster-$name.asok' 2024-09-10T19:17:16.824 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id c --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/mon-bind/c '--log-file=td/mon-bind/$name.log' '--admin-socket=/tmp/ceph-asok.39094/$cluster-$name.asok' --mon-cluster-log-file=td/mon-bind/log --run-dir=td/mon-bind '--pid-file=td/mon-bind/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7134 --public-bind-addr=127.0.0.1:7137 2024-09-10T19:17:17.025 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-10T19:17:17.028 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon c fsid 2024-09-10T19:17:17.028 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-10T19:17:17.028 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=c 2024-09-10T19:17:17.028 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-10T19:17:17.028 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-10T19:17:17.029 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.c 2024-09-10T19:17:17.029 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.c 2024-09-10T19:17:17.029 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.c ']' 2024-09-10T19:17:17.029 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-10T19:17:17.029 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:17:17.030 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.39094 2024-09-10T19:17:17.030 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.39094/ceph-mon.c.asok 2024-09-10T19:17:17.030 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-10T19:17:17.030 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.39094/ceph-mon.c.asok config get fsid 2024-09-10T19:17:17.113 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon c mon_host 2024-09-10T19:17:17.113 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-10T19:17:17.113 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=c 2024-09-10T19:17:17.113 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-10T19:17:17.113 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-10T19:17:17.113 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.c 2024-09-10T19:17:17.113 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.c 2024-09-10T19:17:17.113 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.c ']' 2024-09-10T19:17:17.113 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-10T19:17:17.113 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:17:17.113 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.39094 2024-09-10T19:17:17.114 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.39094/ceph-mon.c.asok 2024-09-10T19:17:17.114 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-10T19:17:17.114 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.39094/ceph-mon.c.asok config get mon_host 2024-09-10T19:17:17.194 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:97: TEST_mon_quorum: port_forward 7132 7135 2024-09-10T19:17:17.194 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:20: port_forward: local source_port=7132 2024-09-10T19:17:17.194 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:21: port_forward: local target_port=7135 2024-09-10T19:17:17.194 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:24: port_forward: SOCAT_PIDS+=($!) 2024-09-10T19:17:17.194 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:98: TEST_mon_quorum: port_forward 7133 7136 2024-09-10T19:17:17.195 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:20: port_forward: local source_port=7133 2024-09-10T19:17:17.195 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:23: port_forward: socat TCP-LISTEN:7132,fork,reuseaddr TCP:localhost:7135 2024-09-10T19:17:17.195 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:21: port_forward: local target_port=7136 2024-09-10T19:17:17.195 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:24: port_forward: SOCAT_PIDS+=($!) 2024-09-10T19:17:17.195 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:99: TEST_mon_quorum: port_forward 7134 7137 2024-09-10T19:17:17.195 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:23: port_forward: socat TCP-LISTEN:7133,fork,reuseaddr TCP:localhost:7136 2024-09-10T19:17:17.195 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:20: port_forward: local source_port=7134 2024-09-10T19:17:17.195 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:21: port_forward: local target_port=7137 2024-09-10T19:17:17.195 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:24: port_forward: SOCAT_PIDS+=($!) 2024-09-10T19:17:17.195 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:23: port_forward: socat TCP-LISTEN:7134,fork,reuseaddr TCP:localhost:7137 2024-09-10T19:17:17.195 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:102: TEST_mon_quorum: ceph quorum_status --format=json 2024-09-10T19:17:20.466 INFO:tasks.workunit.client.0.smithi038.stderr:2024/09/10 19:17:20 socat[39638] E write(6, 0x5555a58cd000, 68): Broken pipe 2024-09-10T19:17:20.466 INFO:tasks.workunit.client.0.smithi038.stderr:2024/09/10 19:17:20 socat[39637] E write(6, 0x563c43522000, 68): Broken pipe 2024-09-10T19:17:20.675 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:102: TEST_mon_quorum: jqinput=' 2024-09-10T19:17:20.675 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4175a07f-e315-4f73-82a9-ae0d4fd12748","modified":"2024-09-10T19:17:14.673526Z","created":"2024-09-10T19:17:14.673526Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7132","nonce":0}]},"addr":"127.0.0.1:7132/0","public_addr":"127.0.0.1:7132/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7133","nonce":0}]},"addr":"127.0.0.1:7133/0","public_addr":"127.0.0.1:7133/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7134","nonce":0}]},"addr":"127.0.0.1:7134/0","public_addr":"127.0.0.1:7134/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:17:20.676 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:103: TEST_mon_quorum: jq_success ' 2024-09-10T19:17:20.676 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4175a07f-e315-4f73-82a9-ae0d4fd12748","modified":"2024-09-10T19:17:14.673526Z","created":"2024-09-10T19:17:14.673526Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7132","nonce":0}]},"addr":"127.0.0.1:7132/0","public_addr":"127.0.0.1:7132/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7133","nonce":0}]},"addr":"127.0.0.1:7133/0","public_addr":"127.0.0.1:7133/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7134","nonce":0}]},"addr":"127.0.0.1:7134/0","public_addr":"127.0.0.1:7134/0","priority":0,"weight":0,"crush_location":"{}"}]}}' '.monmap.mons | length == 3' 2024-09-10T19:17:20.676 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-10T19:17:20.676 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4175a07f-e315-4f73-82a9-ae0d4fd12748","modified":"2024-09-10T19:17:14.673526Z","created":"2024-09-10T19:17:14.673526Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7132","nonce":0}]},"addr":"127.0.0.1:7132/0","public_addr":"127.0.0.1:7132/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7133","nonce":0}]},"addr":"127.0.0.1:7133/0","public_addr":"127.0.0.1:7133/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7134","nonce":0}]},"addr":"127.0.0.1:7134/0","public_addr":"127.0.0.1:7134/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:17:20.676 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.monmap.mons | length == 3' 2024-09-10T19:17:20.676 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='""' 2024-09-10T19:17:20.676 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-10T19:17:20.676 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4175a07f-e315-4f73-82a9-ae0d4fd12748","modified":"2024-09-10T19:17:14.673526Z","created":"2024-09-10T19:17:14.673526Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7132","nonce":0}]},"addr":"127.0.0.1:7132/0","public_addr":"127.0.0.1:7132/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7133","nonce":0}]},"addr":"127.0.0.1:7133/0","public_addr":"127.0.0.1:7133/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7134","nonce":0}]},"addr":"127.0.0.1:7134/0","public_addr":"127.0.0.1:7134/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:17:20.676 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:17:20.677 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-10T19:17:20.677 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4175a07f-e315-4f73-82a9-ae0d4fd12748","modified":"2024-09-10T19:17:14.673526Z","created":"2024-09-10T19:17:14.673526Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7132","nonce":0}]},"addr":"127.0.0.1:7132/0","public_addr":"127.0.0.1:7132/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7133","nonce":0}]},"addr":"127.0.0.1:7133/0","public_addr":"127.0.0.1:7133/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7134","nonce":0}]},"addr":"127.0.0.1:7134/0","public_addr":"127.0.0.1:7134/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:17:20.677 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.monmap.mons | length == 3' 2024-09-10T19:17:20.677 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:17:20.678 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.monmap.mons | length == 3' 2024-09-10T19:17:20.679 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-10T19:17:20.679 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4175a07f-e315-4f73-82a9-ae0d4fd12748","modified":"2024-09-10T19:17:14.673526Z","created":"2024-09-10T19:17:14.673526Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7132","nonce":0}]},"addr":"127.0.0.1:7132/0","public_addr":"127.0.0.1:7132/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7133","nonce":0}]},"addr":"127.0.0.1:7133/0","public_addr":"127.0.0.1:7133/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7134","nonce":0}]},"addr":"127.0.0.1:7134/0","public_addr":"127.0.0.1:7134/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:17:20.679 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.monmap.mons | length == 3' 2024-09-10T19:17:20.682 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret=true 2024-09-10T19:17:20.682 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ true == \t\r\u\e ]] 2024-09-10T19:17:20.682 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2381: jq_success: return 0 2024-09-10T19:17:20.682 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:106: TEST_mon_quorum: wait_for_quorum 300 3 2024-09-10T19:17:20.682 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1046: wait_for_quorum: local timeout=300 2024-09-10T19:17:20.682 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1047: wait_for_quorum: local quorumsize=3 2024-09-10T19:17:20.682 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1049: wait_for_quorum: [[ -z 300 ]] 2024-09-10T19:17:20.683 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1053: wait_for_quorum: [[ -z 3 ]] 2024-09-10T19:17:20.683 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1058: wait_for_quorum: no_quorum=1 2024-09-10T19:17:20.683 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1059: wait_for_quorum: date +%s 2024-09-10T19:17:20.683 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1059: wait_for_quorum: wait_until=1725996140 2024-09-10T19:17:20.683 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2024-09-10T19:17:20.684 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1725995840 -lt 1725996140 ]] 2024-09-10T19:17:20.684 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 3' 2024-09-10T19:17:20.684 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 300 ceph quorum_status --format=json 2024-09-10T19:17:20.936 INFO:tasks.workunit.client.0.smithi038.stderr:2024/09/10 19:17:20 socat[39680] E write(6, 0x5555a58cd000, 68): Broken pipe 2024-09-10T19:17:21.138 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2024-09-10T19:17:21.138 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4175a07f-e315-4f73-82a9-ae0d4fd12748","modified":"2024-09-10T19:17:14.673526Z","created":"2024-09-10T19:17:14.673526Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7132","nonce":0}]},"addr":"127.0.0.1:7132/0","public_addr":"127.0.0.1:7132/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7133","nonce":0}]},"addr":"127.0.0.1:7133/0","public_addr":"127.0.0.1:7133/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7134","nonce":0}]},"addr":"127.0.0.1:7134/0","public_addr":"127.0.0.1:7134/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:17:21.138 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4175a07f-e315-4f73-82a9-ae0d4fd12748","modified":"2024-09-10T19:17:14.673526Z","created":"2024-09-10T19:17:14.673526Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders:' '":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks:' '":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7132","nonce":0}]},"addr":"127.0.0.1:7132/0","public_addr":"127.0.0.1:7132/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7133","nonce":0}]},"addr":"127.0.0.1:7133/0","public_addr":"127.0.0.1:7133/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7134","nonce":0}]},"addr":"127.0.0.1:7134/0","public_addr":"127.0.0.1:7134/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:17:21.138 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 3' 2024-09-10T19:17:21.142 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=true 2024-09-10T19:17:21.142 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ true == \t\r\u\e ]] 2024-09-10T19:17:21.142 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: wait_for_quorum: no_quorum=0 2024-09-10T19:17:21.142 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1066: wait_for_quorum: break 2024-09-10T19:17:21.143 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: return 0 2024-09-10T19:17:21.143 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:108: TEST_mon_quorum: jqfilter='.quorum | length == 3' 2024-09-10T19:17:21.143 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:109: TEST_mon_quorum: jq_success ' 2024-09-10T19:17:21.143 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4175a07f-e315-4f73-82a9-ae0d4fd12748","modified":"2024-09-10T19:17:14.673526Z","created":"2024-09-10T19:17:14.673526Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7132","nonce":0}]},"addr":"127.0.0.1:7132/0","public_addr":"127.0.0.1:7132/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7133","nonce":0}]},"addr":"127.0.0.1:7133/0","public_addr":"127.0.0.1:7133/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7134","nonce":0}]},"addr":"127.0.0.1:7134/0","public_addr":"127.0.0.1:7134/0","priority":0,"weight":0,"crush_location":"{}"}]}}' '.quorum | length == 3' 2024-09-10T19:17:21.143 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-10T19:17:21.143 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4175a07f-e315-4f73-82a9-ae0d4fd12748","modified":"2024-09-10T19:17:14.673526Z","created":"2024-09-10T19:17:14.673526Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7132","nonce":0}]},"addr":"127.0.0.1:7132/0","public_addr":"127.0.0.1:7132/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7133","nonce":0}]},"addr":"127.0.0.1:7133/0","public_addr":"127.0.0.1:7133/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7134","nonce":0}]},"addr":"127.0.0.1:7134/0","public_addr":"127.0.0.1:7134/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:17:21.143 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.quorum | length == 3' 2024-09-10T19:17:21.143 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='""' 2024-09-10T19:17:21.143 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-10T19:17:21.143 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4175a07f-e315-4f73-82a9-ae0d4fd12748","modified":"2024-09-10T19:17:14.673526Z","created":"2024-09-10T19:17:14.673526Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7132","nonce":0}]},"addr":"127.0.0.1:7132/0","public_addr":"127.0.0.1:7132/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7133","nonce":0}]},"addr":"127.0.0.1:7133/0","public_addr":"127.0.0.1:7133/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7134","nonce":0}]},"addr":"127.0.0.1:7134/0","public_addr":"127.0.0.1:7134/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:17:21.143 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:17:21.144 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-10T19:17:21.144 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4175a07f-e315-4f73-82a9-ae0d4fd12748","modified":"2024-09-10T19:17:14.673526Z","created":"2024-09-10T19:17:14.673526Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7132","nonce":0}]},"addr":"127.0.0.1:7132/0","public_addr":"127.0.0.1:7132/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7133","nonce":0}]},"addr":"127.0.0.1:7133/0","public_addr":"127.0.0.1:7133/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7134","nonce":0}]},"addr":"127.0.0.1:7134/0","public_addr":"127.0.0.1:7134/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:17:21.144 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.quorum | length == 3' 2024-09-10T19:17:21.145 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-10T19:17:21.145 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.quorum | length == 3' 2024-09-10T19:17:21.145 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-10T19:17:21.146 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4175a07f-e315-4f73-82a9-ae0d4fd12748","modified":"2024-09-10T19:17:14.673526Z","created":"2024-09-10T19:17:14.673526Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7132","nonce":0}]},"addr":"127.0.0.1:7132/0","public_addr":"127.0.0.1:7132/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7133","nonce":0}]},"addr":"127.0.0.1:7133/0","public_addr":"127.0.0.1:7133/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7134","nonce":0}]},"addr":"127.0.0.1:7134/0","public_addr":"127.0.0.1:7134/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:17:21.146 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.quorum | length == 3' 2024-09-10T19:17:21.149 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret=true 2024-09-10T19:17:21.149 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ true == \t\r\u\e ]] 2024-09-10T19:17:21.149 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2381: jq_success: return 0 2024-09-10T19:17:21.149 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:53: run: cleanup 2024-09-10T19:17:21.149 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:28: cleanup: for p in "${SOCAT_PIDS[@]}" 2024-09-10T19:17:21.149 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:29: cleanup: kill 39597 2024-09-10T19:17:21.149 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:28: cleanup: for p in "${SOCAT_PIDS[@]}" 2024-09-10T19:17:21.149 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:29: cleanup: kill 39598 2024-09-10T19:17:21.149 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:28: cleanup: for p in "${SOCAT_PIDS[@]}" 2024-09-10T19:17:21.150 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:29: cleanup: kill 39599 2024-09-10T19:17:21.150 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:31: cleanup: SOCAT_PIDS=() 2024-09-10T19:17:21.150 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:54: run: teardown td/mon-bind 2024-09-10T19:17:21.150 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mon-bind 2024-09-10T19:17:21.150 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-10T19:17:21.150 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mon-bind KILL 2024-09-10T19:17:21.150 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-10T19:17:21.150 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-10T19:17:21.150 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-10T19:17:21.150 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-10T19:17:21.150 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-10T19:17:21.254 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-10T19:17:21.254 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-10T19:17:21.254 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-10T19:17:21.255 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-10T19:17:21.256 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-10T19:17:21.256 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-10T19:17:21.256 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-10T19:17:21.257 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T19:17:21.257 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-10T19:17:21.257 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-10T19:17:21.257 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T19:17:21.258 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-10T19:17:21.259 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-10T19:17:21.259 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mon-bind 2024-09-10T19:17:21.262 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-10T19:17:21.262 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:17:21.262 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.39094 2024-09-10T19:17:21.262 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.39094 2024-09-10T19:17:21.264 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-10T19:17:21.264 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-10T19:17:21.264 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:51: run: for func in $funcs 2024-09-10T19:17:21.264 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:52: run: setup td/mon-bind 2024-09-10T19:17:21.264 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/mon-bind 2024-09-10T19:17:21.264 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/mon-bind 2024-09-10T19:17:21.264 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mon-bind 2024-09-10T19:17:21.264 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-10T19:17:21.264 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mon-bind KILL 2024-09-10T19:17:21.264 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-10T19:17:21.264 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-10T19:17:21.265 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-10T19:17:21.265 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-10T19:17:21.265 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-10T19:17:21.265 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-10T19:17:21.265 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-10T19:17:21.266 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-10T19:17:21.266 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-10T19:17:21.267 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-10T19:17:21.267 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-10T19:17:21.267 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-10T19:17:21.268 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T19:17:21.268 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-10T19:17:21.268 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-10T19:17:21.269 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T19:17:21.269 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-10T19:17:21.270 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-10T19:17:21.270 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mon-bind 2024-09-10T19:17:21.271 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-10T19:17:21.271 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:17:21.272 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.39094 2024-09-10T19:17:21.272 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.39094 2024-09-10T19:17:21.272 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-10T19:17:21.272 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-10T19:17:21.272 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/mon-bind 2024-09-10T19:17:21.274 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-10T19:17:21.274 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:17:21.274 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.39094 2024-09-10T19:17:21.274 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.39094 2024-09-10T19:17:21.276 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-10T19:17:21.276 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-10T19:17:21.276 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-10T19:17:21.276 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/mon-bind 1' TERM HUP INT 2024-09-10T19:17:21.276 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:53: run: TEST_put_get td/mon-bind 2024-09-10T19:17:21.276 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:113: TEST_put_get: local dir=td/mon-bind 2024-09-10T19:17:21.276 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:117: TEST_put_get: CEPH_ARGS+='--mon-host=127.0.0.1:7132,127.0.0.1:7133,127.0.0.1:7134 ' 2024-09-10T19:17:21.276 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:118: TEST_put_get: run_mon td/mon-bind a --public-addr=127.0.0.1:7132 --public-bind-addr=127.0.0.1:7135 2024-09-10T19:17:21.277 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/mon-bind 2024-09-10T19:17:21.277 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-10T19:17:21.277 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-10T19:17:21.277 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-10T19:17:21.277 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/mon-bind/a 2024-09-10T19:17:21.277 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/mon-bind/a --run-dir=td/mon-bind --public-addr=127.0.0.1:7132 --public-bind-addr=127.0.0.1:7135 2024-09-10T19:17:21.756 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-10T19:17:21.756 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-10T19:17:21.756 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-10T19:17:21.756 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-10T19:17:21.756 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:17:21.756 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.39094 2024-09-10T19:17:21.757 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.39094/$cluster-$name.asok' 2024-09-10T19:17:21.757 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/mon-bind/a '--log-file=td/mon-bind/$name.log' '--admin-socket=/tmp/ceph-asok.39094/$cluster-$name.asok' --mon-cluster-log-file=td/mon-bind/log --run-dir=td/mon-bind '--pid-file=td/mon-bind/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7132 --public-bind-addr=127.0.0.1:7135 2024-09-10T19:17:21.949 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-10T19:17:21.950 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-10T19:17:21.950 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-10T19:17:21.950 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-10T19:17:21.950 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-10T19:17:21.950 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-10T19:17:21.951 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-10T19:17:21.951 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-10T19:17:21.951 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-10T19:17:21.951 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-10T19:17:21.952 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:17:21.952 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.39094 2024-09-10T19:17:21.952 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.39094/ceph-mon.a.asok 2024-09-10T19:17:21.952 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-10T19:17:21.952 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.39094/ceph-mon.a.asok config get fsid 2024-09-10T19:17:22.039 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-10T19:17:22.040 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-10T19:17:22.040 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-10T19:17:22.040 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-10T19:17:22.040 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-10T19:17:22.040 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-10T19:17:22.040 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-10T19:17:22.040 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-10T19:17:22.040 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-10T19:17:22.040 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:17:22.040 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.39094 2024-09-10T19:17:22.040 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.39094/ceph-mon.a.asok 2024-09-10T19:17:22.041 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-10T19:17:22.041 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.39094/ceph-mon.a.asok config get mon_host 2024-09-10T19:17:22.121 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:119: TEST_put_get: run_mon td/mon-bind b --public-addr=127.0.0.1:7133 --public-bind-addr=127.0.0.1:7136 2024-09-10T19:17:22.121 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/mon-bind 2024-09-10T19:17:22.121 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-10T19:17:22.121 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=b 2024-09-10T19:17:22.121 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-10T19:17:22.122 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/mon-bind/b 2024-09-10T19:17:22.122 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id b --mkfs --mon-data=td/mon-bind/b --run-dir=td/mon-bind --public-addr=127.0.0.1:7133 --public-bind-addr=127.0.0.1:7136 2024-09-10T19:17:22.568 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-10T19:17:22.568 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-10T19:17:22.568 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-10T19:17:22.568 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-10T19:17:22.568 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:17:22.568 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.39094 2024-09-10T19:17:22.568 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.39094/$cluster-$name.asok' 2024-09-10T19:17:22.568 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id b --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/mon-bind/b '--log-file=td/mon-bind/$name.log' '--admin-socket=/tmp/ceph-asok.39094/$cluster-$name.asok' --mon-cluster-log-file=td/mon-bind/log --run-dir=td/mon-bind '--pid-file=td/mon-bind/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7133 --public-bind-addr=127.0.0.1:7136 2024-09-10T19:17:22.752 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-10T19:17:22.753 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon b fsid 2024-09-10T19:17:22.753 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-10T19:17:22.753 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=b 2024-09-10T19:17:22.753 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-10T19:17:22.753 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-10T19:17:22.753 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.b 2024-09-10T19:17:22.753 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.b 2024-09-10T19:17:22.754 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.b ']' 2024-09-10T19:17:22.754 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-10T19:17:22.754 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:17:22.754 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.39094 2024-09-10T19:17:22.755 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.39094/ceph-mon.b.asok 2024-09-10T19:17:22.755 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-10T19:17:22.755 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.39094/ceph-mon.b.asok config get fsid 2024-09-10T19:17:22.838 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon b mon_host 2024-09-10T19:17:22.838 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-10T19:17:22.838 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=b 2024-09-10T19:17:22.838 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-10T19:17:22.839 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-10T19:17:22.839 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.b 2024-09-10T19:17:22.839 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.b 2024-09-10T19:17:22.839 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.b ']' 2024-09-10T19:17:22.839 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-10T19:17:22.839 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:17:22.839 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.39094 2024-09-10T19:17:22.839 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.39094/ceph-mon.b.asok 2024-09-10T19:17:22.839 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-10T19:17:22.839 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.39094/ceph-mon.b.asok config get mon_host 2024-09-10T19:17:22.919 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:120: TEST_put_get: run_mon td/mon-bind c --public-addr=127.0.0.1:7134 --public-bind-addr=127.0.0.1:7137 2024-09-10T19:17:22.919 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/mon-bind 2024-09-10T19:17:22.920 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-10T19:17:22.920 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=c 2024-09-10T19:17:22.920 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-10T19:17:22.920 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/mon-bind/c 2024-09-10T19:17:22.920 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id c --mkfs --mon-data=td/mon-bind/c --run-dir=td/mon-bind --public-addr=127.0.0.1:7134 --public-bind-addr=127.0.0.1:7137 2024-09-10T19:17:23.380 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-10T19:17:23.380 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-10T19:17:23.380 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-10T19:17:23.380 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-10T19:17:23.380 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:17:23.380 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.39094 2024-09-10T19:17:23.380 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.39094/$cluster-$name.asok' 2024-09-10T19:17:23.380 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id c --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/mon-bind/c '--log-file=td/mon-bind/$name.log' '--admin-socket=/tmp/ceph-asok.39094/$cluster-$name.asok' --mon-cluster-log-file=td/mon-bind/log --run-dir=td/mon-bind '--pid-file=td/mon-bind/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7134 --public-bind-addr=127.0.0.1:7137 2024-09-10T19:17:23.564 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-10T19:17:23.566 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon c fsid 2024-09-10T19:17:23.566 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-10T19:17:23.566 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=c 2024-09-10T19:17:23.566 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-10T19:17:23.566 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-10T19:17:23.566 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.c 2024-09-10T19:17:23.566 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.c 2024-09-10T19:17:23.567 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.c ']' 2024-09-10T19:17:23.567 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-10T19:17:23.567 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:17:23.567 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.39094 2024-09-10T19:17:23.567 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.39094/ceph-mon.c.asok 2024-09-10T19:17:23.567 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-10T19:17:23.567 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.39094/ceph-mon.c.asok config get fsid 2024-09-10T19:17:23.653 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon c mon_host 2024-09-10T19:17:23.653 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-10T19:17:23.653 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=c 2024-09-10T19:17:23.653 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-10T19:17:23.653 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-10T19:17:23.653 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.c 2024-09-10T19:17:23.653 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.c 2024-09-10T19:17:23.653 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.c ']' 2024-09-10T19:17:23.653 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-10T19:17:23.653 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:17:23.653 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.39094 2024-09-10T19:17:23.654 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.39094/ceph-mon.c.asok 2024-09-10T19:17:23.654 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-10T19:17:23.654 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.39094/ceph-mon.c.asok config get mon_host 2024-09-10T19:17:23.734 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:123: TEST_put_get: port_forward 7132 7135 2024-09-10T19:17:23.734 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:20: port_forward: local source_port=7132 2024-09-10T19:17:23.734 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:21: port_forward: local target_port=7135 2024-09-10T19:17:23.734 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:24: port_forward: SOCAT_PIDS+=($!) 2024-09-10T19:17:23.735 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:124: TEST_put_get: port_forward 7133 7136 2024-09-10T19:17:23.735 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:20: port_forward: local source_port=7133 2024-09-10T19:17:23.735 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:21: port_forward: local target_port=7136 2024-09-10T19:17:23.735 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:23: port_forward: socat TCP-LISTEN:7132,fork,reuseaddr TCP:localhost:7135 2024-09-10T19:17:23.735 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:24: port_forward: SOCAT_PIDS+=($!) 2024-09-10T19:17:23.735 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:125: TEST_put_get: port_forward 7134 7137 2024-09-10T19:17:23.735 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:23: port_forward: socat TCP-LISTEN:7133,fork,reuseaddr TCP:localhost:7136 2024-09-10T19:17:23.735 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:20: port_forward: local source_port=7134 2024-09-10T19:17:23.735 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:21: port_forward: local target_port=7137 2024-09-10T19:17:23.735 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:24: port_forward: SOCAT_PIDS+=($!) 2024-09-10T19:17:23.735 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:128: TEST_put_get: wait_for_quorum 300 3 2024-09-10T19:17:23.735 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1046: wait_for_quorum: local timeout=300 2024-09-10T19:17:23.735 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1047: wait_for_quorum: local quorumsize=3 2024-09-10T19:17:23.736 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:23: port_forward: socat TCP-LISTEN:7134,fork,reuseaddr TCP:localhost:7137 2024-09-10T19:17:23.736 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1049: wait_for_quorum: [[ -z 300 ]] 2024-09-10T19:17:23.736 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1053: wait_for_quorum: [[ -z 3 ]] 2024-09-10T19:17:23.736 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1058: wait_for_quorum: no_quorum=1 2024-09-10T19:17:23.736 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1059: wait_for_quorum: date +%s 2024-09-10T19:17:23.737 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1059: wait_for_quorum: wait_until=1725996143 2024-09-10T19:17:23.737 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2024-09-10T19:17:23.737 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1725995843 -lt 1725996143 ]] 2024-09-10T19:17:23.737 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 3' 2024-09-10T19:17:23.737 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 300 ceph quorum_status --format=json 2024-09-10T19:17:30.144 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2024-09-10T19:17:30.145 INFO:tasks.workunit.client.0.smithi038.stderr:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4175a07f-e315-4f73-82a9-ae0d4fd12748","modified":"2024-09-10T19:17:21.296488Z","created":"2024-09-10T19:17:21.296488Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7132","nonce":0}]},"addr":"127.0.0.1:7132/0","public_addr":"127.0.0.1:7132/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7133","nonce":0}]},"addr":"127.0.0.1:7133/0","public_addr":"127.0.0.1:7133/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7134","nonce":0}]},"addr":"127.0.0.1:7134/0","public_addr":"127.0.0.1:7134/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:17:30.145 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4175a07f-e315-4f73-82a9-ae0d4fd12748","modified":"2024-09-10T19:17:21.296488Z","created":"2024-09-10T19:17:21.296488Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders:' '":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks:' '":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7132","nonce":0}]},"addr":"127.0.0.1:7132/0","public_addr":"127.0.0.1:7132/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7133","nonce":0}]},"addr":"127.0.0.1:7133/0","public_addr":"127.0.0.1:7133/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7134","nonce":0}]},"addr":"127.0.0.1:7134/0","public_addr":"127.0.0.1:7134/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-10T19:17:30.145 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 3' 2024-09-10T19:17:30.148 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=true 2024-09-10T19:17:30.148 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ true == \t\r\u\e ]] 2024-09-10T19:17:30.149 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: wait_for_quorum: no_quorum=0 2024-09-10T19:17:30.149 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1066: wait_for_quorum: break 2024-09-10T19:17:30.149 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: return 0 2024-09-10T19:17:30.149 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:130: TEST_put_get: run_mgr td/mon-bind x 2024-09-10T19:17:30.149 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/mon-bind 2024-09-10T19:17:30.149 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2024-09-10T19:17:30.149 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2024-09-10T19:17:30.149 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2024-09-10T19:17:30.149 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/mon-bind/x 2024-09-10T19:17:30.149 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2024-09-10T19:17:30.832 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2024-09-10T19:17:30.832 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-10T19:17:30.832 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-10T19:17:30.832 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-10T19:17:30.833 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:17:30.833 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.39094 2024-09-10T19:17:30.833 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.39094/$cluster-$name.asok' 2024-09-10T19:17:30.833 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-10T19:17:30.833 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/mon-bind/x '--log-file=td/mon-bind/$name.log' '--admin-socket=/tmp/ceph-asok.39094/$cluster-$name.asok' --run-dir=td/mon-bind '--pid-file=td/mon-bind/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-10T19:17:31.003 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:131: TEST_put_get: run_osd td/mon-bind 0 2024-09-10T19:17:31.003 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/mon-bind 2024-09-10T19:17:31.003 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-10T19:17:31.003 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2024-09-10T19:17:31.003 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-10T19:17:31.003 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/mon-bind/0 2024-09-10T19:17:31.003 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=4175a07f-e315-4f73-82a9-ae0d4fd12748 --auth-supported=none --mon-host=127.0.0.1:7132 --mon-host=127.0.0.1:7132 --mon-host=127.0.0.1:7132,127.0.0.1:7133,127.0.0.1:7134 --mon-host=127.0.0.1:7132,127.0.0.1:7133,127.0.0.1:7134 ' 2024-09-10T19:17:31.003 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-10T19:17:31.003 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-10T19:17:31.003 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-10T19:17:31.003 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/mon-bind/0' 2024-09-10T19:17:31.004 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/mon-bind/0/journal' 2024-09-10T19:17:31.004 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-10T19:17:31.004 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-10T19:17:31.004 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/mon-bind' 2024-09-10T19:17:31.004 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-10T19:17:31.004 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-10T19:17:31.004 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-10T19:17:31.004 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-10T19:17:31.004 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:17:31.004 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.39094 2024-09-10T19:17:31.004 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.39094/$cluster-$name.asok' 2024-09-10T19:17:31.004 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.39094/$cluster-$name.asok' 2024-09-10T19:17:31.004 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-10T19:17:31.005 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-10T19:17:31.005 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-10T19:17:31.005 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/mon-bind/$name.log' 2024-09-10T19:17:31.005 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/mon-bind/$name.pid' 2024-09-10T19:17:31.005 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-10T19:17:31.005 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-10T19:17:31.005 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-10T19:17:31.005 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-10T19:17:31.005 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-10T19:17:31.005 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-10T19:17:31.005 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/mon-bind/0 2024-09-10T19:17:31.006 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-10T19:17:31.006 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=060c2f0a-525a-4227-b4e3-bd22ff6fcc8d 2024-09-10T19:17:31.006 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 060c2f0a-525a-4227-b4e3-bd22ff6fcc8d' 2024-09-10T19:17:31.006 INFO:tasks.workunit.client.0.smithi038.stdout:add osd0 060c2f0a-525a-4227-b4e3-bd22ff6fcc8d 2024-09-10T19:17:31.006 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-10T19:17:31.024 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBLm+BmrdQyARAAqLUj2d6X8DnFpDagtpV3+w== 2024-09-10T19:17:31.024 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBLm+BmrdQyARAAqLUj2d6X8DnFpDagtpV3+w=="}' 2024-09-10T19:17:31.024 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 060c2f0a-525a-4227-b4e3-bd22ff6fcc8d -i td/mon-bind/0/new.json 2024-09-10T19:17:32.286 INFO:tasks.workunit.client.0.smithi038.stdout:0 2024-09-10T19:17:32.295 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/mon-bind/0/new.json 2024-09-10T19:17:32.296 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=4175a07f-e315-4f73-82a9-ae0d4fd12748 --auth-supported=none --mon-host=127.0.0.1:7132 --mon-host=127.0.0.1:7132 --mon-host=127.0.0.1:7132,127.0.0.1:7133,127.0.0.1:7134 --mon-host=127.0.0.1:7132,127.0.0.1:7133,127.0.0.1:7134 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/mon-bind/0 --osd-journal=td/mon-bind/0/journal --chdir= --run-dir=td/mon-bind '--admin-socket=/tmp/ceph-asok.39094/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/mon-bind/$name.log' '--pid-file=td/mon-bind/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBLm+BmrdQyARAAqLUj2d6X8DnFpDagtpV3+w== --osd-uuid 060c2f0a-525a-4227-b4e3-bd22ff6fcc8d 2024-09-10T19:17:32.325 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:17:32.323+0000 7ff7f86e2640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-10T19:17:32.368 INFO:tasks.workunit.client.0.smithi038.stderr:2024/09/10 19:17:32 socat[40147] E write(6, 0x562cedc34000, 68): Broken pipe 2024-09-10T19:17:32.452 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:17:32.449+0000 7ff7f86e2640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-10T19:17:32.452 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:17:32.450+0000 7ff7f86e2640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-10T19:17:32.452 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:17:32.450+0000 7ff7f86e2640 -1 bdev(0x563064a71c00 td/mon-bind/0/block) open stat got: (1) Operation not permitted 2024-09-10T19:17:32.452 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:17:32.450+0000 7ff7f86e2640 -1 bluestore(td/mon-bind/0) _read_fsid unparsable uuid 2024-09-10T19:17:35.558 INFO:tasks.workunit.client.0.smithi038.stderr:2024/09/10 19:17:35 socat[40213] E write(6, 0x55c8f32df000, 68): Broken pipe 2024-09-10T19:17:35.808 INFO:tasks.workunit.client.0.smithi038.stderr:2024/09/10 19:17:35 socat[40605] E write(6, 0x55c8f32df000, 68): Broken pipe 2024-09-10T19:17:38.614 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/mon-bind/0/keyring 2024-09-10T19:17:38.614 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-10T19:17:38.615 INFO:tasks.workunit.client.0.smithi038.stdout:adding osd0 key to auth repository 2024-09-10T19:17:38.615 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2024-09-10T19:17:38.616 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/mon-bind/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-10T19:17:38.874 INFO:tasks.workunit.client.0.smithi038.stderr:2024/09/10 19:17:38 socat[41047] E write(6, 0x562cedc34000, 68): Broken pipe 2024-09-10T19:17:38.874 INFO:tasks.workunit.client.0.smithi038.stderr:2024/09/10 19:17:38 socat[41046] E write(6, 0x555745a89000, 68): Broken pipe 2024-09-10T19:17:39.548 INFO:tasks.workunit.client.0.smithi038.stdout:start osd.0 2024-09-10T19:17:39.549 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2024-09-10T19:17:39.549 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=4175a07f-e315-4f73-82a9-ae0d4fd12748 --auth-supported=none --mon-host=127.0.0.1:7132 --mon-host=127.0.0.1:7132 --mon-host=127.0.0.1:7132,127.0.0.1:7133,127.0.0.1:7134 --mon-host=127.0.0.1:7132,127.0.0.1:7133,127.0.0.1:7134 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/mon-bind/0 --osd-journal=td/mon-bind/0/journal --chdir= --run-dir=td/mon-bind '--admin-socket=/tmp/ceph-asok.39094/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/mon-bind/$name.log' '--pid-file=td/mon-bind/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-10T19:17:39.549 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-10T19:17:39.549 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-10T19:17:39.549 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-10T19:17:39.574 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:17:39.572+0000 7f4aab61e640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-10T19:17:40.364 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2024-09-10T19:17:40.364 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-10T19:17:40.364 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2024-09-10T19:17:40.364 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-10T19:17:40.364 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-10T19:17:40.364 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:17:40.365 INFO:tasks.workunit.client.0.smithi038.stdout:0 2024-09-10T19:17:40.365 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-10T19:17:40.366 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:17:40.366 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-10T19:17:41.267 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:17:42.269 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:17:42.269 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:17:42.269 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-10T19:17:42.269 INFO:tasks.workunit.client.0.smithi038.stdout:1 2024-09-10T19:17:42.269 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:17:42.270 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-10T19:17:42.617 INFO:tasks.workunit.client.0.smithi038.stderr:2024/09/10 19:17:42 socat[41155] E write(6, 0x555745a89000, 68): Broken pipe 2024-09-10T19:17:42.699 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:17:42.698+0000 7f4aab61e640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-10T19:17:42.700 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:17:42.699+0000 7f4aab61e640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-10T19:17:43.079 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:17:44.081 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:17:44.081 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:17:44.081 INFO:tasks.workunit.client.0.smithi038.stdout:2 2024-09-10T19:17:44.082 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-10T19:17:44.082 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:17:44.082 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-10T19:17:44.539 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:17:44.538+0000 7f4aab61e640 -1 Falling back to public interface 2024-09-10T19:17:44.856 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:17:45.858 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:17:45.858 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:17:45.858 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-10T19:17:45.858 INFO:tasks.workunit.client.0.smithi038.stdout:3 2024-09-10T19:17:45.859 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:17:45.859 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-10T19:17:46.163 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:17:46.161+0000 7f4aab61e640 -1 osd.0 0 log_to_monitors true 2024-09-10T19:17:47.077 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:17:48.078 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:17:48.078 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:17:48.078 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-10T19:17:48.079 INFO:tasks.workunit.client.0.smithi038.stdout:4 2024-09-10T19:17:48.079 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:17:48.079 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-10T19:17:49.232 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:17:50.233 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:17:50.233 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:17:50.234 INFO:tasks.workunit.client.0.smithi038.stdout:5 2024-09-10T19:17:50.235 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-10T19:17:50.235 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:17:50.235 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-10T19:17:51.306 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:17:52.307 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:17:52.308 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:17:52.308 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-10T19:17:52.308 INFO:tasks.workunit.client.0.smithi038.stdout:6 2024-09-10T19:17:52.308 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:17:52.308 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-10T19:17:53.349 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:17:54.350 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:17:54.351 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:17:54.351 INFO:tasks.workunit.client.0.smithi038.stdout:7 2024-09-10T19:17:54.351 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-10T19:17:54.352 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:17:54.352 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-10T19:17:54.605 INFO:tasks.workunit.client.0.smithi038.stderr:2024/09/10 19:17:54 socat[41778] E write(6, 0x562cedc34000, 68): Broken pipe 2024-09-10T19:17:55.368 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:17:56.370 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:17:56.370 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:17:56.370 INFO:tasks.workunit.client.0.smithi038.stdout:8 2024-09-10T19:17:56.370 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-10T19:17:56.371 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:17:56.371 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-10T19:17:56.620 INFO:tasks.workunit.client.0.smithi038.stderr:2024/09/10 19:17:56 socat[41810] E write(6, 0x555745a89000, 68): Broken pipe 2024-09-10T19:17:56.621 INFO:tasks.workunit.client.0.smithi038.stderr:2024/09/10 19:17:56 socat[41809] E write(6, 0x562cedc34000, 68): Broken pipe 2024-09-10T19:17:57.023 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:17:58.025 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:17:58.025 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:17:58.025 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-10T19:17:58.025 INFO:tasks.workunit.client.0.smithi038.stdout:9 2024-09-10T19:17:58.026 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:17:58.026 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-10T19:17:58.777 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:17:59.778 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:17:59.778 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:17:59.779 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-10T19:17:59.779 INFO:tasks.workunit.client.0.smithi038.stdout:10 2024-09-10T19:17:59.779 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:17:59.779 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-10T19:18:02.072 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:18:03.074 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:18:03.074 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:18:03.074 INFO:tasks.workunit.client.0.smithi038.stdout:11 2024-09-10T19:18:03.075 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-10T19:18:03.075 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:18:03.075 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-10T19:18:03.778 INFO:tasks.workunit.client.0.smithi038.stderr:2024/09/10 19:18:03 socat[41903] E write(6, 0x555745a89000, 68): Broken pipe 2024-09-10T19:18:05.971 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:18:06.973 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:18:06.973 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:18:06.973 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-10T19:18:06.973 INFO:tasks.workunit.client.0.smithi038.stdout:12 2024-09-10T19:18:06.974 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:18:06.974 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-10T19:18:07.843 INFO:tasks.workunit.client.0.smithi038.stderr:2024/09/10 19:18:07 socat[41932] E write(6, 0x555745a89000, 68): Broken pipe 2024-09-10T19:18:08.502 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:18:09.504 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:18:09.504 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:18:09.504 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-10T19:18:09.504 INFO:tasks.workunit.client.0.smithi038.stdout:13 2024-09-10T19:18:09.505 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:18:09.505 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-10T19:18:11.012 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:18:12.014 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:18:12.014 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:18:12.014 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-10T19:18:12.014 INFO:tasks.workunit.client.0.smithi038.stdout:14 2024-09-10T19:18:12.014 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:18:12.015 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-10T19:18:12.781 INFO:tasks.workunit.client.0.smithi038.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/2040069452,v1:127.0.0.1:6803/2040069452] [v2:127.0.0.1:6804/2040069452,v1:127.0.0.1:6805/2040069452] exists,up 060c2f0a-525a-4227-b4e3-bd22ff6fcc8d 2024-09-10T19:18:12.785 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-10T19:18:12.785 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-10T19:18:12.785 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-10T19:18:12.785 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:132: TEST_put_get: run_osd td/mon-bind 1 2024-09-10T19:18:12.785 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/mon-bind 2024-09-10T19:18:12.785 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-10T19:18:12.785 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2024-09-10T19:18:12.786 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-10T19:18:12.786 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/mon-bind/1 2024-09-10T19:18:12.786 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=4175a07f-e315-4f73-82a9-ae0d4fd12748 --auth-supported=none --mon-host=127.0.0.1:7132 --mon-host=127.0.0.1:7132 --mon-host=127.0.0.1:7132,127.0.0.1:7133,127.0.0.1:7134 --mon-host=127.0.0.1:7132,127.0.0.1:7133,127.0.0.1:7134 ' 2024-09-10T19:18:12.786 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-10T19:18:12.786 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-10T19:18:12.786 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-10T19:18:12.786 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/mon-bind/1' 2024-09-10T19:18:12.786 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/mon-bind/1/journal' 2024-09-10T19:18:12.786 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-10T19:18:12.786 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-10T19:18:12.786 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/mon-bind' 2024-09-10T19:18:12.786 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-10T19:18:12.786 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-10T19:18:12.787 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-10T19:18:12.787 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-10T19:18:12.787 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:18:12.787 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.39094 2024-09-10T19:18:12.787 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.39094/$cluster-$name.asok' 2024-09-10T19:18:12.787 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.39094/$cluster-$name.asok' 2024-09-10T19:18:12.787 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-10T19:18:12.787 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-10T19:18:12.787 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-10T19:18:12.787 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/mon-bind/$name.log' 2024-09-10T19:18:12.787 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/mon-bind/$name.pid' 2024-09-10T19:18:12.787 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-10T19:18:12.787 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-10T19:18:12.787 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-10T19:18:12.788 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-10T19:18:12.788 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-10T19:18:12.788 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-10T19:18:12.788 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/mon-bind/1 2024-09-10T19:18:12.788 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-10T19:18:12.788 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=9d3cc47b-9955-48ba-be66-13a8cf28eb68 2024-09-10T19:18:12.788 INFO:tasks.workunit.client.0.smithi038.stdout:add osd1 9d3cc47b-9955-48ba-be66-13a8cf28eb68 2024-09-10T19:18:12.789 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 9d3cc47b-9955-48ba-be66-13a8cf28eb68' 2024-09-10T19:18:12.789 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-10T19:18:12.801 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQB0m+BmhYyyLxAA4Jw9P3/Ame7PX8lHyjk5IA== 2024-09-10T19:18:12.802 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQB0m+BmhYyyLxAA4Jw9P3/Ame7PX8lHyjk5IA=="}' 2024-09-10T19:18:12.802 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 9d3cc47b-9955-48ba-be66-13a8cf28eb68 -i td/mon-bind/1/new.json 2024-09-10T19:18:13.081 INFO:tasks.workunit.client.0.smithi038.stderr:2024/09/10 19:18:13 socat[42032] E write(6, 0x55c8f32df000, 68): Broken pipe 2024-09-10T19:18:13.748 INFO:tasks.workunit.client.0.smithi038.stdout:1 2024-09-10T19:18:13.759 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/mon-bind/1/new.json 2024-09-10T19:18:13.760 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=4175a07f-e315-4f73-82a9-ae0d4fd12748 --auth-supported=none --mon-host=127.0.0.1:7132 --mon-host=127.0.0.1:7132 --mon-host=127.0.0.1:7132,127.0.0.1:7133,127.0.0.1:7134 --mon-host=127.0.0.1:7132,127.0.0.1:7133,127.0.0.1:7134 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/mon-bind/1 --osd-journal=td/mon-bind/1/journal --chdir= --run-dir=td/mon-bind '--admin-socket=/tmp/ceph-asok.39094/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/mon-bind/$name.log' '--pid-file=td/mon-bind/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQB0m+BmhYyyLxAA4Jw9P3/Ame7PX8lHyjk5IA== --osd-uuid 9d3cc47b-9955-48ba-be66-13a8cf28eb68 2024-09-10T19:18:13.790 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:18:13.788+0000 7f4d52016640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-10T19:18:13.922 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:18:13.920+0000 7f4d52016640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-10T19:18:13.924 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:18:13.922+0000 7f4d52016640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-10T19:18:13.924 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:18:13.922+0000 7f4d52016640 -1 bdev(0x55b7a8c13c00 td/mon-bind/1/block) open stat got: (1) Operation not permitted 2024-09-10T19:18:13.924 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:18:13.922+0000 7f4d52016640 -1 bluestore(td/mon-bind/1) _read_fsid unparsable uuid 2024-09-10T19:18:19.583 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/mon-bind/1/keyring 2024-09-10T19:18:19.583 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-10T19:18:19.584 INFO:tasks.workunit.client.0.smithi038.stdout:adding osd1 key to auth repository 2024-09-10T19:18:19.584 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2024-09-10T19:18:19.585 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/mon-bind/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-10T19:18:19.843 INFO:tasks.workunit.client.0.smithi038.stderr:2024/09/10 19:18:19 socat[42837] E write(6, 0x555745a89000, 68): Broken pipe 2024-09-10T19:18:20.439 INFO:tasks.workunit.client.0.smithi038.stdout:start osd.1 2024-09-10T19:18:20.440 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2024-09-10T19:18:20.440 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=4175a07f-e315-4f73-82a9-ae0d4fd12748 --auth-supported=none --mon-host=127.0.0.1:7132 --mon-host=127.0.0.1:7132 --mon-host=127.0.0.1:7132,127.0.0.1:7133,127.0.0.1:7134 --mon-host=127.0.0.1:7132,127.0.0.1:7133,127.0.0.1:7134 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/mon-bind/1 --osd-journal=td/mon-bind/1/journal --chdir= --run-dir=td/mon-bind '--admin-socket=/tmp/ceph-asok.39094/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/mon-bind/$name.log' '--pid-file=td/mon-bind/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-10T19:18:20.440 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-10T19:18:20.440 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-10T19:18:20.440 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-10T19:18:20.465 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:18:20.463+0000 7fae1a215640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-10T19:18:20.679 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:18:20.678+0000 7fae1a215640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-10T19:18:20.680 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:18:20.679+0000 7fae1a215640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-10T19:18:21.235 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2024-09-10T19:18:21.235 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-10T19:18:21.235 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2024-09-10T19:18:21.236 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-10T19:18:21.236 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-10T19:18:21.236 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:18:21.236 INFO:tasks.workunit.client.0.smithi038.stdout:0 2024-09-10T19:18:21.236 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-10T19:18:21.237 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:18:21.237 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-10T19:18:22.023 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:18:22.022+0000 7fae1a215640 -1 Falling back to public interface 2024-09-10T19:18:22.189 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:18:23.191 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:18:23.191 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:18:23.191 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-10T19:18:23.191 INFO:tasks.workunit.client.0.smithi038.stdout:1 2024-09-10T19:18:23.192 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:18:23.192 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-10T19:18:23.914 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:18:24.117 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:18:24.115+0000 7fae1a215640 -1 osd.1 0 log_to_monitors true 2024-09-10T19:18:24.915 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:18:24.915 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:18:24.915 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-10T19:18:24.916 INFO:tasks.workunit.client.0.smithi038.stdout:2 2024-09-10T19:18:24.916 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:18:24.916 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-10T19:18:25.594 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:18:26.596 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:18:26.596 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:18:26.596 INFO:tasks.workunit.client.0.smithi038.stdout:3 2024-09-10T19:18:26.597 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-10T19:18:26.597 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:18:26.597 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-10T19:18:27.800 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:18:28.801 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:18:28.801 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:18:28.801 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-10T19:18:28.802 INFO:tasks.workunit.client.0.smithi038.stdout:4 2024-09-10T19:18:28.802 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:18:28.802 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-10T19:18:30.230 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:18:31.232 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:18:31.232 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:18:31.232 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-10T19:18:31.232 INFO:tasks.workunit.client.0.smithi038.stdout:5 2024-09-10T19:18:31.232 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:18:31.233 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-10T19:18:32.217 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:18:33.219 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:18:33.219 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:18:33.219 INFO:tasks.workunit.client.0.smithi038.stdout:6 2024-09-10T19:18:33.220 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-10T19:18:33.220 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:18:33.220 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-10T19:18:33.676 INFO:tasks.workunit.client.0.smithi038.stderr:2024/09/10 19:18:33 socat[43530] E write(6, 0x55c8f32df000, 68): Broken pipe 2024-09-10T19:18:34.097 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:18:35.098 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:18:35.098 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:18:35.099 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-10T19:18:35.099 INFO:tasks.workunit.client.0.smithi038.stdout:7 2024-09-10T19:18:35.100 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:18:35.100 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-10T19:18:36.061 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:18:37.063 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:18:37.063 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:18:37.063 INFO:tasks.workunit.client.0.smithi038.stdout:8 2024-09-10T19:18:37.064 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-10T19:18:37.064 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:18:37.064 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-10T19:18:37.727 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:18:38.729 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:18:38.729 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:18:38.729 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-10T19:18:38.729 INFO:tasks.workunit.client.0.smithi038.stdout:9 2024-09-10T19:18:38.730 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:18:38.730 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-10T19:18:39.547 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:18:40.548 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:18:40.548 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:18:40.549 INFO:tasks.workunit.client.0.smithi038.stdout:10 2024-09-10T19:18:40.549 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-10T19:18:40.549 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:18:40.549 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-10T19:18:43.462 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:18:44.464 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:18:44.464 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:18:44.464 INFO:tasks.workunit.client.0.smithi038.stdout:11 2024-09-10T19:18:44.465 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-10T19:18:44.465 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:18:44.465 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-10T19:18:45.263 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:18:46.264 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:18:46.264 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:18:46.264 INFO:tasks.workunit.client.0.smithi038.stdout:12 2024-09-10T19:18:46.265 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-10T19:18:46.265 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:18:46.265 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-10T19:18:46.517 INFO:tasks.workunit.client.0.smithi038.stderr:2024/09/10 19:18:46 socat[43717] E write(6, 0x562cedc34000, 68): Broken pipe 2024-09-10T19:18:46.517 INFO:tasks.workunit.client.0.smithi038.stderr:2024/09/10 19:18:46 socat[43716] E write(6, 0x555745a89000, 68): Broken pipe 2024-09-10T19:18:47.723 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:18:48.725 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:18:48.725 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:18:48.725 INFO:tasks.workunit.client.0.smithi038.stdout:13 2024-09-10T19:18:48.726 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-10T19:18:48.726 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:18:48.726 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-10T19:18:49.016 INFO:tasks.workunit.client.0.smithi038.stderr:2024/09/10 19:18:49 socat[43747] E write(6, 0x55c8f32df000, 68): Broken pipe 2024-09-10T19:18:49.016 INFO:tasks.workunit.client.0.smithi038.stderr:2024/09/10 19:18:49 socat[43748] E write(6, 0x555745a89000, 68): Broken pipe 2024-09-10T19:18:49.424 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:18:50.425 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:18:50.426 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:18:50.426 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-10T19:18:50.426 INFO:tasks.workunit.client.0.smithi038.stdout:14 2024-09-10T19:18:50.426 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:18:50.426 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-10T19:18:54.256 INFO:tasks.workunit.client.0.smithi038.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/2308160764,v1:127.0.0.1:6811/2308160764] [v2:127.0.0.1:6812/2308160764,v1:127.0.0.1:6813/2308160764] exists,up 9d3cc47b-9955-48ba-be66-13a8cf28eb68 2024-09-10T19:18:54.259 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-10T19:18:54.259 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-10T19:18:54.260 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-10T19:18:54.260 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:133: TEST_put_get: run_osd td/mon-bind 2 2024-09-10T19:18:54.260 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/mon-bind 2024-09-10T19:18:54.260 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-10T19:18:54.260 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2024-09-10T19:18:54.260 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-10T19:18:54.260 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/mon-bind/2 2024-09-10T19:18:54.260 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=4175a07f-e315-4f73-82a9-ae0d4fd12748 --auth-supported=none --mon-host=127.0.0.1:7132 --mon-host=127.0.0.1:7132 --mon-host=127.0.0.1:7132,127.0.0.1:7133,127.0.0.1:7134 --mon-host=127.0.0.1:7132,127.0.0.1:7133,127.0.0.1:7134 ' 2024-09-10T19:18:54.260 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-10T19:18:54.260 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-10T19:18:54.260 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-10T19:18:54.260 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/mon-bind/2' 2024-09-10T19:18:54.260 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/mon-bind/2/journal' 2024-09-10T19:18:54.261 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-10T19:18:54.261 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-10T19:18:54.261 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/mon-bind' 2024-09-10T19:18:54.261 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-10T19:18:54.261 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-10T19:18:54.261 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-10T19:18:54.261 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-10T19:18:54.261 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:18:54.261 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.39094 2024-09-10T19:18:54.261 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.39094/$cluster-$name.asok' 2024-09-10T19:18:54.261 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.39094/$cluster-$name.asok' 2024-09-10T19:18:54.261 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-10T19:18:54.262 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-10T19:18:54.262 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-10T19:18:54.262 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/mon-bind/$name.log' 2024-09-10T19:18:54.262 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/mon-bind/$name.pid' 2024-09-10T19:18:54.262 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-10T19:18:54.262 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-10T19:18:54.262 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-10T19:18:54.262 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-10T19:18:54.262 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-10T19:18:54.262 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-10T19:18:54.262 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/mon-bind/2 2024-09-10T19:18:54.262 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-10T19:18:54.262 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=1e347e70-7a1a-4822-ac4a-743045067604 2024-09-10T19:18:54.262 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 1e347e70-7a1a-4822-ac4a-743045067604' 2024-09-10T19:18:54.263 INFO:tasks.workunit.client.0.smithi038.stdout:add osd2 1e347e70-7a1a-4822-ac4a-743045067604 2024-09-10T19:18:54.263 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-10T19:18:54.277 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCem+Bm6XlqEBAAlSx73OpT0iaiq7vXEGo9bA== 2024-09-10T19:18:54.277 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCem+Bm6XlqEBAAlSx73OpT0iaiq7vXEGo9bA=="}' 2024-09-10T19:18:54.277 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 1e347e70-7a1a-4822-ac4a-743045067604 -i td/mon-bind/2/new.json 2024-09-10T19:18:54.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024/09/10 19:18:54 socat[43818] E write(6, 0x555745a89000, 68): Broken pipe 2024-09-10T19:18:54.530 INFO:tasks.workunit.client.0.smithi038.stderr:2024/09/10 19:18:54 socat[43817] E write(6, 0x562cedc34000, 68): Broken pipe 2024-09-10T19:18:55.344 INFO:tasks.workunit.client.0.smithi038.stdout:2 2024-09-10T19:18:55.355 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/mon-bind/2/new.json 2024-09-10T19:18:55.356 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=4175a07f-e315-4f73-82a9-ae0d4fd12748 --auth-supported=none --mon-host=127.0.0.1:7132 --mon-host=127.0.0.1:7132 --mon-host=127.0.0.1:7132,127.0.0.1:7133,127.0.0.1:7134 --mon-host=127.0.0.1:7132,127.0.0.1:7133,127.0.0.1:7134 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/mon-bind/2 --osd-journal=td/mon-bind/2/journal --chdir= --run-dir=td/mon-bind '--admin-socket=/tmp/ceph-asok.39094/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/mon-bind/$name.log' '--pid-file=td/mon-bind/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCem+Bm6XlqEBAAlSx73OpT0iaiq7vXEGo9bA== --osd-uuid 1e347e70-7a1a-4822-ac4a-743045067604 2024-09-10T19:18:55.384 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:18:55.382+0000 7f75f5e14640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-10T19:18:55.532 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:18:55.528+0000 7f75f5e14640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-10T19:18:55.532 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:18:55.529+0000 7f75f5e14640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-10T19:18:55.532 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:18:55.529+0000 7f75f5e14640 -1 bdev(0x55c274241c00 td/mon-bind/2/block) open stat got: (1) Operation not permitted 2024-09-10T19:18:55.533 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:18:55.529+0000 7f75f5e14640 -1 bluestore(td/mon-bind/2) _read_fsid unparsable uuid 2024-09-10T19:19:02.012 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/mon-bind/2/keyring 2024-09-10T19:19:02.012 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-10T19:19:02.013 INFO:tasks.workunit.client.0.smithi038.stdout:adding osd2 key to auth repository 2024-09-10T19:19:02.013 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2024-09-10T19:19:02.013 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/mon-bind/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-10T19:19:03.020 INFO:tasks.workunit.client.0.smithi038.stdout:start osd.2 2024-09-10T19:19:03.020 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2024-09-10T19:19:03.021 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=4175a07f-e315-4f73-82a9-ae0d4fd12748 --auth-supported=none --mon-host=127.0.0.1:7132 --mon-host=127.0.0.1:7132 --mon-host=127.0.0.1:7132,127.0.0.1:7133,127.0.0.1:7134 --mon-host=127.0.0.1:7132,127.0.0.1:7133,127.0.0.1:7134 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/mon-bind/2 --osd-journal=td/mon-bind/2/journal --chdir= --run-dir=td/mon-bind '--admin-socket=/tmp/ceph-asok.39094/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/mon-bind/$name.log' '--pid-file=td/mon-bind/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-10T19:19:03.021 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-10T19:19:03.021 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-10T19:19:03.021 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-10T19:19:03.046 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:19:03.044+0000 7f2e97c0f640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-10T19:19:03.171 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:19:03.170+0000 7f2e97c0f640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-10T19:19:03.172 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:19:03.171+0000 7f2e97c0f640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-10T19:19:03.703 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2024-09-10T19:19:03.703 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-10T19:19:03.703 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2024-09-10T19:19:03.703 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-10T19:19:03.703 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-10T19:19:03.703 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:19:03.703 INFO:tasks.workunit.client.0.smithi038.stdout:0 2024-09-10T19:19:03.704 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-10T19:19:03.704 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:19:03.704 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-10T19:19:04.425 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:19:04.531 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:19:04.528+0000 7f2e97c0f640 -1 Falling back to public interface 2024-09-10T19:19:05.427 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:19:05.427 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:19:05.427 INFO:tasks.workunit.client.0.smithi038.stdout:1 2024-09-10T19:19:05.428 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-10T19:19:05.428 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:19:05.428 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-10T19:19:06.298 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:19:07.014 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:19:07.012+0000 7f2e97c0f640 -1 osd.2 0 log_to_monitors true 2024-09-10T19:19:07.299 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:19:07.299 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:19:07.299 INFO:tasks.workunit.client.0.smithi038.stdout:2 2024-09-10T19:19:07.300 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-10T19:19:07.300 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:19:07.300 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-10T19:19:08.774 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:19:09.776 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:19:09.776 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:19:09.776 INFO:tasks.workunit.client.0.smithi038.stdout:3 2024-09-10T19:19:09.776 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-10T19:19:09.776 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:19:09.777 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-10T19:19:10.656 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:19:11.658 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:19:11.658 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:19:11.658 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-10T19:19:11.658 INFO:tasks.workunit.client.0.smithi038.stdout:4 2024-09-10T19:19:11.659 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:19:11.659 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-10T19:19:12.760 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:19:13.761 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:19:13.761 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:19:13.762 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-10T19:19:13.762 INFO:tasks.workunit.client.0.smithi038.stdout:5 2024-09-10T19:19:13.762 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:19:13.762 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-10T19:19:14.391 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:19:15.392 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:19:15.392 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:19:15.393 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-10T19:19:15.393 INFO:tasks.workunit.client.0.smithi038.stdout:6 2024-09-10T19:19:15.393 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:19:15.394 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-10T19:19:16.698 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:19:17.699 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:19:17.699 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:19:17.700 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-10T19:19:17.700 INFO:tasks.workunit.client.0.smithi038.stdout:7 2024-09-10T19:19:17.700 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:19:17.700 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-10T19:19:18.395 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:19:19.396 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:19:19.396 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:19:19.396 INFO:tasks.workunit.client.0.smithi038.stdout:8 2024-09-10T19:19:19.397 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-10T19:19:19.397 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:19:19.397 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-10T19:19:20.308 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:19:21.310 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:19:21.310 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:19:21.310 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-10T19:19:21.310 INFO:tasks.workunit.client.0.smithi038.stdout:9 2024-09-10T19:19:21.311 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:19:21.311 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-10T19:19:22.356 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:19:23.357 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:19:23.357 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:19:23.357 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-10T19:19:23.357 INFO:tasks.workunit.client.0.smithi038.stdout:10 2024-09-10T19:19:23.358 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:19:23.358 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-10T19:19:25.602 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:19:26.603 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:19:26.603 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:19:26.603 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-10T19:19:26.604 INFO:tasks.workunit.client.0.smithi038.stdout:11 2024-09-10T19:19:26.604 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:19:26.604 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-10T19:19:29.585 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:19:30.587 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:19:30.587 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:19:30.587 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-10T19:19:30.587 INFO:tasks.workunit.client.0.smithi038.stdout:12 2024-09-10T19:19:30.588 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:19:30.588 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-10T19:19:30.800 INFO:tasks.workunit.client.0.smithi038.stderr:2024/09/10 19:19:30 socat[45502] E write(6, 0x55c8f32df000, 68): Broken pipe 2024-09-10T19:19:30.800 INFO:tasks.workunit.client.0.smithi038.stderr:2024/09/10 19:19:30 socat[45503] E write(6, 0x555745a89000, 68): Broken pipe 2024-09-10T19:19:31.207 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:19:32.209 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:19:32.209 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:19:32.209 INFO:tasks.workunit.client.0.smithi038.stdout:13 2024-09-10T19:19:32.210 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-10T19:19:32.210 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:19:32.210 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-10T19:19:33.159 INFO:tasks.workunit.client.0.smithi038.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/3583022239,v1:127.0.0.1:6819/3583022239] [v2:127.0.0.1:6820/3583022239,v1:127.0.0.1:6821/3583022239] exists,up 1e347e70-7a1a-4822-ac4a-743045067604 2024-09-10T19:19:33.160 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-10T19:19:33.160 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-10T19:19:33.160 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-10T19:19:33.160 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:135: TEST_put_get: create_pool hello 8 2024-09-10T19:19:33.160 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create hello 8 2024-09-10T19:19:33.516 INFO:tasks.workunit.client.0.smithi038.stderr:2024/09/10 19:19:33 socat[45562] E write(6, 0x555745a89000, 68): Broken pipe 2024-09-10T19:19:35.249 INFO:tasks.workunit.client.0.smithi038.stderr:pool 'hello' already exists 2024-09-10T19:19:35.263 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2024-09-10T19:19:36.265 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:137: TEST_put_get: echo 'hello world' 2024-09-10T19:19:36.265 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:138: TEST_put_get: rados --pool hello put foo td/mon-bind/hello 2024-09-10T19:19:36.944 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:139: TEST_put_get: rados --pool hello get foo td/mon-bind/hello2 2024-09-10T19:19:37.363 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:140: TEST_put_get: diff td/mon-bind/hello td/mon-bind/hello2 2024-09-10T19:19:37.366 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:53: run: cleanup 2024-09-10T19:19:37.366 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:28: cleanup: for p in "${SOCAT_PIDS[@]}" 2024-09-10T19:19:37.366 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:29: cleanup: kill 39972 2024-09-10T19:19:37.366 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:28: cleanup: for p in "${SOCAT_PIDS[@]}" 2024-09-10T19:19:37.366 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:29: cleanup: kill 39973 2024-09-10T19:19:37.366 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:28: cleanup: for p in "${SOCAT_PIDS[@]}" 2024-09-10T19:19:37.366 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:29: cleanup: kill 39974 2024-09-10T19:19:37.366 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:31: cleanup: SOCAT_PIDS=() 2024-09-10T19:19:37.366 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:54: run: teardown td/mon-bind 2024-09-10T19:19:37.366 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mon-bind 2024-09-10T19:19:37.366 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-10T19:19:37.367 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mon-bind KILL 2024-09-10T19:19:37.367 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-10T19:19:37.367 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-10T19:19:37.367 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-10T19:19:37.367 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-10T19:19:37.367 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-10T19:19:37.478 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-10T19:19:37.478 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-10T19:19:37.479 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-10T19:19:37.480 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-10T19:19:37.481 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-10T19:19:37.481 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-10T19:19:37.481 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-10T19:19:37.482 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T19:19:37.482 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-10T19:19:37.482 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-10T19:19:37.483 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T19:19:37.483 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-10T19:19:37.484 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-10T19:19:37.484 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mon-bind 2024-09-10T19:19:37.507 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-10T19:19:37.507 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:19:37.507 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.39094 2024-09-10T19:19:37.507 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.39094 2024-09-10T19:19:37.509 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-10T19:19:37.509 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-10T19:19:37.509 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2322: main: code=0 2024-09-10T19:19:37.509 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2326: main: teardown td/mon-bind 0 2024-09-10T19:19:37.509 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mon-bind 2024-09-10T19:19:37.509 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2024-09-10T19:19:37.510 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mon-bind KILL 2024-09-10T19:19:37.510 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-10T19:19:37.510 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-10T19:19:37.510 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-10T19:19:37.510 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-10T19:19:37.510 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-10T19:19:37.510 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-10T19:19:37.511 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-10T19:19:37.511 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-10T19:19:37.512 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-10T19:19:37.513 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-10T19:19:37.513 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-10T19:19:37.513 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-10T19:19:37.514 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T19:19:37.514 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-10T19:19:37.514 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-10T19:19:37.515 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T19:19:37.515 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-10T19:19:37.517 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2024-09-10T19:19:37.517 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mon-bind 2024-09-10T19:19:37.518 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-10T19:19:37.518 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:19:37.518 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.39094 2024-09-10T19:19:37.518 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.39094 2024-09-10T19:19:37.520 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-10T19:19:37.520 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-10T19:19:37.520 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2327: main: return 0 2024-09-10T19:19:37.520 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-10T19:19:37.520 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-10T19:19:37.587 INFO:tasks.workunit:Running workunit mon/mon-cluster-log.sh... 2024-09-10T19:19:37.587 DEBUG:teuthology.orchestra.run.smithi038:workunit test mon/mon-cluster-log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad1f558c327094897e4a32e99dd5cb4ae6ccd46 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh 2024-09-10T19:19:37.651 INFO:tasks.workunit.client.0.smithi038.stderr:stty: 'standard input': Inappropriate ioctl for device 2024-09-10T19:19:37.657 INFO:tasks.workunit.client.0.smithi038.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2024-09-10T19:19:37.657 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2315: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-10T19:19:37.657 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2315: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-10T19:19:37.657 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2316: main: export PYTHONWARNINGS=ignore 2024-09-10T19:19:37.657 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2316: main: PYTHONWARNINGS=ignore 2024-09-10T19:19:37.658 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2317: main: export CEPH_CONF=/dev/null 2024-09-10T19:19:37.658 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2317: main: CEPH_CONF=/dev/null 2024-09-10T19:19:37.658 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2318: main: unset CEPH_ARGS 2024-09-10T19:19:37.658 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2320: main: local code 2024-09-10T19:19:37.658 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2321: main: run td/mon-cluster-log 2024-09-10T19:19:37.658 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:21: run: local dir=td/mon-cluster-log 2024-09-10T19:19:37.658 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:22: run: shift 2024-09-10T19:19:37.658 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:24: run: export CEPH_MON=127.0.0.1:7156 2024-09-10T19:19:37.658 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:24: run: CEPH_MON=127.0.0.1:7156 2024-09-10T19:19:37.658 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:25: run: export CEPH_ARGS 2024-09-10T19:19:37.658 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:26: run: uuidgen 2024-09-10T19:19:37.658 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:26: run: CEPH_ARGS+='--fsid=8565f4e9-282c-489c-83a3-3729a976cb0f --auth-supported=none ' 2024-09-10T19:19:37.658 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:27: run: CEPH_ARGS+='--mon-host=127.0.0.1:7156 ' 2024-09-10T19:19:37.660 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:29: run: set 2024-09-10T19:19:37.660 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:29: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2024-09-10T19:19:37.660 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:29: run: local 'funcs=TEST_cluster_log_level 2024-09-10T19:19:37.660 INFO:tasks.workunit.client.0.smithi038.stderr:TEST_journald_cluster_log_level' 2024-09-10T19:19:37.660 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:30: run: for func in $funcs 2024-09-10T19:19:37.660 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:31: run: setup td/mon-cluster-log 2024-09-10T19:19:37.661 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/mon-cluster-log 2024-09-10T19:19:37.661 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/mon-cluster-log 2024-09-10T19:19:37.661 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mon-cluster-log 2024-09-10T19:19:37.661 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-10T19:19:37.661 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mon-cluster-log KILL 2024-09-10T19:19:37.661 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-10T19:19:37.661 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-10T19:19:37.661 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-10T19:19:37.661 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-10T19:19:37.661 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-10T19:19:37.662 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-10T19:19:37.662 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-10T19:19:37.662 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-10T19:19:37.663 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-10T19:19:37.663 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-10T19:19:37.664 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-10T19:19:37.664 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-10T19:19:37.665 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T19:19:37.665 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-10T19:19:37.665 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-10T19:19:37.665 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T19:19:37.666 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-10T19:19:37.667 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-10T19:19:37.667 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mon-cluster-log 2024-09-10T19:19:37.668 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-10T19:19:37.668 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:19:37.669 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.45730 2024-09-10T19:19:37.669 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.45730 2024-09-10T19:19:37.669 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-10T19:19:37.669 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-10T19:19:37.669 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/mon-cluster-log 2024-09-10T19:19:37.670 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-10T19:19:37.671 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:19:37.671 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.45730 2024-09-10T19:19:37.671 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.45730 2024-09-10T19:19:37.673 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-10T19:19:37.673 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2024-09-10T19:19:37.673 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2024-09-10T19:19:37.673 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-10T19:19:37.673 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/mon-cluster-log 1' TERM HUP INT 2024-09-10T19:19:37.673 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:32: run: TEST_cluster_log_level td/mon-cluster-log 2024-09-10T19:19:37.673 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:38: TEST_cluster_log_level: local dir=td/mon-cluster-log 2024-09-10T19:19:37.673 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:40: TEST_cluster_log_level: run_mon td/mon-cluster-log a 2024-09-10T19:19:37.673 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/mon-cluster-log 2024-09-10T19:19:37.674 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-10T19:19:37.674 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-10T19:19:37.674 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-10T19:19:37.674 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/mon-cluster-log/a 2024-09-10T19:19:37.674 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/mon-cluster-log/a --run-dir=td/mon-cluster-log 2024-09-10T19:19:38.118 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-10T19:19:38.119 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-10T19:19:38.119 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-10T19:19:38.119 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-10T19:19:38.119 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:19:38.119 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.45730 2024-09-10T19:19:38.119 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.45730/$cluster-$name.asok' 2024-09-10T19:19:38.119 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/mon-cluster-log/a '--log-file=td/mon-cluster-log/$name.log' '--admin-socket=/tmp/ceph-asok.45730/$cluster-$name.asok' --mon-cluster-log-file=td/mon-cluster-log/log --run-dir=td/mon-cluster-log '--pid-file=td/mon-cluster-log/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-10T19:19:38.304 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-10T19:19:38.305 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-10T19:19:38.305 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-10T19:19:38.305 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-10T19:19:38.305 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-10T19:19:38.305 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-10T19:19:38.307 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-10T19:19:38.307 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-10T19:19:38.307 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-10T19:19:38.307 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-10T19:19:38.307 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:19:38.307 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.45730 2024-09-10T19:19:38.307 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.45730/ceph-mon.a.asok 2024-09-10T19:19:38.307 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-10T19:19:38.307 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.45730/ceph-mon.a.asok config get fsid 2024-09-10T19:19:38.396 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-10T19:19:38.396 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-10T19:19:38.396 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-10T19:19:38.396 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-10T19:19:38.396 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-10T19:19:38.397 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-10T19:19:38.397 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-10T19:19:38.397 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-10T19:19:38.397 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-10T19:19:38.397 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:19:38.397 INFO:tasks.workunit.client.0.smithi038.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.45730 2024-09-10T19:19:38.397 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.45730/ceph-mon.a.asok 2024-09-10T19:19:38.397 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-10T19:19:38.397 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.45730/ceph-mon.a.asok config get mon_host 2024-09-10T19:19:38.478 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:41: TEST_cluster_log_level: run_mgr td/mon-cluster-log x 2024-09-10T19:19:38.478 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/mon-cluster-log 2024-09-10T19:19:38.478 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2024-09-10T19:19:38.478 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2024-09-10T19:19:38.478 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2024-09-10T19:19:38.478 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/mon-cluster-log/x 2024-09-10T19:19:38.478 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2024-09-10T19:19:39.338 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2024-09-10T19:19:39.338 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-10T19:19:39.338 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-10T19:19:39.338 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-10T19:19:39.339 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:19:39.339 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.45730 2024-09-10T19:19:39.339 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.45730/$cluster-$name.asok' 2024-09-10T19:19:39.339 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-10T19:19:39.339 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/mon-cluster-log/x '--log-file=td/mon-cluster-log/$name.log' '--admin-socket=/tmp/ceph-asok.45730/$cluster-$name.asok' --run-dir=td/mon-cluster-log '--pid-file=td/mon-cluster-log/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-10T19:19:39.369 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:42: TEST_cluster_log_level: run_osd td/mon-cluster-log 0 2024-09-10T19:19:39.369 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/mon-cluster-log 2024-09-10T19:19:39.369 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-10T19:19:39.369 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2024-09-10T19:19:39.369 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-10T19:19:39.369 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/mon-cluster-log/0 2024-09-10T19:19:39.369 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=8565f4e9-282c-489c-83a3-3729a976cb0f --auth-supported=none --mon-host=127.0.0.1:7156 ' 2024-09-10T19:19:39.369 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-10T19:19:39.369 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-10T19:19:39.369 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-10T19:19:39.369 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/mon-cluster-log/0' 2024-09-10T19:19:39.370 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/mon-cluster-log/0/journal' 2024-09-10T19:19:39.370 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-10T19:19:39.370 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-10T19:19:39.370 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/mon-cluster-log' 2024-09-10T19:19:39.370 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-10T19:19:39.370 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-10T19:19:39.370 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-10T19:19:39.370 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-10T19:19:39.370 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:19:39.370 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.45730 2024-09-10T19:19:39.370 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.45730/$cluster-$name.asok' 2024-09-10T19:19:39.370 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.45730/$cluster-$name.asok' 2024-09-10T19:19:39.370 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-10T19:19:39.371 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-10T19:19:39.371 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-10T19:19:39.371 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/mon-cluster-log/$name.log' 2024-09-10T19:19:39.371 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/mon-cluster-log/$name.pid' 2024-09-10T19:19:39.371 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-10T19:19:39.371 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-10T19:19:39.371 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-10T19:19:39.371 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-10T19:19:39.371 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-10T19:19:39.371 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-10T19:19:39.371 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/mon-cluster-log/0 2024-09-10T19:19:39.371 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-10T19:19:39.372 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=c703a1aa-e048-4ad9-8374-75154091f7b2 2024-09-10T19:19:39.372 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 c703a1aa-e048-4ad9-8374-75154091f7b2' 2024-09-10T19:19:39.372 INFO:tasks.workunit.client.0.smithi038.stdout:add osd0 c703a1aa-e048-4ad9-8374-75154091f7b2 2024-09-10T19:19:39.372 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-10T19:19:39.387 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDLm+Bm5HL/FhAAcSzS7TyTA0PgvklOQC6pnw== 2024-09-10T19:19:39.387 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDLm+Bm5HL/FhAAcSzS7TyTA0PgvklOQC6pnw=="}' 2024-09-10T19:19:39.388 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new c703a1aa-e048-4ad9-8374-75154091f7b2 -i td/mon-cluster-log/0/new.json 2024-09-10T19:19:39.678 INFO:tasks.workunit.client.0.smithi038.stdout:0 2024-09-10T19:19:39.692 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/mon-cluster-log/0/new.json 2024-09-10T19:19:39.693 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=8565f4e9-282c-489c-83a3-3729a976cb0f --auth-supported=none --mon-host=127.0.0.1:7156 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/mon-cluster-log/0 --osd-journal=td/mon-cluster-log/0/journal --chdir= --run-dir=td/mon-cluster-log '--admin-socket=/tmp/ceph-asok.45730/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/mon-cluster-log/$name.log' '--pid-file=td/mon-cluster-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDLm+Bm5HL/FhAAcSzS7TyTA0PgvklOQC6pnw== --osd-uuid c703a1aa-e048-4ad9-8374-75154091f7b2 2024-09-10T19:19:39.720 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:19:39.719+0000 7fe847b4b640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-10T19:19:39.747 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:19:39.745+0000 7fe847b4b640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-10T19:19:39.748 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:19:39.747+0000 7fe847b4b640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-10T19:19:39.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:19:39.747+0000 7fe847b4b640 -1 bdev(0x558616b8dc00 td/mon-cluster-log/0/block) open stat got: (1) Operation not permitted 2024-09-10T19:19:39.749 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:19:39.747+0000 7fe847b4b640 -1 bluestore(td/mon-cluster-log/0) _read_fsid unparsable uuid 2024-09-10T19:19:45.455 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/mon-cluster-log/0/keyring 2024-09-10T19:19:45.455 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-10T19:19:45.456 INFO:tasks.workunit.client.0.smithi038.stdout:adding osd0 key to auth repository 2024-09-10T19:19:45.456 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2024-09-10T19:19:45.456 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/mon-cluster-log/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-10T19:19:46.020 INFO:tasks.workunit.client.0.smithi038.stdout:start osd.0 2024-09-10T19:19:46.021 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2024-09-10T19:19:46.021 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=8565f4e9-282c-489c-83a3-3729a976cb0f --auth-supported=none --mon-host=127.0.0.1:7156 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/mon-cluster-log/0 --osd-journal=td/mon-cluster-log/0/journal --chdir= --run-dir=td/mon-cluster-log '--admin-socket=/tmp/ceph-asok.45730/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/mon-cluster-log/$name.log' '--pid-file=td/mon-cluster-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-10T19:19:46.021 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-10T19:19:46.021 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-10T19:19:46.021 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-10T19:19:46.046 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:19:46.044+0000 7f056a413640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-10T19:19:46.079 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:19:46.077+0000 7f056a413640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-10T19:19:46.080 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:19:46.078+0000 7f056a413640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-10T19:19:46.424 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2024-09-10T19:19:46.424 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-10T19:19:46.424 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2024-09-10T19:19:46.424 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-10T19:19:46.424 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-10T19:19:46.424 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:19:46.425 INFO:tasks.workunit.client.0.smithi038.stdout:0 2024-09-10T19:19:46.425 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-10T19:19:46.425 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:19:46.425 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-10T19:19:46.824 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:19:47.432 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:19:47.430+0000 7f056a413640 -1 Falling back to public interface 2024-09-10T19:19:47.825 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:19:47.826 INFO:tasks.workunit.client.0.smithi038.stdout:1 2024-09-10T19:19:47.826 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:19:47.826 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-10T19:19:47.826 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:19:47.826 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-10T19:19:48.259 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:19:49.013 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-10T19:19:49.011+0000 7f056a413640 -1 osd.0 0 log_to_monitors true 2024-09-10T19:19:49.260 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:19:49.261 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:19:49.261 INFO:tasks.workunit.client.0.smithi038.stdout:2 2024-09-10T19:19:49.262 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-10T19:19:49.262 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:19:49.262 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-10T19:19:49.736 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:19:50.737 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:19:50.737 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:19:50.738 INFO:tasks.workunit.client.0.smithi038.stdout:3 2024-09-10T19:19:50.738 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-10T19:19:50.738 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:19:50.738 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-10T19:19:51.187 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:19:52.189 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:19:52.189 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:19:52.189 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-10T19:19:52.189 INFO:tasks.workunit.client.0.smithi038.stdout:4 2024-09-10T19:19:52.190 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:19:52.190 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-10T19:19:52.763 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:19:53.764 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:19:53.764 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:19:53.764 INFO:tasks.workunit.client.0.smithi038.stdout:5 2024-09-10T19:19:53.765 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-10T19:19:53.765 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:19:53.765 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-10T19:19:54.178 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:19:55.179 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:19:55.180 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:19:55.180 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-10T19:19:55.180 INFO:tasks.workunit.client.0.smithi038.stdout:6 2024-09-10T19:19:55.180 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:19:55.180 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-10T19:19:55.729 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:19:56.730 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:19:56.730 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:19:56.730 INFO:tasks.workunit.client.0.smithi038.stdout:7 2024-09-10T19:19:56.731 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-10T19:19:56.731 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:19:56.731 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-10T19:19:57.146 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:19:58.147 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:19:58.147 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:19:58.148 INFO:tasks.workunit.client.0.smithi038.stdout:8 2024-09-10T19:19:58.148 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-10T19:19:58.148 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:19:58.148 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-10T19:19:58.558 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:19:59.560 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:19:59.560 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:19:59.560 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-10T19:19:59.561 INFO:tasks.workunit.client.0.smithi038.stdout:9 2024-09-10T19:19:59.561 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:19:59.561 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-10T19:20:00.432 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:20:01.433 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:20:01.434 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:20:01.434 INFO:tasks.workunit.client.0.smithi038.stdout:10 2024-09-10T19:20:01.434 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-10T19:20:01.434 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:20:01.435 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-10T19:20:02.005 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:20:03.007 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:20:03.007 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:20:03.007 INFO:tasks.workunit.client.0.smithi038.stdout:11 2024-09-10T19:20:03.008 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-10T19:20:03.008 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:20:03.008 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-10T19:20:03.646 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:20:04.648 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:20:04.648 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:20:04.648 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-10T19:20:04.648 INFO:tasks.workunit.client.0.smithi038.stdout:12 2024-09-10T19:20:04.649 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:20:04.649 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-10T19:20:05.306 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:20:06.308 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:20:06.308 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:20:06.308 INFO:tasks.workunit.client.0.smithi038.stdout:13 2024-09-10T19:20:06.309 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-10T19:20:06.309 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:20:06.309 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-10T19:20:07.479 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:20:08.480 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:20:08.481 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:20:08.481 INFO:tasks.workunit.client.0.smithi038.stdout:14 2024-09-10T19:20:08.481 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-10T19:20:08.481 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:20:08.482 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-10T19:20:09.404 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:20:10.406 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:20:10.406 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-10T19:20:10.406 INFO:tasks.workunit.client.0.smithi038.stdout:15 2024-09-10T19:20:10.407 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-10T19:20:10.407 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:20:10.407 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-10T19:20:10.852 INFO:tasks.workunit.client.0.smithi038.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/1033535812,v1:127.0.0.1:6803/1033535812] [v2:127.0.0.1:6804/1033535812,v1:127.0.0.1:6805/1033535812] exists,up c703a1aa-e048-4ad9-8374-75154091f7b2 2024-09-10T19:20:10.853 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-10T19:20:10.853 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-10T19:20:10.853 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-10T19:20:10.853 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:44: TEST_cluster_log_level: ceph config set mon.a mon_cluster_log_level debug 2024-09-10T19:20:11.335 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:45: TEST_cluster_log_level: ceph osd pool create replicated1 8 8 2024-09-10T19:20:12.061 INFO:tasks.workunit.client.0.smithi038.stderr:pool 'replicated1' already exists 2024-09-10T19:20:12.073 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:46: TEST_cluster_log_level: ceph osd pool set replicated1 size 1 --yes-i-really-mean-it 2024-09-10T19:20:13.182 INFO:tasks.workunit.client.0.smithi038.stderr:set pool 1 size to 1 2024-09-10T19:20:13.194 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:47: TEST_cluster_log_level: ceph osd pool set replicated1 min_size 1 2024-09-10T19:20:13.970 INFO:tasks.workunit.client.0.smithi038.stderr:set pool 1 min_size to 1 2024-09-10T19:20:13.982 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:49: TEST_cluster_log_level: WAIT_FOR_CLEAN_TIMEOUT=60 2024-09-10T19:20:13.982 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:49: TEST_cluster_log_level: wait_for_clean 2024-09-10T19:20:13.982 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1633: wait_for_clean: local cmd= 2024-09-10T19:20:13.982 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1634: wait_for_clean: local num_active_clean=-1 2024-09-10T19:20:13.982 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1635: wait_for_clean: local cur_active_clean 2024-09-10T19:20:13.983 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: get_timeout_delays 60 .1 2024-09-10T19:20:13.983 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-10T19:20:13.983 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-10T19:20:13.983 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-10T19:20:13.984 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-10T19:20:13.984 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-10T19:20:14.057 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '4.5') 2024-09-10T19:20:14.057 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: local -a delays 2024-09-10T19:20:14.057 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1637: wait_for_clean: local -i loop=0 2024-09-10T19:20:14.057 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1639: wait_for_clean: flush_pg_stats 2024-09-10T19:20:14.057 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-10T19:20:14.057 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-10T19:20:14.467 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids=0 2024-09-10T19:20:14.468 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-10T19:20:14.468 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-10T19:20:14.468 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-10T19:20:14.581 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836487 2024-09-10T19:20:14.581 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836487 2024-09-10T19:20:14.581 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836487' 2024-09-10T19:20:14.581 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-10T19:20:14.582 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836487 2024-09-10T19:20:14.582 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-10T19:20:14.582 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-10T19:20:14.582 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836487 2024-09-10T19:20:14.583 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-10T19:20:14.583 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836487 2024-09-10T19:20:14.584 INFO:tasks.workunit.client.0.smithi038.stdout:waiting osd.0 seq 21474836487 2024-09-10T19:20:14.584 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2024-09-10T19:20:14.584 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-10T19:20:15.003 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836485 -lt 21474836487 2024-09-10T19:20:15.003 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: flush_pg_stats: sleep 1 2024-09-10T19:20:16.005 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2224: flush_pg_stats: '[' 300 -eq 0 ']' 2024-09-10T19:20:16.005 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-10T19:20:16.445 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836488 -lt 21474836487 2024-09-10T19:20:16.446 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: get_num_pgs 2024-09-10T19:20:16.446 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-10T19:20:16.446 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-10T19:20:16.992 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: test 8 == 0 2024-09-10T19:20:16.992 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-10T19:20:16.992 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-10T19:20:16.992 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-10T19:20:16.992 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-10T19:20:16.992 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-10T19:20:16.992 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-10T19:20:16.992 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-10T19:20:17.394 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=8 2024-09-10T19:20:17.395 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-10T19:20:17.395 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-10T19:20:17.395 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-10T19:20:17.977 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 8 = 8 2024-09-10T19:20:17.977 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: break 2024-09-10T19:20:17.977 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: return 0 2024-09-10T19:20:17.977 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:50: TEST_cluster_log_level: ERRORS=0 2024-09-10T19:20:17.978 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:51: TEST_cluster_log_level: truncate td/mon-cluster-log/log -s 0 2024-09-10T19:20:18.003 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:52: TEST_cluster_log_level: ceph pg deep-scrub 1.0 2024-09-10T19:20:18.381 INFO:tasks.workunit.client.0.smithi038.stderr:instructing pg 1.0 on osd.0 to deep-scrub 2024-09-10T19:20:18.393 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:53: TEST_cluster_log_level: search_str='cluster [[]DBG[]] 1.0 deep-scrub' 2024-09-10T19:20:18.393 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:54: TEST_cluster_log_level: TIMEOUT=60 2024-09-10T19:20:18.393 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:54: TEST_cluster_log_level: wait_for_string td/mon-cluster-log/log 'cluster [[]DBG[]] 1.0 deep-scrub' 2024-09-10T19:20:18.393 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1739: wait_for_string: local logfile=td/mon-cluster-log/log 2024-09-10T19:20:18.393 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1740: wait_for_string: local 'searchstr=cluster [[]DBG[]] 1.0 deep-scrub' 2024-09-10T19:20:18.393 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1742: wait_for_string: status=1 2024-09-10T19:20:18.394 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i=0 )) 2024-09-10T19:20:18.394 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:20:18.394 INFO:tasks.workunit.client.0.smithi038.stdout:0 2024-09-10T19:20:18.394 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 0 2024-09-10T19:20:18.394 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.0 deep-scrub' td/mon-cluster-log/log 2024-09-10T19:20:18.394 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:20:19.395 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:20:19.395 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:20:19.396 INFO:tasks.workunit.client.0.smithi038.stdout:1 2024-09-10T19:20:19.396 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 1 2024-09-10T19:20:19.396 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.0 deep-scrub' td/mon-cluster-log/log 2024-09-10T19:20:19.396 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:20:20.398 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:20:20.398 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:20:20.399 INFO:tasks.workunit.client.0.smithi038.stdout:2 2024-09-10T19:20:20.399 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 2 2024-09-10T19:20:20.399 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.0 deep-scrub' td/mon-cluster-log/log 2024-09-10T19:20:20.399 INFO:tasks.workunit.client.0.smithi038.stdout:2024-09-10T19:20:19.219261+0000 osd.0 (osd.0) 3 : cluster [DBG] 1.0 deep-scrub starts 2024-09-10T19:20:20.400 INFO:tasks.workunit.client.0.smithi038.stdout:2024-09-10T19:20:19.219835+0000 osd.0 (osd.0) 4 : cluster [DBG] 1.0 deep-scrub ok 2024-09-10T19:20:20.400 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1748: wait_for_string: status=0 2024-09-10T19:20:20.400 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1749: wait_for_string: break 2024-09-10T19:20:20.400 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1752: wait_for_string: return 0 2024-09-10T19:20:20.400 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:55: TEST_cluster_log_level: grep -q 'cluster [[]DBG[]] 1.0 deep-scrub' td/mon-cluster-log/log 2024-09-10T19:20:20.401 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:56: TEST_cluster_log_level: return_code=0 2024-09-10T19:20:20.401 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:57: TEST_cluster_log_level: '[' 0 -ne 0 ']' 2024-09-10T19:20:20.401 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:62: TEST_cluster_log_level: ceph config set mon.a mon_cluster_log_level info 2024-09-10T19:20:20.901 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:63: TEST_cluster_log_level: ceph osd down 0 2024-09-10T19:20:21.394 INFO:tasks.workunit.client.0.smithi038.stderr:osd.0 is already down. 2024-09-10T19:20:21.406 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:64: TEST_cluster_log_level: TIMEOUT=20 2024-09-10T19:20:21.406 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:64: TEST_cluster_log_level: wait_for_osd up 0 2024-09-10T19:20:21.406 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-10T19:20:21.406 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2024-09-10T19:20:21.406 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-10T19:20:21.406 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-10T19:20:21.406 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 20 )) 2024-09-10T19:20:21.406 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-10T19:20:21.407 INFO:tasks.workunit.client.0.smithi038.stdout:0 2024-09-10T19:20:21.407 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:20:21.407 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-10T19:20:21.897 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:20:22.898 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:20:22.898 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 20 )) 2024-09-10T19:20:22.898 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-10T19:20:22.899 INFO:tasks.workunit.client.0.smithi038.stdout:1 2024-09-10T19:20:22.899 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:20:22.899 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-10T19:20:23.357 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:20:24.358 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:20:24.359 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 20 )) 2024-09-10T19:20:24.359 INFO:tasks.workunit.client.0.smithi038.stdout:2 2024-09-10T19:20:24.359 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-10T19:20:24.359 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:20:24.360 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-10T19:20:24.808 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:20:25.809 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:20:25.809 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 20 )) 2024-09-10T19:20:25.810 INFO:tasks.workunit.client.0.smithi038.stdout:3 2024-09-10T19:20:25.810 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-10T19:20:25.810 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:20:25.810 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-10T19:20:26.251 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:20:27.252 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:20:27.253 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 20 )) 2024-09-10T19:20:27.253 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-10T19:20:27.253 INFO:tasks.workunit.client.0.smithi038.stdout:4 2024-09-10T19:20:27.254 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:20:27.254 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-10T19:20:27.686 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:20:28.688 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:20:28.688 INFO:tasks.workunit.client.0.smithi038.stdout:5 2024-09-10T19:20:28.688 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 20 )) 2024-09-10T19:20:28.689 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-10T19:20:28.689 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:20:28.689 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-10T19:20:29.122 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:20:30.123 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:20:30.123 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 20 )) 2024-09-10T19:20:30.123 INFO:tasks.workunit.client.0.smithi038.stdout:6 2024-09-10T19:20:30.124 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-10T19:20:30.124 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:20:30.124 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-10T19:20:30.539 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:20:31.540 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:20:31.540 INFO:tasks.workunit.client.0.smithi038.stdout:7 2024-09-10T19:20:31.541 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 20 )) 2024-09-10T19:20:31.541 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-10T19:20:31.541 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:20:31.541 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-10T19:20:31.990 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:20:32.991 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:20:32.991 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 20 )) 2024-09-10T19:20:32.992 INFO:tasks.workunit.client.0.smithi038.stdout:8 2024-09-10T19:20:32.992 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-10T19:20:32.992 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:20:32.992 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-10T19:20:33.442 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:20:34.443 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:20:34.444 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 20 )) 2024-09-10T19:20:34.444 INFO:tasks.workunit.client.0.smithi038.stdout:9 2024-09-10T19:20:34.445 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-10T19:20:34.445 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:20:34.446 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-10T19:20:34.868 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:20:35.869 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:20:35.869 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 20 )) 2024-09-10T19:20:35.870 INFO:tasks.workunit.client.0.smithi038.stdout:10 2024-09-10T19:20:35.870 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-10T19:20:35.870 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:20:35.871 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-10T19:20:36.285 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:20:37.288 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:20:37.289 INFO:tasks.workunit.client.0.smithi038.stdout:11 2024-09-10T19:20:37.289 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 20 )) 2024-09-10T19:20:37.289 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-10T19:20:37.289 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:20:37.290 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-10T19:20:37.729 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:20:38.730 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:20:38.731 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 20 )) 2024-09-10T19:20:38.731 INFO:tasks.workunit.client.0.smithi038.stdout:12 2024-09-10T19:20:38.731 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-10T19:20:38.731 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:20:38.732 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-10T19:20:39.172 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:20:40.173 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:20:40.173 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 20 )) 2024-09-10T19:20:40.173 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-10T19:20:40.174 INFO:tasks.workunit.client.0.smithi038.stdout:13 2024-09-10T19:20:40.174 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:20:40.174 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-10T19:20:40.622 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:20:41.624 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:20:41.624 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 20 )) 2024-09-10T19:20:41.624 INFO:tasks.workunit.client.0.smithi038.stdout:14 2024-09-10T19:20:41.625 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-10T19:20:41.625 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:20:41.625 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-10T19:20:42.061 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:20:43.062 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:20:43.062 INFO:tasks.workunit.client.0.smithi038.stdout:15 2024-09-10T19:20:43.063 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 20 )) 2024-09-10T19:20:43.063 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-10T19:20:43.063 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:20:43.063 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-10T19:20:43.603 INFO:tasks.workunit.client.0.smithi038.stdout:osd.0 up in weight 1 up_from 15 up_thru 15 down_at 14 last_clean_interval [5,14) [v2:127.0.0.1:6802/1033535812,v1:127.0.0.1:6803/1033535812] [v2:127.0.0.1:6810/1034535812,v1:127.0.0.1:6811/1034535812] exists,up c703a1aa-e048-4ad9-8374-75154091f7b2 2024-09-10T19:20:43.604 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-10T19:20:43.604 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-10T19:20:43.604 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-10T19:20:43.604 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:65: TEST_cluster_log_level: grep -q 'cluster [[]INF[]] osd.0.*boot' td/mon-cluster-log/log 2024-09-10T19:20:43.605 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:66: TEST_cluster_log_level: return_code=1 2024-09-10T19:20:43.605 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:67: TEST_cluster_log_level: '[' 1 -ne 0 ']' 2024-09-10T19:20:43.605 INFO:tasks.workunit.client.0.smithi038.stdout:Failed : Could not find INF log in the cluster log file 2024-09-10T19:20:43.605 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:68: TEST_cluster_log_level: echo 'Failed : Could not find INF log in the cluster log file' 2024-09-10T19:20:43.606 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:69: TEST_cluster_log_level: ERRORS=1 2024-09-10T19:20:43.606 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:72: TEST_cluster_log_level: ceph pg deep-scrub 1.1 2024-09-10T19:20:44.089 INFO:tasks.workunit.client.0.smithi038.stderr:instructing pg 1.1 on osd.0 to deep-scrub 2024-09-10T19:20:44.101 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:73: TEST_cluster_log_level: search_str='cluster [[]DBG[]] 1.1 deep-scrub' 2024-09-10T19:20:44.101 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:74: TEST_cluster_log_level: TIMEOUT=60 2024-09-10T19:20:44.101 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:74: TEST_cluster_log_level: wait_for_string td/mon-cluster-log/log 'cluster [[]DBG[]] 1.1 deep-scrub' 2024-09-10T19:20:44.101 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1739: wait_for_string: local logfile=td/mon-cluster-log/log 2024-09-10T19:20:44.101 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1740: wait_for_string: local 'searchstr=cluster [[]DBG[]] 1.1 deep-scrub' 2024-09-10T19:20:44.101 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1742: wait_for_string: status=1 2024-09-10T19:20:44.101 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i=0 )) 2024-09-10T19:20:44.102 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:20:44.102 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 0 2024-09-10T19:20:44.102 INFO:tasks.workunit.client.0.smithi038.stdout:0 2024-09-10T19:20:44.102 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-10T19:20:44.102 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:20:45.103 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:20:45.103 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:20:45.103 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 1 2024-09-10T19:20:45.103 INFO:tasks.workunit.client.0.smithi038.stdout:1 2024-09-10T19:20:45.104 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-10T19:20:45.104 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:20:46.106 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:20:46.106 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:20:46.106 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 2 2024-09-10T19:20:46.106 INFO:tasks.workunit.client.0.smithi038.stdout:2 2024-09-10T19:20:46.106 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-10T19:20:46.107 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:20:47.109 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:20:47.109 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:20:47.109 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 3 2024-09-10T19:20:47.109 INFO:tasks.workunit.client.0.smithi038.stdout:3 2024-09-10T19:20:47.109 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-10T19:20:47.110 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:20:48.111 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:20:48.111 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:20:48.112 INFO:tasks.workunit.client.0.smithi038.stdout:4 2024-09-10T19:20:48.112 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 4 2024-09-10T19:20:48.112 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-10T19:20:48.113 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:20:49.114 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:20:49.114 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:20:49.114 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 5 2024-09-10T19:20:49.114 INFO:tasks.workunit.client.0.smithi038.stdout:5 2024-09-10T19:20:49.115 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-10T19:20:49.115 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:20:50.117 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:20:50.117 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:20:50.117 INFO:tasks.workunit.client.0.smithi038.stdout:6 2024-09-10T19:20:50.118 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 6 2024-09-10T19:20:50.118 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-10T19:20:50.118 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:20:51.120 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:20:51.120 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:20:51.120 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 7 2024-09-10T19:20:51.120 INFO:tasks.workunit.client.0.smithi038.stdout:7 2024-09-10T19:20:51.120 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-10T19:20:51.121 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:20:52.122 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:20:52.122 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:20:52.123 INFO:tasks.workunit.client.0.smithi038.stdout:8 2024-09-10T19:20:52.123 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 8 2024-09-10T19:20:52.123 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-10T19:20:52.123 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:20:53.125 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:20:53.125 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:20:53.125 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 9 2024-09-10T19:20:53.126 INFO:tasks.workunit.client.0.smithi038.stdout:9 2024-09-10T19:20:53.126 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-10T19:20:53.126 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:20:54.128 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:20:54.128 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:20:54.128 INFO:tasks.workunit.client.0.smithi038.stdout:10 2024-09-10T19:20:54.128 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 10 2024-09-10T19:20:54.129 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-10T19:20:54.129 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:20:55.130 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:20:55.131 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:20:55.131 INFO:tasks.workunit.client.0.smithi038.stdout:11 2024-09-10T19:20:55.131 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 11 2024-09-10T19:20:55.131 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-10T19:20:55.132 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:20:56.133 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:20:56.133 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:20:56.134 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 12 2024-09-10T19:20:56.134 INFO:tasks.workunit.client.0.smithi038.stdout:12 2024-09-10T19:20:56.134 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-10T19:20:56.134 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:20:57.136 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:20:57.136 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:20:57.136 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 13 2024-09-10T19:20:57.137 INFO:tasks.workunit.client.0.smithi038.stdout:13 2024-09-10T19:20:57.137 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-10T19:20:57.137 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:20:58.139 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:20:58.139 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:20:58.139 INFO:tasks.workunit.client.0.smithi038.stdout:14 2024-09-10T19:20:58.140 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 14 2024-09-10T19:20:58.140 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-10T19:20:58.140 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:20:59.142 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:20:59.142 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:20:59.142 INFO:tasks.workunit.client.0.smithi038.stdout:15 2024-09-10T19:20:59.142 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 15 2024-09-10T19:20:59.143 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-10T19:20:59.143 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:21:00.145 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:21:00.145 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:21:00.145 INFO:tasks.workunit.client.0.smithi038.stdout:16 2024-09-10T19:21:00.145 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 16 2024-09-10T19:21:00.145 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-10T19:21:00.146 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:21:01.147 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:21:01.148 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:21:01.148 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 17 2024-09-10T19:21:01.148 INFO:tasks.workunit.client.0.smithi038.stdout:17 2024-09-10T19:21:01.148 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-10T19:21:01.149 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:21:02.150 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:21:02.150 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:21:02.150 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 18 2024-09-10T19:21:02.151 INFO:tasks.workunit.client.0.smithi038.stdout:18 2024-09-10T19:21:02.151 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-10T19:21:02.151 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:21:03.153 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:21:03.153 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:21:03.153 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 19 2024-09-10T19:21:03.154 INFO:tasks.workunit.client.0.smithi038.stdout:19 2024-09-10T19:21:03.154 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-10T19:21:03.154 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:21:04.156 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:21:04.156 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:21:04.156 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 20 2024-09-10T19:21:04.156 INFO:tasks.workunit.client.0.smithi038.stdout:20 2024-09-10T19:21:04.156 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-10T19:21:04.157 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:21:05.160 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:21:05.160 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:21:05.160 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 21 2024-09-10T19:21:05.161 INFO:tasks.workunit.client.0.smithi038.stdout:21 2024-09-10T19:21:05.161 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-10T19:21:05.161 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:21:06.161 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:21:06.162 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:21:06.162 INFO:tasks.workunit.client.0.smithi038.stdout:22 2024-09-10T19:21:06.162 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 22 2024-09-10T19:21:06.162 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-10T19:21:06.163 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:21:07.164 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:21:07.164 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:21:07.164 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 23 2024-09-10T19:21:07.165 INFO:tasks.workunit.client.0.smithi038.stdout:23 2024-09-10T19:21:07.165 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-10T19:21:07.165 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:21:08.167 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:21:08.167 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:21:08.167 INFO:tasks.workunit.client.0.smithi038.stdout:24 2024-09-10T19:21:08.168 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 24 2024-09-10T19:21:08.168 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-10T19:21:08.168 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:21:09.169 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:21:09.170 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:21:09.170 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 25 2024-09-10T19:21:09.170 INFO:tasks.workunit.client.0.smithi038.stdout:25 2024-09-10T19:21:09.170 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-10T19:21:09.170 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:21:10.172 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:21:10.172 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:21:10.173 INFO:tasks.workunit.client.0.smithi038.stdout:26 2024-09-10T19:21:10.173 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 26 2024-09-10T19:21:10.173 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-10T19:21:10.173 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:21:11.175 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:21:11.175 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:21:11.175 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 27 2024-09-10T19:21:11.175 INFO:tasks.workunit.client.0.smithi038.stdout:27 2024-09-10T19:21:11.175 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-10T19:21:11.176 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:21:12.177 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:21:12.177 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:21:12.178 INFO:tasks.workunit.client.0.smithi038.stdout:28 2024-09-10T19:21:12.178 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 28 2024-09-10T19:21:12.178 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-10T19:21:12.179 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:21:13.180 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:21:13.180 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:21:13.180 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 29 2024-09-10T19:21:13.181 INFO:tasks.workunit.client.0.smithi038.stdout:29 2024-09-10T19:21:13.181 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-10T19:21:13.181 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:21:14.183 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:21:14.183 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:21:14.183 INFO:tasks.workunit.client.0.smithi038.stdout:30 2024-09-10T19:21:14.183 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 30 2024-09-10T19:21:14.184 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-10T19:21:14.184 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:21:15.185 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:21:15.186 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:21:15.186 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 31 2024-09-10T19:21:15.186 INFO:tasks.workunit.client.0.smithi038.stdout:31 2024-09-10T19:21:15.186 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-10T19:21:15.187 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:21:16.188 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:21:16.188 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:21:16.189 INFO:tasks.workunit.client.0.smithi038.stdout:32 2024-09-10T19:21:16.189 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 32 2024-09-10T19:21:16.189 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-10T19:21:16.189 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:21:17.191 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:21:17.191 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:21:17.191 INFO:tasks.workunit.client.0.smithi038.stdout:33 2024-09-10T19:21:17.192 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 33 2024-09-10T19:21:17.192 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-10T19:21:17.193 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:21:18.194 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:21:18.194 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:21:18.194 INFO:tasks.workunit.client.0.smithi038.stdout:34 2024-09-10T19:21:18.194 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 34 2024-09-10T19:21:18.195 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-10T19:21:18.195 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:21:19.196 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:21:19.197 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:21:19.197 INFO:tasks.workunit.client.0.smithi038.stdout:35 2024-09-10T19:21:19.198 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 35 2024-09-10T19:21:19.198 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-10T19:21:19.198 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:21:20.199 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:21:20.199 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:21:20.200 INFO:tasks.workunit.client.0.smithi038.stdout:36 2024-09-10T19:21:20.200 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 36 2024-09-10T19:21:20.200 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-10T19:21:20.200 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:21:21.202 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:21:21.202 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:21:21.202 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 37 2024-09-10T19:21:21.203 INFO:tasks.workunit.client.0.smithi038.stdout:37 2024-09-10T19:21:21.203 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-10T19:21:21.203 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:21:22.205 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:21:22.205 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:21:22.205 INFO:tasks.workunit.client.0.smithi038.stdout:38 2024-09-10T19:21:22.206 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 38 2024-09-10T19:21:22.206 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-10T19:21:22.206 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:21:23.207 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:21:23.208 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:21:23.208 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 39 2024-09-10T19:21:23.208 INFO:tasks.workunit.client.0.smithi038.stdout:39 2024-09-10T19:21:23.208 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-10T19:21:23.209 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:21:24.210 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:21:24.210 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:21:24.210 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 40 2024-09-10T19:21:24.211 INFO:tasks.workunit.client.0.smithi038.stdout:40 2024-09-10T19:21:24.211 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-10T19:21:24.211 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:21:25.213 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:21:25.213 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:21:25.213 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 41 2024-09-10T19:21:25.213 INFO:tasks.workunit.client.0.smithi038.stdout:41 2024-09-10T19:21:25.214 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-10T19:21:25.214 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:21:26.216 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:21:26.216 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:21:26.216 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 42 2024-09-10T19:21:26.216 INFO:tasks.workunit.client.0.smithi038.stdout:42 2024-09-10T19:21:26.217 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-10T19:21:26.217 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:21:27.218 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:21:27.219 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:21:27.219 INFO:tasks.workunit.client.0.smithi038.stdout:43 2024-09-10T19:21:27.220 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 43 2024-09-10T19:21:27.220 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-10T19:21:27.220 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:21:28.221 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:21:28.222 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:21:28.222 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 44 2024-09-10T19:21:28.222 INFO:tasks.workunit.client.0.smithi038.stdout:44 2024-09-10T19:21:28.223 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-10T19:21:28.223 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:21:29.224 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:21:29.224 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:21:29.224 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 45 2024-09-10T19:21:29.224 INFO:tasks.workunit.client.0.smithi038.stdout:45 2024-09-10T19:21:29.225 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-10T19:21:29.225 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:21:30.226 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:21:30.227 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:21:30.227 INFO:tasks.workunit.client.0.smithi038.stdout:46 2024-09-10T19:21:30.227 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 46 2024-09-10T19:21:30.227 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-10T19:21:30.228 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:21:31.229 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:21:31.230 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:21:31.230 INFO:tasks.workunit.client.0.smithi038.stdout:47 2024-09-10T19:21:31.231 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 47 2024-09-10T19:21:31.231 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-10T19:21:31.231 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:21:32.232 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:21:32.232 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:21:32.232 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 48 2024-09-10T19:21:32.233 INFO:tasks.workunit.client.0.smithi038.stdout:48 2024-09-10T19:21:32.233 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-10T19:21:32.233 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:21:33.235 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:21:33.235 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:21:33.235 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 49 2024-09-10T19:21:33.236 INFO:tasks.workunit.client.0.smithi038.stdout:49 2024-09-10T19:21:33.236 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-10T19:21:33.236 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:21:34.238 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:21:34.238 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:21:34.238 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 50 2024-09-10T19:21:34.238 INFO:tasks.workunit.client.0.smithi038.stdout:50 2024-09-10T19:21:34.238 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-10T19:21:34.239 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:21:35.240 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:21:35.240 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:21:35.241 INFO:tasks.workunit.client.0.smithi038.stdout:51 2024-09-10T19:21:35.241 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 51 2024-09-10T19:21:35.242 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-10T19:21:35.242 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:21:36.243 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:21:36.243 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:21:36.243 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 52 2024-09-10T19:21:36.244 INFO:tasks.workunit.client.0.smithi038.stdout:52 2024-09-10T19:21:36.244 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-10T19:21:36.244 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:21:37.246 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:21:37.246 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:21:37.246 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 53 2024-09-10T19:21:37.246 INFO:tasks.workunit.client.0.smithi038.stdout:53 2024-09-10T19:21:37.247 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-10T19:21:37.247 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:21:38.249 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:21:38.249 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:21:38.249 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 54 2024-09-10T19:21:38.249 INFO:tasks.workunit.client.0.smithi038.stdout:54 2024-09-10T19:21:38.249 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-10T19:21:38.250 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:21:39.251 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:21:39.252 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:21:39.252 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 55 2024-09-10T19:21:39.252 INFO:tasks.workunit.client.0.smithi038.stdout:55 2024-09-10T19:21:39.252 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-10T19:21:39.253 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:21:40.254 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:21:40.254 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:21:40.254 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 56 2024-09-10T19:21:40.255 INFO:tasks.workunit.client.0.smithi038.stdout:56 2024-09-10T19:21:40.255 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-10T19:21:40.255 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:21:41.257 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:21:41.257 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:21:41.257 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 57 2024-09-10T19:21:41.257 INFO:tasks.workunit.client.0.smithi038.stdout:57 2024-09-10T19:21:41.258 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-10T19:21:41.258 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:21:42.260 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:21:42.260 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:21:42.260 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 58 2024-09-10T19:21:42.260 INFO:tasks.workunit.client.0.smithi038.stdout:58 2024-09-10T19:21:42.261 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-10T19:21:42.261 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:21:43.262 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:21:43.263 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:21:43.263 INFO:tasks.workunit.client.0.smithi038.stdout:59 2024-09-10T19:21:43.263 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 59 2024-09-10T19:21:43.263 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-10T19:21:43.264 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:21:44.265 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:21:44.266 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:21:44.266 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1752: wait_for_string: return 1 2024-09-10T19:21:44.266 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:75: TEST_cluster_log_level: grep -q 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-10T19:21:44.267 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:76: TEST_cluster_log_level: return_code=1 2024-09-10T19:21:44.267 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:77: TEST_cluster_log_level: '[' 1 -eq 0 ']' 2024-09-10T19:21:44.267 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:82: TEST_cluster_log_level: ceph config set mon.a mon_cluster_log_level warn 2024-09-10T19:21:44.735 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:83: TEST_cluster_log_level: ceph osd set noup 2024-09-10T19:21:45.334 INFO:tasks.workunit.client.0.smithi038.stderr:noup is set 2024-09-10T19:21:45.346 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:84: TEST_cluster_log_level: ceph osd down osd.0 2024-09-10T19:21:45.877 INFO:tasks.workunit.client.0.smithi038.stderr:osd.0 is already down. 2024-09-10T19:21:45.886 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:85: TEST_cluster_log_level: ceph osd unset noup 2024-09-10T19:21:46.509 INFO:tasks.workunit.client.0.smithi038.stderr:noup is unset 2024-09-10T19:21:46.522 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:86: TEST_cluster_log_level: TIMEOUT=60 2024-09-10T19:21:46.522 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:86: TEST_cluster_log_level: wait_for_osd up 0 2024-09-10T19:21:46.522 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-10T19:21:46.522 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2024-09-10T19:21:46.522 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-10T19:21:46.522 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-10T19:21:46.522 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 60 )) 2024-09-10T19:21:46.522 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-10T19:21:46.523 INFO:tasks.workunit.client.0.smithi038.stdout:0 2024-09-10T19:21:46.523 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:21:46.523 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-10T19:21:47.050 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-10T19:21:48.051 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-10T19:21:48.051 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 60 )) 2024-09-10T19:21:48.051 INFO:tasks.workunit.client.0.smithi038.stdout:1 2024-09-10T19:21:48.052 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-10T19:21:48.052 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-10T19:21:48.052 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-10T19:21:48.476 INFO:tasks.workunit.client.0.smithi038.stdout:osd.0 up in weight 1 up_from 23 up_thru 23 down_at 19 last_clean_interval [5,21) [v2:127.0.0.1:6802/1033535812,v1:127.0.0.1:6803/1033535812] [v2:127.0.0.1:6804/1035535812,v1:127.0.0.1:6805/1035535812] exists,up c703a1aa-e048-4ad9-8374-75154091f7b2 2024-09-10T19:21:48.477 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-10T19:21:48.477 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-10T19:21:48.477 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-10T19:21:48.477 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:87: TEST_cluster_log_level: search_str='cluster [[]WRN[]] Health check failed: noup flag(s) set (OSDMAP_FLAGS)' 2024-09-10T19:21:48.477 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:88: TEST_cluster_log_level: grep -q 'cluster [[]WRN[]] Health check failed: noup flag(s) set (OSDMAP_FLAGS)' td/mon-cluster-log/log 2024-09-10T19:21:48.478 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:89: TEST_cluster_log_level: return_code=0 2024-09-10T19:21:48.478 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:90: TEST_cluster_log_level: '[' 0 -ne 0 ']' 2024-09-10T19:21:48.478 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:95: TEST_cluster_log_level: ceph osd out 0 2024-09-10T19:21:49.084 INFO:tasks.workunit.client.0.smithi038.stderr:osd.0 is already out. 2024-09-10T19:21:49.096 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:96: TEST_cluster_log_level: ceph osd in 0 2024-09-10T19:21:49.604 INFO:tasks.workunit.client.0.smithi038.stderr:osd.0 is already in. 2024-09-10T19:21:49.616 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:97: TEST_cluster_log_level: WAIT_FOR_CLEAN_TIMEOUT=60 2024-09-10T19:21:49.616 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:97: TEST_cluster_log_level: wait_for_clean 2024-09-10T19:21:49.616 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1633: wait_for_clean: local cmd= 2024-09-10T19:21:49.616 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1634: wait_for_clean: local num_active_clean=-1 2024-09-10T19:21:49.616 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1635: wait_for_clean: local cur_active_clean 2024-09-10T19:21:49.616 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: get_timeout_delays 60 .1 2024-09-10T19:21:49.617 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-10T19:21:49.617 INFO:tasks.workunit.client.0.smithi038.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-10T19:21:49.617 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-10T19:21:49.617 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-10T19:21:49.617 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-10T19:21:49.690 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '4.5') 2024-09-10T19:21:49.691 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: local -a delays 2024-09-10T19:21:49.691 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1637: wait_for_clean: local -i loop=0 2024-09-10T19:21:49.691 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1639: wait_for_clean: flush_pg_stats 2024-09-10T19:21:49.691 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-10T19:21:49.691 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-10T19:21:50.135 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids=0 2024-09-10T19:21:50.135 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-10T19:21:50.135 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-10T19:21:50.135 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-10T19:21:50.303 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=98784247836 2024-09-10T19:21:50.303 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 98784247836 2024-09-10T19:21:50.303 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-98784247836' 2024-09-10T19:21:50.303 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-10T19:21:50.303 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-98784247836 2024-09-10T19:21:50.304 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-10T19:21:50.304 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-10T19:21:50.304 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-98784247836 2024-09-10T19:21:50.304 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-10T19:21:50.305 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=98784247836 2024-09-10T19:21:50.306 INFO:tasks.workunit.client.0.smithi038.stdout:waiting osd.0 seq 98784247836 2024-09-10T19:21:50.306 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 98784247836' 2024-09-10T19:21:50.306 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-10T19:21:50.701 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 0 -lt 98784247836 2024-09-10T19:21:50.701 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: flush_pg_stats: sleep 1 2024-09-10T19:21:51.702 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2224: flush_pg_stats: '[' 300 -eq 0 ']' 2024-09-10T19:21:51.703 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-10T19:21:52.147 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 98784247837 -lt 98784247836 2024-09-10T19:21:52.147 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: get_num_pgs 2024-09-10T19:21:52.148 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-10T19:21:52.148 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-10T19:21:52.729 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: test 8 == 0 2024-09-10T19:21:52.729 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-10T19:21:52.730 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-10T19:21:52.730 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-10T19:21:52.730 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-10T19:21:52.730 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-10T19:21:52.730 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-10T19:21:52.730 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-10T19:21:53.151 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=8 2024-09-10T19:21:53.151 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-10T19:21:53.151 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-10T19:21:53.151 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-10T19:21:53.744 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 8 = 8 2024-09-10T19:21:53.744 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: break 2024-09-10T19:21:53.744 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: return 0 2024-09-10T19:21:53.744 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:98: TEST_cluster_log_level: search_str='cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' 2024-09-10T19:21:53.744 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:99: TEST_cluster_log_level: ceph log last 1000 2024-09-10T19:21:53.744 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:99: TEST_cluster_log_level: grep -q 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' 2024-09-10T19:21:54.328 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:100: TEST_cluster_log_level: TIMEOUT=60 2024-09-10T19:21:54.328 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:100: TEST_cluster_log_level: wait_for_string td/mon-cluster-log/log 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' 2024-09-10T19:21:54.329 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1739: wait_for_string: local logfile=td/mon-cluster-log/log 2024-09-10T19:21:54.329 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1740: wait_for_string: local 'searchstr=cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' 2024-09-10T19:21:54.329 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1742: wait_for_string: status=1 2024-09-10T19:21:54.329 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i=0 )) 2024-09-10T19:21:54.329 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:21:54.329 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 0 2024-09-10T19:21:54.329 INFO:tasks.workunit.client.0.smithi038.stdout:0 2024-09-10T19:21:54.330 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-10T19:21:54.330 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:21:55.330 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:21:55.330 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:21:55.330 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 1 2024-09-10T19:21:55.331 INFO:tasks.workunit.client.0.smithi038.stdout:1 2024-09-10T19:21:55.331 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-10T19:21:55.331 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:21:56.333 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:21:56.333 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:21:56.333 INFO:tasks.workunit.client.0.smithi038.stdout:2 2024-09-10T19:21:56.334 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 2 2024-09-10T19:21:56.334 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-10T19:21:56.334 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:21:57.336 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:21:57.336 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:21:57.336 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 3 2024-09-10T19:21:57.336 INFO:tasks.workunit.client.0.smithi038.stdout:3 2024-09-10T19:21:57.336 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-10T19:21:57.337 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:21:58.338 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:21:58.339 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:21:58.339 INFO:tasks.workunit.client.0.smithi038.stdout:4 2024-09-10T19:21:58.339 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 4 2024-09-10T19:21:58.339 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-10T19:21:58.340 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:21:59.341 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:21:59.341 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:21:59.341 INFO:tasks.workunit.client.0.smithi038.stdout:5 2024-09-10T19:21:59.342 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 5 2024-09-10T19:21:59.342 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-10T19:21:59.342 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:22:00.344 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:22:00.344 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:22:00.344 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 6 2024-09-10T19:22:00.344 INFO:tasks.workunit.client.0.smithi038.stdout:6 2024-09-10T19:22:00.345 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-10T19:22:00.345 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:22:01.347 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:22:01.347 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:22:01.347 INFO:tasks.workunit.client.0.smithi038.stdout:7 2024-09-10T19:22:01.348 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 7 2024-09-10T19:22:01.348 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-10T19:22:01.348 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:22:02.349 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:22:02.350 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:22:02.350 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 8 2024-09-10T19:22:02.350 INFO:tasks.workunit.client.0.smithi038.stdout:8 2024-09-10T19:22:02.350 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-10T19:22:02.351 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:22:03.352 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:22:03.352 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:22:03.353 INFO:tasks.workunit.client.0.smithi038.stdout:9 2024-09-10T19:22:03.353 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 9 2024-09-10T19:22:03.353 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-10T19:22:03.353 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:22:04.355 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:22:04.355 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:22:04.355 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 10 2024-09-10T19:22:04.355 INFO:tasks.workunit.client.0.smithi038.stdout:10 2024-09-10T19:22:04.355 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-10T19:22:04.356 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:22:05.358 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:22:05.358 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:22:05.358 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 11 2024-09-10T19:22:05.358 INFO:tasks.workunit.client.0.smithi038.stdout:11 2024-09-10T19:22:05.358 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-10T19:22:05.359 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:22:06.361 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:22:06.361 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:22:06.361 INFO:tasks.workunit.client.0.smithi038.stdout:12 2024-09-10T19:22:06.361 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 12 2024-09-10T19:22:06.362 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-10T19:22:06.362 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:22:07.363 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:22:07.363 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:22:07.364 INFO:tasks.workunit.client.0.smithi038.stdout:13 2024-09-10T19:22:07.364 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 13 2024-09-10T19:22:07.364 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-10T19:22:07.364 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:22:08.366 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:22:08.366 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:22:08.366 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 14 2024-09-10T19:22:08.367 INFO:tasks.workunit.client.0.smithi038.stdout:14 2024-09-10T19:22:08.367 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-10T19:22:08.367 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:22:09.369 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:22:09.369 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:22:09.369 INFO:tasks.workunit.client.0.smithi038.stdout:15 2024-09-10T19:22:09.369 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 15 2024-09-10T19:22:09.370 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-10T19:22:09.370 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:22:10.371 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:22:10.372 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:22:10.372 INFO:tasks.workunit.client.0.smithi038.stdout:16 2024-09-10T19:22:10.372 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 16 2024-09-10T19:22:10.372 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-10T19:22:10.373 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:22:11.374 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:22:11.374 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:22:11.375 INFO:tasks.workunit.client.0.smithi038.stdout:17 2024-09-10T19:22:11.375 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 17 2024-09-10T19:22:11.375 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-10T19:22:11.375 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:22:12.377 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:22:12.377 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:22:12.377 INFO:tasks.workunit.client.0.smithi038.stdout:18 2024-09-10T19:22:12.378 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 18 2024-09-10T19:22:12.378 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-10T19:22:12.378 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:22:13.380 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:22:13.380 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:22:13.380 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 19 2024-09-10T19:22:13.380 INFO:tasks.workunit.client.0.smithi038.stdout:19 2024-09-10T19:22:13.380 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-10T19:22:13.381 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:22:14.382 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:22:14.382 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:22:14.383 INFO:tasks.workunit.client.0.smithi038.stdout:20 2024-09-10T19:22:14.383 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 20 2024-09-10T19:22:14.383 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-10T19:22:14.384 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:22:15.385 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:22:15.385 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:22:15.386 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 21 2024-09-10T19:22:15.386 INFO:tasks.workunit.client.0.smithi038.stdout:21 2024-09-10T19:22:15.386 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-10T19:22:15.386 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:22:16.388 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:22:16.388 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:22:16.388 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 22 2024-09-10T19:22:16.389 INFO:tasks.workunit.client.0.smithi038.stdout:22 2024-09-10T19:22:16.389 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-10T19:22:16.389 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:22:17.391 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:22:17.391 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:22:17.391 INFO:tasks.workunit.client.0.smithi038.stdout:23 2024-09-10T19:22:17.391 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 23 2024-09-10T19:22:17.392 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-10T19:22:17.392 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:22:18.393 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:22:18.393 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:22:18.393 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 24 2024-09-10T19:22:18.394 INFO:tasks.workunit.client.0.smithi038.stdout:24 2024-09-10T19:22:18.394 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-10T19:22:18.394 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:22:19.396 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:22:19.396 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:22:19.396 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 25 2024-09-10T19:22:19.397 INFO:tasks.workunit.client.0.smithi038.stdout:25 2024-09-10T19:22:19.397 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-10T19:22:19.397 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:22:20.399 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:22:20.399 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:22:20.399 INFO:tasks.workunit.client.0.smithi038.stdout:26 2024-09-10T19:22:20.400 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 26 2024-09-10T19:22:20.400 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-10T19:22:20.400 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:22:21.401 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:22:21.402 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:22:21.402 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 27 2024-09-10T19:22:21.402 INFO:tasks.workunit.client.0.smithi038.stdout:27 2024-09-10T19:22:21.402 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-10T19:22:21.403 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:22:22.404 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:22:22.404 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:22:22.404 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 28 2024-09-10T19:22:22.405 INFO:tasks.workunit.client.0.smithi038.stdout:28 2024-09-10T19:22:22.405 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-10T19:22:22.405 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:22:23.407 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:22:23.407 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:22:23.407 INFO:tasks.workunit.client.0.smithi038.stdout:29 2024-09-10T19:22:23.408 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 29 2024-09-10T19:22:23.408 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-10T19:22:23.408 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:22:24.410 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:22:24.410 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:22:24.410 INFO:tasks.workunit.client.0.smithi038.stdout:30 2024-09-10T19:22:24.411 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 30 2024-09-10T19:22:24.411 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-10T19:22:24.411 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:22:25.412 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:22:25.413 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:22:25.413 INFO:tasks.workunit.client.0.smithi038.stdout:31 2024-09-10T19:22:25.413 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 31 2024-09-10T19:22:25.413 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-10T19:22:25.414 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:22:26.415 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:22:26.415 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:22:26.415 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 32 2024-09-10T19:22:26.416 INFO:tasks.workunit.client.0.smithi038.stdout:32 2024-09-10T19:22:26.416 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-10T19:22:26.416 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:22:27.418 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:22:27.418 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:22:27.418 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 33 2024-09-10T19:22:27.419 INFO:tasks.workunit.client.0.smithi038.stdout:33 2024-09-10T19:22:27.419 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-10T19:22:27.419 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:22:28.421 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:22:28.421 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:22:28.421 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 34 2024-09-10T19:22:28.421 INFO:tasks.workunit.client.0.smithi038.stdout:34 2024-09-10T19:22:28.421 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-10T19:22:28.422 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:22:29.424 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:22:29.424 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:22:29.424 INFO:tasks.workunit.client.0.smithi038.stdout:35 2024-09-10T19:22:29.424 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 35 2024-09-10T19:22:29.424 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-10T19:22:29.425 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:22:30.426 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:22:30.427 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:22:30.427 INFO:tasks.workunit.client.0.smithi038.stdout:36 2024-09-10T19:22:30.427 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 36 2024-09-10T19:22:30.427 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-10T19:22:30.428 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:22:31.429 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:22:31.429 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:22:31.429 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 37 2024-09-10T19:22:31.430 INFO:tasks.workunit.client.0.smithi038.stdout:37 2024-09-10T19:22:31.430 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-10T19:22:31.430 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:22:32.433 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:22:32.433 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:22:32.433 INFO:tasks.workunit.client.0.smithi038.stdout:38 2024-09-10T19:22:32.433 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 38 2024-09-10T19:22:32.434 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-10T19:22:32.434 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:22:33.435 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:22:33.435 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:22:33.435 INFO:tasks.workunit.client.0.smithi038.stdout:39 2024-09-10T19:22:33.435 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 39 2024-09-10T19:22:33.436 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-10T19:22:33.436 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:22:34.438 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:22:34.438 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:22:34.438 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 40 2024-09-10T19:22:34.438 INFO:tasks.workunit.client.0.smithi038.stdout:40 2024-09-10T19:22:34.438 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-10T19:22:34.439 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:22:35.440 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:22:35.441 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:22:35.441 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 41 2024-09-10T19:22:35.441 INFO:tasks.workunit.client.0.smithi038.stdout:41 2024-09-10T19:22:35.441 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-10T19:22:35.441 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:22:36.443 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:22:36.443 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:22:36.444 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 42 2024-09-10T19:22:36.444 INFO:tasks.workunit.client.0.smithi038.stdout:42 2024-09-10T19:22:36.444 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-10T19:22:36.444 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:22:37.446 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:22:37.446 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:22:37.446 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 43 2024-09-10T19:22:37.446 INFO:tasks.workunit.client.0.smithi038.stdout:43 2024-09-10T19:22:37.447 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-10T19:22:37.447 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:22:38.449 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:22:38.449 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:22:38.449 INFO:tasks.workunit.client.0.smithi038.stdout:44 2024-09-10T19:22:38.450 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 44 2024-09-10T19:22:38.450 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-10T19:22:38.450 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:22:39.451 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:22:39.452 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:22:39.452 INFO:tasks.workunit.client.0.smithi038.stdout:45 2024-09-10T19:22:39.453 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 45 2024-09-10T19:22:39.453 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-10T19:22:39.453 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:22:40.454 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:22:40.454 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:22:40.454 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 46 2024-09-10T19:22:40.455 INFO:tasks.workunit.client.0.smithi038.stdout:46 2024-09-10T19:22:40.455 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-10T19:22:40.455 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:22:41.457 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:22:41.457 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:22:41.457 INFO:tasks.workunit.client.0.smithi038.stdout:47 2024-09-10T19:22:41.458 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 47 2024-09-10T19:22:41.458 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-10T19:22:41.458 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:22:42.460 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:22:42.460 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:22:42.460 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 48 2024-09-10T19:22:42.460 INFO:tasks.workunit.client.0.smithi038.stdout:48 2024-09-10T19:22:42.461 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-10T19:22:42.461 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:22:43.462 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:22:43.463 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:22:43.463 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 49 2024-09-10T19:22:43.463 INFO:tasks.workunit.client.0.smithi038.stdout:49 2024-09-10T19:22:43.463 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-10T19:22:43.464 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:22:44.465 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:22:44.465 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:22:44.465 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 50 2024-09-10T19:22:44.466 INFO:tasks.workunit.client.0.smithi038.stdout:50 2024-09-10T19:22:44.466 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-10T19:22:44.466 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:22:45.468 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:22:45.468 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:22:45.469 INFO:tasks.workunit.client.0.smithi038.stdout:51 2024-09-10T19:22:45.469 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 51 2024-09-10T19:22:45.472 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-10T19:22:45.473 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:22:46.471 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:22:46.471 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:22:46.471 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 52 2024-09-10T19:22:46.471 INFO:tasks.workunit.client.0.smithi038.stdout:52 2024-09-10T19:22:46.472 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-10T19:22:46.472 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:22:47.474 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:22:47.474 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:22:47.474 INFO:tasks.workunit.client.0.smithi038.stdout:53 2024-09-10T19:22:47.474 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 53 2024-09-10T19:22:47.474 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-10T19:22:47.475 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:22:48.476 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:22:48.477 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:22:48.477 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 54 2024-09-10T19:22:48.477 INFO:tasks.workunit.client.0.smithi038.stdout:54 2024-09-10T19:22:48.477 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-10T19:22:48.478 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:22:49.479 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:22:49.480 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:22:49.480 INFO:tasks.workunit.client.0.smithi038.stdout:55 2024-09-10T19:22:49.480 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 55 2024-09-10T19:22:49.480 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-10T19:22:49.481 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:22:50.482 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:22:50.482 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:22:50.483 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 56 2024-09-10T19:22:50.483 INFO:tasks.workunit.client.0.smithi038.stdout:56 2024-09-10T19:22:50.483 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-10T19:22:50.483 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:22:51.485 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:22:51.485 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:22:51.485 INFO:tasks.workunit.client.0.smithi038.stdout:57 2024-09-10T19:22:51.486 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 57 2024-09-10T19:22:51.486 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-10T19:22:51.486 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:22:52.488 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:22:52.488 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:22:52.488 INFO:tasks.workunit.client.0.smithi038.stdout:58 2024-09-10T19:22:52.489 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 58 2024-09-10T19:22:52.489 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-10T19:22:52.489 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:22:53.491 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:22:53.491 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:22:53.491 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 59 2024-09-10T19:22:53.491 INFO:tasks.workunit.client.0.smithi038.stdout:59 2024-09-10T19:22:53.491 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-10T19:22:53.492 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-10T19:22:54.494 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-10T19:22:54.494 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-10T19:22:54.494 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1752: wait_for_string: return 1 2024-09-10T19:22:54.494 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:101: TEST_cluster_log_level: grep -q 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-10T19:22:54.495 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:102: TEST_cluster_log_level: return_code=1 2024-09-10T19:22:54.495 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:103: TEST_cluster_log_level: '[' 1 -eq 0 ']' 2024-09-10T19:22:54.495 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:108: TEST_cluster_log_level: '[' 1 -gt 0 ']' 2024-09-10T19:22:54.495 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:109: TEST_cluster_log_level: echo 'TEST FAILED WITH 1 ERRORS' 2024-09-10T19:22:54.496 INFO:tasks.workunit.client.0.smithi038.stdout:TEST FAILED WITH 1 ERRORS 2024-09-10T19:22:54.497 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:110: TEST_cluster_log_level: return 1 2024-09-10T19:22:54.497 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:32: run: return 1 2024-09-10T19:22:54.497 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2324: main: code=1 2024-09-10T19:22:54.498 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2326: main: teardown td/mon-cluster-log 1 2024-09-10T19:22:54.498 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mon-cluster-log 2024-09-10T19:22:54.498 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=1 2024-09-10T19:22:54.498 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mon-cluster-log KILL 2024-09-10T19:22:54.498 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-10T19:22:54.498 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-10T19:22:54.498 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-10T19:22:54.498 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-10T19:22:54.498 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-10T19:22:54.604 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-10T19:22:54.604 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-10T19:22:54.605 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-10T19:22:54.605 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-10T19:22:54.607 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-10T19:22:54.607 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-10T19:22:54.607 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-10T19:22:54.608 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T19:22:54.608 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-10T19:22:54.609 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-10T19:22:54.609 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T19:22:54.610 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-10T19:22:54.611 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 1 = 1 ']' 2024-09-10T19:22:54.611 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:181: teardown: '[' -n '' ']' 2024-09-10T19:22:54.611 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:185: teardown: mkdir -p /home/ubuntu/cephtest/archive/log 2024-09-10T19:22:54.612 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:186: teardown: mv td/mon-cluster-log/mgr.x.log td/mon-cluster-log/mon.a.log td/mon-cluster-log/osd.0.log /home/ubuntu/cephtest/archive/log 2024-09-10T19:22:54.613 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mon-cluster-log 2024-09-10T19:22:54.619 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-10T19:22:54.619 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-10T19:22:54.619 INFO:tasks.workunit.client.0.smithi038.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.45730 2024-09-10T19:22:54.619 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.45730 2024-09-10T19:22:54.620 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T19:22:54.621 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-10T19:22:54.621 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-10T19:22:54.621 INFO:tasks.workunit.client.0.smithi038.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2327: main: return 1 2024-09-10T19:22:54.621 INFO:tasks.workunit:Stopping ['mon'] on client.0... 2024-09-10T19:22:54.622 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-10T19:22:54.980 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_bad1f558c327094897e4a32e99dd5cb4ae6ccd46/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/github.com_ceph_ceph-c_bad1f558c327094897e4a32e99dd5cb4ae6ccd46/qa/tasks/workunit.py", line 293, in _spawn_on_all_clients with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_bad1f558c327094897e4a32e99dd5cb4ae6ccd46/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test mon/mon-cluster-log.sh) on smithi038 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad1f558c327094897e4a32e99dd5cb4ae6ccd46 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh' 2024-09-10T19:22:55.161 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=98cc2f655b1041bfac33662073b671ab Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_bad1f558c327094897e4a32e99dd5cb4ae6ccd46/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/github.com_ceph_ceph-c_bad1f558c327094897e4a32e99dd5cb4ae6ccd46/qa/tasks/workunit.py", line 293, in _spawn_on_all_clients with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_bad1f558c327094897e4a32e99dd5cb4ae6ccd46/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test mon/mon-cluster-log.sh) on smithi038 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad1f558c327094897e4a32e99dd5cb4ae6ccd46 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh' 2024-09-10T19:22:55.164 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-10T19:22:55.176 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-10T19:22:55.176 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T19:22:55.230 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-10T19:22:55.239 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-10T19:22:55.239 DEBUG:teuthology.orchestra.run.smithi038:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T19:22:55.261 INFO:teuthology.orchestra.run.smithi038.stderr:bash: line 1: ntpq: command not found 2024-09-10T19:22:55.265 INFO:teuthology.orchestra.run.smithi038.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T19:22:55.266 INFO:teuthology.orchestra.run.smithi038.stdout:=============================================================================== 2024-09-10T19:22:55.266 INFO:teuthology.orchestra.run.smithi038.stdout:^* hv01.front.sepia.ceph.com 3 6 377 10 -321us[ -316us] +/- 38ms 2024-09-10T19:22:55.266 INFO:teuthology.orchestra.run.smithi038.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 8 +1481us[+1481us] +/- 57ms 2024-09-10T19:22:55.266 INFO:teuthology.orchestra.run.smithi038.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 10 -1320us[-1320us] +/- 83ms 2024-09-10T19:22:55.266 INFO:teuthology.orchestra.run.smithi038.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T19:22:55.267 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-10T19:22:55.275 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-10T19:22:55.275 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-10T19:22:55.320 DEBUG:teuthology.orchestra.run.smithi038:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T19:22:55.381 DEBUG:teuthology.orchestra.run.smithi038:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-10T19:22:55.409 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T19:22:55.409 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-10T19:22:55.417 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-10T19:22:55.445 INFO:teuthology.task.internal:Duration was 1085.154791 seconds 2024-09-10T19:22:55.445 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-10T19:22:55.496 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-10T19:22:55.496 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T19:22:55.537 INFO:teuthology.orchestra.run.smithi038.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T19:22:55.874 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-10T19:22:55.874 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi038.front.sepia.ceph.com 2024-09-10T19:22:55.874 DEBUG:teuthology.orchestra.run.smithi038:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T19:22:55.948 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-10T19:22:55.949 DEBUG:teuthology.orchestra.run.smithi038:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T19:22:56.016 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-10T19:22:56.016 DEBUG:teuthology.orchestra.run.smithi038:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T19:22:56.154 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-10T19:22:56.163 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-10T19:22:56.163 DEBUG:teuthology.orchestra.run.smithi038:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T19:22:56.189 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-10T19:22:56.204 DEBUG:teuthology.orchestra.run.smithi038:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T19:22:56.253 INFO:teuthology.orchestra.run.smithi038.stdout:kernel.core_pattern = core 2024-09-10T19:22:56.280 DEBUG:teuthology.orchestra.run.smithi038:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T19:22:56.334 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T19:22:56.335 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-10T19:22:56.344 INFO:teuthology.task.internal:Transferring archived files... 2024-09-10T19:22:56.345 DEBUG:teuthology.misc:Transferring archived files from smithi038:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/skanta-2024-09-10_15:30:27-rados-wip-bharath7-testing-2024-09-10-1409-distro-default-smithi/7899459/remote/smithi038 2024-09-10T19:22:56.346 DEBUG:teuthology.orchestra.run.smithi038:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T19:22:56.996 INFO:teuthology.task.internal:Removing archive directory... 2024-09-10T19:22:56.996 DEBUG:teuthology.orchestra.run.smithi038:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T19:22:57.038 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-10T19:22:57.047 INFO:teuthology.task.internal:Not uploading archives. 2024-09-10T19:22:57.048 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-10T19:22:57.088 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-10T19:22:57.088 DEBUG:teuthology.orchestra.run.smithi038:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T19:22:57.104 INFO:teuthology.orchestra.run.smithi038.stdout: 265753 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Sep 10 19:22 /home/ubuntu/cephtest 2024-09-10T19:22:57.104 INFO:teuthology.orchestra.run.smithi038.stdout: 280017 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Sep 10 19:11 /home/ubuntu/cephtest/mnt.0 2024-09-10T19:22:57.105 INFO:teuthology.orchestra.run.smithi038.stdout: 280018 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Sep 10 19:19 /home/ubuntu/cephtest/mnt.0/client.0 2024-09-10T19:22:57.105 INFO:teuthology.orchestra.run.smithi038.stdout: 393235 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Sep 10 19:19 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-10T19:22:57.105 INFO:teuthology.orchestra.run.smithi038.stdout: 393236 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 19:22 /home/ubuntu/cephtest/mnt.0/client.0/tmp/td 2024-09-10T19:22:57.106 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T19:22:57.106 INFO:teuthology.orchestra.run.smithi038.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-09-10T19:22:57.106 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi038 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-09-10T19:22:57.111 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-10T19:22:57.138 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-10T19:22:57.189 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi038 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-09-10T19:22:57.193 INFO:teuthology.run:Summary data: description: rados/standalone/{supported-random-distro$/{centos_latest} workloads/mon} duration: 1085.1547906398773 failure_reason: 'Command failed (workunit test mon/mon-cluster-log.sh) on smithi038 with status 1: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad1f558c327094897e4a32e99dd5cb4ae6ccd46 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh''' flavor: default owner: scheduled_skanta@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=98cc2f655b1041bfac33662073b671ab status: fail success: false 2024-09-10T19:22:57.193 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T19:22:57.279 INFO:teuthology.run:FAIL