2023-11-16T13:38:04.263 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-16T13:38:04.264 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_gabrioux@teuthology --name gabrioux-2023-11-16_12:07:54-orch:cephadm-wip-63555-quincy-distro-default-smithi --archive /home/teuthworker/archive/gabrioux-2023-11-16_12:07:54-orch:cephadm-wip-63555-quincy-distro-default-smithi/7460794 --description orch:cephadm/workunits/{0-distro/rhel_8.4_container_tools_3.0 agent/on mon_election/connectivity task/test_cephadm} --verbose -- /home/teuthworker/archive/gabrioux-2023-11-16_12:07:54-orch:cephadm-wip-63555-quincy-distro-default-smithi/7460794/orig.config.yaml 2023-11-16T13:38:04.288 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T13:38:04.372 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/gabrioux-2023-11-16_12:07:54-orch:cephadm-wip-63555-quincy-distro-default-smithi/7460794 branch: wip-63555-quincy description: orch:cephadm/workunits/{0-distro/rhel_8.4_container_tools_3.0 agent/on mon_election/connectivity task/test_cephadm} email: gabrioux@ibm.com first_in_suite: false job_id: '7460794' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: gabrioux-2023-11-16_12:07:54-orch:cephadm-wip-63555-quincy-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: rhel os_version: '8.4' overrides: admin_socket: branch: wip-63555-quincy ceph: conf: global: mon election default strategy: 3 mgr: debug mgr: 20 debug ms: 1 mgr/cephadm/use_agent: true mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: ae6ce92c0812ba06c9c623ce72df4f3fc59080b4 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: ae6ce92c0812ba06c9c623ce72df4f3fc59080b4 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 workunit: branch: wip-63555-quincy sha1: ae6ce92c0812ba06c9c623ce72df4f3fc59080b4 owner: scheduled_gabrioux@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - client.0 seed: 3535 sha1: ae6ce92c0812ba06c9c623ce72df4f3fc59080b4 sleep_before_teardown: 0 subset: 1/8 suite: orch:cephadm suite_branch: wip-63555-quincy suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_ae6ce92c0812ba06c9c623ce72df4f3fc59080b4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: ae6ce92c0812ba06c9c623ce72df4f3fc59080b4 targets: smithi067.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO4QiM3tGACwSrE19pQ7xtMf2UScG4piqhyd9EdJvhMb7k3OLy6KHpKtB/wvvA5gVlh1O9mnE8zMG5C8ibDEBfw= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools:3.0 --allowerasing --nobest - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - install: null - exec: mon.a: - yum install -y python3 || apt install -y python3 - workunit: clients: client.0: - cephadm/test_cephadm.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 6899cd26fceddb2fec83dc1a1349394b28c8998e timestamp: 2023-11-16_12:07:54 tube: smithi user: gabrioux verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.1224587 2023-11-16T13:38:04.372 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_ae6ce92c0812ba06c9c623ce72df4f3fc59080b4/qa; will attempt to use it 2023-11-16T13:38:04.373 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_ae6ce92c0812ba06c9c623ce72df4f3fc59080b4/qa/tasks 2023-11-16T13:38:04.373 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-11-16T13:38:04.376 INFO:teuthology.task.internal:Checking packages... 2023-11-16T13:38:04.405 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash 'ae6ce92c0812ba06c9c623ce72df4f3fc59080b4' 2023-11-16T13:38:04.405 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-11-16T13:38:04.405 INFO:teuthology.packaging:ref: None 2023-11-16T13:38:04.405 INFO:teuthology.packaging:tag: None 2023-11-16T13:38:04.405 INFO:teuthology.packaging:branch: wip-63555-quincy 2023-11-16T13:38:04.405 INFO:teuthology.packaging:sha1: ae6ce92c0812ba06c9c623ce72df4f3fc59080b4 2023-11-16T13:38:04.405 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-63555-quincy 2023-11-16T13:38:04.561 INFO:teuthology.task.internal:Found packages for ceph version 17.2.7-68.gae6ce92c 2023-11-16T13:38:04.562 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-11-16T13:38:04.569 INFO:teuthology.task.internal:no buildpackages task found 2023-11-16T13:38:04.569 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-11-16T13:38:04.603 INFO:teuthology.task.internal:Saving configuration 2023-11-16T13:38:04.613 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-11-16T13:38:04.635 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-16T13:38:04.658 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi067.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-11-16_12:07:54-orch:cephadm-wip-63555-quincy-distro-default-smithi/7460794', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-16 13:32:55.690441', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO4QiM3tGACwSrE19pQ7xtMf2UScG4piqhyd9EdJvhMb7k3OLy6KHpKtB/wvvA5gVlh1O9mnE8zMG5C8ibDEBfw='} 2023-11-16T13:38:04.658 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-11-16T13:38:04.669 INFO:teuthology.task.internal:roles: ubuntu@smithi067.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'client.0'] 2023-11-16T13:38:04.669 INFO:teuthology.run_tasks:Running task console_log... 2023-11-16T13:38:04.737 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f37633e5b80>, signals=[15]) 2023-11-16T13:38:04.737 INFO:teuthology.run_tasks:Running task internal.connect... 2023-11-16T13:38:04.745 INFO:teuthology.task.internal:Opening connections... 2023-11-16T13:38:04.745 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi067.front.sepia.ceph.com 2023-11-16T13:38:04.747 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T13:38:04.815 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-11-16T13:38:04.822 DEBUG:teuthology.orchestra.run.smithi067:> uname -m 2023-11-16T13:38:04.888 INFO:teuthology.orchestra.run.smithi067.stdout:x86_64 2023-11-16T13:38:04.888 DEBUG:teuthology.orchestra.run.smithi067:> cat /etc/os-release 2023-11-16T13:38:04.945 INFO:teuthology.orchestra.run.smithi067.stdout:NAME="Red Hat Enterprise Linux" 2023-11-16T13:38:04.945 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION="8.4 (Ootpa)" 2023-11-16T13:38:04.945 INFO:teuthology.orchestra.run.smithi067.stdout:ID="rhel" 2023-11-16T13:38:04.945 INFO:teuthology.orchestra.run.smithi067.stdout:ID_LIKE="fedora" 2023-11-16T13:38:04.945 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION_ID="8.4" 2023-11-16T13:38:04.945 INFO:teuthology.orchestra.run.smithi067.stdout:PLATFORM_ID="platform:el8" 2023-11-16T13:38:04.946 INFO:teuthology.orchestra.run.smithi067.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-11-16T13:38:04.946 INFO:teuthology.orchestra.run.smithi067.stdout:ANSI_COLOR="0;31" 2023-11-16T13:38:04.946 INFO:teuthology.orchestra.run.smithi067.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-11-16T13:38:04.946 INFO:teuthology.orchestra.run.smithi067.stdout:HOME_URL="https://www.redhat.com/" 2023-11-16T13:38:04.946 INFO:teuthology.orchestra.run.smithi067.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-16T13:38:04.946 INFO:teuthology.orchestra.run.smithi067.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-16T13:38:04.946 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:38:04.946 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-16T13:38:04.946 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-11-16T13:38:04.946 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-16T13:38:04.946 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-11-16T13:38:04.947 INFO:teuthology.lock.ops:Updating smithi067.front.sepia.ceph.com on lock server 2023-11-16T13:38:04.975 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-11-16T13:38:04.986 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-11-16T13:38:05.033 INFO:teuthology.task.internal:Checking for old test directory... 2023-11-16T13:38:05.034 DEBUG:teuthology.orchestra.run.smithi067:> test '!' -e /home/ubuntu/cephtest 2023-11-16T13:38:05.050 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-11-16T13:38:05.060 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-11-16T13:38:05.060 DEBUG:teuthology.orchestra.run.smithi067:> test -z $(ls -A /var/lib/ceph) 2023-11-16T13:38:05.107 INFO:teuthology.orchestra.run.smithi067.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-11-16T13:38:05.108 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-11-16T13:38:05.141 INFO:teuthology.run_tasks:Running task kernel... 2023-11-16T13:38:05.156 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-11-16T13:38:05.156 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-11-16T13:38:05.157 DEBUG:teuthology.orchestra.run.smithi067:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-16T13:38:05.172 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-16T13:38:05.173 DEBUG:teuthology.orchestra.run.smithi067:> uname -r 2023-11-16T13:38:05.228 INFO:teuthology.orchestra.run.smithi067.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-11-16T13:38:05.229 INFO:teuthology.task.kernel:Running kernel on smithi067: 4.18.0-305.25.1.el8_4.x86_64 2023-11-16T13:38:05.229 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum install -y kernel 2023-11-16T13:38:06.652 INFO:teuthology.orchestra.run.smithi067.stdout:Updating Subscription Management repositories. 2023-11-16T13:38:06.652 INFO:teuthology.orchestra.run.smithi067.stdout:Unable to read consumer identity 2023-11-16T13:38:08.110 INFO:teuthology.orchestra.run.smithi067.stdout:Copr repo for python3-asyncssh owned by ceph 29 kB/s | 3.5 kB 00:00 2023-11-16T13:38:08.702 INFO:teuthology.orchestra.run.smithi067.stdout:Extra Packages for Enterprise Linux 29 MB/s | 16 MB 00:00 2023-11-16T13:38:12.207 INFO:teuthology.orchestra.run.smithi067.stdout:lab-extras 4.9 MB/s | 24 kB 00:00 2023-11-16T13:38:13.017 INFO:teuthology.orchestra.run.smithi067.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-11-16T13:38:13.017 INFO:teuthology.orchestra.run.smithi067.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-11-16T13:38:13.017 INFO:teuthology.orchestra.run.smithi067.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-11-16T13:38:13.176 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2023-11-16T13:38:13.177 INFO:teuthology.orchestra.run.smithi067.stdout:Nothing to do. 2023-11-16T13:38:13.177 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2023-11-16T13:38:13.293 DEBUG:teuthology.orchestra.run.smithi067:> echo no | sudo yum reinstall kernel || true 2023-11-16T13:38:13.657 INFO:teuthology.orchestra.run.smithi067.stdout:Updating Subscription Management repositories. 2023-11-16T13:38:13.657 INFO:teuthology.orchestra.run.smithi067.stdout:Unable to read consumer identity 2023-11-16T13:38:13.969 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:00:01 ago on Thu 16 Nov 2023 01:38:12 PM UTC. 2023-11-16T13:38:14.107 INFO:teuthology.orchestra.run.smithi067.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-11-16T13:38:14.107 INFO:teuthology.orchestra.run.smithi067.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-11-16T13:38:14.107 INFO:teuthology.orchestra.run.smithi067.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-11-16T13:38:14.138 INFO:teuthology.orchestra.run.smithi067.stderr:Error: No packages marked for reinstall. 2023-11-16T13:38:14.188 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum reinstall -y kernel || true 2023-11-16T13:38:14.552 INFO:teuthology.orchestra.run.smithi067.stdout:Updating Subscription Management repositories. 2023-11-16T13:38:14.552 INFO:teuthology.orchestra.run.smithi067.stdout:Unable to read consumer identity 2023-11-16T13:38:14.868 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:00:02 ago on Thu 16 Nov 2023 01:38:12 PM UTC. 2023-11-16T13:38:15.031 INFO:teuthology.orchestra.run.smithi067.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-11-16T13:38:15.031 INFO:teuthology.orchestra.run.smithi067.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-11-16T13:38:15.031 INFO:teuthology.orchestra.run.smithi067.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-11-16T13:38:15.043 INFO:teuthology.orchestra.run.smithi067.stderr:Error: No packages marked for reinstall. 2023-11-16T13:38:15.093 DEBUG:teuthology.orchestra.run.smithi067:> rpm -q kernel | sort -rV | head -n 1 2023-11-16T13:38:15.224 INFO:teuthology.orchestra.run.smithi067.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-11-16T13:38:15.225 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-11-16T13:38:15.225 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.25.1.el8_4.x86_64 Expected: 4.18.0-425.3.1.el8.x86_64 2023-11-16T13:38:15.225 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-11-16T13:38:15.225 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-11-16T13:38:15.226 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-11-16T13:38:15.226 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi067.front.sepia.ceph.com, path=None, version=distro) 2023-11-16T13:38:15.226 DEBUG:teuthology.orchestra.run.smithi067:> rpm -q kernel | sort -rV | head -n 1 2023-11-16T13:38:15.357 INFO:teuthology.orchestra.run.smithi067.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-11-16T13:38:15.357 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-11-16T13:38:15.358 DEBUG:teuthology.orchestra.run.smithi067:> sudo rpm -qi grub2-tools 2023-11-16T13:38:15.385 INFO:teuthology.orchestra.run.smithi067.stdout:Name : grub2-tools 2023-11-16T13:38:15.386 INFO:teuthology.orchestra.run.smithi067.stdout:Epoch : 1 2023-11-16T13:38:15.386 INFO:teuthology.orchestra.run.smithi067.stdout:Version : 2.02 2023-11-16T13:38:15.386 INFO:teuthology.orchestra.run.smithi067.stdout:Release : 99.el8_4.1 2023-11-16T13:38:15.386 INFO:teuthology.orchestra.run.smithi067.stdout:Architecture: x86_64 2023-11-16T13:38:15.386 INFO:teuthology.orchestra.run.smithi067.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-11-16T13:38:15.386 INFO:teuthology.orchestra.run.smithi067.stdout:Group : System Environment/Base 2023-11-16T13:38:15.386 INFO:teuthology.orchestra.run.smithi067.stdout:Size : 9264631 2023-11-16T13:38:15.386 INFO:teuthology.orchestra.run.smithi067.stdout:License : GPLv3+ 2023-11-16T13:38:15.386 INFO:teuthology.orchestra.run.smithi067.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-11-16T13:38:15.387 INFO:teuthology.orchestra.run.smithi067.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-11-16T13:38:15.387 INFO:teuthology.orchestra.run.smithi067.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-11-16T13:38:15.387 INFO:teuthology.orchestra.run.smithi067.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-11-16T13:38:15.387 INFO:teuthology.orchestra.run.smithi067.stdout:Relocations : (not relocatable) 2023-11-16T13:38:15.387 INFO:teuthology.orchestra.run.smithi067.stdout:Packager : Red Hat, Inc. 2023-11-16T13:38:15.387 INFO:teuthology.orchestra.run.smithi067.stdout:Vendor : Red Hat, Inc. 2023-11-16T13:38:15.387 INFO:teuthology.orchestra.run.smithi067.stdout:URL : http://www.gnu.org/software/grub/ 2023-11-16T13:38:15.387 INFO:teuthology.orchestra.run.smithi067.stdout:Summary : Support tools for GRUB. 2023-11-16T13:38:15.387 INFO:teuthology.orchestra.run.smithi067.stdout:Description : 2023-11-16T13:38:15.387 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:38:15.387 INFO:teuthology.orchestra.run.smithi067.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-11-16T13:38:15.387 INFO:teuthology.orchestra.run.smithi067.stdout:customizable bootloader with modular architecture. It supports a rich 2023-11-16T13:38:15.387 INFO:teuthology.orchestra.run.smithi067.stdout:variety of kernel formats, file systems, computer architectures and 2023-11-16T13:38:15.388 INFO:teuthology.orchestra.run.smithi067.stdout:hardware devices. 2023-11-16T13:38:15.388 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:38:15.388 INFO:teuthology.orchestra.run.smithi067.stdout:This subpackage provides tools for support of all platforms. 2023-11-16T13:38:15.389 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-11-16T13:38:15.389 INFO:teuthology.task.kernel:Updating grub on smithi067 to boot 4.18.0-425.3.1.el8.x86_64 2023-11-16T13:38:15.389 DEBUG:teuthology.orchestra.run.smithi067:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-11-16T13:38:16.764 INFO:teuthology.orchestra.run.smithi067.stderr:Generating grub configuration file ... 2023-11-16T13:38:18.531 INFO:teuthology.orchestra.run.smithi067.stderr:done 2023-11-16T13:38:18.533 DEBUG:teuthology.orchestra.run.smithi067:> mktemp 2023-11-16T13:38:18.547 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/tmp.zjjptb72eb 2023-11-16T13:38:18.548 DEBUG:teuthology.orchestra.run.smithi067:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.zjjptb72eb 2023-11-16T13:38:18.615 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 0666 /tmp/tmp.zjjptb72eb 2023-11-16T13:38:18.772 DEBUG:teuthology.orchestra.remote:smithi067:/tmp/tmp.zjjptb72eb is 6KB 2023-11-16T13:38:18.821 DEBUG:teuthology.orchestra.run.smithi067:> rm -fr /tmp/tmp.zjjptb72eb 2023-11-16T13:38:18.835 DEBUG:teuthology.orchestra.run.smithi067:> sudo /bin/ls /boot/loader/entries || true 2023-11-16T13:38:18.909 INFO:teuthology.orchestra.run.smithi067.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-11-16T13:38:18.910 INFO:teuthology.orchestra.run.smithi067.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-11-16T13:38:18.910 INFO:teuthology.orchestra.run.smithi067.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-11-16T13:38:18.910 INFO:teuthology.orchestra.run.smithi067.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-11-16T13:38:18.912 DEBUG:teuthology.orchestra.run.smithi067:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64 2023-11-16T13:38:19.079 DEBUG:teuthology.orchestra.run.smithi067:> sudo shutdown -r now 2023-11-16T13:38:49.110 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-11-16T13:38:49.111 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2023-11-16T13:38:49.112 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T13:39:07.514 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.67 2023-11-16T13:39:16.522 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2023-11-16T13:39:16.523 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T13:39:19.578 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.67 2023-11-16T13:39:31.590 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2023-11-16T13:39:31.591 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T13:39:50.018 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.67 2023-11-16T13:40:05.030 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2023-11-16T13:40:05.031 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T13:40:05.691 DEBUG:teuthology.orchestra.run.smithi067:> true 2023-11-16T13:40:05.998 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi067.front.sepia.ceph.com' 2023-11-16T13:40:05.998 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.18.0-425.3.1.el8.x86_64"... 2023-11-16T13:40:05.998 DEBUG:teuthology.orchestra.run.smithi067:> uname -r 2023-11-16T13:40:06.012 INFO:teuthology.orchestra.run.smithi067.stdout:4.18.0-425.3.1.el8.x86_64 2023-11-16T13:40:06.013 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-425.3.1.el8.x86_64 vs 4.18.0-425.3.1.el8.x86_64 2023-11-16T13:40:06.013 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-16T13:40:06.013 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-11-16T13:40:07.014 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-11-16T13:40:07.014 DEBUG:teuthology.orchestra.run.smithi067:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-16T13:40:07.126 INFO:teuthology.orchestra.run.smithi067.stdout:ttyS1 2023-11-16T13:40:07.143 DEBUG:teuthology.parallel:result is None 2023-11-16T13:40:07.143 INFO:teuthology.run_tasks:Running task internal.base... 2023-11-16T13:40:07.150 INFO:teuthology.task.internal:Creating test directory... 2023-11-16T13:40:07.150 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-16T13:40:07.165 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-11-16T13:40:07.182 INFO:teuthology.run_tasks:Running task internal.archive... 2023-11-16T13:40:07.232 INFO:teuthology.task.internal:Creating archive directory... 2023-11-16T13:40:07.232 DEBUG:teuthology.orchestra.run.smithi067:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-16T13:40:07.252 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-11-16T13:40:07.335 INFO:teuthology.task.internal:Enabling coredump saving... 2023-11-16T13:40:07.335 DEBUG:teuthology.orchestra.run.smithi067:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-16T13:40:07.367 INFO:teuthology.orchestra.run.smithi067.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-16T13:40:07.378 INFO:teuthology.orchestra.run.smithi067.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-16T13:40:07.379 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-11-16T13:40:07.389 INFO:teuthology.task.internal:Configuring sudo... 2023-11-16T13:40:07.393 DEBUG:teuthology.orchestra.run.smithi067:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-16T13:40:07.441 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-11-16T13:40:07.451 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-11-16T13:40:07.451 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-16T13:40:07.494 DEBUG:teuthology.orchestra.run.smithi067:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-16T13:40:07.574 DEBUG:teuthology.orchestra.run.smithi067:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-16T13:40:07.625 DEBUG:teuthology.orchestra.run.smithi067:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-16T13:40:07.706 DEBUG:teuthology.orchestra.run.smithi067:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-16T13:40:07.742 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-11-16T13:40:07.743 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-16T13:40:07.805 DEBUG:teuthology.orchestra.run.smithi067:> sudo service rsyslog restart 2023-11-16T13:40:07.989 INFO:teuthology.orchestra.run.smithi067.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-16T13:40:08.145 INFO:teuthology.run_tasks:Running task internal.timer... 2023-11-16T13:40:08.154 INFO:teuthology.task.internal:Starting timer... 2023-11-16T13:40:08.154 INFO:teuthology.run_tasks:Running task pcp... 2023-11-16T13:40:08.226 INFO:teuthology.run_tasks:Running task selinux... 2023-11-16T13:40:08.276 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-11-16T13:40:08.277 DEBUG:teuthology.orchestra.run.smithi067:> sudo service auditd rotate 2023-11-16T13:40:08.337 INFO:teuthology.orchestra.run.smithi067.stdout:Rotating logs: [ OK ] 2023-11-16T13:40:08.339 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-11-16T13:40:08.339 DEBUG:teuthology.orchestra.run.smithi067:> /usr/sbin/getenforce 2023-11-16T13:40:08.356 INFO:teuthology.orchestra.run.smithi067.stdout:Permissive 2023-11-16T13:40:08.356 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi067.front.sepia.ceph.com': 'permissive'} 2023-11-16T13:40:08.357 DEBUG:teuthology.orchestra.run.smithi067:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-16T13:40:08.422 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-16T13:40:08.423 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-11-16T13:40:08.423 DEBUG:teuthology.orchestra.run.smithi067:> sudo /usr/sbin/setenforce permissive 2023-11-16T13:40:08.488 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-11-16T13:40:08.498 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-11-16T13:40:08.498 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-11-16T13:40:08.515 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-11-16T13:40:08.516 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi067.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-11-16T13:50:06.887 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi067.front.sepia.ceph.com')] 2023-11-16T13:50:06.888 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2023-11-16T13:50:06.889 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T13:50:06.960 DEBUG:teuthology.orchestra.run.smithi067:> true 2023-11-16T13:50:06.984 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi067.front.sepia.ceph.com' 2023-11-16T13:50:06.984 INFO:teuthology.run_tasks:Running task clock... 2023-11-16T13:50:06.998 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-11-16T13:50:06.998 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-16T13:50:06.999 DEBUG:teuthology.orchestra.run.smithi067:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-16T13:50:07.055 INFO:teuthology.orchestra.run.smithi067.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-11-16T13:50:07.069 INFO:teuthology.orchestra.run.smithi067.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-11-16T13:50:07.108 INFO:teuthology.orchestra.run.smithi067.stderr:sudo: ntpd: command not found 2023-11-16T13:50:07.119 INFO:teuthology.orchestra.run.smithi067.stdout:506 Cannot talk to daemon 2023-11-16T13:50:07.133 INFO:teuthology.orchestra.run.smithi067.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-11-16T13:50:07.148 INFO:teuthology.orchestra.run.smithi067.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-11-16T13:50:07.224 INFO:teuthology.orchestra.run.smithi067.stderr:bash: ntpq: command not found 2023-11-16T13:50:07.227 INFO:teuthology.orchestra.run.smithi067.stdout:210 Number of sources = 4 2023-11-16T13:50:07.227 INFO:teuthology.orchestra.run.smithi067.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-16T13:50:07.227 INFO:teuthology.orchestra.run.smithi067.stdout:=============================================================================== 2023-11-16T13:50:07.227 INFO:teuthology.orchestra.run.smithi067.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-16T13:50:07.227 INFO:teuthology.orchestra.run.smithi067.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-16T13:50:07.227 INFO:teuthology.orchestra.run.smithi067.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-16T13:50:07.227 INFO:teuthology.orchestra.run.smithi067.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-16T13:50:07.228 INFO:teuthology.run_tasks:Running task pexec... 2023-11-16T13:50:07.237 INFO:teuthology.task.pexec:Executing custom commands... 2023-11-16T13:50:07.237 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi067.front.sepia.ceph.com 2023-11-16T13:50:07.237 DEBUG:teuthology.orchestra.run.smithi067:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-11-16T13:50:07.681 INFO:teuthology.orchestra.run.smithi067.stdout:Updating Subscription Management repositories. 2023-11-16T13:50:09.647 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:01:50 ago on Thu 16 Nov 2023 01:48:19 PM UTC. 2023-11-16T13:50:11.832 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2023-11-16T13:50:11.833 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-11-16T13:50:11.833 INFO:teuthology.orchestra.run.smithi067.stdout: Package Architecture Version Repository Size 2023-11-16T13:50:11.834 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-11-16T13:50:11.834 INFO:teuthology.orchestra.run.smithi067.stdout:Resetting modules: 2023-11-16T13:50:11.834 INFO:teuthology.orchestra.run.smithi067.stdout: container-tools 2023-11-16T13:50:11.834 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:50:11.834 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2023-11-16T13:50:11.835 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-11-16T13:50:11.835 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:50:12.817 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:01:53 ago on Thu 16 Nov 2023 01:48:19 PM UTC. 2023-11-16T13:50:20.636 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2023-11-16T13:50:21.118 INFO:teuthology.orchestra.run.smithi067.stdout:Updating Subscription Management repositories. 2023-11-16T13:50:22.915 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:02:03 ago on Thu 16 Nov 2023 01:48:19 PM UTC. 2023-11-16T13:50:25.177 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2023-11-16T13:50:25.232 INFO:teuthology.orchestra.run.smithi067.stdout:========================================================================================================================== 2023-11-16T13:50:25.232 INFO:teuthology.orchestra.run.smithi067.stdout: Package Arch Version Repository Size 2023-11-16T13:50:25.232 INFO:teuthology.orchestra.run.smithi067.stdout:========================================================================================================================== 2023-11-16T13:50:25.232 INFO:teuthology.orchestra.run.smithi067.stdout:Installing group/module packages: 2023-11-16T13:50:25.232 INFO:teuthology.orchestra.run.smithi067.stdout: buildah x86_64 1.19.7-1.module+el8.4.0+11818+341460ad rhel-8-for-x86_64-appstream-rpms 7.4 M 2023-11-16T13:50:25.232 INFO:teuthology.orchestra.run.smithi067.stdout: cockpit-podman noarch 29-2.module+el8.4.0+11818+341460ad rhel-8-for-x86_64-appstream-rpms 1.1 M 2023-11-16T13:50:25.232 INFO:teuthology.orchestra.run.smithi067.stdout: crun x86_64 0.18-2.module+el8.4.0+11818+341460ad rhel-8-for-x86_64-appstream-rpms 185 k 2023-11-16T13:50:25.233 INFO:teuthology.orchestra.run.smithi067.stdout: skopeo x86_64 1:1.2.2-8.module+el8.4.0+11818+341460ad rhel-8-for-x86_64-appstream-rpms 6.3 M 2023-11-16T13:50:25.233 INFO:teuthology.orchestra.run.smithi067.stdout: toolbox noarch 0.0.8-1.module+el8.4.0+11818+341460ad rhel-8-for-x86_64-appstream-rpms 16 k 2023-11-16T13:50:25.233 INFO:teuthology.orchestra.run.smithi067.stdout: udica noarch 0.2.4-1.module+el8.4.0+11818+341460ad rhel-8-for-x86_64-appstream-rpms 51 k 2023-11-16T13:50:25.233 INFO:teuthology.orchestra.run.smithi067.stdout:Installing dependencies: 2023-11-16T13:50:25.233 INFO:teuthology.orchestra.run.smithi067.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-11-16T13:50:25.233 INFO:teuthology.orchestra.run.smithi067.stdout:Downgrading: 2023-11-16T13:50:25.233 INFO:teuthology.orchestra.run.smithi067.stdout: conmon x86_64 2:2.0.26-1.module+el8.4.0+11818+341460ad rhel-8-for-x86_64-appstream-rpms 51 k 2023-11-16T13:50:25.233 INFO:teuthology.orchestra.run.smithi067.stdout: container-selinux noarch 2:2.167.0-1.module+el8.4.0+12448+09f02219 rhel-8-for-x86_64-appstream-rpms 52 k 2023-11-16T13:50:25.233 INFO:teuthology.orchestra.run.smithi067.stdout: containernetworking-plugins x86_64 0.9.1-1.module+el8.4.0+11818+341460ad rhel-8-for-x86_64-appstream-rpms 20 M 2023-11-16T13:50:25.233 INFO:teuthology.orchestra.run.smithi067.stdout: containers-common x86_64 1:1.2.2-8.module+el8.4.0+11818+341460ad rhel-8-for-x86_64-appstream-rpms 91 k 2023-11-16T13:50:25.233 INFO:teuthology.orchestra.run.smithi067.stdout: criu x86_64 3.15-1.module+el8.4.0+11818+341460ad rhel-8-for-x86_64-appstream-rpms 511 k 2023-11-16T13:50:25.233 INFO:teuthology.orchestra.run.smithi067.stdout: fuse-overlayfs x86_64 1.4.0-2.module+el8.4.0+11818+341460ad rhel-8-for-x86_64-appstream-rpms 72 k 2023-11-16T13:50:25.234 INFO:teuthology.orchestra.run.smithi067.stdout: libslirp x86_64 4.3.1-1.module+el8.4.0+11818+341460ad rhel-8-for-x86_64-appstream-rpms 69 k 2023-11-16T13:50:25.234 INFO:teuthology.orchestra.run.smithi067.stdout: podman x86_64 3.0.1-7.module+el8.4.0+12906+0cce23da rhel-8-for-x86_64-appstream-rpms 12 M 2023-11-16T13:50:25.234 INFO:teuthology.orchestra.run.smithi067.stdout: podman-catatonit x86_64 3.0.1-7.module+el8.4.0+12906+0cce23da rhel-8-for-x86_64-appstream-rpms 320 k 2023-11-16T13:50:25.234 INFO:teuthology.orchestra.run.smithi067.stdout: podman-docker noarch 3.0.1-7.module+el8.4.0+12906+0cce23da rhel-8-for-x86_64-appstream-rpms 56 k 2023-11-16T13:50:25.234 INFO:teuthology.orchestra.run.smithi067.stdout: runc x86_64 1.0.0-72.rc92.module+el8.4.0+12507+7f8c8fd7 rhel-8-for-x86_64-appstream-rpms 3.1 M 2023-11-16T13:50:25.234 INFO:teuthology.orchestra.run.smithi067.stdout: slirp4netns x86_64 1.1.8-1.module+el8.4.0+11818+341460ad rhel-8-for-x86_64-appstream-rpms 51 k 2023-11-16T13:50:25.234 INFO:teuthology.orchestra.run.smithi067.stdout:Installing module profiles: 2023-11-16T13:50:25.234 INFO:teuthology.orchestra.run.smithi067.stdout: container-tools/common 2023-11-16T13:50:25.234 INFO:teuthology.orchestra.run.smithi067.stdout:Enabling module streams: 2023-11-16T13:50:25.234 INFO:teuthology.orchestra.run.smithi067.stdout: container-tools 3.0 2023-11-16T13:50:25.234 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:50:25.234 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2023-11-16T13:50:25.235 INFO:teuthology.orchestra.run.smithi067.stdout:========================================================================================================================== 2023-11-16T13:50:25.235 INFO:teuthology.orchestra.run.smithi067.stdout:Install 7 Packages 2023-11-16T13:50:25.235 INFO:teuthology.orchestra.run.smithi067.stdout:Downgrade 12 Packages 2023-11-16T13:50:25.235 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:50:25.235 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 51 M 2023-11-16T13:50:25.235 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2023-11-16T13:50:25.331 INFO:teuthology.orchestra.run.smithi067.stdout:(1/19): libslirp-4.3.1-1.module+el8.4.0+11818+3 726 kB/s | 69 kB 00:00 2023-11-16T13:50:25.350 INFO:teuthology.orchestra.run.smithi067.stdout:(2/19): container-selinux-2.167.0-1.module+el8. 452 kB/s | 52 kB 00:00 2023-11-16T13:50:25.418 INFO:teuthology.orchestra.run.smithi067.stdout:(3/19): criu-3.15-1.module+el8.4.0+11818+341460 5.8 MB/s | 511 kB 00:00 2023-11-16T13:50:25.506 INFO:teuthology.orchestra.run.smithi067.stdout:(4/19): runc-1.0.0-72.rc92.module+el8.4.0+12507 20 MB/s | 3.1 MB 00:00 2023-11-16T13:50:25.564 INFO:teuthology.orchestra.run.smithi067.stdout:(5/19): conmon-2.0.26-1.module+el8.4.0+11818+34 349 kB/s | 51 kB 00:00 2023-11-16T13:50:25.587 INFO:teuthology.orchestra.run.smithi067.stdout:(6/19): podman-docker-3.0.1-7.module+el8.4.0+12 690 kB/s | 56 kB 00:00 2023-11-16T13:50:25.719 INFO:teuthology.orchestra.run.smithi067.stdout:(7/19): containernetworking-plugins-0.9.1-1.mod 42 MB/s | 20 MB 00:00 2023-11-16T13:50:25.720 INFO:teuthology.orchestra.run.smithi067.stdout:(8/19): slirp4netns-1.1.8-1.module+el8.4.0+1181 329 kB/s | 51 kB 00:00 2023-11-16T13:50:25.721 INFO:teuthology.orchestra.run.smithi067.stdout:(9/19): fuse-overlayfs-1.4.0-2.module+el8.4.0+1 538 kB/s | 72 kB 00:00 2023-11-16T13:50:25.852 INFO:teuthology.orchestra.run.smithi067.stdout:(10/19): podman-catatonit-3.0.1-7.module+el8.4. 2.4 MB/s | 320 kB 00:00 2023-11-16T13:50:25.876 INFO:teuthology.orchestra.run.smithi067.stdout:(11/19): containers-common-1.2.2-8.module+el8.4 589 kB/s | 91 kB 00:00 2023-11-16T13:50:25.926 INFO:teuthology.orchestra.run.smithi067.stdout:(12/19): yajl-2.1.0-10.el8.x86_64.rpm 551 kB/s | 41 kB 00:00 2023-11-16T13:50:25.963 INFO:teuthology.orchestra.run.smithi067.stdout:(13/19): podman-3.0.1-7.module+el8.4.0+12906+0c 49 MB/s | 12 MB 00:00 2023-11-16T13:50:26.023 INFO:teuthology.orchestra.run.smithi067.stdout:(14/19): udica-0.2.4-1.module+el8.4.0+11818+341 346 kB/s | 51 kB 00:00 2023-11-16T13:50:26.072 INFO:teuthology.orchestra.run.smithi067.stdout:(15/19): cockpit-podman-29-2.module+el8.4.0+118 9.8 MB/s | 1.1 MB 00:00 2023-11-16T13:50:26.149 INFO:teuthology.orchestra.run.smithi067.stdout:(16/19): buildah-1.19.7-1.module+el8.4.0+11818+ 33 MB/s | 7.4 MB 00:00 2023-11-16T13:50:26.158 INFO:teuthology.orchestra.run.smithi067.stdout:(17/19): crun-0.18-2.module+el8.4.0+11818+34146 2.1 MB/s | 185 kB 00:00 2023-11-16T13:50:26.229 INFO:teuthology.orchestra.run.smithi067.stdout:(18/19): skopeo-1.2.2-8.module+el8.4.0+11818+34 31 MB/s | 6.3 MB 00:00 2023-11-16T13:50:26.286 INFO:teuthology.orchestra.run.smithi067.stdout:(19/19): toolbox-0.0.8-1.module+el8.4.0+11818+3 116 kB/s | 16 kB 00:00 2023-11-16T13:50:26.287 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2023-11-16T13:50:26.287 INFO:teuthology.orchestra.run.smithi067.stdout:Total 49 MB/s | 51 MB 00:01 2023-11-16T13:50:26.304 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction check 2023-11-16T13:50:26.351 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction check succeeded. 2023-11-16T13:50:26.351 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction test 2023-11-16T13:50:27.188 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction test succeeded. 2023-11-16T13:50:27.192 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction 2023-11-16T13:50:28.441 INFO:teuthology.orchestra.run.smithi067.stdout: Preparing : 1/1 2023-11-16T13:50:28.509 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: fuse-overlayfs-1.4.0-2.module+el8.4.0+11818+341460ad 1/1 2023-11-16T13:50:28.753 INFO:teuthology.orchestra.run.smithi067.stdout: Downgrading : fuse-overlayfs-1.4.0-2.module+el8.4.0+11818+341460 1/31 2023-11-16T13:50:28.763 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: fuse-overlayfs-1.4.0-2.module+el8.4.0+11818+341460 1/31 2023-11-16T13:50:28.779 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: container-selinux-2:2.167.0-1.module+el8.4.0+12448 2/31 2023-11-16T13:50:29.061 INFO:teuthology.orchestra.run.smithi067.stdout: Downgrading : container-selinux-2:2.167.0-1.module+el8.4.0+12448 2/31 2023-11-16T13:50:45.455 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: container-selinux-2:2.167.0-1.module+el8.4.0+12448 2/31 2023-11-16T13:50:45.674 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : yajl-2.1.0-10.el8.x86_64 3/31 2023-11-16T13:50:45.883 INFO:teuthology.orchestra.run.smithi067.stdout: Downgrading : conmon-2:2.0.26-1.module+el8.4.0+11818+341460ad.x8 4/31 2023-11-16T13:50:46.469 INFO:teuthology.orchestra.run.smithi067.stdout: Downgrading : criu-3.15-1.module+el8.4.0+11818+341460ad.x86_64 5/31 2023-11-16T13:50:46.703 INFO:teuthology.orchestra.run.smithi067.stdout: Downgrading : runc-1.0.0-72.rc92.module+el8.4.0+12507+7f8c8fd7.x 6/31 2023-11-16T13:50:46.920 INFO:teuthology.orchestra.run.smithi067.stdout: Downgrading : libslirp-4.3.1-1.module+el8.4.0+11818+341460ad.x86 7/31 2023-11-16T13:50:47.189 INFO:teuthology.orchestra.run.smithi067.stdout: Downgrading : slirp4netns-1.1.8-1.module+el8.4.0+11818+341460ad. 8/31 2023-11-16T13:50:47.189 INFO:teuthology.orchestra.run.smithi067.stdout: Downgrading : containers-common-1:1.2.2-8.module+el8.4.0+11818+3 9/31 2023-11-16T13:50:47.189 INFO:teuthology.orchestra.run.smithi067.stdout:warning: /etc/containers/registries.conf created as /etc/containers/registries.conf.rpmnew 2023-11-16T13:50:47.189 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:50:49.688 INFO:teuthology.orchestra.run.smithi067.stdout: Downgrading : containernetworking-plugins-0.9.1-1.module+el8.4.0 10/31 2023-11-16T13:50:51.407 INFO:teuthology.orchestra.run.smithi067.stdout: Downgrading : podman-catatonit-3.0.1-7.module+el8.4.0+12906+0cce 11/31 2023-11-16T13:50:51.724 INFO:teuthology.orchestra.run.smithi067.stdout: Downgrading : podman-3.0.1-7.module+el8.4.0+12906+0cce23da.x86_6 12/31 2023-11-16T13:50:52.004 INFO:teuthology.orchestra.run.smithi067.stdout: Downgrading : podman-docker-3.0.1-7.module+el8.4.0+12906+0cce23d 13/31 2023-11-16T13:50:52.170 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : cockpit-podman-29-2.module+el8.4.0+11818+341460ad. 14/31 2023-11-16T13:50:52.985 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : toolbox-0.0.8-1.module+el8.4.0+11818+341460ad.noar 15/31 2023-11-16T13:50:53.780 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : buildah-1.19.7-1.module+el8.4.0+11818+341460ad.x86 16/31 2023-11-16T13:50:53.993 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : skopeo-1:1.2.2-8.module+el8.4.0+11818+341460ad.x86 17/31 2023-11-16T13:50:54.222 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : crun-0.18-2.module+el8.4.0+11818+341460ad.x86_64 18/31 2023-11-16T13:50:54.418 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : udica-0.2.4-1.module+el8.4.0+11818+341460ad.noarch 19/31 2023-11-16T13:50:54.535 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : podman-catatonit-3.2.3-0.11.module+el8.4.0+12050+e 20/31 2023-11-16T13:50:54.682 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : podman-docker-3.2.3-0.11.module+el8.4.0+12050+ef97 21/31 2023-11-16T13:50:54.901 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : podman-3.2.3-0.11.module+el8.4.0+12050+ef972f71.x8 22/31 2023-11-16T13:50:55.099 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : containers-common-1:1.3.1-5.module+el8.4.0+11990+2 23/31 2023-11-16T13:50:55.099 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : container-selinux-2:2.167.0-1.module+el8.4.0+12646 24/31 2023-11-16T13:50:55.236 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: container-selinux-2:2.167.0-1.module+el8.4.0+12646 24/31 2023-11-16T13:50:55.566 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : slirp4netns-1.1.8-1.module+el8.4.0+11822+6cc1e7d7. 25/31 2023-11-16T13:50:55.751 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : runc-1.0.0-74.rc95.module+el8.4.0+11822+6cc1e7d7.x 26/31 2023-11-16T13:50:55.969 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : criu-3.15-1.module+el8.4.0+11822+6cc1e7d7.x86_64 27/31 2023-11-16T13:50:56.151 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : libslirp-4.3.1-1.module+el8.4.0+11822+6cc1e7d7.x86 28/31 2023-11-16T13:50:56.292 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : fuse-overlayfs-1.6-1.module+el8.4.0+11822+6cc1e7d7 29/31 2023-11-16T13:50:56.462 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : conmon-2:2.0.29-1.module+el8.4.0+11822+6cc1e7d7.x8 30/31 2023-11-16T13:50:56.650 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : containernetworking-plugins-0.9.1-1.module+el8.4.0 31/31 2023-11-16T13:50:57.113 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: container-selinux-2:2.167.0-1.module+el8.4.0+12448 31/31 2023-11-16T13:50:57.728 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: containernetworking-plugins-0.9.1-1.module+el8.4.0 31/31 2023-11-16T13:50:57.728 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : container-selinux-2:2.167.0-1.module+el8.4.0+12448 1/31 2023-11-16T13:50:57.729 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : container-selinux-2:2.167.0-1.module+el8.4.0+12646 2/31 2023-11-16T13:50:57.729 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : containernetworking-plugins-0.9.1-1.module+el8.4.0 3/31 2023-11-16T13:50:57.729 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : containernetworking-plugins-0.9.1-1.module+el8.4.0 4/31 2023-11-16T13:50:57.729 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libslirp-4.3.1-1.module+el8.4.0+11818+341460ad.x86 5/31 2023-11-16T13:50:57.729 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libslirp-4.3.1-1.module+el8.4.0+11822+6cc1e7d7.x86 6/31 2023-11-16T13:50:57.729 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : criu-3.15-1.module+el8.4.0+11818+341460ad.x86_64 7/31 2023-11-16T13:50:57.729 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : criu-3.15-1.module+el8.4.0+11822+6cc1e7d7.x86_64 8/31 2023-11-16T13:50:57.729 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : runc-1.0.0-72.rc92.module+el8.4.0+12507+7f8c8fd7.x 9/31 2023-11-16T13:50:57.729 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : runc-1.0.0-74.rc95.module+el8.4.0+11822+6cc1e7d7.x 10/31 2023-11-16T13:50:57.729 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : conmon-2:2.0.26-1.module+el8.4.0+11818+341460ad.x8 11/31 2023-11-16T13:50:57.729 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : conmon-2:2.0.29-1.module+el8.4.0+11822+6cc1e7d7.x8 12/31 2023-11-16T13:50:57.729 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : podman-docker-3.0.1-7.module+el8.4.0+12906+0cce23d 13/31 2023-11-16T13:50:57.730 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : podman-docker-3.2.3-0.11.module+el8.4.0+12050+ef97 14/31 2023-11-16T13:50:57.730 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : slirp4netns-1.1.8-1.module+el8.4.0+11818+341460ad. 15/31 2023-11-16T13:50:57.730 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : slirp4netns-1.1.8-1.module+el8.4.0+11822+6cc1e7d7. 16/31 2023-11-16T13:50:57.730 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : fuse-overlayfs-1.4.0-2.module+el8.4.0+11818+341460 17/31 2023-11-16T13:50:57.730 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : fuse-overlayfs-1.6-1.module+el8.4.0+11822+6cc1e7d7 18/31 2023-11-16T13:50:57.730 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : podman-catatonit-3.0.1-7.module+el8.4.0+12906+0cce 19/31 2023-11-16T13:50:57.730 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : podman-catatonit-3.2.3-0.11.module+el8.4.0+12050+e 20/31 2023-11-16T13:50:57.730 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : podman-3.0.1-7.module+el8.4.0+12906+0cce23da.x86_6 21/31 2023-11-16T13:50:57.730 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : podman-3.2.3-0.11.module+el8.4.0+12050+ef972f71.x8 22/31 2023-11-16T13:50:57.730 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : containers-common-1:1.2.2-8.module+el8.4.0+11818+3 23/31 2023-11-16T13:50:57.730 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : containers-common-1:1.3.1-5.module+el8.4.0+11990+2 24/31 2023-11-16T13:50:57.730 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 25/31 2023-11-16T13:50:57.731 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : udica-0.2.4-1.module+el8.4.0+11818+341460ad.noarch 26/31 2023-11-16T13:50:57.731 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : buildah-1.19.7-1.module+el8.4.0+11818+341460ad.x86 27/31 2023-11-16T13:50:57.731 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : cockpit-podman-29-2.module+el8.4.0+11818+341460ad. 28/31 2023-11-16T13:50:57.731 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : skopeo-1:1.2.2-8.module+el8.4.0+11818+341460ad.x86 29/31 2023-11-16T13:50:57.731 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : crun-0.18-2.module+el8.4.0+11818+341460ad.x86_64 30/31 2023-11-16T13:50:59.223 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : toolbox-0.0.8-1.module+el8.4.0+11818+341460ad.noar 31/31 2023-11-16T13:50:59.223 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:02:39 ago on Thu 16 Nov 2023 01:48:19 PM UTC. 2023-11-16T13:51:03.073 INFO:teuthology.orchestra.run.smithi067.stdout:Installed products updated. 2023-11-16T13:51:03.199 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:51:03.199 INFO:teuthology.orchestra.run.smithi067.stdout:Downgraded: 2023-11-16T13:51:03.199 INFO:teuthology.orchestra.run.smithi067.stdout: conmon-2:2.0.26-1.module+el8.4.0+11818+341460ad.x86_64 2023-11-16T13:51:03.199 INFO:teuthology.orchestra.run.smithi067.stdout: container-selinux-2:2.167.0-1.module+el8.4.0+12448+09f02219.noarch 2023-11-16T13:51:03.199 INFO:teuthology.orchestra.run.smithi067.stdout: containernetworking-plugins-0.9.1-1.module+el8.4.0+11818+341460ad.x86_64 2023-11-16T13:51:03.199 INFO:teuthology.orchestra.run.smithi067.stdout: containers-common-1:1.2.2-8.module+el8.4.0+11818+341460ad.x86_64 2023-11-16T13:51:03.200 INFO:teuthology.orchestra.run.smithi067.stdout: criu-3.15-1.module+el8.4.0+11818+341460ad.x86_64 2023-11-16T13:51:03.200 INFO:teuthology.orchestra.run.smithi067.stdout: fuse-overlayfs-1.4.0-2.module+el8.4.0+11818+341460ad.x86_64 2023-11-16T13:51:03.200 INFO:teuthology.orchestra.run.smithi067.stdout: libslirp-4.3.1-1.module+el8.4.0+11818+341460ad.x86_64 2023-11-16T13:51:03.200 INFO:teuthology.orchestra.run.smithi067.stdout: podman-3.0.1-7.module+el8.4.0+12906+0cce23da.x86_64 2023-11-16T13:51:03.200 INFO:teuthology.orchestra.run.smithi067.stdout: podman-catatonit-3.0.1-7.module+el8.4.0+12906+0cce23da.x86_64 2023-11-16T13:51:03.200 INFO:teuthology.orchestra.run.smithi067.stdout: podman-docker-3.0.1-7.module+el8.4.0+12906+0cce23da.noarch 2023-11-16T13:51:03.200 INFO:teuthology.orchestra.run.smithi067.stdout: runc-1.0.0-72.rc92.module+el8.4.0+12507+7f8c8fd7.x86_64 2023-11-16T13:51:03.200 INFO:teuthology.orchestra.run.smithi067.stdout: slirp4netns-1.1.8-1.module+el8.4.0+11818+341460ad.x86_64 2023-11-16T13:51:03.200 INFO:teuthology.orchestra.run.smithi067.stdout:Installed: 2023-11-16T13:51:03.201 INFO:teuthology.orchestra.run.smithi067.stdout: buildah-1.19.7-1.module+el8.4.0+11818+341460ad.x86_64 2023-11-16T13:51:03.201 INFO:teuthology.orchestra.run.smithi067.stdout: cockpit-podman-29-2.module+el8.4.0+11818+341460ad.noarch 2023-11-16T13:51:03.201 INFO:teuthology.orchestra.run.smithi067.stdout: crun-0.18-2.module+el8.4.0+11818+341460ad.x86_64 2023-11-16T13:51:03.201 INFO:teuthology.orchestra.run.smithi067.stdout: skopeo-1:1.2.2-8.module+el8.4.0+11818+341460ad.x86_64 2023-11-16T13:51:03.201 INFO:teuthology.orchestra.run.smithi067.stdout: toolbox-0.0.8-1.module+el8.4.0+11818+341460ad.noarch 2023-11-16T13:51:03.201 INFO:teuthology.orchestra.run.smithi067.stdout: udica-0.2.4-1.module+el8.4.0+11818+341460ad.noarch 2023-11-16T13:51:03.201 INFO:teuthology.orchestra.run.smithi067.stdout: yajl-2.1.0-10.el8.x86_64 2023-11-16T13:51:03.201 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:51:03.201 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2023-11-16T13:51:03.379 DEBUG:teuthology.parallel:result is None 2023-11-16T13:51:03.379 INFO:teuthology.run_tasks:Running task install... 2023-11-16T13:51:03.388 DEBUG:teuthology.task.install:project ceph 2023-11-16T13:51:03.389 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'ae6ce92c0812ba06c9c623ce72df4f3fc59080b4'}} 2023-11-16T13:51:03.389 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'ae6ce92c0812ba06c9c623ce72df4f3fc59080b4'} 2023-11-16T13:51:03.389 INFO:teuthology.task.install:Using flavor: default 2023-11-16T13:51:03.396 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-11-16T13:51:03.397 INFO:teuthology.task.install:extra packages: [] 2023-11-16T13:51:03.397 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ae6ce92c0812ba06c9c623ce72df4f3fc59080b4', 'tag': None, 'wait_for_package': False} 2023-11-16T13:51:03.398 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ae6ce92c0812ba06c9c623ce72df4f3fc59080b4 2023-11-16T13:51:03.671 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-63555-quincy/ae6ce92c0812ba06c9c623ce72df4f3fc59080b4/centos/8/flavors/default/ 2023-11-16T13:51:03.671 INFO:teuthology.task.install.rpm:Package version is 17.2.7-68.gae6ce92c 2023-11-16T13:51:03.782 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-63555-quincy/ae6ce92c0812ba06c9c623ce72df4f3fc59080b4/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-63555-quincy/ae6ce92c0812ba06c9c623ce72df4f3fc59080b4/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-63555-quincy/ae6ce92c0812ba06c9c623ce72df4f3fc59080b4/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-11-16T13:51:03.782 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-11-16T13:51:03.782 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-11-16T13:51:03.808 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-11-16T13:51:03.808 DEBUG:teuthology.orchestra.run.smithi067:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/ae6ce92c0812ba06c9c623ce72df4f3fc59080b4/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-11-16T13:51:03.875 DEBUG:teuthology.orchestra.run.smithi067:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-11-16T13:51:03.952 DEBUG:teuthology.orchestra.run.smithi067:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-11-16T13:51:04.016 INFO:teuthology.orchestra.run.smithi067.stdout:check_obsoletes = 1 2023-11-16T13:51:04.018 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum clean all 2023-11-16T13:51:04.429 INFO:teuthology.orchestra.run.smithi067.stdout:Updating Subscription Management repositories. 2023-11-16T13:51:05.749 INFO:teuthology.orchestra.run.smithi067.stdout:44 files removed 2023-11-16T13:51:05.809 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install ceph-radosgw 2023-11-16T13:51:06.179 INFO:teuthology.orchestra.run.smithi067.stdout:Updating Subscription Management repositories. 2023-11-16T13:51:07.971 INFO:teuthology.orchestra.run.smithi067.stdout:ceph packages for x86_64 200 kB/s | 78 kB 00:00 2023-11-16T13:51:08.323 INFO:teuthology.orchestra.run.smithi067.stdout:ceph noarch packages 30 kB/s | 9.2 kB 00:00 2023-11-16T13:51:08.638 INFO:teuthology.orchestra.run.smithi067.stdout:ceph source packages 5.1 kB/s | 1.4 kB 00:00 2023-11-16T13:51:08.749 INFO:teuthology.orchestra.run.smithi067.stdout:Copr repo for python3-asyncssh owned by ceph 43 kB/s | 3.5 kB 00:00 2023-11-16T13:51:10.146 INFO:teuthology.orchestra.run.smithi067.stdout:Extra Packages for Enterprise Linux 12 MB/s | 16 MB 00:01 2023-11-16T13:51:13.799 INFO:teuthology.orchestra.run.smithi067.stdout:lab-extras 4.5 MB/s | 24 kB 00:00 2023-11-16T13:51:14.722 INFO:teuthology.orchestra.run.smithi067.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 46 MB/s | 38 MB 00:00 2023-11-16T13:51:20.946 INFO:teuthology.orchestra.run.smithi067.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 49 MB/s | 33 MB 00:00 2023-11-16T13:51:29.867 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2023-11-16T13:51:29.870 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================================== 2023-11-16T13:51:29.870 INFO:teuthology.orchestra.run.smithi067.stdout: Package Arch Version Repository Size 2023-11-16T13:51:29.870 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================================== 2023-11-16T13:51:29.870 INFO:teuthology.orchestra.run.smithi067.stdout:Installing: 2023-11-16T13:51:29.870 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-radosgw x86_64 2:17.2.7-68.gae6ce92c.el8 ceph 17 M 2023-11-16T13:51:29.870 INFO:teuthology.orchestra.run.smithi067.stdout:Upgrading: 2023-11-16T13:51:29.870 INFO:teuthology.orchestra.run.smithi067.stdout: librados2 x86_64 2:17.2.7-68.gae6ce92c.el8 ceph 3.5 M 2023-11-16T13:51:29.870 INFO:teuthology.orchestra.run.smithi067.stdout: librbd1 x86_64 2:17.2.7-68.gae6ce92c.el8 ceph 3.6 M 2023-11-16T13:51:29.870 INFO:teuthology.orchestra.run.smithi067.stdout:Installing dependencies: 2023-11-16T13:51:29.870 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-base x86_64 2:17.2.7-68.gae6ce92c.el8 ceph 5.2 M 2023-11-16T13:51:29.871 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-common x86_64 2:17.2.7-68.gae6ce92c.el8 ceph 23 M 2023-11-16T13:51:29.871 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-selinux x86_64 2:17.2.7-68.gae6ce92c.el8 ceph 24 k 2023-11-16T13:51:29.871 INFO:teuthology.orchestra.run.smithi067.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-11-16T13:51:29.871 INFO:teuthology.orchestra.run.smithi067.stdout: libcephfs2 x86_64 2:17.2.7-68.gae6ce92c.el8 ceph 796 k 2023-11-16T13:51:29.871 INFO:teuthology.orchestra.run.smithi067.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-11-16T13:51:29.871 INFO:teuthology.orchestra.run.smithi067.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-11-16T13:51:29.871 INFO:teuthology.orchestra.run.smithi067.stdout: libradosstriper1 x86_64 2:17.2.7-68.gae6ce92c.el8 ceph 507 k 2023-11-16T13:51:29.871 INFO:teuthology.orchestra.run.smithi067.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-11-16T13:51:29.871 INFO:teuthology.orchestra.run.smithi067.stdout: librgw2 x86_64 2:17.2.7-68.gae6ce92c.el8 ceph 5.6 M 2023-11-16T13:51:29.871 INFO:teuthology.orchestra.run.smithi067.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-11-16T13:51:29.871 INFO:teuthology.orchestra.run.smithi067.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-11-16T13:51:29.871 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ceph-argparse x86_64 2:17.2.7-68.gae6ce92c.el8 ceph 45 k 2023-11-16T13:51:29.871 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ceph-common x86_64 2:17.2.7-68.gae6ce92c.el8 ceph 115 k 2023-11-16T13:51:29.872 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cephfs x86_64 2:17.2.7-68.gae6ce92c.el8 ceph 190 k 2023-11-16T13:51:29.872 INFO:teuthology.orchestra.run.smithi067.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-11-16T13:51:29.872 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rados x86_64 2:17.2.7-68.gae6ce92c.el8 ceph 370 k 2023-11-16T13:51:29.872 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rbd x86_64 2:17.2.7-68.gae6ce92c.el8 ceph 358 k 2023-11-16T13:51:29.872 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rgw x86_64 2:17.2.7-68.gae6ce92c.el8 ceph 107 k 2023-11-16T13:51:29.872 INFO:teuthology.orchestra.run.smithi067.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-11-16T13:51:29.872 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:51:29.872 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2023-11-16T13:51:29.872 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================================== 2023-11-16T13:51:29.872 INFO:teuthology.orchestra.run.smithi067.stdout:Install 21 Packages 2023-11-16T13:51:29.872 INFO:teuthology.orchestra.run.smithi067.stdout:Upgrade 2 Packages 2023-11-16T13:51:29.872 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:51:29.873 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 63 M 2023-11-16T13:51:29.873 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2023-11-16T13:51:30.910 INFO:teuthology.orchestra.run.smithi067.stdout:(1/23): ceph-base-17.2.7-68.gae6ce92c.el8.x86_6 5.3 MB/s | 5.2 MB 00:00 2023-11-16T13:51:30.931 INFO:teuthology.orchestra.run.smithi067.stdout:(2/23): ceph-selinux-17.2.7-68.gae6ce92c.el8.x8 1.1 MB/s | 24 kB 00:00 2023-11-16T13:51:30.986 INFO:teuthology.orchestra.run.smithi067.stdout:(3/23): libcephfs2-17.2.7-68.gae6ce92c.el8.x86_ 14 MB/s | 796 kB 00:00 2023-11-16T13:51:31.029 INFO:teuthology.orchestra.run.smithi067.stdout:(4/23): libradosstriper1-17.2.7-68.gae6ce92c.el 12 MB/s | 507 kB 00:00 2023-11-16T13:51:31.473 INFO:teuthology.orchestra.run.smithi067.stdout:(5/23): librgw2-17.2.7-68.gae6ce92c.el8.x86_64. 13 MB/s | 5.6 MB 00:00 2023-11-16T13:51:31.507 INFO:teuthology.orchestra.run.smithi067.stdout:(6/23): python3-ceph-argparse-17.2.7-68.gae6ce9 1.3 MB/s | 45 kB 00:00 2023-11-16T13:51:31.551 INFO:teuthology.orchestra.run.smithi067.stdout:(7/23): python3-ceph-common-17.2.7-68.gae6ce92c 2.6 MB/s | 115 kB 00:00 2023-11-16T13:51:31.580 INFO:teuthology.orchestra.run.smithi067.stdout:(8/23): python3-cephfs-17.2.7-68.gae6ce92c.el8. 6.4 MB/s | 190 kB 00:00 2023-11-16T13:51:31.614 INFO:teuthology.orchestra.run.smithi067.stdout:(9/23): python3-rados-17.2.7-68.gae6ce92c.el8.x 11 MB/s | 370 kB 00:00 2023-11-16T13:51:31.653 INFO:teuthology.orchestra.run.smithi067.stdout:(10/23): python3-rbd-17.2.7-68.gae6ce92c.el8.x8 9.0 MB/s | 358 kB 00:00 2023-11-16T13:51:31.691 INFO:teuthology.orchestra.run.smithi067.stdout:(11/23): python3-rgw-17.2.7-68.gae6ce92c.el8.x8 2.9 MB/s | 107 kB 00:00 2023-11-16T13:51:32.260 INFO:teuthology.orchestra.run.smithi067.stdout:(12/23): gperftools-libs-2.7-9.el8.x86_64.rpm 536 kB/s | 306 kB 00:00 2023-11-16T13:51:32.347 INFO:teuthology.orchestra.run.smithi067.stdout:(13/23): liboath-2.6.2-3.el8.x86_64.rpm 682 kB/s | 59 kB 00:00 2023-11-16T13:51:32.436 INFO:teuthology.orchestra.run.smithi067.stdout:(14/23): libunwind-1.3.1-3.el8.x86_64.rpm 844 kB/s | 75 kB 00:00 2023-11-16T13:51:32.606 INFO:teuthology.orchestra.run.smithi067.stdout:(15/23): ceph-common-17.2.7-68.gae6ce92c.el8.x8 8.8 MB/s | 23 MB 00:02 2023-11-16T13:51:32.703 INFO:teuthology.orchestra.run.smithi067.stdout:(16/23): ceph-radosgw-17.2.7-68.gae6ce92c.el8.x 6.1 MB/s | 17 MB 00:02 2023-11-16T13:51:32.802 INFO:teuthology.orchestra.run.smithi067.stdout:(17/23): thrift-0.13.0-2.el8.x86_64.rpm 4.8 MB/s | 1.7 MB 00:00 2023-11-16T13:51:32.931 INFO:teuthology.orchestra.run.smithi067.stdout:(18/23): librabbitmq-0.9.0-3.el8.x86_64.rpm 144 kB/s | 47 kB 00:00 2023-11-16T13:51:33.213 INFO:teuthology.orchestra.run.smithi067.stdout:(19/23): python3-prettytable-0.7.2-14.el8.noarc 88 kB/s | 44 kB 00:00 2023-11-16T13:51:33.381 INFO:teuthology.orchestra.run.smithi067.stdout:(20/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 447 kB/s | 259 kB 00:00 2023-11-16T13:51:33.383 INFO:teuthology.orchestra.run.smithi067.stdout:(21/23): librdkafka-0.11.4-1.el8.x86_64.rpm 781 kB/s | 353 kB 00:00 2023-11-16T13:51:33.480 INFO:teuthology.orchestra.run.smithi067.stdout:(22/23): librados2-17.2.7-68.gae6ce92c.el8.x86_ 13 MB/s | 3.5 MB 00:00 2023-11-16T13:51:33.617 INFO:teuthology.orchestra.run.smithi067.stdout:(23/23): librbd1-17.2.7-68.gae6ce92c.el8.x86_64 15 MB/s | 3.6 MB 00:00 2023-11-16T13:51:33.621 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2023-11-16T13:51:33.622 INFO:teuthology.orchestra.run.smithi067.stdout:Total 17 MB/s | 63 MB 00:03 2023-11-16T13:51:33.626 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction check 2023-11-16T13:51:33.675 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction check succeeded. 2023-11-16T13:51:33.676 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction test 2023-11-16T13:51:34.084 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction test succeeded. 2023-11-16T13:51:34.088 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction 2023-11-16T13:51:35.400 INFO:teuthology.orchestra.run.smithi067.stdout: Preparing : 1/1 2023-11-16T13:51:41.344 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 1/25 2023-11-16T13:51:41.369 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 1/25 2023-11-16T13:51:41.369 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : librados2-2:17.2.7-68.gae6ce92c.el8.x86_64 2/25 2023-11-16T13:51:41.369 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librados2-2:17.2.7-68.gae6ce92c.el8.x86_64 2/25 2023-11-16T13:51:41.369 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-rados-2:17.2.7-68.gae6ce92c.el8.x86_64 3/25 2023-11-16T13:51:41.369 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : liboath-2.6.2-3.el8.x86_64 4/25 2023-11-16T13:51:41.369 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libcephfs2-2:17.2.7-68.gae6ce92c.el8.x86_64 5/25 2023-11-16T13:51:41.369 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: libcephfs2-2:17.2.7-68.gae6ce92c.el8.x86_64 5/25 2023-11-16T13:51:41.369 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : librbd1-2:17.2.7-68.gae6ce92c.el8.x86_64 6/25 2023-11-16T13:51:41.369 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librbd1-2:17.2.7-68.gae6ce92c.el8.x86_64 6/25 2023-11-16T13:51:41.370 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 7/25 2023-11-16T13:51:41.370 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 7/25 2023-11-16T13:51:41.370 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 8/25 2023-11-16T13:51:41.370 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/25 2023-11-16T13:51:41.370 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : librgw2-2:17.2.7-68.gae6ce92c.el8.x86_64 10/25 2023-11-16T13:51:41.370 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librgw2-2:17.2.7-68.gae6ce92c.el8.x86_64 10/25 2023-11-16T13:51:41.370 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-ceph-argparse-2:17.2.7-68.gae6ce92c.el8.x8 11/25 2023-11-16T13:51:41.370 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cephfs-2:17.2.7-68.gae6ce92c.el8.x86_64 12/25 2023-11-16T13:51:41.370 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-rgw-2:17.2.7-68.gae6ce92c.el8.x86_64 13/25 2023-11-16T13:51:41.370 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-rbd-2:17.2.7-68.gae6ce92c.el8.x86_64 14/25 2023-11-16T13:51:41.370 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libradosstriper1-2:17.2.7-68.gae6ce92c.el8.x86_64 15/25 2023-11-16T13:51:41.370 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: libradosstriper1-2:17.2.7-68.gae6ce92c.el8.x86_64 15/25 2023-11-16T13:51:41.371 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 16/25 2023-11-16T13:51:41.371 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 17/25 2023-11-16T13:51:41.371 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2023-11-16T13:51:41.371 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-ceph-common-2:17.2.7-68.gae6ce92c.el8.x86_ 19/25 2023-11-16T13:51:47.100 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-common-2:17.2.7-68.gae6ce92c.el8.x86_64 20/25 2023-11-16T13:51:47.319 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-common-2:17.2.7-68.gae6ce92c.el8.x86_64 20/25 2023-11-16T13:51:48.092 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-common-2:17.2.7-68.gae6ce92c.el8.x86_64 20/25 2023-11-16T13:51:48.469 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-base-2:17.2.7-68.gae6ce92c.el8.x86_64 21/25 2023-11-16T13:51:48.588 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-base-2:17.2.7-68.gae6ce92c.el8.x86_64 21/25 2023-11-16T13:51:48.752 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-selinux-2:17.2.7-68.gae6ce92c.el8.x86_64 22/25 2023-11-16T13:52:07.272 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-selinux-2:17.2.7-68.gae6ce92c.el8.x86_64 22/25 2023-11-16T13:52:07.273 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /sys 2023-11-16T13:52:07.273 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /proc 2023-11-16T13:52:07.273 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /dev 2023-11-16T13:52:07.273 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /run 2023-11-16T13:52:07.273 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /mnt 2023-11-16T13:52:07.273 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /var/tmp 2023-11-16T13:52:07.273 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /home 2023-11-16T13:52:07.273 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /tmp 2023-11-16T13:52:07.273 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /dev 2023-11-16T13:52:07.273 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:52:09.079 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-radosgw-2:17.2.7-68.gae6ce92c.el8.x86_64 23/25 2023-11-16T13:52:09.165 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-68.gae6ce92c.el8.x86_64 23/25 2023-11-16T13:52:09.165 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-11-16T13:52:09.385 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-11-16T13:52:09.385 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2023-11-16T13:52:10.175 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2023-11-16T13:52:10.175 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-base-2:17.2.7-68.gae6ce92c.el8.x86_64 1/25 2023-11-16T13:52:10.175 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-common-2:17.2.7-68.gae6ce92c.el8.x86_64 2/25 2023-11-16T13:52:10.176 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-radosgw-2:17.2.7-68.gae6ce92c.el8.x86_64 3/25 2023-11-16T13:52:10.176 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-selinux-2:17.2.7-68.gae6ce92c.el8.x86_64 4/25 2023-11-16T13:52:10.176 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libcephfs2-2:17.2.7-68.gae6ce92c.el8.x86_64 5/25 2023-11-16T13:52:10.176 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libradosstriper1-2:17.2.7-68.gae6ce92c.el8.x86_64 6/25 2023-11-16T13:52:10.176 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librgw2-2:17.2.7-68.gae6ce92c.el8.x86_64 7/25 2023-11-16T13:52:10.177 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-ceph-argparse-2:17.2.7-68.gae6ce92c.el8.x8 8/25 2023-11-16T13:52:10.178 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-ceph-common-2:17.2.7-68.gae6ce92c.el8.x86_ 9/25 2023-11-16T13:52:10.178 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cephfs-2:17.2.7-68.gae6ce92c.el8.x86_64 10/25 2023-11-16T13:52:10.178 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-rados-2:17.2.7-68.gae6ce92c.el8.x86_64 11/25 2023-11-16T13:52:10.178 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-rbd-2:17.2.7-68.gae6ce92c.el8.x86_64 12/25 2023-11-16T13:52:10.178 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-rgw-2:17.2.7-68.gae6ce92c.el8.x86_64 13/25 2023-11-16T13:52:10.179 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 14/25 2023-11-16T13:52:10.179 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 15/25 2023-11-16T13:52:10.179 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 16/25 2023-11-16T13:52:10.179 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 17/25 2023-11-16T13:52:10.179 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 18/25 2023-11-16T13:52:10.179 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 19/25 2023-11-16T13:52:10.180 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 20/25 2023-11-16T13:52:10.181 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 21/25 2023-11-16T13:52:10.182 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librados2-2:17.2.7-68.gae6ce92c.el8.x86_64 22/25 2023-11-16T13:52:10.182 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2023-11-16T13:52:10.182 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librbd1-2:17.2.7-68.gae6ce92c.el8.x86_64 24/25 2023-11-16T13:52:11.693 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2023-11-16T13:52:11.694 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:00:51 ago on Thu 16 Nov 2023 01:51:20 PM UTC. 2023-11-16T13:52:15.523 INFO:teuthology.orchestra.run.smithi067.stdout:Installed products updated. 2023-11-16T13:52:15.630 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:52:15.631 INFO:teuthology.orchestra.run.smithi067.stdout:Upgraded: 2023-11-16T13:52:15.631 INFO:teuthology.orchestra.run.smithi067.stdout: librados2-2:17.2.7-68.gae6ce92c.el8.x86_64 2023-11-16T13:52:15.631 INFO:teuthology.orchestra.run.smithi067.stdout: librbd1-2:17.2.7-68.gae6ce92c.el8.x86_64 2023-11-16T13:52:15.631 INFO:teuthology.orchestra.run.smithi067.stdout:Installed: 2023-11-16T13:52:15.631 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-base-2:17.2.7-68.gae6ce92c.el8.x86_64 2023-11-16T13:52:15.631 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-common-2:17.2.7-68.gae6ce92c.el8.x86_64 2023-11-16T13:52:15.631 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-radosgw-2:17.2.7-68.gae6ce92c.el8.x86_64 2023-11-16T13:52:15.631 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-selinux-2:17.2.7-68.gae6ce92c.el8.x86_64 2023-11-16T13:52:15.631 INFO:teuthology.orchestra.run.smithi067.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-11-16T13:52:15.631 INFO:teuthology.orchestra.run.smithi067.stdout: libcephfs2-2:17.2.7-68.gae6ce92c.el8.x86_64 2023-11-16T13:52:15.632 INFO:teuthology.orchestra.run.smithi067.stdout: liboath-2.6.2-3.el8.x86_64 2023-11-16T13:52:15.632 INFO:teuthology.orchestra.run.smithi067.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-11-16T13:52:15.632 INFO:teuthology.orchestra.run.smithi067.stdout: libradosstriper1-2:17.2.7-68.gae6ce92c.el8.x86_64 2023-11-16T13:52:15.632 INFO:teuthology.orchestra.run.smithi067.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-11-16T13:52:15.632 INFO:teuthology.orchestra.run.smithi067.stdout: librgw2-2:17.2.7-68.gae6ce92c.el8.x86_64 2023-11-16T13:52:15.632 INFO:teuthology.orchestra.run.smithi067.stdout: libunwind-1.3.1-3.el8.x86_64 2023-11-16T13:52:15.632 INFO:teuthology.orchestra.run.smithi067.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-11-16T13:52:15.632 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ceph-argparse-2:17.2.7-68.gae6ce92c.el8.x86_64 2023-11-16T13:52:15.632 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ceph-common-2:17.2.7-68.gae6ce92c.el8.x86_64 2023-11-16T13:52:15.632 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cephfs-2:17.2.7-68.gae6ce92c.el8.x86_64 2023-11-16T13:52:15.632 INFO:teuthology.orchestra.run.smithi067.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-11-16T13:52:15.633 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rados-2:17.2.7-68.gae6ce92c.el8.x86_64 2023-11-16T13:52:15.633 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rbd-2:17.2.7-68.gae6ce92c.el8.x86_64 2023-11-16T13:52:15.633 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rgw-2:17.2.7-68.gae6ce92c.el8.x86_64 2023-11-16T13:52:15.633 INFO:teuthology.orchestra.run.smithi067.stdout: thrift-0.13.0-2.el8.x86_64 2023-11-16T13:52:15.633 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:52:15.633 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2023-11-16T13:52:15.827 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install ceph-test 2023-11-16T13:52:16.216 INFO:teuthology.orchestra.run.smithi067.stdout:Updating Subscription Management repositories. 2023-11-16T13:52:18.075 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:00:58 ago on Thu 16 Nov 2023 01:51:20 PM UTC. 2023-11-16T13:52:20.014 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2023-11-16T13:52:20.016 INFO:teuthology.orchestra.run.smithi067.stdout:========================================================================================== 2023-11-16T13:52:20.017 INFO:teuthology.orchestra.run.smithi067.stdout: Package Arch Version Repository Size 2023-11-16T13:52:20.017 INFO:teuthology.orchestra.run.smithi067.stdout:========================================================================================== 2023-11-16T13:52:20.017 INFO:teuthology.orchestra.run.smithi067.stdout:Installing: 2023-11-16T13:52:20.017 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-test x86_64 2:17.2.7-68.gae6ce92c.el8 ceph 52 M 2023-11-16T13:52:20.017 INFO:teuthology.orchestra.run.smithi067.stdout:Installing dependencies: 2023-11-16T13:52:20.017 INFO:teuthology.orchestra.run.smithi067.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-11-16T13:52:20.017 INFO:teuthology.orchestra.run.smithi067.stdout: libcephsqlite x86_64 2:17.2.7-68.gae6ce92c.el8 ceph 174 k 2023-11-16T13:52:20.017 INFO:teuthology.orchestra.run.smithi067.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-11-16T13:52:20.017 INFO:teuthology.orchestra.run.smithi067.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-11-16T13:52:20.017 INFO:teuthology.orchestra.run.smithi067.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-11-16T13:52:20.017 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:52:20.017 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2023-11-16T13:52:20.018 INFO:teuthology.orchestra.run.smithi067.stdout:========================================================================================== 2023-11-16T13:52:20.018 INFO:teuthology.orchestra.run.smithi067.stdout:Install 6 Packages 2023-11-16T13:52:20.018 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:52:20.018 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 53 M 2023-11-16T13:52:20.018 INFO:teuthology.orchestra.run.smithi067.stdout:Installed size: 233 M 2023-11-16T13:52:20.018 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2023-11-16T13:52:20.022 INFO:teuthology.orchestra.run.smithi067.stdout:(1/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 19 MB/s | 70 kB 00:00 2023-11-16T13:52:20.275 INFO:teuthology.orchestra.run.smithi067.stdout:(2/6): jq-1.5-12.el8.x86_64.rpm 642 kB/s | 161 kB 00:00 2023-11-16T13:52:20.331 INFO:teuthology.orchestra.run.smithi067.stdout:(3/6): libcephsqlite-17.2.7-68.gae6ce92c.el8.x8 558 kB/s | 174 kB 00:00 2023-11-16T13:52:20.494 INFO:teuthology.orchestra.run.smithi067.stdout:(4/6): oniguruma-6.8.2-2.el8.x86_64.rpm 851 kB/s | 187 kB 00:00 2023-11-16T13:52:20.510 INFO:teuthology.orchestra.run.smithi067.stdout:(5/6): socat-1.7.3.3-2.el8.x86_64.rpm 1.6 MB/s | 302 kB 00:00 2023-11-16T13:52:23.282 INFO:teuthology.orchestra.run.smithi067.stdout:(6/6): ceph-test-17.2.7-68.gae6ce92c.el8.x86_64 16 MB/s | 52 MB 00:03 2023-11-16T13:52:23.285 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2023-11-16T13:52:23.285 INFO:teuthology.orchestra.run.smithi067.stdout:Total 16 MB/s | 53 MB 00:03 2023-11-16T13:52:23.289 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction check 2023-11-16T13:52:23.315 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction check succeeded. 2023-11-16T13:52:23.316 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction test 2023-11-16T13:52:23.691 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction test succeeded. 2023-11-16T13:52:23.692 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction 2023-11-16T13:52:24.244 INFO:teuthology.orchestra.run.smithi067.stdout: Preparing : 1/1 2023-11-16T13:52:24.469 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 1/6 2023-11-16T13:52:24.639 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 2/6 2023-11-16T13:52:24.718 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 2/6 2023-11-16T13:52:24.891 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : jq-1.5-12.el8.x86_64 3/6 2023-11-16T13:52:25.080 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 4/6 2023-11-16T13:52:25.231 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libcephsqlite-2:17.2.7-68.gae6ce92c.el8.x86_64 5/6 2023-11-16T13:52:30.563 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: libcephsqlite-2:17.2.7-68.gae6ce92c.el8.x86_64 5/6 2023-11-16T13:52:30.904 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-test-2:17.2.7-68.gae6ce92c.el8.x86_64 6/6 2023-11-16T13:52:31.202 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-test-2:17.2.7-68.gae6ce92c.el8.x86_64 6/6 2023-11-16T13:52:31.203 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-test-2:17.2.7-68.gae6ce92c.el8.x86_64 1/6 2023-11-16T13:52:31.203 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libcephsqlite-2:17.2.7-68.gae6ce92c.el8.x86_64 2/6 2023-11-16T13:52:31.203 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 3/6 2023-11-16T13:52:31.203 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : jq-1.5-12.el8.x86_64 4/6 2023-11-16T13:52:31.203 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 5/6 2023-11-16T13:52:32.293 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 6/6 2023-11-16T13:52:32.293 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:01:12 ago on Thu 16 Nov 2023 01:51:20 PM UTC. 2023-11-16T13:52:38.633 INFO:teuthology.orchestra.run.smithi067.stdout:Installed products updated. 2023-11-16T13:52:38.741 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:52:38.741 INFO:teuthology.orchestra.run.smithi067.stdout:Installed: 2023-11-16T13:52:38.741 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-test-2:17.2.7-68.gae6ce92c.el8.x86_64 jq-1.5-12.el8.x86_64 2023-11-16T13:52:38.741 INFO:teuthology.orchestra.run.smithi067.stdout: libcephsqlite-2:17.2.7-68.gae6ce92c.el8.x86_64 oniguruma-6.8.2-2.el8.x86_64 2023-11-16T13:52:38.742 INFO:teuthology.orchestra.run.smithi067.stdout: socat-1.7.3.3-2.el8.x86_64 xmlstarlet-1.6.1-20.el8.x86_64 2023-11-16T13:52:38.742 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:52:38.742 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2023-11-16T13:52:38.995 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install ceph 2023-11-16T13:52:39.369 INFO:teuthology.orchestra.run.smithi067.stdout:Updating Subscription Management repositories. 2023-11-16T13:52:41.076 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:01:21 ago on Thu 16 Nov 2023 01:51:20 PM UTC. 2023-11-16T13:52:42.973 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2023-11-16T13:52:42.976 INFO:teuthology.orchestra.run.smithi067.stdout:===================================================================================================== 2023-11-16T13:52:42.977 INFO:teuthology.orchestra.run.smithi067.stdout: Package Arch Version Repository Size 2023-11-16T13:52:42.978 INFO:teuthology.orchestra.run.smithi067.stdout:===================================================================================================== 2023-11-16T13:52:42.978 INFO:teuthology.orchestra.run.smithi067.stdout:Installing: 2023-11-16T13:52:42.978 INFO:teuthology.orchestra.run.smithi067.stdout: ceph x86_64 2:17.2.7-68.gae6ce92c.el8 ceph 6.4 k 2023-11-16T13:52:42.978 INFO:teuthology.orchestra.run.smithi067.stdout:Installing dependencies: 2023-11-16T13:52:42.979 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mds x86_64 2:17.2.7-68.gae6ce92c.el8 ceph 2.3 M 2023-11-16T13:52:42.979 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr x86_64 2:17.2.7-68.gae6ce92c.el8 ceph 1.6 M 2023-11-16T13:52:42.979 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-modules-core noarch 2:17.2.7-68.gae6ce92c.el8 ceph-noarch 238 k 2023-11-16T13:52:42.979 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mon x86_64 2:17.2.7-68.gae6ce92c.el8 ceph 3.9 M 2023-11-16T13:52:42.979 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-osd x86_64 2:17.2.7-68.gae6ce92c.el8 ceph 17 M 2023-11-16T13:52:42.979 INFO:teuthology.orchestra.run.smithi067.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-11-16T13:52:42.979 INFO:teuthology.orchestra.run.smithi067.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-11-16T13:52:42.979 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-11-16T13:52:42.979 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-11-16T13:52:42.979 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-11-16T13:52:42.980 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-11-16T13:52:42.980 INFO:teuthology.orchestra.run.smithi067.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-11-16T13:52:42.980 INFO:teuthology.orchestra.run.smithi067.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-11-16T13:52:42.980 INFO:teuthology.orchestra.run.smithi067.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-11-16T13:52:42.980 INFO:teuthology.orchestra.run.smithi067.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-11-16T13:52:42.980 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-11-16T13:52:42.980 INFO:teuthology.orchestra.run.smithi067.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-11-16T13:52:42.980 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-11-16T13:52:42.980 INFO:teuthology.orchestra.run.smithi067.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-11-16T13:52:42.980 INFO:teuthology.orchestra.run.smithi067.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-11-16T13:52:42.980 INFO:teuthology.orchestra.run.smithi067.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-11-16T13:52:42.980 INFO:teuthology.orchestra.run.smithi067.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-11-16T13:52:42.980 INFO:teuthology.orchestra.run.smithi067.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-11-16T13:52:42.981 INFO:teuthology.orchestra.run.smithi067.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-11-16T13:52:42.981 INFO:teuthology.orchestra.run.smithi067.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-11-16T13:52:42.981 INFO:teuthology.orchestra.run.smithi067.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-11-16T13:52:42.981 INFO:teuthology.orchestra.run.smithi067.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-11-16T13:52:42.981 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:52:42.981 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2023-11-16T13:52:42.981 INFO:teuthology.orchestra.run.smithi067.stdout:===================================================================================================== 2023-11-16T13:52:42.981 INFO:teuthology.orchestra.run.smithi067.stdout:Install 28 Packages 2023-11-16T13:52:42.981 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:52:42.982 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 27 M 2023-11-16T13:52:42.987 INFO:teuthology.orchestra.run.smithi067.stdout:Installed size: 106 M 2023-11-16T13:52:42.987 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2023-11-16T13:52:43.284 INFO:teuthology.orchestra.run.smithi067.stdout:(1/28): ceph-17.2.7-68.gae6ce92c.el8.x86_64.rpm 24 kB/s | 6.4 kB 00:00 2023-11-16T13:52:43.871 INFO:teuthology.orchestra.run.smithi067.stdout:(2/28): ceph-mds-17.2.7-68.gae6ce92c.el8.x86_64 2.7 MB/s | 2.3 MB 00:00 2023-11-16T13:52:43.929 INFO:teuthology.orchestra.run.smithi067.stdout:(3/28): ceph-mgr-17.2.7-68.gae6ce92c.el8.x86_64 1.7 MB/s | 1.6 MB 00:00 2023-11-16T13:52:44.027 INFO:teuthology.orchestra.run.smithi067.stdout:(4/28): ceph-mgr-modules-core-17.2.7-68.gae6ce9 2.4 MB/s | 238 kB 00:00 2023-11-16T13:52:44.046 INFO:teuthology.orchestra.run.smithi067.stdout:(5/28): ceph-mon-17.2.7-68.gae6ce92c.el8.x86_64 5.2 MB/s | 3.9 MB 00:00 2023-11-16T13:52:44.318 INFO:teuthology.orchestra.run.smithi067.stdout:(6/28): python3-bcrypt-3.1.6-2.el8.1.x86_64.rpm 150 kB/s | 44 kB 00:00 2023-11-16T13:52:44.485 INFO:teuthology.orchestra.run.smithi067.stdout:(7/28): python3-beautifulsoup4-4.6.3-2.el8.1.no 423 kB/s | 185 kB 00:00 2023-11-16T13:52:44.547 INFO:teuthology.orchestra.run.smithi067.stdout:(8/28): python3-cheroot-8.5.2-1.el8.noarch.rpm 755 kB/s | 173 kB 00:00 2023-11-16T13:52:44.622 INFO:teuthology.orchestra.run.smithi067.stdout:(9/28): python3-jaraco-6.2-6.el8.noarch.rpm 149 kB/s | 11 kB 00:00 2023-11-16T13:52:44.680 INFO:teuthology.orchestra.run.smithi067.stdout:(10/28): python3-cherrypy-18.4.0-1.el8.noarch.r 1.9 MB/s | 384 kB 00:00 2023-11-16T13:52:44.698 INFO:teuthology.orchestra.run.smithi067.stdout:(11/28): python3-jaraco-functools-2.0-4.el8.noa 232 kB/s | 18 kB 00:00 2023-11-16T13:52:44.758 INFO:teuthology.orchestra.run.smithi067.stdout:(12/28): python3-logutils-0.3.5-11.el8.noarch.r 625 kB/s | 49 kB 00:00 2023-11-16T13:52:44.784 INFO:teuthology.orchestra.run.smithi067.stdout:(13/28): python3-more-itertools-7.2.0-3.el8.noa 680 kB/s | 59 kB 00:00 2023-11-16T13:52:44.861 INFO:teuthology.orchestra.run.smithi067.stdout:(14/28): python3-portend-2.6-1.el8.noarch.rpm 206 kB/s | 16 kB 00:00 2023-11-16T13:52:44.864 INFO:teuthology.orchestra.run.smithi067.stdout:(15/28): python3-pecan-1.3.2-9.el8.noarch.rpm 2.6 MB/s | 283 kB 00:00 2023-11-16T13:52:44.936 INFO:teuthology.orchestra.run.smithi067.stdout:(16/28): python3-simplegeneric-0.8.1-17.el8.noa 247 kB/s | 19 kB 00:00 2023-11-16T13:52:44.939 INFO:teuthology.orchestra.run.smithi067.stdout:(17/28): python3-singledispatch-3.4.0.3-18.el8. 321 kB/s | 24 kB 00:00 2023-11-16T13:52:45.097 INFO:teuthology.orchestra.run.smithi067.stdout:(18/28): ceph-osd-17.2.7-68.gae6ce92c.el8.x86_6 14 MB/s | 17 MB 00:01 2023-11-16T13:52:45.100 INFO:teuthology.orchestra.run.smithi067.stdout:(19/28): python3-tempora-1.14.1-5.el8.noarch.rp 181 kB/s | 29 kB 00:00 2023-11-16T13:52:45.101 INFO:teuthology.orchestra.run.smithi067.stdout:(20/28): python3-trustme-0.6.0-4.el8.noarch.rpm 174 kB/s | 27 kB 00:00 2023-11-16T13:52:45.182 INFO:teuthology.orchestra.run.smithi067.stdout:(21/28): python3-webtest-2.0.33-1.el8.noarch.rp 1.0 MB/s | 85 kB 00:00 2023-11-16T13:52:45.235 INFO:teuthology.orchestra.run.smithi067.stdout:(22/28): python3-webob-1.8.5-1.el8.1.noarch.rpm 1.8 MB/s | 251 kB 00:00 2023-11-16T13:52:45.262 INFO:teuthology.orchestra.run.smithi067.stdout:(23/28): python3-zc-lockfile-2.0-2.el8.noarch.r 282 kB/s | 23 kB 00:00 2023-11-16T13:52:45.434 INFO:teuthology.orchestra.run.smithi067.stdout:(24/28): python3-markupsafe-0.23-19.el8.x86_64. 226 kB/s | 39 kB 00:00 2023-11-16T13:52:45.447 INFO:teuthology.orchestra.run.smithi067.stdout:(25/28): python3-werkzeug-0.12.2-4.el8.noarch.r 2.1 MB/s | 457 kB 00:00 2023-11-16T13:52:45.569 INFO:teuthology.orchestra.run.smithi067.stdout:(26/28): python3-waitress-1.4.3-1.el8.noarch.rp 541 kB/s | 255 kB 00:00 2023-11-16T13:52:45.601 INFO:teuthology.orchestra.run.smithi067.stdout:(27/28): python3-mako-1.0.6-13.el8.noarch.rpm 946 kB/s | 157 kB 00:00 2023-11-16T13:52:45.673 INFO:teuthology.orchestra.run.smithi067.stdout:(28/28): python3-pytz-2017.2-9.el8.noarch.rpm 241 kB/s | 54 kB 00:00 2023-11-16T13:52:45.676 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2023-11-16T13:52:45.676 INFO:teuthology.orchestra.run.smithi067.stdout:Total 10 MB/s | 27 MB 00:02 2023-11-16T13:52:45.682 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction check 2023-11-16T13:52:45.725 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction check succeeded. 2023-11-16T13:52:45.725 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction test 2023-11-16T13:52:46.137 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction test succeeded. 2023-11-16T13:52:46.141 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction 2023-11-16T13:52:47.307 INFO:teuthology.orchestra.run.smithi067.stdout: Preparing : 1/1 2023-11-16T13:52:47.549 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/28 2023-11-16T13:52:47.769 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/28 2023-11-16T13:52:47.967 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 3/28 2023-11-16T13:52:48.222 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 4/28 2023-11-16T13:52:48.556 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 5/28 2023-11-16T13:52:48.787 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 6/28 2023-11-16T13:52:49.047 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 7/28 2023-11-16T13:52:49.270 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 8/28 2023-11-16T13:52:49.452 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 9/28 2023-11-16T13:52:49.667 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 10/28 2023-11-16T13:52:49.819 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 11/28 2023-11-16T13:52:50.023 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 12/28 2023-11-16T13:52:50.185 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 13/28 2023-11-16T13:52:50.404 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 14/28 2023-11-16T13:52:50.584 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 15/28 2023-11-16T13:52:50.768 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 16/28 2023-11-16T13:52:51.100 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-portend-2.6-1.el8.noarch 17/28 2023-11-16T13:52:51.450 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 18/28 2023-11-16T13:52:51.711 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 19/28 2023-11-16T13:52:52.050 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 20/28 2023-11-16T13:52:52.330 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 21/28 2023-11-16T13:52:52.639 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 22/28 2023-11-16T13:52:52.978 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-68.gae6ce92c.el8.no 23/28 2023-11-16T13:52:53.153 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-2:17.2.7-68.gae6ce92c.el8.x86_64 24/28 2023-11-16T13:52:54.732 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mgr-2:17.2.7-68.gae6ce92c.el8.x86_64 24/28 2023-11-16T13:52:54.938 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-osd-2:17.2.7-68.gae6ce92c.el8.x86_64 25/28 2023-11-16T13:52:55.355 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-osd-2:17.2.7-68.gae6ce92c.el8.x86_64 25/28 2023-11-16T13:52:55.511 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mon-2:17.2.7-68.gae6ce92c.el8.x86_64 26/28 2023-11-16T13:52:55.760 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mon-2:17.2.7-68.gae6ce92c.el8.x86_64 26/28 2023-11-16T13:52:55.952 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mds-2:17.2.7-68.gae6ce92c.el8.x86_64 27/28 2023-11-16T13:52:55.971 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mds-2:17.2.7-68.gae6ce92c.el8.x86_64 27/28 2023-11-16T13:52:56.111 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-2:17.2.7-68.gae6ce92c.el8.x86_64 28/28 2023-11-16T13:52:56.528 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-2:17.2.7-68.gae6ce92c.el8.x86_64 28/28 2023-11-16T13:52:56.528 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-2:17.2.7-68.gae6ce92c.el8.x86_64 1/28 2023-11-16T13:52:56.528 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mds-2:17.2.7-68.gae6ce92c.el8.x86_64 2/28 2023-11-16T13:52:56.528 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-2:17.2.7-68.gae6ce92c.el8.x86_64 3/28 2023-11-16T13:52:56.528 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mon-2:17.2.7-68.gae6ce92c.el8.x86_64 4/28 2023-11-16T13:52:56.528 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-osd-2:17.2.7-68.gae6ce92c.el8.x86_64 5/28 2023-11-16T13:52:56.528 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-68.gae6ce92c.el8.no 6/28 2023-11-16T13:52:56.529 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 7/28 2023-11-16T13:52:56.529 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 8/28 2023-11-16T13:52:56.529 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 9/28 2023-11-16T13:52:56.529 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 10/28 2023-11-16T13:52:56.529 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 11/28 2023-11-16T13:52:56.529 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 12/28 2023-11-16T13:52:56.529 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 13/28 2023-11-16T13:52:56.529 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 14/28 2023-11-16T13:52:56.529 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 15/28 2023-11-16T13:52:56.529 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-portend-2.6-1.el8.noarch 16/28 2023-11-16T13:52:56.529 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 17/28 2023-11-16T13:52:56.529 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 18/28 2023-11-16T13:52:56.529 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 19/28 2023-11-16T13:52:56.530 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 20/28 2023-11-16T13:52:56.530 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 21/28 2023-11-16T13:52:56.530 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 22/28 2023-11-16T13:52:56.530 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 23/28 2023-11-16T13:52:56.530 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 24/28 2023-11-16T13:52:56.530 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 25/28 2023-11-16T13:52:56.530 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 26/28 2023-11-16T13:52:56.530 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 27/28 2023-11-16T13:52:57.933 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 28/28 2023-11-16T13:52:57.933 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:01:37 ago on Thu 16 Nov 2023 01:51:20 PM UTC. 2023-11-16T13:53:01.322 INFO:teuthology.orchestra.run.smithi067.stdout:Installed products updated. 2023-11-16T13:53:01.433 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:53:01.433 INFO:teuthology.orchestra.run.smithi067.stdout:Installed: 2023-11-16T13:53:01.433 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-2:17.2.7-68.gae6ce92c.el8.x86_64 2023-11-16T13:53:01.433 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mds-2:17.2.7-68.gae6ce92c.el8.x86_64 2023-11-16T13:53:01.433 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-2:17.2.7-68.gae6ce92c.el8.x86_64 2023-11-16T13:53:01.433 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-modules-core-2:17.2.7-68.gae6ce92c.el8.noarch 2023-11-16T13:53:01.433 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mon-2:17.2.7-68.gae6ce92c.el8.x86_64 2023-11-16T13:53:01.433 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-osd-2:17.2.7-68.gae6ce92c.el8.x86_64 2023-11-16T13:53:01.433 INFO:teuthology.orchestra.run.smithi067.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-11-16T13:53:01.433 INFO:teuthology.orchestra.run.smithi067.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-11-16T13:53:01.434 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-11-16T13:53:01.434 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-11-16T13:53:01.434 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-6.2-6.el8.noarch 2023-11-16T13:53:01.434 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-11-16T13:53:01.434 INFO:teuthology.orchestra.run.smithi067.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-11-16T13:53:01.434 INFO:teuthology.orchestra.run.smithi067.stdout: python3-mako-1.0.6-13.el8.noarch 2023-11-16T13:53:01.434 INFO:teuthology.orchestra.run.smithi067.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-11-16T13:53:01.434 INFO:teuthology.orchestra.run.smithi067.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-11-16T13:53:01.434 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-11-16T13:53:01.434 INFO:teuthology.orchestra.run.smithi067.stdout: python3-portend-2.6-1.el8.noarch 2023-11-16T13:53:01.434 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pytz-2017.2-9.el8.noarch 2023-11-16T13:53:01.434 INFO:teuthology.orchestra.run.smithi067.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-11-16T13:53:01.435 INFO:teuthology.orchestra.run.smithi067.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-11-16T13:53:01.435 INFO:teuthology.orchestra.run.smithi067.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-11-16T13:53:01.435 INFO:teuthology.orchestra.run.smithi067.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-11-16T13:53:01.435 INFO:teuthology.orchestra.run.smithi067.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-11-16T13:53:01.435 INFO:teuthology.orchestra.run.smithi067.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-11-16T13:53:01.435 INFO:teuthology.orchestra.run.smithi067.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-11-16T13:53:01.435 INFO:teuthology.orchestra.run.smithi067.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-11-16T13:53:01.435 INFO:teuthology.orchestra.run.smithi067.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-11-16T13:53:01.435 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:53:01.435 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2023-11-16T13:53:01.555 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install ceph-base 2023-11-16T13:53:01.945 INFO:teuthology.orchestra.run.smithi067.stdout:Updating Subscription Management repositories. 2023-11-16T13:53:03.541 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:01:43 ago on Thu 16 Nov 2023 01:51:20 PM UTC. 2023-11-16T13:53:04.967 INFO:teuthology.orchestra.run.smithi067.stdout:Package ceph-base-2:17.2.7-68.gae6ce92c.el8.x86_64 is already installed. 2023-11-16T13:53:05.469 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2023-11-16T13:53:05.470 INFO:teuthology.orchestra.run.smithi067.stdout:Nothing to do. 2023-11-16T13:53:05.470 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2023-11-16T13:53:05.596 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install cephadm 2023-11-16T13:53:05.980 INFO:teuthology.orchestra.run.smithi067.stdout:Updating Subscription Management repositories. 2023-11-16T13:53:07.800 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:01:47 ago on Thu 16 Nov 2023 01:51:20 PM UTC. 2023-11-16T13:53:09.753 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2023-11-16T13:53:09.753 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-11-16T13:53:09.753 INFO:teuthology.orchestra.run.smithi067.stdout: Package Arch Version Repository Size 2023-11-16T13:53:09.753 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-11-16T13:53:09.753 INFO:teuthology.orchestra.run.smithi067.stdout:Installing: 2023-11-16T13:53:09.754 INFO:teuthology.orchestra.run.smithi067.stdout: cephadm noarch 2:17.2.7-68.gae6ce92c.el8 ceph-noarch 80 k 2023-11-16T13:53:09.754 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:53:09.754 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2023-11-16T13:53:09.754 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-11-16T13:53:09.754 INFO:teuthology.orchestra.run.smithi067.stdout:Install 1 Package 2023-11-16T13:53:09.754 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:53:09.754 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 80 k 2023-11-16T13:53:09.754 INFO:teuthology.orchestra.run.smithi067.stdout:Installed size: 364 k 2023-11-16T13:53:09.754 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2023-11-16T13:53:10.146 INFO:teuthology.orchestra.run.smithi067.stdout:cephadm-17.2.7-68.gae6ce92c.el8.noarch.rpm 204 kB/s | 80 kB 00:00 2023-11-16T13:53:10.147 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2023-11-16T13:53:10.147 INFO:teuthology.orchestra.run.smithi067.stdout:Total 204 kB/s | 80 kB 00:00 2023-11-16T13:53:10.148 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction check 2023-11-16T13:53:10.157 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction check succeeded. 2023-11-16T13:53:10.157 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction test 2023-11-16T13:53:10.158 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction test succeeded. 2023-11-16T13:53:10.163 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction 2023-11-16T13:53:10.209 INFO:teuthology.orchestra.run.smithi067.stdout: Preparing : 1/1 2023-11-16T13:53:13.663 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: cephadm-2:17.2.7-68.gae6ce92c.el8.noarch 1/1 2023-11-16T13:53:13.872 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : cephadm-2:17.2.7-68.gae6ce92c.el8.noarch 1/1 2023-11-16T13:53:14.081 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: cephadm-2:17.2.7-68.gae6ce92c.el8.noarch 1/1 2023-11-16T13:53:15.147 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : cephadm-2:17.2.7-68.gae6ce92c.el8.noarch 1/1 2023-11-16T13:53:15.148 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:01:55 ago on Thu 16 Nov 2023 01:51:20 PM UTC. 2023-11-16T13:53:20.317 INFO:teuthology.orchestra.run.smithi067.stdout:Installed products updated. 2023-11-16T13:53:20.422 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:53:20.422 INFO:teuthology.orchestra.run.smithi067.stdout:Installed: 2023-11-16T13:53:20.422 INFO:teuthology.orchestra.run.smithi067.stdout: cephadm-2:17.2.7-68.gae6ce92c.el8.noarch 2023-11-16T13:53:20.422 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:53:20.422 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2023-11-16T13:53:20.547 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install ceph-immutable-object-cache 2023-11-16T13:53:21.048 INFO:teuthology.orchestra.run.smithi067.stdout:Updating Subscription Management repositories. 2023-11-16T13:53:22.845 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:02:02 ago on Thu 16 Nov 2023 01:51:20 PM UTC. 2023-11-16T13:53:24.718 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2023-11-16T13:53:24.721 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-11-16T13:53:24.726 INFO:teuthology.orchestra.run.smithi067.stdout: Package Arch Version Repo Size 2023-11-16T13:53:24.726 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-11-16T13:53:24.726 INFO:teuthology.orchestra.run.smithi067.stdout:Installing: 2023-11-16T13:53:24.726 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-68.gae6ce92c.el8 ceph 161 k 2023-11-16T13:53:24.726 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:53:24.727 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2023-11-16T13:53:24.727 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-11-16T13:53:24.727 INFO:teuthology.orchestra.run.smithi067.stdout:Install 1 Package 2023-11-16T13:53:24.727 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:53:24.727 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 161 k 2023-11-16T13:53:24.728 INFO:teuthology.orchestra.run.smithi067.stdout:Installed size: 490 k 2023-11-16T13:53:24.728 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2023-11-16T13:53:24.963 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-immutable-object-cache-17.2.7-68.gae6ce92c 622 kB/s | 161 kB 00:00 2023-11-16T13:53:24.965 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2023-11-16T13:53:24.965 INFO:teuthology.orchestra.run.smithi067.stdout:Total 617 kB/s | 161 kB 00:00 2023-11-16T13:53:24.965 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction check 2023-11-16T13:53:24.979 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction check succeeded. 2023-11-16T13:53:24.979 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction test 2023-11-16T13:53:25.036 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction test succeeded. 2023-11-16T13:53:25.040 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction 2023-11-16T13:53:25.156 INFO:teuthology.orchestra.run.smithi067.stdout: Preparing : 1/1 2023-11-16T13:53:25.315 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-68.gae6ce92c.el 1/1 2023-11-16T13:53:25.732 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-68.gae6ce92c.el 1/1 2023-11-16T13:53:26.787 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-68.gae6ce92c.el 1/1 2023-11-16T13:53:26.787 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:02:06 ago on Thu 16 Nov 2023 01:51:20 PM UTC. 2023-11-16T13:53:33.114 INFO:teuthology.orchestra.run.smithi067.stdout:Installed products updated. 2023-11-16T13:53:33.218 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:53:33.218 INFO:teuthology.orchestra.run.smithi067.stdout:Installed: 2023-11-16T13:53:33.218 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-immutable-object-cache-2:17.2.7-68.gae6ce92c.el8.x86_64 2023-11-16T13:53:33.218 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:53:33.218 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2023-11-16T13:53:33.339 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install ceph-mgr 2023-11-16T13:53:33.727 INFO:teuthology.orchestra.run.smithi067.stdout:Updating Subscription Management repositories. 2023-11-16T13:53:35.487 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:02:15 ago on Thu 16 Nov 2023 01:51:20 PM UTC. 2023-11-16T13:53:36.888 INFO:teuthology.orchestra.run.smithi067.stdout:Package ceph-mgr-2:17.2.7-68.gae6ce92c.el8.x86_64 is already installed. 2023-11-16T13:53:37.379 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2023-11-16T13:53:37.380 INFO:teuthology.orchestra.run.smithi067.stdout:Nothing to do. 2023-11-16T13:53:37.380 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2023-11-16T13:53:37.478 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install ceph-mgr-dashboard 2023-11-16T13:53:37.864 INFO:teuthology.orchestra.run.smithi067.stdout:Updating Subscription Management repositories. 2023-11-16T13:53:39.733 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:02:19 ago on Thu 16 Nov 2023 01:51:20 PM UTC. 2023-11-16T13:53:41.745 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2023-11-16T13:53:41.746 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================================= 2023-11-16T13:53:41.746 INFO:teuthology.orchestra.run.smithi067.stdout: Package Arch Version Repository Size 2023-11-16T13:53:41.746 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================================= 2023-11-16T13:53:41.746 INFO:teuthology.orchestra.run.smithi067.stdout:Installing: 2023-11-16T13:53:41.746 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-dashboard noarch 2:17.2.7-68.gae6ce92c.el8 ceph-noarch 1.7 M 2023-11-16T13:53:41.746 INFO:teuthology.orchestra.run.smithi067.stdout:Installing dependencies: 2023-11-16T13:53:41.746 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-grafana-dashboards noarch 2:17.2.7-68.gae6ce92c.el8 ceph-noarch 23 k 2023-11-16T13:53:41.746 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-prometheus-alerts noarch 2:17.2.7-68.gae6ce92c.el8 ceph-noarch 14 k 2023-11-16T13:53:41.747 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-11-16T13:53:41.747 INFO:teuthology.orchestra.run.smithi067.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-11-16T13:53:41.747 INFO:teuthology.orchestra.run.smithi067.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-11-16T13:53:41.747 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:53:41.747 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2023-11-16T13:53:41.747 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================================= 2023-11-16T13:53:41.747 INFO:teuthology.orchestra.run.smithi067.stdout:Install 6 Packages 2023-11-16T13:53:41.747 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:53:41.748 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 2.0 M 2023-11-16T13:53:41.748 INFO:teuthology.orchestra.run.smithi067.stdout:Installed size: 8.0 M 2023-11-16T13:53:41.748 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2023-11-16T13:53:42.418 INFO:teuthology.orchestra.run.smithi067.stdout:(1/6): ceph-grafana-dashboards-17.2.7-68.gae6ce 69 kB/s | 23 kB 00:00 2023-11-16T13:53:42.623 INFO:teuthology.orchestra.run.smithi067.stdout:(2/6): ceph-prometheus-alerts-17.2.7-68.gae6ce9 27 kB/s | 14 kB 00:00 2023-11-16T13:53:42.694 INFO:teuthology.orchestra.run.smithi067.stdout:(3/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 122 kB/s | 34 kB 00:00 2023-11-16T13:53:42.823 INFO:teuthology.orchestra.run.smithi067.stdout:(4/6): ceph-mgr-dashboard-17.2.7-68.gae6ce92c.e 2.3 MB/s | 1.7 MB 00:00 2023-11-16T13:53:42.874 INFO:teuthology.orchestra.run.smithi067.stdout:(5/6): python3-routes-2.4.1-12.el8.noarch.rpm 784 kB/s | 196 kB 00:00 2023-11-16T13:53:42.956 INFO:teuthology.orchestra.run.smithi067.stdout:(6/6): python3-jwt-1.6.1-2.el8.noarch.rpm 163 kB/s | 43 kB 00:00 2023-11-16T13:53:42.961 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2023-11-16T13:53:42.961 INFO:teuthology.orchestra.run.smithi067.stdout:Total 1.6 MB/s | 2.0 MB 00:01 2023-11-16T13:53:42.962 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction check 2023-11-16T13:53:42.972 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction check succeeded. 2023-11-16T13:53:42.972 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction test 2023-11-16T13:53:43.064 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction test succeeded. 2023-11-16T13:53:43.068 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction 2023-11-16T13:53:43.399 INFO:teuthology.orchestra.run.smithi067.stdout: Preparing : 1/1 2023-11-16T13:53:43.641 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 1/6 2023-11-16T13:53:43.867 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 2/6 2023-11-16T13:53:44.066 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 3/6 2023-11-16T13:53:44.178 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-68.gae6ce92c.el8.noa 4/6 2023-11-16T13:53:44.602 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-68.gae6ce92c.el8.no 5/6 2023-11-16T13:53:44.838 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-68.gae6ce92c.el8.noarch 6/6 2023-11-16T13:53:45.099 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-68.gae6ce92c.el8.noarch 6/6 2023-11-16T13:53:45.099 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-68.gae6ce92c.el8.no 1/6 2023-11-16T13:53:45.099 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-68.gae6ce92c.el8.noarch 2/6 2023-11-16T13:53:45.100 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-68.gae6ce92c.el8.noa 3/6 2023-11-16T13:53:45.100 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 4/6 2023-11-16T13:53:45.100 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 5/6 2023-11-16T13:53:46.123 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 6/6 2023-11-16T13:53:46.123 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:02:26 ago on Thu 16 Nov 2023 01:51:20 PM UTC. 2023-11-16T13:53:51.490 INFO:teuthology.orchestra.run.smithi067.stdout:Installed products updated. 2023-11-16T13:53:51.598 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:53:51.598 INFO:teuthology.orchestra.run.smithi067.stdout:Installed: 2023-11-16T13:53:51.598 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-grafana-dashboards-2:17.2.7-68.gae6ce92c.el8.noarch 2023-11-16T13:53:51.598 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-dashboard-2:17.2.7-68.gae6ce92c.el8.noarch 2023-11-16T13:53:51.598 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-prometheus-alerts-2:17.2.7-68.gae6ce92c.el8.noarch 2023-11-16T13:53:51.599 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-11-16T13:53:51.599 INFO:teuthology.orchestra.run.smithi067.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-11-16T13:53:51.599 INFO:teuthology.orchestra.run.smithi067.stdout: python3-routes-2.4.1-12.el8.noarch 2023-11-16T13:53:51.599 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:53:51.599 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2023-11-16T13:53:51.735 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install ceph-mgr-diskprediction-local 2023-11-16T13:53:52.123 INFO:teuthology.orchestra.run.smithi067.stdout:Updating Subscription Management repositories. 2023-11-16T13:53:53.883 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:02:33 ago on Thu 16 Nov 2023 01:51:20 PM UTC. 2023-11-16T13:53:55.830 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2023-11-16T13:53:55.831 INFO:teuthology.orchestra.run.smithi067.stdout:====================================================================================================================== 2023-11-16T13:53:55.832 INFO:teuthology.orchestra.run.smithi067.stdout: Package Arch Version Repository Size 2023-11-16T13:53:55.832 INFO:teuthology.orchestra.run.smithi067.stdout:====================================================================================================================== 2023-11-16T13:53:55.832 INFO:teuthology.orchestra.run.smithi067.stdout:Installing: 2023-11-16T13:53:55.832 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-68.gae6ce92c.el8 ceph-noarch 7.4 M 2023-11-16T13:53:55.832 INFO:teuthology.orchestra.run.smithi067.stdout:Installing dependencies: 2023-11-16T13:53:55.832 INFO:teuthology.orchestra.run.smithi067.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-11-16T13:53:55.832 INFO:teuthology.orchestra.run.smithi067.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-11-16T13:53:55.832 INFO:teuthology.orchestra.run.smithi067.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-11-16T13:53:55.832 INFO:teuthology.orchestra.run.smithi067.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-11-16T13:53:55.832 INFO:teuthology.orchestra.run.smithi067.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-11-16T13:53:55.832 INFO:teuthology.orchestra.run.smithi067.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-11-16T13:53:55.833 INFO:teuthology.orchestra.run.smithi067.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-11-16T13:53:55.833 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:53:55.833 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2023-11-16T13:53:55.833 INFO:teuthology.orchestra.run.smithi067.stdout:====================================================================================================================== 2023-11-16T13:53:55.833 INFO:teuthology.orchestra.run.smithi067.stdout:Install 8 Packages 2023-11-16T13:53:55.833 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:53:55.833 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 36 M 2023-11-16T13:53:55.834 INFO:teuthology.orchestra.run.smithi067.stdout:Installed size: 199 M 2023-11-16T13:53:55.834 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2023-11-16T13:53:55.910 INFO:teuthology.orchestra.run.smithi067.stdout:(1/8): libquadmath-8.4.1-1.el8.x86_64.rpm 2.2 MB/s | 169 kB 00:00 2023-11-16T13:53:56.018 INFO:teuthology.orchestra.run.smithi067.stdout:(2/8): libgfortran-8.4.1-1.el8.x86_64.rpm 3.4 MB/s | 639 kB 00:00 2023-11-16T13:53:56.199 INFO:teuthology.orchestra.run.smithi067.stdout:(3/8): python3-numpy-f2py-1.14.3-9.el8.x86_64.r 1.2 MB/s | 225 kB 00:00 2023-11-16T13:53:56.411 INFO:teuthology.orchestra.run.smithi067.stdout:(4/8): python3-numpy-1.14.3-9.el8.x86_64.rpm 18 MB/s | 3.7 MB 00:00 2023-11-16T13:53:56.532 INFO:teuthology.orchestra.run.smithi067.stdout:(5/8): python3-scipy-1.0.0-20.module+el8.1.0+33 23 MB/s | 15 MB 00:00 2023-11-16T13:54:03.656 INFO:teuthology.orchestra.run.smithi067.stdout:(6/8): openblas-threads-0.3.12-1.el8.x86_64.rpm 19 MB/s | 4.7 MB 00:00 2023-11-16T13:54:03.657 INFO:teuthology.orchestra.run.smithi067.stdout:(7/8): openblas-0.3.12-1.el8.x86_64.rpm 21 MB/s | 4.6 MB 00:00 2023-11-16T13:54:03.657 INFO:teuthology.orchestra.run.smithi067.stdout:(8/8): ceph-mgr-diskprediction-local-17.2.7-68. 2.7 MB/s | 7.4 MB 00:02 2023-11-16T13:54:03.657 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2023-11-16T13:54:03.657 INFO:teuthology.orchestra.run.smithi067.stdout:Total 13 MB/s | 36 MB 00:02 2023-11-16T13:54:03.657 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction check 2023-11-16T13:54:03.657 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction check succeeded. 2023-11-16T13:54:03.657 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction test 2023-11-16T13:54:03.657 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction test succeeded. 2023-11-16T13:54:03.657 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction 2023-11-16T13:54:03.657 INFO:teuthology.orchestra.run.smithi067.stdout: Preparing : 1/1 2023-11-16T13:54:03.657 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 1/8 2023-11-16T13:54:03.657 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 1/8 2023-11-16T13:54:03.657 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 2/8 2023-11-16T13:54:03.658 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 2/8 2023-11-16T13:54:03.658 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 3/8 2023-11-16T13:54:03.658 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 3/8 2023-11-16T13:54:03.658 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : openblas-0.3.12-1.el8.x86_64 4/8 2023-11-16T13:54:03.658 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 4/8 2023-11-16T13:54:03.662 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 5/8 2023-11-16T13:54:03.662 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2023-11-16T13:54:05.274 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2023-11-16T13:54:06.638 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7. 7/8 2023-11-16T13:54:06.810 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-68.gae6ce92c. 8/8 2023-11-16T13:54:07.155 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-68.gae6ce92c. 8/8 2023-11-16T13:54:07.155 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-68.gae6ce92c. 1/8 2023-11-16T13:54:07.155 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 2/8 2023-11-16T13:54:07.155 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 3/8 2023-11-16T13:54:07.156 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7. 4/8 2023-11-16T13:54:07.156 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 5/8 2023-11-16T13:54:07.156 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 6/8 2023-11-16T13:54:07.157 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 7/8 2023-11-16T13:54:08.215 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 8/8 2023-11-16T13:54:08.215 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:02:48 ago on Thu 16 Nov 2023 01:51:20 PM UTC. 2023-11-16T13:54:11.747 INFO:teuthology.orchestra.run.smithi067.stdout:Installed products updated. 2023-11-16T13:54:11.855 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:54:11.855 INFO:teuthology.orchestra.run.smithi067.stdout:Installed: 2023-11-16T13:54:11.855 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-diskprediction-local-2:17.2.7-68.gae6ce92c.el8.noarch 2023-11-16T13:54:11.855 INFO:teuthology.orchestra.run.smithi067.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-11-16T13:54:11.855 INFO:teuthology.orchestra.run.smithi067.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-11-16T13:54:11.855 INFO:teuthology.orchestra.run.smithi067.stdout: openblas-0.3.12-1.el8.x86_64 2023-11-16T13:54:11.855 INFO:teuthology.orchestra.run.smithi067.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-11-16T13:54:11.856 INFO:teuthology.orchestra.run.smithi067.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-11-16T13:54:11.856 INFO:teuthology.orchestra.run.smithi067.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-11-16T13:54:11.856 INFO:teuthology.orchestra.run.smithi067.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-11-16T13:54:11.856 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:54:11.856 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2023-11-16T13:54:12.001 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install ceph-mgr-rook 2023-11-16T13:54:12.390 INFO:teuthology.orchestra.run.smithi067.stdout:Updating Subscription Management repositories. 2023-11-16T13:54:14.128 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:02:54 ago on Thu 16 Nov 2023 01:51:20 PM UTC. 2023-11-16T13:54:16.075 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2023-11-16T13:54:16.077 INFO:teuthology.orchestra.run.smithi067.stdout:====================================================================================================== 2023-11-16T13:54:16.077 INFO:teuthology.orchestra.run.smithi067.stdout: Package Arch Version Repository Size 2023-11-16T13:54:16.077 INFO:teuthology.orchestra.run.smithi067.stdout:====================================================================================================== 2023-11-16T13:54:16.077 INFO:teuthology.orchestra.run.smithi067.stdout:Installing: 2023-11-16T13:54:16.077 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-rook noarch 2:17.2.7-68.gae6ce92c.el8 ceph-noarch 47 k 2023-11-16T13:54:16.078 INFO:teuthology.orchestra.run.smithi067.stdout:Installing dependencies: 2023-11-16T13:54:16.078 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-11-16T13:54:16.078 INFO:teuthology.orchestra.run.smithi067.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-11-16T13:54:16.078 INFO:teuthology.orchestra.run.smithi067.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-11-16T13:54:16.078 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-11-16T13:54:16.078 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-11-16T13:54:16.078 INFO:teuthology.orchestra.run.smithi067.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-11-16T13:54:16.078 INFO:teuthology.orchestra.run.smithi067.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-11-16T13:54:16.078 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-11-16T13:54:16.078 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-11-16T13:54:16.078 INFO:teuthology.orchestra.run.smithi067.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-11-16T13:54:16.079 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-11-16T13:54:16.079 INFO:teuthology.orchestra.run.smithi067.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-11-16T13:54:16.079 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:54:16.079 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2023-11-16T13:54:16.079 INFO:teuthology.orchestra.run.smithi067.stdout:====================================================================================================== 2023-11-16T13:54:16.079 INFO:teuthology.orchestra.run.smithi067.stdout:Install 13 Packages 2023-11-16T13:54:16.079 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:54:16.080 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 1.9 M 2023-11-16T13:54:16.080 INFO:teuthology.orchestra.run.smithi067.stdout:Installed size: 25 M 2023-11-16T13:54:16.080 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2023-11-16T13:54:16.415 INFO:teuthology.orchestra.run.smithi067.stdout:(1/13): python3-certifi-2018.10.15-7.el8.noarch 135 kB/s | 16 kB 00:00 2023-11-16T13:54:16.423 INFO:teuthology.orchestra.run.smithi067.stdout:(2/13): python3-cachetools-3.1.1-4.el8.noarch.r 256 kB/s | 33 kB 00:00 2023-11-16T13:54:16.425 INFO:teuthology.orchestra.run.smithi067.stdout:(3/13): ceph-mgr-rook-17.2.7-68.gae6ce92c.el8.n 361 kB/s | 47 kB 00:00 2023-11-16T13:54:16.512 INFO:teuthology.orchestra.run.smithi067.stdout:(4/13): python3-google-auth-1.1.1-10.el8.noarch 841 kB/s | 81 kB 00:00 2023-11-16T13:54:16.557 INFO:teuthology.orchestra.run.smithi067.stdout:(5/13): python3-websocket-client-0.56.0-5.el8.n 1.3 MB/s | 61 kB 00:00 2023-11-16T13:54:16.566 INFO:teuthology.orchestra.run.smithi067.stdout:(6/13): python3-rsa-4.9-2.el8.noarch.rpm 457 kB/s | 64 kB 00:00 2023-11-16T13:54:16.637 INFO:teuthology.orchestra.run.smithi067.stdout:(7/13): python3-kubernetes-11.0.0-6.el8.noarch. 5.4 MB/s | 1.2 MB 00:00 2023-11-16T13:54:16.889 INFO:teuthology.orchestra.run.smithi067.stdout:(8/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 106 kB/s | 27 kB 00:00 2023-11-16T13:54:16.943 INFO:teuthology.orchestra.run.smithi067.stdout:(9/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.3 MB/s | 126 kB 00:00 2023-11-16T13:54:16.972 INFO:teuthology.orchestra.run.smithi067.stdout:(10/13): python3-oauthlib-2.1.0-1.el8.noarch.rp 374 kB/s | 155 kB 00:00 2023-11-16T13:54:16.975 INFO:teuthology.orchestra.run.smithi067.stdout:(11/13): python3-requests-oauthlib-1.0.0-1.el8. 104 kB/s | 43 kB 00:00 2023-11-16T13:54:17.360 INFO:teuthology.orchestra.run.smithi067.stdout:(12/13): python3-pyasn1-modules-0.3.7-6.el8.noa 264 kB/s | 110 kB 00:00 2023-11-16T13:54:17.380 INFO:teuthology.orchestra.run.smithi067.stdout:(13/13): python3-jsonpointer-1.10-11.el8.noarch 49 kB/s | 20 kB 00:00 2023-11-16T13:54:17.380 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2023-11-16T13:54:17.381 INFO:teuthology.orchestra.run.smithi067.stdout:Total 1.5 MB/s | 1.9 MB 00:01 2023-11-16T13:54:17.387 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction check 2023-11-16T13:54:17.406 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction check succeeded. 2023-11-16T13:54:17.406 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction test 2023-11-16T13:54:17.496 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction test succeeded. 2023-11-16T13:54:17.501 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction 2023-11-16T13:54:18.060 INFO:teuthology.orchestra.run.smithi067.stdout: Preparing : 1/1 2023-11-16T13:54:18.341 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2023-11-16T13:54:18.568 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-rsa-4.9-2.el8.noarch 2/13 2023-11-16T13:54:18.784 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 3/13 2023-11-16T13:54:19.000 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 4/13 2023-11-16T13:54:19.282 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 5/13 2023-11-16T13:54:19.568 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2023-11-16T13:54:19.910 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2023-11-16T13:54:20.152 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 8/13 2023-11-16T13:54:20.379 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 9/13 2023-11-16T13:54:20.636 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 10/13 2023-11-16T13:54:21.872 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 11/13 2023-11-16T13:54:22.186 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 12/13 2023-11-16T13:54:22.358 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-rook-2:17.2.7-68.gae6ce92c.el8.noarch 13/13 2023-11-16T13:54:22.627 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-68.gae6ce92c.el8.noarch 13/13 2023-11-16T13:54:22.628 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-rook-2:17.2.7-68.gae6ce92c.el8.noarch 1/13 2023-11-16T13:54:22.628 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 2/13 2023-11-16T13:54:22.628 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 3/13 2023-11-16T13:54:22.628 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 4/13 2023-11-16T13:54:22.628 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 5/13 2023-11-16T13:54:22.628 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 6/13 2023-11-16T13:54:22.628 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 7/13 2023-11-16T13:54:22.628 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2023-11-16T13:54:22.628 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2023-11-16T13:54:22.628 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 10/13 2023-11-16T13:54:22.628 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 11/13 2023-11-16T13:54:22.628 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 12/13 2023-11-16T13:54:23.705 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 13/13 2023-11-16T13:54:23.705 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:03:03 ago on Thu 16 Nov 2023 01:51:20 PM UTC. 2023-11-16T13:54:28.663 INFO:teuthology.orchestra.run.smithi067.stdout:Installed products updated. 2023-11-16T13:54:28.769 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:54:28.769 INFO:teuthology.orchestra.run.smithi067.stdout:Installed: 2023-11-16T13:54:28.769 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-rook-2:17.2.7-68.gae6ce92c.el8.noarch 2023-11-16T13:54:28.770 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-11-16T13:54:28.770 INFO:teuthology.orchestra.run.smithi067.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-11-16T13:54:28.770 INFO:teuthology.orchestra.run.smithi067.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-11-16T13:54:28.770 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-11-16T13:54:28.770 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-11-16T13:54:28.770 INFO:teuthology.orchestra.run.smithi067.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-11-16T13:54:28.770 INFO:teuthology.orchestra.run.smithi067.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-11-16T13:54:28.771 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-11-16T13:54:28.771 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-11-16T13:54:28.771 INFO:teuthology.orchestra.run.smithi067.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-11-16T13:54:28.771 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rsa-4.9-2.el8.noarch 2023-11-16T13:54:28.771 INFO:teuthology.orchestra.run.smithi067.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-11-16T13:54:28.771 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:54:28.772 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2023-11-16T13:54:28.950 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install ceph-mgr-cephadm 2023-11-16T13:54:29.347 INFO:teuthology.orchestra.run.smithi067.stdout:Updating Subscription Management repositories. 2023-11-16T13:54:30.910 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:03:10 ago on Thu 16 Nov 2023 01:51:20 PM UTC. 2023-11-16T13:54:32.851 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2023-11-16T13:54:32.852 INFO:teuthology.orchestra.run.smithi067.stdout:============================================================================================= 2023-11-16T13:54:32.852 INFO:teuthology.orchestra.run.smithi067.stdout: Package Arch Version Repository Size 2023-11-16T13:54:32.852 INFO:teuthology.orchestra.run.smithi067.stdout:============================================================================================= 2023-11-16T13:54:32.852 INFO:teuthology.orchestra.run.smithi067.stdout:Installing: 2023-11-16T13:54:32.852 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-cephadm noarch 2:17.2.7-68.gae6ce92c.el8 ceph-noarch 121 k 2023-11-16T13:54:32.852 INFO:teuthology.orchestra.run.smithi067.stdout:Installing dependencies: 2023-11-16T13:54:32.853 INFO:teuthology.orchestra.run.smithi067.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-11-16T13:54:32.853 INFO:teuthology.orchestra.run.smithi067.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-11-16T13:54:32.853 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-11-16T13:54:32.853 INFO:teuthology.orchestra.run.smithi067.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-11-16T13:54:32.853 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:54:32.853 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2023-11-16T13:54:32.853 INFO:teuthology.orchestra.run.smithi067.stdout:============================================================================================= 2023-11-16T13:54:32.853 INFO:teuthology.orchestra.run.smithi067.stdout:Install 5 Packages 2023-11-16T13:54:32.854 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:54:32.854 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 6.0 M 2023-11-16T13:54:32.854 INFO:teuthology.orchestra.run.smithi067.stdout:Installed size: 26 M 2023-11-16T13:54:32.855 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2023-11-16T13:54:33.517 INFO:teuthology.orchestra.run.smithi067.stdout:(1/5): python3-natsort-7.1.1-2.el8.noarch.rpm 199 kB/s | 60 kB 00:00 2023-11-16T13:54:33.595 INFO:teuthology.orchestra.run.smithi067.stdout:(2/5): ceph-mgr-cephadm-17.2.7-68.gae6ce92c.el8 319 kB/s | 121 kB 00:00 2023-11-16T13:54:33.681 INFO:teuthology.orchestra.run.smithi067.stdout:(3/5): python3-asyncssh-2.7.0-2.el8.noarch.rpm 1.0 MB/s | 476 kB 00:00 2023-11-16T13:54:33.841 INFO:teuthology.orchestra.run.smithi067.stdout:(4/5): python3-babel-2.5.1-5.el8.noarch.rpm 15 MB/s | 4.8 MB 00:00 2023-11-16T13:54:33.937 INFO:teuthology.orchestra.run.smithi067.stdout:(5/5): python3-jinja2-2.10.1-2.el8_0.noarch.rpm 1.5 MB/s | 538 kB 00:00 2023-11-16T13:54:33.940 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2023-11-16T13:54:33.940 INFO:teuthology.orchestra.run.smithi067.stdout:Total 5.5 MB/s | 6.0 MB 00:01 2023-11-16T13:54:33.943 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction check 2023-11-16T13:54:33.955 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction check succeeded. 2023-11-16T13:54:33.955 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction test 2023-11-16T13:54:34.056 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction test succeeded. 2023-11-16T13:54:34.062 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction 2023-11-16T13:54:35.149 INFO:teuthology.orchestra.run.smithi067.stdout: Preparing : 1/1 2023-11-16T13:54:36.911 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 1/5 2023-11-16T13:54:37.576 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 2/5 2023-11-16T13:54:37.963 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 3/5 2023-11-16T13:54:38.281 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 4/5 2023-11-16T13:54:38.481 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-68.gae6ce92c.el8.noarch 5/5 2023-11-16T13:54:38.744 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-68.gae6ce92c.el8.noarch 5/5 2023-11-16T13:54:38.744 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-68.gae6ce92c.el8.noarch 1/5 2023-11-16T13:54:38.744 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 2/5 2023-11-16T13:54:38.744 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 3/5 2023-11-16T13:54:38.744 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 4/5 2023-11-16T13:54:39.775 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 5/5 2023-11-16T13:54:39.775 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:03:19 ago on Thu 16 Nov 2023 01:51:20 PM UTC. 2023-11-16T13:54:44.594 INFO:teuthology.orchestra.run.smithi067.stdout:Installed products updated. 2023-11-16T13:54:44.703 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:54:44.703 INFO:teuthology.orchestra.run.smithi067.stdout:Installed: 2023-11-16T13:54:44.703 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-cephadm-2:17.2.7-68.gae6ce92c.el8.noarch 2023-11-16T13:54:44.703 INFO:teuthology.orchestra.run.smithi067.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-11-16T13:54:44.703 INFO:teuthology.orchestra.run.smithi067.stdout: python3-babel-2.5.1-5.el8.noarch 2023-11-16T13:54:44.703 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-11-16T13:54:44.703 INFO:teuthology.orchestra.run.smithi067.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-11-16T13:54:44.703 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:54:44.703 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2023-11-16T13:54:44.883 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install ceph-fuse 2023-11-16T13:54:45.280 INFO:teuthology.orchestra.run.smithi067.stdout:Updating Subscription Management repositories. 2023-11-16T13:54:47.051 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:03:27 ago on Thu 16 Nov 2023 01:51:20 PM UTC. 2023-11-16T13:54:49.077 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2023-11-16T13:54:49.078 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-11-16T13:54:49.078 INFO:teuthology.orchestra.run.smithi067.stdout: Package Arch Version Repository Size 2023-11-16T13:54:49.078 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-11-16T13:54:49.078 INFO:teuthology.orchestra.run.smithi067.stdout:Installing: 2023-11-16T13:54:49.079 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-fuse x86_64 2:17.2.7-68.gae6ce92c.el8 ceph 875 k 2023-11-16T13:54:49.079 INFO:teuthology.orchestra.run.smithi067.stdout:Installing dependencies: 2023-11-16T13:54:49.079 INFO:teuthology.orchestra.run.smithi067.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-11-16T13:54:49.079 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:54:49.079 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2023-11-16T13:54:49.079 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-11-16T13:54:49.080 INFO:teuthology.orchestra.run.smithi067.stdout:Install 2 Packages 2023-11-16T13:54:49.080 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:54:49.080 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 958 k 2023-11-16T13:54:49.080 INFO:teuthology.orchestra.run.smithi067.stdout:Installed size: 3.1 M 2023-11-16T13:54:49.080 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2023-11-16T13:54:49.242 INFO:teuthology.orchestra.run.smithi067.stdout:(1/2): fuse-2.9.7-12.el8.x86_64.rpm 507 kB/s | 83 kB 00:00 2023-11-16T13:54:50.146 INFO:teuthology.orchestra.run.smithi067.stdout:(2/2): ceph-fuse-17.2.7-68.gae6ce92c.el8.x86_64 820 kB/s | 875 kB 00:01 2023-11-16T13:54:50.148 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2023-11-16T13:54:50.148 INFO:teuthology.orchestra.run.smithi067.stdout:Total 895 kB/s | 958 kB 00:01 2023-11-16T13:54:50.150 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction check 2023-11-16T13:54:50.176 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction check succeeded. 2023-11-16T13:54:50.176 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction test 2023-11-16T13:54:50.273 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction test succeeded. 2023-11-16T13:54:50.278 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction 2023-11-16T13:54:50.474 INFO:teuthology.orchestra.run.smithi067.stdout: Preparing : 1/1 2023-11-16T13:54:50.761 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : fuse-2.9.7-12.el8.x86_64 1/2 2023-11-16T13:54:50.963 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-fuse-2:17.2.7-68.gae6ce92c.el8.x86_64 2/2 2023-11-16T13:54:51.420 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-fuse-2:17.2.7-68.gae6ce92c.el8.x86_64 2/2 2023-11-16T13:54:51.421 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-fuse-2:17.2.7-68.gae6ce92c.el8.x86_64 1/2 2023-11-16T13:54:52.526 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 2/2 2023-11-16T13:54:52.526 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:03:32 ago on Thu 16 Nov 2023 01:51:20 PM UTC. 2023-11-16T13:54:56.690 INFO:teuthology.orchestra.run.smithi067.stdout:Installed products updated. 2023-11-16T13:54:56.794 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:54:56.794 INFO:teuthology.orchestra.run.smithi067.stdout:Installed: 2023-11-16T13:54:56.794 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-fuse-2:17.2.7-68.gae6ce92c.el8.x86_64 fuse-2.9.7-12.el8.x86_64 2023-11-16T13:54:56.794 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:54:56.794 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2023-11-16T13:54:56.915 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install ceph-volume 2023-11-16T13:54:57.316 INFO:teuthology.orchestra.run.smithi067.stdout:Updating Subscription Management repositories. 2023-11-16T13:54:59.025 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:03:39 ago on Thu 16 Nov 2023 01:51:20 PM UTC. 2023-11-16T13:55:00.910 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2023-11-16T13:55:00.911 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-11-16T13:55:00.911 INFO:teuthology.orchestra.run.smithi067.stdout: Package Arch Version Repository Size 2023-11-16T13:55:00.911 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-11-16T13:55:00.911 INFO:teuthology.orchestra.run.smithi067.stdout:Installing: 2023-11-16T13:55:00.912 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-volume noarch 2:17.2.7-68.gae6ce92c.el8 ceph-noarch 267 k 2023-11-16T13:55:00.912 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:55:00.912 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2023-11-16T13:55:00.912 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-11-16T13:55:00.912 INFO:teuthology.orchestra.run.smithi067.stdout:Install 1 Package 2023-11-16T13:55:00.912 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:55:00.912 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 267 k 2023-11-16T13:55:00.912 INFO:teuthology.orchestra.run.smithi067.stdout:Installed size: 1.3 M 2023-11-16T13:55:00.912 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2023-11-16T13:55:01.381 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-volume-17.2.7-68.gae6ce92c.el8.noarch.rpm 570 kB/s | 267 kB 00:00 2023-11-16T13:55:01.382 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2023-11-16T13:55:01.382 INFO:teuthology.orchestra.run.smithi067.stdout:Total 568 kB/s | 267 kB 00:00 2023-11-16T13:55:01.382 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction check 2023-11-16T13:55:01.394 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction check succeeded. 2023-11-16T13:55:01.394 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction test 2023-11-16T13:55:01.419 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction test succeeded. 2023-11-16T13:55:01.424 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction 2023-11-16T13:55:01.617 INFO:teuthology.orchestra.run.smithi067.stdout: Preparing : 1/1 2023-11-16T13:55:01.887 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-volume-2:17.2.7-68.gae6ce92c.el8.noarch 1/1 2023-11-16T13:55:02.314 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-volume-2:17.2.7-68.gae6ce92c.el8.noarch 1/1 2023-11-16T13:55:03.407 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-volume-2:17.2.7-68.gae6ce92c.el8.noarch 1/1 2023-11-16T13:55:03.407 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:03:43 ago on Thu 16 Nov 2023 01:51:20 PM UTC. 2023-11-16T13:55:09.391 INFO:teuthology.orchestra.run.smithi067.stdout:Installed products updated. 2023-11-16T13:55:09.496 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:55:09.496 INFO:teuthology.orchestra.run.smithi067.stdout:Installed: 2023-11-16T13:55:09.496 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-volume-2:17.2.7-68.gae6ce92c.el8.noarch 2023-11-16T13:55:09.497 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:55:09.497 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2023-11-16T13:55:09.616 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install librados-devel 2023-11-16T13:55:10.014 INFO:teuthology.orchestra.run.smithi067.stdout:Updating Subscription Management repositories. 2023-11-16T13:55:12.002 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:03:51 ago on Thu 16 Nov 2023 01:51:20 PM UTC. 2023-11-16T13:55:13.917 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2023-11-16T13:55:13.917 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-11-16T13:55:13.917 INFO:teuthology.orchestra.run.smithi067.stdout: Package Arch Version Repo Size 2023-11-16T13:55:13.917 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-11-16T13:55:13.917 INFO:teuthology.orchestra.run.smithi067.stdout:Installing: 2023-11-16T13:55:13.917 INFO:teuthology.orchestra.run.smithi067.stdout: librados-devel x86_64 2:17.2.7-68.gae6ce92c.el8 ceph 130 k 2023-11-16T13:55:13.917 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:55:13.917 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2023-11-16T13:55:13.917 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-11-16T13:55:13.918 INFO:teuthology.orchestra.run.smithi067.stdout:Install 1 Package 2023-11-16T13:55:13.918 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:55:13.918 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 130 k 2023-11-16T13:55:13.918 INFO:teuthology.orchestra.run.smithi067.stdout:Installed size: 464 k 2023-11-16T13:55:13.918 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2023-11-16T13:55:14.071 INFO:teuthology.orchestra.run.smithi067.stdout:librados-devel-17.2.7-68.gae6ce92c.el8.x86_64.r 849 kB/s | 130 kB 00:00 2023-11-16T13:55:14.071 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2023-11-16T13:55:14.072 INFO:teuthology.orchestra.run.smithi067.stdout:Total 841 kB/s | 130 kB 00:00 2023-11-16T13:55:14.072 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction check 2023-11-16T13:55:14.079 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction check succeeded. 2023-11-16T13:55:14.079 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction test 2023-11-16T13:55:14.140 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction test succeeded. 2023-11-16T13:55:14.145 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction 2023-11-16T13:55:14.272 INFO:teuthology.orchestra.run.smithi067.stdout: Preparing : 1/1 2023-11-16T13:55:14.427 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : librados-devel-2:17.2.7-68.gae6ce92c.el8.x86_64 1/1 2023-11-16T13:55:14.742 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librados-devel-2:17.2.7-68.gae6ce92c.el8.x86_64 1/1 2023-11-16T13:55:15.798 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librados-devel-2:17.2.7-68.gae6ce92c.el8.x86_64 1/1 2023-11-16T13:55:15.799 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:03:55 ago on Thu 16 Nov 2023 01:51:20 PM UTC. 2023-11-16T13:55:19.319 INFO:teuthology.orchestra.run.smithi067.stdout:Installed products updated. 2023-11-16T13:55:19.423 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:55:19.423 INFO:teuthology.orchestra.run.smithi067.stdout:Installed: 2023-11-16T13:55:19.423 INFO:teuthology.orchestra.run.smithi067.stdout: librados-devel-2:17.2.7-68.gae6ce92c.el8.x86_64 2023-11-16T13:55:19.423 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:55:19.423 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2023-11-16T13:55:19.557 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install libcephfs2 2023-11-16T13:55:19.954 INFO:teuthology.orchestra.run.smithi067.stdout:Updating Subscription Management repositories. 2023-11-16T13:55:21.849 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:04:01 ago on Thu 16 Nov 2023 01:51:20 PM UTC. 2023-11-16T13:55:23.292 INFO:teuthology.orchestra.run.smithi067.stdout:Package libcephfs2-2:17.2.7-68.gae6ce92c.el8.x86_64 is already installed. 2023-11-16T13:55:23.784 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2023-11-16T13:55:23.786 INFO:teuthology.orchestra.run.smithi067.stdout:Nothing to do. 2023-11-16T13:55:23.786 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2023-11-16T13:55:23.891 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install libcephfs-devel 2023-11-16T13:55:24.290 INFO:teuthology.orchestra.run.smithi067.stdout:Updating Subscription Management repositories. 2023-11-16T13:55:26.128 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:04:06 ago on Thu 16 Nov 2023 01:51:20 PM UTC. 2023-11-16T13:55:27.975 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2023-11-16T13:55:27.975 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-11-16T13:55:27.975 INFO:teuthology.orchestra.run.smithi067.stdout: Package Arch Version Repo Size 2023-11-16T13:55:27.975 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-11-16T13:55:27.975 INFO:teuthology.orchestra.run.smithi067.stdout:Installing: 2023-11-16T13:55:27.976 INFO:teuthology.orchestra.run.smithi067.stdout: libcephfs-devel x86_64 2:17.2.7-68.gae6ce92c.el8 ceph 25 k 2023-11-16T13:55:27.976 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:55:27.976 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2023-11-16T13:55:27.976 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-11-16T13:55:27.976 INFO:teuthology.orchestra.run.smithi067.stdout:Install 1 Package 2023-11-16T13:55:27.976 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:55:27.976 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 25 k 2023-11-16T13:55:27.977 INFO:teuthology.orchestra.run.smithi067.stdout:Installed size: 109 k 2023-11-16T13:55:27.977 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2023-11-16T13:55:28.252 INFO:teuthology.orchestra.run.smithi067.stdout:libcephfs-devel-17.2.7-68.gae6ce92c.el8.x86_64. 90 kB/s | 25 kB 00:00 2023-11-16T13:55:28.253 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2023-11-16T13:55:28.253 INFO:teuthology.orchestra.run.smithi067.stdout:Total 89 kB/s | 25 kB 00:00 2023-11-16T13:55:28.253 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction check 2023-11-16T13:55:28.258 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction check succeeded. 2023-11-16T13:55:28.258 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction test 2023-11-16T13:55:28.260 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction test succeeded. 2023-11-16T13:55:28.264 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction 2023-11-16T13:55:28.326 INFO:teuthology.orchestra.run.smithi067.stdout: Preparing : 1/1 2023-11-16T13:55:28.474 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libcephfs-devel-2:17.2.7-68.gae6ce92c.el8.x86_64 1/1 2023-11-16T13:55:28.752 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-68.gae6ce92c.el8.x86_64 1/1 2023-11-16T13:55:29.779 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libcephfs-devel-2:17.2.7-68.gae6ce92c.el8.x86_64 1/1 2023-11-16T13:55:29.779 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:04:09 ago on Thu 16 Nov 2023 01:51:20 PM UTC. 2023-11-16T13:55:34.331 INFO:teuthology.orchestra.run.smithi067.stdout:Installed products updated. 2023-11-16T13:55:34.435 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:55:34.435 INFO:teuthology.orchestra.run.smithi067.stdout:Installed: 2023-11-16T13:55:34.435 INFO:teuthology.orchestra.run.smithi067.stdout: libcephfs-devel-2:17.2.7-68.gae6ce92c.el8.x86_64 2023-11-16T13:55:34.435 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:55:34.435 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2023-11-16T13:55:34.638 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install librados2 2023-11-16T13:55:35.032 INFO:teuthology.orchestra.run.smithi067.stdout:Updating Subscription Management repositories. 2023-11-16T13:55:36.569 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:04:16 ago on Thu 16 Nov 2023 01:51:20 PM UTC. 2023-11-16T13:55:37.943 INFO:teuthology.orchestra.run.smithi067.stdout:Package librados2-2:17.2.7-68.gae6ce92c.el8.x86_64 is already installed. 2023-11-16T13:55:38.440 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2023-11-16T13:55:38.441 INFO:teuthology.orchestra.run.smithi067.stdout:Nothing to do. 2023-11-16T13:55:38.441 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2023-11-16T13:55:38.548 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install librbd1 2023-11-16T13:55:38.943 INFO:teuthology.orchestra.run.smithi067.stdout:Updating Subscription Management repositories. 2023-11-16T13:55:40.707 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:04:20 ago on Thu 16 Nov 2023 01:51:20 PM UTC. 2023-11-16T13:55:42.239 INFO:teuthology.orchestra.run.smithi067.stdout:Package librbd1-2:17.2.7-68.gae6ce92c.el8.x86_64 is already installed. 2023-11-16T13:55:42.763 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2023-11-16T13:55:42.764 INFO:teuthology.orchestra.run.smithi067.stdout:Nothing to do. 2023-11-16T13:55:42.765 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2023-11-16T13:55:42.883 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install python3-rados 2023-11-16T13:55:43.282 INFO:teuthology.orchestra.run.smithi067.stdout:Updating Subscription Management repositories. 2023-11-16T13:55:44.998 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:04:24 ago on Thu 16 Nov 2023 01:51:20 PM UTC. 2023-11-16T13:55:46.389 INFO:teuthology.orchestra.run.smithi067.stdout:Package python3-rados-2:17.2.7-68.gae6ce92c.el8.x86_64 is already installed. 2023-11-16T13:55:46.886 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2023-11-16T13:55:46.887 INFO:teuthology.orchestra.run.smithi067.stdout:Nothing to do. 2023-11-16T13:55:46.888 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2023-11-16T13:55:46.997 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install python3-rgw 2023-11-16T13:55:47.393 INFO:teuthology.orchestra.run.smithi067.stdout:Updating Subscription Management repositories. 2023-11-16T13:55:49.112 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:04:29 ago on Thu 16 Nov 2023 01:51:20 PM UTC. 2023-11-16T13:55:50.480 INFO:teuthology.orchestra.run.smithi067.stdout:Package python3-rgw-2:17.2.7-68.gae6ce92c.el8.x86_64 is already installed. 2023-11-16T13:55:51.003 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2023-11-16T13:55:51.005 INFO:teuthology.orchestra.run.smithi067.stdout:Nothing to do. 2023-11-16T13:55:51.005 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2023-11-16T13:55:51.122 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install python3-cephfs 2023-11-16T13:55:51.518 INFO:teuthology.orchestra.run.smithi067.stdout:Updating Subscription Management repositories. 2023-11-16T13:55:53.279 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:04:33 ago on Thu 16 Nov 2023 01:51:20 PM UTC. 2023-11-16T13:55:54.654 INFO:teuthology.orchestra.run.smithi067.stdout:Package python3-cephfs-2:17.2.7-68.gae6ce92c.el8.x86_64 is already installed. 2023-11-16T13:55:55.162 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2023-11-16T13:55:55.163 INFO:teuthology.orchestra.run.smithi067.stdout:Nothing to do. 2023-11-16T13:55:55.163 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2023-11-16T13:55:55.271 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install python3-rbd 2023-11-16T13:55:55.668 INFO:teuthology.orchestra.run.smithi067.stdout:Updating Subscription Management repositories. 2023-11-16T13:55:57.500 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:04:37 ago on Thu 16 Nov 2023 01:51:20 PM UTC. 2023-11-16T13:55:58.962 INFO:teuthology.orchestra.run.smithi067.stdout:Package python3-rbd-2:17.2.7-68.gae6ce92c.el8.x86_64 is already installed. 2023-11-16T13:55:59.470 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2023-11-16T13:55:59.471 INFO:teuthology.orchestra.run.smithi067.stdout:Nothing to do. 2023-11-16T13:55:59.472 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2023-11-16T13:55:59.589 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install rbd-fuse 2023-11-16T13:55:59.989 INFO:teuthology.orchestra.run.smithi067.stdout:Updating Subscription Management repositories. 2023-11-16T13:56:01.973 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:04:41 ago on Thu 16 Nov 2023 01:51:20 PM UTC. 2023-11-16T13:56:03.947 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2023-11-16T13:56:03.948 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-11-16T13:56:03.948 INFO:teuthology.orchestra.run.smithi067.stdout: Package Architecture Version Repository Size 2023-11-16T13:56:03.948 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-11-16T13:56:03.949 INFO:teuthology.orchestra.run.smithi067.stdout:Installing: 2023-11-16T13:56:03.949 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-fuse x86_64 2:17.2.7-68.gae6ce92c.el8 ceph 90 k 2023-11-16T13:56:03.949 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:56:03.949 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2023-11-16T13:56:03.949 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-11-16T13:56:03.949 INFO:teuthology.orchestra.run.smithi067.stdout:Install 1 Package 2023-11-16T13:56:03.949 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:56:03.949 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 90 k 2023-11-16T13:56:03.949 INFO:teuthology.orchestra.run.smithi067.stdout:Installed size: 264 k 2023-11-16T13:56:03.949 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2023-11-16T13:56:04.134 INFO:teuthology.orchestra.run.smithi067.stdout:rbd-fuse-17.2.7-68.gae6ce92c.el8.x86_64.rpm 487 kB/s | 90 kB 00:00 2023-11-16T13:56:04.135 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2023-11-16T13:56:04.135 INFO:teuthology.orchestra.run.smithi067.stdout:Total 483 kB/s | 90 kB 00:00 2023-11-16T13:56:04.136 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction check 2023-11-16T13:56:04.148 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction check succeeded. 2023-11-16T13:56:04.148 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction test 2023-11-16T13:56:04.209 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction test succeeded. 2023-11-16T13:56:04.213 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction 2023-11-16T13:56:04.336 INFO:teuthology.orchestra.run.smithi067.stdout: Preparing : 1/1 2023-11-16T13:56:04.532 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : rbd-fuse-2:17.2.7-68.gae6ce92c.el8.x86_64 1/1 2023-11-16T13:56:04.812 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: rbd-fuse-2:17.2.7-68.gae6ce92c.el8.x86_64 1/1 2023-11-16T13:56:05.990 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : rbd-fuse-2:17.2.7-68.gae6ce92c.el8.x86_64 1/1 2023-11-16T13:56:05.990 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:04:45 ago on Thu 16 Nov 2023 01:51:20 PM UTC. 2023-11-16T13:56:13.396 INFO:teuthology.orchestra.run.smithi067.stdout:Installed products updated. 2023-11-16T13:56:13.501 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:56:13.501 INFO:teuthology.orchestra.run.smithi067.stdout:Installed: 2023-11-16T13:56:13.501 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-fuse-2:17.2.7-68.gae6ce92c.el8.x86_64 2023-11-16T13:56:13.501 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:56:13.501 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2023-11-16T13:56:13.640 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install rbd-mirror 2023-11-16T13:56:14.036 INFO:teuthology.orchestra.run.smithi067.stdout:Updating Subscription Management repositories. 2023-11-16T13:56:15.996 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:04:55 ago on Thu 16 Nov 2023 01:51:20 PM UTC. 2023-11-16T13:56:17.934 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2023-11-16T13:56:17.934 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-11-16T13:56:17.934 INFO:teuthology.orchestra.run.smithi067.stdout: Package Architecture Version Repository Size 2023-11-16T13:56:17.934 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-11-16T13:56:17.934 INFO:teuthology.orchestra.run.smithi067.stdout:Installing: 2023-11-16T13:56:17.935 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-mirror x86_64 2:17.2.7-68.gae6ce92c.el8 ceph 3.5 M 2023-11-16T13:56:17.935 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:56:17.935 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2023-11-16T13:56:17.935 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-11-16T13:56:17.935 INFO:teuthology.orchestra.run.smithi067.stdout:Install 1 Package 2023-11-16T13:56:17.935 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:56:17.935 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 3.5 M 2023-11-16T13:56:17.936 INFO:teuthology.orchestra.run.smithi067.stdout:Installed size: 16 M 2023-11-16T13:56:17.936 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2023-11-16T13:56:18.932 INFO:teuthology.orchestra.run.smithi067.stdout:rbd-mirror-17.2.7-68.gae6ce92c.el8.x86_64.rpm 3.5 MB/s | 3.5 MB 00:00 2023-11-16T13:56:18.933 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2023-11-16T13:56:18.934 INFO:teuthology.orchestra.run.smithi067.stdout:Total 3.5 MB/s | 3.5 MB 00:00 2023-11-16T13:56:18.934 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction check 2023-11-16T13:56:18.950 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction check succeeded. 2023-11-16T13:56:18.950 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction test 2023-11-16T13:56:19.026 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction test succeeded. 2023-11-16T13:56:19.030 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction 2023-11-16T13:56:19.502 INFO:teuthology.orchestra.run.smithi067.stdout: Preparing : 1/1 2023-11-16T13:56:19.661 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : rbd-mirror-2:17.2.7-68.gae6ce92c.el8.x86_64 1/1 2023-11-16T13:56:20.123 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: rbd-mirror-2:17.2.7-68.gae6ce92c.el8.x86_64 1/1 2023-11-16T13:56:21.140 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : rbd-mirror-2:17.2.7-68.gae6ce92c.el8.x86_64 1/1 2023-11-16T13:56:26.136 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:05:01 ago on Thu 16 Nov 2023 01:51:20 PM UTC. 2023-11-16T13:56:26.136 INFO:teuthology.orchestra.run.smithi067.stdout:Installed products updated. 2023-11-16T13:56:26.162 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:56:26.162 INFO:teuthology.orchestra.run.smithi067.stdout:Installed: 2023-11-16T13:56:26.162 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-mirror-2:17.2.7-68.gae6ce92c.el8.x86_64 2023-11-16T13:56:26.162 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:56:26.162 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2023-11-16T13:56:26.311 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install rbd-nbd 2023-11-16T13:56:26.711 INFO:teuthology.orchestra.run.smithi067.stdout:Updating Subscription Management repositories. 2023-11-16T13:56:28.640 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:05:08 ago on Thu 16 Nov 2023 01:51:20 PM UTC. 2023-11-16T13:56:30.549 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2023-11-16T13:56:30.551 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-11-16T13:56:30.552 INFO:teuthology.orchestra.run.smithi067.stdout: Package Architecture Version Repository Size 2023-11-16T13:56:30.552 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-11-16T13:56:30.552 INFO:teuthology.orchestra.run.smithi067.stdout:Installing: 2023-11-16T13:56:30.552 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-nbd x86_64 2:17.2.7-68.gae6ce92c.el8 ceph 173 k 2023-11-16T13:56:30.552 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:56:30.552 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2023-11-16T13:56:30.552 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-11-16T13:56:30.553 INFO:teuthology.orchestra.run.smithi067.stdout:Install 1 Package 2023-11-16T13:56:30.553 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:56:30.553 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 173 k 2023-11-16T13:56:30.553 INFO:teuthology.orchestra.run.smithi067.stdout:Installed size: 552 k 2023-11-16T13:56:30.553 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2023-11-16T13:56:30.715 INFO:teuthology.orchestra.run.smithi067.stdout:rbd-nbd-17.2.7-68.gae6ce92c.el8.x86_64.rpm 1.0 MB/s | 173 kB 00:00 2023-11-16T13:56:30.716 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2023-11-16T13:56:30.716 INFO:teuthology.orchestra.run.smithi067.stdout:Total 1.0 MB/s | 173 kB 00:00 2023-11-16T13:56:30.716 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction check 2023-11-16T13:56:30.730 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction check succeeded. 2023-11-16T13:56:30.730 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction test 2023-11-16T13:56:30.789 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction test succeeded. 2023-11-16T13:56:30.794 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction 2023-11-16T13:56:30.932 INFO:teuthology.orchestra.run.smithi067.stdout: Preparing : 1/1 2023-11-16T13:56:31.109 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : rbd-nbd-2:17.2.7-68.gae6ce92c.el8.x86_64 1/1 2023-11-16T13:56:31.411 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: rbd-nbd-2:17.2.7-68.gae6ce92c.el8.x86_64 1/1 2023-11-16T13:56:32.504 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : rbd-nbd-2:17.2.7-68.gae6ce92c.el8.x86_64 1/1 2023-11-16T13:56:32.504 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:05:12 ago on Thu 16 Nov 2023 01:51:20 PM UTC. 2023-11-16T13:56:38.981 INFO:teuthology.orchestra.run.smithi067.stdout:Installed products updated. 2023-11-16T13:56:41.371 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:56:41.372 INFO:teuthology.orchestra.run.smithi067.stdout:Installed: 2023-11-16T13:56:41.372 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-nbd-2:17.2.7-68.gae6ce92c.el8.x86_64 2023-11-16T13:56:41.372 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-16T13:56:41.372 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2023-11-16T13:56:41.372 DEBUG:teuthology.parallel:result is None 2023-11-16T13:56:41.373 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ae6ce92c0812ba06c9c623ce72df4f3fc59080b4 2023-11-16T13:56:41.526 DEBUG:teuthology.orchestra.run.smithi067:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-11-16T13:56:41.551 INFO:teuthology.orchestra.run.smithi067.stdout:17.2.7-68.gae6ce92c.el8 2023-11-16T13:56:41.551 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-68.gae6ce92c.el8 2023-11-16T13:56:41.551 INFO:teuthology.task.install:The correct ceph version 17.2.7-68.gae6ce92c is installed. 2023-11-16T13:56:41.552 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-11-16T13:56:41.552 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-11-16T13:56:41.552 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-16T13:56:41.621 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-11-16T13:56:41.622 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-11-16T13:56:41.622 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/usr/bin/daemon-helper 2023-11-16T13:56:41.690 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-16T13:56:41.757 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-11-16T13:56:41.757 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-11-16T13:56:41.757 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-16T13:56:41.824 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-16T13:56:41.891 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-11-16T13:56:41.892 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-11-16T13:56:41.892 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/usr/bin/stdin-killer 2023-11-16T13:56:41.958 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-16T13:56:42.024 INFO:teuthology.run_tasks:Running task exec... 2023-11-16T13:56:42.033 INFO:teuthology.task.exec:Executing custom commands... 2023-11-16T13:56:42.033 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi067.front.sepia.ceph.com 2023-11-16T13:56:42.034 DEBUG:teuthology.orchestra.run.smithi067:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'yum install -y python3 || apt install -y python3' 2023-11-16T13:56:42.462 INFO:teuthology.orchestra.run.smithi067.stdout:Updating Subscription Management repositories. 2023-11-16T13:56:44.274 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:05:24 ago on Thu 16 Nov 2023 01:51:20 PM UTC. 2023-11-16T13:56:45.649 INFO:teuthology.orchestra.run.smithi067.stdout:Package python36-3.6.8-2.module+el8.1.0+3334+5cb623d7.x86_64 is already installed. 2023-11-16T13:56:46.151 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2023-11-16T13:56:46.152 INFO:teuthology.orchestra.run.smithi067.stdout:Nothing to do. 2023-11-16T13:56:46.152 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2023-11-16T13:56:46.261 INFO:teuthology.run_tasks:Running task workunit... 2023-11-16T13:56:46.274 INFO:tasks.workunit:Pulling workunits from ref ae6ce92c0812ba06c9c623ce72df4f3fc59080b4 2023-11-16T13:56:46.275 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-11-16T13:56:46.275 DEBUG:teuthology.orchestra.run.smithi067:> stat -- /home/ubuntu/cephtest/mnt.0 2023-11-16T13:56:46.291 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-16T13:56:46.292 INFO:teuthology.orchestra.run.smithi067.stderr:stat: cannot stat '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-11-16T13:56:46.292 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -- /home/ubuntu/cephtest/mnt.0 2023-11-16T13:56:46.347 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2023-11-16T13:56:46.347 DEBUG:teuthology.orchestra.run.smithi067:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2023-11-16T13:56:46.401 INFO:tasks.workunit:timeout=3h 2023-11-16T13:56:46.402 INFO:tasks.workunit:cleanup=True 2023-11-16T13:56:46.402 DEBUG:teuthology.orchestra.run.smithi067:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout ae6ce92c0812ba06c9c623ce72df4f3fc59080b4 2023-11-16T13:56:46.457 INFO:tasks.workunit.client.0.smithi067.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-11-16T13:57:53.507 INFO:tasks.workunit.client.0.smithi067.stderr:Updating files: 93% (11299/12074) Updating files: 94% (11350/12074) Updating files: 95% (11471/12074) Updating files: 96% (11592/12074) Updating files: 97% (11712/12074) Updating files: 98% (11833/12074) Updating files: 99% (11954/12074) Updating files: 100% (12074/12074) Updating files: 100% (12074/12074), done. 2023-11-16T13:57:54.412 INFO:tasks.workunit.client.0.smithi067.stderr:Note: switching to 'ae6ce92c0812ba06c9c623ce72df4f3fc59080b4'. 2023-11-16T13:57:54.412 INFO:tasks.workunit.client.0.smithi067.stderr: 2023-11-16T13:57:54.412 INFO:tasks.workunit.client.0.smithi067.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-11-16T13:57:54.412 INFO:tasks.workunit.client.0.smithi067.stderr:changes and commit them, and you can discard any commits you make in this 2023-11-16T13:57:54.413 INFO:tasks.workunit.client.0.smithi067.stderr:state without impacting any branches by switching back to a branch. 2023-11-16T13:57:54.413 INFO:tasks.workunit.client.0.smithi067.stderr: 2023-11-16T13:57:54.413 INFO:tasks.workunit.client.0.smithi067.stderr:If you want to create a new branch to retain commits you create, you may 2023-11-16T13:57:54.413 INFO:tasks.workunit.client.0.smithi067.stderr:do so (now or later) by using -c with the switch command. Example: 2023-11-16T13:57:54.413 INFO:tasks.workunit.client.0.smithi067.stderr: 2023-11-16T13:57:54.414 INFO:tasks.workunit.client.0.smithi067.stderr: git switch -c 2023-11-16T13:57:54.414 INFO:tasks.workunit.client.0.smithi067.stderr: 2023-11-16T13:57:54.414 INFO:tasks.workunit.client.0.smithi067.stderr:Or undo this operation with: 2023-11-16T13:57:54.415 INFO:tasks.workunit.client.0.smithi067.stderr: 2023-11-16T13:57:54.416 INFO:tasks.workunit.client.0.smithi067.stderr: git switch - 2023-11-16T13:57:54.416 INFO:tasks.workunit.client.0.smithi067.stderr: 2023-11-16T13:57:54.416 INFO:tasks.workunit.client.0.smithi067.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-11-16T13:57:54.417 INFO:tasks.workunit.client.0.smithi067.stderr: 2023-11-16T13:57:54.417 INFO:tasks.workunit.client.0.smithi067.stderr:HEAD is now at ae6ce92c081 ceph-volume: fix a regression in `raw list` 2023-11-16T13:57:54.419 DEBUG:teuthology.orchestra.run.smithi067:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-11-16T13:57:54.483 INFO:tasks.workunit.client.0.smithi067.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-11-16T13:57:54.485 INFO:tasks.workunit.client.0.smithi067.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-11-16T13:57:54.485 INFO:tasks.workunit.client.0.smithi067.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-11-16T13:57:55.063 INFO:tasks.workunit.client.0.smithi067.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-11-16T13:57:55.118 INFO:tasks.workunit.client.0.smithi067.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-11-16T13:57:55.158 INFO:tasks.workunit.client.0.smithi067.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-11-16T13:57:55.159 INFO:tasks.workunit.client.0.smithi067.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-11-16T13:57:55.159 INFO:tasks.workunit.client.0.smithi067.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-11-16T13:57:55.198 INFO:tasks.workunit.client.0.smithi067.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-11-16T13:57:55.201 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-11-16T13:57:55.201 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-11-16T13:57:55.258 INFO:tasks.workunit:Running workunits matching cephadm/test_cephadm.sh on client.0... 2023-11-16T13:57:55.259 INFO:tasks.workunit:Running workunit cephadm/test_cephadm.sh... 2023-11-16T13:57:55.259 DEBUG:teuthology.orchestra.run.smithi067:workunit test cephadm/test_cephadm.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ae6ce92c0812ba06c9c623ce72df4f3fc59080b4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh 2023-11-16T13:57:55.324 INFO:tasks.workunit.client.0.smithi067.stderr:++ basename /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh 2023-11-16T13:57:55.324 INFO:tasks.workunit.client.0.smithi067.stderr:+ SCRIPT_NAME=test_cephadm.sh 2023-11-16T13:57:55.325 INFO:tasks.workunit.client.0.smithi067.stderr:+++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh 2023-11-16T13:57:55.327 INFO:tasks.workunit.client.0.smithi067.stderr:++ cd /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm 2023-11-16T13:57:55.327 INFO:tasks.workunit.client.0.smithi067.stderr:++ pwd 2023-11-16T13:57:55.328 INFO:tasks.workunit.client.0.smithi067.stderr:+ SCRIPT_DIR=/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm 2023-11-16T13:57:55.328 INFO:tasks.workunit.client.0.smithi067.stderr:+ '[' -z '' ']' 2023-11-16T13:57:55.328 INFO:tasks.workunit.client.0.smithi067.stderr:+ CLEANUP=true 2023-11-16T13:57:55.328 INFO:tasks.workunit.client.0.smithi067.stderr:+ FSID=00000000-0000-0000-0000-0000deadbeef 2023-11-16T13:57:55.328 INFO:tasks.workunit.client.0.smithi067.stderr:+ IMAGE_MAIN=quay.ceph.io/ceph-ci/ceph:main 2023-11-16T13:57:55.328 INFO:tasks.workunit.client.0.smithi067.stderr:+ IMAGE_QUINCY=quay.ceph.io/ceph-ci/ceph:quincy 2023-11-16T13:57:55.328 INFO:tasks.workunit.client.0.smithi067.stderr:+ IMAGE_PACIFIC=quay.ceph.io/ceph-ci/ceph:pacific 2023-11-16T13:57:55.328 INFO:tasks.workunit.client.0.smithi067.stderr:+ IMAGE_DEFAULT=quay.ceph.io/ceph-ci/ceph:quincy 2023-11-16T13:57:55.328 INFO:tasks.workunit.client.0.smithi067.stderr:+ OSD_IMAGE_NAME=test_cephadm_osd.img 2023-11-16T13:57:55.328 INFO:tasks.workunit.client.0.smithi067.stderr:+ OSD_IMAGE_SIZE=6G 2023-11-16T13:57:55.328 INFO:tasks.workunit.client.0.smithi067.stderr:+ OSD_TO_CREATE=2 2023-11-16T13:57:55.328 INFO:tasks.workunit.client.0.smithi067.stderr:+ OSD_VG_NAME=test_cephadm 2023-11-16T13:57:55.329 INFO:tasks.workunit.client.0.smithi067.stderr:+ OSD_LV_NAME=test_cephadm 2023-11-16T13:57:55.329 INFO:tasks.workunit.client.0.smithi067.stderr:+ CEPHADM_SRC_DIR=/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm 2023-11-16T13:57:55.329 INFO:tasks.workunit.client.0.smithi067.stderr:+ CEPHADM_SAMPLES_DIR=/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/samples 2023-11-16T13:57:55.329 INFO:tasks.workunit.client.0.smithi067.stderr:+ '[' -z '' ']' 2023-11-16T13:57:55.329 INFO:tasks.workunit.client.0.smithi067.stderr:+ SUDO=sudo 2023-11-16T13:57:55.329 INFO:tasks.workunit.client.0.smithi067.stderr:+ '[' -z '' ']' 2023-11-16T13:57:55.329 INFO:tasks.workunit.client.0.smithi067.stderr:+ CEPHADM=/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm 2023-11-16T13:57:55.329 INFO:tasks.workunit.client.0.smithi067.stderr:+ '[' -x /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm ']' 2023-11-16T13:57:55.329 INFO:tasks.workunit.client.0.smithi067.stderr:+ CEPHADM_ARGS=' --image quay.ceph.io/ceph-ci/ceph:quincy' 2023-11-16T13:57:55.329 INFO:tasks.workunit.client.0.smithi067.stderr:+ CEPHADM_BIN=/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm 2023-11-16T13:57:55.329 INFO:tasks.workunit.client.0.smithi067.stderr:+ CEPHADM='sudo /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy' 2023-11-16T13:57:55.329 INFO:tasks.workunit.client.0.smithi067.stderr:+ sudo /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy rm-cluster --fsid 00000000-0000-0000-0000-0000deadbeef --force 2023-11-16T13:57:58.867 INFO:tasks.workunit.client.0.smithi067.stderr:+ sudo vgchange -an test_cephadm 2023-11-16T13:57:58.889 INFO:tasks.workunit.client.0.smithi067.stderr: Volume group "test_cephadm" not found 2023-11-16T13:57:58.890 INFO:tasks.workunit.client.0.smithi067.stderr: Cannot process volume group test_cephadm 2023-11-16T13:57:58.913 INFO:tasks.workunit.client.0.smithi067.stderr:+ true 2023-11-16T13:57:58.913 INFO:tasks.workunit.client.0.smithi067.stderr:++ sudo losetup -a 2023-11-16T13:57:58.913 INFO:tasks.workunit.client.0.smithi067.stderr:++ awk -F : '{print $1}' 2023-11-16T13:57:58.914 INFO:tasks.workunit.client.0.smithi067.stderr:+++ basename test_cephadm_osd.img 2023-11-16T13:57:58.914 INFO:tasks.workunit.client.0.smithi067.stderr:++ grep test_cephadm_osd.img 2023-11-16T13:57:58.925 INFO:tasks.workunit.client.0.smithi067.stderr:+ loopdev= 2023-11-16T13:57:58.926 INFO:tasks.workunit.client.0.smithi067.stderr:+ '[' '' = '' ']' 2023-11-16T13:57:58.926 INFO:tasks.workunit.client.0.smithi067.stderr:+ '[' -d '' ']' 2023-11-16T13:57:58.926 INFO:tasks.workunit.client.0.smithi067.stderr:++ mktemp -d tmp.test_cephadm.sh.XXXXXX 2023-11-16T13:57:58.927 INFO:tasks.workunit.client.0.smithi067.stderr:+ TMPDIR=tmp.test_cephadm.sh.Kh7Xjy 2023-11-16T13:57:58.927 INFO:tasks.workunit.client.0.smithi067.stderr:+ '[' -d '' ']' 2023-11-16T13:57:58.927 INFO:tasks.workunit.client.0.smithi067.stderr:++ mktemp -d tmp.test_cephadm.sh.XXXXXX 2023-11-16T13:57:58.927 INFO:tasks.workunit.client.0.smithi067.stderr:+ TMPDIR_TEST_MULTIPLE_MOUNTS=tmp.test_cephadm.sh.KLwpMq 2023-11-16T13:57:58.927 INFO:tasks.workunit.client.0.smithi067.stderr:+ trap cleanup EXIT 2023-11-16T13:57:58.927 INFO:tasks.workunit.client.0.smithi067.stderr:+ sudo sudo /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy check-host 2023-11-16T13:57:59.170 INFO:tasks.workunit.client.0.smithi067.stderr:podman (/bin/podman) version 3.0.1 is present 2023-11-16T13:57:59.170 INFO:tasks.workunit.client.0.smithi067.stderr:systemctl is present 2023-11-16T13:57:59.171 INFO:tasks.workunit.client.0.smithi067.stderr:lvcreate is present 2023-11-16T13:57:59.195 INFO:tasks.workunit.client.0.smithi067.stderr:Unit chronyd.service is enabled and running 2023-11-16T13:57:59.196 INFO:tasks.workunit.client.0.smithi067.stderr:Host looks OK 2023-11-16T13:57:59.214 INFO:tasks.workunit.client.0.smithi067.stderr:+ sudo sudo /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy gather-facts 2023-11-16T13:57:59.587 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2023-11-16T13:57:59.587 INFO:tasks.workunit.client.0.smithi067.stdout: "arch": "x86_64", 2023-11-16T13:57:59.587 INFO:tasks.workunit.client.0.smithi067.stdout: "bios_date": "12/17/2015", 2023-11-16T13:57:59.587 INFO:tasks.workunit.client.0.smithi067.stdout: "bios_version": "2.0", 2023-11-16T13:57:59.587 INFO:tasks.workunit.client.0.smithi067.stdout: "cpu_cores": 4, 2023-11-16T13:57:59.588 INFO:tasks.workunit.client.0.smithi067.stdout: "cpu_count": 1, 2023-11-16T13:57:59.588 INFO:tasks.workunit.client.0.smithi067.stdout: "cpu_load": { 2023-11-16T13:57:59.588 INFO:tasks.workunit.client.0.smithi067.stdout: "15min": 0.78, 2023-11-16T13:57:59.588 INFO:tasks.workunit.client.0.smithi067.stdout: "1min": 1.5, 2023-11-16T13:57:59.588 INFO:tasks.workunit.client.0.smithi067.stdout: "5min": 1.08 2023-11-16T13:57:59.588 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2023-11-16T13:57:59.588 INFO:tasks.workunit.client.0.smithi067.stdout: "cpu_model": "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", 2023-11-16T13:57:59.588 INFO:tasks.workunit.client.0.smithi067.stdout: "cpu_threads": 8, 2023-11-16T13:57:59.588 INFO:tasks.workunit.client.0.smithi067.stdout: "flash_capacity": "400.1GB", 2023-11-16T13:57:59.588 INFO:tasks.workunit.client.0.smithi067.stdout: "flash_capacity_bytes": 400088457216, 2023-11-16T13:57:59.588 INFO:tasks.workunit.client.0.smithi067.stdout: "flash_count": 1, 2023-11-16T13:57:59.588 INFO:tasks.workunit.client.0.smithi067.stdout: "flash_list": [ 2023-11-16T13:57:59.588 INFO:tasks.workunit.client.0.smithi067.stdout: { 2023-11-16T13:57:59.589 INFO:tasks.workunit.client.0.smithi067.stdout: "description": "Unknown INTEL SSDPEDMD400G4 (400.1GB)", 2023-11-16T13:57:59.589 INFO:tasks.workunit.client.0.smithi067.stdout: "dev_name": "nvme0n1", 2023-11-16T13:57:59.589 INFO:tasks.workunit.client.0.smithi067.stdout: "disk_size_bytes": 400088457216, 2023-11-16T13:57:59.589 INFO:tasks.workunit.client.0.smithi067.stdout: "model": "INTEL SSDPEDMD400G4", 2023-11-16T13:57:59.589 INFO:tasks.workunit.client.0.smithi067.stdout: "rev": "Unknown", 2023-11-16T13:57:59.589 INFO:tasks.workunit.client.0.smithi067.stdout: "vendor": "Unknown", 2023-11-16T13:57:59.589 INFO:tasks.workunit.client.0.smithi067.stdout: "wwid": "Unknown" 2023-11-16T13:57:59.589 INFO:tasks.workunit.client.0.smithi067.stdout: } 2023-11-16T13:57:59.589 INFO:tasks.workunit.client.0.smithi067.stdout: ], 2023-11-16T13:57:59.589 INFO:tasks.workunit.client.0.smithi067.stdout: "fqdn": "smithi067.front.sepia.ceph.com", 2023-11-16T13:57:59.589 INFO:tasks.workunit.client.0.smithi067.stdout: "hdd_capacity": "1.0TB", 2023-11-16T13:57:59.589 INFO:tasks.workunit.client.0.smithi067.stdout: "hdd_capacity_bytes": 1000204886016, 2023-11-16T13:57:59.589 INFO:tasks.workunit.client.0.smithi067.stdout: "hdd_count": 1, 2023-11-16T13:57:59.590 INFO:tasks.workunit.client.0.smithi067.stdout: "hdd_list": [ 2023-11-16T13:57:59.590 INFO:tasks.workunit.client.0.smithi067.stdout: { 2023-11-16T13:57:59.590 INFO:tasks.workunit.client.0.smithi067.stdout: "description": "ATA ST1000NM0033-9ZM (1.0TB)", 2023-11-16T13:57:59.590 INFO:tasks.workunit.client.0.smithi067.stdout: "dev_name": "sda", 2023-11-16T13:57:59.590 INFO:tasks.workunit.client.0.smithi067.stdout: "disk_size_bytes": 1000204886016, 2023-11-16T13:57:59.590 INFO:tasks.workunit.client.0.smithi067.stdout: "model": "ST1000NM0033-9ZM", 2023-11-16T13:57:59.590 INFO:tasks.workunit.client.0.smithi067.stdout: "rev": "SN04", 2023-11-16T13:57:59.590 INFO:tasks.workunit.client.0.smithi067.stdout: "vendor": "ATA", 2023-11-16T13:57:59.590 INFO:tasks.workunit.client.0.smithi067.stdout: "wwid": "t10.ATA ST1000NM0033-9ZM173 Z1W4W31M" 2023-11-16T13:57:59.590 INFO:tasks.workunit.client.0.smithi067.stdout: } 2023-11-16T13:57:59.590 INFO:tasks.workunit.client.0.smithi067.stdout: ], 2023-11-16T13:57:59.590 INFO:tasks.workunit.client.0.smithi067.stdout: "hostname": "smithi067", 2023-11-16T13:57:59.590 INFO:tasks.workunit.client.0.smithi067.stdout: "interfaces": { 2023-11-16T13:57:59.591 INFO:tasks.workunit.client.0.smithi067.stdout: "eno1": { 2023-11-16T13:57:59.591 INFO:tasks.workunit.client.0.smithi067.stdout: "driver": "igb", 2023-11-16T13:57:59.591 INFO:tasks.workunit.client.0.smithi067.stdout: "iftype": "physical", 2023-11-16T13:57:59.591 INFO:tasks.workunit.client.0.smithi067.stdout: "ipv4_address": "", 2023-11-16T13:57:59.591 INFO:tasks.workunit.client.0.smithi067.stdout: "ipv6_address": "", 2023-11-16T13:57:59.591 INFO:tasks.workunit.client.0.smithi067.stdout: "lower_devs_list": [], 2023-11-16T13:57:59.591 INFO:tasks.workunit.client.0.smithi067.stdout: "mtu": 1500, 2023-11-16T13:57:59.591 INFO:tasks.workunit.client.0.smithi067.stdout: "nic_type": "ethernet", 2023-11-16T13:57:59.591 INFO:tasks.workunit.client.0.smithi067.stdout: "operstate": "down", 2023-11-16T13:57:59.591 INFO:tasks.workunit.client.0.smithi067.stdout: "speed": -1, 2023-11-16T13:57:59.591 INFO:tasks.workunit.client.0.smithi067.stdout: "upper_devs_list": [] 2023-11-16T13:57:59.591 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2023-11-16T13:57:59.591 INFO:tasks.workunit.client.0.smithi067.stdout: "eno2": { 2023-11-16T13:57:59.592 INFO:tasks.workunit.client.0.smithi067.stdout: "driver": "igb", 2023-11-16T13:57:59.592 INFO:tasks.workunit.client.0.smithi067.stdout: "iftype": "physical", 2023-11-16T13:57:59.592 INFO:tasks.workunit.client.0.smithi067.stdout: "ipv4_address": "", 2023-11-16T13:57:59.592 INFO:tasks.workunit.client.0.smithi067.stdout: "ipv6_address": "", 2023-11-16T13:57:59.592 INFO:tasks.workunit.client.0.smithi067.stdout: "lower_devs_list": [], 2023-11-16T13:57:59.592 INFO:tasks.workunit.client.0.smithi067.stdout: "mtu": 1500, 2023-11-16T13:57:59.592 INFO:tasks.workunit.client.0.smithi067.stdout: "nic_type": "ethernet", 2023-11-16T13:57:59.592 INFO:tasks.workunit.client.0.smithi067.stdout: "operstate": "down", 2023-11-16T13:57:59.592 INFO:tasks.workunit.client.0.smithi067.stdout: "speed": -1, 2023-11-16T13:57:59.592 INFO:tasks.workunit.client.0.smithi067.stdout: "upper_devs_list": [] 2023-11-16T13:57:59.592 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2023-11-16T13:57:59.592 INFO:tasks.workunit.client.0.smithi067.stdout: "enp3s0f0": { 2023-11-16T13:57:59.592 INFO:tasks.workunit.client.0.smithi067.stdout: "driver": "ixgbe", 2023-11-16T13:57:59.592 INFO:tasks.workunit.client.0.smithi067.stdout: "iftype": "physical", 2023-11-16T13:57:59.593 INFO:tasks.workunit.client.0.smithi067.stdout: "ipv4_address": "", 2023-11-16T13:57:59.593 INFO:tasks.workunit.client.0.smithi067.stdout: "ipv6_address": "", 2023-11-16T13:57:59.593 INFO:tasks.workunit.client.0.smithi067.stdout: "lower_devs_list": [], 2023-11-16T13:57:59.593 INFO:tasks.workunit.client.0.smithi067.stdout: "mtu": 1500, 2023-11-16T13:57:59.593 INFO:tasks.workunit.client.0.smithi067.stdout: "nic_type": "ethernet", 2023-11-16T13:57:59.593 INFO:tasks.workunit.client.0.smithi067.stdout: "operstate": "down", 2023-11-16T13:57:59.593 INFO:tasks.workunit.client.0.smithi067.stdout: "speed": -1, 2023-11-16T13:57:59.593 INFO:tasks.workunit.client.0.smithi067.stdout: "upper_devs_list": [] 2023-11-16T13:57:59.593 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2023-11-16T13:57:59.593 INFO:tasks.workunit.client.0.smithi067.stdout: "enp3s0f1": { 2023-11-16T13:57:59.593 INFO:tasks.workunit.client.0.smithi067.stdout: "driver": "ixgbe", 2023-11-16T13:57:59.593 INFO:tasks.workunit.client.0.smithi067.stdout: "iftype": "physical", 2023-11-16T13:57:59.593 INFO:tasks.workunit.client.0.smithi067.stdout: "ipv4_address": "172.21.15.67/20", 2023-11-16T13:57:59.594 INFO:tasks.workunit.client.0.smithi067.stdout: "ipv6_address": "fe80::ec4:7aff:feb6:fc0b/64", 2023-11-16T13:57:59.594 INFO:tasks.workunit.client.0.smithi067.stdout: "lower_devs_list": [], 2023-11-16T13:57:59.594 INFO:tasks.workunit.client.0.smithi067.stdout: "mtu": 1500, 2023-11-16T13:57:59.594 INFO:tasks.workunit.client.0.smithi067.stdout: "nic_type": "ethernet", 2023-11-16T13:57:59.594 INFO:tasks.workunit.client.0.smithi067.stdout: "operstate": "up", 2023-11-16T13:57:59.594 INFO:tasks.workunit.client.0.smithi067.stdout: "speed": 10000, 2023-11-16T13:57:59.594 INFO:tasks.workunit.client.0.smithi067.stdout: "upper_devs_list": [] 2023-11-16T13:57:59.594 INFO:tasks.workunit.client.0.smithi067.stdout: } 2023-11-16T13:57:59.594 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2023-11-16T13:57:59.594 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel": "4.18.0-425.3.1.el8.x86_64", 2023-11-16T13:57:59.594 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel_parameters": { 2023-11-16T13:57:59.594 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.ip_nonlocal_bind": "0" 2023-11-16T13:57:59.594 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2023-11-16T13:57:59.595 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel_security": { 2023-11-16T13:57:59.595 INFO:tasks.workunit.client.0.smithi067.stdout: "description": "SELinux: Enabled(permissive, targeted)", 2023-11-16T13:57:59.595 INFO:tasks.workunit.client.0.smithi067.stdout: "type": "SELinux" 2023-11-16T13:57:59.595 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2023-11-16T13:57:59.595 INFO:tasks.workunit.client.0.smithi067.stdout: "memory_available_kb": 31765436, 2023-11-16T13:57:59.595 INFO:tasks.workunit.client.0.smithi067.stdout: "memory_free_kb": 29381896, 2023-11-16T13:57:59.595 INFO:tasks.workunit.client.0.smithi067.stdout: "memory_total_kb": 32605524, 2023-11-16T13:57:59.595 INFO:tasks.workunit.client.0.smithi067.stdout: "model": "Default string (SYS-5018R-WR)", 2023-11-16T13:57:59.595 INFO:tasks.workunit.client.0.smithi067.stdout: "nic_count": 4, 2023-11-16T13:57:59.595 INFO:tasks.workunit.client.0.smithi067.stdout: "operating_system": "Red Hat Enterprise Linux 8.4 (Ootpa)", 2023-11-16T13:57:59.595 INFO:tasks.workunit.client.0.smithi067.stdout: "selinux_enabled": true, 2023-11-16T13:57:59.595 INFO:tasks.workunit.client.0.smithi067.stdout: "shortname": "smithi067", 2023-11-16T13:57:59.595 INFO:tasks.workunit.client.0.smithi067.stdout: "subscribed": "Yes", 2023-11-16T13:57:59.595 INFO:tasks.workunit.client.0.smithi067.stdout: "sysctl_options": { 2023-11-16T13:57:59.596 INFO:tasks.workunit.client.0.smithi067.stdout: "abi.vsyscall32": "1", 2023-11-16T13:57:59.596 INFO:tasks.workunit.client.0.smithi067.stdout: "crypto.fips_enabled": "0", 2023-11-16T13:57:59.596 INFO:tasks.workunit.client.0.smithi067.stdout: "crypto.fips_name": "Red Hat Enterprise Linux 8 - Kernel Cryptographic API", 2023-11-16T13:57:59.596 INFO:tasks.workunit.client.0.smithi067.stdout: "crypto.fips_version": "4.18.0-425.3.1.el8.x86_64", 2023-11-16T13:57:59.596 INFO:tasks.workunit.client.0.smithi067.stdout: "debug.exception-trace": "1", 2023-11-16T13:57:59.596 INFO:tasks.workunit.client.0.smithi067.stdout: "debug.kprobes-optimization": "1", 2023-11-16T13:57:59.596 INFO:tasks.workunit.client.0.smithi067.stdout: "dev.hpet.max-user-freq": "64", 2023-11-16T13:57:59.597 INFO:tasks.workunit.client.0.smithi067.stdout: "dev.mac_hid.mouse_button2_keycode": "97", 2023-11-16T13:57:59.597 INFO:tasks.workunit.client.0.smithi067.stdout: "dev.mac_hid.mouse_button3_keycode": "100", 2023-11-16T13:57:59.597 INFO:tasks.workunit.client.0.smithi067.stdout: "dev.mac_hid.mouse_button_emulation": "0", 2023-11-16T13:57:59.597 INFO:tasks.workunit.client.0.smithi067.stdout: "dev.raid.speed_limit_max": "200000", 2023-11-16T13:57:59.597 INFO:tasks.workunit.client.0.smithi067.stdout: "dev.raid.speed_limit_min": "1000", 2023-11-16T13:57:59.597 INFO:tasks.workunit.client.0.smithi067.stdout: "dev.scsi.logging_level": "0", 2023-11-16T13:57:59.598 INFO:tasks.workunit.client.0.smithi067.stdout: "fs.aio-max-nr": "1048576", 2023-11-16T13:57:59.598 INFO:tasks.workunit.client.0.smithi067.stdout: "fs.aio-nr": "0", 2023-11-16T13:57:59.598 INFO:tasks.workunit.client.0.smithi067.stdout: "fs.binfmt_misc.status": "enabled", 2023-11-16T13:57:59.598 INFO:tasks.workunit.client.0.smithi067.stdout: "fs.dentry-state": "120068\t96499\t45\t0\t13728\t0", 2023-11-16T13:57:59.598 INFO:tasks.workunit.client.0.smithi067.stdout: "fs.dir-notify-enable": "1", 2023-11-16T13:57:59.598 INFO:tasks.workunit.client.0.smithi067.stdout: "fs.epoll.max_user_watches": "6670766", 2023-11-16T13:57:59.599 INFO:tasks.workunit.client.0.smithi067.stdout: "fs.file-max": "3248335", 2023-11-16T13:57:59.599 INFO:tasks.workunit.client.0.smithi067.stdout: "fs.file-nr": "2048\t0\t3248335", 2023-11-16T13:57:59.599 INFO:tasks.workunit.client.0.smithi067.stdout: "fs.inode-nr": "104106\t469", 2023-11-16T13:57:59.599 INFO:tasks.workunit.client.0.smithi067.stdout: "fs.inode-state": "104106\t469\t0\t0\t0\t0\t0", 2023-11-16T13:57:59.599 INFO:tasks.workunit.client.0.smithi067.stdout: "fs.inotify.max_queued_events": "16384", 2023-11-16T13:57:59.599 INFO:tasks.workunit.client.0.smithi067.stdout: "fs.inotify.max_user_instances": "128", 2023-11-16T13:57:59.600 INFO:tasks.workunit.client.0.smithi067.stdout: "fs.inotify.max_user_watches": "242396", 2023-11-16T13:57:59.600 INFO:tasks.workunit.client.0.smithi067.stdout: "fs.lease-break-time": "45", 2023-11-16T13:57:59.600 INFO:tasks.workunit.client.0.smithi067.stdout: "fs.leases-enable": "1", 2023-11-16T13:57:59.600 INFO:tasks.workunit.client.0.smithi067.stdout: "fs.mount-max": "100000", 2023-11-16T13:57:59.600 INFO:tasks.workunit.client.0.smithi067.stdout: "fs.mqueue.msg_default": "10", 2023-11-16T13:57:59.600 INFO:tasks.workunit.client.0.smithi067.stdout: "fs.mqueue.msg_max": "10", 2023-11-16T13:57:59.600 INFO:tasks.workunit.client.0.smithi067.stdout: "fs.mqueue.msgsize_default": "8192", 2023-11-16T13:57:59.600 INFO:tasks.workunit.client.0.smithi067.stdout: "fs.mqueue.msgsize_max": "8192", 2023-11-16T13:57:59.600 INFO:tasks.workunit.client.0.smithi067.stdout: "fs.mqueue.queues_max": "256", 2023-11-16T13:57:59.601 INFO:tasks.workunit.client.0.smithi067.stdout: "fs.nr_open": "1048576", 2023-11-16T13:57:59.601 INFO:tasks.workunit.client.0.smithi067.stdout: "fs.overflowgid": "65534", 2023-11-16T13:57:59.601 INFO:tasks.workunit.client.0.smithi067.stdout: "fs.overflowuid": "65534", 2023-11-16T13:57:59.601 INFO:tasks.workunit.client.0.smithi067.stdout: "fs.pipe-max-size": "1048576", 2023-11-16T13:57:59.601 INFO:tasks.workunit.client.0.smithi067.stdout: "fs.pipe-user-pages-hard": "0", 2023-11-16T13:57:59.601 INFO:tasks.workunit.client.0.smithi067.stdout: "fs.pipe-user-pages-soft": "16384", 2023-11-16T13:57:59.601 INFO:tasks.workunit.client.0.smithi067.stdout: "fs.protected_fifos": "0", 2023-11-16T13:57:59.601 INFO:tasks.workunit.client.0.smithi067.stdout: "fs.protected_hardlinks": "1", 2023-11-16T13:57:59.602 INFO:tasks.workunit.client.0.smithi067.stdout: "fs.protected_regular": "0", 2023-11-16T13:57:59.602 INFO:tasks.workunit.client.0.smithi067.stdout: "fs.protected_symlinks": "1", 2023-11-16T13:57:59.602 INFO:tasks.workunit.client.0.smithi067.stdout: "fs.quota.allocated_dquots": "0", 2023-11-16T13:57:59.602 INFO:tasks.workunit.client.0.smithi067.stdout: "fs.quota.cache_hits": "0", 2023-11-16T13:57:59.602 INFO:tasks.workunit.client.0.smithi067.stdout: "fs.quota.drops": "0", 2023-11-16T13:57:59.603 INFO:tasks.workunit.client.0.smithi067.stdout: "fs.quota.free_dquots": "0", 2023-11-16T13:57:59.603 INFO:tasks.workunit.client.0.smithi067.stdout: "fs.quota.lookups": "0", 2023-11-16T13:57:59.603 INFO:tasks.workunit.client.0.smithi067.stdout: "fs.quota.reads": "0", 2023-11-16T13:57:59.603 INFO:tasks.workunit.client.0.smithi067.stdout: "fs.quota.syncs": "28", 2023-11-16T13:57:59.603 INFO:tasks.workunit.client.0.smithi067.stdout: "fs.quota.warnings": "1", 2023-11-16T13:57:59.603 INFO:tasks.workunit.client.0.smithi067.stdout: "fs.quota.writes": "0", 2023-11-16T13:57:59.603 INFO:tasks.workunit.client.0.smithi067.stdout: "fs.suid_dumpable": "0", 2023-11-16T13:57:59.603 INFO:tasks.workunit.client.0.smithi067.stdout: "fs.xfs.error_level": "3", 2023-11-16T13:57:59.604 INFO:tasks.workunit.client.0.smithi067.stdout: "fs.xfs.filestream_centisecs": "3000", 2023-11-16T13:57:59.604 INFO:tasks.workunit.client.0.smithi067.stdout: "fs.xfs.inherit_noatime": "1", 2023-11-16T13:57:59.604 INFO:tasks.workunit.client.0.smithi067.stdout: "fs.xfs.inherit_nodefrag": "1", 2023-11-16T13:57:59.604 INFO:tasks.workunit.client.0.smithi067.stdout: "fs.xfs.inherit_nodump": "1", 2023-11-16T13:57:59.604 INFO:tasks.workunit.client.0.smithi067.stdout: "fs.xfs.inherit_nosymlinks": "0", 2023-11-16T13:57:59.604 INFO:tasks.workunit.client.0.smithi067.stdout: "fs.xfs.inherit_sync": "1", 2023-11-16T13:57:59.605 INFO:tasks.workunit.client.0.smithi067.stdout: "fs.xfs.irix_sgid_inherit": "0", 2023-11-16T13:57:59.605 INFO:tasks.workunit.client.0.smithi067.stdout: "fs.xfs.irix_symlink_mode": "0", 2023-11-16T13:57:59.605 INFO:tasks.workunit.client.0.smithi067.stdout: "fs.xfs.panic_mask": "0", 2023-11-16T13:57:59.605 INFO:tasks.workunit.client.0.smithi067.stdout: "fs.xfs.rotorstep": "1", 2023-11-16T13:57:59.605 INFO:tasks.workunit.client.0.smithi067.stdout: "fs.xfs.speculative_cow_prealloc_lifetime": "300", 2023-11-16T13:57:59.605 INFO:tasks.workunit.client.0.smithi067.stdout: "fs.xfs.speculative_prealloc_lifetime": "300", 2023-11-16T13:57:59.605 INFO:tasks.workunit.client.0.smithi067.stdout: "fs.xfs.stats_clear": "0", 2023-11-16T13:57:59.605 INFO:tasks.workunit.client.0.smithi067.stdout: "fs.xfs.xfssyncd_centisecs": "3000", 2023-11-16T13:57:59.605 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.acct": "4\t2\t30", 2023-11-16T13:57:59.605 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.acpi_video_flags": "0", 2023-11-16T13:57:59.605 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.auto_msgmni": "0", 2023-11-16T13:57:59.605 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.bootloader_type": "114", 2023-11-16T13:57:59.606 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.bootloader_version": "2", 2023-11-16T13:57:59.606 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.bpf_stats_enabled": "0", 2023-11-16T13:57:59.606 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.cad_pid": "1", 2023-11-16T13:57:59.606 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.cap_last_cap": "40", 2023-11-16T13:57:59.606 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.core_pattern": "/home/ubuntu/cephtest/archive/coredump/%t.%p.core", 2023-11-16T13:57:59.606 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.core_pipe_limit": "16", 2023-11-16T13:57:59.606 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.core_uses_pid": "1", 2023-11-16T13:57:59.606 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.ctrl-alt-del": "0", 2023-11-16T13:57:59.606 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.dmesg_restrict": "0", 2023-11-16T13:57:59.606 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.domainname": "(none)", 2023-11-16T13:57:59.606 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.firmware_config.force_sysfs_fallback": "0", 2023-11-16T13:57:59.607 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.firmware_config.ignore_sysfs_fallback": "0", 2023-11-16T13:57:59.607 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.ftrace_dump_on_oops": "0", 2023-11-16T13:57:59.607 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.ftrace_enabled": "1", 2023-11-16T13:57:59.607 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.hardlockup_all_cpu_backtrace": "0", 2023-11-16T13:57:59.607 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.hardlockup_panic": "1", 2023-11-16T13:57:59.607 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.hostname": "smithi067", 2023-11-16T13:57:59.607 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.hung_task_check_count": "4194304", 2023-11-16T13:57:59.607 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.hung_task_panic": "0", 2023-11-16T13:57:59.607 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.hung_task_timeout_secs": "120", 2023-11-16T13:57:59.607 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.hung_task_warnings": "10", 2023-11-16T13:57:59.607 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.io_delay_type": "0", 2023-11-16T13:57:59.607 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.kexec_load_disabled": "0", 2023-11-16T13:57:59.607 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.keys.gc_delay": "300", 2023-11-16T13:57:59.608 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.keys.maxbytes": "20000", 2023-11-16T13:57:59.608 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.keys.maxkeys": "200", 2023-11-16T13:57:59.608 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.keys.persistent_keyring_expiry": "259200", 2023-11-16T13:57:59.608 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.keys.root_maxbytes": "25000000", 2023-11-16T13:57:59.608 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.keys.root_maxkeys": "1000000", 2023-11-16T13:57:59.608 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.kptr_restrict": "1", 2023-11-16T13:57:59.608 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.max_lock_depth": "1024", 2023-11-16T13:57:59.608 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.max_rcu_stall_to_panic": "0", 2023-11-16T13:57:59.608 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.modprobe": "/sbin/modprobe", 2023-11-16T13:57:59.608 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.modules_disabled": "0", 2023-11-16T13:57:59.608 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.msg_next_id": "-1", 2023-11-16T13:57:59.608 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.msgmax": "8192", 2023-11-16T13:57:59.608 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.msgmnb": "16384", 2023-11-16T13:57:59.609 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.msgmni": "32000", 2023-11-16T13:57:59.609 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.ngroups_max": "65536", 2023-11-16T13:57:59.609 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.nmi_watchdog": "1", 2023-11-16T13:57:59.609 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.ns_last_pid": "85044", 2023-11-16T13:57:59.609 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.numa_balancing": "0", 2023-11-16T13:57:59.609 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.numa_balancing_scan_delay_ms": "1000", 2023-11-16T13:57:59.609 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.numa_balancing_scan_period_max_ms": "60000", 2023-11-16T13:57:59.609 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.numa_balancing_scan_period_min_ms": "1000", 2023-11-16T13:57:59.609 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.numa_balancing_scan_size_mb": "256", 2023-11-16T13:57:59.609 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.osrelease": "4.18.0-425.3.1.el8.x86_64", 2023-11-16T13:57:59.610 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.ostype": "Linux", 2023-11-16T13:57:59.610 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.overflowgid": "65534", 2023-11-16T13:57:59.610 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.overflowuid": "65534", 2023-11-16T13:57:59.610 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.panic": "0", 2023-11-16T13:57:59.610 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.panic_on_io_nmi": "0", 2023-11-16T13:57:59.610 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.panic_on_oops": "1", 2023-11-16T13:57:59.610 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.panic_on_rcu_stall": "0", 2023-11-16T13:57:59.610 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.panic_on_unrecovered_nmi": "0", 2023-11-16T13:57:59.610 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.panic_on_warn": "0", 2023-11-16T13:57:59.610 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.panic_print": "0", 2023-11-16T13:57:59.611 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.perf_cpu_time_max_percent": "25", 2023-11-16T13:57:59.611 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.perf_event_max_contexts_per_stack": "8", 2023-11-16T13:57:59.611 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.perf_event_max_sample_rate": "100000", 2023-11-16T13:57:59.611 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.perf_event_max_stack": "127", 2023-11-16T13:57:59.611 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.perf_event_mlock_kb": "516", 2023-11-16T13:57:59.611 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.perf_event_paranoid": "2", 2023-11-16T13:57:59.611 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.pid_max": "4194304", 2023-11-16T13:57:59.611 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.poweroff_cmd": "/sbin/poweroff", 2023-11-16T13:57:59.611 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.print-fatal-signals": "0", 2023-11-16T13:57:59.611 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.printk": "7\t4\t1\t7", 2023-11-16T13:57:59.611 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.printk_delay": "0", 2023-11-16T13:57:59.612 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.printk_devkmsg": "ratelimit", 2023-11-16T13:57:59.612 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.printk_ratelimit": "5", 2023-11-16T13:57:59.612 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.printk_ratelimit_burst": "10", 2023-11-16T13:57:59.612 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.pty.max": "4096", 2023-11-16T13:57:59.612 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.pty.nr": "0", 2023-11-16T13:57:59.612 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.pty.reserve": "1024", 2023-11-16T13:57:59.612 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.random.boot_id": "6ebc11f8-3371-4aa9-be7f-0cbae9036a55", 2023-11-16T13:57:59.612 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.random.entropy_avail": "3964", 2023-11-16T13:57:59.612 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.random.poolsize": "4096", 2023-11-16T13:57:59.612 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.random.read_wakeup_threshold": "64", 2023-11-16T13:57:59.613 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.random.urandom_min_reseed_secs": "60", 2023-11-16T13:57:59.613 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.random.uuid": "ea2d6e2e-059d-4217-9f0a-d10aa2497179", 2023-11-16T13:57:59.613 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.random.write_wakeup_threshold": "3072", 2023-11-16T13:57:59.613 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.randomize_va_space": "2", 2023-11-16T13:57:59.613 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.real-root-dev": "0", 2023-11-16T13:57:59.613 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.rh_flags": "", 2023-11-16T13:57:59.613 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_autogroup_enabled": "0", 2023-11-16T13:57:59.613 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_cfs_bandwidth_slice_us": "5000", 2023-11-16T13:57:59.613 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_child_runs_first": "0", 2023-11-16T13:57:59.613 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_deadline_period_max_us": "4194304", 2023-11-16T13:57:59.613 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_deadline_period_min_us": "100", 2023-11-16T13:57:59.613 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu0.domain0.busy_factor": "16", 2023-11-16T13:57:59.613 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu0.domain0.cache_nice_tries": "0", 2023-11-16T13:57:59.614 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu0.domain0.flags": "4783", 2023-11-16T13:57:59.614 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu0.domain0.imbalance_pct": "110", 2023-11-16T13:57:59.614 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu0.domain0.max_interval": "4", 2023-11-16T13:57:59.614 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu0.domain0.max_newidle_lb_cost": "6179", 2023-11-16T13:57:59.614 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu0.domain0.min_interval": "2", 2023-11-16T13:57:59.614 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu0.domain0.name": "SMT", 2023-11-16T13:57:59.614 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu0.domain1.busy_factor": "16", 2023-11-16T13:57:59.614 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu0.domain1.cache_nice_tries": "1", 2023-11-16T13:57:59.614 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu0.domain1.flags": "4655", 2023-11-16T13:57:59.615 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu0.domain1.imbalance_pct": "117", 2023-11-16T13:57:59.615 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu0.domain1.max_interval": "16", 2023-11-16T13:57:59.615 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu0.domain1.max_newidle_lb_cost": "7058", 2023-11-16T13:57:59.615 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu0.domain1.min_interval": "8", 2023-11-16T13:57:59.615 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu0.domain1.name": "MC", 2023-11-16T13:57:59.615 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu1.domain0.busy_factor": "16", 2023-11-16T13:57:59.615 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu1.domain0.cache_nice_tries": "0", 2023-11-16T13:57:59.615 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu1.domain0.flags": "4783", 2023-11-16T13:57:59.615 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu1.domain0.imbalance_pct": "110", 2023-11-16T13:57:59.615 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu1.domain0.max_interval": "4", 2023-11-16T13:57:59.615 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu1.domain0.max_newidle_lb_cost": "3140", 2023-11-16T13:57:59.616 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu1.domain0.min_interval": "2", 2023-11-16T13:57:59.616 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu1.domain0.name": "SMT", 2023-11-16T13:57:59.616 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu1.domain1.busy_factor": "16", 2023-11-16T13:57:59.616 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu1.domain1.cache_nice_tries": "1", 2023-11-16T13:57:59.616 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu1.domain1.flags": "4655", 2023-11-16T13:57:59.616 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu1.domain1.imbalance_pct": "117", 2023-11-16T13:57:59.616 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu1.domain1.max_interval": "16", 2023-11-16T13:57:59.616 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu1.domain1.max_newidle_lb_cost": "6843", 2023-11-16T13:57:59.616 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu1.domain1.min_interval": "8", 2023-11-16T13:57:59.616 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu1.domain1.name": "MC", 2023-11-16T13:57:59.616 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu2.domain0.busy_factor": "16", 2023-11-16T13:57:59.616 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu2.domain0.cache_nice_tries": "0", 2023-11-16T13:57:59.617 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu2.domain0.flags": "4783", 2023-11-16T13:57:59.617 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu2.domain0.imbalance_pct": "110", 2023-11-16T13:57:59.617 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu2.domain0.max_interval": "4", 2023-11-16T13:57:59.617 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu2.domain0.max_newidle_lb_cost": "4438", 2023-11-16T13:57:59.617 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu2.domain0.min_interval": "2", 2023-11-16T13:57:59.617 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu2.domain0.name": "SMT", 2023-11-16T13:57:59.617 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu2.domain1.busy_factor": "16", 2023-11-16T13:57:59.617 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu2.domain1.cache_nice_tries": "1", 2023-11-16T13:57:59.617 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu2.domain1.flags": "4655", 2023-11-16T13:57:59.617 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu2.domain1.imbalance_pct": "117", 2023-11-16T13:57:59.617 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu2.domain1.max_interval": "16", 2023-11-16T13:57:59.617 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu2.domain1.max_newidle_lb_cost": "3365", 2023-11-16T13:57:59.618 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu2.domain1.min_interval": "8", 2023-11-16T13:57:59.618 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu2.domain1.name": "MC", 2023-11-16T13:57:59.618 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu3.domain0.busy_factor": "16", 2023-11-16T13:57:59.618 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu3.domain0.cache_nice_tries": "0", 2023-11-16T13:57:59.618 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu3.domain0.flags": "4783", 2023-11-16T13:57:59.618 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu3.domain0.imbalance_pct": "110", 2023-11-16T13:57:59.618 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu3.domain0.max_interval": "4", 2023-11-16T13:57:59.618 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu3.domain0.max_newidle_lb_cost": "3334", 2023-11-16T13:57:59.618 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu3.domain0.min_interval": "2", 2023-11-16T13:57:59.619 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu3.domain0.name": "SMT", 2023-11-16T13:57:59.619 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu3.domain1.busy_factor": "16", 2023-11-16T13:57:59.619 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu3.domain1.cache_nice_tries": "1", 2023-11-16T13:57:59.619 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu3.domain1.flags": "4655", 2023-11-16T13:57:59.619 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu3.domain1.imbalance_pct": "117", 2023-11-16T13:57:59.619 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu3.domain1.max_interval": "16", 2023-11-16T13:57:59.619 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu3.domain1.max_newidle_lb_cost": "4187", 2023-11-16T13:57:59.619 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu3.domain1.min_interval": "8", 2023-11-16T13:57:59.619 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu3.domain1.name": "MC", 2023-11-16T13:57:59.619 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu4.domain0.busy_factor": "16", 2023-11-16T13:57:59.619 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu4.domain0.cache_nice_tries": "0", 2023-11-16T13:57:59.620 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu4.domain0.flags": "4783", 2023-11-16T13:57:59.620 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu4.domain0.imbalance_pct": "110", 2023-11-16T13:57:59.620 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu4.domain0.max_interval": "4", 2023-11-16T13:57:59.620 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu4.domain0.max_newidle_lb_cost": "3792", 2023-11-16T13:57:59.620 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu4.domain0.min_interval": "2", 2023-11-16T13:57:59.620 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu4.domain0.name": "SMT", 2023-11-16T13:57:59.620 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu4.domain1.busy_factor": "16", 2023-11-16T13:57:59.620 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu4.domain1.cache_nice_tries": "1", 2023-11-16T13:57:59.620 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu4.domain1.flags": "4655", 2023-11-16T13:57:59.620 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu4.domain1.imbalance_pct": "117", 2023-11-16T13:57:59.620 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu4.domain1.max_interval": "16", 2023-11-16T13:57:59.620 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu4.domain1.max_newidle_lb_cost": "3518", 2023-11-16T13:57:59.621 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu4.domain1.min_interval": "8", 2023-11-16T13:57:59.621 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu4.domain1.name": "MC", 2023-11-16T13:57:59.621 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu5.domain0.busy_factor": "16", 2023-11-16T13:57:59.621 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu5.domain0.cache_nice_tries": "0", 2023-11-16T13:57:59.621 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu5.domain0.flags": "4783", 2023-11-16T13:57:59.621 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu5.domain0.imbalance_pct": "110", 2023-11-16T13:57:59.621 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu5.domain0.max_interval": "4", 2023-11-16T13:57:59.621 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu5.domain0.max_newidle_lb_cost": "2742", 2023-11-16T13:57:59.621 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu5.domain0.min_interval": "2", 2023-11-16T13:57:59.621 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu5.domain0.name": "SMT", 2023-11-16T13:57:59.621 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu5.domain1.busy_factor": "16", 2023-11-16T13:57:59.622 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu5.domain1.cache_nice_tries": "1", 2023-11-16T13:57:59.622 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu5.domain1.flags": "4655", 2023-11-16T13:57:59.622 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu5.domain1.imbalance_pct": "117", 2023-11-16T13:57:59.622 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu5.domain1.max_interval": "16", 2023-11-16T13:57:59.622 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu5.domain1.max_newidle_lb_cost": "7197", 2023-11-16T13:57:59.622 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu5.domain1.min_interval": "8", 2023-11-16T13:57:59.622 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu5.domain1.name": "MC", 2023-11-16T13:57:59.622 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu6.domain0.busy_factor": "16", 2023-11-16T13:57:59.622 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu6.domain0.cache_nice_tries": "0", 2023-11-16T13:57:59.622 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu6.domain0.flags": "4783", 2023-11-16T13:57:59.622 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu6.domain0.imbalance_pct": "110", 2023-11-16T13:57:59.622 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu6.domain0.max_interval": "4", 2023-11-16T13:57:59.623 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu6.domain0.max_newidle_lb_cost": "6380", 2023-11-16T13:57:59.623 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu6.domain0.min_interval": "2", 2023-11-16T13:57:59.623 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu6.domain0.name": "SMT", 2023-11-16T13:57:59.623 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu6.domain1.busy_factor": "16", 2023-11-16T13:57:59.623 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu6.domain1.cache_nice_tries": "1", 2023-11-16T13:57:59.623 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu6.domain1.flags": "4655", 2023-11-16T13:57:59.623 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu6.domain1.imbalance_pct": "117", 2023-11-16T13:57:59.623 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu6.domain1.max_interval": "16", 2023-11-16T13:57:59.623 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu6.domain1.max_newidle_lb_cost": "7252", 2023-11-16T13:57:59.623 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu6.domain1.min_interval": "8", 2023-11-16T13:57:59.623 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu6.domain1.name": "MC", 2023-11-16T13:57:59.623 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu7.domain0.busy_factor": "16", 2023-11-16T13:57:59.623 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu7.domain0.cache_nice_tries": "0", 2023-11-16T13:57:59.624 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu7.domain0.flags": "4783", 2023-11-16T13:57:59.624 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu7.domain0.imbalance_pct": "110", 2023-11-16T13:57:59.624 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu7.domain0.max_interval": "4", 2023-11-16T13:57:59.624 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu7.domain0.max_newidle_lb_cost": "2807", 2023-11-16T13:57:59.624 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu7.domain0.min_interval": "2", 2023-11-16T13:57:59.624 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu7.domain0.name": "SMT", 2023-11-16T13:57:59.624 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu7.domain1.busy_factor": "16", 2023-11-16T13:57:59.624 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu7.domain1.cache_nice_tries": "1", 2023-11-16T13:57:59.624 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu7.domain1.flags": "4655", 2023-11-16T13:57:59.624 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu7.domain1.imbalance_pct": "117", 2023-11-16T13:57:59.624 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu7.domain1.max_interval": "16", 2023-11-16T13:57:59.625 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu7.domain1.max_newidle_lb_cost": "20823", 2023-11-16T13:57:59.625 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu7.domain1.min_interval": "8", 2023-11-16T13:57:59.625 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_domain.cpu7.domain1.name": "MC", 2023-11-16T13:57:59.625 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_energy_aware": "1", 2023-11-16T13:57:59.625 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_latency_ns": "24000000", 2023-11-16T13:57:59.625 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_migration_cost_ns": "500000", 2023-11-16T13:57:59.625 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_min_granularity_ns": "10000000", 2023-11-16T13:57:59.625 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_nr_migrate": "32", 2023-11-16T13:57:59.625 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_rr_timeslice_ms": "100", 2023-11-16T13:57:59.625 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_rt_period_us": "1000000", 2023-11-16T13:57:59.625 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_rt_runtime_us": "950000", 2023-11-16T13:57:59.625 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_schedstats": "0", 2023-11-16T13:57:59.625 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_tunable_scaling": "1", 2023-11-16T13:57:59.625 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sched_wakeup_granularity_ns": "15000000", 2023-11-16T13:57:59.626 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.seccomp.actions_avail": "kill_process kill_thread trap errno trace log allow", 2023-11-16T13:57:59.626 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.seccomp.actions_logged": "kill_process kill_thread trap errno trace log", 2023-11-16T13:57:59.626 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sem": "32000\t1024000000\t500\t32000", 2023-11-16T13:57:59.626 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sem_next_id": "-1", 2023-11-16T13:57:59.626 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.shm_next_id": "-1", 2023-11-16T13:57:59.626 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.shm_rmid_forced": "0", 2023-11-16T13:57:59.626 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.shmall": "18446744073692774399", 2023-11-16T13:57:59.626 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.shmmax": "18446744073692774399", 2023-11-16T13:57:59.626 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.shmmni": "4096", 2023-11-16T13:57:59.626 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.soft_watchdog": "1", 2023-11-16T13:57:59.626 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.softlockup_all_cpu_backtrace": "0", 2023-11-16T13:57:59.627 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.softlockup_panic": "0", 2023-11-16T13:57:59.627 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.stack_tracer_enabled": "0", 2023-11-16T13:57:59.627 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sysctl_writes_strict": "1", 2023-11-16T13:57:59.627 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.sysrq": "16", 2023-11-16T13:57:59.627 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.tainted": "0", 2023-11-16T13:57:59.627 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.threads-max": "254469", 2023-11-16T13:57:59.627 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.timer_migration": "1", 2023-11-16T13:57:59.627 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.traceoff_on_warning": "0", 2023-11-16T13:57:59.627 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.tracepoint_printk": "0", 2023-11-16T13:57:59.627 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.unknown_nmi_panic": "0", 2023-11-16T13:57:59.627 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.unprivileged_bpf_disabled": "1", 2023-11-16T13:57:59.627 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.usermodehelper.bset": "4294967295\t511", 2023-11-16T13:57:59.627 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.usermodehelper.inheritable": "4294967295\t511", 2023-11-16T13:57:59.628 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.version": "#1 SMP Fri Sep 30 11:45:06 EDT 2022", 2023-11-16T13:57:59.628 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.watchdog": "1", 2023-11-16T13:57:59.628 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.watchdog_cpumask": "0-7", 2023-11-16T13:57:59.628 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.watchdog_thresh": "10", 2023-11-16T13:57:59.628 INFO:tasks.workunit.client.0.smithi067.stdout: "kernel.yama.ptrace_scope": "0", 2023-11-16T13:57:59.628 INFO:tasks.workunit.client.0.smithi067.stdout: "net.core.bpf_jit_enable": "1", 2023-11-16T13:57:59.628 INFO:tasks.workunit.client.0.smithi067.stdout: "net.core.bpf_jit_harden": "1", 2023-11-16T13:57:59.628 INFO:tasks.workunit.client.0.smithi067.stdout: "net.core.bpf_jit_kallsyms": "1", 2023-11-16T13:57:59.628 INFO:tasks.workunit.client.0.smithi067.stdout: "net.core.bpf_jit_limit": "264241152", 2023-11-16T13:57:59.628 INFO:tasks.workunit.client.0.smithi067.stdout: "net.core.busy_poll": "0", 2023-11-16T13:57:59.628 INFO:tasks.workunit.client.0.smithi067.stdout: "net.core.busy_read": "0", 2023-11-16T13:57:59.629 INFO:tasks.workunit.client.0.smithi067.stdout: "net.core.default_qdisc": "fq_codel", 2023-11-16T13:57:59.629 INFO:tasks.workunit.client.0.smithi067.stdout: "net.core.dev_weight": "64", 2023-11-16T13:57:59.629 INFO:tasks.workunit.client.0.smithi067.stdout: "net.core.dev_weight_rx_bias": "1", 2023-11-16T13:57:59.629 INFO:tasks.workunit.client.0.smithi067.stdout: "net.core.dev_weight_tx_bias": "1", 2023-11-16T13:57:59.629 INFO:tasks.workunit.client.0.smithi067.stdout: "net.core.fb_tunnels_only_for_init_net": "0", 2023-11-16T13:57:59.629 INFO:tasks.workunit.client.0.smithi067.stdout: "net.core.flow_limit_cpu_bitmap": "00", 2023-11-16T13:57:59.629 INFO:tasks.workunit.client.0.smithi067.stdout: "net.core.flow_limit_table_len": "4096", 2023-11-16T13:57:59.629 INFO:tasks.workunit.client.0.smithi067.stdout: "net.core.max_skb_frags": "17", 2023-11-16T13:57:59.629 INFO:tasks.workunit.client.0.smithi067.stdout: "net.core.message_burst": "10", 2023-11-16T13:57:59.629 INFO:tasks.workunit.client.0.smithi067.stdout: "net.core.message_cost": "5", 2023-11-16T13:57:59.629 INFO:tasks.workunit.client.0.smithi067.stdout: "net.core.netdev_budget": "300", 2023-11-16T13:57:59.630 INFO:tasks.workunit.client.0.smithi067.stdout: "net.core.netdev_budget_usecs": "2000", 2023-11-16T13:57:59.630 INFO:tasks.workunit.client.0.smithi067.stdout: "net.core.netdev_max_backlog": "1000", 2023-11-16T13:57:59.630 INFO:tasks.workunit.client.0.smithi067.stdout: "net.core.netdev_rss_key": "ca:0d:b6:e1:41:31:d4:4e:a4:0e:a2:fb:ab:6b:9c:97:25:90:db:a5:d2:30:e8:74:53:c9:a2:ec:55:c8:fc:5f:8d:89:92:f1:87:37:f9:37:a6:f6:87:46:c7:31:3e:8a:ac:f5:0c:6a", 2023-11-16T13:57:59.630 INFO:tasks.workunit.client.0.smithi067.stdout: "net.core.netdev_tstamp_prequeue": "1", 2023-11-16T13:57:59.630 INFO:tasks.workunit.client.0.smithi067.stdout: "net.core.optmem_max": "81920", 2023-11-16T13:57:59.630 INFO:tasks.workunit.client.0.smithi067.stdout: "net.core.rmem_default": "212992", 2023-11-16T13:57:59.630 INFO:tasks.workunit.client.0.smithi067.stdout: "net.core.rmem_max": "212992", 2023-11-16T13:57:59.630 INFO:tasks.workunit.client.0.smithi067.stdout: "net.core.rps_sock_flow_entries": "0", 2023-11-16T13:57:59.630 INFO:tasks.workunit.client.0.smithi067.stdout: "net.core.somaxconn": "128", 2023-11-16T13:57:59.630 INFO:tasks.workunit.client.0.smithi067.stdout: "net.core.tstamp_allow_data": "1", 2023-11-16T13:57:59.630 INFO:tasks.workunit.client.0.smithi067.stdout: "net.core.warnings": "0", 2023-11-16T13:57:59.630 INFO:tasks.workunit.client.0.smithi067.stdout: "net.core.wmem_default": "212992", 2023-11-16T13:57:59.631 INFO:tasks.workunit.client.0.smithi067.stdout: "net.core.wmem_max": "212992", 2023-11-16T13:57:59.631 INFO:tasks.workunit.client.0.smithi067.stdout: "net.core.xfrm_acq_expires": "30", 2023-11-16T13:57:59.631 INFO:tasks.workunit.client.0.smithi067.stdout: "net.core.xfrm_aevent_etime": "10", 2023-11-16T13:57:59.631 INFO:tasks.workunit.client.0.smithi067.stdout: "net.core.xfrm_aevent_rseqth": "2", 2023-11-16T13:57:59.631 INFO:tasks.workunit.client.0.smithi067.stdout: "net.core.xfrm_larval_drop": "1", 2023-11-16T13:57:59.631 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.cipso_cache_bucket_size": "10", 2023-11-16T13:57:59.631 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.cipso_cache_enable": "1", 2023-11-16T13:57:59.631 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.cipso_rbm_optfmt": "0", 2023-11-16T13:57:59.631 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.cipso_rbm_strictvalid": "1", 2023-11-16T13:57:59.631 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.all.accept_local": "0", 2023-11-16T13:57:59.631 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.all.accept_redirects": "1", 2023-11-16T13:57:59.632 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.all.accept_source_route": "0", 2023-11-16T13:57:59.632 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.all.arp_accept": "0", 2023-11-16T13:57:59.632 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.all.arp_announce": "0", 2023-11-16T13:57:59.632 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.all.arp_filter": "0", 2023-11-16T13:57:59.632 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.all.arp_ignore": "0", 2023-11-16T13:57:59.632 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.all.arp_notify": "0", 2023-11-16T13:57:59.632 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.all.bc_forwarding": "0", 2023-11-16T13:57:59.632 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.all.bootp_relay": "0", 2023-11-16T13:57:59.632 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.all.disable_policy": "0", 2023-11-16T13:57:59.632 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.all.disable_xfrm": "0", 2023-11-16T13:57:59.632 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.all.drop_gratuitous_arp": "0", 2023-11-16T13:57:59.632 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.all.drop_unicast_in_l2_multicast": "0", 2023-11-16T13:57:59.632 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.all.force_igmp_version": "0", 2023-11-16T13:57:59.633 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.all.forwarding": "0", 2023-11-16T13:57:59.633 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.all.igmpv2_unsolicited_report_interval": "10000", 2023-11-16T13:57:59.633 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.all.igmpv3_unsolicited_report_interval": "1000", 2023-11-16T13:57:59.633 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.all.ignore_routes_with_linkdown": "0", 2023-11-16T13:57:59.633 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.all.log_martians": "0", 2023-11-16T13:57:59.633 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.all.mc_forwarding": "0", 2023-11-16T13:57:59.633 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.all.medium_id": "0", 2023-11-16T13:57:59.633 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.all.promote_secondaries": "1", 2023-11-16T13:57:59.633 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.all.proxy_arp": "0", 2023-11-16T13:57:59.633 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.all.proxy_arp_pvlan": "0", 2023-11-16T13:57:59.633 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.all.route_localnet": "0", 2023-11-16T13:57:59.633 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.all.rp_filter": "1", 2023-11-16T13:57:59.633 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.all.secure_redirects": "1", 2023-11-16T13:57:59.634 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.all.send_redirects": "1", 2023-11-16T13:57:59.634 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.all.shared_media": "1", 2023-11-16T13:57:59.634 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.all.src_valid_mark": "0", 2023-11-16T13:57:59.634 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.all.tag": "0", 2023-11-16T13:57:59.634 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.default.accept_local": "0", 2023-11-16T13:57:59.634 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.default.accept_redirects": "1", 2023-11-16T13:57:59.634 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.default.accept_source_route": "1", 2023-11-16T13:57:59.634 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.default.arp_accept": "0", 2023-11-16T13:57:59.634 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.default.arp_announce": "0", 2023-11-16T13:57:59.634 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.default.arp_filter": "0", 2023-11-16T13:57:59.634 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.default.arp_ignore": "0", 2023-11-16T13:57:59.634 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.default.arp_notify": "0", 2023-11-16T13:57:59.635 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.default.bc_forwarding": "0", 2023-11-16T13:57:59.635 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.default.bootp_relay": "0", 2023-11-16T13:57:59.635 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.default.disable_policy": "0", 2023-11-16T13:57:59.635 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.default.disable_xfrm": "0", 2023-11-16T13:57:59.635 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.default.drop_gratuitous_arp": "0", 2023-11-16T13:57:59.635 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.default.drop_unicast_in_l2_multicast": "0", 2023-11-16T13:57:59.635 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.default.force_igmp_version": "0", 2023-11-16T13:57:59.635 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.default.forwarding": "0", 2023-11-16T13:57:59.635 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.default.igmpv2_unsolicited_report_interval": "10000", 2023-11-16T13:57:59.635 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.default.igmpv3_unsolicited_report_interval": "1000", 2023-11-16T13:57:59.635 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.default.ignore_routes_with_linkdown": "0", 2023-11-16T13:57:59.635 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.default.log_martians": "0", 2023-11-16T13:57:59.635 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.default.mc_forwarding": "0", 2023-11-16T13:57:59.636 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.default.medium_id": "0", 2023-11-16T13:57:59.636 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.default.promote_secondaries": "0", 2023-11-16T13:57:59.636 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.default.proxy_arp": "0", 2023-11-16T13:57:59.636 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.default.proxy_arp_pvlan": "0", 2023-11-16T13:57:59.636 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.default.route_localnet": "0", 2023-11-16T13:57:59.636 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.default.rp_filter": "0", 2023-11-16T13:57:59.636 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.default.secure_redirects": "1", 2023-11-16T13:57:59.636 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.default.send_redirects": "1", 2023-11-16T13:57:59.636 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.default.shared_media": "1", 2023-11-16T13:57:59.636 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.default.src_valid_mark": "0", 2023-11-16T13:57:59.636 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.default.tag": "0", 2023-11-16T13:57:59.637 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.eno1.accept_local": "0", 2023-11-16T13:57:59.637 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.eno1.accept_redirects": "1", 2023-11-16T13:57:59.637 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.eno1.accept_source_route": "1", 2023-11-16T13:57:59.637 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.eno1.arp_accept": "0", 2023-11-16T13:57:59.637 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.eno1.arp_announce": "0", 2023-11-16T13:57:59.637 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.eno1.arp_filter": "0", 2023-11-16T13:57:59.637 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.eno1.arp_ignore": "0", 2023-11-16T13:57:59.637 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.eno1.arp_notify": "0", 2023-11-16T13:57:59.637 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.eno1.bc_forwarding": "0", 2023-11-16T13:57:59.637 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.eno1.bootp_relay": "0", 2023-11-16T13:57:59.637 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.eno1.disable_policy": "0", 2023-11-16T13:57:59.637 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.eno1.disable_xfrm": "0", 2023-11-16T13:57:59.637 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.eno1.drop_gratuitous_arp": "0", 2023-11-16T13:57:59.638 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.eno1.drop_unicast_in_l2_multicast": "0", 2023-11-16T13:57:59.638 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.eno1.force_igmp_version": "0", 2023-11-16T13:57:59.638 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.eno1.forwarding": "0", 2023-11-16T13:57:59.638 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.eno1.igmpv2_unsolicited_report_interval": "10000", 2023-11-16T13:57:59.638 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.eno1.igmpv3_unsolicited_report_interval": "1000", 2023-11-16T13:57:59.638 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.eno1.ignore_routes_with_linkdown": "0", 2023-11-16T13:57:59.638 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.eno1.log_martians": "0", 2023-11-16T13:57:59.638 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.eno1.mc_forwarding": "0", 2023-11-16T13:57:59.638 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.eno1.medium_id": "0", 2023-11-16T13:57:59.638 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.eno1.promote_secondaries": "0", 2023-11-16T13:57:59.638 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.eno1.proxy_arp": "0", 2023-11-16T13:57:59.638 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.eno1.proxy_arp_pvlan": "0", 2023-11-16T13:57:59.639 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.eno1.route_localnet": "0", 2023-11-16T13:57:59.639 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.eno1.rp_filter": "0", 2023-11-16T13:57:59.639 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.eno1.secure_redirects": "1", 2023-11-16T13:57:59.639 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.eno1.send_redirects": "1", 2023-11-16T13:57:59.639 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.eno1.shared_media": "1", 2023-11-16T13:57:59.639 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.eno1.src_valid_mark": "0", 2023-11-16T13:57:59.639 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.eno1.tag": "0", 2023-11-16T13:57:59.639 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.eno2.accept_local": "0", 2023-11-16T13:57:59.639 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.eno2.accept_redirects": "1", 2023-11-16T13:57:59.639 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.eno2.accept_source_route": "1", 2023-11-16T13:57:59.639 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.eno2.arp_accept": "0", 2023-11-16T13:57:59.639 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.eno2.arp_announce": "0", 2023-11-16T13:57:59.639 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.eno2.arp_filter": "0", 2023-11-16T13:57:59.640 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.eno2.arp_ignore": "0", 2023-11-16T13:57:59.640 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.eno2.arp_notify": "0", 2023-11-16T13:57:59.640 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.eno2.bc_forwarding": "0", 2023-11-16T13:57:59.640 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.eno2.bootp_relay": "0", 2023-11-16T13:57:59.640 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.eno2.disable_policy": "0", 2023-11-16T13:57:59.640 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.eno2.disable_xfrm": "0", 2023-11-16T13:57:59.640 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.eno2.drop_gratuitous_arp": "0", 2023-11-16T13:57:59.640 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.eno2.drop_unicast_in_l2_multicast": "0", 2023-11-16T13:57:59.640 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.eno2.force_igmp_version": "0", 2023-11-16T13:57:59.640 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.eno2.forwarding": "0", 2023-11-16T13:57:59.640 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.eno2.igmpv2_unsolicited_report_interval": "10000", 2023-11-16T13:57:59.640 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.eno2.igmpv3_unsolicited_report_interval": "1000", 2023-11-16T13:57:59.641 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.eno2.ignore_routes_with_linkdown": "0", 2023-11-16T13:57:59.641 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.eno2.log_martians": "0", 2023-11-16T13:57:59.641 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.eno2.mc_forwarding": "0", 2023-11-16T13:57:59.641 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.eno2.medium_id": "0", 2023-11-16T13:57:59.641 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.eno2.promote_secondaries": "0", 2023-11-16T13:57:59.641 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.eno2.proxy_arp": "0", 2023-11-16T13:57:59.641 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.eno2.proxy_arp_pvlan": "0", 2023-11-16T13:57:59.641 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.eno2.route_localnet": "0", 2023-11-16T13:57:59.641 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.eno2.rp_filter": "0", 2023-11-16T13:57:59.641 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.eno2.secure_redirects": "1", 2023-11-16T13:57:59.641 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.eno2.send_redirects": "1", 2023-11-16T13:57:59.641 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.eno2.shared_media": "1", 2023-11-16T13:57:59.642 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.eno2.src_valid_mark": "0", 2023-11-16T13:57:59.642 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.eno2.tag": "0", 2023-11-16T13:57:59.642 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.enp3s0f0.accept_local": "0", 2023-11-16T13:57:59.642 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.enp3s0f0.accept_redirects": "1", 2023-11-16T13:57:59.642 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.enp3s0f0.accept_source_route": "1", 2023-11-16T13:57:59.642 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.enp3s0f0.arp_accept": "0", 2023-11-16T13:57:59.642 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.enp3s0f0.arp_announce": "0", 2023-11-16T13:57:59.642 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.enp3s0f0.arp_filter": "0", 2023-11-16T13:57:59.642 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.enp3s0f0.arp_ignore": "0", 2023-11-16T13:57:59.642 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.enp3s0f0.arp_notify": "0", 2023-11-16T13:57:59.642 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.enp3s0f0.bc_forwarding": "0", 2023-11-16T13:57:59.642 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.enp3s0f0.bootp_relay": "0", 2023-11-16T13:57:59.642 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.enp3s0f0.disable_policy": "0", 2023-11-16T13:57:59.643 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.enp3s0f0.disable_xfrm": "0", 2023-11-16T13:57:59.643 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.enp3s0f0.drop_gratuitous_arp": "0", 2023-11-16T13:57:59.643 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.enp3s0f0.drop_unicast_in_l2_multicast": "0", 2023-11-16T13:57:59.643 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.enp3s0f0.force_igmp_version": "0", 2023-11-16T13:57:59.643 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.enp3s0f0.forwarding": "0", 2023-11-16T13:57:59.643 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.enp3s0f0.igmpv2_unsolicited_report_interval": "10000", 2023-11-16T13:57:59.643 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.enp3s0f0.igmpv3_unsolicited_report_interval": "1000", 2023-11-16T13:57:59.643 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.enp3s0f0.ignore_routes_with_linkdown": "0", 2023-11-16T13:57:59.643 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.enp3s0f0.log_martians": "0", 2023-11-16T13:57:59.643 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.enp3s0f0.mc_forwarding": "0", 2023-11-16T13:57:59.643 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.enp3s0f0.medium_id": "0", 2023-11-16T13:57:59.643 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.enp3s0f0.promote_secondaries": "0", 2023-11-16T13:57:59.643 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.enp3s0f0.proxy_arp": "0", 2023-11-16T13:57:59.644 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.enp3s0f0.proxy_arp_pvlan": "0", 2023-11-16T13:57:59.644 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.enp3s0f0.route_localnet": "0", 2023-11-16T13:57:59.644 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.enp3s0f0.rp_filter": "0", 2023-11-16T13:57:59.644 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.enp3s0f0.secure_redirects": "1", 2023-11-16T13:57:59.644 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.enp3s0f0.send_redirects": "1", 2023-11-16T13:57:59.644 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.enp3s0f0.shared_media": "1", 2023-11-16T13:57:59.644 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.enp3s0f0.src_valid_mark": "0", 2023-11-16T13:57:59.644 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.enp3s0f0.tag": "0", 2023-11-16T13:57:59.644 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.enp3s0f1.accept_local": "0", 2023-11-16T13:57:59.644 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.enp3s0f1.accept_redirects": "1", 2023-11-16T13:57:59.644 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.enp3s0f1.accept_source_route": "1", 2023-11-16T13:57:59.644 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.enp3s0f1.arp_accept": "0", 2023-11-16T13:57:59.644 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.enp3s0f1.arp_announce": "0", 2023-11-16T13:57:59.645 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.enp3s0f1.arp_filter": "0", 2023-11-16T13:57:59.645 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.enp3s0f1.arp_ignore": "0", 2023-11-16T13:57:59.645 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.enp3s0f1.arp_notify": "0", 2023-11-16T13:57:59.645 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.enp3s0f1.bc_forwarding": "0", 2023-11-16T13:57:59.645 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.enp3s0f1.bootp_relay": "0", 2023-11-16T13:57:59.645 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.enp3s0f1.disable_policy": "0", 2023-11-16T13:57:59.645 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.enp3s0f1.disable_xfrm": "0", 2023-11-16T13:57:59.645 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.enp3s0f1.drop_gratuitous_arp": "0", 2023-11-16T13:57:59.645 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.enp3s0f1.drop_unicast_in_l2_multicast": "0", 2023-11-16T13:57:59.645 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.enp3s0f1.force_igmp_version": "0", 2023-11-16T13:57:59.645 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.enp3s0f1.forwarding": "0", 2023-11-16T13:57:59.645 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.enp3s0f1.igmpv2_unsolicited_report_interval": "10000", 2023-11-16T13:57:59.645 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.enp3s0f1.igmpv3_unsolicited_report_interval": "1000", 2023-11-16T13:57:59.646 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.enp3s0f1.ignore_routes_with_linkdown": "0", 2023-11-16T13:57:59.646 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.enp3s0f1.log_martians": "0", 2023-11-16T13:57:59.646 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.enp3s0f1.mc_forwarding": "0", 2023-11-16T13:57:59.646 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.enp3s0f1.medium_id": "0", 2023-11-16T13:57:59.646 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.enp3s0f1.promote_secondaries": "0", 2023-11-16T13:57:59.646 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.enp3s0f1.proxy_arp": "0", 2023-11-16T13:57:59.646 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.enp3s0f1.proxy_arp_pvlan": "0", 2023-11-16T13:57:59.646 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.enp3s0f1.route_localnet": "0", 2023-11-16T13:57:59.647 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.enp3s0f1.rp_filter": "0", 2023-11-16T13:57:59.647 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.enp3s0f1.secure_redirects": "1", 2023-11-16T13:57:59.647 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.enp3s0f1.send_redirects": "1", 2023-11-16T13:57:59.647 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.enp3s0f1.shared_media": "1", 2023-11-16T13:57:59.647 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.enp3s0f1.src_valid_mark": "0", 2023-11-16T13:57:59.647 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.enp3s0f1.tag": "0", 2023-11-16T13:57:59.647 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.lo.accept_local": "0", 2023-11-16T13:57:59.647 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.lo.accept_redirects": "1", 2023-11-16T13:57:59.647 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.lo.accept_source_route": "1", 2023-11-16T13:57:59.647 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.lo.arp_accept": "0", 2023-11-16T13:57:59.647 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.lo.arp_announce": "0", 2023-11-16T13:57:59.648 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.lo.arp_filter": "0", 2023-11-16T13:57:59.648 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.lo.arp_ignore": "0", 2023-11-16T13:57:59.648 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.lo.arp_notify": "0", 2023-11-16T13:57:59.648 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.lo.bc_forwarding": "0", 2023-11-16T13:57:59.648 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.lo.bootp_relay": "0", 2023-11-16T13:57:59.648 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.lo.disable_policy": "1", 2023-11-16T13:57:59.648 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.lo.disable_xfrm": "1", 2023-11-16T13:57:59.648 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.lo.drop_gratuitous_arp": "0", 2023-11-16T13:57:59.648 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.lo.drop_unicast_in_l2_multicast": "0", 2023-11-16T13:57:59.648 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.lo.force_igmp_version": "0", 2023-11-16T13:57:59.649 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.lo.forwarding": "0", 2023-11-16T13:57:59.649 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.lo.igmpv2_unsolicited_report_interval": "10000", 2023-11-16T13:57:59.649 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.lo.igmpv3_unsolicited_report_interval": "1000", 2023-11-16T13:57:59.649 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.lo.ignore_routes_with_linkdown": "0", 2023-11-16T13:57:59.649 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.lo.log_martians": "0", 2023-11-16T13:57:59.649 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.lo.mc_forwarding": "0", 2023-11-16T13:57:59.649 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.lo.medium_id": "0", 2023-11-16T13:57:59.649 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.lo.promote_secondaries": "0", 2023-11-16T13:57:59.649 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.lo.proxy_arp": "0", 2023-11-16T13:57:59.649 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.lo.proxy_arp_pvlan": "0", 2023-11-16T13:57:59.649 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.lo.route_localnet": "0", 2023-11-16T13:57:59.650 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.lo.rp_filter": "0", 2023-11-16T13:57:59.650 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.lo.secure_redirects": "1", 2023-11-16T13:57:59.650 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.lo.send_redirects": "1", 2023-11-16T13:57:59.650 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.lo.shared_media": "1", 2023-11-16T13:57:59.650 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.lo.src_valid_mark": "0", 2023-11-16T13:57:59.650 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.conf.lo.tag": "0", 2023-11-16T13:57:59.650 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.fib_multipath_hash_fields": "7", 2023-11-16T13:57:59.650 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.fib_multipath_hash_policy": "0", 2023-11-16T13:57:59.650 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.fib_multipath_use_neigh": "0", 2023-11-16T13:57:59.650 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.fwmark_reflect": "0", 2023-11-16T13:57:59.650 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.icmp_echo_ignore_all": "0", 2023-11-16T13:57:59.650 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.icmp_echo_ignore_broadcasts": "1", 2023-11-16T13:57:59.650 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.icmp_errors_use_inbound_ifaddr": "0", 2023-11-16T13:57:59.651 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.icmp_ignore_bogus_error_responses": "1", 2023-11-16T13:57:59.651 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.icmp_msgs_burst": "50", 2023-11-16T13:57:59.651 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.icmp_msgs_per_sec": "1000", 2023-11-16T13:57:59.651 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.icmp_ratelimit": "1000", 2023-11-16T13:57:59.651 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.icmp_ratemask": "6168", 2023-11-16T13:57:59.651 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.igmp_link_local_mcast_reports": "1", 2023-11-16T13:57:59.651 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.igmp_max_memberships": "20", 2023-11-16T13:57:59.651 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.igmp_max_msf": "10", 2023-11-16T13:57:59.651 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.igmp_qrv": "2", 2023-11-16T13:57:59.651 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.inet_peer_maxttl": "600", 2023-11-16T13:57:59.651 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.inet_peer_minttl": "120", 2023-11-16T13:57:59.651 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.inet_peer_threshold": "65664", 2023-11-16T13:57:59.651 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.ip_default_ttl": "64", 2023-11-16T13:57:59.652 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.ip_dynaddr": "0", 2023-11-16T13:57:59.652 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.ip_early_demux": "1", 2023-11-16T13:57:59.652 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.ip_forward": "0", 2023-11-16T13:57:59.652 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.ip_forward_update_priority": "1", 2023-11-16T13:57:59.652 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.ip_forward_use_pmtu": "0", 2023-11-16T13:57:59.652 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.ip_local_port_range": "32768\t60999", 2023-11-16T13:57:59.652 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.ip_local_reserved_ports": "", 2023-11-16T13:57:59.652 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.ip_no_pmtu_disc": "0", 2023-11-16T13:57:59.652 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.ip_nonlocal_bind": "0", 2023-11-16T13:57:59.652 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.ip_unprivileged_port_start": "1024", 2023-11-16T13:57:59.652 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.ipfrag_high_thresh": "4194304", 2023-11-16T13:57:59.652 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.ipfrag_low_thresh": "3145728", 2023-11-16T13:57:59.652 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.ipfrag_max_dist": "64", 2023-11-16T13:57:59.653 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.ipfrag_secret_interval": "0", 2023-11-16T13:57:59.653 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.ipfrag_time": "30", 2023-11-16T13:57:59.653 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.default.anycast_delay": "100", 2023-11-16T13:57:59.653 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.default.app_solicit": "0", 2023-11-16T13:57:59.653 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.default.base_reachable_time_ms": "30000", 2023-11-16T13:57:59.653 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.default.delay_first_probe_time": "5", 2023-11-16T13:57:59.653 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.default.gc_interval": "30", 2023-11-16T13:57:59.653 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.default.gc_stale_time": "60", 2023-11-16T13:57:59.653 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.default.gc_thresh1": "128", 2023-11-16T13:57:59.653 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.default.gc_thresh2": "512", 2023-11-16T13:57:59.653 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.default.gc_thresh3": "1024", 2023-11-16T13:57:59.653 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.default.locktime": "100", 2023-11-16T13:57:59.654 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.default.mcast_resolicit": "0", 2023-11-16T13:57:59.654 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.default.mcast_solicit": "3", 2023-11-16T13:57:59.654 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.default.proxy_delay": "80", 2023-11-16T13:57:59.654 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.default.proxy_qlen": "64", 2023-11-16T13:57:59.654 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.default.retrans_time_ms": "1000", 2023-11-16T13:57:59.654 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.default.ucast_solicit": "3", 2023-11-16T13:57:59.654 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.default.unres_qlen": "101", 2023-11-16T13:57:59.654 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.default.unres_qlen_bytes": "212992", 2023-11-16T13:57:59.654 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.eno1.anycast_delay": "100", 2023-11-16T13:57:59.654 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.eno1.app_solicit": "0", 2023-11-16T13:57:59.654 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.eno1.base_reachable_time_ms": "30000", 2023-11-16T13:57:59.654 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.eno1.delay_first_probe_time": "5", 2023-11-16T13:57:59.655 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.eno1.gc_stale_time": "60", 2023-11-16T13:57:59.655 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.eno1.locktime": "100", 2023-11-16T13:57:59.655 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.eno1.mcast_resolicit": "0", 2023-11-16T13:57:59.655 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.eno1.mcast_solicit": "3", 2023-11-16T13:57:59.655 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.eno1.proxy_delay": "80", 2023-11-16T13:57:59.655 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.eno1.proxy_qlen": "64", 2023-11-16T13:57:59.655 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.eno1.retrans_time_ms": "1000", 2023-11-16T13:57:59.655 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.eno1.ucast_solicit": "3", 2023-11-16T13:57:59.655 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.eno1.unres_qlen": "101", 2023-11-16T13:57:59.655 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.eno1.unres_qlen_bytes": "212992", 2023-11-16T13:57:59.655 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.eno2.anycast_delay": "100", 2023-11-16T13:57:59.655 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.eno2.app_solicit": "0", 2023-11-16T13:57:59.656 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.eno2.base_reachable_time_ms": "30000", 2023-11-16T13:57:59.656 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.eno2.delay_first_probe_time": "5", 2023-11-16T13:57:59.656 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.eno2.gc_stale_time": "60", 2023-11-16T13:57:59.656 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.eno2.locktime": "100", 2023-11-16T13:57:59.656 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.eno2.mcast_resolicit": "0", 2023-11-16T13:57:59.656 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.eno2.mcast_solicit": "3", 2023-11-16T13:57:59.656 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.eno2.proxy_delay": "80", 2023-11-16T13:57:59.656 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.eno2.proxy_qlen": "64", 2023-11-16T13:57:59.656 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.eno2.retrans_time_ms": "1000", 2023-11-16T13:57:59.656 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.eno2.ucast_solicit": "3", 2023-11-16T13:57:59.656 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.eno2.unres_qlen": "101", 2023-11-16T13:57:59.656 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.eno2.unres_qlen_bytes": "212992", 2023-11-16T13:57:59.657 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.enp3s0f0.anycast_delay": "100", 2023-11-16T13:57:59.657 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.enp3s0f0.app_solicit": "0", 2023-11-16T13:57:59.657 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.enp3s0f0.base_reachable_time_ms": "30000", 2023-11-16T13:57:59.657 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.enp3s0f0.delay_first_probe_time": "5", 2023-11-16T13:57:59.657 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.enp3s0f0.gc_stale_time": "60", 2023-11-16T13:57:59.657 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.enp3s0f0.locktime": "100", 2023-11-16T13:57:59.657 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.enp3s0f0.mcast_resolicit": "0", 2023-11-16T13:57:59.657 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.enp3s0f0.mcast_solicit": "3", 2023-11-16T13:57:59.657 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.enp3s0f0.proxy_delay": "80", 2023-11-16T13:57:59.657 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.enp3s0f0.proxy_qlen": "64", 2023-11-16T13:57:59.657 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.enp3s0f0.retrans_time_ms": "1000", 2023-11-16T13:57:59.657 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.enp3s0f0.ucast_solicit": "3", 2023-11-16T13:57:59.658 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.enp3s0f0.unres_qlen": "101", 2023-11-16T13:57:59.658 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.enp3s0f0.unres_qlen_bytes": "212992", 2023-11-16T13:57:59.658 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.enp3s0f1.anycast_delay": "100", 2023-11-16T13:57:59.658 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.enp3s0f1.app_solicit": "0", 2023-11-16T13:57:59.658 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.enp3s0f1.base_reachable_time_ms": "30000", 2023-11-16T13:57:59.658 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.enp3s0f1.delay_first_probe_time": "5", 2023-11-16T13:57:59.658 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.enp3s0f1.gc_stale_time": "60", 2023-11-16T13:57:59.658 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.enp3s0f1.locktime": "100", 2023-11-16T13:57:59.658 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.enp3s0f1.mcast_resolicit": "0", 2023-11-16T13:57:59.658 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.enp3s0f1.mcast_solicit": "3", 2023-11-16T13:57:59.658 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.enp3s0f1.proxy_delay": "80", 2023-11-16T13:57:59.659 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.enp3s0f1.proxy_qlen": "64", 2023-11-16T13:57:59.659 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.enp3s0f1.retrans_time_ms": "1000", 2023-11-16T13:57:59.659 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.enp3s0f1.ucast_solicit": "3", 2023-11-16T13:57:59.659 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.enp3s0f1.unres_qlen": "101", 2023-11-16T13:57:59.659 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.enp3s0f1.unres_qlen_bytes": "212992", 2023-11-16T13:57:59.659 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.lo.anycast_delay": "100", 2023-11-16T13:57:59.659 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.lo.app_solicit": "0", 2023-11-16T13:57:59.659 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.lo.base_reachable_time_ms": "30000", 2023-11-16T13:57:59.659 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.lo.delay_first_probe_time": "5", 2023-11-16T13:57:59.659 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.lo.gc_stale_time": "60", 2023-11-16T13:57:59.659 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.lo.locktime": "100", 2023-11-16T13:57:59.659 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.lo.mcast_resolicit": "0", 2023-11-16T13:57:59.659 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.lo.mcast_solicit": "3", 2023-11-16T13:57:59.660 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.lo.proxy_delay": "80", 2023-11-16T13:57:59.660 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.lo.proxy_qlen": "64", 2023-11-16T13:57:59.660 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.lo.retrans_time_ms": "1000", 2023-11-16T13:57:59.660 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.lo.ucast_solicit": "3", 2023-11-16T13:57:59.660 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.lo.unres_qlen": "101", 2023-11-16T13:57:59.660 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.neigh.lo.unres_qlen_bytes": "212992", 2023-11-16T13:57:59.660 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.ping_group_range": "0\t2147483647", 2023-11-16T13:57:59.660 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.route.error_burst": "5000", 2023-11-16T13:57:59.660 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.route.error_cost": "1000", 2023-11-16T13:57:59.660 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.route.gc_elasticity": "8", 2023-11-16T13:57:59.660 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.route.gc_interval": "60", 2023-11-16T13:57:59.660 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.route.gc_min_interval": "0", 2023-11-16T13:57:59.660 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.route.gc_min_interval_ms": "500", 2023-11-16T13:57:59.661 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.route.gc_thresh": "-1", 2023-11-16T13:57:59.661 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.route.gc_timeout": "300", 2023-11-16T13:57:59.661 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.route.max_size": "2147483647", 2023-11-16T13:57:59.661 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.route.min_adv_mss": "256", 2023-11-16T13:57:59.661 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.route.min_pmtu": "552", 2023-11-16T13:57:59.661 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.route.mtu_expires": "600", 2023-11-16T13:57:59.661 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.route.redirect_load": "20", 2023-11-16T13:57:59.661 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.route.redirect_number": "9", 2023-11-16T13:57:59.661 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.route.redirect_silence": "20480", 2023-11-16T13:57:59.661 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.tcp_abort_on_overflow": "0", 2023-11-16T13:57:59.661 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.tcp_adv_win_scale": "1", 2023-11-16T13:57:59.661 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.tcp_allowed_congestion_control": "reno cubic", 2023-11-16T13:57:59.661 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.tcp_app_win": "31", 2023-11-16T13:57:59.662 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.tcp_autocorking": "1", 2023-11-16T13:57:59.662 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.tcp_available_congestion_control": "reno cubic", 2023-11-16T13:57:59.662 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.tcp_available_ulp": "espintcp mptcp", 2023-11-16T13:57:59.662 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.tcp_base_mss": "1024", 2023-11-16T13:57:59.662 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.tcp_challenge_ack_limit": "1000", 2023-11-16T13:57:59.662 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.tcp_comp_sack_delay_ns": "1000000", 2023-11-16T13:57:59.662 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.tcp_comp_sack_nr": "44", 2023-11-16T13:57:59.662 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.tcp_congestion_control": "cubic", 2023-11-16T13:57:59.662 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.tcp_dsack": "1", 2023-11-16T13:57:59.662 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.tcp_early_demux": "1", 2023-11-16T13:57:59.662 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.tcp_early_retrans": "3", 2023-11-16T13:57:59.662 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.tcp_ecn": "2", 2023-11-16T13:57:59.662 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.tcp_ecn_fallback": "1", 2023-11-16T13:57:59.663 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.tcp_fack": "0", 2023-11-16T13:57:59.663 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.tcp_fastopen": "1", 2023-11-16T13:57:59.663 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.tcp_fastopen_blackhole_timeout_sec": "3600", 2023-11-16T13:57:59.663 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.tcp_fastopen_key": "00000000-00000000-00000000-00000000", 2023-11-16T13:57:59.663 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.tcp_fin_timeout": "60", 2023-11-16T13:57:59.663 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.tcp_frto": "2", 2023-11-16T13:57:59.663 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.tcp_fwmark_accept": "0", 2023-11-16T13:57:59.663 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.tcp_invalid_ratelimit": "500", 2023-11-16T13:57:59.663 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.tcp_keepalive_intvl": "75", 2023-11-16T13:57:59.663 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.tcp_keepalive_probes": "9", 2023-11-16T13:57:59.663 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.tcp_keepalive_time": "7200", 2023-11-16T13:57:59.663 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.tcp_l3mdev_accept": "0", 2023-11-16T13:57:59.663 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.tcp_limit_output_bytes": "262144", 2023-11-16T13:57:59.664 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.tcp_low_latency": "0", 2023-11-16T13:57:59.664 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.tcp_max_orphans": "131072", 2023-11-16T13:57:59.664 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.tcp_max_reordering": "300", 2023-11-16T13:57:59.664 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.tcp_max_syn_backlog": "1024", 2023-11-16T13:57:59.664 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.tcp_max_tw_buckets": "131072", 2023-11-16T13:57:59.664 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.tcp_mem": "380148\t506865\t760296", 2023-11-16T13:57:59.664 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.tcp_min_rtt_wlen": "300", 2023-11-16T13:57:59.664 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.tcp_min_snd_mss": "48", 2023-11-16T13:57:59.664 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.tcp_min_tso_segs": "2", 2023-11-16T13:57:59.664 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.tcp_moderate_rcvbuf": "1", 2023-11-16T13:57:59.664 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.tcp_mtu_probing": "0", 2023-11-16T13:57:59.665 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.tcp_no_metrics_save": "0", 2023-11-16T13:57:59.665 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.tcp_notsent_lowat": "4294967295", 2023-11-16T13:57:59.665 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.tcp_orphan_retries": "0", 2023-11-16T13:57:59.665 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.tcp_pacing_ca_ratio": "120", 2023-11-16T13:57:59.665 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.tcp_pacing_ss_ratio": "200", 2023-11-16T13:57:59.665 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.tcp_probe_interval": "600", 2023-11-16T13:57:59.665 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.tcp_probe_threshold": "8", 2023-11-16T13:57:59.665 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.tcp_recovery": "1", 2023-11-16T13:57:59.665 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.tcp_reordering": "3", 2023-11-16T13:57:59.665 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.tcp_retrans_collapse": "1", 2023-11-16T13:57:59.665 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.tcp_retries1": "3", 2023-11-16T13:57:59.665 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.tcp_retries2": "15", 2023-11-16T13:57:59.665 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.tcp_rfc1337": "0", 2023-11-16T13:57:59.666 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.tcp_rmem": "4096\t87380\t6291456", 2023-11-16T13:57:59.666 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.tcp_sack": "1", 2023-11-16T13:57:59.666 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.tcp_slow_start_after_idle": "1", 2023-11-16T13:57:59.666 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.tcp_stdurg": "0", 2023-11-16T13:57:59.666 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.tcp_syn_retries": "6", 2023-11-16T13:57:59.666 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.tcp_synack_retries": "5", 2023-11-16T13:57:59.666 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.tcp_syncookies": "1", 2023-11-16T13:57:59.666 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.tcp_thin_linear_timeouts": "0", 2023-11-16T13:57:59.666 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.tcp_timestamps": "1", 2023-11-16T13:57:59.666 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.tcp_tso_win_divisor": "3", 2023-11-16T13:57:59.666 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.tcp_tw_reuse": "2", 2023-11-16T13:57:59.667 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.tcp_tx_skb_cache": "0", 2023-11-16T13:57:59.667 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.tcp_window_scaling": "1", 2023-11-16T13:57:59.667 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.tcp_wmem": "4096\t16384\t4194304", 2023-11-16T13:57:59.667 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.tcp_workaround_signed_windows": "0", 2023-11-16T13:57:59.667 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.udp_early_demux": "1", 2023-11-16T13:57:59.667 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.udp_l3mdev_accept": "0", 2023-11-16T13:57:59.667 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.udp_mem": "760296\t1013731\t1520592", 2023-11-16T13:57:59.667 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.udp_rmem_min": "4096", 2023-11-16T13:57:59.667 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.udp_wmem_min": "4096", 2023-11-16T13:57:59.667 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv4.xfrm4_gc_thresh": "32768", 2023-11-16T13:57:59.667 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.anycast_src_echo_reply": "0", 2023-11-16T13:57:59.668 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.auto_flowlabels": "1", 2023-11-16T13:57:59.668 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.bindv6only": "0", 2023-11-16T13:57:59.668 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.calipso_cache_bucket_size": "10", 2023-11-16T13:57:59.668 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.calipso_cache_enable": "1", 2023-11-16T13:57:59.668 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.all.accept_dad": "0", 2023-11-16T13:57:59.668 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.all.accept_ra": "1", 2023-11-16T13:57:59.668 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.all.accept_ra_defrtr": "1", 2023-11-16T13:57:59.668 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.all.accept_ra_from_local": "0", 2023-11-16T13:57:59.668 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.all.accept_ra_min_hop_limit": "1", 2023-11-16T13:57:59.668 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.all.accept_ra_mtu": "1", 2023-11-16T13:57:59.668 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.all.accept_ra_pinfo": "1", 2023-11-16T13:57:59.668 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.all.accept_ra_rt_info_max_plen": "0", 2023-11-16T13:57:59.668 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.all.accept_ra_rt_info_min_plen": "0", 2023-11-16T13:57:59.669 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.all.accept_ra_rtr_pref": "1", 2023-11-16T13:57:59.669 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.all.accept_redirects": "1", 2023-11-16T13:57:59.669 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.all.accept_source_route": "0", 2023-11-16T13:57:59.669 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.all.addr_gen_mode": "0", 2023-11-16T13:57:59.669 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.all.autoconf": "1", 2023-11-16T13:57:59.669 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.all.dad_transmits": "1", 2023-11-16T13:57:59.669 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.all.disable_ipv6": "0", 2023-11-16T13:57:59.669 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.all.disable_policy": "0", 2023-11-16T13:57:59.669 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.all.drop_unicast_in_l2_multicast": "0", 2023-11-16T13:57:59.669 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.all.drop_unsolicited_na": "0", 2023-11-16T13:57:59.669 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.all.enhanced_dad": "1", 2023-11-16T13:57:59.669 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.all.force_mld_version": "0", 2023-11-16T13:57:59.670 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.all.force_tllao": "0", 2023-11-16T13:57:59.670 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.all.forwarding": "0", 2023-11-16T13:57:59.670 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.all.hop_limit": "64", 2023-11-16T13:57:59.670 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.all.ignore_routes_with_linkdown": "0", 2023-11-16T13:57:59.670 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.all.keep_addr_on_down": "0", 2023-11-16T13:57:59.670 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.all.max_addresses": "16", 2023-11-16T13:57:59.670 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.all.max_desync_factor": "600", 2023-11-16T13:57:59.670 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.all.mc_forwarding": "0", 2023-11-16T13:57:59.670 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.all.mldv1_unsolicited_report_interval": "10000", 2023-11-16T13:57:59.670 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.all.mldv2_unsolicited_report_interval": "1000", 2023-11-16T13:57:59.670 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.all.mtu": "1280", 2023-11-16T13:57:59.670 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.all.ndisc_notify": "0", 2023-11-16T13:57:59.671 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.all.ndisc_tclass": "0", 2023-11-16T13:57:59.671 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.all.optimistic_dad": "0", 2023-11-16T13:57:59.671 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.all.proxy_ndp": "0", 2023-11-16T13:57:59.671 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.all.regen_max_retry": "3", 2023-11-16T13:57:59.671 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.all.router_probe_interval": "60", 2023-11-16T13:57:59.671 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.all.router_solicitation_delay": "1", 2023-11-16T13:57:59.671 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.all.router_solicitation_interval": "4", 2023-11-16T13:57:59.671 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.all.router_solicitation_max_interval": "3600", 2023-11-16T13:57:59.671 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.all.router_solicitations": "-1", 2023-11-16T13:57:59.671 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.all.seg6_enabled": "0", 2023-11-16T13:57:59.671 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.all.suppress_frag_ndisc": "1", 2023-11-16T13:57:59.672 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.all.temp_prefered_lft": "86400", 2023-11-16T13:57:59.672 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.all.temp_valid_lft": "604800", 2023-11-16T13:57:59.672 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.all.use_oif_addrs_only": "0", 2023-11-16T13:57:59.672 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.all.use_optimistic": "0", 2023-11-16T13:57:59.672 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.all.use_tempaddr": "0", 2023-11-16T13:57:59.672 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.default.accept_dad": "1", 2023-11-16T13:57:59.672 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.default.accept_ra": "1", 2023-11-16T13:57:59.672 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.default.accept_ra_defrtr": "1", 2023-11-16T13:57:59.672 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.default.accept_ra_from_local": "0", 2023-11-16T13:57:59.672 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.default.accept_ra_min_hop_limit": "1", 2023-11-16T13:57:59.672 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.default.accept_ra_mtu": "1", 2023-11-16T13:57:59.672 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.default.accept_ra_pinfo": "1", 2023-11-16T13:57:59.672 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.default.accept_ra_rt_info_max_plen": "0", 2023-11-16T13:57:59.673 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.default.accept_ra_rt_info_min_plen": "0", 2023-11-16T13:57:59.673 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.default.accept_ra_rtr_pref": "1", 2023-11-16T13:57:59.673 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.default.accept_redirects": "1", 2023-11-16T13:57:59.673 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.default.accept_source_route": "0", 2023-11-16T13:57:59.673 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.default.addr_gen_mode": "0", 2023-11-16T13:57:59.673 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.default.autoconf": "1", 2023-11-16T13:57:59.673 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.default.dad_transmits": "1", 2023-11-16T13:57:59.673 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.default.disable_ipv6": "0", 2023-11-16T13:57:59.673 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.default.disable_policy": "0", 2023-11-16T13:57:59.673 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.default.drop_unicast_in_l2_multicast": "0", 2023-11-16T13:57:59.673 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.default.drop_unsolicited_na": "0", 2023-11-16T13:57:59.673 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.default.enhanced_dad": "1", 2023-11-16T13:57:59.673 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.default.force_mld_version": "0", 2023-11-16T13:57:59.674 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.default.force_tllao": "0", 2023-11-16T13:57:59.674 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.default.forwarding": "0", 2023-11-16T13:57:59.674 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.default.hop_limit": "64", 2023-11-16T13:57:59.674 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.default.ignore_routes_with_linkdown": "0", 2023-11-16T13:57:59.674 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.default.keep_addr_on_down": "0", 2023-11-16T13:57:59.674 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.default.max_addresses": "16", 2023-11-16T13:57:59.674 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.default.max_desync_factor": "600", 2023-11-16T13:57:59.674 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.default.mc_forwarding": "0", 2023-11-16T13:57:59.674 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.default.mldv1_unsolicited_report_interval": "10000", 2023-11-16T13:57:59.674 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.default.mldv2_unsolicited_report_interval": "1000", 2023-11-16T13:57:59.674 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.default.mtu": "1280", 2023-11-16T13:57:59.674 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.default.ndisc_notify": "0", 2023-11-16T13:57:59.674 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.default.ndisc_tclass": "0", 2023-11-16T13:57:59.675 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.default.optimistic_dad": "0", 2023-11-16T13:57:59.675 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.default.proxy_ndp": "0", 2023-11-16T13:57:59.675 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.default.regen_max_retry": "3", 2023-11-16T13:57:59.675 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.default.router_probe_interval": "60", 2023-11-16T13:57:59.675 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.default.router_solicitation_delay": "1", 2023-11-16T13:57:59.675 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.default.router_solicitation_interval": "4", 2023-11-16T13:57:59.675 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.default.router_solicitation_max_interval": "3600", 2023-11-16T13:57:59.675 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.default.router_solicitations": "-1", 2023-11-16T13:57:59.675 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.default.seg6_enabled": "0", 2023-11-16T13:57:59.675 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.default.suppress_frag_ndisc": "1", 2023-11-16T13:57:59.675 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.default.temp_prefered_lft": "86400", 2023-11-16T13:57:59.675 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.default.temp_valid_lft": "604800", 2023-11-16T13:57:59.675 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.default.use_oif_addrs_only": "0", 2023-11-16T13:57:59.676 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.default.use_optimistic": "0", 2023-11-16T13:57:59.676 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.default.use_tempaddr": "0", 2023-11-16T13:57:59.676 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno1.accept_dad": "1", 2023-11-16T13:57:59.676 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno1.accept_ra": "0", 2023-11-16T13:57:59.676 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno1.accept_ra_defrtr": "1", 2023-11-16T13:57:59.676 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno1.accept_ra_from_local": "0", 2023-11-16T13:57:59.676 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno1.accept_ra_min_hop_limit": "1", 2023-11-16T13:57:59.676 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno1.accept_ra_mtu": "1", 2023-11-16T13:57:59.676 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno1.accept_ra_pinfo": "1", 2023-11-16T13:57:59.676 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno1.accept_ra_rt_info_max_plen": "0", 2023-11-16T13:57:59.676 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno1.accept_ra_rt_info_min_plen": "0", 2023-11-16T13:57:59.676 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno1.accept_ra_rtr_pref": "1", 2023-11-16T13:57:59.677 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno1.accept_redirects": "1", 2023-11-16T13:57:59.677 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno1.accept_source_route": "0", 2023-11-16T13:57:59.677 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno1.addr_gen_mode": "1", 2023-11-16T13:57:59.677 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno1.autoconf": "1", 2023-11-16T13:57:59.677 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno1.dad_transmits": "1", 2023-11-16T13:57:59.677 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno1.disable_ipv6": "0", 2023-11-16T13:57:59.677 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno1.disable_policy": "0", 2023-11-16T13:57:59.677 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno1.drop_unicast_in_l2_multicast": "0", 2023-11-16T13:57:59.677 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno1.drop_unsolicited_na": "0", 2023-11-16T13:57:59.677 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno1.enhanced_dad": "1", 2023-11-16T13:57:59.677 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno1.force_mld_version": "0", 2023-11-16T13:57:59.677 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno1.force_tllao": "0", 2023-11-16T13:57:59.678 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno1.forwarding": "0", 2023-11-16T13:57:59.678 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno1.hop_limit": "64", 2023-11-16T13:57:59.678 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno1.ignore_routes_with_linkdown": "0", 2023-11-16T13:57:59.678 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno1.keep_addr_on_down": "0", 2023-11-16T13:57:59.678 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno1.max_addresses": "16", 2023-11-16T13:57:59.678 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno1.max_desync_factor": "600", 2023-11-16T13:57:59.678 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno1.mc_forwarding": "0", 2023-11-16T13:57:59.678 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno1.mldv1_unsolicited_report_interval": "10000", 2023-11-16T13:57:59.678 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno1.mldv2_unsolicited_report_interval": "1000", 2023-11-16T13:57:59.678 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno1.mtu": "1500", 2023-11-16T13:57:59.678 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno1.ndisc_notify": "0", 2023-11-16T13:57:59.678 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno1.ndisc_tclass": "0", 2023-11-16T13:57:59.678 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno1.optimistic_dad": "0", 2023-11-16T13:57:59.679 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno1.proxy_ndp": "0", 2023-11-16T13:57:59.679 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno1.regen_max_retry": "3", 2023-11-16T13:57:59.679 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno1.router_probe_interval": "60", 2023-11-16T13:57:59.679 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno1.router_solicitation_delay": "1", 2023-11-16T13:57:59.679 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno1.router_solicitation_interval": "4", 2023-11-16T13:57:59.679 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno1.router_solicitation_max_interval": "3600", 2023-11-16T13:57:59.679 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno1.router_solicitations": "-1", 2023-11-16T13:57:59.679 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno1.seg6_enabled": "0", 2023-11-16T13:57:59.679 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno1.suppress_frag_ndisc": "1", 2023-11-16T13:57:59.679 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno1.temp_prefered_lft": "86400", 2023-11-16T13:57:59.679 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno1.temp_valid_lft": "604800", 2023-11-16T13:57:59.680 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno1.use_oif_addrs_only": "0", 2023-11-16T13:57:59.680 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno1.use_optimistic": "0", 2023-11-16T13:57:59.680 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno1.use_tempaddr": "0", 2023-11-16T13:57:59.680 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno2.accept_dad": "1", 2023-11-16T13:57:59.680 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno2.accept_ra": "0", 2023-11-16T13:57:59.680 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno2.accept_ra_defrtr": "1", 2023-11-16T13:57:59.680 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno2.accept_ra_from_local": "0", 2023-11-16T13:57:59.680 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno2.accept_ra_min_hop_limit": "1", 2023-11-16T13:57:59.680 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno2.accept_ra_mtu": "1", 2023-11-16T13:57:59.680 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno2.accept_ra_pinfo": "1", 2023-11-16T13:57:59.680 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno2.accept_ra_rt_info_max_plen": "0", 2023-11-16T13:57:59.680 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno2.accept_ra_rt_info_min_plen": "0", 2023-11-16T13:57:59.680 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno2.accept_ra_rtr_pref": "1", 2023-11-16T13:57:59.681 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno2.accept_redirects": "1", 2023-11-16T13:57:59.681 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno2.accept_source_route": "0", 2023-11-16T13:57:59.681 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno2.addr_gen_mode": "1", 2023-11-16T13:57:59.681 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno2.autoconf": "1", 2023-11-16T13:57:59.681 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno2.dad_transmits": "1", 2023-11-16T13:57:59.681 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno2.disable_ipv6": "0", 2023-11-16T13:57:59.681 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno2.disable_policy": "0", 2023-11-16T13:57:59.681 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno2.drop_unicast_in_l2_multicast": "0", 2023-11-16T13:57:59.681 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno2.drop_unsolicited_na": "0", 2023-11-16T13:57:59.681 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno2.enhanced_dad": "1", 2023-11-16T13:57:59.681 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno2.force_mld_version": "0", 2023-11-16T13:57:59.681 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno2.force_tllao": "0", 2023-11-16T13:57:59.682 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno2.forwarding": "0", 2023-11-16T13:57:59.682 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno2.hop_limit": "64", 2023-11-16T13:57:59.682 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno2.ignore_routes_with_linkdown": "0", 2023-11-16T13:57:59.682 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno2.keep_addr_on_down": "0", 2023-11-16T13:57:59.682 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno2.max_addresses": "16", 2023-11-16T13:57:59.682 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno2.max_desync_factor": "600", 2023-11-16T13:57:59.682 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno2.mc_forwarding": "0", 2023-11-16T13:57:59.682 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno2.mldv1_unsolicited_report_interval": "10000", 2023-11-16T13:57:59.682 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno2.mldv2_unsolicited_report_interval": "1000", 2023-11-16T13:57:59.682 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno2.mtu": "1500", 2023-11-16T13:57:59.682 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno2.ndisc_notify": "0", 2023-11-16T13:57:59.682 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno2.ndisc_tclass": "0", 2023-11-16T13:57:59.683 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno2.optimistic_dad": "0", 2023-11-16T13:57:59.683 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno2.proxy_ndp": "0", 2023-11-16T13:57:59.683 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno2.regen_max_retry": "3", 2023-11-16T13:57:59.683 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno2.router_probe_interval": "60", 2023-11-16T13:57:59.683 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno2.router_solicitation_delay": "1", 2023-11-16T13:57:59.683 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno2.router_solicitation_interval": "4", 2023-11-16T13:57:59.683 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno2.router_solicitation_max_interval": "3600", 2023-11-16T13:57:59.683 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno2.router_solicitations": "-1", 2023-11-16T13:57:59.683 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno2.seg6_enabled": "0", 2023-11-16T13:57:59.683 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno2.suppress_frag_ndisc": "1", 2023-11-16T13:57:59.683 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno2.temp_prefered_lft": "86400", 2023-11-16T13:57:59.683 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno2.temp_valid_lft": "604800", 2023-11-16T13:57:59.684 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno2.use_oif_addrs_only": "0", 2023-11-16T13:57:59.684 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno2.use_optimistic": "0", 2023-11-16T13:57:59.684 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.eno2.use_tempaddr": "0", 2023-11-16T13:57:59.684 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f0.accept_dad": "1", 2023-11-16T13:57:59.684 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f0.accept_ra": "0", 2023-11-16T13:57:59.684 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f0.accept_ra_defrtr": "1", 2023-11-16T13:57:59.684 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f0.accept_ra_from_local": "0", 2023-11-16T13:57:59.684 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f0.accept_ra_min_hop_limit": "1", 2023-11-16T13:57:59.684 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f0.accept_ra_mtu": "1", 2023-11-16T13:57:59.684 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f0.accept_ra_pinfo": "1", 2023-11-16T13:57:59.684 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f0.accept_ra_rt_info_max_plen": "0", 2023-11-16T13:57:59.684 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f0.accept_ra_rt_info_min_plen": "0", 2023-11-16T13:57:59.685 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f0.accept_ra_rtr_pref": "1", 2023-11-16T13:57:59.685 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f0.accept_redirects": "1", 2023-11-16T13:57:59.685 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f0.accept_source_route": "0", 2023-11-16T13:57:59.685 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f0.addr_gen_mode": "1", 2023-11-16T13:57:59.685 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f0.autoconf": "1", 2023-11-16T13:57:59.685 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f0.dad_transmits": "1", 2023-11-16T13:57:59.685 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f0.disable_ipv6": "0", 2023-11-16T13:57:59.685 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f0.disable_policy": "0", 2023-11-16T13:57:59.685 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f0.drop_unicast_in_l2_multicast": "0", 2023-11-16T13:57:59.685 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f0.drop_unsolicited_na": "0", 2023-11-16T13:57:59.685 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f0.enhanced_dad": "1", 2023-11-16T13:57:59.685 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f0.force_mld_version": "0", 2023-11-16T13:57:59.685 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f0.force_tllao": "0", 2023-11-16T13:57:59.686 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f0.forwarding": "0", 2023-11-16T13:57:59.686 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f0.hop_limit": "64", 2023-11-16T13:57:59.686 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f0.ignore_routes_with_linkdown": "0", 2023-11-16T13:57:59.686 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f0.keep_addr_on_down": "0", 2023-11-16T13:57:59.686 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f0.max_addresses": "16", 2023-11-16T13:57:59.686 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f0.max_desync_factor": "600", 2023-11-16T13:57:59.686 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f0.mc_forwarding": "0", 2023-11-16T13:57:59.686 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f0.mldv1_unsolicited_report_interval": "10000", 2023-11-16T13:57:59.686 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f0.mldv2_unsolicited_report_interval": "1000", 2023-11-16T13:57:59.686 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f0.mtu": "1500", 2023-11-16T13:57:59.686 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f0.ndisc_notify": "0", 2023-11-16T13:57:59.686 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f0.ndisc_tclass": "0", 2023-11-16T13:57:59.686 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f0.optimistic_dad": "0", 2023-11-16T13:57:59.687 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f0.proxy_ndp": "0", 2023-11-16T13:57:59.687 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f0.regen_max_retry": "3", 2023-11-16T13:57:59.687 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f0.router_probe_interval": "60", 2023-11-16T13:57:59.687 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f0.router_solicitation_delay": "1", 2023-11-16T13:57:59.687 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f0.router_solicitation_interval": "4", 2023-11-16T13:57:59.687 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f0.router_solicitation_max_interval": "3600", 2023-11-16T13:57:59.687 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f0.router_solicitations": "-1", 2023-11-16T13:57:59.687 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f0.seg6_enabled": "0", 2023-11-16T13:57:59.687 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f0.suppress_frag_ndisc": "1", 2023-11-16T13:57:59.687 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f0.temp_prefered_lft": "86400", 2023-11-16T13:57:59.687 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f0.temp_valid_lft": "604800", 2023-11-16T13:57:59.687 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f0.use_oif_addrs_only": "0", 2023-11-16T13:57:59.688 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f0.use_optimistic": "0", 2023-11-16T13:57:59.688 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f0.use_tempaddr": "0", 2023-11-16T13:57:59.688 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f1.accept_dad": "1", 2023-11-16T13:57:59.688 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f1.accept_ra": "1", 2023-11-16T13:57:59.688 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f1.accept_ra_defrtr": "1", 2023-11-16T13:57:59.688 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f1.accept_ra_from_local": "0", 2023-11-16T13:57:59.688 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f1.accept_ra_min_hop_limit": "1", 2023-11-16T13:57:59.688 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f1.accept_ra_mtu": "1", 2023-11-16T13:57:59.688 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f1.accept_ra_pinfo": "1", 2023-11-16T13:57:59.688 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f1.accept_ra_rt_info_max_plen": "0", 2023-11-16T13:57:59.688 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f1.accept_ra_rt_info_min_plen": "0", 2023-11-16T13:57:59.688 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f1.accept_ra_rtr_pref": "1", 2023-11-16T13:57:59.689 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f1.accept_redirects": "1", 2023-11-16T13:57:59.689 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f1.accept_source_route": "0", 2023-11-16T13:57:59.689 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f1.addr_gen_mode": "0", 2023-11-16T13:57:59.689 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f1.autoconf": "1", 2023-11-16T13:57:59.689 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f1.dad_transmits": "1", 2023-11-16T13:57:59.689 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f1.disable_ipv6": "0", 2023-11-16T13:57:59.689 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f1.disable_policy": "0", 2023-11-16T13:57:59.689 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f1.drop_unicast_in_l2_multicast": "0", 2023-11-16T13:57:59.689 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f1.drop_unsolicited_na": "0", 2023-11-16T13:57:59.689 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f1.enhanced_dad": "1", 2023-11-16T13:57:59.689 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f1.force_mld_version": "0", 2023-11-16T13:57:59.689 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f1.force_tllao": "0", 2023-11-16T13:57:59.690 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f1.forwarding": "0", 2023-11-16T13:57:59.690 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f1.hop_limit": "64", 2023-11-16T13:57:59.690 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f1.ignore_routes_with_linkdown": "0", 2023-11-16T13:57:59.690 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f1.keep_addr_on_down": "0", 2023-11-16T13:57:59.690 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f1.max_addresses": "16", 2023-11-16T13:57:59.690 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f1.max_desync_factor": "600", 2023-11-16T13:57:59.690 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f1.mc_forwarding": "0", 2023-11-16T13:57:59.690 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f1.mldv1_unsolicited_report_interval": "10000", 2023-11-16T13:57:59.690 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f1.mldv2_unsolicited_report_interval": "1000", 2023-11-16T13:57:59.690 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f1.mtu": "1500", 2023-11-16T13:57:59.690 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f1.ndisc_notify": "0", 2023-11-16T13:57:59.690 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f1.ndisc_tclass": "0", 2023-11-16T13:57:59.691 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f1.optimistic_dad": "0", 2023-11-16T13:57:59.691 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f1.proxy_ndp": "0", 2023-11-16T13:57:59.691 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f1.regen_max_retry": "3", 2023-11-16T13:57:59.691 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f1.router_probe_interval": "60", 2023-11-16T13:57:59.691 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f1.router_solicitation_delay": "1", 2023-11-16T13:57:59.691 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f1.router_solicitation_interval": "4", 2023-11-16T13:57:59.691 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f1.router_solicitation_max_interval": "3600", 2023-11-16T13:57:59.691 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f1.router_solicitations": "-1", 2023-11-16T13:57:59.691 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f1.seg6_enabled": "0", 2023-11-16T13:57:59.691 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f1.suppress_frag_ndisc": "1", 2023-11-16T13:57:59.691 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f1.temp_prefered_lft": "86400", 2023-11-16T13:57:59.691 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f1.temp_valid_lft": "604800", 2023-11-16T13:57:59.692 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f1.use_oif_addrs_only": "0", 2023-11-16T13:57:59.692 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f1.use_optimistic": "0", 2023-11-16T13:57:59.692 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.enp3s0f1.use_tempaddr": "0", 2023-11-16T13:57:59.692 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.lo.accept_dad": "-1", 2023-11-16T13:57:59.692 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.lo.accept_ra": "1", 2023-11-16T13:57:59.692 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.lo.accept_ra_defrtr": "1", 2023-11-16T13:57:59.692 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.lo.accept_ra_from_local": "0", 2023-11-16T13:57:59.692 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.lo.accept_ra_min_hop_limit": "1", 2023-11-16T13:57:59.692 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.lo.accept_ra_mtu": "1", 2023-11-16T13:57:59.692 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.lo.accept_ra_pinfo": "1", 2023-11-16T13:57:59.692 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.lo.accept_ra_rt_info_max_plen": "0", 2023-11-16T13:57:59.692 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.lo.accept_ra_rt_info_min_plen": "0", 2023-11-16T13:57:59.692 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.lo.accept_ra_rtr_pref": "1", 2023-11-16T13:57:59.693 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.lo.accept_redirects": "1", 2023-11-16T13:57:59.693 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.lo.accept_source_route": "0", 2023-11-16T13:57:59.693 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.lo.addr_gen_mode": "0", 2023-11-16T13:57:59.693 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.lo.autoconf": "1", 2023-11-16T13:57:59.693 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.lo.dad_transmits": "1", 2023-11-16T13:57:59.693 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.lo.disable_ipv6": "0", 2023-11-16T13:57:59.693 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.lo.disable_policy": "0", 2023-11-16T13:57:59.693 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.lo.drop_unicast_in_l2_multicast": "0", 2023-11-16T13:57:59.693 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.lo.drop_unsolicited_na": "0", 2023-11-16T13:57:59.693 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.lo.enhanced_dad": "1", 2023-11-16T13:57:59.693 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.lo.force_mld_version": "0", 2023-11-16T13:57:59.693 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.lo.force_tllao": "0", 2023-11-16T13:57:59.693 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.lo.forwarding": "0", 2023-11-16T13:57:59.693 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.lo.hop_limit": "64", 2023-11-16T13:57:59.694 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.lo.ignore_routes_with_linkdown": "0", 2023-11-16T13:57:59.694 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.lo.keep_addr_on_down": "0", 2023-11-16T13:57:59.694 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.lo.max_addresses": "16", 2023-11-16T13:57:59.694 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.lo.max_desync_factor": "600", 2023-11-16T13:57:59.694 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.lo.mc_forwarding": "0", 2023-11-16T13:57:59.694 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.lo.mldv1_unsolicited_report_interval": "10000", 2023-11-16T13:57:59.694 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.lo.mldv2_unsolicited_report_interval": "1000", 2023-11-16T13:57:59.694 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.lo.mtu": "65536", 2023-11-16T13:57:59.694 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.lo.ndisc_notify": "0", 2023-11-16T13:57:59.695 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.lo.ndisc_tclass": "0", 2023-11-16T13:57:59.695 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.lo.optimistic_dad": "0", 2023-11-16T13:57:59.695 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.lo.proxy_ndp": "0", 2023-11-16T13:57:59.695 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.lo.regen_max_retry": "3", 2023-11-16T13:57:59.695 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.lo.router_probe_interval": "60", 2023-11-16T13:57:59.695 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.lo.router_solicitation_delay": "1", 2023-11-16T13:57:59.695 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.lo.router_solicitation_interval": "4", 2023-11-16T13:57:59.695 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.lo.router_solicitation_max_interval": "3600", 2023-11-16T13:57:59.695 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.lo.router_solicitations": "-1", 2023-11-16T13:57:59.695 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.lo.seg6_enabled": "0", 2023-11-16T13:57:59.695 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.lo.suppress_frag_ndisc": "1", 2023-11-16T13:57:59.695 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.lo.temp_prefered_lft": "86400", 2023-11-16T13:57:59.696 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.lo.temp_valid_lft": "604800", 2023-11-16T13:57:59.696 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.lo.use_oif_addrs_only": "0", 2023-11-16T13:57:59.696 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.lo.use_optimistic": "0", 2023-11-16T13:57:59.696 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.conf.lo.use_tempaddr": "-1", 2023-11-16T13:57:59.696 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.fib_multipath_hash_fields": "7", 2023-11-16T13:57:59.696 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.fib_multipath_hash_policy": "0", 2023-11-16T13:57:59.696 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.flowlabel_consistency": "1", 2023-11-16T13:57:59.696 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.flowlabel_reflect": "0", 2023-11-16T13:57:59.696 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.flowlabel_state_ranges": "0", 2023-11-16T13:57:59.696 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.fwmark_reflect": "0", 2023-11-16T13:57:59.696 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.icmp.ratelimit": "1000", 2023-11-16T13:57:59.696 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.idgen_delay": "1", 2023-11-16T13:57:59.696 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.idgen_retries": "3", 2023-11-16T13:57:59.696 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.ip6frag_high_thresh": "4194304", 2023-11-16T13:57:59.697 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.ip6frag_low_thresh": "3145728", 2023-11-16T13:57:59.697 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.ip6frag_secret_interval": "0", 2023-11-16T13:57:59.697 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.ip6frag_time": "60", 2023-11-16T13:57:59.697 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.ip_nonlocal_bind": "0", 2023-11-16T13:57:59.697 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.max_dst_opts_length": "2147483647", 2023-11-16T13:57:59.697 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.max_dst_opts_number": "8", 2023-11-16T13:57:59.697 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.max_hbh_length": "2147483647", 2023-11-16T13:57:59.697 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.max_hbh_opts_number": "8", 2023-11-16T13:57:59.697 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.mld_max_msf": "64", 2023-11-16T13:57:59.697 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.mld_qrv": "2", 2023-11-16T13:57:59.697 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.default.anycast_delay": "100", 2023-11-16T13:57:59.697 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.default.app_solicit": "0", 2023-11-16T13:57:59.697 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.default.base_reachable_time_ms": "30000", 2023-11-16T13:57:59.698 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.default.delay_first_probe_time": "5", 2023-11-16T13:57:59.698 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.default.gc_interval": "30", 2023-11-16T13:57:59.698 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.default.gc_stale_time": "60", 2023-11-16T13:57:59.698 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.default.gc_thresh1": "128", 2023-11-16T13:57:59.698 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.default.gc_thresh2": "512", 2023-11-16T13:57:59.698 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.default.gc_thresh3": "1024", 2023-11-16T13:57:59.698 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.default.locktime": "0", 2023-11-16T13:57:59.698 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.default.mcast_resolicit": "0", 2023-11-16T13:57:59.698 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.default.mcast_solicit": "3", 2023-11-16T13:57:59.698 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.default.proxy_delay": "80", 2023-11-16T13:57:59.698 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.default.proxy_qlen": "64", 2023-11-16T13:57:59.699 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.default.retrans_time_ms": "1000", 2023-11-16T13:57:59.699 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.default.ucast_solicit": "3", 2023-11-16T13:57:59.699 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.default.unres_qlen": "101", 2023-11-16T13:57:59.699 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.default.unres_qlen_bytes": "212992", 2023-11-16T13:57:59.699 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.eno1.anycast_delay": "100", 2023-11-16T13:57:59.699 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.eno1.app_solicit": "0", 2023-11-16T13:57:59.699 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.eno1.base_reachable_time_ms": "30000", 2023-11-16T13:57:59.699 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.eno1.delay_first_probe_time": "5", 2023-11-16T13:57:59.699 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.eno1.gc_stale_time": "60", 2023-11-16T13:57:59.699 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.eno1.locktime": "0", 2023-11-16T13:57:59.699 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.eno1.mcast_resolicit": "0", 2023-11-16T13:57:59.699 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.eno1.mcast_solicit": "3", 2023-11-16T13:57:59.700 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.eno1.proxy_delay": "80", 2023-11-16T13:57:59.700 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.eno1.proxy_qlen": "64", 2023-11-16T13:57:59.700 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.eno1.retrans_time_ms": "1000", 2023-11-16T13:57:59.700 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.eno1.ucast_solicit": "3", 2023-11-16T13:57:59.700 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.eno1.unres_qlen": "101", 2023-11-16T13:57:59.700 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.eno1.unres_qlen_bytes": "212992", 2023-11-16T13:57:59.700 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.eno2.anycast_delay": "100", 2023-11-16T13:57:59.700 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.eno2.app_solicit": "0", 2023-11-16T13:57:59.700 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.eno2.base_reachable_time_ms": "30000", 2023-11-16T13:57:59.700 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.eno2.delay_first_probe_time": "5", 2023-11-16T13:57:59.700 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.eno2.gc_stale_time": "60", 2023-11-16T13:57:59.700 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.eno2.locktime": "0", 2023-11-16T13:57:59.700 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.eno2.mcast_resolicit": "0", 2023-11-16T13:57:59.700 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.eno2.mcast_solicit": "3", 2023-11-16T13:57:59.701 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.eno2.proxy_delay": "80", 2023-11-16T13:57:59.701 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.eno2.proxy_qlen": "64", 2023-11-16T13:57:59.701 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.eno2.retrans_time_ms": "1000", 2023-11-16T13:57:59.701 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.eno2.ucast_solicit": "3", 2023-11-16T13:57:59.701 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.eno2.unres_qlen": "101", 2023-11-16T13:57:59.701 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.eno2.unres_qlen_bytes": "212992", 2023-11-16T13:57:59.701 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.enp3s0f0.anycast_delay": "100", 2023-11-16T13:57:59.701 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.enp3s0f0.app_solicit": "0", 2023-11-16T13:57:59.701 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.enp3s0f0.base_reachable_time_ms": "30000", 2023-11-16T13:57:59.701 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.enp3s0f0.delay_first_probe_time": "5", 2023-11-16T13:57:59.701 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.enp3s0f0.gc_stale_time": "60", 2023-11-16T13:57:59.701 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.enp3s0f0.locktime": "0", 2023-11-16T13:57:59.701 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.enp3s0f0.mcast_resolicit": "0", 2023-11-16T13:57:59.702 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.enp3s0f0.mcast_solicit": "3", 2023-11-16T13:57:59.702 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.enp3s0f0.proxy_delay": "80", 2023-11-16T13:57:59.702 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.enp3s0f0.proxy_qlen": "64", 2023-11-16T13:57:59.702 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.enp3s0f0.retrans_time_ms": "1000", 2023-11-16T13:57:59.702 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.enp3s0f0.ucast_solicit": "3", 2023-11-16T13:57:59.702 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.enp3s0f0.unres_qlen": "101", 2023-11-16T13:57:59.702 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.enp3s0f0.unres_qlen_bytes": "212992", 2023-11-16T13:57:59.702 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.enp3s0f1.anycast_delay": "100", 2023-11-16T13:57:59.702 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.enp3s0f1.app_solicit": "0", 2023-11-16T13:57:59.702 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.enp3s0f1.base_reachable_time_ms": "30000", 2023-11-16T13:57:59.702 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.enp3s0f1.delay_first_probe_time": "5", 2023-11-16T13:57:59.702 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.enp3s0f1.gc_stale_time": "60", 2023-11-16T13:57:59.703 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.enp3s0f1.locktime": "0", 2023-11-16T13:57:59.703 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.enp3s0f1.mcast_resolicit": "0", 2023-11-16T13:57:59.703 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.enp3s0f1.mcast_solicit": "3", 2023-11-16T13:57:59.703 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.enp3s0f1.proxy_delay": "80", 2023-11-16T13:57:59.703 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.enp3s0f1.proxy_qlen": "64", 2023-11-16T13:57:59.703 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.enp3s0f1.retrans_time_ms": "1000", 2023-11-16T13:57:59.703 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.enp3s0f1.ucast_solicit": "3", 2023-11-16T13:57:59.703 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.enp3s0f1.unres_qlen": "101", 2023-11-16T13:57:59.703 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.enp3s0f1.unres_qlen_bytes": "212992", 2023-11-16T13:57:59.703 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.lo.anycast_delay": "100", 2023-11-16T13:57:59.703 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.lo.app_solicit": "0", 2023-11-16T13:57:59.703 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.lo.base_reachable_time_ms": "30000", 2023-11-16T13:57:59.704 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.lo.delay_first_probe_time": "5", 2023-11-16T13:57:59.704 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.lo.gc_stale_time": "60", 2023-11-16T13:57:59.704 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.lo.locktime": "0", 2023-11-16T13:57:59.704 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.lo.mcast_resolicit": "0", 2023-11-16T13:57:59.704 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.lo.mcast_solicit": "3", 2023-11-16T13:57:59.704 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.lo.proxy_delay": "80", 2023-11-16T13:57:59.704 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.lo.proxy_qlen": "64", 2023-11-16T13:57:59.704 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.lo.retrans_time_ms": "1000", 2023-11-16T13:57:59.704 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.lo.ucast_solicit": "3", 2023-11-16T13:57:59.704 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.lo.unres_qlen": "101", 2023-11-16T13:57:59.704 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.neigh.lo.unres_qlen_bytes": "212992", 2023-11-16T13:57:59.704 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.route.gc_elasticity": "9", 2023-11-16T13:57:59.704 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.route.gc_interval": "30", 2023-11-16T13:57:59.704 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.route.gc_min_interval": "0", 2023-11-16T13:57:59.705 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.route.gc_min_interval_ms": "500", 2023-11-16T13:57:59.705 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.route.gc_thresh": "1024", 2023-11-16T13:57:59.705 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.route.gc_timeout": "60", 2023-11-16T13:57:59.705 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.route.max_size": "4096", 2023-11-16T13:57:59.705 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.route.min_adv_mss": "1220", 2023-11-16T13:57:59.705 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.route.mtu_expires": "600", 2023-11-16T13:57:59.705 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.seg6_flowlabel": "0", 2023-11-16T13:57:59.705 INFO:tasks.workunit.client.0.smithi067.stdout: "net.ipv6.xfrm6_gc_thresh": "32768", 2023-11-16T13:57:59.705 INFO:tasks.workunit.client.0.smithi067.stdout: "net.mptcp.add_addr_timeout": "120", 2023-11-16T13:57:59.705 INFO:tasks.workunit.client.0.smithi067.stdout: "net.mptcp.enabled": "0", 2023-11-16T13:57:59.705 INFO:tasks.workunit.client.0.smithi067.stdout: "net.mptcp.stale_loss_cnt": "4", 2023-11-16T13:57:59.705 INFO:tasks.workunit.client.0.smithi067.stdout: "net.netfilter.nf_log.0": "NONE", 2023-11-16T13:57:59.705 INFO:tasks.workunit.client.0.smithi067.stdout: "net.netfilter.nf_log.1": "NONE", 2023-11-16T13:57:59.706 INFO:tasks.workunit.client.0.smithi067.stdout: "net.netfilter.nf_log.10": "NONE", 2023-11-16T13:57:59.706 INFO:tasks.workunit.client.0.smithi067.stdout: "net.netfilter.nf_log.11": "NONE", 2023-11-16T13:57:59.706 INFO:tasks.workunit.client.0.smithi067.stdout: "net.netfilter.nf_log.12": "NONE", 2023-11-16T13:57:59.706 INFO:tasks.workunit.client.0.smithi067.stdout: "net.netfilter.nf_log.2": "NONE", 2023-11-16T13:57:59.706 INFO:tasks.workunit.client.0.smithi067.stdout: "net.netfilter.nf_log.3": "NONE", 2023-11-16T13:57:59.706 INFO:tasks.workunit.client.0.smithi067.stdout: "net.netfilter.nf_log.4": "NONE", 2023-11-16T13:57:59.706 INFO:tasks.workunit.client.0.smithi067.stdout: "net.netfilter.nf_log.5": "NONE", 2023-11-16T13:57:59.706 INFO:tasks.workunit.client.0.smithi067.stdout: "net.netfilter.nf_log.6": "NONE", 2023-11-16T13:57:59.706 INFO:tasks.workunit.client.0.smithi067.stdout: "net.netfilter.nf_log.7": "NONE", 2023-11-16T13:57:59.706 INFO:tasks.workunit.client.0.smithi067.stdout: "net.netfilter.nf_log.8": "NONE", 2023-11-16T13:57:59.706 INFO:tasks.workunit.client.0.smithi067.stdout: "net.netfilter.nf_log.9": "NONE", 2023-11-16T13:57:59.706 INFO:tasks.workunit.client.0.smithi067.stdout: "net.netfilter.nf_log_all_netns": "0", 2023-11-16T13:57:59.706 INFO:tasks.workunit.client.0.smithi067.stdout: "net.unix.max_dgram_qlen": "512", 2023-11-16T13:57:59.707 INFO:tasks.workunit.client.0.smithi067.stdout: "sunrpc.max_resvport": "1023", 2023-11-16T13:57:59.707 INFO:tasks.workunit.client.0.smithi067.stdout: "sunrpc.min_resvport": "665", 2023-11-16T13:57:59.707 INFO:tasks.workunit.client.0.smithi067.stdout: "sunrpc.nfs_debug": "0x0000", 2023-11-16T13:57:59.707 INFO:tasks.workunit.client.0.smithi067.stdout: "sunrpc.nfsd_debug": "0x0000", 2023-11-16T13:57:59.707 INFO:tasks.workunit.client.0.smithi067.stdout: "sunrpc.nlm_debug": "0x0000", 2023-11-16T13:57:59.707 INFO:tasks.workunit.client.0.smithi067.stdout: "sunrpc.rpc_debug": "0x0000", 2023-11-16T13:57:59.707 INFO:tasks.workunit.client.0.smithi067.stdout: "sunrpc.tcp_fin_timeout": "15", 2023-11-16T13:57:59.707 INFO:tasks.workunit.client.0.smithi067.stdout: "sunrpc.tcp_max_slot_table_entries": "65536", 2023-11-16T13:57:59.707 INFO:tasks.workunit.client.0.smithi067.stdout: "sunrpc.tcp_slot_table_entries": "2", 2023-11-16T13:57:59.707 INFO:tasks.workunit.client.0.smithi067.stdout: "sunrpc.transports": "udp 32768", 2023-11-16T13:57:59.707 INFO:tasks.workunit.client.0.smithi067.stdout: "sunrpc.udp_slot_table_entries": "16", 2023-11-16T13:57:59.707 INFO:tasks.workunit.client.0.smithi067.stdout: "user.max_cgroup_namespaces": "127234", 2023-11-16T13:57:59.707 INFO:tasks.workunit.client.0.smithi067.stdout: "user.max_inotify_instances": "128", 2023-11-16T13:57:59.708 INFO:tasks.workunit.client.0.smithi067.stdout: "user.max_inotify_watches": "242396", 2023-11-16T13:57:59.708 INFO:tasks.workunit.client.0.smithi067.stdout: "user.max_ipc_namespaces": "127234", 2023-11-16T13:57:59.708 INFO:tasks.workunit.client.0.smithi067.stdout: "user.max_mnt_namespaces": "127234", 2023-11-16T13:57:59.708 INFO:tasks.workunit.client.0.smithi067.stdout: "user.max_net_namespaces": "127234", 2023-11-16T13:57:59.708 INFO:tasks.workunit.client.0.smithi067.stdout: "user.max_pid_namespaces": "127234", 2023-11-16T13:57:59.708 INFO:tasks.workunit.client.0.smithi067.stdout: "user.max_time_namespaces": "127234", 2023-11-16T13:57:59.708 INFO:tasks.workunit.client.0.smithi067.stdout: "user.max_user_namespaces": "127234", 2023-11-16T13:57:59.708 INFO:tasks.workunit.client.0.smithi067.stdout: "user.max_uts_namespaces": "127234", 2023-11-16T13:57:59.708 INFO:tasks.workunit.client.0.smithi067.stdout: "vm.admin_reserve_kbytes": "8192", 2023-11-16T13:57:59.708 INFO:tasks.workunit.client.0.smithi067.stdout: "vm.block_dump": "0", 2023-11-16T13:57:59.708 INFO:tasks.workunit.client.0.smithi067.stdout: "vm.compact_unevictable_allowed": "1", 2023-11-16T13:57:59.708 INFO:tasks.workunit.client.0.smithi067.stdout: "vm.compaction_proactiveness": "0", 2023-11-16T13:57:59.709 INFO:tasks.workunit.client.0.smithi067.stdout: "vm.dirty_background_bytes": "0", 2023-11-16T13:57:59.709 INFO:tasks.workunit.client.0.smithi067.stdout: "vm.dirty_background_ratio": "10", 2023-11-16T13:57:59.709 INFO:tasks.workunit.client.0.smithi067.stdout: "vm.dirty_bytes": "0", 2023-11-16T13:57:59.709 INFO:tasks.workunit.client.0.smithi067.stdout: "vm.dirty_expire_centisecs": "3000", 2023-11-16T13:57:59.709 INFO:tasks.workunit.client.0.smithi067.stdout: "vm.dirty_ratio": "40", 2023-11-16T13:57:59.709 INFO:tasks.workunit.client.0.smithi067.stdout: "vm.dirty_writeback_centisecs": "500", 2023-11-16T13:57:59.709 INFO:tasks.workunit.client.0.smithi067.stdout: "vm.dirtytime_expire_seconds": "43200", 2023-11-16T13:57:59.709 INFO:tasks.workunit.client.0.smithi067.stdout: "vm.drop_caches": "0", 2023-11-16T13:57:59.709 INFO:tasks.workunit.client.0.smithi067.stdout: "vm.extfrag_threshold": "500", 2023-11-16T13:57:59.709 INFO:tasks.workunit.client.0.smithi067.stdout: "vm.force_cgroup_v2_swappiness": "0", 2023-11-16T13:57:59.709 INFO:tasks.workunit.client.0.smithi067.stdout: "vm.hugetlb_shm_group": "0", 2023-11-16T13:57:59.709 INFO:tasks.workunit.client.0.smithi067.stdout: "vm.laptop_mode": "0", 2023-11-16T13:57:59.709 INFO:tasks.workunit.client.0.smithi067.stdout: "vm.legacy_va_layout": "0", 2023-11-16T13:57:59.709 INFO:tasks.workunit.client.0.smithi067.stdout: "vm.lowmem_reserve_ratio": "256\t256\t32\t0\t0", 2023-11-16T13:57:59.710 INFO:tasks.workunit.client.0.smithi067.stdout: "vm.max_map_count": "65530", 2023-11-16T13:57:59.710 INFO:tasks.workunit.client.0.smithi067.stdout: "vm.memory_failure_early_kill": "0", 2023-11-16T13:57:59.710 INFO:tasks.workunit.client.0.smithi067.stdout: "vm.memory_failure_recovery": "1", 2023-11-16T13:57:59.710 INFO:tasks.workunit.client.0.smithi067.stdout: "vm.min_free_kbytes": "67584", 2023-11-16T13:57:59.710 INFO:tasks.workunit.client.0.smithi067.stdout: "vm.min_slab_ratio": "5", 2023-11-16T13:57:59.710 INFO:tasks.workunit.client.0.smithi067.stdout: "vm.min_unmapped_ratio": "1", 2023-11-16T13:57:59.710 INFO:tasks.workunit.client.0.smithi067.stdout: "vm.mmap_min_addr": "4096", 2023-11-16T13:57:59.710 INFO:tasks.workunit.client.0.smithi067.stdout: "vm.mmap_rnd_bits": "28", 2023-11-16T13:57:59.710 INFO:tasks.workunit.client.0.smithi067.stdout: "vm.mmap_rnd_compat_bits": "8", 2023-11-16T13:57:59.710 INFO:tasks.workunit.client.0.smithi067.stdout: "vm.nr_hugepages": "0", 2023-11-16T13:57:59.710 INFO:tasks.workunit.client.0.smithi067.stdout: "vm.nr_hugepages_mempolicy": "0", 2023-11-16T13:57:59.711 INFO:tasks.workunit.client.0.smithi067.stdout: "vm.nr_overcommit_hugepages": "0", 2023-11-16T13:57:59.711 INFO:tasks.workunit.client.0.smithi067.stdout: "vm.numa_stat": "1", 2023-11-16T13:57:59.711 INFO:tasks.workunit.client.0.smithi067.stdout: "vm.numa_zonelist_order": "Node", 2023-11-16T13:57:59.711 INFO:tasks.workunit.client.0.smithi067.stdout: "vm.oom_dump_tasks": "1", 2023-11-16T13:57:59.711 INFO:tasks.workunit.client.0.smithi067.stdout: "vm.oom_kill_allocating_task": "0", 2023-11-16T13:57:59.711 INFO:tasks.workunit.client.0.smithi067.stdout: "vm.overcommit_kbytes": "0", 2023-11-16T13:57:59.711 INFO:tasks.workunit.client.0.smithi067.stdout: "vm.overcommit_memory": "0", 2023-11-16T13:57:59.711 INFO:tasks.workunit.client.0.smithi067.stdout: "vm.overcommit_ratio": "50", 2023-11-16T13:57:59.711 INFO:tasks.workunit.client.0.smithi067.stdout: "vm.page-cluster": "3", 2023-11-16T13:57:59.711 INFO:tasks.workunit.client.0.smithi067.stdout: "vm.panic_on_oom": "0", 2023-11-16T13:57:59.711 INFO:tasks.workunit.client.0.smithi067.stdout: "vm.percpu_pagelist_fraction": "0", 2023-11-16T13:57:59.711 INFO:tasks.workunit.client.0.smithi067.stdout: "vm.stat_interval": "1", 2023-11-16T13:57:59.711 INFO:tasks.workunit.client.0.smithi067.stdout: "vm.swappiness": "10", 2023-11-16T13:57:59.711 INFO:tasks.workunit.client.0.smithi067.stdout: "vm.user_reserve_kbytes": "131072", 2023-11-16T13:57:59.712 INFO:tasks.workunit.client.0.smithi067.stdout: "vm.vfs_cache_pressure": "100", 2023-11-16T13:57:59.712 INFO:tasks.workunit.client.0.smithi067.stdout: "vm.watermark_boost_factor": "15000", 2023-11-16T13:57:59.712 INFO:tasks.workunit.client.0.smithi067.stdout: "vm.watermark_scale_factor": "10", 2023-11-16T13:57:59.712 INFO:tasks.workunit.client.0.smithi067.stdout: "vm.zone_reclaim_mode": "0" 2023-11-16T13:57:59.712 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2023-11-16T13:57:59.712 INFO:tasks.workunit.client.0.smithi067.stdout: "system_uptime": 1097.93, 2023-11-16T13:57:59.712 INFO:tasks.workunit.client.0.smithi067.stdout: "tcp6_ports_used": [ 2023-11-16T13:57:59.712 INFO:tasks.workunit.client.0.smithi067.stdout: 5666, 2023-11-16T13:57:59.712 INFO:tasks.workunit.client.0.smithi067.stdout: 111, 2023-11-16T13:57:59.712 INFO:tasks.workunit.client.0.smithi067.stdout: 22, 2023-11-16T13:57:59.712 INFO:tasks.workunit.client.0.smithi067.stdout: 631 2023-11-16T13:57:59.712 INFO:tasks.workunit.client.0.smithi067.stdout: ], 2023-11-16T13:57:59.713 INFO:tasks.workunit.client.0.smithi067.stdout: "tcp_ports_used": [ 2023-11-16T13:57:59.713 INFO:tasks.workunit.client.0.smithi067.stdout: 5666, 2023-11-16T13:57:59.713 INFO:tasks.workunit.client.0.smithi067.stdout: 111, 2023-11-16T13:57:59.713 INFO:tasks.workunit.client.0.smithi067.stdout: 22, 2023-11-16T13:57:59.713 INFO:tasks.workunit.client.0.smithi067.stdout: 631 2023-11-16T13:57:59.713 INFO:tasks.workunit.client.0.smithi067.stdout: ], 2023-11-16T13:57:59.713 INFO:tasks.workunit.client.0.smithi067.stdout: "timestamp": 1700143079.5818992, 2023-11-16T13:57:59.713 INFO:tasks.workunit.client.0.smithi067.stdout: "udp6_ports_used": [ 2023-11-16T13:57:59.713 INFO:tasks.workunit.client.0.smithi067.stdout: 5353, 2023-11-16T13:57:59.713 INFO:tasks.workunit.client.0.smithi067.stdout: 47728, 2023-11-16T13:57:59.713 INFO:tasks.workunit.client.0.smithi067.stdout: 111, 2023-11-16T13:57:59.713 INFO:tasks.workunit.client.0.smithi067.stdout: 323 2023-11-16T13:57:59.714 INFO:tasks.workunit.client.0.smithi067.stdout: ], 2023-11-16T13:57:59.714 INFO:tasks.workunit.client.0.smithi067.stdout: "udp_ports_used": [ 2023-11-16T13:57:59.714 INFO:tasks.workunit.client.0.smithi067.stdout: 5353, 2023-11-16T13:57:59.714 INFO:tasks.workunit.client.0.smithi067.stdout: 46795, 2023-11-16T13:57:59.714 INFO:tasks.workunit.client.0.smithi067.stdout: 111, 2023-11-16T13:57:59.714 INFO:tasks.workunit.client.0.smithi067.stdout: 323 2023-11-16T13:57:59.714 INFO:tasks.workunit.client.0.smithi067.stdout: ], 2023-11-16T13:57:59.714 INFO:tasks.workunit.client.0.smithi067.stdout: "vendor": "Supermicro" 2023-11-16T13:57:59.714 INFO:tasks.workunit.client.0.smithi067.stdout:} 2023-11-16T13:57:59.715 INFO:tasks.workunit.client.0.smithi067.stderr:+ sudo CEPHADM_IMAGE=quay.ceph.io/ceph-ci/ceph:pacific /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm version 2023-11-16T13:58:42.693 INFO:tasks.workunit.client.0.smithi067.stdout:ceph version 16.2.14-180-g9513c28f (9513c28fe2d0c3ab65a3cff29b7944305ca42a95) pacific (stable) 2023-11-16T13:58:42.718 INFO:tasks.workunit.client.0.smithi067.stderr:+ sudo CEPHADM_IMAGE=quay.ceph.io/ceph-ci/ceph:pacific /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm version 2023-11-16T13:58:42.719 INFO:tasks.workunit.client.0.smithi067.stderr:+ grep 'ceph version 16' 2023-11-16T13:58:44.038 INFO:tasks.workunit.client.0.smithi067.stdout:ceph version 16.2.14-180-g9513c28f (9513c28fe2d0c3ab65a3cff29b7944305ca42a95) pacific (stable) 2023-11-16T13:58:44.039 INFO:tasks.workunit.client.0.smithi067.stderr:+ sudo /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm --image quay.ceph.io/ceph-ci/ceph:main version 2023-11-16T13:58:44.039 INFO:tasks.workunit.client.0.smithi067.stderr:+ grep 'ceph version' 2023-11-16T13:59:21.580 INFO:tasks.workunit.client.0.smithi067.stdout:ceph version 18.0.0-7374-gd9a4752c (d9a4752cd89db11e6480d5d59cf3fd277bbeaf49) reef (dev) 2023-11-16T13:59:21.581 INFO:tasks.workunit.client.0.smithi067.stderr:+ systemctl status docker 2023-11-16T13:59:21.587 INFO:tasks.workunit.client.0.smithi067.stderr:Unit docker.service could not be found. 2023-11-16T13:59:21.587 INFO:tasks.workunit.client.0.smithi067.stderr:+ echo 'docker not installed' 2023-11-16T13:59:21.588 INFO:tasks.workunit.client.0.smithi067.stdout:docker not installed 2023-11-16T13:59:21.588 INFO:tasks.workunit.client.0.smithi067.stderr:+ sudo /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 00000000-0000-0000-0000-0000deadbeef -- ceph -v 2023-11-16T13:59:21.588 INFO:tasks.workunit.client.0.smithi067.stderr:+ grep 'ceph version' 2023-11-16T14:00:11.191 INFO:tasks.workunit.client.0.smithi067.stdout:ceph version 17.2.7-67-g7155e8e3 (7155e8e36fbbeb81765cc73048bcb9c2ada8125c) quincy (stable) 2023-11-16T14:00:11.192 INFO:tasks.workunit.client.0.smithi067.stderr:+ sudo /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 00000000-0000-0000-0000-0000deadbeef -e FOO=BAR -- printenv 2023-11-16T14:00:11.192 INFO:tasks.workunit.client.0.smithi067.stderr:+ grep FOO=BAR 2023-11-16T14:00:13.647 INFO:tasks.workunit.client.0.smithi067.stdout:FOO=BAR 2023-11-16T14:00:13.647 INFO:tasks.workunit.client.0.smithi067.stderr:+ echo foo 2023-11-16T14:00:13.647 INFO:tasks.workunit.client.0.smithi067.stderr:+ sudo /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -- cat 2023-11-16T14:00:13.647 INFO:tasks.workunit.client.0.smithi067.stderr:+ grep -q foo 2023-11-16T14:00:15.108 INFO:tasks.workunit.client.0.smithi067.stderr:+ sudo /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy rm-cluster --fsid 00000000-0000-0000-0000-0000deadbeef --force 2023-11-16T14:00:15.651 INFO:tasks.workunit.client.0.smithi067.stderr:++ mktemp -p tmp.test_cephadm.sh.Kh7Xjy 2023-11-16T14:00:15.652 INFO:tasks.workunit.client.0.smithi067.stderr:+ ORIG_CONFIG=tmp.test_cephadm.sh.Kh7Xjy/tmp.CiZ7EIm7xm 2023-11-16T14:00:15.652 INFO:tasks.workunit.client.0.smithi067.stderr:++ mktemp -p tmp.test_cephadm.sh.Kh7Xjy 2023-11-16T14:00:15.653 INFO:tasks.workunit.client.0.smithi067.stderr:+ CONFIG=tmp.test_cephadm.sh.Kh7Xjy/tmp.WISDFcPwVW 2023-11-16T14:00:15.653 INFO:tasks.workunit.client.0.smithi067.stderr:++ mktemp -p tmp.test_cephadm.sh.Kh7Xjy 2023-11-16T14:00:15.653 INFO:tasks.workunit.client.0.smithi067.stderr:+ MONCONFIG=tmp.test_cephadm.sh.Kh7Xjy/tmp.HfJs9pAfLJ 2023-11-16T14:00:15.654 INFO:tasks.workunit.client.0.smithi067.stderr:++ mktemp -p tmp.test_cephadm.sh.Kh7Xjy 2023-11-16T14:00:15.654 INFO:tasks.workunit.client.0.smithi067.stderr:+ KEYRING=tmp.test_cephadm.sh.Kh7Xjy/tmp.aRbRYvgvnb 2023-11-16T14:00:15.654 INFO:tasks.workunit.client.0.smithi067.stderr:+ IP=127.0.0.1 2023-11-16T14:00:15.654 INFO:tasks.workunit.client.0.smithi067.stderr:+ cat 2023-11-16T14:00:15.656 INFO:tasks.workunit.client.0.smithi067.stderr:+ sudo /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy bootstrap --mon-id a --mgr-id x --mon-ip 127.0.0.1 --fsid 00000000-0000-0000-0000-0000deadbeef --config tmp.test_cephadm.sh.Kh7Xjy/tmp.CiZ7EIm7xm --output-config tmp.test_cephadm.sh.Kh7Xjy/tmp.WISDFcPwVW --output-keyring tmp.test_cephadm.sh.Kh7Xjy/tmp.aRbRYvgvnb --output-pub-ssh-key tmp.test_cephadm.sh.Kh7Xjy/ceph.pub --allow-overwrite --skip-mon-network --skip-monitoring-stack 2023-11-16T14:00:15.896 INFO:tasks.workunit.client.0.smithi067.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2023-11-16T14:00:15.896 INFO:tasks.workunit.client.0.smithi067.stdout:Verifying podman|docker is present... 2023-11-16T14:00:15.961 INFO:tasks.workunit.client.0.smithi067.stdout:Verifying lvm2 is present... 2023-11-16T14:00:15.961 INFO:tasks.workunit.client.0.smithi067.stdout:Verifying time synchronization is in place... 2023-11-16T14:00:15.986 INFO:tasks.workunit.client.0.smithi067.stdout:Unit chronyd.service is enabled and running 2023-11-16T14:00:15.987 INFO:tasks.workunit.client.0.smithi067.stdout:Repeating the final host check... 2023-11-16T14:00:16.048 INFO:tasks.workunit.client.0.smithi067.stdout:podman (/bin/podman) version 3.0.1 is present 2023-11-16T14:00:16.048 INFO:tasks.workunit.client.0.smithi067.stdout:systemctl is present 2023-11-16T14:00:16.048 INFO:tasks.workunit.client.0.smithi067.stdout:lvcreate is present 2023-11-16T14:00:16.072 INFO:tasks.workunit.client.0.smithi067.stdout:Unit chronyd.service is enabled and running 2023-11-16T14:00:16.072 INFO:tasks.workunit.client.0.smithi067.stdout:Host looks OK 2023-11-16T14:00:16.072 INFO:tasks.workunit.client.0.smithi067.stdout:Cluster fsid: 00000000-0000-0000-0000-0000deadbeef 2023-11-16T14:00:16.072 INFO:tasks.workunit.client.0.smithi067.stdout:Verifying IP 127.0.0.1 port 3300 ... 2023-11-16T14:00:16.072 INFO:tasks.workunit.client.0.smithi067.stdout:Verifying IP 127.0.0.1 port 6789 ... 2023-11-16T14:00:16.073 INFO:tasks.workunit.client.0.smithi067.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2023-11-16T14:00:16.073 INFO:tasks.workunit.client.0.smithi067.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2023-11-16T14:00:17.733 INFO:tasks.workunit.client.0.smithi067.stdout:Ceph version: ceph version 17.2.7-67-g7155e8e3 (7155e8e36fbbeb81765cc73048bcb9c2ada8125c) quincy (stable) 2023-11-16T14:00:17.733 INFO:tasks.workunit.client.0.smithi067.stdout:Extracting ceph user uid/gid from container image... 2023-11-16T14:00:18.609 INFO:tasks.workunit.client.0.smithi067.stdout:Creating initial keys... 2023-11-16T14:00:21.497 INFO:tasks.workunit.client.0.smithi067.stdout:Creating initial monmap... 2023-11-16T14:00:22.464 INFO:tasks.workunit.client.0.smithi067.stdout:Creating mon... 2023-11-16T14:00:24.889 INFO:tasks.workunit.client.0.smithi067.stdout:Waiting for mon to start... 2023-11-16T14:00:24.889 INFO:tasks.workunit.client.0.smithi067.stdout:Waiting for mon... 2023-11-16T14:00:26.272 INFO:tasks.workunit.client.0.smithi067.stdout:mon is available 2023-11-16T14:00:26.273 INFO:tasks.workunit.client.0.smithi067.stdout:Assimilating anything we can from ceph.conf... 2023-11-16T14:00:27.630 INFO:tasks.workunit.client.0.smithi067.stdout:Generating new minimal ceph.conf... 2023-11-16T14:00:28.855 INFO:tasks.workunit.client.0.smithi067.stdout:Restarting the monitor... 2023-11-16T14:00:30.626 INFO:tasks.workunit.client.0.smithi067.stdout:Wrote config to tmp.test_cephadm.sh.Kh7Xjy/tmp.WISDFcPwVW 2023-11-16T14:00:30.626 INFO:tasks.workunit.client.0.smithi067.stdout:Wrote keyring to tmp.test_cephadm.sh.Kh7Xjy/tmp.aRbRYvgvnb 2023-11-16T14:00:30.626 INFO:tasks.workunit.client.0.smithi067.stdout:Creating mgr... 2023-11-16T14:00:30.627 INFO:tasks.workunit.client.0.smithi067.stdout:Verifying port 9283 ... 2023-11-16T14:00:31.548 INFO:tasks.workunit.client.0.smithi067.stdout:Waiting for mgr to start... 2023-11-16T14:00:31.549 INFO:tasks.workunit.client.0.smithi067.stdout:Waiting for mgr... 2023-11-16T14:00:33.047 INFO:tasks.workunit.client.0.smithi067.stdout:mgr not available, waiting (1/15)... 2023-11-16T14:00:36.421 INFO:tasks.workunit.client.0.smithi067.stdout:mgr not available, waiting (2/15)... 2023-11-16T14:00:39.671 INFO:tasks.workunit.client.0.smithi067.stdout:mgr not available, waiting (3/15)... 2023-11-16T14:00:43.137 INFO:tasks.workunit.client.0.smithi067.stdout:mgr is available 2023-11-16T14:00:44.487 INFO:tasks.workunit.client.0.smithi067.stdout:Enabling cephadm module... 2023-11-16T14:00:47.411 INFO:tasks.workunit.client.0.smithi067.stdout:Waiting for the mgr to restart... 2023-11-16T14:00:47.411 INFO:tasks.workunit.client.0.smithi067.stdout:Waiting for mgr epoch 5... 2023-11-16T14:00:53.753 INFO:tasks.workunit.client.0.smithi067.stdout:mgr epoch 5 is available 2023-11-16T14:00:53.753 INFO:tasks.workunit.client.0.smithi067.stdout:Setting orchestrator backend to cephadm... 2023-11-16T14:00:56.635 INFO:tasks.workunit.client.0.smithi067.stdout:Generating ssh key... 2023-11-16T14:00:59.577 INFO:tasks.workunit.client.0.smithi067.stdout:Wrote public SSH key to tmp.test_cephadm.sh.Kh7Xjy/ceph.pub 2023-11-16T14:00:59.577 INFO:tasks.workunit.client.0.smithi067.stdout:Adding key to root@localhost authorized_keys... 2023-11-16T14:00:59.578 INFO:tasks.workunit.client.0.smithi067.stdout:Adding host smithi067... 2023-11-16T14:01:02.777 INFO:tasks.workunit.client.0.smithi067.stdout:Deploying mon service with default placement... 2023-11-16T14:01:04.559 INFO:tasks.workunit.client.0.smithi067.stdout:Deploying mgr service with default placement... 2023-11-16T14:01:06.242 INFO:tasks.workunit.client.0.smithi067.stdout:Deploying crash service with default placement... 2023-11-16T14:01:11.618 INFO:tasks.workunit.client.0.smithi067.stdout:Enabling the dashboard module... 2023-11-16T14:01:15.221 INFO:tasks.workunit.client.0.smithi067.stdout:Waiting for the mgr to restart... 2023-11-16T14:01:15.222 INFO:tasks.workunit.client.0.smithi067.stdout:Waiting for mgr epoch 9... 2023-11-16T14:01:21.624 INFO:tasks.workunit.client.0.smithi067.stdout:mgr epoch 9 is available 2023-11-16T14:01:23.935 INFO:tasks.workunit.client.0.smithi067.stdout:Generating a dashboard self-signed certificate... 2023-11-16T14:01:23.935 INFO:tasks.workunit.client.0.smithi067.stdout:Creating initial admin user... 2023-11-16T14:01:25.256 INFO:tasks.workunit.client.0.smithi067.stdout:Fetching dashboard port number... 2023-11-16T14:01:26.787 INFO:tasks.workunit.client.0.smithi067.stdout:Ceph Dashboard is now available at: 2023-11-16T14:01:26.787 INFO:tasks.workunit.client.0.smithi067.stdout: 2023-11-16T14:01:26.787 INFO:tasks.workunit.client.0.smithi067.stdout: URL: https://smithi067.front.sepia.ceph.com:8443/ 2023-11-16T14:01:26.787 INFO:tasks.workunit.client.0.smithi067.stdout: User: admin 2023-11-16T14:01:26.787 INFO:tasks.workunit.client.0.smithi067.stdout: Password: zi5673bjh6 2023-11-16T14:01:26.787 INFO:tasks.workunit.client.0.smithi067.stdout: 2023-11-16T14:01:26.787 INFO:tasks.workunit.client.0.smithi067.stdout:Saving cluster configuration to /var/lib/ceph/00000000-0000-0000-0000-0000deadbeef/config directory 2023-11-16T14:01:26.788 INFO:tasks.workunit.client.0.smithi067.stdout:Enabling autotune for osd_memory_target 2023-11-16T14:01:29.815 INFO:tasks.workunit.client.0.smithi067.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2023-11-16T14:01:29.815 INFO:tasks.workunit.client.0.smithi067.stdout: 2023-11-16T14:01:29.815 INFO:tasks.workunit.client.0.smithi067.stdout: sudo /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm shell --fsid 00000000-0000-0000-0000-0000deadbeef -c tmp.test_cephadm.sh.Kh7Xjy/tmp.WISDFcPwVW -k tmp.test_cephadm.sh.Kh7Xjy/tmp.aRbRYvgvnb 2023-11-16T14:01:29.815 INFO:tasks.workunit.client.0.smithi067.stdout: 2023-11-16T14:01:29.815 INFO:tasks.workunit.client.0.smithi067.stdout:Or, if you are only running a single cluster on this host: 2023-11-16T14:01:29.816 INFO:tasks.workunit.client.0.smithi067.stdout: 2023-11-16T14:01:29.816 INFO:tasks.workunit.client.0.smithi067.stdout: sudo /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm shell 2023-11-16T14:01:29.816 INFO:tasks.workunit.client.0.smithi067.stdout: 2023-11-16T14:01:29.816 INFO:tasks.workunit.client.0.smithi067.stdout:Please consider enabling telemetry to help improve Ceph: 2023-11-16T14:01:29.816 INFO:tasks.workunit.client.0.smithi067.stdout: 2023-11-16T14:01:29.816 INFO:tasks.workunit.client.0.smithi067.stdout: ceph telemetry on 2023-11-16T14:01:29.816 INFO:tasks.workunit.client.0.smithi067.stdout: 2023-11-16T14:01:29.816 INFO:tasks.workunit.client.0.smithi067.stdout:For more information see: 2023-11-16T14:01:29.816 INFO:tasks.workunit.client.0.smithi067.stdout: 2023-11-16T14:01:29.816 INFO:tasks.workunit.client.0.smithi067.stdout: https://docs.ceph.com/docs/master/mgr/telemetry/ 2023-11-16T14:01:29.816 INFO:tasks.workunit.client.0.smithi067.stdout: 2023-11-16T14:01:29.816 INFO:tasks.workunit.client.0.smithi067.stdout:Bootstrap complete. 2023-11-16T14:01:29.838 INFO:tasks.workunit.client.0.smithi067.stderr:+ test -e tmp.test_cephadm.sh.Kh7Xjy/tmp.WISDFcPwVW 2023-11-16T14:01:29.839 INFO:tasks.workunit.client.0.smithi067.stderr:+ test -e tmp.test_cephadm.sh.Kh7Xjy/tmp.aRbRYvgvnb 2023-11-16T14:01:29.839 INFO:tasks.workunit.client.0.smithi067.stderr:+ rm -f tmp.test_cephadm.sh.Kh7Xjy/tmp.CiZ7EIm7xm 2023-11-16T14:01:29.839 INFO:tasks.workunit.client.0.smithi067.stderr:+ sudo test -e /var/log/ceph/00000000-0000-0000-0000-0000deadbeef/ceph-mon.a.log 2023-11-16T14:01:29.866 INFO:tasks.workunit.client.0.smithi067.stderr:+ sudo test -e /var/log/ceph/00000000-0000-0000-0000-0000deadbeef/ceph-mgr.x.log 2023-11-16T14:01:29.877 INFO:tasks.workunit.client.0.smithi067.stderr:+ for u in ceph.target ceph-$FSID.target ceph-$FSID@mon.a ceph-$FSID@mgr.x 2023-11-16T14:01:29.878 INFO:tasks.workunit.client.0.smithi067.stderr:+ systemctl is-enabled ceph.target 2023-11-16T14:01:29.883 INFO:tasks.workunit.client.0.smithi067.stdout:enabled 2023-11-16T14:01:29.883 INFO:tasks.workunit.client.0.smithi067.stderr:+ systemctl is-active ceph.target 2023-11-16T14:01:29.887 INFO:tasks.workunit.client.0.smithi067.stdout:active 2023-11-16T14:01:29.888 INFO:tasks.workunit.client.0.smithi067.stderr:+ for u in ceph.target ceph-$FSID.target ceph-$FSID@mon.a ceph-$FSID@mgr.x 2023-11-16T14:01:29.888 INFO:tasks.workunit.client.0.smithi067.stderr:+ systemctl is-enabled ceph-00000000-0000-0000-0000-0000deadbeef.target 2023-11-16T14:01:29.892 INFO:tasks.workunit.client.0.smithi067.stdout:enabled 2023-11-16T14:01:29.892 INFO:tasks.workunit.client.0.smithi067.stderr:+ systemctl is-active ceph-00000000-0000-0000-0000-0000deadbeef.target 2023-11-16T14:01:29.896 INFO:tasks.workunit.client.0.smithi067.stdout:active 2023-11-16T14:01:29.897 INFO:tasks.workunit.client.0.smithi067.stderr:+ for u in ceph.target ceph-$FSID.target ceph-$FSID@mon.a ceph-$FSID@mgr.x 2023-11-16T14:01:29.897 INFO:tasks.workunit.client.0.smithi067.stderr:+ systemctl is-enabled ceph-00000000-0000-0000-0000-0000deadbeef@mon.a 2023-11-16T14:01:29.902 INFO:tasks.workunit.client.0.smithi067.stdout:enabled 2023-11-16T14:01:29.903 INFO:tasks.workunit.client.0.smithi067.stderr:+ systemctl is-active ceph-00000000-0000-0000-0000-0000deadbeef@mon.a 2023-11-16T14:01:29.907 INFO:tasks.workunit.client.0.smithi067.stdout:active 2023-11-16T14:01:29.908 INFO:tasks.workunit.client.0.smithi067.stderr:+ for u in ceph.target ceph-$FSID.target ceph-$FSID@mon.a ceph-$FSID@mgr.x 2023-11-16T14:01:29.908 INFO:tasks.workunit.client.0.smithi067.stderr:+ systemctl is-enabled ceph-00000000-0000-0000-0000-0000deadbeef@mgr.x 2023-11-16T14:01:29.913 INFO:tasks.workunit.client.0.smithi067.stdout:enabled 2023-11-16T14:01:29.914 INFO:tasks.workunit.client.0.smithi067.stderr:+ systemctl is-active ceph-00000000-0000-0000-0000-0000deadbeef@mgr.x 2023-11-16T14:01:29.918 INFO:tasks.workunit.client.0.smithi067.stdout:active 2023-11-16T14:01:29.918 INFO:tasks.workunit.client.0.smithi067.stderr:+ systemctl 2023-11-16T14:01:29.918 INFO:tasks.workunit.client.0.smithi067.stderr:+ grep system-ceph 2023-11-16T14:01:29.919 INFO:tasks.workunit.client.0.smithi067.stderr:+ grep -q .slice 2023-11-16T14:01:29.926 INFO:tasks.workunit.client.0.smithi067.stderr:+ sudo /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 00000000-0000-0000-0000-0000deadbeef --config tmp.test_cephadm.sh.Kh7Xjy/tmp.WISDFcPwVW --keyring tmp.test_cephadm.sh.Kh7Xjy/tmp.aRbRYvgvnb -- ceph -s 2023-11-16T14:01:29.926 INFO:tasks.workunit.client.0.smithi067.stderr:+ grep 00000000-0000-0000-0000-0000deadbeef 2023-11-16T14:01:33.841 INFO:tasks.workunit.client.0.smithi067.stdout: id: 00000000-0000-0000-0000-0000deadbeef 2023-11-16T14:01:33.841 INFO:tasks.workunit.client.0.smithi067.stderr:+ for t in mon mgr node-exporter prometheus grafana 2023-11-16T14:01:33.841 INFO:tasks.workunit.client.0.smithi067.stderr:+ sudo /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 00000000-0000-0000-0000-0000deadbeef --config tmp.test_cephadm.sh.Kh7Xjy/tmp.WISDFcPwVW --keyring tmp.test_cephadm.sh.Kh7Xjy/tmp.aRbRYvgvnb -- ceph orch apply mon --unmanaged 2023-11-16T14:01:37.099 INFO:tasks.workunit.client.0.smithi067.stdout:Scheduled mon update... 2023-11-16T14:01:38.226 INFO:tasks.workunit.client.0.smithi067.stderr:+ for t in mon mgr node-exporter prometheus grafana 2023-11-16T14:01:38.226 INFO:tasks.workunit.client.0.smithi067.stderr:+ sudo /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 00000000-0000-0000-0000-0000deadbeef --config tmp.test_cephadm.sh.Kh7Xjy/tmp.WISDFcPwVW --keyring tmp.test_cephadm.sh.Kh7Xjy/tmp.aRbRYvgvnb -- ceph orch apply mgr --unmanaged 2023-11-16T14:01:40.752 INFO:tasks.workunit.client.0.smithi067.stdout:Scheduled mgr update... 2023-11-16T14:01:41.734 INFO:tasks.workunit.client.0.smithi067.stderr:+ for t in mon mgr node-exporter prometheus grafana 2023-11-16T14:01:41.735 INFO:tasks.workunit.client.0.smithi067.stderr:+ sudo /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 00000000-0000-0000-0000-0000deadbeef --config tmp.test_cephadm.sh.Kh7Xjy/tmp.WISDFcPwVW --keyring tmp.test_cephadm.sh.Kh7Xjy/tmp.aRbRYvgvnb -- ceph orch apply node-exporter --unmanaged 2023-11-16T14:01:43.801 INFO:tasks.workunit.client.0.smithi067.stdout:Scheduled node-exporter update... 2023-11-16T14:01:44.533 INFO:tasks.workunit.client.0.smithi067.stderr:+ for t in mon mgr node-exporter prometheus grafana 2023-11-16T14:01:44.534 INFO:tasks.workunit.client.0.smithi067.stderr:+ sudo /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 00000000-0000-0000-0000-0000deadbeef --config tmp.test_cephadm.sh.Kh7Xjy/tmp.WISDFcPwVW --keyring tmp.test_cephadm.sh.Kh7Xjy/tmp.aRbRYvgvnb -- ceph orch apply prometheus --unmanaged 2023-11-16T14:01:46.541 INFO:tasks.workunit.client.0.smithi067.stdout:Scheduled prometheus update... 2023-11-16T14:01:47.234 INFO:tasks.workunit.client.0.smithi067.stderr:+ for t in mon mgr node-exporter prometheus grafana 2023-11-16T14:01:47.235 INFO:tasks.workunit.client.0.smithi067.stderr:+ sudo /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 00000000-0000-0000-0000-0000deadbeef --config tmp.test_cephadm.sh.Kh7Xjy/tmp.WISDFcPwVW --keyring tmp.test_cephadm.sh.Kh7Xjy/tmp.aRbRYvgvnb -- ceph orch apply grafana --unmanaged 2023-11-16T14:01:49.367 INFO:tasks.workunit.client.0.smithi067.stdout:Scheduled grafana update... 2023-11-16T14:01:50.051 INFO:tasks.workunit.client.0.smithi067.stderr:+ sudo /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ls 2023-11-16T14:01:50.052 INFO:tasks.workunit.client.0.smithi067.stderr:+ jq '.[]' 2023-11-16T14:01:50.052 INFO:tasks.workunit.client.0.smithi067.stderr:+ jq 'select(.name == "mon.a").fsid' 2023-11-16T14:01:50.053 INFO:tasks.workunit.client.0.smithi067.stderr:+ grep 00000000-0000-0000-0000-0000deadbeef 2023-11-16T14:01:51.151 INFO:tasks.workunit.client.0.smithi067.stdout:"00000000-0000-0000-0000-0000deadbeef" 2023-11-16T14:01:51.152 INFO:tasks.workunit.client.0.smithi067.stderr:+ sudo /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ls 2023-11-16T14:01:51.152 INFO:tasks.workunit.client.0.smithi067.stderr:+ jq '.[]' 2023-11-16T14:01:51.152 INFO:tasks.workunit.client.0.smithi067.stderr:+ jq 'select(.name == "mgr.x").fsid' 2023-11-16T14:01:51.152 INFO:tasks.workunit.client.0.smithi067.stderr:+ grep 00000000-0000-0000-0000-0000deadbeef 2023-11-16T14:01:52.271 INFO:tasks.workunit.client.0.smithi067.stdout:"00000000-0000-0000-0000-0000deadbeef" 2023-11-16T14:01:52.272 INFO:tasks.workunit.client.0.smithi067.stderr:+ sudo /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ls 2023-11-16T14:01:52.272 INFO:tasks.workunit.client.0.smithi067.stderr:+ jq '.[]' 2023-11-16T14:01:52.273 INFO:tasks.workunit.client.0.smithi067.stderr:+ jq 'select(.name == "mon.a").version' 2023-11-16T14:01:52.273 INFO:tasks.workunit.client.0.smithi067.stderr:+ grep -q '\.' 2023-11-16T14:01:53.349 INFO:tasks.workunit.client.0.smithi067.stderr:+ cp tmp.test_cephadm.sh.Kh7Xjy/tmp.WISDFcPwVW tmp.test_cephadm.sh.Kh7Xjy/tmp.HfJs9pAfLJ 2023-11-16T14:01:53.350 INFO:tasks.workunit.client.0.smithi067.stderr:+ echo 'public addrv = [v2:127.0.0.1:3301,v1:127.0.0.1:6790]' 2023-11-16T14:01:53.350 INFO:tasks.workunit.client.0.smithi067.stderr:+ sudo /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy deploy --name mon.b --fsid 00000000-0000-0000-0000-0000deadbeef --keyring /var/lib/ceph/00000000-0000-0000-0000-0000deadbeef/mon.a/keyring --config tmp.test_cephadm.sh.Kh7Xjy/tmp.HfJs9pAfLJ 2023-11-16T14:01:53.650 INFO:tasks.workunit.client.0.smithi067.stderr:Non-zero exit code 125 from /bin/podman container inspect --format {{.State.Status}} ceph-00000000-0000-0000-0000-0000deadbeef-mon-b 2023-11-16T14:01:53.650 INFO:tasks.workunit.client.0.smithi067.stderr:/bin/podman: stderr Error: error inspecting object: no such container ceph-00000000-0000-0000-0000-0000deadbeef-mon-b 2023-11-16T14:01:53.707 INFO:tasks.workunit.client.0.smithi067.stderr:Non-zero exit code 125 from /bin/podman container inspect --format {{.State.Status}} ceph-00000000-0000-0000-0000-0000deadbeef-mon.b 2023-11-16T14:01:53.707 INFO:tasks.workunit.client.0.smithi067.stderr:/bin/podman: stderr Error: error inspecting object: no such container ceph-00000000-0000-0000-0000-0000deadbeef-mon.b 2023-11-16T14:01:53.707 INFO:tasks.workunit.client.0.smithi067.stderr:Deploy daemon mon.b ... 2023-11-16T14:01:56.790 INFO:tasks.workunit.client.0.smithi067.stderr:+ for u in ceph-$FSID@mon.b 2023-11-16T14:01:56.790 INFO:tasks.workunit.client.0.smithi067.stderr:+ systemctl is-enabled ceph-00000000-0000-0000-0000-0000deadbeef@mon.b 2023-11-16T14:01:56.796 INFO:tasks.workunit.client.0.smithi067.stdout:enabled 2023-11-16T14:01:56.796 INFO:tasks.workunit.client.0.smithi067.stderr:+ systemctl is-active ceph-00000000-0000-0000-0000-0000deadbeef@mon.b 2023-11-16T14:01:56.800 INFO:tasks.workunit.client.0.smithi067.stdout:active 2023-11-16T14:01:56.801 INFO:tasks.workunit.client.0.smithi067.stderr:+ cond='sudo /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 00000000-0000-0000-0000-0000deadbeef --config tmp.test_cephadm.sh.Kh7Xjy/tmp.WISDFcPwVW --keyring tmp.test_cephadm.sh.Kh7Xjy/tmp.aRbRYvgvnb -- ceph mon stat | grep '\''2 mons'\''' 2023-11-16T14:01:56.801 INFO:tasks.workunit.client.0.smithi067.stderr:+ is_available mon.b 'sudo /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 00000000-0000-0000-0000-0000deadbeef --config tmp.test_cephadm.sh.Kh7Xjy/tmp.WISDFcPwVW --keyring tmp.test_cephadm.sh.Kh7Xjy/tmp.aRbRYvgvnb -- ceph mon stat | grep '\''2 mons'\''' 30 2023-11-16T14:01:56.801 INFO:tasks.workunit.client.0.smithi067.stderr:+ local name=mon.b 2023-11-16T14:01:56.802 INFO:tasks.workunit.client.0.smithi067.stderr:+ local 'condition=sudo /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 00000000-0000-0000-0000-0000deadbeef --config tmp.test_cephadm.sh.Kh7Xjy/tmp.WISDFcPwVW --keyring tmp.test_cephadm.sh.Kh7Xjy/tmp.aRbRYvgvnb -- ceph mon stat | grep '\''2 mons'\''' 2023-11-16T14:01:56.802 INFO:tasks.workunit.client.0.smithi067.stderr:+ local tries=30 2023-11-16T14:01:56.802 INFO:tasks.workunit.client.0.smithi067.stderr:+ local num=0 2023-11-16T14:01:56.802 INFO:tasks.workunit.client.0.smithi067.stderr:+ eval 'sudo /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 00000000-0000-0000-0000-0000deadbeef --config tmp.test_cephadm.sh.Kh7Xjy/tmp.WISDFcPwVW --keyring tmp.test_cephadm.sh.Kh7Xjy/tmp.aRbRYvgvnb -- ceph mon stat | grep '\''2 mons'\''' 2023-11-16T14:01:56.802 INFO:tasks.workunit.client.0.smithi067.stderr:++ sudo /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 00000000-0000-0000-0000-0000deadbeef --config tmp.test_cephadm.sh.Kh7Xjy/tmp.WISDFcPwVW --keyring tmp.test_cephadm.sh.Kh7Xjy/tmp.aRbRYvgvnb -- ceph mon stat 2023-11-16T14:01:56.802 INFO:tasks.workunit.client.0.smithi067.stderr:++ grep '2 mons' 2023-11-16T14:02:02.808 INFO:tasks.workunit.client.0.smithi067.stdout:e2: 2 mons at {a=[v2:127.0.0.1:3300/0,v1:127.0.0.1:6789/0],b=[v2:127.0.0.1:3301/0,v1:127.0.0.1:6790/0]} removed_ranks: {} disallowed_leaders: {}, election epoch 10, leader 0 a, quorum 0,1 a,b 2023-11-16T14:02:02.808 INFO:tasks.workunit.client.0.smithi067.stdout:mon.b is available 2023-11-16T14:02:02.808 INFO:tasks.workunit.client.0.smithi067.stderr:+ echo 'mon.b is available' 2023-11-16T14:02:02.808 INFO:tasks.workunit.client.0.smithi067.stderr:+ true 2023-11-16T14:02:02.808 INFO:tasks.workunit.client.0.smithi067.stderr:+ sudo /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 00000000-0000-0000-0000-0000deadbeef --config tmp.test_cephadm.sh.Kh7Xjy/tmp.WISDFcPwVW --keyring tmp.test_cephadm.sh.Kh7Xjy/tmp.aRbRYvgvnb -- ceph auth get-or-create mgr.y mon 'allow profile mgr' osd 'allow *' mds 'allow *' 2023-11-16T14:02:05.825 INFO:tasks.workunit.client.0.smithi067.stderr:+ sudo /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy deploy --name mgr.y --fsid 00000000-0000-0000-0000-0000deadbeef --keyring tmp.test_cephadm.sh.Kh7Xjy/keyring.mgr.y --config tmp.test_cephadm.sh.Kh7Xjy/tmp.WISDFcPwVW 2023-11-16T14:02:06.130 INFO:tasks.workunit.client.0.smithi067.stderr:Non-zero exit code 125 from /bin/podman container inspect --format {{.State.Status}} ceph-00000000-0000-0000-0000-0000deadbeef-mgr-y 2023-11-16T14:02:06.131 INFO:tasks.workunit.client.0.smithi067.stderr:/bin/podman: stderr Error: error inspecting object: no such container ceph-00000000-0000-0000-0000-0000deadbeef-mgr-y 2023-11-16T14:02:06.185 INFO:tasks.workunit.client.0.smithi067.stderr:Non-zero exit code 125 from /bin/podman container inspect --format {{.State.Status}} ceph-00000000-0000-0000-0000-0000deadbeef-mgr.y 2023-11-16T14:02:06.185 INFO:tasks.workunit.client.0.smithi067.stderr:/bin/podman: stderr Error: error inspecting object: no such container ceph-00000000-0000-0000-0000-0000deadbeef-mgr.y 2023-11-16T14:02:06.185 INFO:tasks.workunit.client.0.smithi067.stderr:Deploy daemon mgr.y ... 2023-11-16T14:02:08.188 INFO:tasks.workunit.client.0.smithi067.stderr:+ for u in ceph-$FSID@mgr.y 2023-11-16T14:02:08.188 INFO:tasks.workunit.client.0.smithi067.stderr:+ systemctl is-enabled ceph-00000000-0000-0000-0000-0000deadbeef@mgr.y 2023-11-16T14:02:08.194 INFO:tasks.workunit.client.0.smithi067.stdout:enabled 2023-11-16T14:02:08.194 INFO:tasks.workunit.client.0.smithi067.stderr:+ systemctl is-active ceph-00000000-0000-0000-0000-0000deadbeef@mgr.y 2023-11-16T14:02:08.198 INFO:tasks.workunit.client.0.smithi067.stdout:active 2023-11-16T14:02:08.198 INFO:tasks.workunit.client.0.smithi067.stderr:++ seq 1 30 2023-11-16T14:02:08.241 INFO:tasks.workunit.client.0.smithi067.stderr:+ for f in `seq 1 30` 2023-11-16T14:02:08.241 INFO:tasks.workunit.client.0.smithi067.stderr:+ sudo /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 00000000-0000-0000-0000-0000deadbeef --config tmp.test_cephadm.sh.Kh7Xjy/tmp.WISDFcPwVW --keyring tmp.test_cephadm.sh.Kh7Xjy/tmp.aRbRYvgvnb -- ceph -s -f json-pretty 2023-11-16T14:02:08.241 INFO:tasks.workunit.client.0.smithi067.stderr:+ jq .mgrmap.num_standbys 2023-11-16T14:02:08.241 INFO:tasks.workunit.client.0.smithi067.stderr:+ grep -q 1 2023-11-16T14:02:11.516 INFO:tasks.workunit.client.0.smithi067.stderr:+ sleep 1 2023-11-16T14:02:12.518 INFO:tasks.workunit.client.0.smithi067.stderr:+ for f in `seq 1 30` 2023-11-16T14:02:12.518 INFO:tasks.workunit.client.0.smithi067.stderr:+ sudo /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 00000000-0000-0000-0000-0000deadbeef --config tmp.test_cephadm.sh.Kh7Xjy/tmp.WISDFcPwVW --keyring tmp.test_cephadm.sh.Kh7Xjy/tmp.aRbRYvgvnb -- ceph -s -f json-pretty 2023-11-16T14:02:12.518 INFO:tasks.workunit.client.0.smithi067.stderr:+ jq .mgrmap.num_standbys 2023-11-16T14:02:12.518 INFO:tasks.workunit.client.0.smithi067.stderr:+ grep -q 1 2023-11-16T14:02:15.599 INFO:tasks.workunit.client.0.smithi067.stderr:+ sleep 1 2023-11-16T14:02:16.599 INFO:tasks.workunit.client.0.smithi067.stderr:+ for f in `seq 1 30` 2023-11-16T14:02:16.599 INFO:tasks.workunit.client.0.smithi067.stderr:+ sudo /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 00000000-0000-0000-0000-0000deadbeef --config tmp.test_cephadm.sh.Kh7Xjy/tmp.WISDFcPwVW --keyring tmp.test_cephadm.sh.Kh7Xjy/tmp.aRbRYvgvnb -- ceph -s -f json-pretty 2023-11-16T14:02:16.599 INFO:tasks.workunit.client.0.smithi067.stderr:+ jq .mgrmap.num_standbys 2023-11-16T14:02:16.599 INFO:tasks.workunit.client.0.smithi067.stderr:+ grep -q 1 2023-11-16T14:02:19.751 INFO:tasks.workunit.client.0.smithi067.stderr:+ break 2023-11-16T14:02:19.751 INFO:tasks.workunit.client.0.smithi067.stderr:+ sudo /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 00000000-0000-0000-0000-0000deadbeef --config tmp.test_cephadm.sh.Kh7Xjy/tmp.WISDFcPwVW --keyring tmp.test_cephadm.sh.Kh7Xjy/tmp.aRbRYvgvnb -- ceph -s -f json-pretty 2023-11-16T14:02:19.751 INFO:tasks.workunit.client.0.smithi067.stderr:+ jq .mgrmap.num_standbys 2023-11-16T14:02:19.751 INFO:tasks.workunit.client.0.smithi067.stderr:+ grep -q 1 2023-11-16T14:02:22.796 INFO:tasks.workunit.client.0.smithi067.stderr:+ dd if=/dev/zero of=tmp.test_cephadm.sh.Kh7Xjy/test_cephadm_osd.img bs=1 count=0 seek=6G 2023-11-16T14:02:22.797 INFO:tasks.workunit.client.0.smithi067.stderr:0+0 records in 2023-11-16T14:02:22.797 INFO:tasks.workunit.client.0.smithi067.stderr:0+0 records out 2023-11-16T14:02:22.797 INFO:tasks.workunit.client.0.smithi067.stderr:0 bytes copied, 3.5635e-05 s, 0.0 kB/s 2023-11-16T14:02:22.798 INFO:tasks.workunit.client.0.smithi067.stderr:++ sudo losetup -f 2023-11-16T14:02:22.820 INFO:tasks.workunit.client.0.smithi067.stderr:+ loop_dev=/dev/loop0 2023-11-16T14:02:22.821 INFO:tasks.workunit.client.0.smithi067.stderr:+ sudo vgremove -f test_cephadm 2023-11-16T14:02:22.870 INFO:tasks.workunit.client.0.smithi067.stderr: Volume group "test_cephadm" not found 2023-11-16T14:02:22.870 INFO:tasks.workunit.client.0.smithi067.stderr: Cannot process volume group test_cephadm 2023-11-16T14:02:22.890 INFO:tasks.workunit.client.0.smithi067.stderr:+ true 2023-11-16T14:02:22.890 INFO:tasks.workunit.client.0.smithi067.stderr:+ sudo losetup /dev/loop0 tmp.test_cephadm.sh.Kh7Xjy/test_cephadm_osd.img 2023-11-16T14:02:22.914 INFO:tasks.workunit.client.0.smithi067.stderr:+ sudo pvcreate /dev/loop0 2023-11-16T14:02:22.981 INFO:tasks.workunit.client.0.smithi067.stdout: Physical volume "/dev/loop0" successfully created. 2023-11-16T14:02:23.011 INFO:tasks.workunit.client.0.smithi067.stderr:+ sudo vgcreate test_cephadm /dev/loop0 2023-11-16T14:02:23.137 INFO:tasks.workunit.client.0.smithi067.stdout: Volume group "test_cephadm" successfully created 2023-11-16T14:02:23.175 INFO:tasks.workunit.client.0.smithi067.stderr:+ sudo /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 00000000-0000-0000-0000-0000deadbeef --config tmp.test_cephadm.sh.Kh7Xjy/tmp.WISDFcPwVW --keyring tmp.test_cephadm.sh.Kh7Xjy/tmp.aRbRYvgvnb -- ceph auth get client.bootstrap-osd 2023-11-16T14:02:26.197 INFO:tasks.workunit.client.0.smithi067.stderr:++ seq 0 1 2023-11-16T14:02:26.198 INFO:tasks.workunit.client.0.smithi067.stderr:+ for id in `seq 0 $((--OSD_TO_CREATE))` 2023-11-16T14:02:26.198 INFO:tasks.workunit.client.0.smithi067.stderr:+ sudo lvcreate -l 50%VG -n test_cephadm.0 test_cephadm 2023-11-16T14:02:26.327 INFO:tasks.workunit.client.0.smithi067.stdout: Logical volume "test_cephadm.0" created. 2023-11-16T14:02:26.361 INFO:tasks.workunit.client.0.smithi067.stderr:+ for id in `seq 0 $((--OSD_TO_CREATE))` 2023-11-16T14:02:26.361 INFO:tasks.workunit.client.0.smithi067.stderr:+ sudo lvcreate -l 50%VG -n test_cephadm.1 test_cephadm 2023-11-16T14:02:26.449 INFO:tasks.workunit.client.0.smithi067.stdout: Logical volume "test_cephadm.1" created. 2023-11-16T14:02:26.488 INFO:tasks.workunit.client.0.smithi067.stderr:++ seq 0 1 2023-11-16T14:02:26.488 INFO:tasks.workunit.client.0.smithi067.stderr:+ for id in `seq 0 $((--OSD_TO_CREATE))` 2023-11-16T14:02:26.488 INFO:tasks.workunit.client.0.smithi067.stderr:+ device_name=/dev/test_cephadm/test_cephadm.0 2023-11-16T14:02:26.489 INFO:tasks.workunit.client.0.smithi067.stderr:+ CEPH_VOLUME='sudo /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume --fsid 00000000-0000-0000-0000-0000deadbeef --config tmp.test_cephadm.sh.Kh7Xjy/tmp.WISDFcPwVW --keyring tmp.test_cephadm.sh.Kh7Xjy/keyring.bootstrap.osd --' 2023-11-16T14:02:26.489 INFO:tasks.workunit.client.0.smithi067.stderr:+ sudo /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume --fsid 00000000-0000-0000-0000-0000deadbeef --config tmp.test_cephadm.sh.Kh7Xjy/tmp.WISDFcPwVW --keyring tmp.test_cephadm.sh.Kh7Xjy/keyring.bootstrap.osd -- lvm prepare --bluestore --data /dev/test_cephadm/test_cephadm.0 --no-systemd 2023-11-16T14:02:35.567 INFO:tasks.workunit.client.0.smithi067.stdout: 2023-11-16T14:02:35.596 INFO:tasks.workunit.client.0.smithi067.stderr:+ sudo /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume --fsid 00000000-0000-0000-0000-0000deadbeef --config tmp.test_cephadm.sh.Kh7Xjy/tmp.WISDFcPwVW --keyring tmp.test_cephadm.sh.Kh7Xjy/keyring.bootstrap.osd -- lvm batch --no-auto /dev/test_cephadm/test_cephadm.0 --yes --no-systemd 2023-11-16T14:02:38.623 INFO:tasks.workunit.client.0.smithi067.stdout: 2023-11-16T14:02:38.645 INFO:tasks.workunit.client.0.smithi067.stderr:+ sudo /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume --fsid 00000000-0000-0000-0000-0000deadbeef --config tmp.test_cephadm.sh.Kh7Xjy/tmp.WISDFcPwVW --keyring tmp.test_cephadm.sh.Kh7Xjy/keyring.bootstrap.osd -- lvm list --format json /dev/test_cephadm/test_cephadm.0 2023-11-16T14:02:41.882 INFO:tasks.workunit.client.0.smithi067.stderr:++ sudo cat tmp.test_cephadm.sh.Kh7Xjy/osd.map 2023-11-16T14:02:41.882 INFO:tasks.workunit.client.0.smithi067.stderr:++ jq -cr '.. | ."ceph.osd_id"? | select(.)' 2023-11-16T14:02:41.896 INFO:tasks.workunit.client.0.smithi067.stderr:+ osd_id=0 2023-11-16T14:02:41.897 INFO:tasks.workunit.client.0.smithi067.stderr:++ sudo cat tmp.test_cephadm.sh.Kh7Xjy/osd.map 2023-11-16T14:02:41.897 INFO:tasks.workunit.client.0.smithi067.stderr:++ jq -cr '.. | ."ceph.osd_fsid"? | select(.)' 2023-11-16T14:02:41.908 INFO:tasks.workunit.client.0.smithi067.stderr:+ osd_fsid=1fce8843-9abb-4eee-8a6e-f51e57ac8710 2023-11-16T14:02:41.908 INFO:tasks.workunit.client.0.smithi067.stderr:+ sudo /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy deploy --name osd.0 --fsid 00000000-0000-0000-0000-0000deadbeef --keyring tmp.test_cephadm.sh.Kh7Xjy/keyring.bootstrap.osd --config tmp.test_cephadm.sh.Kh7Xjy/tmp.WISDFcPwVW --osd-fsid 1fce8843-9abb-4eee-8a6e-f51e57ac8710 2023-11-16T14:02:42.217 INFO:tasks.workunit.client.0.smithi067.stderr:Non-zero exit code 125 from /bin/podman container inspect --format {{.State.Status}} ceph-00000000-0000-0000-0000-0000deadbeef-osd-0 2023-11-16T14:02:42.218 INFO:tasks.workunit.client.0.smithi067.stderr:/bin/podman: stderr Error: error inspecting object: no such container ceph-00000000-0000-0000-0000-0000deadbeef-osd-0 2023-11-16T14:02:42.272 INFO:tasks.workunit.client.0.smithi067.stderr:Non-zero exit code 125 from /bin/podman container inspect --format {{.State.Status}} ceph-00000000-0000-0000-0000-0000deadbeef-osd.0 2023-11-16T14:02:42.272 INFO:tasks.workunit.client.0.smithi067.stderr:/bin/podman: stderr Error: error inspecting object: no such container ceph-00000000-0000-0000-0000-0000deadbeef-osd.0 2023-11-16T14:02:42.272 INFO:tasks.workunit.client.0.smithi067.stderr:Deploy daemon osd.0 ... 2023-11-16T14:02:47.861 INFO:tasks.workunit.client.0.smithi067.stderr:+ for id in `seq 0 $((--OSD_TO_CREATE))` 2023-11-16T14:02:48.988 INFO:tasks.workunit.client.0.smithi067.stderr:+ device_name=/dev/test_cephadm/test_cephadm.1 2023-11-16T14:02:48.988 INFO:tasks.workunit.client.0.smithi067.stderr:+ CEPH_VOLUME='sudo /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume --fsid 00000000-0000-0000-0000-0000deadbeef --config tmp.test_cephadm.sh.Kh7Xjy/tmp.WISDFcPwVW --keyring tmp.test_cephadm.sh.Kh7Xjy/keyring.bootstrap.osd --' 2023-11-16T14:02:48.989 INFO:tasks.workunit.client.0.smithi067.stderr:+ sudo /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume --fsid 00000000-0000-0000-0000-0000deadbeef --config tmp.test_cephadm.sh.Kh7Xjy/tmp.WISDFcPwVW --keyring tmp.test_cephadm.sh.Kh7Xjy/keyring.bootstrap.osd -- lvm prepare --bluestore --data /dev/test_cephadm/test_cephadm.1 --no-systemd 2023-11-16T14:03:01.223 INFO:tasks.workunit.client.0.smithi067.stdout: 2023-11-16T14:03:01.249 INFO:tasks.workunit.client.0.smithi067.stderr:+ sudo /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume --fsid 00000000-0000-0000-0000-0000deadbeef --config tmp.test_cephadm.sh.Kh7Xjy/tmp.WISDFcPwVW --keyring tmp.test_cephadm.sh.Kh7Xjy/keyring.bootstrap.osd -- lvm batch --no-auto /dev/test_cephadm/test_cephadm.1 --yes --no-systemd 2023-11-16T14:03:07.654 INFO:tasks.workunit.client.0.smithi067.stdout: 2023-11-16T14:03:07.680 INFO:tasks.workunit.client.0.smithi067.stderr:+ sudo /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume --fsid 00000000-0000-0000-0000-0000deadbeef --config tmp.test_cephadm.sh.Kh7Xjy/tmp.WISDFcPwVW --keyring tmp.test_cephadm.sh.Kh7Xjy/keyring.bootstrap.osd -- lvm list --format json /dev/test_cephadm/test_cephadm.1 2023-11-16T14:03:17.212 INFO:tasks.workunit.client.0.smithi067.stderr:++ sudo cat tmp.test_cephadm.sh.Kh7Xjy/osd.map 2023-11-16T14:03:17.212 INFO:tasks.workunit.client.0.smithi067.stderr:++ jq -cr '.. | ."ceph.osd_id"? | select(.)' 2023-11-16T14:03:17.228 INFO:tasks.workunit.client.0.smithi067.stderr:+ osd_id=1 2023-11-16T14:03:17.228 INFO:tasks.workunit.client.0.smithi067.stderr:++ sudo cat tmp.test_cephadm.sh.Kh7Xjy/osd.map 2023-11-16T14:03:17.228 INFO:tasks.workunit.client.0.smithi067.stderr:++ jq -cr '.. | ."ceph.osd_fsid"? | select(.)' 2023-11-16T14:03:17.240 INFO:tasks.workunit.client.0.smithi067.stderr:+ osd_fsid=8a33076f-9da9-496e-b41c-0372fa7e3b57 2023-11-16T14:03:17.240 INFO:tasks.workunit.client.0.smithi067.stderr:+ sudo /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy deploy --name osd.1 --fsid 00000000-0000-0000-0000-0000deadbeef --keyring tmp.test_cephadm.sh.Kh7Xjy/keyring.bootstrap.osd --config tmp.test_cephadm.sh.Kh7Xjy/tmp.WISDFcPwVW --osd-fsid 8a33076f-9da9-496e-b41c-0372fa7e3b57 2023-11-16T14:03:17.545 INFO:tasks.workunit.client.0.smithi067.stderr:Non-zero exit code 125 from /bin/podman container inspect --format {{.State.Status}} ceph-00000000-0000-0000-0000-0000deadbeef-osd-1 2023-11-16T14:03:17.545 INFO:tasks.workunit.client.0.smithi067.stderr:/bin/podman: stderr Error: error inspecting object: no such container ceph-00000000-0000-0000-0000-0000deadbeef-osd-1 2023-11-16T14:03:17.601 INFO:tasks.workunit.client.0.smithi067.stderr:Non-zero exit code 125 from /bin/podman container inspect --format {{.State.Status}} ceph-00000000-0000-0000-0000-0000deadbeef-osd.1 2023-11-16T14:03:17.601 INFO:tasks.workunit.client.0.smithi067.stderr:/bin/podman: stderr Error: error inspecting object: no such container ceph-00000000-0000-0000-0000-0000deadbeef-osd.1 2023-11-16T14:03:17.601 INFO:tasks.workunit.client.0.smithi067.stderr:Deploy daemon osd.1 ... 2023-11-16T14:03:25.517 INFO:tasks.workunit.client.0.smithi067.stderr:+ sudo /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm deploy --name node-exporter.a --fsid 00000000-0000-0000-0000-0000deadbeef 2023-11-16T14:03:25.832 INFO:tasks.workunit.client.0.smithi067.stderr:Non-zero exit code 125 from /bin/podman container inspect --format {{.State.Status}} ceph-00000000-0000-0000-0000-0000deadbeef-node-exporter-a 2023-11-16T14:03:25.832 INFO:tasks.workunit.client.0.smithi067.stderr:/bin/podman: stderr Error: error inspecting object: no such container ceph-00000000-0000-0000-0000-0000deadbeef-node-exporter-a 2023-11-16T14:03:25.886 INFO:tasks.workunit.client.0.smithi067.stderr:Non-zero exit code 125 from /bin/podman container inspect --format {{.State.Status}} ceph-00000000-0000-0000-0000-0000deadbeef-node-exporter.a 2023-11-16T14:03:25.886 INFO:tasks.workunit.client.0.smithi067.stderr:/bin/podman: stderr Error: error inspecting object: no such container ceph-00000000-0000-0000-0000-0000deadbeef-node-exporter.a 2023-11-16T14:03:25.886 INFO:tasks.workunit.client.0.smithi067.stderr:Deploy daemon node-exporter.a ... 2023-11-16T14:03:29.652 INFO:tasks.workunit.client.0.smithi067.stderr:+ cond='curl '\''http://localhost:9100'\'' | grep -q '\''Node Exporter'\''' 2023-11-16T14:03:29.652 INFO:tasks.workunit.client.0.smithi067.stderr:+ is_available node-exporter 'curl '\''http://localhost:9100'\'' | grep -q '\''Node Exporter'\''' 10 2023-11-16T14:03:29.653 INFO:tasks.workunit.client.0.smithi067.stderr:+ local name=node-exporter 2023-11-16T14:03:29.653 INFO:tasks.workunit.client.0.smithi067.stderr:+ local 'condition=curl '\''http://localhost:9100'\'' | grep -q '\''Node Exporter'\''' 2023-11-16T14:03:29.653 INFO:tasks.workunit.client.0.smithi067.stderr:+ local tries=10 2023-11-16T14:03:29.653 INFO:tasks.workunit.client.0.smithi067.stderr:+ local num=0 2023-11-16T14:03:29.653 INFO:tasks.workunit.client.0.smithi067.stderr:+ eval 'curl '\''http://localhost:9100'\'' | grep -q '\''Node Exporter'\''' 2023-11-16T14:03:29.653 INFO:tasks.workunit.client.0.smithi067.stderr:++ curl http://localhost:9100 2023-11-16T14:03:29.653 INFO:tasks.workunit.client.0.smithi067.stderr:++ grep -q 'Node Exporter' 2023-11-16T14:03:29.661 INFO:tasks.workunit.client.0.smithi067.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2023-11-16T14:03:29.661 INFO:tasks.workunit.client.0.smithi067.stderr: Dload Upload Total Spent Left Speed 2023-11-16T14:03:29.661 INFO:tasks.workunit.client.0.smithi067.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 150 100 150 0 0 146k 0 --:--:-- --:--:-- --:--:-- 146k 2023-11-16T14:03:29.661 INFO:tasks.workunit.client.0.smithi067.stdout:node-exporter is available 2023-11-16T14:03:29.662 INFO:tasks.workunit.client.0.smithi067.stderr:+ echo 'node-exporter is available' 2023-11-16T14:03:29.662 INFO:tasks.workunit.client.0.smithi067.stderr:+ true 2023-11-16T14:03:29.662 INFO:tasks.workunit.client.0.smithi067.stderr:+ cat /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/samples/prometheus.json 2023-11-16T14:03:29.662 INFO:tasks.workunit.client.0.smithi067.stderr:+ sudo /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm deploy --name prometheus.a --fsid 00000000-0000-0000-0000-0000deadbeef --config-json - 2023-11-16T14:03:29.971 INFO:tasks.workunit.client.0.smithi067.stderr:Non-zero exit code 125 from /bin/podman container inspect --format {{.State.Status}} ceph-00000000-0000-0000-0000-0000deadbeef-prometheus-a 2023-11-16T14:03:29.972 INFO:tasks.workunit.client.0.smithi067.stderr:/bin/podman: stderr Error: error inspecting object: no such container ceph-00000000-0000-0000-0000-0000deadbeef-prometheus-a 2023-11-16T14:03:30.029 INFO:tasks.workunit.client.0.smithi067.stderr:Non-zero exit code 125 from /bin/podman container inspect --format {{.State.Status}} ceph-00000000-0000-0000-0000-0000deadbeef-prometheus.a 2023-11-16T14:03:30.029 INFO:tasks.workunit.client.0.smithi067.stderr:/bin/podman: stderr Error: error inspecting object: no such container ceph-00000000-0000-0000-0000-0000deadbeef-prometheus.a 2023-11-16T14:03:30.029 INFO:tasks.workunit.client.0.smithi067.stderr:Deploy daemon prometheus.a ... 2023-11-16T14:03:52.294 INFO:tasks.workunit.client.0.smithi067.stderr:+ cond='curl '\''localhost:9095/api/v1/query?query=up'\''' 2023-11-16T14:03:52.294 INFO:tasks.workunit.client.0.smithi067.stderr:+ is_available prometheus 'curl '\''localhost:9095/api/v1/query?query=up'\''' 10 2023-11-16T14:03:52.294 INFO:tasks.workunit.client.0.smithi067.stderr:+ local name=prometheus 2023-11-16T14:03:52.295 INFO:tasks.workunit.client.0.smithi067.stderr:+ local 'condition=curl '\''localhost:9095/api/v1/query?query=up'\''' 2023-11-16T14:03:52.295 INFO:tasks.workunit.client.0.smithi067.stderr:+ local tries=10 2023-11-16T14:03:52.295 INFO:tasks.workunit.client.0.smithi067.stderr:+ local num=0 2023-11-16T14:03:52.295 INFO:tasks.workunit.client.0.smithi067.stderr:+ eval 'curl '\''localhost:9095/api/v1/query?query=up'\''' 2023-11-16T14:03:52.295 INFO:tasks.workunit.client.0.smithi067.stderr:++ curl 'localhost:9095/api/v1/query?query=up' 2023-11-16T14:03:52.299 INFO:tasks.workunit.client.0.smithi067.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2023-11-16T14:03:52.299 INFO:tasks.workunit.client.0.smithi067.stderr: Dload Upload Total Spent Left Speed 2023-11-16T14:03:52.300 INFO:tasks.workunit.client.0.smithi067.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 63 100 63 0 0 63000 0 --:--:-- --:--:-- --:--:-- 63000 2023-11-16T14:03:52.301 INFO:tasks.workunit.client.0.smithi067.stderr:+ echo 'prometheus is available' 2023-11-16T14:03:52.301 INFO:tasks.workunit.client.0.smithi067.stdout:{"status":"success","data":{"resultType":"vector","result":[]}}prometheus is available 2023-11-16T14:03:52.301 INFO:tasks.workunit.client.0.smithi067.stderr:+ true 2023-11-16T14:03:52.302 INFO:tasks.workunit.client.0.smithi067.stderr:+ cat /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/samples/grafana.json 2023-11-16T14:03:52.302 INFO:tasks.workunit.client.0.smithi067.stderr:+ sudo /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm deploy --name grafana.a --fsid 00000000-0000-0000-0000-0000deadbeef --config-json - 2023-11-16T14:03:52.630 INFO:tasks.workunit.client.0.smithi067.stderr:Non-zero exit code 125 from /bin/podman container inspect --format {{.State.Status}} ceph-00000000-0000-0000-0000-0000deadbeef-grafana-a 2023-11-16T14:03:52.630 INFO:tasks.workunit.client.0.smithi067.stderr:/bin/podman: stderr Error: error inspecting object: no such container ceph-00000000-0000-0000-0000-0000deadbeef-grafana-a 2023-11-16T14:03:52.686 INFO:tasks.workunit.client.0.smithi067.stderr:Non-zero exit code 125 from /bin/podman container inspect --format {{.State.Status}} ceph-00000000-0000-0000-0000-0000deadbeef-grafana.a 2023-11-16T14:03:52.686 INFO:tasks.workunit.client.0.smithi067.stderr:/bin/podman: stderr Error: error inspecting object: no such container ceph-00000000-0000-0000-0000-0000deadbeef-grafana.a 2023-11-16T14:03:52.686 INFO:tasks.workunit.client.0.smithi067.stderr:Deploy daemon grafana.a ... 2023-11-16T14:04:13.865 INFO:tasks.workunit.client.0.smithi067.stderr:+ cond='curl --insecure '\''https://localhost:3000'\'' | grep -q '\''grafana'\''' 2023-11-16T14:04:13.866 INFO:tasks.workunit.client.0.smithi067.stderr:+ is_available grafana 'curl --insecure '\''https://localhost:3000'\'' | grep -q '\''grafana'\''' 50 2023-11-16T14:04:13.866 INFO:tasks.workunit.client.0.smithi067.stderr:+ local name=grafana 2023-11-16T14:04:13.866 INFO:tasks.workunit.client.0.smithi067.stderr:+ local 'condition=curl --insecure '\''https://localhost:3000'\'' | grep -q '\''grafana'\''' 2023-11-16T14:04:13.866 INFO:tasks.workunit.client.0.smithi067.stderr:+ local tries=50 2023-11-16T14:04:13.867 INFO:tasks.workunit.client.0.smithi067.stderr:+ local num=0 2023-11-16T14:04:13.867 INFO:tasks.workunit.client.0.smithi067.stderr:+ eval 'curl --insecure '\''https://localhost:3000'\'' | grep -q '\''grafana'\''' 2023-11-16T14:04:13.867 INFO:tasks.workunit.client.0.smithi067.stderr:++ curl --insecure https://localhost:3000 2023-11-16T14:04:13.867 INFO:tasks.workunit.client.0.smithi067.stderr:++ grep -q grafana 2023-11-16T14:04:13.874 INFO:tasks.workunit.client.0.smithi067.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2023-11-16T14:04:13.874 INFO:tasks.workunit.client.0.smithi067.stderr: Dload Upload Total Spent Left Speed 2023-11-16T14:04:13.875 INFO:tasks.workunit.client.0.smithi067.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed to connect to localhost port 3000: Connection refused 2023-11-16T14:04:13.875 INFO:tasks.workunit.client.0.smithi067.stderr:+ num=1 2023-11-16T14:04:13.875 INFO:tasks.workunit.client.0.smithi067.stderr:+ '[' 1 -ge 50 ']' 2023-11-16T14:04:13.875 INFO:tasks.workunit.client.0.smithi067.stderr:+ sleep 5 2023-11-16T14:04:18.874 INFO:tasks.workunit.client.0.smithi067.stderr:+ eval 'curl --insecure '\''https://localhost:3000'\'' | grep -q '\''grafana'\''' 2023-11-16T14:04:18.875 INFO:tasks.workunit.client.0.smithi067.stderr:++ curl --insecure https://localhost:3000 2023-11-16T14:04:18.875 INFO:tasks.workunit.client.0.smithi067.stderr:++ grep -q grafana 2023-11-16T14:04:18.880 INFO:tasks.workunit.client.0.smithi067.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2023-11-16T14:04:18.880 INFO:tasks.workunit.client.0.smithi067.stderr: Dload Upload Total Spent Left Speed 2023-11-16T14:04:18.880 INFO:tasks.workunit.client.0.smithi067.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed to connect to localhost port 3000: Connection refused 2023-11-16T14:04:18.881 INFO:tasks.workunit.client.0.smithi067.stderr:+ num=2 2023-11-16T14:04:18.881 INFO:tasks.workunit.client.0.smithi067.stderr:+ '[' 2 -ge 50 ']' 2023-11-16T14:04:18.881 INFO:tasks.workunit.client.0.smithi067.stderr:+ sleep 5 2023-11-16T14:04:23.883 INFO:tasks.workunit.client.0.smithi067.stderr:+ eval 'curl --insecure '\''https://localhost:3000'\'' | grep -q '\''grafana'\''' 2023-11-16T14:04:23.883 INFO:tasks.workunit.client.0.smithi067.stderr:++ curl --insecure https://localhost:3000 2023-11-16T14:04:23.883 INFO:tasks.workunit.client.0.smithi067.stderr:++ grep -q grafana 2023-11-16T14:04:23.891 INFO:tasks.workunit.client.0.smithi067.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2023-11-16T14:04:23.891 INFO:tasks.workunit.client.0.smithi067.stderr: Dload Upload Total Spent Left Speed 2023-11-16T14:04:23.891 INFO:tasks.workunit.client.0.smithi067.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed to connect to localhost port 3000: Connection refused 2023-11-16T14:04:23.891 INFO:tasks.workunit.client.0.smithi067.stderr:+ num=3 2023-11-16T14:04:23.891 INFO:tasks.workunit.client.0.smithi067.stderr:+ '[' 3 -ge 50 ']' 2023-11-16T14:04:23.891 INFO:tasks.workunit.client.0.smithi067.stderr:+ sleep 5 2023-11-16T14:04:28.891 INFO:tasks.workunit.client.0.smithi067.stderr:+ eval 'curl --insecure '\''https://localhost:3000'\'' | grep -q '\''grafana'\''' 2023-11-16T14:04:28.891 INFO:tasks.workunit.client.0.smithi067.stderr:++ curl --insecure https://localhost:3000 2023-11-16T14:04:28.891 INFO:tasks.workunit.client.0.smithi067.stderr:++ grep -q grafana 2023-11-16T14:04:28.896 INFO:tasks.workunit.client.0.smithi067.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2023-11-16T14:04:28.897 INFO:tasks.workunit.client.0.smithi067.stderr: Dload Upload Total Spent Left Speed 2023-11-16T14:04:28.897 INFO:tasks.workunit.client.0.smithi067.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed to connect to localhost port 3000: Connection refused 2023-11-16T14:04:28.897 INFO:tasks.workunit.client.0.smithi067.stderr:+ num=4 2023-11-16T14:04:28.897 INFO:tasks.workunit.client.0.smithi067.stderr:+ '[' 4 -ge 50 ']' 2023-11-16T14:04:28.897 INFO:tasks.workunit.client.0.smithi067.stderr:+ sleep 5 2023-11-16T14:04:33.898 INFO:tasks.workunit.client.0.smithi067.stderr:+ eval 'curl --insecure '\''https://localhost:3000'\'' | grep -q '\''grafana'\''' 2023-11-16T14:04:33.898 INFO:tasks.workunit.client.0.smithi067.stderr:++ curl --insecure https://localhost:3000 2023-11-16T14:04:33.898 INFO:tasks.workunit.client.0.smithi067.stderr:++ grep -q grafana 2023-11-16T14:04:33.904 INFO:tasks.workunit.client.0.smithi067.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2023-11-16T14:04:33.904 INFO:tasks.workunit.client.0.smithi067.stderr: Dload Upload Total Spent Left Speed 2023-11-16T14:04:34.067 INFO:tasks.workunit.client.0.smithi067.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 35232 0 35232 0 0 211k 0 --:--:-- --:--:-- --:--:-- 211k 2023-11-16T14:04:34.067 INFO:tasks.workunit.client.0.smithi067.stderr:curl: (23) Failed writing body (1632 != 2048) 2023-11-16T14:04:34.068 INFO:tasks.workunit.client.0.smithi067.stdout:grafana is available 2023-11-16T14:04:34.069 INFO:tasks.workunit.client.0.smithi067.stderr:+ echo 'grafana is available' 2023-11-16T14:04:34.069 INFO:tasks.workunit.client.0.smithi067.stderr:+ true 2023-11-16T14:04:34.069 INFO:tasks.workunit.client.0.smithi067.stderr:+ nfs_stop 2023-11-16T14:04:34.069 INFO:tasks.workunit.client.0.smithi067.stderr:+ local 'units=nfs-server nfs-kernel-server' 2023-11-16T14:04:34.069 INFO:tasks.workunit.client.0.smithi067.stderr:+ for unit in $units 2023-11-16T14:04:34.069 INFO:tasks.workunit.client.0.smithi067.stderr:+ systemctl status nfs-server 2023-11-16T14:04:34.079 INFO:tasks.workunit.client.0.smithi067.stdout:● nfs-server.service - NFS server and services 2023-11-16T14:04:34.080 INFO:tasks.workunit.client.0.smithi067.stdout: Loaded: loaded (/usr/lib/systemd/system/nfs-server.service; disabled; vendor preset: disabled) 2023-11-16T14:04:34.080 INFO:tasks.workunit.client.0.smithi067.stdout: Active: inactive (dead) 2023-11-16T14:04:34.080 INFO:tasks.workunit.client.0.smithi067.stderr:+ for unit in $units 2023-11-16T14:04:34.080 INFO:tasks.workunit.client.0.smithi067.stderr:+ systemctl status nfs-kernel-server 2023-11-16T14:04:34.086 INFO:tasks.workunit.client.0.smithi067.stderr:Unit nfs-kernel-server.service could not be found. 2023-11-16T14:04:34.087 INFO:tasks.workunit.client.0.smithi067.stderr:+ expect_false 'sudo ss -tlnp '\''( sport = :nfs )'\'' | grep LISTEN' 2023-11-16T14:04:34.087 INFO:tasks.workunit.client.0.smithi067.stderr:+ set -x 2023-11-16T14:04:34.087 INFO:tasks.workunit.client.0.smithi067.stderr:+ eval 'sudo ss -tlnp '\''( sport = :nfs )'\'' | grep LISTEN' 2023-11-16T14:04:34.087 INFO:tasks.workunit.client.0.smithi067.stderr:++ sudo ss -tlnp '( sport = :nfs )' 2023-11-16T14:04:34.087 INFO:tasks.workunit.client.0.smithi067.stderr:++ grep LISTEN 2023-11-16T14:04:34.165 INFO:tasks.workunit.client.0.smithi067.stderr:+ return 0 2023-11-16T14:04:34.166 INFO:tasks.workunit.client.0.smithi067.stderr:++ cat /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/samples/nfs.json 2023-11-16T14:04:34.166 INFO:tasks.workunit.client.0.smithi067.stderr:++ jq -r '.["pool"]' 2023-11-16T14:04:34.168 INFO:tasks.workunit.client.0.smithi067.stderr:+ nfs_rados_pool=nfs-ganesha 2023-11-16T14:04:34.168 INFO:tasks.workunit.client.0.smithi067.stderr:+ sudo /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 00000000-0000-0000-0000-0000deadbeef --config tmp.test_cephadm.sh.Kh7Xjy/tmp.WISDFcPwVW --keyring tmp.test_cephadm.sh.Kh7Xjy/tmp.aRbRYvgvnb -- ceph osd pool create nfs-ganesha 64 2023-11-16T14:04:37.059 INFO:tasks.workunit.client.0.smithi067.stderr:pool 'nfs-ganesha' created 2023-11-16T14:04:38.027 INFO:tasks.workunit.client.0.smithi067.stderr:+ sudo /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 00000000-0000-0000-0000-0000deadbeef --config tmp.test_cephadm.sh.Kh7Xjy/tmp.WISDFcPwVW --keyring tmp.test_cephadm.sh.Kh7Xjy/tmp.aRbRYvgvnb -- rados --pool nfs-ganesha --namespace nfs-ns create conf-nfs.a 2023-11-16T14:04:41.083 INFO:tasks.workunit.client.0.smithi067.stderr:+ sudo /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 00000000-0000-0000-0000-0000deadbeef --config tmp.test_cephadm.sh.Kh7Xjy/tmp.WISDFcPwVW --keyring tmp.test_cephadm.sh.Kh7Xjy/tmp.aRbRYvgvnb -- ceph orch pause 2023-11-16T14:04:44.058 INFO:tasks.workunit.client.0.smithi067.stderr:+ sudo /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy deploy --name nfs.a --fsid 00000000-0000-0000-0000-0000deadbeef --keyring tmp.test_cephadm.sh.Kh7Xjy/tmp.aRbRYvgvnb --config tmp.test_cephadm.sh.Kh7Xjy/tmp.WISDFcPwVW --config-json /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/samples/nfs.json 2023-11-16T14:04:44.369 INFO:tasks.workunit.client.0.smithi067.stderr:Non-zero exit code 125 from /bin/podman container inspect --format {{.State.Status}} ceph-00000000-0000-0000-0000-0000deadbeef-nfs-a 2023-11-16T14:04:44.369 INFO:tasks.workunit.client.0.smithi067.stderr:/bin/podman: stderr Error: error inspecting object: no such container ceph-00000000-0000-0000-0000-0000deadbeef-nfs-a 2023-11-16T14:04:44.425 INFO:tasks.workunit.client.0.smithi067.stderr:Non-zero exit code 125 from /bin/podman container inspect --format {{.State.Status}} ceph-00000000-0000-0000-0000-0000deadbeef-nfs.a 2023-11-16T14:04:44.425 INFO:tasks.workunit.client.0.smithi067.stderr:/bin/podman: stderr Error: error inspecting object: no such container ceph-00000000-0000-0000-0000-0000deadbeef-nfs.a 2023-11-16T14:04:44.425 INFO:tasks.workunit.client.0.smithi067.stderr:Deploy daemon nfs.a ... 2023-11-16T14:04:45.586 INFO:tasks.workunit.client.0.smithi067.stderr:Verifying port 2049 ... 2023-11-16T14:04:45.587 INFO:tasks.workunit.client.0.smithi067.stderr:Creating ganesha config... 2023-11-16T14:04:45.587 INFO:tasks.workunit.client.0.smithi067.stderr:Write file: /var/lib/ceph/00000000-0000-0000-0000-0000deadbeef/nfs.a/etc/ganesha/ganesha.conf 2023-11-16T14:04:46.657 INFO:tasks.workunit.client.0.smithi067.stderr:+ cond='sudo ss -tlnp '\''( sport = :nfs )'\'' | grep '\''ganesha.nfsd'\''' 2023-11-16T14:04:46.658 INFO:tasks.workunit.client.0.smithi067.stderr:+ is_available nfs 'sudo ss -tlnp '\''( sport = :nfs )'\'' | grep '\''ganesha.nfsd'\''' 10 2023-11-16T14:04:46.658 INFO:tasks.workunit.client.0.smithi067.stderr:+ local name=nfs 2023-11-16T14:04:46.658 INFO:tasks.workunit.client.0.smithi067.stderr:+ local 'condition=sudo ss -tlnp '\''( sport = :nfs )'\'' | grep '\''ganesha.nfsd'\''' 2023-11-16T14:04:46.658 INFO:tasks.workunit.client.0.smithi067.stderr:+ local tries=10 2023-11-16T14:04:46.658 INFO:tasks.workunit.client.0.smithi067.stderr:+ local num=0 2023-11-16T14:04:46.658 INFO:tasks.workunit.client.0.smithi067.stderr:+ eval 'sudo ss -tlnp '\''( sport = :nfs )'\'' | grep '\''ganesha.nfsd'\''' 2023-11-16T14:04:46.658 INFO:tasks.workunit.client.0.smithi067.stderr:++ sudo ss -tlnp '( sport = :nfs )' 2023-11-16T14:04:46.658 INFO:tasks.workunit.client.0.smithi067.stderr:++ grep ganesha.nfsd 2023-11-16T14:04:46.696 INFO:tasks.workunit.client.0.smithi067.stdout:LISTEN 0 128 *:2049 *:* users:(("ganesha.nfsd",pid=121486,fd=23)) 2023-11-16T14:04:46.696 INFO:tasks.workunit.client.0.smithi067.stderr:+ echo 'nfs is available' 2023-11-16T14:04:46.696 INFO:tasks.workunit.client.0.smithi067.stdout:nfs is available 2023-11-16T14:04:46.697 INFO:tasks.workunit.client.0.smithi067.stderr:+ true 2023-11-16T14:04:46.697 INFO:tasks.workunit.client.0.smithi067.stderr:+ sudo /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 00000000-0000-0000-0000-0000deadbeef --config tmp.test_cephadm.sh.Kh7Xjy/tmp.WISDFcPwVW --keyring tmp.test_cephadm.sh.Kh7Xjy/tmp.aRbRYvgvnb -- ceph orch resume 2023-11-16T14:04:49.421 INFO:tasks.workunit.client.0.smithi067.stderr:++ cat /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/samples/custom_container.json 2023-11-16T14:04:49.422 INFO:tasks.workunit.client.0.smithi067.stderr:++ jq -r .image 2023-11-16T14:04:49.423 INFO:tasks.workunit.client.0.smithi067.stderr:+ alertmanager_image=docker.io/prom/alertmanager:v0.20.0 2023-11-16T14:04:49.424 INFO:tasks.workunit.client.0.smithi067.stderr:++ cat /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/samples/custom_container.json 2023-11-16T14:04:49.424 INFO:tasks.workunit.client.0.smithi067.stderr:++ jq -r '.ports | map_values(.|tostring) | join(" ")' 2023-11-16T14:04:49.427 INFO:tasks.workunit.client.0.smithi067.stderr:+ tcp_ports='9093 9094' 2023-11-16T14:04:49.427 INFO:tasks.workunit.client.0.smithi067.stderr:+ cat /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/samples/custom_container.json 2023-11-16T14:04:49.427 INFO:tasks.workunit.client.0.smithi067.stderr:+ sudo /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm --image docker.io/prom/alertmanager:v0.20.0 deploy --tcp-ports '9093 9094' --name container.alertmanager.a --fsid 00000000-0000-0000-0000-0000deadbeef --config-json - 2023-11-16T14:04:49.736 INFO:tasks.workunit.client.0.smithi067.stderr:Non-zero exit code 125 from /bin/podman container inspect --format {{.State.Status}} ceph-00000000-0000-0000-0000-0000deadbeef-container-alertmanager-a 2023-11-16T14:04:49.736 INFO:tasks.workunit.client.0.smithi067.stderr:/bin/podman: stderr Error: error inspecting object: no such container ceph-00000000-0000-0000-0000-0000deadbeef-container-alertmanager-a 2023-11-16T14:04:49.791 INFO:tasks.workunit.client.0.smithi067.stderr:Non-zero exit code 125 from /bin/podman container inspect --format {{.State.Status}} ceph-00000000-0000-0000-0000-0000deadbeef-container.alertmanager.a 2023-11-16T14:04:49.791 INFO:tasks.workunit.client.0.smithi067.stderr:/bin/podman: stderr Error: error inspecting object: no such container ceph-00000000-0000-0000-0000-0000deadbeef-container.alertmanager.a 2023-11-16T14:04:49.791 INFO:tasks.workunit.client.0.smithi067.stderr:Deploy daemon container.alertmanager.a ... 2023-11-16T14:04:49.791 INFO:tasks.workunit.client.0.smithi067.stderr:Verifying port 9093 ... 2023-11-16T14:04:49.793 INFO:tasks.workunit.client.0.smithi067.stderr:Verifying port 9094 ... 2023-11-16T14:04:49.793 INFO:tasks.workunit.client.0.smithi067.stderr:Verifying port 9093 ... 2023-11-16T14:04:49.793 INFO:tasks.workunit.client.0.smithi067.stderr:Verifying port 9094 ... 2023-11-16T14:04:49.793 INFO:tasks.workunit.client.0.smithi067.stderr:Creating custom container configuration dirs/files in /var/lib/ceph/00000000-0000-0000-0000-0000deadbeef/container.alertmanager.a ... 2023-11-16T14:04:49.793 INFO:tasks.workunit.client.0.smithi067.stderr:Creating directory: etc/alertmanager 2023-11-16T14:04:49.794 INFO:tasks.workunit.client.0.smithi067.stderr:Creating file: etc/alertmanager/alertmanager.yml 2023-11-16T14:07:23.140 INFO:tasks.workunit.client.0.smithi067.stderr:Non-zero exit code 1 from systemctl start ceph-00000000-0000-0000-0000-0000deadbeef@container.alertmanager.a 2023-11-16T14:07:23.141 INFO:tasks.workunit.client.0.smithi067.stderr:systemctl: stderr Job for ceph-00000000-0000-0000-0000-0000deadbeef@container.alertmanager.a.service failed because the control process exited with error code. 2023-11-16T14:07:23.141 INFO:tasks.workunit.client.0.smithi067.stderr:systemctl: stderr See "systemctl status ceph-00000000-0000-0000-0000-0000deadbeef@container.alertmanager.a.service" and "journalctl -xe" for details. 2023-11-16T14:07:23.146 INFO:tasks.workunit.client.0.smithi067.stderr:Traceback (most recent call last): 2023-11-16T14:07:23.146 INFO:tasks.workunit.client.0.smithi067.stderr: File "/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm", line 9687, in 2023-11-16T14:07:23.147 INFO:tasks.workunit.client.0.smithi067.stderr: main() 2023-11-16T14:07:23.147 INFO:tasks.workunit.client.0.smithi067.stderr: File "/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm", line 9675, in main 2023-11-16T14:07:23.147 INFO:tasks.workunit.client.0.smithi067.stderr: r = ctx.func(ctx) 2023-11-16T14:07:23.147 INFO:tasks.workunit.client.0.smithi067.stderr: File "/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm", line 2168, in _default_image 2023-11-16T14:07:23.147 INFO:tasks.workunit.client.0.smithi067.stderr: return func(ctx) 2023-11-16T14:07:23.147 INFO:tasks.workunit.client.0.smithi067.stderr: File "/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm", line 6068, in command_deploy 2023-11-16T14:07:23.148 INFO:tasks.workunit.client.0.smithi067.stderr: ports=daemon_ports) 2023-11-16T14:07:23.148 INFO:tasks.workunit.client.0.smithi067.stderr: File "/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm", line 3302, in deploy_daemon 2023-11-16T14:07:23.148 INFO:tasks.workunit.client.0.smithi067.stderr: c, osd_fsid=osd_fsid, ports=ports) 2023-11-16T14:07:23.148 INFO:tasks.workunit.client.0.smithi067.stderr: File "/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm", line 3558, in deploy_daemon_units 2023-11-16T14:07:23.148 INFO:tasks.workunit.client.0.smithi067.stderr: call_throws(ctx, ['systemctl', 'start', unit_name]) 2023-11-16T14:07:23.148 INFO:tasks.workunit.client.0.smithi067.stderr: File "/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm", line 1806, in call_throws 2023-11-16T14:07:23.148 INFO:tasks.workunit.client.0.smithi067.stderr: raise RuntimeError(f'Failed command: {" ".join(command)}: {s}') 2023-11-16T14:07:23.148 INFO:tasks.workunit.client.0.smithi067.stderr:RuntimeError: Failed command: systemctl start ceph-00000000-0000-0000-0000-0000deadbeef@container.alertmanager.a: Job for ceph-00000000-0000-0000-0000-0000deadbeef@container.alertmanager.a.service failed because the control process exited with error code. 2023-11-16T14:07:23.149 INFO:tasks.workunit.client.0.smithi067.stderr:See "systemctl status ceph-00000000-0000-0000-0000-0000deadbeef@container.alertmanager.a.service" and "journalctl -xe" for details. 2023-11-16T14:07:23.149 INFO:tasks.workunit.client.0.smithi067.stderr: 2023-11-16T14:07:23.167 INFO:tasks.workunit.client.0.smithi067.stderr:+ cleanup 2023-11-16T14:07:23.167 INFO:tasks.workunit.client.0.smithi067.stderr:+ '[' true = false ']' 2023-11-16T14:07:23.167 INFO:tasks.workunit.client.0.smithi067.stderr:+ dump_all_logs 00000000-0000-0000-0000-0000deadbeef 2023-11-16T14:07:23.167 INFO:tasks.workunit.client.0.smithi067.stderr:+ local fsid=00000000-0000-0000-0000-0000deadbeef 2023-11-16T14:07:23.167 INFO:tasks.workunit.client.0.smithi067.stderr:++ sudo /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ls 2023-11-16T14:07:23.167 INFO:tasks.workunit.client.0.smithi067.stderr:++ jq -r '.[] | select(.fsid == "00000000-0000-0000-0000-0000deadbeef").name' 2023-11-16T14:07:27.336 INFO:tasks.workunit.client.0.smithi067.stderr:+ local 'names=mon.a 2023-11-16T14:07:27.336 INFO:tasks.workunit.client.0.smithi067.stderr:mgr.x 2023-11-16T14:07:27.336 INFO:tasks.workunit.client.0.smithi067.stderr:crash.smithi067 2023-11-16T14:07:27.336 INFO:tasks.workunit.client.0.smithi067.stderr:mon.b 2023-11-16T14:07:27.337 INFO:tasks.workunit.client.0.smithi067.stderr:mgr.y 2023-11-16T14:07:27.337 INFO:tasks.workunit.client.0.smithi067.stderr:osd.0 2023-11-16T14:07:27.337 INFO:tasks.workunit.client.0.smithi067.stderr:osd.1 2023-11-16T14:07:27.337 INFO:tasks.workunit.client.0.smithi067.stderr:node-exporter.a 2023-11-16T14:07:27.337 INFO:tasks.workunit.client.0.smithi067.stderr:prometheus.a 2023-11-16T14:07:27.337 INFO:tasks.workunit.client.0.smithi067.stderr:grafana.a 2023-11-16T14:07:27.337 INFO:tasks.workunit.client.0.smithi067.stderr:nfs.a 2023-11-16T14:07:27.337 INFO:tasks.workunit.client.0.smithi067.stderr:container.alertmanager.a' 2023-11-16T14:07:27.337 INFO:tasks.workunit.client.0.smithi067.stdout:dumping logs for daemons: mon.a mgr.x crash.smithi067 mon.b mgr.y osd.0 osd.1 node-exporter.a prometheus.a grafana.a nfs.a container.alertmanager.a 2023-11-16T14:07:27.338 INFO:tasks.workunit.client.0.smithi067.stdout:------------------------- 2023-11-16T14:07:27.338 INFO:tasks.workunit.client.0.smithi067.stdout:dump daemon log: mon.a 2023-11-16T14:07:27.338 INFO:tasks.workunit.client.0.smithi067.stdout:------------------------- 2023-11-16T14:07:27.338 INFO:tasks.workunit.client.0.smithi067.stderr:+ echo 'dumping logs for daemons: ' mon.a mgr.x crash.smithi067 mon.b mgr.y osd.0 osd.1 node-exporter.a prometheus.a grafana.a nfs.a container.alertmanager.a 2023-11-16T14:07:27.338 INFO:tasks.workunit.client.0.smithi067.stderr:+ for name in $names 2023-11-16T14:07:27.338 INFO:tasks.workunit.client.0.smithi067.stderr:+ dump_log 00000000-0000-0000-0000-0000deadbeef mon.a 2023-11-16T14:07:27.338 INFO:tasks.workunit.client.0.smithi067.stderr:+ local fsid=00000000-0000-0000-0000-0000deadbeef 2023-11-16T14:07:27.338 INFO:tasks.workunit.client.0.smithi067.stderr:+ local name=mon.a 2023-11-16T14:07:27.338 INFO:tasks.workunit.client.0.smithi067.stderr:+ local num_lines= 2023-11-16T14:07:27.338 INFO:tasks.workunit.client.0.smithi067.stderr:+ '[' -z ']' 2023-11-16T14:07:27.338 INFO:tasks.workunit.client.0.smithi067.stderr:+ num_lines=100 2023-11-16T14:07:27.339 INFO:tasks.workunit.client.0.smithi067.stderr:+ echo ------------------------- 2023-11-16T14:07:27.339 INFO:tasks.workunit.client.0.smithi067.stderr:+ echo 'dump daemon log:' mon.a 2023-11-16T14:07:27.339 INFO:tasks.workunit.client.0.smithi067.stderr:+ echo ------------------------- 2023-11-16T14:07:27.339 INFO:tasks.workunit.client.0.smithi067.stderr:+ sudo /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy logs --fsid 00000000-0000-0000-0000-0000deadbeef --name mon.a -- --no-pager -n 100 2023-11-16T14:07:27.566 INFO:tasks.workunit.client.0.smithi067.stderr:Inferring config /var/lib/ceph/00000000-0000-0000-0000-0000deadbeef/mon.a/config 2023-11-16T14:07:27.703 INFO:tasks.workunit.client.0.smithi067.stdout:-- Logs begin at Thu 2023-11-16 13:39:45 UTC, end at Thu 2023-11-16 14:07:27 UTC. -- 2023-11-16T14:07:27.703 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:30 smithi067 ceph-mon[89263]: mon.a@0(leader).osd e16 _set_new_cache_sizes cache_size:1020054731 inc_alloc: 348127232 full_alloc: 348127232 kv_alloc: 322961408 2023-11-16T14:07:27.703 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:31 smithi067 ceph-mon[89263]: pgmap v139: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:27.703 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:33 smithi067 ceph-mon[89263]: pgmap v140: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:27.704 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:35 smithi067 ceph-mon[89263]: mon.a@0(leader).osd e16 _set_new_cache_sizes cache_size:1020054731 inc_alloc: 348127232 full_alloc: 348127232 kv_alloc: 322961408 2023-11-16T14:07:27.704 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:35 smithi067 ceph-mon[89263]: pgmap v141: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:27.704 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:37 smithi067 ceph-mon[89263]: pgmap v142: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:27.704 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:38 smithi067 ceph-mon[89263]: log_channel(cluster) log [WRN] : Health check update: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded, 64 pgs undersized (PG_DEGRADED) 2023-11-16T14:07:27.705 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:38 smithi067 ceph-mon[89263]: Health check update: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded, 64 pgs undersized (PG_DEGRADED) 2023-11-16T14:07:27.705 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:39 smithi067 ceph-mon[89263]: pgmap v143: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:27.705 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:40 smithi067 ceph-mon[89263]: mon.a@0(leader).osd e16 _set_new_cache_sizes cache_size:1020054731 inc_alloc: 348127232 full_alloc: 348127232 kv_alloc: 322961408 2023-11-16T14:07:27.705 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:41 smithi067 ceph-mon[89263]: pgmap v144: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:27.706 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:43 smithi067 ceph-mon[89263]: pgmap v145: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:27.706 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:45 smithi067 ceph-mon[89263]: mon.a@0(leader).osd e16 _set_new_cache_sizes cache_size:1020054731 inc_alloc: 348127232 full_alloc: 348127232 kv_alloc: 322961408 2023-11-16T14:07:27.706 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:45 smithi067 ceph-mon[89263]: pgmap v146: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:27.706 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:47 smithi067 ceph-mon[89263]: pgmap v147: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:27.707 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:48 smithi067 ceph-mon[89263]: mon.a@0(leader) e2 handle_command mon_command({"prefix": "config dump", "format": "json"} v 0) v1 2023-11-16T14:07:27.707 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:48 smithi067 ceph-mon[89263]: log_channel(audit) log [DBG] : from='mgr.14152 127.0.0.1:0/2798010156' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-11-16T14:07:27.707 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:48 smithi067 ceph-mon[89263]: from='mgr.14152 127.0.0.1:0/2798010156' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-11-16T14:07:27.707 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:49 smithi067 ceph-mon[89263]: mon.a@0(leader) e2 handle_command mon_command([{prefix=config-key set, key=mgr/cephadm/osd_remove_queue}] v 0) v1 2023-11-16T14:07:27.708 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:49 smithi067 ceph-mon[89263]: log_channel(audit) log [INF] : from='mgr.14152 127.0.0.1:0/2798010156' entity='mgr.x' 2023-11-16T14:07:27.708 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:49 smithi067 ceph-mon[89263]: pgmap v148: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:27.709 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:49 smithi067 ceph-mon[89263]: from='mgr.14152 127.0.0.1:0/2798010156' entity='mgr.x' 2023-11-16T14:07:27.709 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:50 smithi067 ceph-mon[89263]: mon.a@0(leader).osd e16 _set_new_cache_sizes cache_size:1020054731 inc_alloc: 348127232 full_alloc: 348127232 kv_alloc: 322961408 2023-11-16T14:07:27.709 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:50 smithi067 ceph-mon[89263]: pgmap v149: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:27.709 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:50 smithi067 ceph-mon[89263]: pgmap v150: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:27.709 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:52 smithi067 ceph-mon[89263]: pgmap v151: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:27.709 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:54 smithi067 ceph-mon[89263]: pgmap v152: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:27.709 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:55 smithi067 ceph-mon[89263]: mon.a@0(leader).osd e16 _set_new_cache_sizes cache_size:1020054731 inc_alloc: 348127232 full_alloc: 348127232 kv_alloc: 322961408 2023-11-16T14:07:27.710 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:56 smithi067 ceph-mon[89263]: pgmap v153: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:27.710 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:58 smithi067 ceph-mon[89263]: pgmap v154: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:27.710 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:00 smithi067 ceph-mon[89263]: mon.a@0(leader).osd e16 _set_new_cache_sizes cache_size:1020054731 inc_alloc: 348127232 full_alloc: 348127232 kv_alloc: 322961408 2023-11-16T14:07:27.710 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:00 smithi067 ceph-mon[89263]: pgmap v155: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:27.710 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:02 smithi067 ceph-mon[89263]: pgmap v156: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:27.710 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:04 smithi067 ceph-mon[89263]: pgmap v157: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:27.710 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:05 smithi067 ceph-mon[89263]: mon.a@0(leader).osd e16 _set_new_cache_sizes cache_size:1020054731 inc_alloc: 348127232 full_alloc: 348127232 kv_alloc: 322961408 2023-11-16T14:07:27.710 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:06 smithi067 ceph-mon[89263]: pgmap v158: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:27.710 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:08 smithi067 ceph-mon[89263]: pgmap v159: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:27.710 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:10 smithi067 ceph-mon[89263]: mon.a@0(leader).osd e16 _set_new_cache_sizes cache_size:1020054731 inc_alloc: 348127232 full_alloc: 348127232 kv_alloc: 322961408 2023-11-16T14:07:27.710 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:10 smithi067 ceph-mon[89263]: pgmap v160: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:27.711 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:12 smithi067 ceph-mon[89263]: pgmap v161: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:27.711 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:14 smithi067 ceph-mon[89263]: pgmap v162: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:27.711 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:15 smithi067 ceph-mon[89263]: mon.a@0(leader).osd e16 _set_new_cache_sizes cache_size:1020054731 inc_alloc: 348127232 full_alloc: 348127232 kv_alloc: 322961408 2023-11-16T14:07:27.711 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:16 smithi067 ceph-mon[89263]: pgmap v163: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:27.711 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:18 smithi067 ceph-mon[89263]: pgmap v164: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:27.711 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:20 smithi067 ceph-mon[89263]: mon.a@0(leader).osd e16 _set_new_cache_sizes cache_size:1020054731 inc_alloc: 348127232 full_alloc: 348127232 kv_alloc: 322961408 2023-11-16T14:07:27.711 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:20 smithi067 ceph-mon[89263]: pgmap v165: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:27.711 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:22 smithi067 ceph-mon[89263]: pgmap v166: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:27.711 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:24 smithi067 ceph-mon[89263]: pgmap v167: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:27.711 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:25 smithi067 ceph-mon[89263]: mon.a@0(leader).osd e16 _set_new_cache_sizes cache_size:1020054731 inc_alloc: 348127232 full_alloc: 348127232 kv_alloc: 322961408 2023-11-16T14:07:27.711 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:26 smithi067 ceph-mon[89263]: pgmap v168: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:27.711 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:28 smithi067 ceph-mon[89263]: pgmap v169: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:27.712 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:30 smithi067 ceph-mon[89263]: mon.a@0(leader).osd e16 _set_new_cache_sizes cache_size:1020054731 inc_alloc: 348127232 full_alloc: 348127232 kv_alloc: 322961408 2023-11-16T14:07:27.712 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:30 smithi067 ceph-mon[89263]: pgmap v170: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:27.712 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:32 smithi067 ceph-mon[89263]: pgmap v171: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:27.712 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:34 smithi067 ceph-mon[89263]: pgmap v172: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:27.712 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:35 smithi067 ceph-mon[89263]: mon.a@0(leader).osd e16 _set_new_cache_sizes cache_size:1020054731 inc_alloc: 348127232 full_alloc: 348127232 kv_alloc: 322961408 2023-11-16T14:07:27.712 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:36 smithi067 ceph-mon[89263]: pgmap v173: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:27.712 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:38 smithi067 ceph-mon[89263]: pgmap v174: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:27.712 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:40 smithi067 ceph-mon[89263]: mon.a@0(leader).osd e16 _set_new_cache_sizes cache_size:1020054731 inc_alloc: 348127232 full_alloc: 348127232 kv_alloc: 322961408 2023-11-16T14:07:27.712 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:40 smithi067 ceph-mon[89263]: pgmap v175: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:27.712 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:42 smithi067 ceph-mon[89263]: pgmap v176: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:27.712 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:44 smithi067 ceph-mon[89263]: pgmap v177: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:27.712 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:45 smithi067 ceph-mon[89263]: mon.a@0(leader).osd e16 _set_new_cache_sizes cache_size:1020054731 inc_alloc: 348127232 full_alloc: 348127232 kv_alloc: 322961408 2023-11-16T14:07:27.713 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:46 smithi067 ceph-mon[89263]: pgmap v178: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:27.713 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:48 smithi067 ceph-mon[89263]: pgmap v179: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:27.713 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:49 smithi067 ceph-mon[89263]: mon.a@0(leader) e2 handle_command mon_command({"prefix": "config dump", "format": "json"} v 0) v1 2023-11-16T14:07:27.713 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:49 smithi067 ceph-mon[89263]: log_channel(audit) log [DBG] : from='mgr.14152 127.0.0.1:0/2798010156' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-11-16T14:07:27.713 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:49 smithi067 ceph-mon[89263]: mon.a@0(leader) e2 handle_command mon_command([{prefix=config-key set, key=mgr/cephadm/osd_remove_queue}] v 0) v1 2023-11-16T14:07:27.713 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:49 smithi067 ceph-mon[89263]: log_channel(audit) log [INF] : from='mgr.14152 127.0.0.1:0/2798010156' entity='mgr.x' 2023-11-16T14:07:27.713 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:49 smithi067 ceph-mon[89263]: from='mgr.14152 127.0.0.1:0/2798010156' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-11-16T14:07:27.714 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:49 smithi067 ceph-mon[89263]: from='mgr.14152 127.0.0.1:0/2798010156' entity='mgr.x' 2023-11-16T14:07:27.714 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:50 smithi067 ceph-mon[89263]: mon.a@0(leader).osd e16 _set_new_cache_sizes cache_size:1020054731 inc_alloc: 348127232 full_alloc: 348127232 kv_alloc: 322961408 2023-11-16T14:07:27.714 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:50 smithi067 ceph-mon[89263]: pgmap v180: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:27.714 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:50 smithi067 ceph-mon[89263]: pgmap v181: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:27.714 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:50 smithi067 ceph-mon[89263]: pgmap v182: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:27.714 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:52 smithi067 ceph-mon[89263]: pgmap v183: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:27.714 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:54 smithi067 ceph-mon[89263]: pgmap v184: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:27.714 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:55 smithi067 ceph-mon[89263]: mon.a@0(leader).osd e16 _set_new_cache_sizes cache_size:1020054731 inc_alloc: 348127232 full_alloc: 348127232 kv_alloc: 322961408 2023-11-16T14:07:27.714 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:56 smithi067 ceph-mon[89263]: pgmap v185: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:27.715 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:58 smithi067 ceph-mon[89263]: pgmap v186: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:27.715 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:00 smithi067 ceph-mon[89263]: mon.a@0(leader).osd e16 _set_new_cache_sizes cache_size:1020054731 inc_alloc: 348127232 full_alloc: 348127232 kv_alloc: 322961408 2023-11-16T14:07:27.715 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:00 smithi067 ceph-mon[89263]: pgmap v187: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:27.715 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:02 smithi067 ceph-mon[89263]: pgmap v188: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:27.715 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:04 smithi067 ceph-mon[89263]: pgmap v189: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:27.715 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:05 smithi067 ceph-mon[89263]: mon.a@0(leader).osd e16 _set_new_cache_sizes cache_size:1020054731 inc_alloc: 348127232 full_alloc: 348127232 kv_alloc: 322961408 2023-11-16T14:07:27.715 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:06 smithi067 ceph-mon[89263]: pgmap v190: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:27.715 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:08 smithi067 ceph-mon[89263]: pgmap v191: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:27.715 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:10 smithi067 ceph-mon[89263]: mon.a@0(leader).osd e16 _set_new_cache_sizes cache_size:1020054731 inc_alloc: 348127232 full_alloc: 348127232 kv_alloc: 322961408 2023-11-16T14:07:27.715 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:10 smithi067 ceph-mon[89263]: pgmap v192: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:27.715 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:12 smithi067 ceph-mon[89263]: pgmap v193: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:27.715 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:14 smithi067 ceph-mon[89263]: pgmap v194: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:27.716 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:15 smithi067 ceph-mon[89263]: mon.a@0(leader).osd e16 _set_new_cache_sizes cache_size:1020054731 inc_alloc: 348127232 full_alloc: 348127232 kv_alloc: 322961408 2023-11-16T14:07:27.716 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:16 smithi067 ceph-mon[89263]: pgmap v195: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:27.716 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:18 smithi067 ceph-mon[89263]: pgmap v196: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:27.716 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:20 smithi067 ceph-mon[89263]: mon.a@0(leader).osd e16 _set_new_cache_sizes cache_size:1020054731 inc_alloc: 348127232 full_alloc: 348127232 kv_alloc: 322961408 2023-11-16T14:07:27.716 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:20 smithi067 ceph-mon[89263]: pgmap v197: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:27.716 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:22 smithi067 ceph-mon[89263]: pgmap v198: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:27.716 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:24 smithi067 ceph-mon[89263]: pgmap v199: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:27.716 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:25 smithi067 ceph-mon[89263]: mon.a@0(leader).osd e16 _set_new_cache_sizes cache_size:1020054731 inc_alloc: 348127232 full_alloc: 348127232 kv_alloc: 322961408 2023-11-16T14:07:27.716 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:26 smithi067 ceph-mon[89263]: pgmap v200: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:27.722 INFO:tasks.workunit.client.0.smithi067.stderr:+ for name in $names 2023-11-16T14:07:27.723 INFO:tasks.workunit.client.0.smithi067.stderr:+ dump_log 00000000-0000-0000-0000-0000deadbeef mgr.x 2023-11-16T14:07:27.723 INFO:tasks.workunit.client.0.smithi067.stderr:+ local fsid=00000000-0000-0000-0000-0000deadbeef 2023-11-16T14:07:27.723 INFO:tasks.workunit.client.0.smithi067.stderr:+ local name=mgr.x 2023-11-16T14:07:27.723 INFO:tasks.workunit.client.0.smithi067.stderr:+ local num_lines= 2023-11-16T14:07:27.723 INFO:tasks.workunit.client.0.smithi067.stdout:------------------------- 2023-11-16T14:07:27.723 INFO:tasks.workunit.client.0.smithi067.stdout:dump daemon log: mgr.x 2023-11-16T14:07:27.723 INFO:tasks.workunit.client.0.smithi067.stderr:+ '[' -z ']' 2023-11-16T14:07:27.724 INFO:tasks.workunit.client.0.smithi067.stderr:+ num_lines=100 2023-11-16T14:07:27.724 INFO:tasks.workunit.client.0.smithi067.stderr:+ echo ------------------------- 2023-11-16T14:07:27.724 INFO:tasks.workunit.client.0.smithi067.stderr:+ echo 'dump daemon log:' mgr.x 2023-11-16T14:07:27.724 INFO:tasks.workunit.client.0.smithi067.stderr:+ echo ------------------------- 2023-11-16T14:07:27.725 INFO:tasks.workunit.client.0.smithi067.stdout:------------------------- 2023-11-16T14:07:27.725 INFO:tasks.workunit.client.0.smithi067.stderr:+ sudo /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy logs --fsid 00000000-0000-0000-0000-0000deadbeef --name mgr.x -- --no-pager -n 100 2023-11-16T14:07:27.948 INFO:tasks.workunit.client.0.smithi067.stderr:Inferring config /var/lib/ceph/00000000-0000-0000-0000-0000deadbeef/mgr.x/config 2023-11-16T14:07:28.080 INFO:tasks.workunit.client.0.smithi067.stdout:-- Logs begin at Thu 2023-11-16 13:39:45 UTC, end at Thu 2023-11-16 14:07:27 UTC. -- 2023-11-16T14:07:28.080 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:40 smithi067 ceph-mgr[89566]: log_channel(cluster) log [DBG] : pgmap v144: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:28.081 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:42 smithi067 ceph-mgr[89566]: log_channel(cluster) log [DBG] : pgmap v145: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:28.081 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:44 smithi067 ceph-mgr[89566]: log_channel(cluster) log [DBG] : pgmap v146: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:28.081 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:46 smithi067 ceph-mgr[89566]: log_channel(cluster) log [DBG] : pgmap v147: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:28.081 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:48 smithi067 ceph-mgr[89566]: log_channel(cluster) log [DBG] : pgmap v148: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:28.081 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:49 smithi067 ceph-mgr[89566]: log_channel(cluster) log [DBG] : pgmap v149: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:28.081 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:49 smithi067 ceph-mgr[89566]: log_channel(cluster) log [DBG] : pgmap v150: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:28.081 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:49 smithi067 ceph-mgr[89566]: [progress WARNING root] complete: ev 148405a5-2d88-4b45-9e41-34702a4246a1 does not exist 2023-11-16T14:07:28.081 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:49 smithi067 ceph-mgr[89566]: [volumes INFO mgr_util] scanning for idle connections.. 2023-11-16T14:07:28.081 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:49 smithi067 ceph-mgr[89566]: [volumes INFO mgr_util] cleaning up connections: [] 2023-11-16T14:07:28.081 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:49 smithi067 ceph-mgr[89566]: [volumes INFO mgr_util] scanning for idle connections.. 2023-11-16T14:07:28.081 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:49 smithi067 ceph-mgr[89566]: [volumes INFO mgr_util] cleaning up connections: [] 2023-11-16T14:07:28.081 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:49 smithi067 ceph-mgr[89566]: [volumes INFO mgr_util] scanning for idle connections.. 2023-11-16T14:07:28.081 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:49 smithi067 ceph-mgr[89566]: [volumes INFO mgr_util] cleaning up connections: [] 2023-11-16T14:07:28.082 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:51 smithi067 ceph-mgr[89566]: log_channel(cluster) log [DBG] : pgmap v151: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:28.082 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:53 smithi067 ceph-mgr[89566]: log_channel(cluster) log [DBG] : pgmap v152: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:28.082 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:55 smithi067 ceph-mgr[89566]: log_channel(cluster) log [DBG] : pgmap v153: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:28.082 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:57 smithi067 ceph-mgr[89566]: log_channel(cluster) log [DBG] : pgmap v154: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:28.082 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:59 smithi067 ceph-mgr[89566]: log_channel(cluster) log [DBG] : pgmap v155: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:28.082 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:01 smithi067 ceph-mgr[89566]: log_channel(cluster) log [DBG] : pgmap v156: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:28.082 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:03 smithi067 ceph-mgr[89566]: log_channel(cluster) log [DBG] : pgmap v157: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:28.082 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:05 smithi067 ceph-mgr[89566]: log_channel(cluster) log [DBG] : pgmap v158: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:28.082 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:07 smithi067 ceph-mgr[89566]: log_channel(cluster) log [DBG] : pgmap v159: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:28.082 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:09 smithi067 ceph-mgr[89566]: log_channel(cluster) log [DBG] : pgmap v160: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:28.082 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:11 smithi067 ceph-mgr[89566]: log_channel(cluster) log [DBG] : pgmap v161: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:28.082 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:13 smithi067 ceph-mgr[89566]: log_channel(cluster) log [DBG] : pgmap v162: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:28.083 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:15 smithi067 ceph-mgr[89566]: log_channel(cluster) log [DBG] : pgmap v163: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:28.083 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:17 smithi067 ceph-mgr[89566]: log_channel(cluster) log [DBG] : pgmap v164: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:28.083 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:19 smithi067 ceph-mgr[89566]: log_channel(cluster) log [DBG] : pgmap v165: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:28.083 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:19 smithi067 ceph-mgr[89566]: [balancer INFO root] Optimize plan auto_2023-11-16_14:06:19 2023-11-16T14:07:28.083 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:19 smithi067 ceph-mgr[89566]: [balancer INFO root] Mode upmap, max misplaced 0.050000 2023-11-16T14:07:28.083 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:19 smithi067 ceph-mgr[89566]: [balancer INFO root] Some objects (0.333333) are degraded; try again later 2023-11-16T14:07:28.083 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:19 smithi067 ceph-mgr[89566]: [pg_autoscaler INFO root] _maybe_adjust 2023-11-16T14:07:28.083 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:19 smithi067 ceph-mgr[89566]: [pg_autoscaler INFO root] effective_target_ratio 0.0 0.0 0 6434062336 2023-11-16T14:07:28.083 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:19 smithi067 ceph-mgr[89566]: [pg_autoscaler INFO root] Pool 'nfs-ganesha' root_id -1 using 0.0 of space, bias 1.0, pg target 0.0 quantized to 32 (current 64) 2023-11-16T14:07:28.083 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:19 smithi067 ceph-mgr[89566]: [rbd_support INFO root] MirrorSnapshotScheduleHandler: load_schedules 2023-11-16T14:07:28.083 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:19 smithi067 ceph-mgr[89566]: [volumes INFO mgr_util] scanning for idle connections.. 2023-11-16T14:07:28.083 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:19 smithi067 ceph-mgr[89566]: [volumes INFO mgr_util] cleaning up connections: [] 2023-11-16T14:07:28.083 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:19 smithi067 ceph-mgr[89566]: [rbd_support INFO root] TrashPurgeScheduleHandler: load_schedules 2023-11-16T14:07:28.083 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:19 smithi067 ceph-mgr[89566]: [volumes INFO mgr_util] scanning for idle connections.. 2023-11-16T14:07:28.083 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:19 smithi067 ceph-mgr[89566]: [volumes INFO mgr_util] cleaning up connections: [] 2023-11-16T14:07:28.084 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:19 smithi067 ceph-mgr[89566]: [volumes INFO mgr_util] scanning for idle connections.. 2023-11-16T14:07:28.084 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:19 smithi067 ceph-mgr[89566]: [volumes INFO mgr_util] cleaning up connections: [] 2023-11-16T14:07:28.084 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:21 smithi067 ceph-mgr[89566]: log_channel(cluster) log [DBG] : pgmap v166: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:28.084 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:23 smithi067 ceph-mgr[89566]: log_channel(cluster) log [DBG] : pgmap v167: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:28.084 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:25 smithi067 ceph-mgr[89566]: log_channel(cluster) log [DBG] : pgmap v168: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:28.084 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:27 smithi067 ceph-mgr[89566]: log_channel(cluster) log [DBG] : pgmap v169: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:28.084 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:29 smithi067 ceph-mgr[89566]: log_channel(cluster) log [DBG] : pgmap v170: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:28.084 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:31 smithi067 ceph-mgr[89566]: log_channel(cluster) log [DBG] : pgmap v171: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:28.084 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:33 smithi067 ceph-mgr[89566]: log_channel(cluster) log [DBG] : pgmap v172: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:28.084 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:35 smithi067 ceph-mgr[89566]: log_channel(cluster) log [DBG] : pgmap v173: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:28.084 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:37 smithi067 ceph-mgr[89566]: log_channel(cluster) log [DBG] : pgmap v174: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:28.084 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:39 smithi067 ceph-mgr[89566]: log_channel(cluster) log [DBG] : pgmap v175: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:28.084 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:41 smithi067 ceph-mgr[89566]: log_channel(cluster) log [DBG] : pgmap v176: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:28.084 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:43 smithi067 ceph-mgr[89566]: log_channel(cluster) log [DBG] : pgmap v177: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:28.085 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:45 smithi067 ceph-mgr[89566]: log_channel(cluster) log [DBG] : pgmap v178: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:28.085 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:47 smithi067 ceph-mgr[89566]: log_channel(cluster) log [DBG] : pgmap v179: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:28.085 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:49 smithi067 ceph-mgr[89566]: log_channel(cluster) log [DBG] : pgmap v180: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:28.085 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:49 smithi067 ceph-mgr[89566]: log_channel(cluster) log [DBG] : pgmap v181: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:28.085 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:49 smithi067 ceph-mgr[89566]: log_channel(cluster) log [DBG] : pgmap v182: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:28.085 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:49 smithi067 ceph-mgr[89566]: [progress WARNING root] complete: ev 83207537-d5f7-4000-ab08-0c4cac18e8ad does not exist 2023-11-16T14:07:28.085 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:49 smithi067 ceph-mgr[89566]: [volumes INFO mgr_util] scanning for idle connections.. 2023-11-16T14:07:28.085 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:49 smithi067 ceph-mgr[89566]: [volumes INFO mgr_util] cleaning up connections: [] 2023-11-16T14:07:28.085 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:49 smithi067 ceph-mgr[89566]: [volumes INFO mgr_util] scanning for idle connections.. 2023-11-16T14:07:28.085 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:49 smithi067 ceph-mgr[89566]: [volumes INFO mgr_util] cleaning up connections: [] 2023-11-16T14:07:28.085 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:49 smithi067 ceph-mgr[89566]: [volumes INFO mgr_util] scanning for idle connections.. 2023-11-16T14:07:28.085 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:49 smithi067 ceph-mgr[89566]: [volumes INFO mgr_util] cleaning up connections: [] 2023-11-16T14:07:28.085 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:51 smithi067 ceph-mgr[89566]: log_channel(cluster) log [DBG] : pgmap v183: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:28.085 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:53 smithi067 ceph-mgr[89566]: log_channel(cluster) log [DBG] : pgmap v184: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:28.086 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:55 smithi067 ceph-mgr[89566]: log_channel(cluster) log [DBG] : pgmap v185: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:28.086 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:57 smithi067 ceph-mgr[89566]: log_channel(cluster) log [DBG] : pgmap v186: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:28.086 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:59 smithi067 ceph-mgr[89566]: log_channel(cluster) log [DBG] : pgmap v187: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:28.086 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:01 smithi067 ceph-mgr[89566]: log_channel(cluster) log [DBG] : pgmap v188: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:28.086 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:03 smithi067 ceph-mgr[89566]: log_channel(cluster) log [DBG] : pgmap v189: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:28.086 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:05 smithi067 ceph-mgr[89566]: log_channel(cluster) log [DBG] : pgmap v190: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:28.086 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:07 smithi067 ceph-mgr[89566]: log_channel(cluster) log [DBG] : pgmap v191: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:28.086 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:09 smithi067 ceph-mgr[89566]: log_channel(cluster) log [DBG] : pgmap v192: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:28.086 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:11 smithi067 ceph-mgr[89566]: log_channel(cluster) log [DBG] : pgmap v193: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:28.086 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:13 smithi067 ceph-mgr[89566]: log_channel(cluster) log [DBG] : pgmap v194: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:28.086 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:15 smithi067 ceph-mgr[89566]: log_channel(cluster) log [DBG] : pgmap v195: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:28.086 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:17 smithi067 ceph-mgr[89566]: log_channel(cluster) log [DBG] : pgmap v196: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:28.086 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:19 smithi067 ceph-mgr[89566]: log_channel(cluster) log [DBG] : pgmap v197: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:28.087 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:19 smithi067 ceph-mgr[89566]: [balancer INFO root] Optimize plan auto_2023-11-16_14:07:19 2023-11-16T14:07:28.087 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:19 smithi067 ceph-mgr[89566]: [balancer INFO root] Mode upmap, max misplaced 0.050000 2023-11-16T14:07:28.087 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:19 smithi067 ceph-mgr[89566]: [balancer INFO root] Some objects (0.333333) are degraded; try again later 2023-11-16T14:07:28.087 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:19 smithi067 ceph-mgr[89566]: [pg_autoscaler INFO root] _maybe_adjust 2023-11-16T14:07:28.087 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:19 smithi067 ceph-mgr[89566]: [rbd_support INFO root] MirrorSnapshotScheduleHandler: load_schedules 2023-11-16T14:07:28.087 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:19 smithi067 ceph-mgr[89566]: [pg_autoscaler INFO root] effective_target_ratio 0.0 0.0 0 6434062336 2023-11-16T14:07:28.087 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:19 smithi067 ceph-mgr[89566]: [pg_autoscaler INFO root] Pool 'nfs-ganesha' root_id -1 using 0.0 of space, bias 1.0, pg target 0.0 quantized to 32 (current 64) 2023-11-16T14:07:28.087 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:19 smithi067 ceph-mgr[89566]: [volumes INFO mgr_util] scanning for idle connections.. 2023-11-16T14:07:28.087 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:19 smithi067 ceph-mgr[89566]: [volumes INFO mgr_util] cleaning up connections: [] 2023-11-16T14:07:28.087 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:19 smithi067 ceph-mgr[89566]: [rbd_support INFO root] TrashPurgeScheduleHandler: load_schedules 2023-11-16T14:07:28.087 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:19 smithi067 ceph-mgr[89566]: [volumes INFO mgr_util] scanning for idle connections.. 2023-11-16T14:07:28.087 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:19 smithi067 ceph-mgr[89566]: [volumes INFO mgr_util] cleaning up connections: [] 2023-11-16T14:07:28.087 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:19 smithi067 ceph-mgr[89566]: [volumes INFO mgr_util] scanning for idle connections.. 2023-11-16T14:07:28.087 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:19 smithi067 ceph-mgr[89566]: [volumes INFO mgr_util] cleaning up connections: [] 2023-11-16T14:07:28.088 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:21 smithi067 ceph-mgr[89566]: log_channel(cluster) log [DBG] : pgmap v198: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:28.088 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:23 smithi067 ceph-mgr[89566]: log_channel(cluster) log [DBG] : pgmap v199: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:28.088 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:25 smithi067 ceph-mgr[89566]: log_channel(cluster) log [DBG] : pgmap v200: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:28.088 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:27 smithi067 ceph-mgr[89566]: log_channel(cluster) log [DBG] : pgmap v201: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:28.101 INFO:tasks.workunit.client.0.smithi067.stderr:+ for name in $names 2023-11-16T14:07:28.101 INFO:tasks.workunit.client.0.smithi067.stderr:+ dump_log 00000000-0000-0000-0000-0000deadbeef crash.smithi067 2023-11-16T14:07:28.101 INFO:tasks.workunit.client.0.smithi067.stderr:+ local fsid=00000000-0000-0000-0000-0000deadbeef 2023-11-16T14:07:28.101 INFO:tasks.workunit.client.0.smithi067.stderr:+ local name=crash.smithi067 2023-11-16T14:07:28.101 INFO:tasks.workunit.client.0.smithi067.stderr:+ local num_lines= 2023-11-16T14:07:28.101 INFO:tasks.workunit.client.0.smithi067.stderr:+ '[' -z ']' 2023-11-16T14:07:28.101 INFO:tasks.workunit.client.0.smithi067.stderr:+ num_lines=100 2023-11-16T14:07:28.101 INFO:tasks.workunit.client.0.smithi067.stderr:+ echo ------------------------- 2023-11-16T14:07:28.101 INFO:tasks.workunit.client.0.smithi067.stdout:------------------------- 2023-11-16T14:07:28.102 INFO:tasks.workunit.client.0.smithi067.stdout:dump daemon log: crash.smithi067 2023-11-16T14:07:28.102 INFO:tasks.workunit.client.0.smithi067.stderr:+ echo 'dump daemon log:' crash.smithi067 2023-11-16T14:07:28.102 INFO:tasks.workunit.client.0.smithi067.stdout:------------------------- 2023-11-16T14:07:28.102 INFO:tasks.workunit.client.0.smithi067.stderr:+ echo ------------------------- 2023-11-16T14:07:28.103 INFO:tasks.workunit.client.0.smithi067.stderr:+ sudo /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy logs --fsid 00000000-0000-0000-0000-0000deadbeef --name crash.smithi067 -- --no-pager -n 100 2023-11-16T14:07:28.326 INFO:tasks.workunit.client.0.smithi067.stderr:Inferring config /var/lib/ceph/00000000-0000-0000-0000-0000deadbeef/crash.smithi067/config 2023-11-16T14:07:33.274 INFO:tasks.workunit.client.0.smithi067.stdout:-- Logs begin at Thu 2023-11-16 13:39:45 UTC, end at Thu 2023-11-16 14:07:28 UTC. -- 2023-11-16T14:07:33.282 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:01:36 smithi067 systemd[1]: Starting Ceph crash.smithi067 for 00000000-0000-0000-0000-0000deadbeef... 2023-11-16T14:07:33.282 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:01:37 smithi067 bash[104224]: 389eff5fc55c947391045f9b71f4c551faf77a7d506e0928e8e4c29207905db9 2023-11-16T14:07:33.306 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:01:37 smithi067 systemd[1]: Started Ceph crash.smithi067 for 00000000-0000-0000-0000-0000deadbeef. 2023-11-16T14:07:33.307 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:01:37 smithi067 conmon[104279]: INFO:ceph-crash:pinging cluster to exercise our key 2023-11-16T14:07:33.307 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:01:37 smithi067 conmon[104279]: 2023-11-16T14:01:37.559+0000 7f41d6ca8700 -1 auth: unable to find a keyring on /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin: (2) No such file or directory 2023-11-16T14:07:33.307 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:01:37 smithi067 conmon[104279]: 2023-11-16T14:01:37.559+0000 7f41d6ca8700 -1 AuthRegistry(0x7f41d0064ec0) no keyring found at /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin, disabling cephx 2023-11-16T14:07:33.307 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:01:37 smithi067 conmon[104279]: 2023-11-16T14:01:37.560+0000 7f41d6ca8700 -1 auth: unable to find a keyring on /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin: (2) No such file or directory 2023-11-16T14:07:33.307 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:01:37 smithi067 conmon[104279]: 2023-11-16T14:01:37.560+0000 7f41d6ca8700 -1 AuthRegistry(0x7f41d6ca6ea0) no keyring found at /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin, disabling cephx 2023-11-16T14:07:33.307 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:01:37 smithi067 conmon[104279]: 2023-11-16T14:01:37.560+0000 7f41d4a44700 -1 monclient(hunting): handle_auth_bad_method server allowed_methods [2] but i only support [1] 2023-11-16T14:07:33.307 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:01:37 smithi067 conmon[104279]: 2023-11-16T14:01:37.560+0000 7f41d6ca8700 -1 monclient: authenticate NOTE: no keyring found; disabled cephx authentication 2023-11-16T14:07:33.307 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:01:37 smithi067 conmon[104279]: [errno 13] RADOS permission denied (error connecting to the cluster) 2023-11-16T14:07:33.307 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:01:37 smithi067 conmon[104279]: INFO:ceph-crash:monitoring path /var/lib/ceph/crash, delay 600s 2023-11-16T14:07:33.308 INFO:tasks.workunit.client.0.smithi067.stderr:+ for name in $names 2023-11-16T14:07:33.308 INFO:tasks.workunit.client.0.smithi067.stderr:+ dump_log 00000000-0000-0000-0000-0000deadbeef mon.b 2023-11-16T14:07:33.308 INFO:tasks.workunit.client.0.smithi067.stderr:+ local fsid=00000000-0000-0000-0000-0000deadbeef 2023-11-16T14:07:33.308 INFO:tasks.workunit.client.0.smithi067.stderr:+ local name=mon.b 2023-11-16T14:07:33.308 INFO:tasks.workunit.client.0.smithi067.stderr:+ local num_lines= 2023-11-16T14:07:33.308 INFO:tasks.workunit.client.0.smithi067.stdout:------------------------- 2023-11-16T14:07:33.309 INFO:tasks.workunit.client.0.smithi067.stderr:+ '[' -z ']' 2023-11-16T14:07:33.309 INFO:tasks.workunit.client.0.smithi067.stderr:+ num_lines=100 2023-11-16T14:07:33.309 INFO:tasks.workunit.client.0.smithi067.stderr:+ echo ------------------------- 2023-11-16T14:07:33.309 INFO:tasks.workunit.client.0.smithi067.stdout:dump daemon log: mon.b 2023-11-16T14:07:33.310 INFO:tasks.workunit.client.0.smithi067.stderr:+ echo 'dump daemon log:' mon.b 2023-11-16T14:07:33.310 INFO:tasks.workunit.client.0.smithi067.stderr:+ echo ------------------------- 2023-11-16T14:07:33.310 INFO:tasks.workunit.client.0.smithi067.stdout:------------------------- 2023-11-16T14:07:33.310 INFO:tasks.workunit.client.0.smithi067.stderr:+ sudo /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy logs --fsid 00000000-0000-0000-0000-0000deadbeef --name mon.b -- --no-pager -n 100 2023-11-16T14:07:33.310 INFO:tasks.workunit.client.0.smithi067.stderr:Inferring config /var/lib/ceph/00000000-0000-0000-0000-0000deadbeef/mon.b/config 2023-11-16T14:07:33.311 INFO:tasks.workunit.client.0.smithi067.stdout:-- Logs begin at Thu 2023-11-16 13:39:45 UTC, end at Thu 2023-11-16 14:07:28 UTC. -- 2023-11-16T14:07:33.311 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:17 smithi067 ceph-mon[108073]: pgmap v132: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:33.311 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:19 smithi067 ceph-mon[108073]: pgmap v133: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:33.311 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:21 smithi067 ceph-mon[108073]: pgmap v134: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:33.312 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:21 smithi067 ceph-mon[108073]: mon.b@1(peon).osd e16 _set_new_cache_sizes cache_size:1020054731 inc_alloc: 348127232 full_alloc: 348127232 kv_alloc: 322961408 2023-11-16T14:07:33.312 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:23 smithi067 ceph-mon[108073]: pgmap v135: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:33.312 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:25 smithi067 ceph-mon[108073]: pgmap v136: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:33.312 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:26 smithi067 ceph-mon[108073]: mon.b@1(peon).osd e16 _set_new_cache_sizes cache_size:1020054731 inc_alloc: 348127232 full_alloc: 348127232 kv_alloc: 322961408 2023-11-16T14:07:33.312 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:27 smithi067 ceph-mon[108073]: pgmap v137: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:33.312 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:29 smithi067 ceph-mon[108073]: pgmap v138: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:33.312 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:31 smithi067 ceph-mon[108073]: pgmap v139: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:33.312 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:31 smithi067 ceph-mon[108073]: mon.b@1(peon).osd e16 _set_new_cache_sizes cache_size:1020054731 inc_alloc: 348127232 full_alloc: 348127232 kv_alloc: 322961408 2023-11-16T14:07:33.312 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:33 smithi067 ceph-mon[108073]: pgmap v140: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:33.312 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:35 smithi067 ceph-mon[108073]: pgmap v141: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:33.312 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:36 smithi067 ceph-mon[108073]: mon.b@1(peon).osd e16 _set_new_cache_sizes cache_size:1020054731 inc_alloc: 348127232 full_alloc: 348127232 kv_alloc: 322961408 2023-11-16T14:07:33.312 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:37 smithi067 ceph-mon[108073]: pgmap v142: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:33.312 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:38 smithi067 ceph-mon[108073]: Health check update: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded, 64 pgs undersized (PG_DEGRADED) 2023-11-16T14:07:33.313 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:39 smithi067 ceph-mon[108073]: pgmap v143: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:33.313 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:41 smithi067 ceph-mon[108073]: pgmap v144: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:33.313 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:41 smithi067 ceph-mon[108073]: mon.b@1(peon).osd e16 _set_new_cache_sizes cache_size:1020054731 inc_alloc: 348127232 full_alloc: 348127232 kv_alloc: 322961408 2023-11-16T14:07:33.333 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:43 smithi067 ceph-mon[108073]: pgmap v145: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:33.333 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:45 smithi067 ceph-mon[108073]: pgmap v146: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:33.333 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:46 smithi067 ceph-mon[108073]: mon.b@1(peon).osd e16 _set_new_cache_sizes cache_size:1020054731 inc_alloc: 348127232 full_alloc: 348127232 kv_alloc: 322961408 2023-11-16T14:07:33.333 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:47 smithi067 ceph-mon[108073]: pgmap v147: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:33.334 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:48 smithi067 ceph-mon[108073]: from='mgr.14152 127.0.0.1:0/2798010156' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-11-16T14:07:33.334 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:49 smithi067 ceph-mon[108073]: pgmap v148: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:33.335 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:49 smithi067 ceph-mon[108073]: from='mgr.14152 127.0.0.1:0/2798010156' entity='mgr.x' 2023-11-16T14:07:33.335 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:50 smithi067 ceph-mon[108073]: pgmap v149: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:33.335 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:50 smithi067 ceph-mon[108073]: pgmap v150: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:33.335 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:51 smithi067 ceph-mon[108073]: mon.b@1(peon).osd e16 _set_new_cache_sizes cache_size:1020054731 inc_alloc: 348127232 full_alloc: 348127232 kv_alloc: 322961408 2023-11-16T14:07:33.335 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:52 smithi067 ceph-mon[108073]: pgmap v151: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:33.335 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:54 smithi067 ceph-mon[108073]: pgmap v152: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:33.335 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:56 smithi067 ceph-mon[108073]: mon.b@1(peon).osd e16 _set_new_cache_sizes cache_size:1020054731 inc_alloc: 348127232 full_alloc: 348127232 kv_alloc: 322961408 2023-11-16T14:07:33.335 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:56 smithi067 ceph-mon[108073]: pgmap v153: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:33.335 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:58 smithi067 ceph-mon[108073]: pgmap v154: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:33.335 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:00 smithi067 ceph-mon[108073]: pgmap v155: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:33.335 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:01 smithi067 ceph-mon[108073]: mon.b@1(peon).osd e16 _set_new_cache_sizes cache_size:1020054731 inc_alloc: 348127232 full_alloc: 348127232 kv_alloc: 322961408 2023-11-16T14:07:33.336 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:02 smithi067 ceph-mon[108073]: pgmap v156: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:33.336 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:04 smithi067 ceph-mon[108073]: pgmap v157: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:33.336 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:06 smithi067 ceph-mon[108073]: mon.b@1(peon).osd e16 _set_new_cache_sizes cache_size:1020054731 inc_alloc: 348127232 full_alloc: 348127232 kv_alloc: 322961408 2023-11-16T14:07:33.336 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:06 smithi067 ceph-mon[108073]: pgmap v158: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:33.336 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:08 smithi067 ceph-mon[108073]: pgmap v159: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:33.336 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:10 smithi067 ceph-mon[108073]: pgmap v160: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:33.336 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:11 smithi067 ceph-mon[108073]: mon.b@1(peon).osd e16 _set_new_cache_sizes cache_size:1020054731 inc_alloc: 348127232 full_alloc: 348127232 kv_alloc: 322961408 2023-11-16T14:07:33.336 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:12 smithi067 ceph-mon[108073]: pgmap v161: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:33.336 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:14 smithi067 ceph-mon[108073]: pgmap v162: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:33.336 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:16 smithi067 ceph-mon[108073]: mon.b@1(peon).osd e16 _set_new_cache_sizes cache_size:1020054731 inc_alloc: 348127232 full_alloc: 348127232 kv_alloc: 322961408 2023-11-16T14:07:33.336 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:16 smithi067 ceph-mon[108073]: pgmap v163: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:33.336 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:18 smithi067 ceph-mon[108073]: pgmap v164: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:33.336 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:20 smithi067 ceph-mon[108073]: pgmap v165: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:33.337 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:21 smithi067 ceph-mon[108073]: mon.b@1(peon).osd e16 _set_new_cache_sizes cache_size:1020054731 inc_alloc: 348127232 full_alloc: 348127232 kv_alloc: 322961408 2023-11-16T14:07:33.337 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:22 smithi067 ceph-mon[108073]: pgmap v166: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:33.360 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:24 smithi067 ceph-mon[108073]: pgmap v167: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:33.360 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:26 smithi067 ceph-mon[108073]: mon.b@1(peon).osd e16 _set_new_cache_sizes cache_size:1020054731 inc_alloc: 348127232 full_alloc: 348127232 kv_alloc: 322961408 2023-11-16T14:07:33.360 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:26 smithi067 ceph-mon[108073]: pgmap v168: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:33.360 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:28 smithi067 ceph-mon[108073]: pgmap v169: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:33.360 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:30 smithi067 ceph-mon[108073]: pgmap v170: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:33.360 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:31 smithi067 ceph-mon[108073]: mon.b@1(peon).osd e16 _set_new_cache_sizes cache_size:1020054731 inc_alloc: 348127232 full_alloc: 348127232 kv_alloc: 322961408 2023-11-16T14:07:33.360 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:32 smithi067 ceph-mon[108073]: pgmap v171: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:33.360 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:34 smithi067 ceph-mon[108073]: pgmap v172: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:33.360 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:36 smithi067 ceph-mon[108073]: mon.b@1(peon).osd e16 _set_new_cache_sizes cache_size:1020054731 inc_alloc: 348127232 full_alloc: 348127232 kv_alloc: 322961408 2023-11-16T14:07:33.360 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:36 smithi067 ceph-mon[108073]: pgmap v173: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:33.360 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:38 smithi067 ceph-mon[108073]: pgmap v174: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:33.360 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:40 smithi067 ceph-mon[108073]: pgmap v175: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:33.361 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:41 smithi067 ceph-mon[108073]: mon.b@1(peon).osd e16 _set_new_cache_sizes cache_size:1020054731 inc_alloc: 348127232 full_alloc: 348127232 kv_alloc: 322961408 2023-11-16T14:07:33.361 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:42 smithi067 ceph-mon[108073]: pgmap v176: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:33.361 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:44 smithi067 ceph-mon[108073]: pgmap v177: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:33.361 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:46 smithi067 ceph-mon[108073]: mon.b@1(peon).osd e16 _set_new_cache_sizes cache_size:1020054731 inc_alloc: 348127232 full_alloc: 348127232 kv_alloc: 322961408 2023-11-16T14:07:33.361 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:46 smithi067 ceph-mon[108073]: pgmap v178: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:33.361 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:48 smithi067 ceph-mon[108073]: pgmap v179: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:33.361 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:49 smithi067 ceph-mon[108073]: from='mgr.14152 127.0.0.1:0/2798010156' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-11-16T14:07:33.361 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:49 smithi067 ceph-mon[108073]: from='mgr.14152 127.0.0.1:0/2798010156' entity='mgr.x' 2023-11-16T14:07:33.361 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:50 smithi067 ceph-mon[108073]: pgmap v180: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:33.361 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:50 smithi067 ceph-mon[108073]: pgmap v181: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:33.361 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:50 smithi067 ceph-mon[108073]: pgmap v182: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:33.361 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:51 smithi067 ceph-mon[108073]: mon.b@1(peon).osd e16 _set_new_cache_sizes cache_size:1020054731 inc_alloc: 348127232 full_alloc: 348127232 kv_alloc: 322961408 2023-11-16T14:07:33.361 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:52 smithi067 ceph-mon[108073]: pgmap v183: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:33.361 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:54 smithi067 ceph-mon[108073]: pgmap v184: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:33.362 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:56 smithi067 ceph-mon[108073]: pgmap v185: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:33.362 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:56 smithi067 ceph-mon[108073]: mon.b@1(peon).osd e16 _set_new_cache_sizes cache_size:1020054731 inc_alloc: 348127232 full_alloc: 348127232 kv_alloc: 322961408 2023-11-16T14:07:33.362 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:58 smithi067 ceph-mon[108073]: pgmap v186: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:33.362 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:00 smithi067 ceph-mon[108073]: pgmap v187: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:33.362 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:01 smithi067 ceph-mon[108073]: mon.b@1(peon).osd e16 _set_new_cache_sizes cache_size:1020054731 inc_alloc: 348127232 full_alloc: 348127232 kv_alloc: 322961408 2023-11-16T14:07:33.362 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:02 smithi067 ceph-mon[108073]: pgmap v188: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:33.362 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:04 smithi067 ceph-mon[108073]: pgmap v189: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:33.362 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:06 smithi067 ceph-mon[108073]: pgmap v190: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:33.362 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:06 smithi067 ceph-mon[108073]: mon.b@1(peon).osd e16 _set_new_cache_sizes cache_size:1020054731 inc_alloc: 348127232 full_alloc: 348127232 kv_alloc: 322961408 2023-11-16T14:07:33.362 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:08 smithi067 ceph-mon[108073]: pgmap v191: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:33.362 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:10 smithi067 ceph-mon[108073]: pgmap v192: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:33.362 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:11 smithi067 ceph-mon[108073]: mon.b@1(peon).osd e16 _set_new_cache_sizes cache_size:1020054731 inc_alloc: 348127232 full_alloc: 348127232 kv_alloc: 322961408 2023-11-16T14:07:33.363 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:12 smithi067 ceph-mon[108073]: pgmap v193: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:33.363 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:14 smithi067 ceph-mon[108073]: pgmap v194: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:33.363 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:16 smithi067 ceph-mon[108073]: pgmap v195: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:33.363 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:16 smithi067 ceph-mon[108073]: mon.b@1(peon).osd e16 _set_new_cache_sizes cache_size:1020054731 inc_alloc: 348127232 full_alloc: 348127232 kv_alloc: 322961408 2023-11-16T14:07:33.363 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:18 smithi067 ceph-mon[108073]: pgmap v196: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:33.363 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:20 smithi067 ceph-mon[108073]: pgmap v197: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:33.363 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:21 smithi067 ceph-mon[108073]: mon.b@1(peon).osd e16 _set_new_cache_sizes cache_size:1020054731 inc_alloc: 348127232 full_alloc: 348127232 kv_alloc: 322961408 2023-11-16T14:07:33.363 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:22 smithi067 ceph-mon[108073]: pgmap v198: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:33.363 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:24 smithi067 ceph-mon[108073]: pgmap v199: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:33.363 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:26 smithi067 ceph-mon[108073]: pgmap v200: 64 pgs: 1 active+undersized+degraded, 63 active+undersized; 0 B data, 581 MiB used, 5.4 GiB / 6.0 GiB avail; 1/3 objects degraded (33.333%) 2023-11-16T14:07:33.363 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:26 smithi067 ceph-mon[108073]: mon.b@1(peon).osd e16 _set_new_cache_sizes cache_size:1020054731 inc_alloc: 348127232 full_alloc: 348127232 kv_alloc: 322961408 2023-11-16T14:07:33.364 INFO:tasks.workunit.client.0.smithi067.stderr:+ for name in $names 2023-11-16T14:07:33.364 INFO:tasks.workunit.client.0.smithi067.stderr:+ dump_log 00000000-0000-0000-0000-0000deadbeef mgr.y 2023-11-16T14:07:33.364 INFO:tasks.workunit.client.0.smithi067.stderr:+ local fsid=00000000-0000-0000-0000-0000deadbeef 2023-11-16T14:07:33.364 INFO:tasks.workunit.client.0.smithi067.stderr:+ local name=mgr.y 2023-11-16T14:07:33.364 INFO:tasks.workunit.client.0.smithi067.stderr:+ local num_lines= 2023-11-16T14:07:33.364 INFO:tasks.workunit.client.0.smithi067.stderr:+ '[' -z ']' 2023-11-16T14:07:33.365 INFO:tasks.workunit.client.0.smithi067.stderr:+ num_lines=100 2023-11-16T14:07:33.365 INFO:tasks.workunit.client.0.smithi067.stdout:------------------------- 2023-11-16T14:07:33.365 INFO:tasks.workunit.client.0.smithi067.stderr:+ echo ------------------------- 2023-11-16T14:07:33.365 INFO:tasks.workunit.client.0.smithi067.stdout:dump daemon log: mgr.y 2023-11-16T14:07:33.366 INFO:tasks.workunit.client.0.smithi067.stderr:+ echo 'dump daemon log:' mgr.y 2023-11-16T14:07:33.366 INFO:tasks.workunit.client.0.smithi067.stderr:+ echo ------------------------- 2023-11-16T14:07:33.366 INFO:tasks.workunit.client.0.smithi067.stdout:------------------------- 2023-11-16T14:07:33.367 INFO:tasks.workunit.client.0.smithi067.stderr:+ sudo /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy logs --fsid 00000000-0000-0000-0000-0000deadbeef --name mgr.y -- --no-pager -n 100 2023-11-16T14:07:33.367 INFO:tasks.workunit.client.0.smithi067.stderr:Inferring config /var/lib/ceph/00000000-0000-0000-0000-0000deadbeef/mgr.y/config 2023-11-16T14:07:33.367 INFO:tasks.workunit.client.0.smithi067.stdout:-- Logs begin at Thu 2023-11-16 13:39:45 UTC, end at Thu 2023-11-16 14:07:28 UTC. -- 2023-11-16T14:07:33.367 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:09 smithi067 conmon[109228]: 2023-11-16T14:02:09.435+0000 7f9627b951c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-16T14:07:33.368 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:09 smithi067 ceph-mgr[109251]: mgr[py] Loading python module 'osd_support' 2023-11-16T14:07:33.368 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:09 smithi067 ceph-mgr[109251]: mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-16T14:07:33.368 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:09 smithi067 ceph-mgr[109251]: mgr[py] Loading python module 'balancer' 2023-11-16T14:07:33.368 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:09 smithi067 conmon[109228]: 2023-11-16T14:02:09.600+0000 7f9627b951c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-16T14:07:33.368 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:09 smithi067 ceph-mgr[109251]: mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-16T14:07:33.368 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:09 smithi067 ceph-mgr[109251]: mgr[py] Loading python module 'orchestrator' 2023-11-16T14:07:33.368 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:09 smithi067 conmon[109228]: 2023-11-16T14:02:09.692+0000 7f9627b951c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-16T14:07:33.368 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:09 smithi067 ceph-mgr[109251]: mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-16T14:07:33.368 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:09 smithi067 conmon[109228]: 2023-11-16T14:02:09.933+0000 7f9627b951c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-16T14:07:33.368 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:09 smithi067 ceph-mgr[109251]: mgr[py] Loading python module 'volumes' 2023-11-16T14:07:33.368 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:10 smithi067 ceph-mgr[109251]: mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-16T14:07:33.368 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:10 smithi067 ceph-mgr[109251]: mgr[py] Loading python module 'pg_autoscaler' 2023-11-16T14:07:33.369 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:10 smithi067 conmon[109228]: 2023-11-16T14:02:10.146+0000 7f9627b951c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-16T14:07:33.369 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:10 smithi067 ceph-mgr[109251]: mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-16T14:07:33.369 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:10 smithi067 ceph-mgr[109251]: mgr[py] Loading python module 'iostat' 2023-11-16T14:07:33.369 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:10 smithi067 conmon[109228]: 2023-11-16T14:02:10.317+0000 7f9627b951c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-16T14:07:33.369 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:10 smithi067 ceph-mgr[109251]: mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-16T14:07:33.369 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:10 smithi067 ceph-mgr[109251]: mgr[py] Loading python module 'k8sevents' 2023-11-16T14:07:33.369 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:10 smithi067 conmon[109228]: 2023-11-16T14:02:10.406+0000 7f9627b951c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-16T14:07:33.370 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:10 smithi067 ceph-mgr[109251]: mgr[py] Loading python module 'rbd_support' 2023-11-16T14:07:33.370 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:11 smithi067 ceph-mgr[109251]: mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-16T14:07:33.370 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:11 smithi067 ceph-mgr[109251]: mgr[py] Loading python module 'restful' 2023-11-16T14:07:33.370 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:11 smithi067 conmon[109228]: 2023-11-16T14:02:11.038+0000 7f9627b951c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-16T14:07:33.370 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:11 smithi067 ceph-mgr[109251]: mgr[py] Loading python module 'nfs' 2023-11-16T14:07:33.370 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:11 smithi067 ceph-mgr[109251]: mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-16T14:07:33.370 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:11 smithi067 ceph-mgr[109251]: mgr[py] Loading python module 'crash' 2023-11-16T14:07:33.370 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:11 smithi067 conmon[109228]: 2023-11-16T14:02:11.550+0000 7f9627b951c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-16T14:07:33.370 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:11 smithi067 ceph-mgr[109251]: mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-16T14:07:33.370 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:11 smithi067 ceph-mgr[109251]: mgr[py] Loading python module 'snap_schedule' 2023-11-16T14:07:33.370 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:11 smithi067 conmon[109228]: 2023-11-16T14:02:11.645+0000 7f9627b951c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-16T14:07:33.371 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:11 smithi067 ceph-mgr[109251]: mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-16T14:07:33.371 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:11 smithi067 ceph-mgr[109251]: mgr[py] Loading python module 'rook' 2023-11-16T14:07:33.371 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:11 smithi067 conmon[109228]: 2023-11-16T14:02:11.742+0000 7f9627b951c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-16T14:07:33.371 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:12 smithi067 conmon[109228]: 2023-11-16T14:02:12.360+0000 7f9627b951c0 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-16T14:07:33.371 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:12 smithi067 ceph-mgr[109251]: mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-16T14:07:33.371 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:12 smithi067 ceph-mgr[109251]: mgr[py] Loading python module 'test_orchestrator' 2023-11-16T14:07:33.371 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:12 smithi067 ceph-mgr[109251]: mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-16T14:07:33.371 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:12 smithi067 ceph-mgr[109251]: mgr[py] Loading python module 'selftest' 2023-11-16T14:07:33.371 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:12 smithi067 conmon[109228]: 2023-11-16T14:02:12.537+0000 7f9627b951c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-16T14:07:33.371 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:12 smithi067 ceph-mgr[109251]: mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-16T14:07:33.371 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:12 smithi067 ceph-mgr[109251]: mgr[py] Loading python module 'diskprediction_local' 2023-11-16T14:07:33.371 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:12 smithi067 conmon[109228]: 2023-11-16T14:02:12.636+0000 7f9627b951c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-16T14:07:33.371 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:12 smithi067 ceph-mgr[109251]: mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-16T14:07:33.371 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:12 smithi067 conmon[109228]: 2023-11-16T14:02:12.784+0000 7f9627b951c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-16T14:07:33.372 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:12 smithi067 ceph-mgr[109251]: mgr[py] Loading python module 'status' 2023-11-16T14:07:33.372 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:12 smithi067 ceph-mgr[109251]: mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-16T14:07:33.372 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:12 smithi067 ceph-mgr[109251]: mgr[py] Loading python module 'cephadm' 2023-11-16T14:07:33.372 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:12 smithi067 conmon[109228]: 2023-11-16T14:02:12.883+0000 7f9627b951c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-16T14:07:33.372 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:13 smithi067 ceph-mgr[109251]: mgr[py] Loading python module 'rgw' 2023-11-16T14:07:33.372 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:13 smithi067 ceph-mgr[109251]: mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-11-16T14:07:33.372 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:13 smithi067 ceph-mgr[109251]: mgr[py] Loading python module 'zabbix' 2023-11-16T14:07:33.372 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:13 smithi067 conmon[109228]: 2023-11-16T14:02:13.823+0000 7f9627b951c0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-11-16T14:07:33.372 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:13 smithi067 ceph-mgr[109251]: mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-16T14:07:33.372 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:13 smithi067 ceph-mgr[109251]: mgr[py] Loading python module 'influx' 2023-11-16T14:07:33.372 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:13 smithi067 conmon[109228]: 2023-11-16T14:02:13.914+0000 7f9627b951c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-16T14:07:33.372 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:14 smithi067 ceph-mgr[109251]: mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-16T14:07:33.372 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:14 smithi067 conmon[109228]: 2023-11-16T14:02:14.010+0000 7f9627b951c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-16T14:07:33.372 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:14 smithi067 ceph-mgr[109251]: mgr[py] Loading python module 'telemetry' 2023-11-16T14:07:33.373 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:14 smithi067 ceph-mgr[109251]: mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-16T14:07:33.373 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:14 smithi067 ceph-mgr[109251]: mgr[py] Loading python module 'alerts' 2023-11-16T14:07:33.373 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:14 smithi067 conmon[109228]: 2023-11-16T14:02:14.174+0000 7f9627b951c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-16T14:07:33.373 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:14 smithi067 ceph-mgr[109251]: mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-16T14:07:33.373 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:14 smithi067 conmon[109228]: 2023-11-16T14:02:14.280+0000 7f9627b951c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-16T14:07:33.373 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:14 smithi067 ceph-mgr[109251]: mgr[py] Loading python module 'insights' 2023-11-16T14:07:33.373 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:14 smithi067 ceph-mgr[109251]: mgr[py] Loading python module 'osd_perf_query' 2023-11-16T14:07:33.373 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:14 smithi067 ceph-mgr[109251]: mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-16T14:07:33.373 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:14 smithi067 ceph-mgr[109251]: mgr[py] Loading python module 'devicehealth' 2023-11-16T14:07:33.373 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:14 smithi067 conmon[109228]: 2023-11-16T14:02:14.701+0000 7f9627b951c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-16T14:07:33.373 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:14 smithi067 ceph-mgr[109251]: mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-16T14:07:33.373 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:14 smithi067 ceph-mgr[109251]: mgr[py] Loading python module 'progress' 2023-11-16T14:07:33.373 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:14 smithi067 conmon[109228]: 2023-11-16T14:02:14.796+0000 7f9627b951c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-16T14:07:33.373 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:14 smithi067 ceph-mgr[109251]: mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-16T14:07:33.374 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:14 smithi067 ceph-mgr[109251]: mgr[py] Loading python module 'telegraf' 2023-11-16T14:07:33.374 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:14 smithi067 conmon[109228]: 2023-11-16T14:02:14.890+0000 7f9627b951c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-16T14:07:33.374 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:14 smithi067 ceph-mgr[109251]: mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-16T14:07:33.374 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:14 smithi067 conmon[109228]: 2023-11-16T14:02:14.989+0000 7f9627b951c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-16T14:07:33.374 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:15 smithi067 ceph-mgr[109251]: ms_deliver_dispatch: unhandled message 0x564a74048c60 mon_map magic: 0 v1 from mon.0 v2:127.0.0.1:3300/0 2023-11-16T14:07:33.374 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:15 smithi067 ceph-mgr[109251]: [dashboard DEBUG root] setting log level based on debug_mgr: INFO (2/5) 2023-11-16T14:07:33.374 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:15 smithi067 ceph-mgr[109251]: mgr load Constructed class from module: dashboard 2023-11-16T14:07:33.374 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:15 smithi067 ceph-mgr[109251]: [dashboard INFO root] server: ssl=yes host=:: port=8443 2023-11-16T14:07:33.374 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:15 smithi067 ceph-mgr[109251]: client.0 ms_handle_reset on v2:127.0.0.1:6800/3456604665 2023-11-16T14:07:33.374 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:15 smithi067 ceph-mgr[109251]: [dashboard INFO root] Configured CherryPy, starting engine... 2023-11-16T14:07:33.374 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:15 smithi067 ceph-mgr[109251]: [dashboard INFO root] Starting engine... 2023-11-16T14:07:33.374 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:16 smithi067 ceph-mgr[109251]: log_channel(cluster) log [ERR] : Unhandled exception from module 'dashboard' while running on mgr.y: Timeout('Port 8443 not free on ::.',) 2023-11-16T14:07:33.374 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:16 smithi067 ceph-mgr[109251]: dashboard.serve: 2023-11-16T14:07:33.375 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:16 smithi067 conmon[109228]: 2023-11-16T14:02:16.037+0000 7f95d8414700 -1 log_channel(cluster) log [ERR] : Unhandled exception from module 'dashboard' while running on mgr.y: Timeout('Port 8443 not free on ::.',) 2023-11-16T14:07:33.375 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:16 smithi067 conmon[109228]: 2023-11-16T14:02:16.037+0000 7f95d8414700 -1 dashboard.serve: 2023-11-16T14:07:33.375 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:16 smithi067 ceph-mgr[109251]: Traceback (most recent call last): 2023-11-16T14:07:33.375 INFO:tasks.workunit.client.0.smithi067.stdout: File "/usr/share/ceph/mgr/dashboard/module.py", line 630, in serve 2023-11-16T14:07:33.375 INFO:tasks.workunit.client.0.smithi067.stdout: cherrypy.engine.start() 2023-11-16T14:07:33.375 INFO:tasks.workunit.client.0.smithi067.stdout: File "/lib/python3.6/site-packages/cherrypy/process/wspbus.py", line 283, in start 2023-11-16T14:07:33.375 INFO:tasks.workunit.client.0.smithi067.stdout: raise e_info 2023-11-16T14:07:33.375 INFO:tasks.workunit.client.0.smithi067.stdout: File "/lib/python3.6/site-packages/cherrypy/process/wspbus.py", line 268, in start 2023-11-16T14:07:33.375 INFO:tasks.workunit.client.0.smithi067.stdout: self.publish('start') 2023-11-16T14:07:33.375 INFO:tasks.workunit.client.0.smithi067.stdout: File "/lib/python3.6/site-packages/cherrypy/process/wspbus.py", line 248, in publish 2023-11-16T14:07:33.375 INFO:tasks.workunit.client.0.smithi067.stdout: raise exc 2023-11-16T14:07:33.375 INFO:tasks.workunit.client.0.smithi067.stdout: cherrypy.process.wspbus.ChannelFailures: Timeout('Port 8443 not free on ::.',) 2023-11-16T14:07:33.375 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:16 smithi067 conmon[109228]: 2023-11-16T14:02:16.037+0000 7f95d8414700 -1 Traceback (most recent call last): 2023-11-16T14:07:33.375 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:16 smithi067 conmon[109228]: File "/usr/share/ceph/mgr/dashboard/module.py", line 630, in serve 2023-11-16T14:07:33.376 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:16 smithi067 conmon[109228]: cherrypy.engine.start() 2023-11-16T14:07:33.376 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:16 smithi067 conmon[109228]: File "/lib/python3.6/site-packages/cherrypy/process/wspbus.py", line 283, in start 2023-11-16T14:07:33.376 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:16 smithi067 conmon[109228]: raise e_info 2023-11-16T14:07:33.376 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:16 smithi067 conmon[109228]: File "/lib/python3.6/site-packages/cherrypy/process/wspbus.py", line 268, in start 2023-11-16T14:07:33.376 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:16 smithi067 conmon[109228]: self.publish('start') 2023-11-16T14:07:33.376 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:16 smithi067 conmon[109228]: File "/lib/python3.6/site-packages/cherrypy/process/wspbus.py", line 248, in publish 2023-11-16T14:07:33.376 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:16 smithi067 conmon[109228]: raise exc 2023-11-16T14:07:33.376 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:16 smithi067 conmon[109228]: cherrypy.process.wspbus.ChannelFailures: Timeout('Port 8443 not free on ::.',) 2023-11-16T14:07:33.376 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:16 smithi067 conmon[109228]: 2023-11-16T14:07:33.377 INFO:tasks.workunit.client.0.smithi067.stderr:+ for name in $names 2023-11-16T14:07:33.377 INFO:tasks.workunit.client.0.smithi067.stderr:+ dump_log 00000000-0000-0000-0000-0000deadbeef osd.0 2023-11-16T14:07:33.377 INFO:tasks.workunit.client.0.smithi067.stderr:+ local fsid=00000000-0000-0000-0000-0000deadbeef 2023-11-16T14:07:33.377 INFO:tasks.workunit.client.0.smithi067.stderr:+ local name=osd.0 2023-11-16T14:07:33.378 INFO:tasks.workunit.client.0.smithi067.stderr:+ local num_lines= 2023-11-16T14:07:33.378 INFO:tasks.workunit.client.0.smithi067.stderr:+ '[' -z ']' 2023-11-16T14:07:33.378 INFO:tasks.workunit.client.0.smithi067.stderr:+ num_lines=100 2023-11-16T14:07:33.378 INFO:tasks.workunit.client.0.smithi067.stderr:+ echo ------------------------- 2023-11-16T14:07:33.378 INFO:tasks.workunit.client.0.smithi067.stdout:------------------------- 2023-11-16T14:07:33.378 INFO:tasks.workunit.client.0.smithi067.stdout:dump daemon log: osd.0 2023-11-16T14:07:33.378 INFO:tasks.workunit.client.0.smithi067.stderr:+ echo 'dump daemon log:' osd.0 2023-11-16T14:07:33.378 INFO:tasks.workunit.client.0.smithi067.stderr:+ echo ------------------------- 2023-11-16T14:07:33.379 INFO:tasks.workunit.client.0.smithi067.stdout:------------------------- 2023-11-16T14:07:33.379 INFO:tasks.workunit.client.0.smithi067.stderr:+ sudo /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy logs --fsid 00000000-0000-0000-0000-0000deadbeef --name osd.0 -- --no-pager -n 100 2023-11-16T14:07:33.379 INFO:tasks.workunit.client.0.smithi067.stderr:Inferring config /var/lib/ceph/00000000-0000-0000-0000-0000deadbeef/osd.0/config 2023-11-16T14:07:33.380 INFO:tasks.workunit.client.0.smithi067.stdout:-- Logs begin at Thu 2023-11-16 13:39:45 UTC, end at Thu 2023-11-16 14:07:29 UTC. -- 2023-11-16T14:07:33.380 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:50 smithi067 ceph-osd[113847]: osd.0 0 crush map has features 288232575208783872, adjusting msgr requires for osds 2023-11-16T14:07:33.380 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:50 smithi067 ceph-osd[113847]: osd.0 0 check_osdmap_features enabling on-disk ERASURE CODES compat feature 2023-11-16T14:07:33.380 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:50 smithi067 ceph-osd[113847]: osd.0 0 load_pgs 2023-11-16T14:07:33.380 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:50 smithi067 ceph-osd[113847]: osd.0 0 load_pgs opened 0 pgs 2023-11-16T14:07:33.380 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:50 smithi067 ceph-osd[113847]: osd.0 0 log_to_monitors true 2023-11-16T14:07:33.380 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:50 smithi067 conmon[113824]: 2023-11-16T14:02:50.886+0000 7f050e1c5540 -1 osd.0 0 log_to_monitors true 2023-11-16T14:07:33.381 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:51 smithi067 ceph-osd[113847]: log_channel(cluster) log [DBG] : purged_snaps scrub starts 2023-11-16T14:07:33.381 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:51 smithi067 ceph-osd[113847]: log_channel(cluster) log [DBG] : purged_snaps scrub ok 2023-11-16T14:07:33.381 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:52 smithi067 ceph-osd[113847]: osd.0 0 done with init, starting boot process 2023-11-16T14:07:33.381 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:52 smithi067 ceph-osd[113847]: osd.0 0 start_boot 2023-11-16T14:07:33.381 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:52 smithi067 ceph-osd[113847]: osd.0 0 maybe_override_options_for_qos osd_max_backfills set to 1 2023-11-16T14:07:33.381 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:52 smithi067 ceph-osd[113847]: osd.0 0 maybe_override_options_for_qos osd_recovery_max_active set to 0 2023-11-16T14:07:33.381 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:52 smithi067 ceph-osd[113847]: osd.0 0 maybe_override_options_for_qos osd_recovery_max_active_hdd set to 3 2023-11-16T14:07:33.381 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:52 smithi067 ceph-osd[113847]: osd.0 0 maybe_override_options_for_qos osd_recovery_max_active_ssd set to 10 2023-11-16T14:07:33.381 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:02:52 smithi067 ceph-osd[113847]: osd.0 0 bench count 12288000 bsize 4 KiB 2023-11-16T14:07:33.381 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:20 smithi067 ceph-osd[113847]: osd.0 0 maybe_override_max_osd_capacity_for_qos osd bench result - bandwidth (MiB/sec): 0.923 iops: 236.278 elapsed_sec: 12.697 2023-11-16T14:07:33.382 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:20 smithi067 ceph-osd[113847]: osd.0 0 waiting for initial osdmap 2023-11-16T14:07:33.382 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:20 smithi067 conmon[113824]: 2023-11-16T14:03:20.663+0000 7f05061ad700 -1 osd.0 0 waiting for initial osdmap 2023-11-16T14:07:33.382 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:20 smithi067 ceph-osd[113847]: mClockScheduler: set_osd_capacity_params_from_config: osd_bandwidth_cost_per_io: 665683.26 bytes/io, osd_bandwidth_capacity_per_shard 31457280.00 bytes/second 2023-11-16T14:07:33.382 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:20 smithi067 ceph-osd[113847]: mClockScheduler: set_osd_capacity_params_from_config: osd_bandwidth_cost_per_io: 665683.26 bytes/io, osd_bandwidth_capacity_per_shard 31457280.00 bytes/second 2023-11-16T14:07:33.382 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:20 smithi067 ceph-osd[113847]: mClockScheduler: set_osd_capacity_params_from_config: osd_bandwidth_cost_per_io: 665683.26 bytes/io, osd_bandwidth_capacity_per_shard 31457280.00 bytes/second 2023-11-16T14:07:33.382 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:20 smithi067 ceph-osd[113847]: mClockScheduler: set_osd_capacity_params_from_config: osd_bandwidth_cost_per_io: 665683.26 bytes/io, osd_bandwidth_capacity_per_shard 31457280.00 bytes/second 2023-11-16T14:07:33.382 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:20 smithi067 ceph-osd[113847]: mClockScheduler: set_osd_capacity_params_from_config: osd_bandwidth_cost_per_io: 665683.26 bytes/io, osd_bandwidth_capacity_per_shard 31457280.00 bytes/second 2023-11-16T14:07:33.382 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:20 smithi067 ceph-osd[113847]: osd.0 7 crush map has features 288514050185494528, adjusting msgr requires for clients 2023-11-16T14:07:33.382 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:20 smithi067 ceph-osd[113847]: osd.0 7 crush map has features 288514050185494528 was 288232575208792577, adjusting msgr requires for mons 2023-11-16T14:07:33.382 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:20 smithi067 ceph-osd[113847]: osd.0 7 crush map has features 3314932999778484224, adjusting msgr requires for osds 2023-11-16T14:07:33.382 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:20 smithi067 ceph-osd[113847]: osd.0 7 check_osdmap_features require_osd_release unknown -> quincy 2023-11-16T14:07:33.382 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:20 smithi067 ceph-osd[113847]: osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-16T14:07:33.383 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:20 smithi067 ceph-osd[113847]: osd.0 7 set_numa_affinity not setting numa affinity 2023-11-16T14:07:33.383 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:20 smithi067 conmon[113824]: 2023-11-16T14:03:20.893+0000 7f04fefa4700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-16T14:07:33.383 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:20 smithi067 ceph-osd[113847]: osd.0 7 _collect_metadata loop0: no unique device id for loop0: fallback method has no model nor serial 2023-11-16T14:07:33.383 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:21 smithi067 ceph-osd[113847]: osd.0 7 tick checking mon for new map 2023-11-16T14:07:33.383 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:21 smithi067 ceph-osd[113847]: osd.0 8 state: booting -> active 2023-11-16T14:07:33.383 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[113847]: osd.0 14 crush map has features 288514051259236352, adjusting msgr requires for clients 2023-11-16T14:07:33.383 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[113847]: osd.0 14 crush map has features 288514051259236352 was 288514050185503233, adjusting msgr requires for mons 2023-11-16T14:07:33.383 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[113847]: osd.0 14 crush map has features 3314933000852226048, adjusting msgr requires for osds 2023-11-16T14:07:33.383 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[113847]: osd.0 pg_epoch: 14 pg[1.17( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [0,1] r=0 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Primary 2023-11-16T14:07:33.383 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[113847]: osd.0 pg_epoch: 14 pg[1.31( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [0,1] r=0 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Primary 2023-11-16T14:07:33.383 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[113847]: osd.0 pg_epoch: 14 pg[1.34( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [0,1] r=0 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Primary 2023-11-16T14:07:33.383 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[113847]: osd.0 pg_epoch: 14 pg[1.1c( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [0,1] r=0 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Primary 2023-11-16T14:07:33.383 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[113847]: osd.0 pg_epoch: 14 pg[1.2f( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [0,1] r=0 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Primary 2023-11-16T14:07:33.384 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[113847]: osd.0 pg_epoch: 14 pg[1.12( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [0,1] r=0 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Primary 2023-11-16T14:07:33.384 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[113847]: osd.0 pg_epoch: 14 pg[1.2a( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [0,1] r=0 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Primary 2023-11-16T14:07:33.384 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[113847]: osd.0 pg_epoch: 14 pg[1.28( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [0,1] r=0 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Primary 2023-11-16T14:07:33.384 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[113847]: osd.0 pg_epoch: 14 pg[1.36( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [0,1] r=0 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Primary 2023-11-16T14:07:33.384 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[113847]: osd.0 pg_epoch: 14 pg[1.30( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [0,1] r=0 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Primary 2023-11-16T14:07:33.384 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[113847]: osd.0 pg_epoch: 14 pg[1.1b( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [0,1] r=0 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Primary 2023-11-16T14:07:33.384 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[113847]: osd.0 pg_epoch: 14 pg[1.35( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [0,1] r=0 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Primary 2023-11-16T14:07:33.384 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[113847]: osd.0 pg_epoch: 14 pg[1.10( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [0,1] r=0 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Primary 2023-11-16T14:07:33.384 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[113847]: osd.0 pg_epoch: 14 pg[1.2c( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [0,1] r=0 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Primary 2023-11-16T14:07:33.384 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[113847]: osd.0 pg_epoch: 14 pg[1.23( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [0,1] r=0 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Primary 2023-11-16T14:07:33.384 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[113847]: osd.0 pg_epoch: 14 pg[1.2( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [0,1] r=0 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Primary 2023-11-16T14:07:33.384 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[113847]: osd.0 pg_epoch: 14 pg[1.3a( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [0,1] r=0 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Primary 2023-11-16T14:07:33.384 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[113847]: osd.0 pg_epoch: 14 pg[1.1( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [0,1] r=0 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Primary 2023-11-16T14:07:33.385 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[113847]: osd.0 pg_epoch: 14 pg[1.11( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [0,1] r=0 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Primary 2023-11-16T14:07:33.385 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[113847]: osd.0 pg_epoch: 14 pg[1.3b( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [0,1] r=0 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Primary 2023-11-16T14:07:33.385 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[113847]: osd.0 pg_epoch: 14 pg[1.32( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [0,1] r=0 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Primary 2023-11-16T14:07:33.385 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[113847]: osd.0 pg_epoch: 14 pg[1.1f( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [0,1] r=0 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Primary 2023-11-16T14:07:33.385 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[113847]: osd.0 pg_epoch: 14 pg[1.39( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [0,1] r=0 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Primary 2023-11-16T14:07:33.385 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[113847]: osd.0 pg_epoch: 14 pg[1.24( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [0,1] r=0 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Primary 2023-11-16T14:07:33.385 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[113847]: osd.0 pg_epoch: 14 pg[1.3c( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [0,1] r=0 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Primary 2023-11-16T14:07:33.385 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[113847]: osd.0 pg_epoch: 14 pg[1.29( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [0,1] r=0 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Primary 2023-11-16T14:07:33.385 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[113847]: osd.0 pg_epoch: 14 pg[1.3d( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [0,1] r=0 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Primary 2023-11-16T14:07:33.386 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:38 smithi067 ceph-osd[113847]: osd.0 pg_epoch: 14 pg[1.18( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=1 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Stray 2023-11-16T14:07:33.386 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:38 smithi067 ceph-osd[113847]: osd.0 pg_epoch: 14 pg[1.14( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=1 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Stray 2023-11-16T14:07:33.386 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:38 smithi067 ceph-osd[113847]: osd.0 pg_epoch: 14 pg[1.25( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=1 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Stray 2023-11-16T14:07:33.386 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:38 smithi067 ceph-osd[113847]: osd.0 pg_epoch: 14 pg[1.2b( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=1 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Stray 2023-11-16T14:07:33.386 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:38 smithi067 ceph-osd[113847]: osd.0 pg_epoch: 14 pg[1.38( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=1 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Stray 2023-11-16T14:07:33.386 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:38 smithi067 ceph-osd[113847]: osd.0 pg_epoch: 14 pg[1.9( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=1 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Stray 2023-11-16T14:07:33.386 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:38 smithi067 ceph-osd[113847]: osd.0 pg_epoch: 14 pg[1.5( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=1 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Stray 2023-11-16T14:07:33.386 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:38 smithi067 ceph-osd[113847]: osd.0 pg_epoch: 14 pg[1.3e( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=1 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Stray 2023-11-16T14:07:33.386 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:38 smithi067 ceph-osd[113847]: osd.0 pg_epoch: 14 pg[1.1d( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=1 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Stray 2023-11-16T14:07:33.386 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:38 smithi067 ceph-osd[113847]: osd.0 pg_epoch: 14 pg[1.15( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=1 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Stray 2023-11-16T14:07:33.387 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:38 smithi067 ceph-osd[113847]: osd.0 pg_epoch: 14 pg[1.19( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=1 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Stray 2023-11-16T14:07:33.387 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:38 smithi067 ceph-osd[113847]: osd.0 pg_epoch: 14 pg[1.21( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=1 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Stray 2023-11-16T14:07:33.387 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:38 smithi067 ceph-osd[113847]: osd.0 pg_epoch: 14 pg[1.2e( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=1 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Stray 2023-11-16T14:07:33.387 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:38 smithi067 ceph-osd[113847]: osd.0 pg_epoch: 14 pg[1.3( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=1 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Stray 2023-11-16T14:07:33.387 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:38 smithi067 ceph-osd[113847]: osd.0 pg_epoch: 14 pg[1.27( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=1 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Stray 2023-11-16T14:07:33.387 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:38 smithi067 ceph-osd[113847]: osd.0 pg_epoch: 14 pg[1.2d( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=1 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Stray 2023-11-16T14:07:33.387 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:38 smithi067 ceph-osd[113847]: osd.0 pg_epoch: 14 pg[1.20( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=1 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Stray 2023-11-16T14:07:33.387 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:38 smithi067 ceph-osd[113847]: osd.0 pg_epoch: 14 pg[1.33( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=1 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Stray 2023-11-16T14:07:33.387 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:38 smithi067 ceph-osd[113847]: osd.0 pg_epoch: 14 pg[1.16( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=1 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Stray 2023-11-16T14:07:33.387 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:38 smithi067 ceph-osd[113847]: osd.0 pg_epoch: 14 pg[1.d( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=1 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Stray 2023-11-16T14:07:33.387 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:38 smithi067 ceph-osd[113847]: osd.0 pg_epoch: 14 pg[1.13( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=1 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Stray 2023-11-16T14:07:33.388 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:38 smithi067 ceph-osd[113847]: osd.0 pg_epoch: 14 pg[1.f( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=1 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Stray 2023-11-16T14:07:33.388 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:38 smithi067 ceph-osd[113847]: osd.0 pg_epoch: 14 pg[1.1a( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=1 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Stray 2023-11-16T14:07:33.388 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:38 smithi067 ceph-osd[113847]: osd.0 pg_epoch: 14 pg[1.7( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=1 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Stray 2023-11-16T14:07:33.388 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:38 smithi067 ceph-osd[113847]: osd.0 pg_epoch: 14 pg[1.22( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=1 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Stray 2023-11-16T14:07:33.388 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:38 smithi067 ceph-osd[113847]: osd.0 pg_epoch: 14 pg[1.26( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=1 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Stray 2023-11-16T14:07:33.388 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:38 smithi067 ceph-osd[113847]: osd.0 pg_epoch: 14 pg[1.1e( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=1 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Stray 2023-11-16T14:07:33.388 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:38 smithi067 ceph-osd[113847]: osd.0 pg_epoch: 14 pg[1.b( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=1 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Stray 2023-11-16T14:07:33.388 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:38 smithi067 ceph-osd[113847]: osd.0 pg_epoch: 14 pg[1.c( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=1 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Stray 2023-11-16T14:07:33.388 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:38 smithi067 ceph-osd[113847]: osd.0 pg_epoch: 14 pg[1.4( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=1 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Stray 2023-11-16T14:07:33.389 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:38 smithi067 ceph-osd[113847]: osd.0 pg_epoch: 14 pg[1.e( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=1 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Stray 2023-11-16T14:07:33.389 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:38 smithi067 ceph-osd[113847]: osd.0 pg_epoch: 14 pg[1.8( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=1 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Stray 2023-11-16T14:07:33.389 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:38 smithi067 ceph-osd[113847]: osd.0 pg_epoch: 14 pg[1.0( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=1 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Stray 2023-11-16T14:07:33.389 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:38 smithi067 ceph-osd[113847]: osd.0 pg_epoch: 14 pg[1.6( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=1 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Stray 2023-11-16T14:07:33.389 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:38 smithi067 ceph-osd[113847]: osd.0 pg_epoch: 14 pg[1.3f( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=1 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Stray 2023-11-16T14:07:33.389 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:38 smithi067 ceph-osd[113847]: osd.0 pg_epoch: 14 pg[1.a( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=1 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Stray 2023-11-16T14:07:33.389 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:38 smithi067 ceph-osd[113847]: osd.0 pg_epoch: 14 pg[1.37( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=1 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Stray 2023-11-16T14:07:33.390 INFO:tasks.workunit.client.0.smithi067.stderr:+ for name in $names 2023-11-16T14:07:33.390 INFO:tasks.workunit.client.0.smithi067.stderr:+ dump_log 00000000-0000-0000-0000-0000deadbeef osd.1 2023-11-16T14:07:33.390 INFO:tasks.workunit.client.0.smithi067.stderr:+ local fsid=00000000-0000-0000-0000-0000deadbeef 2023-11-16T14:07:33.390 INFO:tasks.workunit.client.0.smithi067.stderr:+ local name=osd.1 2023-11-16T14:07:33.390 INFO:tasks.workunit.client.0.smithi067.stderr:+ local num_lines= 2023-11-16T14:07:33.390 INFO:tasks.workunit.client.0.smithi067.stderr:+ '[' -z ']' 2023-11-16T14:07:33.390 INFO:tasks.workunit.client.0.smithi067.stderr:+ num_lines=100 2023-11-16T14:07:33.390 INFO:tasks.workunit.client.0.smithi067.stdout:------------------------- 2023-11-16T14:07:33.391 INFO:tasks.workunit.client.0.smithi067.stderr:+ echo ------------------------- 2023-11-16T14:07:33.391 INFO:tasks.workunit.client.0.smithi067.stdout:dump daemon log: osd.1 2023-11-16T14:07:33.391 INFO:tasks.workunit.client.0.smithi067.stderr:+ echo 'dump daemon log:' osd.1 2023-11-16T14:07:33.391 INFO:tasks.workunit.client.0.smithi067.stderr:+ echo ------------------------- 2023-11-16T14:07:33.392 INFO:tasks.workunit.client.0.smithi067.stdout:------------------------- 2023-11-16T14:07:33.392 INFO:tasks.workunit.client.0.smithi067.stderr:+ sudo /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy logs --fsid 00000000-0000-0000-0000-0000deadbeef --name osd.1 -- --no-pager -n 100 2023-11-16T14:07:33.392 INFO:tasks.workunit.client.0.smithi067.stderr:Inferring config /var/lib/ceph/00000000-0000-0000-0000-0000deadbeef/osd.1/config 2023-11-16T14:07:33.393 INFO:tasks.workunit.client.0.smithi067.stdout:-- Logs begin at Thu 2023-11-16 13:39:45 UTC, end at Thu 2023-11-16 14:07:29 UTC. -- 2023-11-16T14:07:33.393 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:28 smithi067 ceph-osd[117539]: osd.1 0 crush map has features 288232575208783872, adjusting msgr requires for osds 2023-11-16T14:07:33.393 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:28 smithi067 ceph-osd[117539]: osd.1 0 check_osdmap_features enabling on-disk ERASURE CODES compat feature 2023-11-16T14:07:33.393 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:28 smithi067 ceph-osd[117539]: osd.1 0 load_pgs 2023-11-16T14:07:33.393 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:28 smithi067 ceph-osd[117539]: osd.1 0 load_pgs opened 0 pgs 2023-11-16T14:07:33.393 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:28 smithi067 ceph-osd[117539]: osd.1 0 log_to_monitors true 2023-11-16T14:07:33.393 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:28 smithi067 conmon[117516]: 2023-11-16T14:03:28.631+0000 7fcc65191540 -1 osd.1 0 log_to_monitors true 2023-11-16T14:07:33.393 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:29 smithi067 ceph-osd[117539]: log_channel(cluster) log [DBG] : purged_snaps scrub starts 2023-11-16T14:07:33.394 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:29 smithi067 ceph-osd[117539]: log_channel(cluster) log [DBG] : purged_snaps scrub ok 2023-11-16T14:07:33.394 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:30 smithi067 ceph-osd[117539]: osd.1 0 done with init, starting boot process 2023-11-16T14:07:33.394 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:30 smithi067 ceph-osd[117539]: osd.1 0 start_boot 2023-11-16T14:07:33.394 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:30 smithi067 ceph-osd[117539]: osd.1 0 maybe_override_options_for_qos osd_max_backfills set to 1 2023-11-16T14:07:33.394 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:30 smithi067 ceph-osd[117539]: osd.1 0 maybe_override_options_for_qos osd_recovery_max_active set to 0 2023-11-16T14:07:33.394 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:30 smithi067 ceph-osd[117539]: osd.1 0 maybe_override_options_for_qos osd_recovery_max_active_hdd set to 3 2023-11-16T14:07:33.394 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:30 smithi067 ceph-osd[117539]: osd.1 0 maybe_override_options_for_qos osd_recovery_max_active_ssd set to 10 2023-11-16T14:07:33.394 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:30 smithi067 ceph-osd[117539]: osd.1 0 bench count 12288000 bsize 4 KiB 2023-11-16T14:07:33.394 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:57 smithi067 ceph-osd[117539]: osd.1 0 maybe_override_max_osd_capacity_for_qos osd bench result - bandwidth (MiB/sec): 0.994 iops: 254.494 elapsed_sec: 11.788 2023-11-16T14:07:33.394 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:57 smithi067 ceph-osd[117539]: osd.1 0 waiting for initial osdmap 2023-11-16T14:07:33.394 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:57 smithi067 conmon[117516]: 2023-11-16T14:03:57.224+0000 7fcc5b976700 -1 osd.1 0 waiting for initial osdmap 2023-11-16T14:07:33.394 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:57 smithi067 ceph-osd[117539]: mClockScheduler: set_osd_capacity_params_from_config: osd_bandwidth_cost_per_io: 618034.60 bytes/io, osd_bandwidth_capacity_per_shard 31457280.00 bytes/second 2023-11-16T14:07:33.395 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:57 smithi067 ceph-osd[117539]: mClockScheduler: set_osd_capacity_params_from_config: osd_bandwidth_cost_per_io: 618034.60 bytes/io, osd_bandwidth_capacity_per_shard 31457280.00 bytes/second 2023-11-16T14:07:33.395 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:57 smithi067 ceph-osd[117539]: mClockScheduler: set_osd_capacity_params_from_config: osd_bandwidth_cost_per_io: 618034.60 bytes/io, osd_bandwidth_capacity_per_shard 31457280.00 bytes/second 2023-11-16T14:07:33.395 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:57 smithi067 ceph-osd[117539]: mClockScheduler: set_osd_capacity_params_from_config: osd_bandwidth_cost_per_io: 618034.60 bytes/io, osd_bandwidth_capacity_per_shard 31457280.00 bytes/second 2023-11-16T14:07:33.395 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:57 smithi067 ceph-osd[117539]: mClockScheduler: set_osd_capacity_params_from_config: osd_bandwidth_cost_per_io: 618034.60 bytes/io, osd_bandwidth_capacity_per_shard 31457280.00 bytes/second 2023-11-16T14:07:33.395 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:57 smithi067 ceph-osd[117539]: osd.1 11 crush map has features 288514050185494528, adjusting msgr requires for clients 2023-11-16T14:07:33.395 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:57 smithi067 ceph-osd[117539]: osd.1 11 crush map has features 288514050185494528 was 288232575208792577, adjusting msgr requires for mons 2023-11-16T14:07:33.395 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:57 smithi067 ceph-osd[117539]: osd.1 11 crush map has features 3314932999778484224, adjusting msgr requires for osds 2023-11-16T14:07:33.395 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:57 smithi067 ceph-osd[117539]: osd.1 11 check_osdmap_features require_osd_release unknown -> quincy 2023-11-16T14:07:33.395 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:57 smithi067 ceph-osd[117539]: osd.1 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-16T14:07:33.395 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:57 smithi067 ceph-osd[117539]: osd.1 11 set_numa_affinity not setting numa affinity 2023-11-16T14:07:33.395 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:57 smithi067 conmon[117516]: 2023-11-16T14:03:57.283+0000 7fcc55f70700 -1 osd.1 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-16T14:07:33.395 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:57 smithi067 ceph-osd[117539]: osd.1 11 _collect_metadata loop0: no unique device id for loop0: fallback method has no model nor serial 2023-11-16T14:07:33.396 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:58 smithi067 ceph-osd[117539]: osd.1 11 tick checking mon for new map 2023-11-16T14:07:33.396 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:58 smithi067 ceph-osd[117539]: osd.1 12 state: booting -> active 2023-11-16T14:07:33.396 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[117539]: osd.1 14 crush map has features 288514051259236352, adjusting msgr requires for clients 2023-11-16T14:07:33.396 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[117539]: osd.1 14 crush map has features 288514051259236352 was 288514050185503233, adjusting msgr requires for mons 2023-11-16T14:07:33.396 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[117539]: osd.1 14 crush map has features 3314933000852226048, adjusting msgr requires for osds 2023-11-16T14:07:33.396 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[117539]: osd.1 pg_epoch: 14 pg[1.3e( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=0 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Primary 2023-11-16T14:07:33.396 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[117539]: osd.1 pg_epoch: 14 pg[1.1d( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=0 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Primary 2023-11-16T14:07:33.396 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[117539]: osd.1 pg_epoch: 14 pg[1.19( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=0 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Primary 2023-11-16T14:07:33.396 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[117539]: osd.1 pg_epoch: 14 pg[1.33( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=0 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Primary 2023-11-16T14:07:33.396 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[117539]: osd.1 pg_epoch: 14 pg[1.2b( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=0 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Primary 2023-11-16T14:07:33.396 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[117539]: osd.1 pg_epoch: 14 pg[1.25( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=0 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Primary 2023-11-16T14:07:33.396 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[117539]: osd.1 pg_epoch: 14 pg[1.14( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=0 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Primary 2023-11-16T14:07:33.396 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[117539]: osd.1 pg_epoch: 14 pg[1.26( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=0 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Primary 2023-11-16T14:07:33.397 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[117539]: osd.1 pg_epoch: 14 pg[1.5( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=0 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Primary 2023-11-16T14:07:33.397 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[117539]: osd.1 pg_epoch: 14 pg[1.2e( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=0 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Primary 2023-11-16T14:07:33.397 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[117539]: osd.1 pg_epoch: 14 pg[1.21( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=0 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Primary 2023-11-16T14:07:33.397 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[117539]: osd.1 pg_epoch: 14 pg[1.18( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=0 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Primary 2023-11-16T14:07:33.397 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[117539]: osd.1 pg_epoch: 14 pg[1.f( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=0 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Primary 2023-11-16T14:07:33.397 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[117539]: osd.1 pg_epoch: 14 pg[1.d( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=0 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Primary 2023-11-16T14:07:33.397 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[117539]: osd.1 pg_epoch: 14 pg[1.1e( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=0 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Primary 2023-11-16T14:07:33.397 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[117539]: osd.1 pg_epoch: 14 pg[1.9( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=0 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Primary 2023-11-16T14:07:33.397 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[117539]: osd.1 pg_epoch: 14 pg[1.1a( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=0 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Primary 2023-11-16T14:07:33.398 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[117539]: osd.1 pg_epoch: 14 pg[1.3( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=0 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Primary 2023-11-16T14:07:33.398 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[117539]: osd.1 pg_epoch: 14 pg[1.20( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=0 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Primary 2023-11-16T14:07:33.398 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[117539]: osd.1 pg_epoch: 14 pg[1.0( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=0 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Primary 2023-11-16T14:07:33.398 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[117539]: osd.1 pg_epoch: 14 pg[1.13( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=0 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Primary 2023-11-16T14:07:33.398 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[117539]: osd.1 pg_epoch: 14 pg[1.8( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=0 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Primary 2023-11-16T14:07:33.398 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[117539]: osd.1 pg_epoch: 14 pg[1.b( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=0 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Primary 2023-11-16T14:07:33.398 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[117539]: osd.1 pg_epoch: 14 pg[1.16( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=0 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Primary 2023-11-16T14:07:33.398 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[117539]: osd.1 pg_epoch: 14 pg[1.22( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=0 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Primary 2023-11-16T14:07:33.398 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[117539]: osd.1 pg_epoch: 14 pg[1.7( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=0 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Primary 2023-11-16T14:07:33.398 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[117539]: osd.1 pg_epoch: 14 pg[1.15( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=0 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Primary 2023-11-16T14:07:33.399 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[117539]: osd.1 pg_epoch: 14 pg[1.4( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=0 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Primary 2023-11-16T14:07:33.399 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[117539]: osd.1 pg_epoch: 14 pg[1.a( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=0 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Primary 2023-11-16T14:07:33.399 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[117539]: osd.1 pg_epoch: 14 pg[1.c( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=0 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Primary 2023-11-16T14:07:33.399 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[117539]: osd.1 pg_epoch: 14 pg[1.6( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=0 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Primary 2023-11-16T14:07:33.399 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[117539]: osd.1 pg_epoch: 14 pg[1.e( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=0 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Primary 2023-11-16T14:07:33.399 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[117539]: osd.1 pg_epoch: 14 pg[1.2d( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=0 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Primary 2023-11-16T14:07:33.399 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[117539]: osd.1 pg_epoch: 14 pg[1.38( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=0 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Primary 2023-11-16T14:07:33.399 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[117539]: osd.1 pg_epoch: 14 pg[1.37( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=0 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Primary 2023-11-16T14:07:33.399 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[117539]: osd.1 pg_epoch: 14 pg[1.27( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=0 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Primary 2023-11-16T14:07:33.399 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:37 smithi067 ceph-osd[117539]: osd.1 pg_epoch: 14 pg[1.3f( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [1,0] r=0 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Primary 2023-11-16T14:07:33.399 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:38 smithi067 ceph-osd[117539]: osd.1 pg_epoch: 14 pg[1.34( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [0,1] r=1 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Stray 2023-11-16T14:07:33.399 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:38 smithi067 ceph-osd[117539]: osd.1 pg_epoch: 14 pg[1.3a( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [0,1] r=1 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Stray 2023-11-16T14:07:33.399 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:38 smithi067 ceph-osd[117539]: osd.1 pg_epoch: 14 pg[1.2f( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [0,1] r=1 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Stray 2023-11-16T14:07:33.400 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:38 smithi067 ceph-osd[117539]: osd.1 pg_epoch: 14 pg[1.35( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [0,1] r=1 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Stray 2023-11-16T14:07:33.400 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:38 smithi067 ceph-osd[117539]: osd.1 pg_epoch: 14 pg[1.30( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [0,1] r=1 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Stray 2023-11-16T14:07:33.400 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:38 smithi067 ceph-osd[117539]: osd.1 pg_epoch: 14 pg[1.12( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [0,1] r=1 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Stray 2023-11-16T14:07:33.400 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:38 smithi067 ceph-osd[117539]: osd.1 pg_epoch: 14 pg[1.2c( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [0,1] r=1 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Stray 2023-11-16T14:07:33.400 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:38 smithi067 ceph-osd[117539]: osd.1 pg_epoch: 14 pg[1.3b( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [0,1] r=1 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Stray 2023-11-16T14:07:33.400 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:38 smithi067 ceph-osd[117539]: osd.1 pg_epoch: 14 pg[1.36( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [0,1] r=1 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Stray 2023-11-16T14:07:33.400 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:38 smithi067 ceph-osd[117539]: osd.1 pg_epoch: 14 pg[1.3d( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [0,1] r=1 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Stray 2023-11-16T14:07:33.400 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:38 smithi067 ceph-osd[117539]: osd.1 pg_epoch: 14 pg[1.28( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [0,1] r=1 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Stray 2023-11-16T14:07:33.400 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:38 smithi067 ceph-osd[117539]: osd.1 pg_epoch: 14 pg[1.2a( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [0,1] r=1 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Stray 2023-11-16T14:07:33.400 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:38 smithi067 ceph-osd[117539]: osd.1 pg_epoch: 14 pg[1.29( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [0,1] r=1 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Stray 2023-11-16T14:07:33.400 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:38 smithi067 ceph-osd[117539]: osd.1 pg_epoch: 14 pg[1.3c( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [0,1] r=1 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Stray 2023-11-16T14:07:33.401 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:38 smithi067 ceph-osd[117539]: osd.1 pg_epoch: 14 pg[1.1b( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [0,1] r=1 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Stray 2023-11-16T14:07:33.401 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:38 smithi067 ceph-osd[117539]: osd.1 pg_epoch: 14 pg[1.1c( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [0,1] r=1 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Stray 2023-11-16T14:07:33.401 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:38 smithi067 ceph-osd[117539]: osd.1 pg_epoch: 14 pg[1.24( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [0,1] r=1 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Stray 2023-11-16T14:07:33.401 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:38 smithi067 ceph-osd[117539]: osd.1 pg_epoch: 14 pg[1.2( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [0,1] r=1 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Stray 2023-11-16T14:07:33.401 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:38 smithi067 ceph-osd[117539]: osd.1 pg_epoch: 14 pg[1.1f( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [0,1] r=1 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Stray 2023-11-16T14:07:33.401 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:38 smithi067 ceph-osd[117539]: osd.1 pg_epoch: 14 pg[1.31( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [0,1] r=1 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Stray 2023-11-16T14:07:33.401 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:38 smithi067 ceph-osd[117539]: osd.1 pg_epoch: 14 pg[1.1( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [0,1] r=1 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Stray 2023-11-16T14:07:33.401 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:38 smithi067 ceph-osd[117539]: osd.1 pg_epoch: 14 pg[1.10( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [0,1] r=1 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Stray 2023-11-16T14:07:33.401 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:38 smithi067 ceph-osd[117539]: osd.1 pg_epoch: 14 pg[1.11( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [0,1] r=1 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Stray 2023-11-16T14:07:33.401 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:38 smithi067 ceph-osd[117539]: osd.1 pg_epoch: 14 pg[1.39( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [0,1] r=1 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Stray 2023-11-16T14:07:33.401 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:38 smithi067 ceph-osd[117539]: osd.1 pg_epoch: 14 pg[1.17( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [0,1] r=1 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Stray 2023-11-16T14:07:33.402 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:38 smithi067 ceph-osd[117539]: osd.1 pg_epoch: 14 pg[1.32( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [0,1] r=1 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Stray 2023-11-16T14:07:33.402 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:38 smithi067 ceph-osd[117539]: osd.1 pg_epoch: 14 pg[1.23( empty local-lis/les=0/0 n=0 ec=14/14 lis/c=0/0 les/c/f=0/0/0 sis=14) [0,1] r=1 lpr=14 crt=0'0 mlcod 0'0 unknown mbc={}] state: transitioning to Stray 2023-11-16T14:07:33.402 INFO:tasks.workunit.client.0.smithi067.stderr:+ for name in $names 2023-11-16T14:07:33.403 INFO:tasks.workunit.client.0.smithi067.stderr:+ dump_log 00000000-0000-0000-0000-0000deadbeef node-exporter.a 2023-11-16T14:07:33.403 INFO:tasks.workunit.client.0.smithi067.stderr:+ local fsid=00000000-0000-0000-0000-0000deadbeef 2023-11-16T14:07:33.403 INFO:tasks.workunit.client.0.smithi067.stderr:+ local name=node-exporter.a 2023-11-16T14:07:33.403 INFO:tasks.workunit.client.0.smithi067.stderr:+ local num_lines= 2023-11-16T14:07:33.403 INFO:tasks.workunit.client.0.smithi067.stderr:+ '[' -z ']' 2023-11-16T14:07:33.403 INFO:tasks.workunit.client.0.smithi067.stderr:+ num_lines=100 2023-11-16T14:07:33.403 INFO:tasks.workunit.client.0.smithi067.stderr:+ echo ------------------------- 2023-11-16T14:07:33.403 INFO:tasks.workunit.client.0.smithi067.stdout:------------------------- 2023-11-16T14:07:33.403 INFO:tasks.workunit.client.0.smithi067.stderr:+ echo 'dump daemon log:' node-exporter.a 2023-11-16T14:07:33.404 INFO:tasks.workunit.client.0.smithi067.stdout:dump daemon log: node-exporter.a 2023-11-16T14:07:33.404 INFO:tasks.workunit.client.0.smithi067.stdout:------------------------- 2023-11-16T14:07:33.404 INFO:tasks.workunit.client.0.smithi067.stderr:+ echo ------------------------- 2023-11-16T14:07:33.404 INFO:tasks.workunit.client.0.smithi067.stderr:+ sudo /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy logs --fsid 00000000-0000-0000-0000-0000deadbeef --name node-exporter.a -- --no-pager -n 100 2023-11-16T14:07:33.405 INFO:tasks.workunit.client.0.smithi067.stderr:Inferring config /var/lib/ceph/00000000-0000-0000-0000-0000deadbeef/node-exporter.a/config 2023-11-16T14:07:33.405 INFO:tasks.workunit.client.0.smithi067.stdout:-- Logs begin at Thu 2023-11-16 13:39:45 UTC, end at Thu 2023-11-16 14:07:30 UTC. -- 2023-11-16T14:07:33.405 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:26 smithi067 systemd[1]: Starting Ceph node-exporter.a for 00000000-0000-0000-0000-0000deadbeef... 2023-11-16T14:07:33.405 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:26 smithi067 bash[117895]: Trying to pull quay.io/prometheus/node-exporter:v1.5.0... 2023-11-16T14:07:33.405 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:27 smithi067 bash[117895]: Getting image source signatures 2023-11-16T14:07:33.405 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:27 smithi067 bash[117895]: Copying blob sha256:22b70bddd3acadc892fca4c2af4260629bfda5dfd11ebc106a93ce24e752b5ed 2023-11-16T14:07:33.405 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:27 smithi067 bash[117895]: Copying blob sha256:5c12815fee558b157dee7f7509dedbaba0a8379098858a65ec869e1f1526ea0c 2023-11-16T14:07:33.406 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:27 smithi067 bash[117895]: Copying blob sha256:c0e87333d3805a7b7e1c25783dd25f27da0fe70a8e262eee7ed190c8dc843fa7 2023-11-16T14:07:33.406 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:27 smithi067 bash[117895]: Copying config sha256:0da6a335fe1356545476b749c68f022c897de3a2139e8f0054f6937349ee2b83 2023-11-16T14:07:33.406 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:27 smithi067 bash[117895]: Writing manifest to image destination 2023-11-16T14:07:33.406 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:27 smithi067 bash[117895]: Storing signatures 2023-11-16T14:07:33.406 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:29 smithi067 conmon[118402]: ts=2023-11-16T14:03:29.569Z caller=node_exporter.go:180 level=info msg="Starting node_exporter" version="(version=1.5.0, branch=HEAD, revision=1b48970ffcf5630534fb00bb0687d73c66d1c959)" 2023-11-16T14:07:33.406 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:29 smithi067 conmon[118402]: ts=2023-11-16T14:03:29.569Z caller=node_exporter.go:181 level=info msg="Build context" build_context="(go=go1.19.3, user=root@6e7732a7b81b, date=20221129-18:59:09)" 2023-11-16T14:07:33.406 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:29 smithi067 conmon[118402]: ts=2023-11-16T14:03:29.569Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2023-11-16T14:07:33.406 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:29 smithi067 conmon[118402]: ts=2023-11-16T14:03:29.569Z caller=diskstats_linux.go:264 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2023-11-16T14:07:33.406 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:29 smithi067 conmon[118402]: ts=2023-11-16T14:03:29.569Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2023-11-16T14:07:33.406 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:29 smithi067 conmon[118402]: ts=2023-11-16T14:03:29.569Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2023-11-16T14:07:33.406 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:29 smithi067 conmon[118402]: ts=2023-11-16T14:03:29.570Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2023-11-16T14:07:33.406 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:29 smithi067 conmon[118402]: ts=2023-11-16T14:03:29.570Z caller=node_exporter.go:117 level=info collector=arp 2023-11-16T14:07:33.407 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:29 smithi067 conmon[118402]: ts=2023-11-16T14:03:29.570Z caller=node_exporter.go:117 level=info collector=bcache 2023-11-16T14:07:33.407 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:29 smithi067 conmon[118402]: ts=2023-11-16T14:03:29.570Z caller=node_exporter.go:117 level=info collector=bonding 2023-11-16T14:07:33.407 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:29 smithi067 conmon[118402]: ts=2023-11-16T14:03:29.570Z caller=node_exporter.go:117 level=info collector=btrfs 2023-11-16T14:07:33.407 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:29 smithi067 conmon[118402]: ts=2023-11-16T14:03:29.570Z caller=node_exporter.go:117 level=info collector=conntrack 2023-11-16T14:07:33.407 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:29 smithi067 conmon[118402]: ts=2023-11-16T14:03:29.570Z caller=node_exporter.go:117 level=info collector=cpu 2023-11-16T14:07:33.407 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:29 smithi067 conmon[118402]: ts=2023-11-16T14:03:29.570Z caller=node_exporter.go:117 level=info collector=cpufreq 2023-11-16T14:07:33.407 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:29 smithi067 conmon[118402]: ts=2023-11-16T14:03:29.570Z caller=node_exporter.go:117 level=info collector=diskstats 2023-11-16T14:07:33.407 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:29 smithi067 conmon[118402]: ts=2023-11-16T14:03:29.570Z caller=node_exporter.go:117 level=info collector=dmi 2023-11-16T14:07:33.407 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:29 smithi067 conmon[118402]: ts=2023-11-16T14:03:29.570Z caller=node_exporter.go:117 level=info collector=edac 2023-11-16T14:07:33.408 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:29 smithi067 conmon[118402]: ts=2023-11-16T14:03:29.570Z caller=node_exporter.go:117 level=info collector=entropy 2023-11-16T14:07:33.408 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:29 smithi067 conmon[118402]: ts=2023-11-16T14:03:29.570Z caller=node_exporter.go:117 level=info collector=fibrechannel 2023-11-16T14:07:33.408 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:29 smithi067 conmon[118402]: ts=2023-11-16T14:03:29.570Z caller=node_exporter.go:117 level=info collector=filefd 2023-11-16T14:07:33.408 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:29 smithi067 conmon[118402]: ts=2023-11-16T14:03:29.570Z caller=node_exporter.go:117 level=info collector=filesystem 2023-11-16T14:07:33.408 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:29 smithi067 conmon[118402]: ts=2023-11-16T14:03:29.570Z caller=node_exporter.go:117 level=info collector=hwmon 2023-11-16T14:07:33.408 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:29 smithi067 conmon[118402]: ts=2023-11-16T14:03:29.570Z caller=node_exporter.go:117 level=info collector=infiniband 2023-11-16T14:07:33.408 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:29 smithi067 conmon[118402]: ts=2023-11-16T14:03:29.570Z caller=node_exporter.go:117 level=info collector=ipvs 2023-11-16T14:07:33.408 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:29 smithi067 conmon[118402]: ts=2023-11-16T14:03:29.570Z caller=node_exporter.go:117 level=info collector=loadavg 2023-11-16T14:07:33.408 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:29 smithi067 conmon[118402]: ts=2023-11-16T14:03:29.570Z caller=node_exporter.go:117 level=info collector=mdadm 2023-11-16T14:07:33.408 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:29 smithi067 conmon[118402]: ts=2023-11-16T14:03:29.570Z caller=node_exporter.go:117 level=info collector=meminfo 2023-11-16T14:07:33.408 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:29 smithi067 conmon[118402]: ts=2023-11-16T14:03:29.570Z caller=node_exporter.go:117 level=info collector=netclass 2023-11-16T14:07:33.409 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:29 smithi067 conmon[118402]: ts=2023-11-16T14:03:29.570Z caller=node_exporter.go:117 level=info collector=netdev 2023-11-16T14:07:33.409 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:29 smithi067 conmon[118402]: ts=2023-11-16T14:03:29.570Z caller=node_exporter.go:117 level=info collector=netstat 2023-11-16T14:07:33.409 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:29 smithi067 conmon[118402]: ts=2023-11-16T14:03:29.570Z caller=node_exporter.go:117 level=info collector=nfs 2023-11-16T14:07:33.409 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:29 smithi067 conmon[118402]: ts=2023-11-16T14:03:29.570Z caller=node_exporter.go:117 level=info collector=nfsd 2023-11-16T14:07:33.409 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:29 smithi067 conmon[118402]: ts=2023-11-16T14:03:29.570Z caller=node_exporter.go:117 level=info collector=nvme 2023-11-16T14:07:33.409 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:29 smithi067 conmon[118402]: ts=2023-11-16T14:03:29.570Z caller=node_exporter.go:117 level=info collector=os 2023-11-16T14:07:33.409 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:29 smithi067 conmon[118402]: ts=2023-11-16T14:03:29.570Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2023-11-16T14:07:33.409 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:29 smithi067 conmon[118402]: ts=2023-11-16T14:03:29.570Z caller=node_exporter.go:117 level=info collector=pressure 2023-11-16T14:07:33.409 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:29 smithi067 conmon[118402]: ts=2023-11-16T14:03:29.570Z caller=node_exporter.go:117 level=info collector=rapl 2023-11-16T14:07:33.409 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:29 smithi067 conmon[118402]: ts=2023-11-16T14:03:29.570Z caller=node_exporter.go:117 level=info collector=schedstat 2023-11-16T14:07:33.409 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:29 smithi067 conmon[118402]: ts=2023-11-16T14:03:29.570Z caller=node_exporter.go:117 level=info collector=selinux 2023-11-16T14:07:33.409 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:29 smithi067 conmon[118402]: ts=2023-11-16T14:03:29.570Z caller=node_exporter.go:117 level=info collector=sockstat 2023-11-16T14:07:33.409 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:29 smithi067 conmon[118402]: ts=2023-11-16T14:03:29.570Z caller=node_exporter.go:117 level=info collector=softnet 2023-11-16T14:07:33.410 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:29 smithi067 conmon[118402]: ts=2023-11-16T14:03:29.570Z caller=node_exporter.go:117 level=info collector=stat 2023-11-16T14:07:33.410 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:29 smithi067 conmon[118402]: ts=2023-11-16T14:03:29.570Z caller=node_exporter.go:117 level=info collector=tapestats 2023-11-16T14:07:33.410 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:29 smithi067 conmon[118402]: ts=2023-11-16T14:03:29.570Z caller=node_exporter.go:117 level=info collector=textfile 2023-11-16T14:07:33.410 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:29 smithi067 conmon[118402]: ts=2023-11-16T14:03:29.570Z caller=node_exporter.go:117 level=info collector=thermal_zone 2023-11-16T14:07:33.410 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:29 smithi067 conmon[118402]: ts=2023-11-16T14:03:29.570Z caller=node_exporter.go:117 level=info collector=time 2023-11-16T14:07:33.410 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:29 smithi067 conmon[118402]: ts=2023-11-16T14:03:29.570Z caller=node_exporter.go:117 level=info collector=udp_queues 2023-11-16T14:07:33.410 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:29 smithi067 conmon[118402]: ts=2023-11-16T14:03:29.570Z caller=node_exporter.go:117 level=info collector=uname 2023-11-16T14:07:33.410 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:29 smithi067 conmon[118402]: ts=2023-11-16T14:03:29.570Z caller=node_exporter.go:117 level=info collector=vmstat 2023-11-16T14:07:33.410 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:29 smithi067 conmon[118402]: ts=2023-11-16T14:03:29.570Z caller=node_exporter.go:117 level=info collector=xfs 2023-11-16T14:07:33.410 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:29 smithi067 conmon[118402]: ts=2023-11-16T14:03:29.570Z caller=node_exporter.go:117 level=info collector=zfs 2023-11-16T14:07:33.410 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:29 smithi067 conmon[118402]: ts=2023-11-16T14:03:29.571Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9100 2023-11-16T14:07:33.410 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:29 smithi067 conmon[118402]: ts=2023-11-16T14:03:29.571Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9100 2023-11-16T14:07:33.410 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:29 smithi067 bash[117895]: 981be0ce7f12e24eb1eb0e13da375ed93f0a67e1e8d30344db516cf47c92259a 2023-11-16T14:07:33.411 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:29 smithi067 systemd[1]: Started Ceph node-exporter.a for 00000000-0000-0000-0000-0000deadbeef. 2023-11-16T14:07:33.413 INFO:tasks.workunit.client.0.smithi067.stderr:+ for name in $names 2023-11-16T14:07:33.413 INFO:tasks.workunit.client.0.smithi067.stderr:+ dump_log 00000000-0000-0000-0000-0000deadbeef prometheus.a 2023-11-16T14:07:33.413 INFO:tasks.workunit.client.0.smithi067.stderr:+ local fsid=00000000-0000-0000-0000-0000deadbeef 2023-11-16T14:07:33.413 INFO:tasks.workunit.client.0.smithi067.stderr:+ local name=prometheus.a 2023-11-16T14:07:33.413 INFO:tasks.workunit.client.0.smithi067.stderr:+ local num_lines= 2023-11-16T14:07:33.413 INFO:tasks.workunit.client.0.smithi067.stderr:+ '[' -z ']' 2023-11-16T14:07:33.413 INFO:tasks.workunit.client.0.smithi067.stderr:+ num_lines=100 2023-11-16T14:07:33.414 INFO:tasks.workunit.client.0.smithi067.stderr:+ echo ------------------------- 2023-11-16T14:07:33.414 INFO:tasks.workunit.client.0.smithi067.stdout:------------------------- 2023-11-16T14:07:33.415 INFO:tasks.workunit.client.0.smithi067.stdout:dump daemon log: prometheus.a 2023-11-16T14:07:33.415 INFO:tasks.workunit.client.0.smithi067.stdout:------------------------- 2023-11-16T14:07:33.415 INFO:tasks.workunit.client.0.smithi067.stderr:+ echo 'dump daemon log:' prometheus.a 2023-11-16T14:07:33.415 INFO:tasks.workunit.client.0.smithi067.stderr:+ echo ------------------------- 2023-11-16T14:07:33.415 INFO:tasks.workunit.client.0.smithi067.stderr:+ sudo /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy logs --fsid 00000000-0000-0000-0000-0000deadbeef --name prometheus.a -- --no-pager -n 100 2023-11-16T14:07:33.415 INFO:tasks.workunit.client.0.smithi067.stderr:Inferring config /var/lib/ceph/00000000-0000-0000-0000-0000deadbeef/prometheus.a/config 2023-11-16T14:07:33.416 INFO:tasks.workunit.client.0.smithi067.stdout:-- Logs begin at Thu 2023-11-16 13:39:45 UTC, end at Thu 2023-11-16 14:07:30 UTC. -- 2023-11-16T14:07:33.416 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:50 smithi067 systemd[1]: Starting Ceph prometheus.a for 00000000-0000-0000-0000-0000deadbeef... 2023-11-16T14:07:33.416 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:51 smithi067 conmon[119172]: ts=2023-11-16T14:03:51.916Z caller=main.go:564 level=info msg="Starting Prometheus Server" mode=server version="(version=2.43.0, branch=HEAD, revision=edfc3bcd025dd6fe296c167a14a216cab1e552ee)" 2023-11-16T14:07:33.416 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:51 smithi067 conmon[119172]: ts=2023-11-16T14:03:51.916Z caller=main.go:569 level=info build_context="(go=go1.19.7, platform=linux/amd64, user=root@8a0ee342e522, date=20230321-12:56:07, tags=netgo,builtinassets)" 2023-11-16T14:07:33.416 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:51 smithi067 conmon[119172]: ts=2023-11-16T14:03:51.916Z caller=main.go:570 level=info host_details="(Linux 4.18.0-425.3.1.el8.x86_64 #1 SMP Fri Sep 30 11:45:06 EDT 2022 x86_64 smithi067 (none))" 2023-11-16T14:07:33.416 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:51 smithi067 conmon[119172]: ts=2023-11-16T14:03:51.916Z caller=main.go:571 level=info fd_limits="(soft=1048576, hard=1048576)" 2023-11-16T14:07:33.416 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:51 smithi067 conmon[119172]: ts=2023-11-16T14:03:51.916Z caller=main.go:572 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2023-11-16T14:07:33.416 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:51 smithi067 conmon[119172]: ts=2023-11-16T14:03:51.917Z caller=web.go:561 level=info component=web msg="Start listening for connections" address=:9095 2023-11-16T14:07:33.416 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:51 smithi067 conmon[119172]: ts=2023-11-16T14:03:51.918Z caller=main.go:1005 level=info msg="Starting TSDB ..." 2023-11-16T14:07:33.417 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:51 smithi067 conmon[119172]: ts=2023-11-16T14:03:51.919Z caller=tls_config.go:232 level=info component=web msg="Listening on" address=[::]:9095 2023-11-16T14:07:33.417 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:51 smithi067 conmon[119172]: ts=2023-11-16T14:03:51.919Z caller=tls_config.go:235 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2023-11-16T14:07:33.417 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:51 smithi067 conmon[119172]: ts=2023-11-16T14:03:51.921Z caller=head.go:587 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2023-11-16T14:07:33.417 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:51 smithi067 conmon[119172]: ts=2023-11-16T14:03:51.921Z caller=head.go:658 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=1.894µs 2023-11-16T14:07:33.417 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:51 smithi067 conmon[119172]: ts=2023-11-16T14:03:51.921Z caller=head.go:664 level=info component=tsdb msg="Replaying WAL, this may take a while" 2023-11-16T14:07:33.417 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:51 smithi067 conmon[119172]: ts=2023-11-16T14:03:51.922Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=0 2023-11-16T14:07:33.417 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:51 smithi067 conmon[119172]: ts=2023-11-16T14:03:51.922Z caller=head.go:772 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=25.785µs wal_replay_duration=281.961µs wbl_replay_duration=123ns total_replay_duration=327.134µs 2023-11-16T14:07:33.417 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:51 smithi067 conmon[119172]: ts=2023-11-16T14:03:51.922Z caller=main.go:1026 level=info fs_type=XFS_SUPER_MAGIC 2023-11-16T14:07:33.417 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:51 smithi067 conmon[119172]: ts=2023-11-16T14:03:51.922Z caller=main.go:1029 level=info msg="TSDB started" 2023-11-16T14:07:33.417 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:51 smithi067 conmon[119172]: ts=2023-11-16T14:03:51.923Z caller=main.go:1209 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2023-11-16T14:07:33.417 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:51 smithi067 conmon[119172]: ts=2023-11-16T14:03:51.923Z caller=main.go:1246 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=768.315µs db_storage=862ns remote_storage=1.273µs web_handler=572ns query_engine=704ns scrape=514.991µs scrape_sd=21.451µs notify=1.217µs notify_sd=2.38µs rules=35.01µs tracing=20.566µs 2023-11-16T14:07:33.417 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:51 smithi067 conmon[119172]: ts=2023-11-16T14:03:51.923Z caller=main.go:990 level=info msg="Server is ready to receive web requests." 2023-11-16T14:07:33.418 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:51 smithi067 conmon[119172]: ts=2023-11-16T14:03:51.923Z caller=manager.go:974 level=info component="rule manager" msg="Starting rule manager..." 2023-11-16T14:07:33.418 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:52 smithi067 bash[119132]: a43136889e945cdf937dff4c9ebb6731b16831826d4018f76f489641c4d59ac7 2023-11-16T14:07:33.418 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:03:52 smithi067 systemd[1]: Started Ceph prometheus.a for 00000000-0000-0000-0000-0000deadbeef. 2023-11-16T14:07:33.419 INFO:tasks.workunit.client.0.smithi067.stderr:+ for name in $names 2023-11-16T14:07:33.419 INFO:tasks.workunit.client.0.smithi067.stderr:+ dump_log 00000000-0000-0000-0000-0000deadbeef grafana.a 2023-11-16T14:07:33.419 INFO:tasks.workunit.client.0.smithi067.stderr:+ local fsid=00000000-0000-0000-0000-0000deadbeef 2023-11-16T14:07:33.419 INFO:tasks.workunit.client.0.smithi067.stderr:+ local name=grafana.a 2023-11-16T14:07:33.419 INFO:tasks.workunit.client.0.smithi067.stderr:+ local num_lines= 2023-11-16T14:07:33.420 INFO:tasks.workunit.client.0.smithi067.stderr:+ '[' -z ']' 2023-11-16T14:07:33.420 INFO:tasks.workunit.client.0.smithi067.stderr:+ num_lines=100 2023-11-16T14:07:33.420 INFO:tasks.workunit.client.0.smithi067.stderr:+ echo ------------------------- 2023-11-16T14:07:33.420 INFO:tasks.workunit.client.0.smithi067.stdout:------------------------- 2023-11-16T14:07:33.420 INFO:tasks.workunit.client.0.smithi067.stdout:dump daemon log: grafana.a 2023-11-16T14:07:33.420 INFO:tasks.workunit.client.0.smithi067.stdout:------------------------- 2023-11-16T14:07:33.421 INFO:tasks.workunit.client.0.smithi067.stderr:+ echo 'dump daemon log:' grafana.a 2023-11-16T14:07:33.421 INFO:tasks.workunit.client.0.smithi067.stderr:+ echo ------------------------- 2023-11-16T14:07:33.421 INFO:tasks.workunit.client.0.smithi067.stderr:+ sudo /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy logs --fsid 00000000-0000-0000-0000-0000deadbeef --name grafana.a -- --no-pager -n 100 2023-11-16T14:07:33.421 INFO:tasks.workunit.client.0.smithi067.stderr:Inferring config /var/lib/ceph/00000000-0000-0000-0000-0000deadbeef/grafana.a/config 2023-11-16T14:07:33.423 INFO:tasks.workunit.client.0.smithi067.stdout:-- Logs begin at Thu 2023-11-16 13:39:45 UTC, end at Thu 2023-11-16 14:07:30 UTC. -- 2023-11-16T14:07:33.423 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:28 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:28.045065441Z level=info msg="Executing migration" id="create builtin role table" 2023-11-16T14:07:33.423 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:28 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:28.070179806Z level=info msg="Executing migration" id="add index builtin_role.role_id" 2023-11-16T14:07:33.423 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:28 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:28.153692355Z level=info msg="Executing migration" id="add index builtin_role.name" 2023-11-16T14:07:33.423 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:28 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:28.178838806Z level=info msg="Executing migration" id="Add column org_id to builtin_role table" 2023-11-16T14:07:33.423 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:28 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:28.203818463Z level=info msg="Executing migration" id="add index builtin_role.org_id" 2023-11-16T14:07:33.424 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:28 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:28.246026414Z level=info msg="Executing migration" id="add unique index builtin_role_org_id_role_id_role" 2023-11-16T14:07:33.424 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:28 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:28.271089804Z level=info msg="Executing migration" id="Remove unique index role_org_id_uid" 2023-11-16T14:07:33.424 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:28 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:28.296133236Z level=info msg="Executing migration" id="add unique index role.uid" 2023-11-16T14:07:33.424 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:28 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:28.321215116Z level=info msg="Executing migration" id="create seed assignment table" 2023-11-16T14:07:33.424 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:28 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:28.413234515Z level=info msg="Executing migration" id="add unique index builtin_role_role_name" 2023-11-16T14:07:33.424 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:28 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:28.438475586Z level=info msg="Executing migration" id="add column hidden to role table" 2023-11-16T14:07:33.424 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:28 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:28.463504728Z level=info msg="Executing migration" id="create query_history table v1" 2023-11-16T14:07:33.424 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:28 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:28.488955167Z level=info msg="Executing migration" id="add index query_history.org_id-created_by-datasource_uid" 2023-11-16T14:07:33.424 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:28 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:28.513946314Z level=info msg="Executing migration" id="alter table query_history alter column created_by type to bigint" 2023-11-16T14:07:33.424 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:28 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:28.555739263Z level=info msg="Executing migration" id="teams permissions migration" 2023-11-16T14:07:33.424 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:28 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:28.580952311Z level=info msg="Executing migration" id="dashboard permissions" 2023-11-16T14:07:33.424 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:28 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:28.664743125Z level=info msg="Executing migration" id="dashboard permissions uid scopes" 2023-11-16T14:07:33.425 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:28 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:28.689965256Z level=info msg="Executing migration" id="drop managed folder create actions" 2023-11-16T14:07:33.425 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:28 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:28.714984578Z level=info msg="Executing migration" id="alerting notification permissions" 2023-11-16T14:07:33.425 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:28 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:28.757044585Z level=info msg="Executing migration" id="create query_history_star table v1" 2023-11-16T14:07:33.425 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:28 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:28.782144935Z level=info msg="Executing migration" id="add index query_history.user_id-query_uid" 2023-11-16T14:07:33.425 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:28 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:28.807405255Z level=info msg="Executing migration" id="add column org_id in query_history_star" 2023-11-16T14:07:33.425 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:28 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:28.832570469Z level=info msg="Executing migration" id="alter table query_history_star_mig column user_id type to bigint" 2023-11-16T14:07:33.425 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:28 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:28.924417272Z level=info msg="Executing migration" id="create correlation table v1" 2023-11-16T14:07:33.425 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:28 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:28.949611021Z level=info msg="Executing migration" id="add index correlations.uid" 2023-11-16T14:07:33.425 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:28 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:28.974900573Z level=info msg="Executing migration" id="add index correlations.source_uid" 2023-11-16T14:07:33.425 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:29 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:29.000324712Z level=info msg="Executing migration" id="add correlation config column" 2023-11-16T14:07:33.425 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:29 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:29.02519071Z level=info msg="Executing migration" id="create entity_events table" 2023-11-16T14:07:33.425 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:29 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:29.050656618Z level=info msg="Executing migration" id="create dashboard public config v1" 2023-11-16T14:07:33.426 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:29 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:29.075809334Z level=info msg="Executing migration" id="drop index UQE_dashboard_public_config_uid - v1" 2023-11-16T14:07:33.426 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:29 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:29.075951278Z level=warn msg="Skipping migration: Already executed, but not recorded in migration log" id="drop index UQE_dashboard_public_config_uid - v1" 2023-11-16T14:07:33.426 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:29 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:29.167666082Z level=info msg="Executing migration" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v1" 2023-11-16T14:07:33.426 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:29 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:29.167813866Z level=warn msg="Skipping migration: Already executed, but not recorded in migration log" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v1" 2023-11-16T14:07:33.426 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:29 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:29.201081181Z level=info msg="Executing migration" id="Drop old dashboard public config table" 2023-11-16T14:07:33.426 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:29 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:29.23434935Z level=info msg="Executing migration" id="recreate dashboard public config v1" 2023-11-16T14:07:33.426 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:29 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:29.284774133Z level=info msg="Executing migration" id="create index UQE_dashboard_public_config_uid - v1" 2023-11-16T14:07:33.426 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:29 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:29.318302422Z level=info msg="Executing migration" id="create index IDX_dashboard_public_config_org_id_dashboard_uid - v1" 2023-11-16T14:07:33.426 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:29 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:29.401853575Z level=info msg="Executing migration" id="drop index UQE_dashboard_public_config_uid - v2" 2023-11-16T14:07:33.426 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:29 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:29.43529905Z level=info msg="Executing migration" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v2" 2023-11-16T14:07:33.426 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:29 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:29.468877891Z level=info msg="Executing migration" id="Drop public config table" 2023-11-16T14:07:33.426 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:29 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:29.502438731Z level=info msg="Executing migration" id="Recreate dashboard public config v2" 2023-11-16T14:07:33.426 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:29 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:29.53578275Z level=info msg="Executing migration" id="create index UQE_dashboard_public_config_uid - v2" 2023-11-16T14:07:33.427 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:29 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:29.569245131Z level=info msg="Executing migration" id="create index IDX_dashboard_public_config_org_id_dashboard_uid - v2" 2023-11-16T14:07:33.427 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:29 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:29.661311233Z level=info msg="Executing migration" id="create index UQE_dashboard_public_config_access_token - v2" 2023-11-16T14:07:33.427 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:29 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:29.686510035Z level=info msg="Executing migration" id="Rename table dashboard_public_config to dashboard_public - v2" 2023-11-16T14:07:33.427 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:29 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:29.711469217Z level=info msg="Executing migration" id="add annotations_enabled column" 2023-11-16T14:07:33.427 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:29 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:29.736572652Z level=info msg="Executing migration" id="add time_selection_enabled column" 2023-11-16T14:07:33.427 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:29 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:29.76192297Z level=info msg="Executing migration" id="delete orphaned public dashboards" 2023-11-16T14:07:33.427 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:29 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:29.803927703Z level=info msg="Executing migration" id="add share column" 2023-11-16T14:07:33.427 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:29 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:29.829030798Z level=info msg="Executing migration" id="create default alerting folders" 2023-11-16T14:07:33.427 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:29 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:29.912577265Z level=info msg="Executing migration" id="create file table" 2023-11-16T14:07:33.427 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:29 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:29.937826275Z level=info msg="Executing migration" id="file table idx: path natural pk" 2023-11-16T14:07:33.427 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:29 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:29.962913262Z level=info msg="Executing migration" id="file table idx: parent_folder_path_hash fast folder retrieval" 2023-11-16T14:07:33.427 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:29 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:29.996591038Z level=info msg="Executing migration" id="create file_meta table" 2023-11-16T14:07:33.428 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:30 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:30.021690465Z level=info msg="Executing migration" id="file table idx: path key" 2023-11-16T14:07:33.428 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:30 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:30.055246544Z level=info msg="Executing migration" id="set path collation in file table" 2023-11-16T14:07:33.428 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:30 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:30.088916696Z level=info msg="Executing migration" id="managed permissions migration" 2023-11-16T14:07:33.428 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:30 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:30.180634961Z level=info msg="Executing migration" id="managed folder permissions alert actions migration" 2023-11-16T14:07:33.428 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:30 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:30.214053793Z level=info msg="Executing migration" id="RBAC action name migrator" 2023-11-16T14:07:33.428 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:30 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:30.247515075Z level=info msg="Executing migration" id="Add UID column to playlist" 2023-11-16T14:07:33.428 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:30 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:30.289688681Z level=info msg="Executing migration" id="Update uid column values in playlist" 2023-11-16T14:07:33.428 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:30 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:30.331892086Z level=info msg="Executing migration" id="Add index for uid in playlist" 2023-11-16T14:07:33.428 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:30 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:30.415221546Z level=info msg="Executing migration" id="update group index for alert rules" 2023-11-16T14:07:33.429 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:30 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:30.440330567Z level=info msg="Executing migration" id="managed folder permissions alert actions repeated migration" 2023-11-16T14:07:33.429 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:30 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:30.465557489Z level=info msg="Executing migration" id="admin only folder/dashboard permission" 2023-11-16T14:07:33.429 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:30 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:30.490726045Z level=info msg="Executing migration" id="add action column to seed_assignment" 2023-11-16T14:07:33.429 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:30 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:30.515938871Z level=info msg="Executing migration" id="add scope column to seed_assignment" 2023-11-16T14:07:33.429 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:30 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:30.557782768Z level=info msg="Executing migration" id="remove unique index builtin_role_role_name before nullable update" 2023-11-16T14:07:33.429 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:30 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:30.58296156Z level=info msg="Executing migration" id="update seed_assignment role_name column to nullable" 2023-11-16T14:07:33.430 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:30 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:30.674922179Z level=info msg="Executing migration" id="add unique index builtin_role_name back" 2023-11-16T14:07:33.430 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:30 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:30.700126252Z level=info msg="Executing migration" id="add unique index builtin_role_action_scope" 2023-11-16T14:07:33.430 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:30 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:30.725216234Z level=info msg="Executing migration" id="add primary key to seed_assigment" 2023-11-16T14:07:33.430 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:30 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:30.75028314Z level=info msg="Executing migration" id="managed folder permissions alert actions repeated fixed migration" 2023-11-16T14:07:33.430 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:30 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:30.775645412Z level=info msg="Executing migration" id="migrate external alertmanagers to datsourcse" 2023-11-16T14:07:33.430 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:30 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:30.800596857Z level=info msg="Executing migration" id="create folder table" 2023-11-16T14:07:33.430 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:30 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:30.825911549Z level=info msg="Executing migration" id="Add index for parent_uid" 2023-11-16T14:07:33.430 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:30 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:30.917865179Z level=info msg="Executing migration" id="Add unique index for folder.uid and folder.org_id" 2023-11-16T14:07:33.430 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:30 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:30.943131436Z level=info msg="Executing migration" id="Update folder title length" 2023-11-16T14:07:33.430 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:30 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:30.968234798Z level=info msg="Executing migration" id="Add unique index for folder.title and folder.parent_uid" 2023-11-16T14:07:33.430 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:30 smithi067 conmon[119968]: logger=migrator t=2023-11-16T14:04:30.993230677Z level=info msg="migrations completed" performed=485 skipped=0 duration=17.037444357s 2023-11-16T14:07:33.431 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:31 smithi067 conmon[119968]: logger=sqlstore t=2023-11-16T14:04:31.004231975Z level=info msg="Created default admin" user=admin 2023-11-16T14:07:33.431 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:31 smithi067 conmon[119968]: logger=sqlstore t=2023-11-16T14:04:31.004371578Z level=info msg="Created default organization" 2023-11-16T14:07:33.431 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:31 smithi067 conmon[119968]: logger=plugin.loader t=2023-11-16T14:04:31.090139742Z level=info msg="Plugin registered" pluginID=input 2023-11-16T14:07:33.431 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:31 smithi067 conmon[119968]: logger=plugin.loader t=2023-11-16T14:04:31.120530908Z level=info msg="Plugin registered" pluginID=grafana-piechart-panel 2023-11-16T14:07:33.431 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:31 smithi067 conmon[119968]: logger=plugin.loader t=2023-11-16T14:04:31.120566855Z level=info msg="Plugin registered" pluginID=vonage-status-panel 2023-11-16T14:07:33.431 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:31 smithi067 conmon[119968]: logger=secrets t=2023-11-16T14:04:31.120623104Z level=info msg="Envelope encryption state" enabled=true currentprovider=secretKey.v1 2023-11-16T14:07:33.431 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:31 smithi067 conmon[119968]: logger=query_data t=2023-11-16T14:04:31.122433763Z level=info msg="Query Service initialization" 2023-11-16T14:07:33.431 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:31 smithi067 conmon[119968]: logger=live.push_http t=2023-11-16T14:04:31.124859977Z level=info msg="Live Push Gateway initialization" 2023-11-16T14:07:33.431 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:31 smithi067 conmon[119968]: logger=infra.usagestats.collector t=2023-11-16T14:04:31.921563304Z level=info msg="registering usage stat providers" usageStatsProvidersLen=2 2023-11-16T14:07:33.431 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:31 smithi067 conmon[119968]: logger=provisioning.datasources t=2023-11-16T14:04:31.92187386Z level=warn msg="[Deprecated] the datasource provisioning config is outdated. please upgrade" filename=/etc/grafana/provisioning/datasources/ceph-dashboard.yml 2023-11-16T14:07:33.431 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:31 smithi067 conmon[119968]: logger=provisioning.datasources t=2023-11-16T14:04:31.944437517Z level=info msg="inserting datasource from configuration " name=Dashboard uid=P67B696468610B879 2023-11-16T14:07:33.431 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:31 smithi067 conmon[119968]: logger=provisioning.alerting t=2023-11-16T14:04:31.994653364Z level=info msg="starting to provision alerting" 2023-11-16T14:07:33.431 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:31 smithi067 conmon[119968]: logger=provisioning.alerting t=2023-11-16T14:04:31.994675632Z level=info msg="finished to provision alerting" 2023-11-16T14:07:33.432 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:31 smithi067 conmon[119968]: logger=grafanaStorageLogger t=2023-11-16T14:04:31.994865919Z level=info msg="storage starting" 2023-11-16T14:07:33.432 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:31 smithi067 conmon[119968]: logger=ngalert.state.manager t=2023-11-16T14:04:31.995042041Z level=info msg="Warming state cache for startup" 2023-11-16T14:07:33.432 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:31 smithi067 conmon[119968]: logger=http.server t=2023-11-16T14:04:31.997183728Z level=info msg="HTTP Server Listen" address=127.0.0.1:3000 protocol=https subUrl= socket= 2023-11-16T14:07:33.432 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:32 smithi067 conmon[119968]: logger=sqlstore.transactions t=2023-11-16T14:04:32.005889189Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=0 code="database is locked" 2023-11-16T14:07:33.432 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:32 smithi067 conmon[119968]: logger=ngalert.state.manager t=2023-11-16T14:04:32.062209689Z level=info msg="State cache has been initialized" states=0 duration=67.166743ms 2023-11-16T14:07:33.433 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:32 smithi067 conmon[119968]: logger=ticker t=2023-11-16T14:04:32.06228145Z level=info msg=starting first_tick=2023-11-16T14:04:40Z 2023-11-16T14:07:33.433 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:32 smithi067 conmon[119968]: logger=ngalert.multiorg.alertmanager t=2023-11-16T14:04:32.062299672Z level=info msg="starting MultiOrg Alertmanager" 2023-11-16T14:07:33.433 INFO:tasks.workunit.client.0.smithi067.stderr:+ for name in $names 2023-11-16T14:07:33.433 INFO:tasks.workunit.client.0.smithi067.stderr:+ dump_log 00000000-0000-0000-0000-0000deadbeef nfs.a 2023-11-16T14:07:33.433 INFO:tasks.workunit.client.0.smithi067.stderr:+ local fsid=00000000-0000-0000-0000-0000deadbeef 2023-11-16T14:07:33.433 INFO:tasks.workunit.client.0.smithi067.stderr:+ local name=nfs.a 2023-11-16T14:07:33.433 INFO:tasks.workunit.client.0.smithi067.stderr:+ local num_lines= 2023-11-16T14:07:33.434 INFO:tasks.workunit.client.0.smithi067.stdout:------------------------- 2023-11-16T14:07:33.434 INFO:tasks.workunit.client.0.smithi067.stdout:dump daemon log: nfs.a 2023-11-16T14:07:33.434 INFO:tasks.workunit.client.0.smithi067.stderr:+ '[' -z ']' 2023-11-16T14:07:33.435 INFO:tasks.workunit.client.0.smithi067.stderr:+ num_lines=100 2023-11-16T14:07:33.435 INFO:tasks.workunit.client.0.smithi067.stderr:+ echo ------------------------- 2023-11-16T14:07:33.435 INFO:tasks.workunit.client.0.smithi067.stderr:+ echo 'dump daemon log:' nfs.a 2023-11-16T14:07:33.435 INFO:tasks.workunit.client.0.smithi067.stderr:+ echo ------------------------- 2023-11-16T14:07:33.435 INFO:tasks.workunit.client.0.smithi067.stdout:------------------------- 2023-11-16T14:07:33.435 INFO:tasks.workunit.client.0.smithi067.stderr:+ sudo /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy logs --fsid 00000000-0000-0000-0000-0000deadbeef --name nfs.a -- --no-pager -n 100 2023-11-16T14:07:33.436 INFO:tasks.workunit.client.0.smithi067.stderr:Inferring config /var/lib/ceph/00000000-0000-0000-0000-0000deadbeef/nfs.a/config 2023-11-16T14:07:33.436 INFO:tasks.workunit.client.0.smithi067.stdout:-- Logs begin at Thu 2023-11-16 13:39:45 UTC, end at Thu 2023-11-16 14:07:31 UTC. -- 2023-11-16T14:07:33.436 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:45 smithi067 systemd[1]: Starting Ceph nfs.a for 00000000-0000-0000-0000-0000deadbeef... 2023-11-16T14:07:33.436 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:46 smithi067 conmon[121463]: 16/11/2023 14:04:46 : epoch 6556217e : smithi067 : ganesha.nfsd-7[main] main :MAIN :EVENT :ganesha.nfsd Starting: Ganesha Version 4.0 2023-11-16T14:07:33.436 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:46 smithi067 bash[121422]: bb12fc78b70625a3b10e7a242acce2d12f6375a6679e59e48a481faf183400f7 2023-11-16T14:07:33.436 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:46 smithi067 systemd[1]: Started Ceph nfs.a for 00000000-0000-0000-0000-0000deadbeef. 2023-11-16T14:07:33.437 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:46 smithi067 conmon[121463]: 16/11/2023 14:04:46 : epoch 6556217e : smithi067 : ganesha.nfsd-7[main] nfs_set_param_from_conf :NFS STARTUP :EVENT :Configuration file successfully parsed 2023-11-16T14:07:33.437 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:46 smithi067 conmon[121463]: 16/11/2023 14:04:46 : epoch 6556217e : smithi067 : ganesha.nfsd-7[main] init_server_pkgs :NFS STARTUP :EVENT :Initializing ID Mapper. 2023-11-16T14:07:33.437 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:46 smithi067 conmon[121463]: 16/11/2023 14:04:46 : epoch 6556217e : smithi067 : ganesha.nfsd-7[main] init_server_pkgs :NFS STARTUP :EVENT :ID Mapper successfully initialized. 2023-11-16T14:07:33.437 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:46 smithi067 conmon[121463]: 16/11/2023 14:04:46 : epoch 6556217e : smithi067 : ganesha.nfsd-7[main] nfs_start_grace :STATE :EVENT :NFS Server Now IN GRACE, duration 90 2023-11-16T14:07:33.437 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:46 smithi067 conmon[121463]: 16/11/2023 14:04:46 : epoch 6556217e : smithi067 : ganesha.nfsd-7[main] nfs_start_grace :STATE :EVENT :grace reload client info completed from backend 2023-11-16T14:07:33.437 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:46 smithi067 conmon[121463]: 16/11/2023 14:04:46 : epoch 6556217e : smithi067 : ganesha.nfsd-7[main] nfs_try_lift_grace :STATE :EVENT :check grace:reclaim complete(0) clid count(0) 2023-11-16T14:07:33.437 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:46 smithi067 conmon[121463]: 16/11/2023 14:04:46 : epoch 6556217e : smithi067 : ganesha.nfsd-7[main] main :NFS STARTUP :WARN :No export entries found in configuration file !!! 2023-11-16T14:07:33.437 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:46 smithi067 conmon[121463]: 16/11/2023 14:04:46 : epoch 6556217e : smithi067 : ganesha.nfsd-7[main] lower_my_caps :NFS STARTUP :EVENT :CAP_SYS_RESOURCE was successfully removed for proper quota management in FSAL 2023-11-16T14:07:33.437 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:46 smithi067 conmon[121463]: 16/11/2023 14:04:46 : epoch 6556217e : smithi067 : ganesha.nfsd-7[main] lower_my_caps :NFS STARTUP :EVENT :currenty set capabilities are: cap_chown,cap_dac_override,cap_fowner,cap_fsetid,cap_kill,cap_setgid,cap_setuid,cap_setpcap,cap_net_bind_service,cap_net_raw,cap_sys_chroot,cap_setfcap=eip 2023-11-16T14:07:33.437 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:46 smithi067 conmon[121463]: 16/11/2023 14:04:46 : epoch 6556217e : smithi067 : ganesha.nfsd-7[main] gsh_dbus_pkginit :DBUS :CRIT :dbus_bus_get failed (Failed to connect to socket /run/dbus/system_bus_socket: No such file or directory) 2023-11-16T14:07:33.437 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:46 smithi067 conmon[121463]: 16/11/2023 14:04:46 : epoch 6556217e : smithi067 : ganesha.nfsd-7[main] gsh_dbus_register_path :DBUS :CRIT :dbus_connection_register_object_path called with no DBUS connection 2023-11-16T14:07:33.438 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:46 smithi067 conmon[121463]: 16/11/2023 14:04:46 : epoch 6556217e : smithi067 : ganesha.nfsd-7[main] gsh_dbus_register_path :DBUS :CRIT :dbus_connection_register_object_path called with no DBUS connection 2023-11-16T14:07:33.438 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:46 smithi067 conmon[121463]: 16/11/2023 14:04:46 : epoch 6556217e : smithi067 : ganesha.nfsd-7[main] gsh_dbus_register_path :DBUS :CRIT :dbus_connection_register_object_path called with no DBUS connection 2023-11-16T14:07:33.438 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:46 smithi067 conmon[121463]: 16/11/2023 14:04:46 : epoch 6556217e : smithi067 : ganesha.nfsd-7[main] nfs_Init_svc :DISP :CRIT :Cannot acquire credentials for principal nfs 2023-11-16T14:07:33.438 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:46 smithi067 conmon[121463]: 16/11/2023 14:04:46 : epoch 6556217e : smithi067 : ganesha.nfsd-7[main] gsh_dbus_register_path :DBUS :CRIT :dbus_connection_register_object_path called with no DBUS connection 2023-11-16T14:07:33.438 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:46 smithi067 conmon[121463]: 16/11/2023 14:04:46 : epoch 6556217e : smithi067 : ganesha.nfsd-7[main] nfs_Init_admin_thread :NFS CB :EVENT :Admin thread initialized 2023-11-16T14:07:33.438 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:46 smithi067 conmon[121463]: 16/11/2023 14:04:46 : epoch 6556217e : smithi067 : ganesha.nfsd-7[main] nfs_rpc_cb_init_ccache :NFS STARTUP :EVENT :Callback creds directory (/var/run/ganesha) already exists 2023-11-16T14:07:33.438 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:46 smithi067 conmon[121463]: 16/11/2023 14:04:46 : epoch 6556217e : smithi067 : ganesha.nfsd-7[main] find_keytab_entry :NFS CB :WARN :Configuration file does not specify default realm while getting default realm name 2023-11-16T14:07:33.438 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:46 smithi067 conmon[121463]: 16/11/2023 14:04:46 : epoch 6556217e : smithi067 : ganesha.nfsd-7[main] gssd_refresh_krb5_machine_credential :NFS CB :CRIT :ERROR: gssd_refresh_krb5_machine_credential: no usable keytab entry found in keytab /etc/krb5.keytab for connection with host localhost 2023-11-16T14:07:33.438 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:46 smithi067 conmon[121463]: 16/11/2023 14:04:46 : epoch 6556217e : smithi067 : ganesha.nfsd-7[main] nfs_rpc_cb_init_ccache :NFS STARTUP :WARN :gssd_refresh_krb5_machine_credential failed (-1765328160:2) 2023-11-16T14:07:33.438 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:46 smithi067 conmon[121463]: 16/11/2023 14:04:46 : epoch 6556217e : smithi067 : ganesha.nfsd-7[main] nfs_Start_threads :THREAD :EVENT :Starting delayed executor. 2023-11-16T14:07:33.438 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:46 smithi067 conmon[121463]: 16/11/2023 14:04:46 : epoch 6556217e : smithi067 : ganesha.nfsd-7[main] nfs_Start_threads :THREAD :EVENT :gsh_dbusthread was started successfully 2023-11-16T14:07:33.438 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:46 smithi067 conmon[121463]: 16/11/2023 14:04:46 : epoch 6556217e : smithi067 : ganesha.nfsd-7[dbus] gsh_dbus_thread :DBUS :CRIT :DBUS not initialized, service thread exiting 2023-11-16T14:07:33.438 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:46 smithi067 conmon[121463]: 16/11/2023 14:04:46 : epoch 6556217e : smithi067 : ganesha.nfsd-7[dbus] gsh_dbus_thread :DBUS :EVENT :shutdown 2023-11-16T14:07:33.439 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:46 smithi067 conmon[121463]: 16/11/2023 14:04:46 : epoch 6556217e : smithi067 : ganesha.nfsd-7[main] nfs_Start_threads :THREAD :EVENT :admin thread was started successfully 2023-11-16T14:07:33.439 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:46 smithi067 conmon[121463]: 16/11/2023 14:04:46 : epoch 6556217e : smithi067 : ganesha.nfsd-7[main] nfs_Start_threads :THREAD :EVENT :reaper thread was started successfully 2023-11-16T14:07:33.439 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:46 smithi067 conmon[121463]: 16/11/2023 14:04:46 : epoch 6556217e : smithi067 : ganesha.nfsd-7[reaper] nfs_try_lift_grace :STATE :EVENT :check grace:reclaim complete(0) clid count(0) 2023-11-16T14:07:33.439 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:46 smithi067 conmon[121463]: 16/11/2023 14:04:46 : epoch 6556217e : smithi067 : ganesha.nfsd-7[main] nfs_Start_threads :THREAD :EVENT :General fridge was started successfully 2023-11-16T14:07:33.439 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:46 smithi067 conmon[121463]: 16/11/2023 14:04:46 : epoch 6556217e : smithi067 : ganesha.nfsd-7[main] rpc :TIRPC :EVENT :svc_rqst_hook_events: 0x55b1108b4fd0 fd 1024 xp_refcnt 1 sr_rec 0x55b11088e130 evchan 2 ev_refcnt 3 epoll_fd 33 control fd pair (31:32) direction in hook failed (9) 2023-11-16T14:07:33.439 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:46 smithi067 conmon[121463]: 16/11/2023 14:04:46 : epoch 6556217e : smithi067 : ganesha.nfsd-7[main] nsm_connect :NLM :EVENT :connect to statd failed: RPC: Unknown protocol 2023-11-16T14:07:33.439 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:46 smithi067 conmon[121463]: 16/11/2023 14:04:46 : epoch 6556217e : smithi067 : ganesha.nfsd-7[main] nsm_unmonitor_all :NLM :EVENT :Unmonitor all nsm_connect failed 2023-11-16T14:07:33.439 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:46 smithi067 conmon[121463]: 16/11/2023 14:04:46 : epoch 6556217e : smithi067 : ganesha.nfsd-7[main] nfs_start :NFS STARTUP :EVENT :------------------------------------------------- 2023-11-16T14:07:33.439 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:46 smithi067 conmon[121463]: 16/11/2023 14:04:46 : epoch 6556217e : smithi067 : ganesha.nfsd-7[main] nfs_start :NFS STARTUP :EVENT : NFS SERVER INITIALIZED 2023-11-16T14:07:33.439 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:46 smithi067 conmon[121463]: 16/11/2023 14:04:46 : epoch 6556217e : smithi067 : ganesha.nfsd-7[main] nfs_start :NFS STARTUP :EVENT :------------------------------------------------- 2023-11-16T14:07:33.439 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:56 smithi067 conmon[121463]: 16/11/2023 14:04:56 : epoch 6556217e : smithi067 : ganesha.nfsd-7[reaper] nfs_try_lift_grace :STATE :EVENT :check grace:reclaim complete(0) clid count(0) 2023-11-16T14:07:33.439 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:06 smithi067 conmon[121463]: 16/11/2023 14:05:06 : epoch 6556217e : smithi067 : ganesha.nfsd-7[reaper] nfs_try_lift_grace :STATE :EVENT :check grace:reclaim complete(0) clid count(0) 2023-11-16T14:07:33.440 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:16 smithi067 conmon[121463]: 16/11/2023 14:05:16 : epoch 6556217e : smithi067 : ganesha.nfsd-7[reaper] nfs_try_lift_grace :STATE :EVENT :check grace:reclaim complete(0) clid count(0) 2023-11-16T14:07:33.440 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:26 smithi067 conmon[121463]: 16/11/2023 14:05:26 : epoch 6556217e : smithi067 : ganesha.nfsd-7[reaper] nfs_try_lift_grace :STATE :EVENT :check grace:reclaim complete(0) clid count(0) 2023-11-16T14:07:33.440 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:36 smithi067 conmon[121463]: 16/11/2023 14:05:36 : epoch 6556217e : smithi067 : ganesha.nfsd-7[reaper] nfs_try_lift_grace :STATE :EVENT :check grace:reclaim complete(0) clid count(0) 2023-11-16T14:07:33.440 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:46 smithi067 conmon[121463]: 16/11/2023 14:05:46 : epoch 6556217e : smithi067 : ganesha.nfsd-7[reaper] nfs_try_lift_grace :STATE :EVENT :check grace:reclaim complete(0) clid count(0) 2023-11-16T14:07:33.440 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:56 smithi067 conmon[121463]: 16/11/2023 14:05:56 : epoch 6556217e : smithi067 : ganesha.nfsd-7[reaper] nfs_try_lift_grace :STATE :EVENT :check grace:reclaim complete(0) clid count(0) 2023-11-16T14:07:33.440 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:06 smithi067 conmon[121463]: 16/11/2023 14:06:06 : epoch 6556217e : smithi067 : ganesha.nfsd-7[reaper] nfs_try_lift_grace :STATE :EVENT :check grace:reclaim complete(0) clid count(0) 2023-11-16T14:07:33.440 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:16 smithi067 conmon[121463]: 16/11/2023 14:06:16 : epoch 6556217e : smithi067 : ganesha.nfsd-7[reaper] nfs_try_lift_grace :STATE :EVENT :check grace:reclaim complete(0) clid count(0) 2023-11-16T14:07:33.440 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:16 smithi067 conmon[121463]: 16/11/2023 14:06:16 : epoch 6556217e : smithi067 : ganesha.nfsd-7[reaper] nfs_lift_grace_locked :STATE :EVENT :NFS Server Now NOT IN GRACE 2023-11-16T14:07:33.441 INFO:tasks.workunit.client.0.smithi067.stderr:+ for name in $names 2023-11-16T14:07:33.441 INFO:tasks.workunit.client.0.smithi067.stderr:+ dump_log 00000000-0000-0000-0000-0000deadbeef container.alertmanager.a 2023-11-16T14:07:33.441 INFO:tasks.workunit.client.0.smithi067.stderr:+ local fsid=00000000-0000-0000-0000-0000deadbeef 2023-11-16T14:07:33.441 INFO:tasks.workunit.client.0.smithi067.stderr:+ local name=container.alertmanager.a 2023-11-16T14:07:33.441 INFO:tasks.workunit.client.0.smithi067.stderr:+ local num_lines= 2023-11-16T14:07:33.441 INFO:tasks.workunit.client.0.smithi067.stdout:------------------------- 2023-11-16T14:07:33.441 INFO:tasks.workunit.client.0.smithi067.stdout:dump daemon log: container.alertmanager.a 2023-11-16T14:07:33.441 INFO:tasks.workunit.client.0.smithi067.stdout:------------------------- 2023-11-16T14:07:33.442 INFO:tasks.workunit.client.0.smithi067.stderr:+ '[' -z ']' 2023-11-16T14:07:33.442 INFO:tasks.workunit.client.0.smithi067.stderr:+ num_lines=100 2023-11-16T14:07:33.442 INFO:tasks.workunit.client.0.smithi067.stderr:+ echo ------------------------- 2023-11-16T14:07:33.442 INFO:tasks.workunit.client.0.smithi067.stderr:+ echo 'dump daemon log:' container.alertmanager.a 2023-11-16T14:07:33.442 INFO:tasks.workunit.client.0.smithi067.stderr:+ echo ------------------------- 2023-11-16T14:07:33.442 INFO:tasks.workunit.client.0.smithi067.stderr:+ sudo /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/../../../src/cephadm/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy logs --fsid 00000000-0000-0000-0000-0000deadbeef --name container.alertmanager.a -- --no-pager -n 100 2023-11-16T14:07:33.443 INFO:tasks.workunit.client.0.smithi067.stderr:Inferring config /var/lib/ceph/00000000-0000-0000-0000-0000deadbeef/container.alertmanager.a/config 2023-11-16T14:07:33.443 INFO:tasks.workunit.client.0.smithi067.stdout:-- Logs begin at Thu 2023-11-16 13:39:45 UTC, end at Thu 2023-11-16 14:07:31 UTC. -- 2023-11-16T14:07:33.443 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:50 smithi067 systemd[1]: Starting Ceph container.alertmanager.a for 00000000-0000-0000-0000-0000deadbeef... 2023-11-16T14:07:33.443 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:04:50 smithi067 bash[122187]: Trying to pull docker.io/prom/alertmanager:v0.20.0... 2023-11-16T14:07:33.443 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:05:26 smithi067 bash[122187]: time="2023-11-16T14:05:26Z" level=warning msg="failed, retrying in 1s ... (1/3). Error: Error initializing source docker://prom/alertmanager:v0.20.0: (Mirrors also failed: [docker-mirror.front.sepia.ceph.com:5000/prom/alertmanager:v0.20.0: error pinging docker registry docker-mirror.front.sepia.ceph.com:5000: Get \"https://docker-mirror.front.sepia.ceph.com:5000/v2/\": dial tcp 172.21.0.79:5000: connect: no route to host]): docker.io/prom/alertmanager:v0.20.0: Error reading manifest v0.20.0 in docker.io/prom/alertmanager: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit" 2023-11-16T14:07:33.443 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:04 smithi067 bash[122187]: time="2023-11-16T14:06:04Z" level=warning msg="failed, retrying in 2s ... (2/3). Error: Error initializing source docker://prom/alertmanager:v0.20.0: (Mirrors also failed: [docker-mirror.front.sepia.ceph.com:5000/prom/alertmanager:v0.20.0: error pinging docker registry docker-mirror.front.sepia.ceph.com:5000: Get \"https://docker-mirror.front.sepia.ceph.com:5000/v2/\": dial tcp 172.21.0.79:5000: connect: no route to host]): docker.io/prom/alertmanager:v0.20.0: Error reading manifest v0.20.0 in docker.io/prom/alertmanager: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit" 2023-11-16T14:07:33.444 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:06:42 smithi067 bash[122187]: time="2023-11-16T14:06:42Z" level=warning msg="failed, retrying in 4s ... (3/3). Error: Error initializing source docker://prom/alertmanager:v0.20.0: (Mirrors also failed: [docker-mirror.front.sepia.ceph.com:5000/prom/alertmanager:v0.20.0: error pinging docker registry docker-mirror.front.sepia.ceph.com:5000: Get \"https://docker-mirror.front.sepia.ceph.com:5000/v2/\": dial tcp 172.21.0.79:5000: connect: no route to host]): docker.io/prom/alertmanager:v0.20.0: Error reading manifest v0.20.0 in docker.io/prom/alertmanager: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit" 2023-11-16T14:07:33.444 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:22 smithi067 bash[122187]: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit 2023-11-16T14:07:33.444 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:22 smithi067 bash[122187]: Error: Error initializing source docker://prom/alertmanager:v0.20.0: (Mirrors also failed: [docker-mirror.front.sepia.ceph.com:5000/prom/alertmanager:v0.20.0: error pinging docker registry docker-mirror.front.sepia.ceph.com:5000: Get "https://docker-mirror.front.sepia.ceph.com:5000/v2/": dial tcp 172.21.0.79:5000: connect: no route to host]): docker.io/prom/alertmanager:v0.20.0: Error reading manifest v0.20.0 in docker.io/prom/alertmanager: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit 2023-11-16T14:07:33.444 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:22 smithi067 systemd[1]: ceph-00000000-0000-0000-0000-0000deadbeef@container.alertmanager.a.service: Control process exited, code=exited status=125 2023-11-16T14:07:33.444 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:23 smithi067 systemd[1]: ceph-00000000-0000-0000-0000-0000deadbeef@container.alertmanager.a.service: Failed with result 'exit-code'. 2023-11-16T14:07:33.444 INFO:tasks.workunit.client.0.smithi067.stdout:Nov 16 14:07:23 smithi067 systemd[1]: Failed to start Ceph container.alertmanager.a for 00000000-0000-0000-0000-0000deadbeef. 2023-11-16T14:07:33.445 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-16T14:07:33.445 INFO:tasks.workunit.client.0.smithi067.stderr:+ rm -rf tmp.test_cephadm.sh.Kh7Xjy 2023-11-16T14:07:33.445 INFO:tasks.workunit:Stopping ['cephadm/test_cephadm.sh'] on client.0... 2023-11-16T14:07:33.445 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-11-16T14:07:33.736 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_ae6ce92c0812ba06c9c623ce72df4f3fc59080b4/qa/tasks/workunit.py", line 129, in task p.spawn(_run_tests, ctx, refspec, role, tests, File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_ae6ce92c0812ba06c9c623ce72df4f3fc59080b4/qa/tasks/workunit.py", line 424, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test cephadm/test_cephadm.sh) on smithi067 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ae6ce92c0812ba06c9c623ce72df4f3fc59080b4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' 2023-11-16T14:07:33.808 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=d1a0132ec000497ab8fd6fba3603fecc Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_ae6ce92c0812ba06c9c623ce72df4f3fc59080b4/qa/tasks/workunit.py", line 129, in task p.spawn(_run_tests, ctx, refspec, role, tests, File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_ae6ce92c0812ba06c9c623ce72df4f3fc59080b4/qa/tasks/workunit.py", line 424, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test cephadm/test_cephadm.sh) on smithi067 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ae6ce92c0812ba06c9c623ce72df4f3fc59080b4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' 2023-11-16T14:07:33.811 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-11-16T14:07:33.823 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-11-16T14:07:33.823 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-16T14:07:33.877 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-11-16T14:07:33.891 INFO:teuthology.task.clock:Checking final clock skew... 2023-11-16T14:07:33.891 DEBUG:teuthology.orchestra.run.smithi067:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-16T14:07:33.907 INFO:teuthology.orchestra.run.smithi067.stderr:bash: ntpq: command not found 2023-11-16T14:07:33.911 INFO:teuthology.orchestra.run.smithi067.stdout:210 Number of sources = 4 2023-11-16T14:07:33.911 INFO:teuthology.orchestra.run.smithi067.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-16T14:07:33.912 INFO:teuthology.orchestra.run.smithi067.stdout:=============================================================================== 2023-11-16T14:07:33.912 INFO:teuthology.orchestra.run.smithi067.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 5 +549us[ +549us] +/- 75ms 2023-11-16T14:07:33.912 INFO:teuthology.orchestra.run.smithi067.stdout:^* hv02.front.sepia.ceph.com 3 6 377 8 -817us[ -790us] +/- 59ms 2023-11-16T14:07:33.913 INFO:teuthology.orchestra.run.smithi067.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 4 +599us[ +599us] +/- 84ms 2023-11-16T14:07:33.913 INFO:teuthology.orchestra.run.smithi067.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-11-16T14:07:33.913 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-11-16T14:07:33.928 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-11-16T14:07:33.928 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-11-16T14:07:33.965 DEBUG:teuthology.orchestra.run.smithi067:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-11-16T14:07:34.058 DEBUG:teuthology.orchestra.run.smithi067:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-16T14:07:34.089 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-16T14:07:34.089 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-11-16T14:07:34.099 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-11-16T14:07:34.140 INFO:teuthology.task.internal:Duration was 1645.986455 seconds 2023-11-16T14:07:34.141 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-11-16T14:07:34.190 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-11-16T14:07:34.191 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-16T14:07:34.237 INFO:teuthology.orchestra.run.smithi067.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-16T14:07:34.255 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-11-16T14:07:34.255 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi067.front.sepia.ceph.com 2023-11-16T14:07:34.256 DEBUG:teuthology.orchestra.run.smithi067:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-16T14:07:34.275 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-11-16T14:07:34.276 DEBUG:teuthology.orchestra.run.smithi067:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-16T14:07:34.374 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-11-16T14:07:34.374 DEBUG:teuthology.orchestra.run.smithi067:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-16T14:07:34.512 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-11-16T14:07:34.523 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-11-16T14:07:34.523 DEBUG:teuthology.orchestra.run.smithi067:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-16T14:07:34.548 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-11-16T14:07:34.566 DEBUG:teuthology.orchestra.run.smithi067:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-16T14:07:34.614 INFO:teuthology.orchestra.run.smithi067.stdout:kernel.core_pattern = core 2023-11-16T14:07:34.628 DEBUG:teuthology.orchestra.run.smithi067:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-16T14:07:34.683 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-16T14:07:34.684 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-11-16T14:07:34.694 INFO:teuthology.task.internal:Transferring archived files... 2023-11-16T14:07:34.695 DEBUG:teuthology.misc:Transferring archived files from smithi067:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/gabrioux-2023-11-16_12:07:54-orch:cephadm-wip-63555-quincy-distro-default-smithi/7460794/remote/smithi067 2023-11-16T14:07:34.696 DEBUG:teuthology.orchestra.run.smithi067:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-16T14:07:34.784 INFO:teuthology.task.internal:Removing archive directory... 2023-11-16T14:07:34.785 DEBUG:teuthology.orchestra.run.smithi067:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-16T14:07:34.832 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-11-16T14:07:34.844 INFO:teuthology.task.internal:Not uploading archives. 2023-11-16T14:07:34.844 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-11-16T14:07:34.875 INFO:teuthology.task.internal:Tidying up after the test... 2023-11-16T14:07:34.875 DEBUG:teuthology.orchestra.run.smithi067:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-16T14:07:34.892 INFO:teuthology.orchestra.run.smithi067.stdout: 262729 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Nov 16 14:07 /home/ubuntu/cephtest 2023-11-16T14:07:34.893 INFO:teuthology.orchestra.run.smithi067.stdout: 658647 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 16 13:56 /home/ubuntu/cephtest/mnt.0 2023-11-16T14:07:34.893 INFO:teuthology.orchestra.run.smithi067.stdout: 658648 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 16 13:57 /home/ubuntu/cephtest/mnt.0/client.0 2023-11-16T14:07:34.894 INFO:teuthology.orchestra.run.smithi067.stdout: 658689 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 16 14:07 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-11-16T14:07:34.894 INFO:teuthology.orchestra.run.smithi067.stdout: 660590 4 drwx------ 2 ubuntu ubuntu 4096 Nov 16 13:57 /home/ubuntu/cephtest/mnt.0/client.0/tmp/tmp.test_cephadm.sh.KLwpMq 2023-11-16T14:07:34.895 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-16T14:07:34.895 INFO:teuthology.orchestra.run.smithi067.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-11-16T14:07:34.896 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi067 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-11-16T14:07:34.900 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-11-16T14:07:34.925 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-11-16T14:07:34.976 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi067 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-11-16T14:07:34.976 INFO:teuthology.nuke:Checking targets against current locks 2023-11-16T14:07:35.000 DEBUG:teuthology.nuke:shortname: smithi067 2023-11-16T14:07:35.000 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-16T14:07:35.017 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi067.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-11-16_12:07:54-orch:cephadm-wip-63555-quincy-distro-default-smithi/7460794', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-16 13:32:55.690441', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO4QiM3tGACwSrE19pQ7xtMf2UScG4piqhyd9EdJvhMb7k3OLy6KHpKtB/wvvA5gVlh1O9mnE8zMG5C8ibDEBfw='} 2023-11-16T14:07:35.063 INFO:teuthology.orchestra.console.smithi067:Power off 2023-11-16T14:07:35.064 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-16T14:07:35.086 DEBUG:teuthology.orchestra.console.smithi067:power off output: Chassis Power Control: Down/Off 2023-11-16T14:07:35.087 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T14:07:35.112 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is on 2023-11-16T14:07:39.114 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T14:07:39.223 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is on 2023-11-16T14:07:43.227 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T14:07:43.336 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is off 2023-11-16T14:07:43.437 INFO:teuthology.orchestra.console.smithi067:Power off completed 2023-11-16T14:07:43.542 INFO:teuthology.run:Summary data: description: orch:cephadm/workunits/{0-distro/rhel_8.4_container_tools_3.0 agent/on mon_election/connectivity task/test_cephadm} duration: 1645.9864552021027 failure_reason: 'Command failed (workunit test cephadm/test_cephadm.sh) on smithi067 with status 1: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ae6ce92c0812ba06c9c623ce72df4f3fc59080b4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh''' flavor: default owner: scheduled_gabrioux@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=d1a0132ec000497ab8fd6fba3603fecc status: fail success: false 2023-11-16T14:07:43.543 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T14:07:43.624 INFO:teuthology.run:FAIL