2023-06-24T14:08:08.404 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb 2023-06-24T14:08:08.405 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/yuriw-2023-06-23_21:02:01-rbd-reef-distro-default-smithi/7315260 --name yuriw-2023-06-23_21:02:01-rbd-reef-distro-default-smithi --owner scheduled_yuriw@teuthology --description rbd/encryption/{cache/writethrough clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-hybrid pool/none supported-random-distro$/{centos_8} workloads/qemu_xfstests_luks1_luks2} --verbose -- /home/teuthworker/archive/yuriw-2023-06-23_21:02:01-rbd-reef-distro-default-smithi/7315260/orig.config.yaml 2023-06-24T14:08:08.445 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-24T14:08:08.532 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-06-23_21:02:01-rbd-reef-distro-default-smithi/7315260 branch: reef description: rbd/encryption/{cache/writethrough clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-hybrid pool/none supported-random-distro$/{centos_8} workloads/qemu_xfstests_luks1_luks2} email: yweinste@redhat.com exclude_arch: armv7l first_in_suite: false job_id: '7315260' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: yuriw-2023-06-23_21:02:01-rbd-reef-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 - machine: cpus: 1 disk: 40 ram: 30000 volumes: count: 4 size: 30 os_type: centos os_version: 8.stream overrides: admin_socket: branch: reef ceph: conf: client: rbd default features: 61 global: mon client directed command retry: 5 ms inject socket failures: 5000 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bluefs allocator: hybrid bluestore allocator: hybrid bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - but it is still running - \(OSD_SLOW_PING_TIME sha1: c9d917e3a4a8fddd8a281c771f80a9b76e3a6fb8 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: extra_packages: - rbd-nbd flavor: default sha1: c9d917e3a4a8fddd8a281c771f80a9b76e3a6fb8 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: reef sha1: b9d28de6006117997208584eb86d8d304f2a113d owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.c - mgr.x - osd.0 - osd.1 - osd.2 - osd.3 - - mon.b - mgr.y - osd.4 - osd.5 - osd.6 - osd.7 - - client.0 seed: 5812 sha1: c9d917e3a4a8fddd8a281c771f80a9b76e3a6fb8 sleep_before_teardown: 0 subset: 111/120000 suite: rbd suite_branch: reef suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_b9d28de6006117997208584eb86d8d304f2a113d/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: b9d28de6006117997208584eb86d8d304f2a113d targets: smithi104.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCxMZI+isAG+upXvZwELe117eBkubjWGGJtpr0/lJvTAhiViBMySqWdyb68icL0ezsRvogsXTCDAF75+w7AumgXpo0u2FZ2gRPLPBWruPZ4wrBUw2BsnqfTxjKslf5uJCulQaBBZwELTkVsrEDcFng0gQGFJmVm4ZaehQfJohu5IasQGuomvf5q6ISohk+uZIaUgTUFPifDs8tA9ehTJoasLnl14Bs3/Da3mmqo5ZFFr+S85lQAyZrTfkey/t49ULP3SrAuuZ7zWidljrxg8gN+E925Vswwql7lC2agXioFIZT3ZJHTXMSaKZwq6tyay/ZbLEtsc/8g2+Hnc1kepBm3PoJIqrdJu72B0/VrAmrhmiPkaR1hCFYXJr11I/6Uo0e2dzu7Ek7JYSeXWIJhpxRZEsV3MAUK8QX8UcVIOp3mAKqgavL8etS4CM/hvnyXpUWfg5k0QTlY3fadLqyo0Vk2Jiz703vKjlVJh4NBOjIaW9FfJ2f1aX4Gxq59jU+eVEM= smithi132.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDptTubT0mpiPW6a5n6OWG02FeElc0QUKw10+tp8SCrKIxbL+3WWSTeV/ZROjIfGQCGiCjb6FP8IK1AEo0sAGPj2iTi/2/ujry8K2YQPEoGA07hKa3syiD7vdhOu//9AX0e/JT0YZXIPQr4TIFZ+cSWfEisdNeNZQt4hmABW9b6piAoGLXfSCASnVhuC5lcCTX3dxDgYoohWQNrgxWgXbXZtfJJCaheYtB5Y/z974TlO1mm/Q/Hi7N6xsn+vrydZqSLQqoDZ39+LvFIlr2GX3F9cFiDUYwx1NXTSvsSK6PmboHc82FQDAJL+vwTPnvPvq345HfXG2m1ZXTj5CjmfaUb3zCLET9+/msZoOjGKFpRAN54jnXJHEC4LqjN90GVSQ1zVjg5xXt8rI/hUxiIU3E1jqYw7kAK3IcGidB3ND6mZvny0ntzoBVvddTtvoxsL8MrF7yK0BmN1Klmb6Hmht8FKBRUjQq/t0+tQL1JZD/KKeRfEZvqm1O5JzHf62qgx/s= smithi181.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE5zP4uQ5mwkaH/Oakm9ruw4cLby62b5wVg0rGUn+PmXVPrRd1phkQfwzzgPWVdAVmbRByYbMNIGxjrcVA6q/eM= tasks: - install: null - ceph: conf: client: rbd cache: true rbd cache max dirty: 0 - qemu: all: clone: true disks: 3 encryption_format: luks2 parent_encryption_format: luks1 test: qa/run_xfstests_qemu.sh type: block teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 076bbebc42a14f7d568aaa78eabb0038327bcb23 timestamp: 2023-06-23_21:02:01 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-06-24T14:08:08.532 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_b9d28de6006117997208584eb86d8d304f2a113d/qa; will attempt to use it 2023-06-24T14:08:08.533 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_b9d28de6006117997208584eb86d8d304f2a113d/qa/tasks 2023-06-24T14:08:08.533 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-06-24T14:08:08.540 INFO:teuthology.task.internal:Checking packages... 2023-06-24T14:08:08.572 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'c9d917e3a4a8fddd8a281c771f80a9b76e3a6fb8' 2023-06-24T14:08:08.572 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-06-24T14:08:08.573 INFO:teuthology.packaging:ref: None 2023-06-24T14:08:08.573 INFO:teuthology.packaging:tag: None 2023-06-24T14:08:08.573 INFO:teuthology.packaging:branch: reef 2023-06-24T14:08:08.573 INFO:teuthology.packaging:sha1: c9d917e3a4a8fddd8a281c771f80a9b76e3a6fb8 2023-06-24T14:08:08.574 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=reef 2023-06-24T14:08:08.820 INFO:teuthology.task.internal:Found packages for ceph version 18.1.0-176.g026e2477 2023-06-24T14:08:08.820 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-06-24T14:08:08.828 INFO:teuthology.task.internal:no buildpackages task found 2023-06-24T14:08:08.828 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-06-24T14:08:08.882 INFO:teuthology.task.internal:Saving configuration 2023-06-24T14:08:08.896 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-06-24T14:08:08.924 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-24T14:08:08.955 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi104.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-23_21:02:01-rbd-reef-distro-default-smithi/7315260', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-24 14:03:10.012408', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLyoTFNI7OsqAKF8ECC1pj8Msl0o9f0Zf1Ak/LyOV0dzYPmY7NrovMlOoQ3QkP2X4AUTj2947el7tyUFL/uwQqM='} 2023-06-24T14:08:08.983 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi132.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-23_21:02:01-rbd-reef-distro-default-smithi/7315260', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-24 14:03:10.015382', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGRyHzLo+wG/xH2vETAB+5sJT6dXVtXVzNBCv5fA3nzzgCNPgvAn9dRg2nXJD7ea+VsJaoJ/jThuG9RXugaU5eE='} 2023-06-24T14:08:09.005 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi181.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-23_21:02:01-rbd-reef-distro-default-smithi/7315260', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-24 14:03:10.014043', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE5zP4uQ5mwkaH/Oakm9ruw4cLby62b5wVg0rGUn+PmXVPrRd1phkQfwzzgPWVdAVmbRByYbMNIGxjrcVA6q/eM='} 2023-06-24T14:08:09.006 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-06-24T14:08:09.013 INFO:teuthology.task.internal:roles: ubuntu@smithi104.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2023-06-24T14:08:09.013 INFO:teuthology.task.internal:roles: ubuntu@smithi132.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2023-06-24T14:08:09.013 INFO:teuthology.task.internal:roles: ubuntu@smithi181.front.sepia.ceph.com - ['client.0'] 2023-06-24T14:08:09.014 INFO:teuthology.run_tasks:Running task console_log... 2023-06-24T14:08:09.152 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd498de6ee0>, signals=[15]) 2023-06-24T14:08:09.154 INFO:teuthology.run_tasks:Running task internal.connect... 2023-06-24T14:08:09.160 INFO:teuthology.task.internal:Opening connections... 2023-06-24T14:08:09.161 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi104.front.sepia.ceph.com 2023-06-24T14:08:09.163 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-24T14:08:09.232 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi132.front.sepia.ceph.com 2023-06-24T14:08:09.233 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-24T14:08:09.303 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi181.front.sepia.ceph.com 2023-06-24T14:08:09.304 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-24T14:08:09.371 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-06-24T14:08:09.379 DEBUG:teuthology.orchestra.run.smithi104:> uname -m 2023-06-24T14:08:09.401 INFO:teuthology.orchestra.run.smithi104.stdout:x86_64 2023-06-24T14:08:09.401 DEBUG:teuthology.orchestra.run.smithi104:> cat /etc/os-release 2023-06-24T14:08:09.462 INFO:teuthology.orchestra.run.smithi104.stdout:NAME="CentOS Stream" 2023-06-24T14:08:09.462 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION="8" 2023-06-24T14:08:09.463 INFO:teuthology.orchestra.run.smithi104.stdout:ID="centos" 2023-06-24T14:08:09.463 INFO:teuthology.orchestra.run.smithi104.stdout:ID_LIKE="rhel fedora" 2023-06-24T14:08:09.463 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_ID="8" 2023-06-24T14:08:09.463 INFO:teuthology.orchestra.run.smithi104.stdout:PLATFORM_ID="platform:el8" 2023-06-24T14:08:09.463 INFO:teuthology.orchestra.run.smithi104.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-24T14:08:09.463 INFO:teuthology.orchestra.run.smithi104.stdout:ANSI_COLOR="0;31" 2023-06-24T14:08:09.463 INFO:teuthology.orchestra.run.smithi104.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-24T14:08:09.463 INFO:teuthology.orchestra.run.smithi104.stdout:HOME_URL="https://centos.org/" 2023-06-24T14:08:09.464 INFO:teuthology.orchestra.run.smithi104.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-24T14:08:09.464 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-24T14:08:09.464 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-24T14:08:09.464 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server 2023-06-24T14:08:09.490 DEBUG:teuthology.orchestra.run.smithi132:> uname -m 2023-06-24T14:08:09.513 INFO:teuthology.orchestra.run.smithi132.stdout:x86_64 2023-06-24T14:08:09.513 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release 2023-06-24T14:08:09.574 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="CentOS Stream" 2023-06-24T14:08:09.574 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="8" 2023-06-24T14:08:09.575 INFO:teuthology.orchestra.run.smithi132.stdout:ID="centos" 2023-06-24T14:08:09.575 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="rhel fedora" 2023-06-24T14:08:09.575 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="8" 2023-06-24T14:08:09.575 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el8" 2023-06-24T14:08:09.575 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-24T14:08:09.575 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31" 2023-06-24T14:08:09.575 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-24T14:08:09.575 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://centos.org/" 2023-06-24T14:08:09.576 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-24T14:08:09.576 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-24T14:08:09.576 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-24T14:08:09.576 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server 2023-06-24T14:08:09.598 DEBUG:teuthology.orchestra.run.smithi181:> uname -m 2023-06-24T14:08:09.620 INFO:teuthology.orchestra.run.smithi181.stdout:x86_64 2023-06-24T14:08:09.621 DEBUG:teuthology.orchestra.run.smithi181:> cat /etc/os-release 2023-06-24T14:08:09.680 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="CentOS Stream" 2023-06-24T14:08:09.681 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="8" 2023-06-24T14:08:09.681 INFO:teuthology.orchestra.run.smithi181.stdout:ID="centos" 2023-06-24T14:08:09.681 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE="rhel fedora" 2023-06-24T14:08:09.681 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="8" 2023-06-24T14:08:09.681 INFO:teuthology.orchestra.run.smithi181.stdout:PLATFORM_ID="platform:el8" 2023-06-24T14:08:09.681 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-24T14:08:09.681 INFO:teuthology.orchestra.run.smithi181.stdout:ANSI_COLOR="0;31" 2023-06-24T14:08:09.682 INFO:teuthology.orchestra.run.smithi181.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-24T14:08:09.682 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://centos.org/" 2023-06-24T14:08:09.682 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-24T14:08:09.682 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-24T14:08:09.682 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-24T14:08:09.683 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server 2023-06-24T14:08:09.706 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-06-24T14:08:09.715 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-06-24T14:08:09.779 INFO:teuthology.task.internal:Checking for old test directory... 2023-06-24T14:08:09.780 DEBUG:teuthology.orchestra.run.smithi104:> test '!' -e /home/ubuntu/cephtest 2023-06-24T14:08:09.782 DEBUG:teuthology.orchestra.run.smithi132:> test '!' -e /home/ubuntu/cephtest 2023-06-24T14:08:09.784 DEBUG:teuthology.orchestra.run.smithi181:> test '!' -e /home/ubuntu/cephtest 2023-06-24T14:08:09.804 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-06-24T14:08:09.834 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-06-24T14:08:09.834 DEBUG:teuthology.orchestra.run.smithi104:> test -z $(ls -A /var/lib/ceph) 2023-06-24T14:08:09.842 DEBUG:teuthology.orchestra.run.smithi132:> test -z $(ls -A /var/lib/ceph) 2023-06-24T14:08:09.845 DEBUG:teuthology.orchestra.run.smithi181:> test -z $(ls -A /var/lib/ceph) 2023-06-24T14:08:09.896 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-06-24T14:08:09.979 INFO:teuthology.run_tasks:Running task kernel... 2023-06-24T14:08:09.994 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-06-24T14:08:09.995 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-06-24T14:08:09.996 DEBUG:teuthology.orchestra.run.smithi104:> test -f /run/.containerenv -o -f /.dockerenv 2023-06-24T14:08:09.997 DEBUG:teuthology.orchestra.run.smithi132:> test -f /run/.containerenv -o -f /.dockerenv 2023-06-24T14:08:09.997 DEBUG:teuthology.orchestra.run.smithi181:> test -f /run/.containerenv -o -f /.dockerenv 2023-06-24T14:08:10.016 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-24T14:08:10.017 DEBUG:teuthology.orchestra.run.smithi104:> uname -r 2023-06-24T14:08:10.018 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-24T14:08:10.018 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-24T14:08:10.019 DEBUG:teuthology.orchestra.run.smithi132:> uname -r 2023-06-24T14:08:10.020 DEBUG:teuthology.orchestra.run.smithi181:> uname -r 2023-06-24T14:08:10.077 INFO:teuthology.orchestra.run.smithi104.stdout:4.18.0-489.el8.x86_64 2023-06-24T14:08:10.078 INFO:teuthology.task.kernel:Running kernel on smithi104: 4.18.0-489.el8.x86_64 2023-06-24T14:08:10.078 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum install -y kernel 2023-06-24T14:08:10.080 INFO:teuthology.orchestra.run.smithi132.stdout:4.18.0-489.el8.x86_64 2023-06-24T14:08:10.080 INFO:teuthology.task.kernel:Running kernel on smithi132: 4.18.0-489.el8.x86_64 2023-06-24T14:08:10.080 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum install -y kernel 2023-06-24T14:08:10.081 INFO:teuthology.orchestra.run.smithi181.stdout:4.18.0-489.el8.x86_64 2023-06-24T14:08:10.082 INFO:teuthology.task.kernel:Running kernel on smithi181: 4.18.0-489.el8.x86_64 2023-06-24T14:08:10.082 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum install -y kernel 2023-06-24T14:08:14.027 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 8 - AppStream 23 MB/s | 30 MB 00:01 2023-06-24T14:08:14.111 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 8 - AppStream 21 MB/s | 30 MB 00:01 2023-06-24T14:08:14.186 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 8 - AppStream 19 MB/s | 30 MB 00:01 2023-06-24T14:08:20.527 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 8 - BaseOS 33 MB/s | 39 MB 00:01 2023-06-24T14:08:20.803 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 8 - BaseOS 28 MB/s | 39 MB 00:01 2023-06-24T14:08:21.544 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 8 - BaseOS 19 MB/s | 39 MB 00:02 2023-06-24T14:09:00.223 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 8 - Extras 537 B/s | 18 kB 00:33 2023-06-24T14:09:00.704 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 8 - Extras 543 B/s | 18 kB 00:33 2023-06-24T14:09:00.724 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 8 - Extras common packages 19 kB/s | 6.6 kB 00:00 2023-06-24T14:09:01.142 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 8 - Extras 525 B/s | 18 kB 00:34 2023-06-24T14:09:01.247 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 8 - Extras common packages 17 kB/s | 6.6 kB 00:00 2023-06-24T14:09:01.567 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 8 - Extras common packages 25 kB/s | 6.6 kB 00:00 2023-06-24T14:09:03.450 INFO:teuthology.orchestra.run.smithi132.stdout:Copr repo for python3-asyncssh owned by ceph 1.3 kB/s | 3.5 kB 00:02 2023-06-24T14:09:04.031 INFO:teuthology.orchestra.run.smithi104.stdout:Copr repo for python3-asyncssh owned by ceph 1.3 kB/s | 3.5 kB 00:02 2023-06-24T14:09:04.343 INFO:teuthology.orchestra.run.smithi181.stdout:Copr repo for python3-asyncssh owned by ceph 1.3 kB/s | 3.5 kB 00:02 2023-06-24T14:09:06.056 INFO:teuthology.orchestra.run.smithi104.stdout:Extra Packages for Enterprise Linux 8.3 MB/s | 16 MB 00:01 2023-06-24T14:09:06.651 INFO:teuthology.orchestra.run.smithi132.stdout:Extra Packages for Enterprise Linux 5.1 MB/s | 16 MB 00:03 2023-06-24T14:09:07.870 INFO:teuthology.orchestra.run.smithi181.stdout:Extra Packages for Enterprise Linux 4.6 MB/s | 16 MB 00:03 2023-06-24T14:09:09.805 INFO:teuthology.orchestra.run.smithi104.stdout:lab-extras 517 kB/s | 24 kB 00:00 2023-06-24T14:09:10.376 INFO:teuthology.orchestra.run.smithi132.stdout:lab-extras 419 kB/s | 24 kB 00:00 2023-06-24T14:09:11.568 INFO:teuthology.orchestra.run.smithi181.stdout:lab-extras 421 kB/s | 24 kB 00:00 2023-06-24T14:09:12.970 INFO:teuthology.orchestra.run.smithi104.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2023-06-24T14:09:12.971 INFO:teuthology.orchestra.run.smithi104.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2023-06-24T14:09:13.189 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2023-06-24T14:09:13.190 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2023-06-24T14:09:13.190 INFO:teuthology.orchestra.run.smithi104.stdout: Package Architecture Version Repository Size 2023-06-24T14:09:13.191 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2023-06-24T14:09:13.191 INFO:teuthology.orchestra.run.smithi104.stdout:Installing: 2023-06-24T14:09:13.191 INFO:teuthology.orchestra.run.smithi104.stdout: kernel x86_64 4.18.0-497.el8 baseos 9.6 M 2023-06-24T14:09:13.191 INFO:teuthology.orchestra.run.smithi104.stdout:Installing dependencies: 2023-06-24T14:09:13.192 INFO:teuthology.orchestra.run.smithi104.stdout: kernel-core x86_64 4.18.0-497.el8 baseos 42 M 2023-06-24T14:09:13.192 INFO:teuthology.orchestra.run.smithi104.stdout: kernel-modules x86_64 4.18.0-497.el8 baseos 35 M 2023-06-24T14:09:13.192 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-06-24T14:09:13.192 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction Summary 2023-06-24T14:09:13.192 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2023-06-24T14:09:13.193 INFO:teuthology.orchestra.run.smithi104.stdout:Install 3 Packages 2023-06-24T14:09:13.193 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-06-24T14:09:13.193 INFO:teuthology.orchestra.run.smithi104.stdout:Total download size: 87 M 2023-06-24T14:09:13.194 INFO:teuthology.orchestra.run.smithi104.stdout:Installed size: 95 M 2023-06-24T14:09:13.194 INFO:teuthology.orchestra.run.smithi104.stdout:Downloading Packages: 2023-06-24T14:09:13.457 INFO:teuthology.orchestra.run.smithi132.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2023-06-24T14:09:13.458 INFO:teuthology.orchestra.run.smithi132.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2023-06-24T14:09:13.687 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2023-06-24T14:09:13.688 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2023-06-24T14:09:13.688 INFO:teuthology.orchestra.run.smithi132.stdout: Package Architecture Version Repository Size 2023-06-24T14:09:13.688 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2023-06-24T14:09:13.688 INFO:teuthology.orchestra.run.smithi132.stdout:Installing: 2023-06-24T14:09:13.689 INFO:teuthology.orchestra.run.smithi132.stdout: kernel x86_64 4.18.0-497.el8 baseos 9.6 M 2023-06-24T14:09:13.689 INFO:teuthology.orchestra.run.smithi132.stdout:Installing dependencies: 2023-06-24T14:09:13.689 INFO:teuthology.orchestra.run.smithi132.stdout: kernel-core x86_64 4.18.0-497.el8 baseos 42 M 2023-06-24T14:09:13.689 INFO:teuthology.orchestra.run.smithi132.stdout: kernel-modules x86_64 4.18.0-497.el8 baseos 35 M 2023-06-24T14:09:13.689 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-06-24T14:09:13.689 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2023-06-24T14:09:13.690 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2023-06-24T14:09:13.690 INFO:teuthology.orchestra.run.smithi132.stdout:Install 3 Packages 2023-06-24T14:09:13.690 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-06-24T14:09:13.690 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 87 M 2023-06-24T14:09:13.691 INFO:teuthology.orchestra.run.smithi132.stdout:Installed size: 95 M 2023-06-24T14:09:13.691 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading Packages: 2023-06-24T14:09:13.981 INFO:teuthology.orchestra.run.smithi104.stdout:(1/3): kernel-4.18.0-497.el8.x86_64.rpm 13 MB/s | 9.6 MB 00:00 2023-06-24T14:09:14.657 INFO:teuthology.orchestra.run.smithi104.stdout:(2/3): kernel-modules-4.18.0-497.el8.x86_64.rpm 25 MB/s | 35 MB 00:01 2023-06-24T14:09:14.666 INFO:teuthology.orchestra.run.smithi181.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2023-06-24T14:09:14.667 INFO:teuthology.orchestra.run.smithi181.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2023-06-24T14:09:14.881 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2023-06-24T14:09:14.882 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2023-06-24T14:09:14.882 INFO:teuthology.orchestra.run.smithi181.stdout: Package Architecture Version Repository Size 2023-06-24T14:09:14.883 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2023-06-24T14:09:14.883 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2023-06-24T14:09:14.883 INFO:teuthology.orchestra.run.smithi181.stdout: kernel x86_64 4.18.0-497.el8 baseos 9.6 M 2023-06-24T14:09:14.883 INFO:teuthology.orchestra.run.smithi181.stdout:Installing dependencies: 2023-06-24T14:09:14.883 INFO:teuthology.orchestra.run.smithi181.stdout: kernel-core x86_64 4.18.0-497.el8 baseos 42 M 2023-06-24T14:09:14.883 INFO:teuthology.orchestra.run.smithi181.stdout: kernel-modules x86_64 4.18.0-497.el8 baseos 35 M 2023-06-24T14:09:14.883 INFO:teuthology.orchestra.run.smithi181.stdout: 2023-06-24T14:09:14.884 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2023-06-24T14:09:14.884 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2023-06-24T14:09:14.884 INFO:teuthology.orchestra.run.smithi181.stdout:Install 3 Packages 2023-06-24T14:09:14.884 INFO:teuthology.orchestra.run.smithi181.stdout: 2023-06-24T14:09:14.884 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 87 M 2023-06-24T14:09:14.885 INFO:teuthology.orchestra.run.smithi181.stdout:Installed size: 95 M 2023-06-24T14:09:14.885 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2023-06-24T14:09:15.382 INFO:teuthology.orchestra.run.smithi104.stdout:(3/3): kernel-core-4.18.0-497.el8.x86_64.rpm 20 MB/s | 42 MB 00:02 2023-06-24T14:09:15.382 INFO:teuthology.orchestra.run.smithi104.stdout:-------------------------------------------------------------------------------- 2023-06-24T14:09:15.382 INFO:teuthology.orchestra.run.smithi104.stdout:Total 40 MB/s | 87 MB 00:02 2023-06-24T14:09:15.460 INFO:teuthology.orchestra.run.smithi132.stdout:(1/3): kernel-4.18.0-497.el8.x86_64.rpm 6.3 MB/s | 9.6 MB 00:01 2023-06-24T14:09:16.043 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction check 2023-06-24T14:09:16.457 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction check succeeded. 2023-06-24T14:09:16.457 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction test 2023-06-24T14:09:16.469 INFO:teuthology.orchestra.run.smithi181.stdout:(1/3): kernel-4.18.0-497.el8.x86_64.rpm 6.4 MB/s | 9.6 MB 00:01 2023-06-24T14:09:16.824 INFO:teuthology.orchestra.run.smithi132.stdout:(2/3): kernel-core-4.18.0-497.el8.x86_64.rpm 15 MB/s | 42 MB 00:02 2023-06-24T14:09:17.161 INFO:teuthology.orchestra.run.smithi132.stdout:(3/3): kernel-modules-4.18.0-497.el8.x86_64.rpm 11 MB/s | 35 MB 00:03 2023-06-24T14:09:17.161 INFO:teuthology.orchestra.run.smithi132.stdout:-------------------------------------------------------------------------------- 2023-06-24T14:09:17.162 INFO:teuthology.orchestra.run.smithi132.stdout:Total 25 MB/s | 87 MB 00:03 2023-06-24T14:09:17.646 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction test succeeded. 2023-06-24T14:09:17.668 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction 2023-06-24T14:09:17.794 INFO:teuthology.orchestra.run.smithi181.stdout:(2/3): kernel-modules-4.18.0-497.el8.x86_64.rpm 12 MB/s | 35 MB 00:02 2023-06-24T14:09:17.811 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2023-06-24T14:09:18.245 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction check succeeded. 2023-06-24T14:09:18.245 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2023-06-24T14:09:18.336 INFO:teuthology.orchestra.run.smithi181.stdout:(3/3): kernel-core-4.18.0-497.el8.x86_64.rpm 13 MB/s | 42 MB 00:03 2023-06-24T14:09:18.337 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2023-06-24T14:09:18.337 INFO:teuthology.orchestra.run.smithi181.stdout:Total 25 MB/s | 87 MB 00:03 2023-06-24T14:09:18.994 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2023-06-24T14:09:19.403 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2023-06-24T14:09:19.403 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2023-06-24T14:09:19.464 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded. 2023-06-24T14:09:19.489 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2023-06-24T14:09:20.431 INFO:teuthology.orchestra.run.smithi104.stdout: Preparing : 1/1 2023-06-24T14:09:20.594 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2023-06-24T14:09:20.620 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2023-06-24T14:09:20.952 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : kernel-core-4.18.0-497.el8.x86_64 1/3 2023-06-24T14:09:22.244 INFO:teuthology.orchestra.run.smithi132.stdout: Preparing : 1/1 2023-06-24T14:09:22.743 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : kernel-core-4.18.0-497.el8.x86_64 1/3 2023-06-24T14:09:23.373 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2023-06-24T14:09:23.867 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : kernel-core-4.18.0-497.el8.x86_64 1/3 2023-06-24T14:09:24.463 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: kernel-core-4.18.0-497.el8.x86_64 1/3 2023-06-24T14:09:24.893 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : kernel-modules-4.18.0-497.el8.x86_64 2/3 2023-06-24T14:09:26.306 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: kernel-core-4.18.0-497.el8.x86_64 1/3 2023-06-24T14:09:26.718 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : kernel-modules-4.18.0-497.el8.x86_64 2/3 2023-06-24T14:09:27.436 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: kernel-core-4.18.0-497.el8.x86_64 1/3 2023-06-24T14:09:27.825 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : kernel-modules-4.18.0-497.el8.x86_64 2/3 2023-06-24T14:09:28.238 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: kernel-modules-4.18.0-497.el8.x86_64 2/3 2023-06-24T14:09:28.510 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : kernel-4.18.0-497.el8.x86_64 3/3 2023-06-24T14:09:30.062 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: kernel-modules-4.18.0-497.el8.x86_64 2/3 2023-06-24T14:09:30.328 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : kernel-4.18.0-497.el8.x86_64 3/3 2023-06-24T14:09:31.228 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: kernel-modules-4.18.0-497.el8.x86_64 2/3 2023-06-24T14:09:31.494 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : kernel-4.18.0-497.el8.x86_64 3/3 2023-06-24T14:09:50.250 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: kernel-core-4.18.0-497.el8.x86_64 3/3 2023-06-24T14:09:50.272 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: kernel-modules-4.18.0-497.el8.x86_64 3/3 2023-06-24T14:09:50.642 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: kernel-4.18.0-497.el8.x86_64 3/3 2023-06-24T14:09:50.643 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : kernel-4.18.0-497.el8.x86_64 1/3 2023-06-24T14:09:50.643 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : kernel-core-4.18.0-497.el8.x86_64 2/3 2023-06-24T14:09:51.285 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : kernel-modules-4.18.0-497.el8.x86_64 3/3 2023-06-24T14:09:51.285 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-06-24T14:09:51.286 INFO:teuthology.orchestra.run.smithi104.stdout:Installed: 2023-06-24T14:09:51.286 INFO:teuthology.orchestra.run.smithi104.stdout: kernel-4.18.0-497.el8.x86_64 kernel-core-4.18.0-497.el8.x86_64 2023-06-24T14:09:51.286 INFO:teuthology.orchestra.run.smithi104.stdout: kernel-modules-4.18.0-497.el8.x86_64 2023-06-24T14:09:51.286 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-06-24T14:09:51.286 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2023-06-24T14:09:51.445 DEBUG:teuthology.orchestra.run.smithi104:> rpm -q kernel | sort -rV | head -n 1 2023-06-24T14:09:51.654 INFO:teuthology.orchestra.run.smithi104.stdout:kernel-4.18.0-497.el8.x86_64 2023-06-24T14:09:51.655 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-497.el8.x86_64 2023-06-24T14:09:51.656 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-497.el8.x86_64 2023-06-24T14:09:51.656 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-06-24T14:09:51.656 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-06-24T14:09:51.656 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-06-24T14:09:51.656 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi104.front.sepia.ceph.com, path=None, version=distro) 2023-06-24T14:09:51.657 DEBUG:teuthology.orchestra.run.smithi104:> rpm -q kernel | sort -rV | head -n 1 2023-06-24T14:09:51.861 INFO:teuthology.orchestra.run.smithi104.stdout:kernel-4.18.0-497.el8.x86_64 2023-06-24T14:09:51.862 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-497.el8.x86_64 2023-06-24T14:09:51.862 DEBUG:teuthology.orchestra.run.smithi104:> sudo rpm -qi grub2-tools 2023-06-24T14:09:51.895 INFO:teuthology.orchestra.run.smithi104.stdout:Name : grub2-tools 2023-06-24T14:09:51.896 INFO:teuthology.orchestra.run.smithi104.stdout:Epoch : 1 2023-06-24T14:09:51.896 INFO:teuthology.orchestra.run.smithi104.stdout:Version : 2.02 2023-06-24T14:09:51.896 INFO:teuthology.orchestra.run.smithi104.stdout:Release : 129.el8 2023-06-24T14:09:51.896 INFO:teuthology.orchestra.run.smithi104.stdout:Architecture: x86_64 2023-06-24T14:09:51.896 INFO:teuthology.orchestra.run.smithi104.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-06-24T14:09:51.896 INFO:teuthology.orchestra.run.smithi104.stdout:Group : System Environment/Base 2023-06-24T14:09:51.897 INFO:teuthology.orchestra.run.smithi104.stdout:Size : 9265586 2023-06-24T14:09:51.897 INFO:teuthology.orchestra.run.smithi104.stdout:License : GPLv3+ 2023-06-24T14:09:51.897 INFO:teuthology.orchestra.run.smithi104.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-06-24T14:09:51.897 INFO:teuthology.orchestra.run.smithi104.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-06-24T14:09:51.897 INFO:teuthology.orchestra.run.smithi104.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-06-24T14:09:51.897 INFO:teuthology.orchestra.run.smithi104.stdout:Build Host : kbuilder.bsys.centos.org 2023-06-24T14:09:51.897 INFO:teuthology.orchestra.run.smithi104.stdout:Relocations : (not relocatable) 2023-06-24T14:09:51.898 INFO:teuthology.orchestra.run.smithi104.stdout:Packager : CentOS BuildSystem 2023-06-24T14:09:51.898 INFO:teuthology.orchestra.run.smithi104.stdout:Vendor : CentOS 2023-06-24T14:09:51.898 INFO:teuthology.orchestra.run.smithi104.stdout:URL : http://www.gnu.org/software/grub/ 2023-06-24T14:09:51.898 INFO:teuthology.orchestra.run.smithi104.stdout:Summary : Support tools for GRUB. 2023-06-24T14:09:51.898 INFO:teuthology.orchestra.run.smithi104.stdout:Description : 2023-06-24T14:09:51.898 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-06-24T14:09:51.898 INFO:teuthology.orchestra.run.smithi104.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-06-24T14:09:51.898 INFO:teuthology.orchestra.run.smithi104.stdout:customizable bootloader with modular architecture. It supports a rich 2023-06-24T14:09:51.899 INFO:teuthology.orchestra.run.smithi104.stdout:variety of kernel formats, file systems, computer architectures and 2023-06-24T14:09:51.899 INFO:teuthology.orchestra.run.smithi104.stdout:hardware devices. 2023-06-24T14:09:51.899 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-06-24T14:09:51.899 INFO:teuthology.orchestra.run.smithi104.stdout:This subpackage provides tools for support of all platforms. 2023-06-24T14:09:51.900 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-06-24T14:09:51.900 INFO:teuthology.task.kernel:Updating grub on smithi104 to boot 4.18.0-497.el8.x86_64 2023-06-24T14:09:51.900 DEBUG:teuthology.orchestra.run.smithi104:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-06-24T14:09:52.033 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: kernel-core-4.18.0-497.el8.x86_64 3/3 2023-06-24T14:09:52.056 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: kernel-modules-4.18.0-497.el8.x86_64 3/3 2023-06-24T14:09:52.399 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: kernel-4.18.0-497.el8.x86_64 3/3 2023-06-24T14:09:52.400 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : kernel-4.18.0-497.el8.x86_64 1/3 2023-06-24T14:09:52.400 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : kernel-core-4.18.0-497.el8.x86_64 2/3 2023-06-24T14:09:53.042 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : kernel-modules-4.18.0-497.el8.x86_64 3/3 2023-06-24T14:09:53.043 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-06-24T14:09:53.043 INFO:teuthology.orchestra.run.smithi132.stdout:Installed: 2023-06-24T14:09:53.043 INFO:teuthology.orchestra.run.smithi132.stdout: kernel-4.18.0-497.el8.x86_64 kernel-core-4.18.0-497.el8.x86_64 2023-06-24T14:09:53.043 INFO:teuthology.orchestra.run.smithi132.stdout: kernel-modules-4.18.0-497.el8.x86_64 2023-06-24T14:09:53.043 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-06-24T14:09:53.044 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2023-06-24T14:09:53.185 DEBUG:teuthology.orchestra.run.smithi132:> rpm -q kernel | sort -rV | head -n 1 2023-06-24T14:09:53.206 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: kernel-core-4.18.0-497.el8.x86_64 3/3 2023-06-24T14:09:53.228 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: kernel-modules-4.18.0-497.el8.x86_64 3/3 2023-06-24T14:09:53.395 INFO:teuthology.orchestra.run.smithi132.stdout:kernel-4.18.0-497.el8.x86_64 2023-06-24T14:09:53.396 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-497.el8.x86_64 2023-06-24T14:09:53.397 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-497.el8.x86_64 2023-06-24T14:09:53.397 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-06-24T14:09:53.397 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-06-24T14:09:53.398 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-06-24T14:09:53.398 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi132.front.sepia.ceph.com, path=None, version=distro) 2023-06-24T14:09:53.398 DEBUG:teuthology.orchestra.run.smithi132:> rpm -q kernel | sort -rV | head -n 1 2023-06-24T14:09:53.568 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: kernel-4.18.0-497.el8.x86_64 3/3 2023-06-24T14:09:53.569 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : kernel-4.18.0-497.el8.x86_64 1/3 2023-06-24T14:09:53.569 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : kernel-core-4.18.0-497.el8.x86_64 2/3 2023-06-24T14:09:53.604 INFO:teuthology.orchestra.run.smithi132.stdout:kernel-4.18.0-497.el8.x86_64 2023-06-24T14:09:53.605 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-497.el8.x86_64 2023-06-24T14:09:53.605 DEBUG:teuthology.orchestra.run.smithi132:> sudo rpm -qi grub2-tools 2023-06-24T14:09:53.638 INFO:teuthology.orchestra.run.smithi132.stdout:Name : grub2-tools 2023-06-24T14:09:53.638 INFO:teuthology.orchestra.run.smithi132.stdout:Epoch : 1 2023-06-24T14:09:53.639 INFO:teuthology.orchestra.run.smithi132.stdout:Version : 2.02 2023-06-24T14:09:53.639 INFO:teuthology.orchestra.run.smithi132.stdout:Release : 129.el8 2023-06-24T14:09:53.639 INFO:teuthology.orchestra.run.smithi132.stdout:Architecture: x86_64 2023-06-24T14:09:53.639 INFO:teuthology.orchestra.run.smithi132.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-06-24T14:09:53.639 INFO:teuthology.orchestra.run.smithi132.stdout:Group : System Environment/Base 2023-06-24T14:09:53.639 INFO:teuthology.orchestra.run.smithi132.stdout:Size : 9265586 2023-06-24T14:09:53.640 INFO:teuthology.orchestra.run.smithi132.stdout:License : GPLv3+ 2023-06-24T14:09:53.640 INFO:teuthology.orchestra.run.smithi132.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-06-24T14:09:53.640 INFO:teuthology.orchestra.run.smithi132.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-06-24T14:09:53.640 INFO:teuthology.orchestra.run.smithi132.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-06-24T14:09:53.640 INFO:teuthology.orchestra.run.smithi132.stdout:Build Host : kbuilder.bsys.centos.org 2023-06-24T14:09:53.640 INFO:teuthology.orchestra.run.smithi132.stdout:Relocations : (not relocatable) 2023-06-24T14:09:53.640 INFO:teuthology.orchestra.run.smithi132.stdout:Packager : CentOS BuildSystem 2023-06-24T14:09:53.641 INFO:teuthology.orchestra.run.smithi132.stdout:Vendor : CentOS 2023-06-24T14:09:53.641 INFO:teuthology.orchestra.run.smithi132.stdout:URL : http://www.gnu.org/software/grub/ 2023-06-24T14:09:53.641 INFO:teuthology.orchestra.run.smithi132.stdout:Summary : Support tools for GRUB. 2023-06-24T14:09:53.641 INFO:teuthology.orchestra.run.smithi132.stdout:Description : 2023-06-24T14:09:53.641 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-06-24T14:09:53.641 INFO:teuthology.orchestra.run.smithi132.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-06-24T14:09:53.641 INFO:teuthology.orchestra.run.smithi132.stdout:customizable bootloader with modular architecture. It supports a rich 2023-06-24T14:09:53.641 INFO:teuthology.orchestra.run.smithi132.stdout:variety of kernel formats, file systems, computer architectures and 2023-06-24T14:09:53.642 INFO:teuthology.orchestra.run.smithi132.stdout:hardware devices. 2023-06-24T14:09:53.642 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-06-24T14:09:53.642 INFO:teuthology.orchestra.run.smithi132.stdout:This subpackage provides tools for support of all platforms. 2023-06-24T14:09:53.643 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-06-24T14:09:53.643 INFO:teuthology.task.kernel:Updating grub on smithi132 to boot 4.18.0-497.el8.x86_64 2023-06-24T14:09:53.643 DEBUG:teuthology.orchestra.run.smithi132:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-06-24T14:09:53.712 INFO:teuthology.orchestra.run.smithi104.stderr:Generating grub configuration file ... 2023-06-24T14:09:54.219 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : kernel-modules-4.18.0-497.el8.x86_64 3/3 2023-06-24T14:09:54.219 INFO:teuthology.orchestra.run.smithi181.stdout: 2023-06-24T14:09:54.219 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2023-06-24T14:09:54.219 INFO:teuthology.orchestra.run.smithi181.stdout: kernel-4.18.0-497.el8.x86_64 kernel-core-4.18.0-497.el8.x86_64 2023-06-24T14:09:54.220 INFO:teuthology.orchestra.run.smithi181.stdout: kernel-modules-4.18.0-497.el8.x86_64 2023-06-24T14:09:54.220 INFO:teuthology.orchestra.run.smithi181.stdout: 2023-06-24T14:09:54.220 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2023-06-24T14:09:54.363 DEBUG:teuthology.orchestra.run.smithi181:> rpm -q kernel | sort -rV | head -n 1 2023-06-24T14:09:54.576 INFO:teuthology.orchestra.run.smithi181.stdout:kernel-4.18.0-497.el8.x86_64 2023-06-24T14:09:54.576 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-497.el8.x86_64 2023-06-24T14:09:54.576 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-497.el8.x86_64 2023-06-24T14:09:54.576 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-06-24T14:09:54.577 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-06-24T14:09:54.577 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2023-06-24T14:09:54.577 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi181.front.sepia.ceph.com, path=None, version=distro) 2023-06-24T14:09:54.577 DEBUG:teuthology.orchestra.run.smithi181:> rpm -q kernel | sort -rV | head -n 1 2023-06-24T14:09:54.782 INFO:teuthology.orchestra.run.smithi181.stdout:kernel-4.18.0-497.el8.x86_64 2023-06-24T14:09:54.782 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-497.el8.x86_64 2023-06-24T14:09:54.782 DEBUG:teuthology.orchestra.run.smithi181:> sudo rpm -qi grub2-tools 2023-06-24T14:09:54.816 INFO:teuthology.orchestra.run.smithi181.stdout:Name : grub2-tools 2023-06-24T14:09:54.816 INFO:teuthology.orchestra.run.smithi181.stdout:Epoch : 1 2023-06-24T14:09:54.817 INFO:teuthology.orchestra.run.smithi181.stdout:Version : 2.02 2023-06-24T14:09:54.817 INFO:teuthology.orchestra.run.smithi181.stdout:Release : 129.el8 2023-06-24T14:09:54.817 INFO:teuthology.orchestra.run.smithi181.stdout:Architecture: x86_64 2023-06-24T14:09:54.817 INFO:teuthology.orchestra.run.smithi181.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-06-24T14:09:54.817 INFO:teuthology.orchestra.run.smithi181.stdout:Group : System Environment/Base 2023-06-24T14:09:54.817 INFO:teuthology.orchestra.run.smithi181.stdout:Size : 9265586 2023-06-24T14:09:54.817 INFO:teuthology.orchestra.run.smithi181.stdout:License : GPLv3+ 2023-06-24T14:09:54.818 INFO:teuthology.orchestra.run.smithi181.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-06-24T14:09:54.818 INFO:teuthology.orchestra.run.smithi181.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-06-24T14:09:54.818 INFO:teuthology.orchestra.run.smithi181.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-06-24T14:09:54.818 INFO:teuthology.orchestra.run.smithi181.stdout:Build Host : kbuilder.bsys.centos.org 2023-06-24T14:09:54.818 INFO:teuthology.orchestra.run.smithi181.stdout:Relocations : (not relocatable) 2023-06-24T14:09:54.818 INFO:teuthology.orchestra.run.smithi181.stdout:Packager : CentOS BuildSystem 2023-06-24T14:09:54.818 INFO:teuthology.orchestra.run.smithi181.stdout:Vendor : CentOS 2023-06-24T14:09:54.818 INFO:teuthology.orchestra.run.smithi181.stdout:URL : http://www.gnu.org/software/grub/ 2023-06-24T14:09:54.819 INFO:teuthology.orchestra.run.smithi181.stdout:Summary : Support tools for GRUB. 2023-06-24T14:09:54.819 INFO:teuthology.orchestra.run.smithi181.stdout:Description : 2023-06-24T14:09:54.819 INFO:teuthology.orchestra.run.smithi181.stdout: 2023-06-24T14:09:54.819 INFO:teuthology.orchestra.run.smithi181.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-06-24T14:09:54.819 INFO:teuthology.orchestra.run.smithi181.stdout:customizable bootloader with modular architecture. It supports a rich 2023-06-24T14:09:54.819 INFO:teuthology.orchestra.run.smithi181.stdout:variety of kernel formats, file systems, computer architectures and 2023-06-24T14:09:54.819 INFO:teuthology.orchestra.run.smithi181.stdout:hardware devices. 2023-06-24T14:09:54.820 INFO:teuthology.orchestra.run.smithi181.stdout: 2023-06-24T14:09:54.820 INFO:teuthology.orchestra.run.smithi181.stdout:This subpackage provides tools for support of all platforms. 2023-06-24T14:09:54.821 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-06-24T14:09:54.821 INFO:teuthology.task.kernel:Updating grub on smithi181 to boot 4.18.0-497.el8.x86_64 2023-06-24T14:09:54.821 DEBUG:teuthology.orchestra.run.smithi181:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-06-24T14:09:55.512 INFO:teuthology.orchestra.run.smithi132.stderr:Generating grub configuration file ... 2023-06-24T14:09:56.232 INFO:teuthology.orchestra.run.smithi104.stderr:done 2023-06-24T14:09:56.234 DEBUG:teuthology.orchestra.run.smithi104:> mktemp 2023-06-24T14:09:56.263 INFO:teuthology.orchestra.run.smithi104.stdout:/tmp/tmp.oMNsIuV7fj 2023-06-24T14:09:56.263 DEBUG:teuthology.orchestra.run.smithi104:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.oMNsIuV7fj 2023-06-24T14:09:56.341 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 0666 /tmp/tmp.oMNsIuV7fj 2023-06-24T14:09:56.485 DEBUG:teuthology.orchestra.remote:smithi104:/tmp/tmp.oMNsIuV7fj is 6KB 2023-06-24T14:09:56.496 INFO:teuthology.orchestra.run.smithi181.stderr:Generating grub configuration file ... 2023-06-24T14:09:56.531 DEBUG:teuthology.orchestra.run.smithi104:> rm -fr /tmp/tmp.oMNsIuV7fj 2023-06-24T14:09:56.549 DEBUG:teuthology.orchestra.run.smithi104:> sudo /bin/ls /boot/loader/entries || true 2023-06-24T14:09:56.622 INFO:teuthology.orchestra.run.smithi104.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-06-24T14:09:56.622 INFO:teuthology.orchestra.run.smithi104.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-06-24T14:09:56.623 INFO:teuthology.orchestra.run.smithi104.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-06-24T14:09:56.623 INFO:teuthology.orchestra.run.smithi104.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-497.el8.x86_64.conf 2023-06-24T14:09:56.624 DEBUG:teuthology.orchestra.run.smithi104:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-497.el8.x86_64 2023-06-24T14:09:56.771 DEBUG:teuthology.orchestra.run.smithi104:> sudo shutdown -r now 2023-06-24T14:09:57.666 INFO:teuthology.orchestra.run.smithi132.stderr:done 2023-06-24T14:09:57.668 DEBUG:teuthology.orchestra.run.smithi132:> mktemp 2023-06-24T14:09:57.695 INFO:teuthology.orchestra.run.smithi132.stdout:/tmp/tmp.vR7792OTLH 2023-06-24T14:09:57.696 DEBUG:teuthology.orchestra.run.smithi132:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.vR7792OTLH 2023-06-24T14:09:57.782 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 0666 /tmp/tmp.vR7792OTLH 2023-06-24T14:09:57.884 DEBUG:teuthology.orchestra.remote:smithi132:/tmp/tmp.vR7792OTLH is 6KB 2023-06-24T14:09:57.931 DEBUG:teuthology.orchestra.run.smithi132:> rm -fr /tmp/tmp.vR7792OTLH 2023-06-24T14:09:57.948 DEBUG:teuthology.orchestra.run.smithi132:> sudo /bin/ls /boot/loader/entries || true 2023-06-24T14:09:58.021 INFO:teuthology.orchestra.run.smithi132.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-06-24T14:09:58.021 INFO:teuthology.orchestra.run.smithi132.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-06-24T14:09:58.022 INFO:teuthology.orchestra.run.smithi132.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-06-24T14:09:58.022 INFO:teuthology.orchestra.run.smithi132.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-497.el8.x86_64.conf 2023-06-24T14:09:58.023 DEBUG:teuthology.orchestra.run.smithi132:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-497.el8.x86_64 2023-06-24T14:09:58.185 DEBUG:teuthology.orchestra.run.smithi132:> sudo shutdown -r now 2023-06-24T14:09:58.678 INFO:teuthology.orchestra.run.smithi181.stderr:done 2023-06-24T14:09:58.679 DEBUG:teuthology.orchestra.run.smithi181:> mktemp 2023-06-24T14:09:58.722 INFO:teuthology.orchestra.run.smithi181.stdout:/tmp/tmp.QEugjiw8NO 2023-06-24T14:09:58.722 DEBUG:teuthology.orchestra.run.smithi181:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.QEugjiw8NO 2023-06-24T14:09:58.796 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 0666 /tmp/tmp.QEugjiw8NO 2023-06-24T14:09:58.938 DEBUG:teuthology.orchestra.remote:smithi181:/tmp/tmp.QEugjiw8NO is 6KB 2023-06-24T14:09:58.986 DEBUG:teuthology.orchestra.run.smithi181:> rm -fr /tmp/tmp.QEugjiw8NO 2023-06-24T14:09:59.003 DEBUG:teuthology.orchestra.run.smithi181:> sudo /bin/ls /boot/loader/entries || true 2023-06-24T14:09:59.072 INFO:teuthology.orchestra.run.smithi181.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-06-24T14:09:59.072 INFO:teuthology.orchestra.run.smithi181.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-06-24T14:09:59.073 INFO:teuthology.orchestra.run.smithi181.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-06-24T14:09:59.073 INFO:teuthology.orchestra.run.smithi181.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-497.el8.x86_64.conf 2023-06-24T14:09:59.074 DEBUG:teuthology.orchestra.run.smithi181:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-497.el8.x86_64 2023-06-24T14:09:59.295 DEBUG:teuthology.orchestra.run.smithi181:> sudo shutdown -r now 2023-06-24T14:10:26.800 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-06-24T14:10:26.801 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com' 2023-06-24T14:10:26.802 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-24T14:10:28.188 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-06-24T14:10:28.189 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2023-06-24T14:10:28.189 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-24T14:10:29.298 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-06-24T14:10:29.299 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2023-06-24T14:10:29.299 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-24T14:11:26.860 DEBUG:teuthology.orchestra.remote:timed out 2023-06-24T14:11:28.192 DEBUG:teuthology.orchestra.remote:timed out 2023-06-24T14:11:29.302 DEBUG:teuthology.orchestra.remote:timed out 2023-06-24T14:11:56.888 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com' 2023-06-24T14:11:56.889 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-24T14:11:57.222 DEBUG:teuthology.orchestra.run.smithi104:> true 2023-06-24T14:11:57.509 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi104.front.sepia.ceph.com' 2023-06-24T14:11:57.510 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.18.0-497.el8.x86_64"... 2023-06-24T14:11:57.510 DEBUG:teuthology.orchestra.run.smithi104:> uname -r 2023-06-24T14:11:57.529 INFO:teuthology.orchestra.run.smithi104.stdout:4.18.0-497.el8.x86_64 2023-06-24T14:11:57.529 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-497.el8.x86_64 vs 4.18.0-497.el8.x86_64 2023-06-24T14:11:57.529 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-06-24T14:11:57.530 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-06-24T14:11:58.194 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2023-06-24T14:11:58.194 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-24T14:11:58.455 DEBUG:teuthology.orchestra.run.smithi132:> true 2023-06-24T14:11:58.530 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-06-24T14:11:58.531 DEBUG:teuthology.orchestra.run.smithi104:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-06-24T14:11:58.612 INFO:teuthology.orchestra.run.smithi104.stdout:ttyS1 2023-06-24T14:11:58.628 DEBUG:teuthology.parallel:result is None 2023-06-24T14:11:58.757 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi132.front.sepia.ceph.com' 2023-06-24T14:11:58.780 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "4.18.0-497.el8.x86_64"... 2023-06-24T14:11:58.781 DEBUG:teuthology.orchestra.run.smithi132:> uname -r 2023-06-24T14:11:58.818 INFO:teuthology.orchestra.run.smithi132.stdout:4.18.0-497.el8.x86_64 2023-06-24T14:11:58.818 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-497.el8.x86_64 vs 4.18.0-497.el8.x86_64 2023-06-24T14:11:58.818 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-06-24T14:11:58.818 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-06-24T14:11:59.304 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2023-06-24T14:11:59.305 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-24T14:11:59.693 DEBUG:teuthology.orchestra.run.smithi181:> true 2023-06-24T14:11:59.819 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-06-24T14:11:59.819 DEBUG:teuthology.orchestra.run.smithi132:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-06-24T14:11:59.889 INFO:teuthology.orchestra.run.smithi132.stdout:ttyS1 2023-06-24T14:11:59.904 DEBUG:teuthology.parallel:result is None 2023-06-24T14:12:00.004 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi181.front.sepia.ceph.com' 2023-06-24T14:12:00.005 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "4.18.0-497.el8.x86_64"... 2023-06-24T14:12:00.005 DEBUG:teuthology.orchestra.run.smithi181:> uname -r 2023-06-24T14:12:00.024 INFO:teuthology.orchestra.run.smithi181.stdout:4.18.0-497.el8.x86_64 2023-06-24T14:12:00.024 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-497.el8.x86_64 vs 4.18.0-497.el8.x86_64 2023-06-24T14:12:00.025 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-06-24T14:12:00.025 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-06-24T14:12:01.026 INFO:teuthology.task.kernel:Enabling kdb on client.0... 2023-06-24T14:12:01.026 DEBUG:teuthology.orchestra.run.smithi181:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-06-24T14:12:01.144 INFO:teuthology.orchestra.run.smithi181.stdout:ttyS1 2023-06-24T14:12:01.159 DEBUG:teuthology.parallel:result is None 2023-06-24T14:12:01.160 INFO:teuthology.run_tasks:Running task internal.base... 2023-06-24T14:12:01.168 INFO:teuthology.task.internal:Creating test directory... 2023-06-24T14:12:01.168 DEBUG:teuthology.orchestra.run.smithi104:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-06-24T14:12:01.171 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-06-24T14:12:01.173 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-06-24T14:12:01.194 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-06-24T14:12:01.218 INFO:teuthology.run_tasks:Running task internal.archive... 2023-06-24T14:12:01.260 INFO:teuthology.task.internal:Creating archive directory... 2023-06-24T14:12:01.260 DEBUG:teuthology.orchestra.run.smithi104:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-06-24T14:12:01.263 DEBUG:teuthology.orchestra.run.smithi132:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-06-24T14:12:01.265 DEBUG:teuthology.orchestra.run.smithi181:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-06-24T14:12:01.305 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-06-24T14:12:01.312 INFO:teuthology.task.internal:Enabling coredump saving... 2023-06-24T14:12:01.313 DEBUG:teuthology.orchestra.run.smithi104:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-06-24T14:12:01.330 DEBUG:teuthology.orchestra.run.smithi132:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-06-24T14:12:01.340 DEBUG:teuthology.orchestra.run.smithi181:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-06-24T14:12:01.373 INFO:teuthology.orchestra.run.smithi104.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-24T14:12:01.373 INFO:teuthology.orchestra.run.smithi132.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-24T14:12:01.375 INFO:teuthology.orchestra.run.smithi181.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-24T14:12:01.384 INFO:teuthology.orchestra.run.smithi104.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-24T14:12:01.384 INFO:teuthology.orchestra.run.smithi132.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-24T14:12:01.387 INFO:teuthology.orchestra.run.smithi181.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-24T14:12:01.388 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-06-24T14:12:01.395 INFO:teuthology.task.internal:Configuring sudo... 2023-06-24T14:12:01.395 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-06-24T14:12:01.397 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-06-24T14:12:01.428 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-06-24T14:12:01.462 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-06-24T14:12:01.470 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-06-24T14:12:01.471 DEBUG:teuthology.orchestra.run.smithi104:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-06-24T14:12:01.473 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-06-24T14:12:01.498 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-06-24T14:12:01.522 DEBUG:teuthology.orchestra.run.smithi104:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-24T14:12:01.578 DEBUG:teuthology.orchestra.run.smithi104:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-24T14:12:01.637 DEBUG:teuthology.orchestra.run.smithi104:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-24T14:12:01.683 DEBUG:teuthology.orchestra.run.smithi104:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-24T14:12:01.723 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2023-06-24T14:12:01.723 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-06-24T14:12:01.790 DEBUG:teuthology.orchestra.run.smithi132:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-24T14:12:01.840 DEBUG:teuthology.orchestra.run.smithi132:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-24T14:12:01.887 DEBUG:teuthology.orchestra.run.smithi132:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-24T14:12:01.979 DEBUG:teuthology.orchestra.run.smithi132:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-24T14:12:02.017 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-06-24T14:12:02.017 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-06-24T14:12:02.085 DEBUG:teuthology.orchestra.run.smithi181:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-24T14:12:02.138 DEBUG:teuthology.orchestra.run.smithi181:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-24T14:12:02.186 DEBUG:teuthology.orchestra.run.smithi181:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-24T14:12:02.275 DEBUG:teuthology.orchestra.run.smithi181:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-24T14:12:02.319 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2023-06-24T14:12:02.319 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-06-24T14:12:02.388 DEBUG:teuthology.orchestra.run.smithi104:> sudo service rsyslog restart 2023-06-24T14:12:02.391 DEBUG:teuthology.orchestra.run.smithi132:> sudo service rsyslog restart 2023-06-24T14:12:02.394 DEBUG:teuthology.orchestra.run.smithi181:> sudo service rsyslog restart 2023-06-24T14:12:02.452 INFO:teuthology.orchestra.run.smithi104.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-06-24T14:12:02.453 INFO:teuthology.orchestra.run.smithi132.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-06-24T14:12:02.485 INFO:teuthology.orchestra.run.smithi181.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-06-24T14:12:02.929 INFO:teuthology.run_tasks:Running task internal.timer... 2023-06-24T14:12:02.943 INFO:teuthology.task.internal:Starting timer... 2023-06-24T14:12:02.944 INFO:teuthology.run_tasks:Running task pcp... 2023-06-24T14:12:03.003 INFO:teuthology.run_tasks:Running task selinux... 2023-06-24T14:12:03.037 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-06-24T14:12:03.038 DEBUG:teuthology.orchestra.run.smithi104:> sudo service auditd rotate 2023-06-24T14:12:03.112 INFO:teuthology.orchestra.run.smithi104.stdout:Rotating logs: 2023-06-24T14:12:03.114 DEBUG:teuthology.orchestra.run.smithi132:> sudo service auditd rotate 2023-06-24T14:12:03.205 INFO:teuthology.orchestra.run.smithi132.stdout:Rotating logs: 2023-06-24T14:12:03.206 DEBUG:teuthology.orchestra.run.smithi181:> sudo service auditd rotate 2023-06-24T14:12:03.301 INFO:teuthology.orchestra.run.smithi181.stdout:Rotating logs: 2023-06-24T14:12:03.303 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-06-24T14:12:03.303 DEBUG:teuthology.orchestra.run.smithi104:> /usr/sbin/getenforce 2023-06-24T14:12:03.328 INFO:teuthology.orchestra.run.smithi104.stdout:Permissive 2023-06-24T14:12:03.329 DEBUG:teuthology.orchestra.run.smithi132:> /usr/sbin/getenforce 2023-06-24T14:12:03.373 INFO:teuthology.orchestra.run.smithi132.stdout:Permissive 2023-06-24T14:12:03.374 DEBUG:teuthology.orchestra.run.smithi181:> /usr/sbin/getenforce 2023-06-24T14:12:03.434 INFO:teuthology.orchestra.run.smithi181.stdout:Permissive 2023-06-24T14:12:03.434 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi104.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi132.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi181.front.sepia.ceph.com': 'permissive'} 2023-06-24T14:12:03.435 DEBUG:teuthology.orchestra.run.smithi104:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-06-24T14:12:03.463 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-24T14:12:03.464 DEBUG:teuthology.orchestra.run.smithi132:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-06-24T14:12:03.491 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-24T14:12:03.492 DEBUG:teuthology.orchestra.run.smithi181:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-06-24T14:12:03.519 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-24T14:12:03.520 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-06-24T14:12:03.520 DEBUG:teuthology.orchestra.run.smithi104:> sudo /usr/sbin/setenforce permissive 2023-06-24T14:12:03.549 DEBUG:teuthology.orchestra.run.smithi132:> sudo /usr/sbin/setenforce permissive 2023-06-24T14:12:03.575 DEBUG:teuthology.orchestra.run.smithi181:> sudo /usr/sbin/setenforce permissive 2023-06-24T14:12:03.603 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-06-24T14:12:03.614 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-06-24T14:12:03.621 INFO:teuthology.repo_utils:Fetching main from origin 2023-06-24T14:12:03.792 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-06-24T14:12:03.814 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-06-24T14:12:03.815 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi104.front.sepia.ceph.com,smithi132.front.sepia.ceph.com,smithi181.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-06-24T14:17:40.207 INFO:teuthology.task.ansible:Archiving ansible failure log at: /home/teuthworker/archive/yuriw-2023-06-23_21:02:01-rbd-reef-distro-default-smithi/7315260/ansible_failures.yaml 2023-06-24T14:17:40.210 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/task/__init__.py", line 123, in __enter__ self.begin() File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/task/ansible.py", line 426, in begin super(CephLab, self).begin() File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/task/ansible.py", line 267, in begin self.execute_playbook() File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/task/ansible.py", line 295, in execute_playbook self._handle_failure(command, status) File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/task/ansible.py", line 320, in _handle_failure raise AnsibleFailedError(failures) teuthology.exceptions.AnsibleFailedError: {'smithi181.front.sepia.ceph.com': {'changed': True, 'msg': 'All items completed', 'results': [{'_ansible_item_label': 'ceph/python3-asyncssh', '_ansible_no_log': False, 'ansible_loop_var': 'item', 'changed': True, 'cmd': ['dnf', '-y', 'copr', 'enable', 'ceph/python3-asyncssh'], 'delta': '0:00:11.936132', 'end': '2023-06-24 14:17:39.685663', 'failed': True, 'invocation': {'module_args': {'_raw_params': 'dnf -y copr enable ceph/python3-asyncssh', '_uses_shell': False, 'argv': None, 'chdir': None, 'creates': None, 'executable': None, 'removes': None, 'stdin': None, 'stdin_add_newline': True, 'strip_empty_ends': True, 'warn': True}}, 'item': 'ceph/python3-asyncssh', 'msg': 'non-zero return code', 'rc': 1, 'start': '2023-06-24 14:17:27.749531', 'stderr': 'Enabling a Copr repository. Please note that this repository is not part\nof the main distribution, and quality may vary.\n\nThe Fedora Project does not exercise any power over the contents of\nthis repository beyond the rules outlined in the Copr FAQ at\n,\nand packages are not held to any quality or security level.\n\nPlease do not file bug reports about these packages in Fedora\nBugzilla. In case of problems, contact the owner of this repository.\nError: Failed to connect to https://copr.fedorainfracloud.org/coprs/ceph/python3-asyncssh/repo/epel-8/dnf.repo?arch=x86_64: Name or service not known', 'stderr_lines': ['Enabling a Copr repository. Please note that this repository is not part', 'of the main distribution, and quality may vary.', '', 'The Fedora Project does not exercise any power over the contents of', 'this repository beyond the rules outlined in the Copr FAQ at', ',', 'and packages are not held to any quality or security level.', '', 'Please do not file bug reports about these packages in Fedora', 'Bugzilla. In case of problems, contact the owner of this repository.', 'Error: Failed to connect to https://copr.fedorainfracloud.org/coprs/ceph/python3-asyncssh/repo/epel-8/dnf.repo?arch=x86_64: Name or service not known'], 'stdout': '', 'stdout_lines': []}], 'warnings': ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."]}, 'smithi132.front.sepia.ceph.com': {'changed': True, 'msg': 'All items completed', 'results': [{'_ansible_item_label': 'ceph/python3-asyncssh', '_ansible_no_log': False, 'ansible_loop_var': 'item', 'changed': True, 'cmd': ['dnf', '-y', 'copr', 'enable', 'ceph/python3-asyncssh'], 'delta': '0:00:11.442072', 'end': '2023-06-24 14:17:39.700663', 'failed': True, 'invocation': {'module_args': {'_raw_params': 'dnf -y copr enable ceph/python3-asyncssh', '_uses_shell': False, 'argv': None, 'chdir': None, 'creates': None, 'executable': None, 'removes': None, 'stdin': None, 'stdin_add_newline': True, 'strip_empty_ends': True, 'warn': True}}, 'item': 'ceph/python3-asyncssh', 'msg': 'non-zero return code', 'rc': 1, 'start': '2023-06-24 14:17:28.258591', 'stderr': 'Enabling a Copr repository. Please note that this repository is not part\nof the main distribution, and quality may vary.\n\nThe Fedora Project does not exercise any power over the contents of\nthis repository beyond the rules outlined in the Copr FAQ at\n,\nand packages are not held to any quality or security level.\n\nPlease do not file bug reports about these packages in Fedora\nBugzilla. In case of problems, contact the owner of this repository.\nError: Failed to connect to https://copr.fedorainfracloud.org/coprs/ceph/python3-asyncssh/repo/epel-8/dnf.repo?arch=x86_64: Name or service not known', 'stderr_lines': ['Enabling a Copr repository. Please note that this repository is not part', 'of the main distribution, and quality may vary.', '', 'The Fedora Project does not exercise any power over the contents of', 'this repository beyond the rules outlined in the Copr FAQ at', ',', 'and packages are not held to any quality or security level.', '', 'Please do not file bug reports about these packages in Fedora', 'Bugzilla. In case of problems, contact the owner of this repository.', 'Error: Failed to connect to https://copr.fedorainfracloud.org/coprs/ceph/python3-asyncssh/repo/epel-8/dnf.repo?arch=x86_64: Name or service not known'], 'stdout': '', 'stdout_lines': []}], 'warnings': ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."]}, 'smithi104.front.sepia.ceph.com': {'changed': True, 'msg': 'All items completed', 'results': [{'_ansible_item_label': 'ceph/python3-asyncssh', '_ansible_no_log': False, 'ansible_loop_var': 'item', 'changed': True, 'cmd': ['dnf', '-y', 'copr', 'enable', 'ceph/python3-asyncssh'], 'delta': '0:00:13.406142', 'end': '2023-06-24 14:17:39.710222', 'failed': True, 'invocation': {'module_args': {'_raw_params': 'dnf -y copr enable ceph/python3-asyncssh', '_uses_shell': False, 'argv': None, 'chdir': None, 'creates': None, 'executable': None, 'removes': None, 'stdin': None, 'stdin_add_newline': True, 'strip_empty_ends': True, 'warn': True}}, 'item': 'ceph/python3-asyncssh', 'msg': 'non-zero return code', 'rc': 1, 'start': '2023-06-24 14:17:26.304080', 'stderr': 'Enabling a Copr repository. Please note that this repository is not part\nof the main distribution, and quality may vary.\n\nThe Fedora Project does not exercise any power over the contents of\nthis repository beyond the rules outlined in the Copr FAQ at\n,\nand packages are not held to any quality or security level.\n\nPlease do not file bug reports about these packages in Fedora\nBugzilla. In case of problems, contact the owner of this repository.\nError: Failed to connect to https://copr.fedorainfracloud.org/coprs/ceph/python3-asyncssh/repo/epel-8/dnf.repo?arch=x86_64: Name or service not known', 'stderr_lines': ['Enabling a Copr repository. Please note that this repository is not part', 'of the main distribution, and quality may vary.', '', 'The Fedora Project does not exercise any power over the contents of', 'this repository beyond the rules outlined in the Copr FAQ at', ',', 'and packages are not held to any quality or security level.', '', 'Please do not file bug reports about these packages in Fedora', 'Bugzilla. In case of problems, contact the owner of this repository.', 'Error: Failed to connect to https://copr.fedorainfracloud.org/coprs/ceph/python3-asyncssh/repo/epel-8/dnf.repo?arch=x86_64: Name or service not known'], 'stdout': '', 'stdout_lines': []}], 'warnings': ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."]}} 2023-06-24T14:17:40.295 ERROR:teuthology.run_tasks: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=b3faf66820a04214b98eeb3cd7cfe56f Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/task/__init__.py", line 123, in __enter__ self.begin() File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/task/ansible.py", line 426, in begin super(CephLab, self).begin() File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/task/ansible.py", line 267, in begin self.execute_playbook() File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/task/ansible.py", line 295, in execute_playbook self._handle_failure(command, status) File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/task/ansible.py", line 320, in _handle_failure raise AnsibleFailedError(failures) teuthology.exceptions.AnsibleFailedError: {'smithi181.front.sepia.ceph.com': {'changed': True, 'msg': 'All items completed', 'results': [{'_ansible_item_label': 'ceph/python3-asyncssh', '_ansible_no_log': False, 'ansible_loop_var': 'item', 'changed': True, 'cmd': ['dnf', '-y', 'copr', 'enable', 'ceph/python3-asyncssh'], 'delta': '0:00:11.936132', 'end': '2023-06-24 14:17:39.685663', 'failed': True, 'invocation': {'module_args': {'_raw_params': 'dnf -y copr enable ceph/python3-asyncssh', '_uses_shell': False, 'argv': None, 'chdir': None, 'creates': None, 'executable': None, 'removes': None, 'stdin': None, 'stdin_add_newline': True, 'strip_empty_ends': True, 'warn': True}}, 'item': 'ceph/python3-asyncssh', 'msg': 'non-zero return code', 'rc': 1, 'start': '2023-06-24 14:17:27.749531', 'stderr': 'Enabling a Copr repository. Please note that this repository is not part\nof the main distribution, and quality may vary.\n\nThe Fedora Project does not exercise any power over the contents of\nthis repository beyond the rules outlined in the Copr FAQ at\n,\nand packages are not held to any quality or security level.\n\nPlease do not file bug reports about these packages in Fedora\nBugzilla. In case of problems, contact the owner of this repository.\nError: Failed to connect to https://copr.fedorainfracloud.org/coprs/ceph/python3-asyncssh/repo/epel-8/dnf.repo?arch=x86_64: Name or service not known', 'stderr_lines': ['Enabling a Copr repository. Please note that this repository is not part', 'of the main distribution, and quality may vary.', '', 'The Fedora Project does not exercise any power over the contents of', 'this repository beyond the rules outlined in the Copr FAQ at', ',', 'and packages are not held to any quality or security level.', '', 'Please do not file bug reports about these packages in Fedora', 'Bugzilla. In case of problems, contact the owner of this repository.', 'Error: Failed to connect to https://copr.fedorainfracloud.org/coprs/ceph/python3-asyncssh/repo/epel-8/dnf.repo?arch=x86_64: Name or service not known'], 'stdout': '', 'stdout_lines': []}], 'warnings': ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."]}, 'smithi132.front.sepia.ceph.com': {'changed': True, 'msg': 'All items completed', 'results': [{'_ansible_item_label': 'ceph/python3-asyncssh', '_ansible_no_log': False, 'ansible_loop_var': 'item', 'changed': True, 'cmd': ['dnf', '-y', 'copr', 'enable', 'ceph/python3-asyncssh'], 'delta': '0:00:11.442072', 'end': '2023-06-24 14:17:39.700663', 'failed': True, 'invocation': {'module_args': {'_raw_params': 'dnf -y copr enable ceph/python3-asyncssh', '_uses_shell': False, 'argv': None, 'chdir': None, 'creates': None, 'executable': None, 'removes': None, 'stdin': None, 'stdin_add_newline': True, 'strip_empty_ends': True, 'warn': True}}, 'item': 'ceph/python3-asyncssh', 'msg': 'non-zero return code', 'rc': 1, 'start': '2023-06-24 14:17:28.258591', 'stderr': 'Enabling a Copr repository. Please note that this repository is not part\nof the main distribution, and quality may vary.\n\nThe Fedora Project does not exercise any power over the contents of\nthis repository beyond the rules outlined in the Copr FAQ at\n,\nand packages are not held to any quality or security level.\n\nPlease do not file bug reports about these packages in Fedora\nBugzilla. In case of problems, contact the owner of this repository.\nError: Failed to connect to https://copr.fedorainfracloud.org/coprs/ceph/python3-asyncssh/repo/epel-8/dnf.repo?arch=x86_64: Name or service not known', 'stderr_lines': ['Enabling a Copr repository. Please note that this repository is not part', 'of the main distribution, and quality may vary.', '', 'The Fedora Project does not exercise any power over the contents of', 'this repository beyond the rules outlined in the Copr FAQ at', ',', 'and packages are not held to any quality or security level.', '', 'Please do not file bug reports about these packages in Fedora', 'Bugzilla. In case of problems, contact the owner of this repository.', 'Error: Failed to connect to https://copr.fedorainfracloud.org/coprs/ceph/python3-asyncssh/repo/epel-8/dnf.repo?arch=x86_64: Name or service not known'], 'stdout': '', 'stdout_lines': []}], 'warnings': ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."]}, 'smithi104.front.sepia.ceph.com': {'changed': True, 'msg': 'All items completed', 'results': [{'_ansible_item_label': 'ceph/python3-asyncssh', '_ansible_no_log': False, 'ansible_loop_var': 'item', 'changed': True, 'cmd': ['dnf', '-y', 'copr', 'enable', 'ceph/python3-asyncssh'], 'delta': '0:00:13.406142', 'end': '2023-06-24 14:17:39.710222', 'failed': True, 'invocation': {'module_args': {'_raw_params': 'dnf -y copr enable ceph/python3-asyncssh', '_uses_shell': False, 'argv': None, 'chdir': None, 'creates': None, 'executable': None, 'removes': None, 'stdin': None, 'stdin_add_newline': True, 'strip_empty_ends': True, 'warn': True}}, 'item': 'ceph/python3-asyncssh', 'msg': 'non-zero return code', 'rc': 1, 'start': '2023-06-24 14:17:26.304080', 'stderr': 'Enabling a Copr repository. Please note that this repository is not part\nof the main distribution, and quality may vary.\n\nThe Fedora Project does not exercise any power over the contents of\nthis repository beyond the rules outlined in the Copr FAQ at\n,\nand packages are not held to any quality or security level.\n\nPlease do not file bug reports about these packages in Fedora\nBugzilla. In case of problems, contact the owner of this repository.\nError: Failed to connect to https://copr.fedorainfracloud.org/coprs/ceph/python3-asyncssh/repo/epel-8/dnf.repo?arch=x86_64: Name or service not known', 'stderr_lines': ['Enabling a Copr repository. Please note that this repository is not part', 'of the main distribution, and quality may vary.', '', 'The Fedora Project does not exercise any power over the contents of', 'this repository beyond the rules outlined in the Copr FAQ at', ',', 'and packages are not held to any quality or security level.', '', 'Please do not file bug reports about these packages in Fedora', 'Bugzilla. In case of problems, contact the owner of this repository.', 'Error: Failed to connect to https://copr.fedorainfracloud.org/coprs/ceph/python3-asyncssh/repo/epel-8/dnf.repo?arch=x86_64: Name or service not known'], 'stdout': '', 'stdout_lines': []}], 'warnings': ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."]}} 2023-06-24T14:17:40.297 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-06-24T14:17:40.308 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-06-24T14:17:40.309 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-06-24T14:17:40.341 DEBUG:teuthology.orchestra.run.smithi104:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-06-24T14:17:40.445 DEBUG:teuthology.orchestra.run.smithi132:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-06-24T14:17:40.530 DEBUG:teuthology.orchestra.run.smithi181:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-06-24T14:17:40.618 DEBUG:teuthology.orchestra.run.smithi104:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-06-24T14:17:40.652 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-24T14:17:40.653 DEBUG:teuthology.orchestra.run.smithi132:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-06-24T14:17:40.685 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-24T14:17:40.687 DEBUG:teuthology.orchestra.run.smithi181:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-06-24T14:17:40.720 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-24T14:17:40.722 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-06-24T14:17:40.731 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-06-24T14:17:40.768 INFO:teuthology.task.internal:Duration was 337.824190 seconds 2023-06-24T14:17:40.769 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-06-24T14:17:40.817 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-06-24T14:17:40.817 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-06-24T14:17:40.821 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-06-24T14:17:40.823 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-06-24T14:17:40.868 INFO:teuthology.orchestra.run.smithi104.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-06-24T14:17:40.870 INFO:teuthology.orchestra.run.smithi132.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-06-24T14:17:40.873 INFO:teuthology.orchestra.run.smithi181.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-06-24T14:17:41.314 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-06-24T14:17:41.315 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi104.front.sepia.ceph.com 2023-06-24T14:17:41.315 DEBUG:teuthology.orchestra.run.smithi104:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-06-24T14:17:41.341 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi132.front.sepia.ceph.com 2023-06-24T14:17:41.341 DEBUG:teuthology.orchestra.run.smithi132:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-06-24T14:17:41.367 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi181.front.sepia.ceph.com 2023-06-24T14:17:41.367 DEBUG:teuthology.orchestra.run.smithi181:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-06-24T14:17:41.393 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-06-24T14:17:41.394 DEBUG:teuthology.orchestra.run.smithi104:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-06-24T14:17:41.396 DEBUG:teuthology.orchestra.run.smithi132:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-06-24T14:17:41.409 DEBUG:teuthology.orchestra.run.smithi181:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-06-24T14:17:41.473 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-06-24T14:17:41.474 DEBUG:teuthology.orchestra.run.smithi104:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-06-24T14:17:41.476 DEBUG:teuthology.orchestra.run.smithi132:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-06-24T14:17:41.486 DEBUG:teuthology.orchestra.run.smithi181:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-06-24T14:17:41.575 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-06-24T14:17:41.584 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-06-24T14:17:41.585 DEBUG:teuthology.orchestra.run.smithi104:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-06-24T14:17:41.613 DEBUG:teuthology.orchestra.run.smithi132:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-06-24T14:17:41.640 DEBUG:teuthology.orchestra.run.smithi181:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-06-24T14:17:41.669 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-06-24T14:17:41.680 DEBUG:teuthology.orchestra.run.smithi104:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-06-24T14:17:41.684 DEBUG:teuthology.orchestra.run.smithi132:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-06-24T14:17:41.686 DEBUG:teuthology.orchestra.run.smithi181:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-06-24T14:17:41.708 INFO:teuthology.orchestra.run.smithi104.stdout:kernel.core_pattern = core 2023-06-24T14:17:41.710 INFO:teuthology.orchestra.run.smithi132.stdout:kernel.core_pattern = core 2023-06-24T14:17:41.736 INFO:teuthology.orchestra.run.smithi181.stdout:kernel.core_pattern = core 2023-06-24T14:17:41.760 DEBUG:teuthology.orchestra.run.smithi104:> test -e /home/ubuntu/cephtest/archive/coredump 2023-06-24T14:17:41.790 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-24T14:17:41.791 DEBUG:teuthology.orchestra.run.smithi132:> test -e /home/ubuntu/cephtest/archive/coredump 2023-06-24T14:17:41.814 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-24T14:17:41.816 DEBUG:teuthology.orchestra.run.smithi181:> test -e /home/ubuntu/cephtest/archive/coredump 2023-06-24T14:17:41.833 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-24T14:17:41.834 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-06-24T14:17:41.907 INFO:teuthology.task.internal:Transferring archived files... 2023-06-24T14:17:41.912 DEBUG:teuthology.misc:Transferring archived files from smithi104:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-06-23_21:02:01-rbd-reef-distro-default-smithi/7315260/remote/smithi104 2023-06-24T14:17:41.914 DEBUG:teuthology.orchestra.run.smithi104:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-06-24T14:17:41.995 DEBUG:teuthology.misc:Transferring archived files from smithi132:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-06-23_21:02:01-rbd-reef-distro-default-smithi/7315260/remote/smithi132 2023-06-24T14:17:41.996 DEBUG:teuthology.orchestra.run.smithi132:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-06-24T14:17:42.042 DEBUG:teuthology.misc:Transferring archived files from smithi181:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-06-23_21:02:01-rbd-reef-distro-default-smithi/7315260/remote/smithi181 2023-06-24T14:17:42.043 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-06-24T14:17:42.097 INFO:teuthology.task.internal:Removing archive directory... 2023-06-24T14:17:42.098 DEBUG:teuthology.orchestra.run.smithi104:> rm -rf -- /home/ubuntu/cephtest/archive 2023-06-24T14:17:42.101 DEBUG:teuthology.orchestra.run.smithi132:> rm -rf -- /home/ubuntu/cephtest/archive 2023-06-24T14:17:42.104 DEBUG:teuthology.orchestra.run.smithi181:> rm -rf -- /home/ubuntu/cephtest/archive 2023-06-24T14:17:42.153 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-06-24T14:17:42.165 INFO:teuthology.task.internal:Not uploading archives. 2023-06-24T14:17:42.166 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-06-24T14:17:42.192 INFO:teuthology.task.internal:Tidying up after the test... 2023-06-24T14:17:42.193 DEBUG:teuthology.orchestra.run.smithi104:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-06-24T14:17:42.198 DEBUG:teuthology.orchestra.run.smithi132:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-06-24T14:17:42.201 DEBUG:teuthology.orchestra.run.smithi181:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-06-24T14:17:42.212 INFO:teuthology.orchestra.run.smithi104.stdout: 393224 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 24 14:17 /home/ubuntu/cephtest 2023-06-24T14:17:42.216 INFO:teuthology.orchestra.run.smithi132.stdout: 393224 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 24 14:17 /home/ubuntu/cephtest 2023-06-24T14:17:42.219 INFO:teuthology.orchestra.run.smithi181.stdout: 393224 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 24 14:17 /home/ubuntu/cephtest 2023-06-24T14:17:42.220 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-06-24T14:17:42.242 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-06-24T14:17:42.348 INFO:teuthology.nuke:Checking targets against current locks 2023-06-24T14:17:42.380 DEBUG:teuthology.nuke:shortname: smithi104 2023-06-24T14:17:42.380 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-24T14:17:42.408 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi104.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-23_21:02:01-rbd-reef-distro-default-smithi/7315260', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-24 14:03:10.012408', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCxMZI+isAG+upXvZwELe117eBkubjWGGJtpr0/lJvTAhiViBMySqWdyb68icL0ezsRvogsXTCDAF75+w7AumgXpo0u2FZ2gRPLPBWruPZ4wrBUw2BsnqfTxjKslf5uJCulQaBBZwELTkVsrEDcFng0gQGFJmVm4ZaehQfJohu5IasQGuomvf5q6ISohk+uZIaUgTUFPifDs8tA9ehTJoasLnl14Bs3/Da3mmqo5ZFFr+S85lQAyZrTfkey/t49ULP3SrAuuZ7zWidljrxg8gN+E925Vswwql7lC2agXioFIZT3ZJHTXMSaKZwq6tyay/ZbLEtsc/8g2+Hnc1kepBm3PoJIqrdJu72B0/VrAmrhmiPkaR1hCFYXJr11I/6Uo0e2dzu7Ek7JYSeXWIJhpxRZEsV3MAUK8QX8UcVIOp3mAKqgavL8etS4CM/hvnyXpUWfg5k0QTlY3fadLqyo0Vk2Jiz703vKjlVJh4NBOjIaW9FfJ2f1aX4Gxq59jU+eVEM='} 2023-06-24T14:17:42.412 DEBUG:teuthology.nuke:shortname: smithi132 2023-06-24T14:17:42.413 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-24T14:17:42.438 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi132.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-23_21:02:01-rbd-reef-distro-default-smithi/7315260', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-24 14:03:10.015382', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDptTubT0mpiPW6a5n6OWG02FeElc0QUKw10+tp8SCrKIxbL+3WWSTeV/ZROjIfGQCGiCjb6FP8IK1AEo0sAGPj2iTi/2/ujry8K2YQPEoGA07hKa3syiD7vdhOu//9AX0e/JT0YZXIPQr4TIFZ+cSWfEisdNeNZQt4hmABW9b6piAoGLXfSCASnVhuC5lcCTX3dxDgYoohWQNrgxWgXbXZtfJJCaheYtB5Y/z974TlO1mm/Q/Hi7N6xsn+vrydZqSLQqoDZ39+LvFIlr2GX3F9cFiDUYwx1NXTSvsSK6PmboHc82FQDAJL+vwTPnvPvq345HfXG2m1ZXTj5CjmfaUb3zCLET9+/msZoOjGKFpRAN54jnXJHEC4LqjN90GVSQ1zVjg5xXt8rI/hUxiIU3E1jqYw7kAK3IcGidB3ND6mZvny0ntzoBVvddTtvoxsL8MrF7yK0BmN1Klmb6Hmht8FKBRUjQq/t0+tQL1JZD/KKeRfEZvqm1O5JzHf62qgx/s='} 2023-06-24T14:17:42.441 DEBUG:teuthology.nuke:shortname: smithi181 2023-06-24T14:17:42.442 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-24T14:17:42.476 INFO:teuthology.orchestra.console:Power off smithi104 2023-06-24T14:17:42.478 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-24T14:17:42.488 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi181.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-23_21:02:01-rbd-reef-distro-default-smithi/7315260', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-24 14:03:10.014043', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE5zP4uQ5mwkaH/Oakm9ruw4cLby62b5wVg0rGUn+PmXVPrRd1phkQfwzzgPWVdAVmbRByYbMNIGxjrcVA6q/eM='} 2023-06-24T14:17:42.498 INFO:teuthology.orchestra.console:Power off smithi132 2023-06-24T14:17:42.499 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-24T14:17:42.509 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-24T14:17:42.520 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-24T14:17:42.572 INFO:teuthology.orchestra.console:Power off smithi181 2023-06-24T14:17:42.573 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-24T14:17:42.596 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-24T14:17:46.541 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-24T14:17:46.550 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-24T14:17:46.621 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-24T14:17:51.654 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-24T14:17:51.664 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-24T14:17:51.732 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-24T14:17:51.945 INFO:teuthology.orchestra.console:Power off for smithi181 completed 2023-06-24T14:17:56.767 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-24T14:17:56.777 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-24T14:17:56.990 INFO:teuthology.orchestra.console:Power off for smithi132 completed 2023-06-24T14:18:01.882 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-24T14:18:06.995 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-24T14:18:07.207 INFO:teuthology.orchestra.console:Power off for smithi104 completed 2023-06-24T14:18:07.329 INFO:teuthology.run:Summary data: description: rbd/encryption/{cache/writethrough clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-hybrid pool/none supported-random-distro$/{centos_8} workloads/qemu_xfstests_luks1_luks2} duration: 337.8241901397705 failure_reason: '{''smithi181.front.sepia.ceph.com'': {''changed'': True, ''msg'': ''All items completed'', ''results'': [{''_ansible_item_label'': ''ceph/python3-asyncssh'', ''_ansible_no_log'': False, ''ansible_loop_var'': ''item'', ''changed'': True, ''cmd'': [''dnf'', ''-y'', ''copr'', ''enable'', ''ceph/python3-asyncssh''], ''delta'': ''0:00:11.936132'', ''end'': ''2023-06-24 14:17:39.685663'', ''failed'': True, ''invocation'': {''module_args'': {''_raw_params'': ''dnf -y copr enable ceph/python3-asyncssh'', ''_uses_shell'': False, ''argv'': None, ''chdir'': None, ''creates'': None, ''executable'': None, ''removes'': None, ''stdin'': None, ''stdin_add_newline'': True, ''strip_empty_ends'': True, ''warn'': True}}, ''item'': ''ceph/python3-asyncssh'', ''msg'': ''non-zero return code'', ''rc'': 1, ''start'': ''2023-06-24 14:17:27.749531'', ''stderr'': ''Enabling a Copr repository. Please note that this repository is not part\nof the main distribution, and quality may vary.\n\nThe Fedora Project does not exercise any power over the contents of\nthis repository beyond the rules outlined in the Copr FAQ at\n,\nand packages are not held to any quality or security level.\n\nPlease do not file bug reports about these packages in Fedora\nBugzilla. In case of problems, contact the owner of this repository.\nError: Failed to connect to https://copr.fedorainfracloud.org/coprs/ceph/python3-asyncssh/repo/epel-8/dnf.repo?arch=x86_64: Name or service not known'', ''stderr_lines'': [''Enabling a Copr repository. Please note that this repository is not part'', ''of the main distribution, and quality may vary.'', '''', ''The Fedora Project does not exercise any power over the contents of'', ''this repository beyond the rules outlined in the Copr FAQ at'', '','', ''and packages are not held to any quality or security level.'', '''', ''Please do not file bug reports about these packages in Fedora'', ''Bugzilla. In case of problems, contact the owner of this repository.'', ''Error: Failed to connect to https://copr.fedorainfracloud.org/coprs/ceph/python3-asyncssh/repo/epel-8/dnf.repo?arch=x86_64: Name or service not known''], ''stdout'': '''', ''stdout_lines'': []}], ''warnings'': ["Consider using the dnf module rather than running ''dnf''. If you need to use command because dnf is insufficient you can add ''warn: false'' to this command task or set ''command_warnings=False'' in ansible.cfg to get rid of this message."]}, ''smithi132.front.sepia.ceph.com'': {''changed'': True, ''msg'': ''All items completed'', ''results'': [{''_ansible_item_label'': ''ceph/python3-asyncssh'', ''_ansible_no_log'': False, ''ansible_loop_var'': ''item'', ''changed'': True, ''cmd'': [''dnf'', ''-y'', ''copr'', ''enable'', ''ceph/python3-asyncssh''], ''delta'': ''0:00:11.442072'', ''end'': ''2023-06-24 14:17:39.700663'', ''failed'': True, ''invocation'': {''module_args'': {''_raw_params'': ''dnf -y copr enable ceph/python3-asyncssh'', ''_uses_shell'': False, ''argv'': None, ''chdir'': None, ''creates'': None, ''executable'': None, ''removes'': None, ''stdin'': None, ''stdin_add_newline'': True, ''strip_empty_ends'': True, ''warn'': True}}, ''item'': ''ceph/python3-asyncssh'', ''msg'': ''non-zero return code'', ''rc'': 1, ''start'': ''2023-06-24 14:17:28.258591'', ''stderr'': ''Enabling a Copr repository. Please note that this repository is not part\nof the main distribution, and quality may vary.\n\nThe Fedora Project does not exercise any power over the contents of\nthis repository beyond the rules outlined in the Copr FAQ at\n,\nand packages are not held to any quality or security level.\n\nPlease do not file bug reports about these packages in Fedora\nBugzilla. In case of problems, contact the owner of this repository.\nError: Failed to connect to https://copr.fedorainfracloud.org/coprs/ceph/python3-asyncssh/repo/epel-8/dnf.repo?arch=x86_64: Name or service not known'', ''stderr_lines'': [''Enabling a Copr repository. Please note that this repository is not part'', ''of the main distribution, and quality may vary.'', '''', ''The Fedora Project does not exercise any power over the contents of'', ''this repository beyond the rules outlined in the Copr FAQ at'', '','', ''and packages are not held to any quality or security level.'', '''', ''Please do not file bug reports about these packages in Fedora'', ''Bugzilla. In case of problems, contact the owner of this repository.'', ''Error: Failed to connect to https://copr.fedorainfracloud.org/coprs/ceph/python3-asyncssh/repo/epel-8/dnf.repo?arch=x86_64: Name or service not known''], ''stdout'': '''', ''stdout_lines'': []}], ''warnings'': ["Consider using the dnf module rather than running ''dnf''. If you need to use command because dnf is insufficient you can add ''warn: false'' to this command task or set ''command_warnings=False'' in ansible.cfg to get rid of this message."]}, ''smithi104.front.sepia.ceph.com'': {''changed'': True, ''msg'': ''All items completed'', ''results'': [{''_ansible_item_label'': ''ceph/python3-asyncssh'', ''_ansible_no_log'': False, ''ansible_loop_var'': ''item'', ''changed'': True, ''cmd'': [''dnf'', ''-y'', ''copr'', ''enable'', ''ceph/python3-asyncssh''], ''delta'': ''0:00:13.406142'', ''end'': ''2023-06-24 14:17:39.710222'', ''failed'': True, ''invocation'': {''module_args'': {''_raw_params'': ''dnf -y copr enable ceph/python3-asyncssh'', ''_uses_shell'': False, ''argv'': None, ''chdir'': None, ''creates'': None, ''executable'': None, ''removes'': None, ''stdin'': None, ''stdin_add_newline'': True, ''strip_empty_ends'': True, ''warn'': True}}, ''item'': ''ceph/python3-asyncssh'', ''msg'': ''non-zero return code'', ''rc'': 1, ''start'': ''2023-06-24 14:17:26.304080'', ''stderr'': ''Enabling a Copr repository. Please note that this repository is not part\nof the main distribution, and quality may vary.\n\nThe Fedora Project does not exercise any power over the contents of\nthis repository beyond the rules outlined in the Copr FAQ at\n,\nand packages are not held to any quality or security level.\n\nPlease do not file bug reports about these packages in Fedora\nBugzilla. In case of problems, contact the owner of this repository.\nError: Failed to connect to https://copr.fedorainfracloud.org/coprs/ceph/python3-asyncssh/repo/epel-8/dnf.repo?arch=x86_64: Name or service not known'', ''stderr_lines'': [''Enabling a Copr repository. Please note that this repository is not part'', ''of the main distribution, and quality may vary.'', '''', ''The Fedora Project does not exercise any power over the contents of'', ''this repository beyond the rules outlined in the Copr FAQ at'', '','', ''and packages are not held to any quality or security level.'', '''', ''Please do not file bug reports about these packages in Fedora'', ''Bugzilla. In case of problems, contact the owner of this repository.'', ''Error: Failed to connect to https://copr.fedorainfracloud.org/coprs/ceph/python3-asyncssh/repo/epel-8/dnf.repo?arch=x86_64: Name or service not known''], ''stdout'': '''', ''stdout_lines'': []}], ''warnings'': ["Consider using the dnf module rather than running ''dnf''. If you need to use command because dnf is insufficient you can add ''warn: false'' to this command task or set ''command_warnings=False'' in ansible.cfg to get rid of this message."]}}' owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=b3faf66820a04214b98eeb3cd7cfe56f status: dead success: false 2023-06-24T14:18:07.329 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-24T14:18:22.428 INFO:teuthology.run:DEAD