2024-02-20T06:05:47.244 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55
2024-02-20T06:05:47.244 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/yuriw-2024-02-19_20:17:41-rbd-wip-yuri5-testing-2024-02-16-1120-quincy-distro-default-smithi/7567340 --description rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{rhel_8} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} --verbose --owner scheduled_yuriw@teuthology --name yuriw-2024-02-19_20:17:41-rbd-wip-yuri5-testing-2024-02-16-1120-quincy-distro-default-smithi -- /home/teuthworker/archive/yuriw-2024-02-19_20:17:41-rbd-wip-yuri5-testing-2024-02-16-1120-quincy-distro-default-smithi/7567340/orig.config.yaml
2024-02-20T06:05:47.287 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T06:05:47.369 INFO:teuthology.run:Config:
  archive_path: /home/teuthworker/archive/yuriw-2024-02-19_20:17:41-rbd-wip-yuri5-testing-2024-02-16-1120-quincy-distro-default-smithi/7567340
  branch: wip-yuri5-testing-2024-02-16-1120-quincy
  description: rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node
    openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-comp-snappy
    supported-random-distro$/{rhel_8} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus}
  email: yweinste@redhat.com
  first_in_suite: false
  job_id: '7567340'
  kernel:
    kdb: true
    sha1: distro
  last_in_suite: false
  machine_type: smithi
  meta:
  - desc: run two ceph clusters and install rbd-mirror
  - desc: configure the permissions for client.mirror
  - desc: configure the permissions for client.mirror
  - desc: 2 ceph clusters with 1 mon and 3 osds each
  - desc: run the rbd_mirror_stress.sh workunit to test the rbd-mirror daemon
  name: yuriw-2024-02-19_20:17:41-rbd-wip-yuri5-testing-2024-02-16-1120-quincy-distro-default-smithi
  no_nested_subset: false
  nuke-on-error: true
  openstack:
  - volumes:
      count: 3
      size: 30
  os_type: rhel
  os_version: '8.6'
  overrides:
    admin_socket:
      branch: wip-yuri5-testing-2024-02-16-1120-quincy
    ceph:
      conf:
        client:
          debug rbd: 20
          debug rbd_mirror: 15
          log to stderr: false
          rbd default features: 125
        client.mirror.0:
          admin socket: /var/run/ceph/rbd-mirror.$cluster-$name.asok
          pid file: /var/run/ceph/rbd-mirror.$cluster-$name.pid
        client.mirror.1:
          admin socket: /var/run/ceph/rbd-mirror.$cluster-$name.asok
          pid file: /var/run/ceph/rbd-mirror.$cluster-$name.pid
        client.mirror.2:
          admin socket: /var/run/ceph/rbd-mirror.$cluster-$name.asok
          pid file: /var/run/ceph/rbd-mirror.$cluster-$name.pid
        client.mirror.3:
          admin socket: /var/run/ceph/rbd-mirror.$cluster-$name.asok
          pid file: /var/run/ceph/rbd-mirror.$cluster-$name.pid
        client.mirror.4:
          admin socket: /var/run/ceph/rbd-mirror.$cluster-$name.asok
          pid file: /var/run/ceph/rbd-mirror.$cluster-$name.pid
        client.mirror.5:
          admin socket: /var/run/ceph/rbd-mirror.$cluster-$name.asok
          pid file: /var/run/ceph/rbd-mirror.$cluster-$name.pid
        client.mirror.6:
          admin socket: /var/run/ceph/rbd-mirror.$cluster-$name.asok
          pid file: /var/run/ceph/rbd-mirror.$cluster-$name.pid
        global:
          mon client directed command retry: 5
          mon warn on pool no app: false
          ms inject socket failures: 5000
        mgr:
          debug mgr: 20
          debug ms: 1
        mon:
          debug mon: 20
          debug ms: 1
          debug paxos: 20
        osd:
          bluestore block size: 96636764160
          bluestore compression algorithm: snappy
          bluestore compression mode: aggressive
          bluestore fsck on mount: true
          debug bluefs: 1/20
          debug bluestore: 1/20
          debug ms: 1
          debug osd: 20
          debug rocksdb: 4/10
          mon osd backfillfull_ratio: 0.85
          mon osd full ratio: 0.9
          mon osd nearfull ratio: 0.8
          osd failsafe full ratio: 0.95
          osd objectstore: bluestore
      flavor: default
      fs: xfs
      log-ignorelist:
      - \(MDS_ALL_DOWN\)
      - \(MDS_UP_LESS_THAN_MAX\)
      - \(OSD_SLOW_PING_TIME
      sha1: b0bd01b8442d66b8a31f8cb3050334b026de2f3b
    ceph-deploy:
      conf:
        client:
          log file: /var/log/ceph/ceph-$name.$pid.log
        mon: {}
    install:
      ceph:
        flavor: default
        sha1: b0bd01b8442d66b8a31f8cb3050334b026de2f3b
    selinux:
      whitelist:
      - scontext=system_u:system_r:logrotate_t:s0
    thrashosds:
      bdev_inject_crash: 2
      bdev_inject_crash_probability: 0.5
    workunit:
      branch: wip-yuri5-testing-2024-02-16-1120-quincy
      sha1: b0bd01b8442d66b8a31f8cb3050334b026de2f3b
  owner: scheduled_yuriw@teuthology
  priority: 71
  repo: https://github.com/ceph/ceph-ci.git
  roles:
  - - cluster1.mon.a
    - cluster1.mgr.x
    - cluster2.mgr.x
    - cluster1.osd.0
    - cluster1.osd.1
    - cluster1.osd.2
    - cluster1.client.0
    - cluster2.client.0
  - - cluster2.mon.a
    - cluster2.osd.0
    - cluster2.osd.1
    - cluster2.osd.2
    - cluster1.client.mirror
    - cluster1.client.mirror.0
    - cluster1.client.mirror.1
    - cluster1.client.mirror.2
    - cluster1.client.mirror.3
    - cluster1.client.mirror.4
    - cluster1.client.mirror.5
    - cluster1.client.mirror.6
    - cluster2.client.mirror
    - cluster2.client.mirror.0
    - cluster2.client.mirror.1
    - cluster2.client.mirror.2
    - cluster2.client.mirror.3
    - cluster2.client.mirror.4
    - cluster2.client.mirror.5
    - cluster2.client.mirror.6
  seed: 7821
  sha1: b0bd01b8442d66b8a31f8cb3050334b026de2f3b
  sleep_before_teardown: 0
  subset: 111/120000
  suite: rbd
  suite_branch: wip-yuri5-testing-2024-02-16-1120-quincy
  suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_b0bd01b8442d66b8a31f8cb3050334b026de2f3b/qa
  suite_relpath: qa
  suite_repo: https://github.com/ceph/ceph-ci.git
  suite_sha1: b0bd01b8442d66b8a31f8cb3050334b026de2f3b
  targets:
    smithi138.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHIk2XW09za2VTSWHaTwKT5ATuGuXn5vrVEiQEorKwO/QSQMkZ6Y591t5smG2XodTDsI6JQRs9oTFD1PVoZ14eQ=
    smithi155.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBExYPO6y8hksL+0GPL1laa3hl4XTKlSoTn5vCV/CKNuxo3zW7C/fvwaJgZSFFYf0dh//CdksE63WUghFRT0MF7U=
  tasks:
  - install:
      extra_packages:
      - rbd-mirror
  - ceph:
      cluster: cluster1
  - ceph:
      cluster: cluster2
  - exec:
      cluster1.client.mirror.0:
      - sudo ceph --cluster cluster1 auth caps client.mirror.4 mon 'profile rbd-mirror'
        osd 'profile rbd'
      - sudo ceph --cluster cluster1 auth caps client.mirror.5 mon 'profile rbd-mirror'
        osd 'profile rbd'
      - sudo ceph --cluster cluster1 auth caps client.mirror.6 mon 'profile rbd-mirror'
        osd 'profile rbd'
      - sudo ceph --cluster cluster2 auth caps client.mirror.4 mon 'profile rbd-mirror'
        osd 'profile rbd'
      - sudo ceph --cluster cluster2 auth caps client.mirror.5 mon 'profile rbd-mirror'
        osd 'profile rbd'
      - sudo ceph --cluster cluster2 auth caps client.mirror.6 mon 'profile rbd-mirror'
        osd 'profile rbd'
  - exec:
      cluster1.client.mirror.0:
      - sudo ceph --cluster cluster1 auth caps client.mirror mon 'profile rbd-mirror-peer'
        osd 'profile rbd'
      - sudo ceph --cluster cluster1 auth caps client.mirror.0 mon 'profile rbd-mirror'
        osd 'profile rbd'
      - sudo ceph --cluster cluster1 auth caps client.mirror.1 mon 'profile rbd-mirror'
        osd 'profile rbd'
      - sudo ceph --cluster cluster1 auth caps client.mirror.2 mon 'profile rbd-mirror'
        osd 'profile rbd'
      - sudo ceph --cluster cluster1 auth caps client.mirror.3 mon 'profile rbd-mirror'
        osd 'profile rbd'
      - sudo ceph --cluster cluster2 auth caps client.mirror mon 'profile rbd-mirror-peer'
        osd 'profile rbd'
      - sudo ceph --cluster cluster2 auth caps client.mirror.0 mon 'profile rbd-mirror'
        osd 'profile rbd'
      - sudo ceph --cluster cluster2 auth caps client.mirror.1 mon 'profile rbd-mirror'
        osd 'profile rbd'
      - sudo ceph --cluster cluster2 auth caps client.mirror.2 mon 'profile rbd-mirror'
        osd 'profile rbd'
      - sudo ceph --cluster cluster2 auth caps client.mirror.3 mon 'profile rbd-mirror'
        osd 'profile rbd'
  - workunit:
      clients:
        cluster1.client.mirror:
        - rbd/rbd_mirror_stress.sh
      env:
        CEPH_ARGS: ''
        RBD_MIRROR_MIN_COMPAT_CLIENT: octopus
        RBD_MIRROR_USE_EXISTING_CLUSTER: '1'
  teuthology:
    fragments_dropped: []
    meta: {}
    postmerge: []
  teuthology_branch: main
  teuthology_sha1: b1dac5519c57c269ea98a22fb7729016a1d0e4d2
  timestamp: 2024-02-19_20:17:41
  tube: smithi
  user: yuriw
  verbose: true
  worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885
2024-02-20T06:05:47.369 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_b0bd01b8442d66b8a31f8cb3050334b026de2f3b/qa; will attempt to use it
2024-02-20T06:05:47.370 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_b0bd01b8442d66b8a31f8cb3050334b026de2f3b/qa/tasks
2024-02-20T06:05:47.370 INFO:teuthology.run_tasks:Running task internal.check_packages...
2024-02-20T06:05:47.371 INFO:teuthology.task.internal:Checking packages...
2024-02-20T06:05:47.396 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash 'b0bd01b8442d66b8a31f8cb3050334b026de2f3b'
2024-02-20T06:05:47.396 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch
2024-02-20T06:05:47.396 INFO:teuthology.packaging:ref: None
2024-02-20T06:05:47.396 INFO:teuthology.packaging:tag: None
2024-02-20T06:05:47.396 INFO:teuthology.packaging:branch: wip-yuri5-testing-2024-02-16-1120-quincy
2024-02-20T06:05:47.396 INFO:teuthology.packaging:sha1: b0bd01b8442d66b8a31f8cb3050334b026de2f3b
2024-02-20T06:05:47.397 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri5-testing-2024-02-16-1120-quincy
2024-02-20T06:05:47.616 INFO:teuthology.task.internal:Found packages for ceph version 17.2.7-543.gb0bd01b8
2024-02-20T06:05:47.618 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep...
2024-02-20T06:05:47.624 INFO:teuthology.task.internal:no buildpackages task found
2024-02-20T06:05:47.624 INFO:teuthology.run_tasks:Running task internal.save_config...
2024-02-20T06:05:47.639 INFO:teuthology.task.internal:Saving configuration
2024-02-20T06:05:47.655 INFO:teuthology.run_tasks:Running task internal.check_lock...
2024-02-20T06:05:47.661 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-02-20T06:05:47.687 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi138.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-19_20:17:41-rbd-wip-yuri5-testing-2024-02-16-1120-quincy-distro-default-smithi/7567340', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-20 06:00:29.520636', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHIk2XW09za2VTSWHaTwKT5ATuGuXn5vrVEiQEorKwO/QSQMkZ6Y591t5smG2XodTDsI6JQRs9oTFD1PVoZ14eQ='}
2024-02-20T06:05:47.709 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi155.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-19_20:17:41-rbd-wip-yuri5-testing-2024-02-16-1120-quincy-distro-default-smithi/7567340', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-20 06:00:29.518910', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBExYPO6y8hksL+0GPL1laa3hl4XTKlSoTn5vCV/CKNuxo3zW7C/fvwaJgZSFFYf0dh//CdksE63WUghFRT0MF7U='}
2024-02-20T06:05:47.710 INFO:teuthology.run_tasks:Running task internal.add_remotes...
2024-02-20T06:05:47.715 INFO:teuthology.task.internal:roles: ubuntu@smithi138.front.sepia.ceph.com - ['cluster1.mon.a', 'cluster1.mgr.x', 'cluster2.mgr.x', 'cluster1.osd.0', 'cluster1.osd.1', 'cluster1.osd.2', 'cluster1.client.0', 'cluster2.client.0']
2024-02-20T06:05:47.715 INFO:teuthology.task.internal:roles: ubuntu@smithi155.front.sepia.ceph.com - ['cluster2.mon.a', 'cluster2.osd.0', 'cluster2.osd.1', 'cluster2.osd.2', 'cluster1.client.mirror', 'cluster1.client.mirror.0', 'cluster1.client.mirror.1', 'cluster1.client.mirror.2', 'cluster1.client.mirror.3', 'cluster1.client.mirror.4', 'cluster1.client.mirror.5', 'cluster1.client.mirror.6', 'cluster2.client.mirror', 'cluster2.client.mirror.0', 'cluster2.client.mirror.1', 'cluster2.client.mirror.2', 'cluster2.client.mirror.3', 'cluster2.client.mirror.4', 'cluster2.client.mirror.5', 'cluster2.client.mirror.6']
2024-02-20T06:05:47.715 INFO:teuthology.run_tasks:Running task console_log...
2024-02-20T06:05:47.787 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f3e79162790>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f3e7a02e160>, signals=[15])
2024-02-20T06:05:47.787 INFO:teuthology.run_tasks:Running task internal.connect...
2024-02-20T06:05:47.793 INFO:teuthology.task.internal:Opening connections...
2024-02-20T06:05:47.793 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi138.front.sepia.ceph.com
2024-02-20T06:05:47.795 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T06:05:47.870 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi155.front.sepia.ceph.com
2024-02-20T06:05:47.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T06:05:47.945 INFO:teuthology.run_tasks:Running task internal.push_inventory...
2024-02-20T06:05:47.951 DEBUG:teuthology.orchestra.run.smithi138:> uname -m
2024-02-20T06:05:47.971 INFO:teuthology.orchestra.run.smithi138.stdout:x86_64
2024-02-20T06:05:47.972 DEBUG:teuthology.orchestra.run.smithi138:> cat /etc/os-release
2024-02-20T06:05:48.031 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="Red Hat Enterprise Linux"
2024-02-20T06:05:48.031 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="8.6 (Ootpa)"
2024-02-20T06:05:48.032 INFO:teuthology.orchestra.run.smithi138.stdout:ID="rhel"
2024-02-20T06:05:48.032 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE="fedora"
2024-02-20T06:05:48.032 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="8.6"
2024-02-20T06:05:48.032 INFO:teuthology.orchestra.run.smithi138.stdout:PLATFORM_ID="platform:el8"
2024-02-20T06:05:48.032 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-02-20T06:05:48.032 INFO:teuthology.orchestra.run.smithi138.stdout:ANSI_COLOR="0;31"
2024-02-20T06:05:48.032 INFO:teuthology.orchestra.run.smithi138.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-02-20T06:05:48.032 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://www.redhat.com/"
2024-02-20T06:05:48.032 INFO:teuthology.orchestra.run.smithi138.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-02-20T06:05:48.032 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-20T06:05:48.032 INFO:teuthology.orchestra.run.smithi138.stdout:
2024-02-20T06:05:48.032 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-02-20T06:05:48.032 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-02-20T06:05:48.032 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-02-20T06:05:48.032 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-02-20T06:05:48.033 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server
2024-02-20T06:05:48.051 DEBUG:teuthology.orchestra.run.smithi155:> uname -m
2024-02-20T06:05:48.071 INFO:teuthology.orchestra.run.smithi155.stdout:x86_64
2024-02-20T06:05:48.071 DEBUG:teuthology.orchestra.run.smithi155:> cat /etc/os-release
2024-02-20T06:05:48.131 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="Red Hat Enterprise Linux"
2024-02-20T06:05:48.131 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="8.6 (Ootpa)"
2024-02-20T06:05:48.131 INFO:teuthology.orchestra.run.smithi155.stdout:ID="rhel"
2024-02-20T06:05:48.131 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE="fedora"
2024-02-20T06:05:48.131 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="8.6"
2024-02-20T06:05:48.131 INFO:teuthology.orchestra.run.smithi155.stdout:PLATFORM_ID="platform:el8"
2024-02-20T06:05:48.131 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-02-20T06:05:48.132 INFO:teuthology.orchestra.run.smithi155.stdout:ANSI_COLOR="0;31"
2024-02-20T06:05:48.132 INFO:teuthology.orchestra.run.smithi155.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-02-20T06:05:48.132 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://www.redhat.com/"
2024-02-20T06:05:48.132 INFO:teuthology.orchestra.run.smithi155.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-02-20T06:05:48.132 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-20T06:05:48.132 INFO:teuthology.orchestra.run.smithi155.stdout:
2024-02-20T06:05:48.132 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-02-20T06:05:48.132 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-02-20T06:05:48.132 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-02-20T06:05:48.132 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-02-20T06:05:48.132 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server
2024-02-20T06:05:48.151 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles...
2024-02-20T06:05:48.161 INFO:teuthology.run_tasks:Running task internal.check_conflict...
2024-02-20T06:05:48.166 INFO:teuthology.task.internal:Checking for old test directory...
2024-02-20T06:05:48.166 DEBUG:teuthology.orchestra.run.smithi138:> test '!' -e /home/ubuntu/cephtest
2024-02-20T06:05:48.169 DEBUG:teuthology.orchestra.run.smithi155:> test '!' -e /home/ubuntu/cephtest
2024-02-20T06:05:48.190 INFO:teuthology.run_tasks:Running task internal.check_ceph_data...
2024-02-20T06:05:48.196 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph...
2024-02-20T06:05:48.196 DEBUG:teuthology.orchestra.run.smithi138:> test -z $(ls -A /var/lib/ceph)
2024-02-20T06:05:48.228 DEBUG:teuthology.orchestra.run.smithi155:> test -z $(ls -A /var/lib/ceph)
2024-02-20T06:05:48.277 INFO:teuthology.run_tasks:Running task internal.vm_setup...
2024-02-20T06:05:48.325 INFO:teuthology.run_tasks:Running task kernel...
2024-02-20T06:05:48.340 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'}
2024-02-20T06:05:48.340 INFO:teuthology.task.kernel:config {'cluster1.mon.a': {'kdb': True, 'sha1': 'distro'}, 'cluster2.mon.a': {'kdb': True, 'sha1': 'distro'}}, timeout 300
2024-02-20T06:05:48.341 DEBUG:teuthology.orchestra.run.smithi138:> test -f /run/.containerenv -o -f /.dockerenv
2024-02-20T06:05:48.341 DEBUG:teuthology.orchestra.run.smithi155:> test -f /run/.containerenv -o -f /.dockerenv
2024-02-20T06:05:48.359 DEBUG:teuthology.orchestra.run:got remote process result: 1
2024-02-20T06:05:48.360 DEBUG:teuthology.orchestra.run:got remote process result: 1
2024-02-20T06:05:48.361 DEBUG:teuthology.orchestra.run.smithi138:> uname -r
2024-02-20T06:05:48.361 DEBUG:teuthology.orchestra.run.smithi155:> uname -r
2024-02-20T06:05:48.419 INFO:teuthology.orchestra.run.smithi138.stdout:4.18.0-513.9.1.el8_9.x86_64
2024-02-20T06:05:48.420 INFO:teuthology.task.kernel:Running kernel on smithi138: 4.18.0-513.9.1.el8_9.x86_64
2024-02-20T06:05:48.420 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum install -y kernel
2024-02-20T06:05:48.421 INFO:teuthology.orchestra.run.smithi155.stdout:4.18.0-513.9.1.el8_9.x86_64
2024-02-20T06:05:48.421 INFO:teuthology.task.kernel:Running kernel on smithi155: 4.18.0-513.9.1.el8_9.x86_64
2024-02-20T06:05:48.421 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum install -y kernel
2024-02-20T06:05:49.923 INFO:teuthology.orchestra.run.smithi138.stdout:Updating Subscription Management repositories.
2024-02-20T06:05:49.923 INFO:teuthology.orchestra.run.smithi138.stdout:Unable to read consumer identity
2024-02-20T06:05:50.036 INFO:teuthology.orchestra.run.smithi155.stdout:Updating Subscription Management repositories.
2024-02-20T06:05:50.036 INFO:teuthology.orchestra.run.smithi155.stdout:Unable to read consumer identity
2024-02-20T06:05:50.226 INFO:teuthology.orchestra.run.smithi138.stdout:
2024-02-20T06:05:50.227 INFO:teuthology.orchestra.run.smithi138.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register.
2024-02-20T06:05:50.227 INFO:teuthology.orchestra.run.smithi138.stdout:
2024-02-20T06:05:50.320 INFO:teuthology.orchestra.run.smithi155.stdout:
2024-02-20T06:05:50.321 INFO:teuthology.orchestra.run.smithi155.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register.
2024-02-20T06:05:50.321 INFO:teuthology.orchestra.run.smithi155.stdout:
2024-02-20T06:05:52.065 INFO:teuthology.orchestra.run.smithi138.stdout:Copr repo for python3-asyncssh owned by ceph     23 kB/s | 3.5 kB     00:00
2024-02-20T06:05:52.142 INFO:teuthology.orchestra.run.smithi155.stdout:Copr repo for python3-asyncssh owned by ceph     20 kB/s | 3.5 kB     00:00
2024-02-20T06:05:53.858 INFO:teuthology.orchestra.run.smithi138.stdout:Extra Packages for Enterprise Linux             9.1 MB/s |  16 MB     00:01
2024-02-20T06:05:57.542 INFO:teuthology.orchestra.run.smithi138.stdout:lab-extras                                      291 kB/s |  24 kB     00:00
2024-02-20T06:05:58.286 INFO:teuthology.orchestra.run.smithi138.stdout:Package kernel-4.18.0-513.9.1.el8_9.x86_64 is already installed.
2024-02-20T06:05:58.286 INFO:teuthology.orchestra.run.smithi138.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed.
2024-02-20T06:05:58.349 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved.
2024-02-20T06:05:58.350 INFO:teuthology.orchestra.run.smithi138.stdout:Nothing to do.
2024-02-20T06:05:58.350 INFO:teuthology.orchestra.run.smithi138.stdout:Complete!
2024-02-20T06:05:58.488 DEBUG:teuthology.orchestra.run.smithi138:> echo no | sudo yum reinstall kernel || true
2024-02-20T06:05:58.825 INFO:teuthology.orchestra.run.smithi138.stdout:Updating Subscription Management repositories.
2024-02-20T06:05:58.825 INFO:teuthology.orchestra.run.smithi138.stdout:Unable to read consumer identity
2024-02-20T06:05:59.061 INFO:teuthology.orchestra.run.smithi138.stdout:
2024-02-20T06:05:59.062 INFO:teuthology.orchestra.run.smithi138.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register.
2024-02-20T06:05:59.062 INFO:teuthology.orchestra.run.smithi138.stdout:
2024-02-20T06:05:59.369 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:00:02 ago on Tue 20 Feb 2024 06:05:57 AM UTC.
2024-02-20T06:05:59.447 INFO:teuthology.orchestra.run.smithi138.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available.
2024-02-20T06:05:59.454 INFO:teuthology.orchestra.run.smithi138.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available.
2024-02-20T06:05:59.506 INFO:teuthology.orchestra.run.smithi138.stderr:Error: No packages marked for reinstall.
2024-02-20T06:05:59.552 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum reinstall -y kernel || true
2024-02-20T06:05:59.885 INFO:teuthology.orchestra.run.smithi138.stdout:Updating Subscription Management repositories.
2024-02-20T06:05:59.885 INFO:teuthology.orchestra.run.smithi138.stdout:Unable to read consumer identity
2024-02-20T06:06:00.121 INFO:teuthology.orchestra.run.smithi138.stdout:
2024-02-20T06:06:00.121 INFO:teuthology.orchestra.run.smithi138.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register.
2024-02-20T06:06:00.121 INFO:teuthology.orchestra.run.smithi138.stdout:
2024-02-20T06:06:00.426 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:00:03 ago on Tue 20 Feb 2024 06:05:57 AM UTC.
2024-02-20T06:06:00.488 INFO:teuthology.orchestra.run.smithi138.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available.
2024-02-20T06:06:00.488 INFO:teuthology.orchestra.run.smithi138.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available.
2024-02-20T06:06:00.531 INFO:teuthology.orchestra.run.smithi138.stderr:Error: No packages marked for reinstall.
2024-02-20T06:06:00.578 DEBUG:teuthology.orchestra.run.smithi138:> rpm -q kernel | sort -rV | head -n 1
2024-02-20T06:06:00.734 INFO:teuthology.orchestra.run.smithi138.stdout:kernel-4.18.0-513.9.1.el8_9.x86_64
2024-02-20T06:06:00.735 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-513.9.1.el8_9.x86_64
2024-02-20T06:06:00.735 INFO:teuthology.task.kernel:Newest distro kernel installed and running
2024-02-20T06:06:00.735 INFO:teuthology.task.kernel:Enabling kdb on cluster1.mon.a...
2024-02-20T06:06:00.735 DEBUG:teuthology.orchestra.run.smithi138:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc
2024-02-20T06:06:00.767 INFO:teuthology.orchestra.run.smithi138.stdout:ttyS1
2024-02-20T06:06:00.791 DEBUG:teuthology.parallel:result is None
2024-02-20T06:16:26.456 INFO:teuthology.orchestra.run.smithi155.stdout:Extra Packages for Enterprise Linux              20 kB/s |  12 MB     10:34
2024-02-20T06:16:26.458 INFO:teuthology.orchestra.run.smithi155.stderr:Errors during downloading metadata for repository 'epel':
2024-02-20T06:16:26.458 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for http://mirror.dst.ca/fedora-linux/epel/8/Everything/x86_64/repodata/3041b357f5493087f52f1ce0f07aa188edb89002519a6a51079d03adb214b814-updateinfo.xml.bz2 (IP: 208.89.84.55)
2024-02-20T06:16:26.458 INFO:teuthology.orchestra.run.smithi155.stderr:  - Curl error (7): Couldn't connect to server for https://epel.stl.us.ssimn.org/8/Everything/x86_64/repodata/062a51a268ef517f7991f81cfd6b1bf55e21912a9515aa68c52a8587a73c6d8d-filelists.xml.gz [Failed to connect to epel.stl.us.ssimn.org port 443: Connection timed out]
2024-02-20T06:16:26.459 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for https://sjc.mirror.rackspace.com/epel/8/Everything/x86_64/repodata/3041b357f5493087f52f1ce0f07aa188edb89002519a6a51079d03adb214b814-updateinfo.xml.bz2 (IP: 159.135.194.176)
2024-02-20T06:16:26.459 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for http://mirror.arizona.edu/fedora-epel/8/Everything/x86_64/repodata/e7ac9d048a02398eacc82d04cc0e9dde94c5f2715c0a63a762a0216fcba42e8d-primary.xml.gz (IP: 128.196.204.204)
2024-02-20T06:16:26.459 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for https://mirrors.wcupa.edu/epel/8/Everything/x86_64/repodata/7a1ac7e0bc8f7c2f7213c6370e54fff456d13df7b9ff311d8979ad88e8e14b63-prestodelta.xml.xz (IP: 144.26.0.246)
2024-02-20T06:16:26.459 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for https://ftp-osl.osuosl.org/pub/fedora-epel/8/Everything/x86_64/repodata/062a51a268ef517f7991f81cfd6b1bf55e21912a9515aa68c52a8587a73c6d8d-filelists.xml.gz (IP: 140.211.166.134)
2024-02-20T06:16:26.459 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for https://mirror.arizona.edu/fedora-epel/8/Everything/x86_64/repodata/3041b357f5493087f52f1ce0f07aa188edb89002519a6a51079d03adb214b814-updateinfo.xml.bz2 (IP: 128.196.204.204)
2024-02-20T06:16:26.459 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for http://mirror.dst.ca/fedora-linux/epel/8/Everything/x86_64/repodata/e7ac9d048a02398eacc82d04cc0e9dde94c5f2715c0a63a762a0216fcba42e8d-primary.xml.gz (IP: 208.89.84.55)
2024-02-20T06:16:26.459 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for http://pubmirror2.math.uh.edu/fedora-buffet/epel/8/Everything/x86_64/repodata/062a51a268ef517f7991f81cfd6b1bf55e21912a9515aa68c52a8587a73c6d8d-filelists.xml.gz (IP: 129.7.128.190)
2024-02-20T06:16:26.459 INFO:teuthology.orchestra.run.smithi155.stderr:  - Curl error (7): Couldn't connect to server for http://epel.stl.us.ssimn.org/8/Everything/x86_64/repodata/b3c4416ce481fc571b6500701fbf2a24c7b2dec695d891ffaeb66433dd7d9574-comps-Everything.x86_64.xml [Failed to connect to epel.stl.us.ssimn.org port 80: Connection timed out]
2024-02-20T06:16:26.459 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for http://pubmirror1.math.uh.edu/fedora-buffet/epel/8/Everything/x86_64/repodata/e7ac9d048a02398eacc82d04cc0e9dde94c5f2715c0a63a762a0216fcba42e8d-primary.xml.gz (IP: 129.7.128.189)
2024-02-20T06:16:26.459 INFO:teuthology.orchestra.run.smithi155.stderr:  - Curl error (7): Couldn't connect to server for https://epel.stl.us.ssimn.org/8/Everything/x86_64/repodata/7a1ac7e0bc8f7c2f7213c6370e54fff456d13df7b9ff311d8979ad88e8e14b63-prestodelta.xml.xz [Failed to connect to epel.stl.us.ssimn.org port 443: Connection timed out]
2024-02-20T06:16:26.459 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for http://mirrors.upr.edu/epel/8/Everything/x86_64/repodata/3041b357f5493087f52f1ce0f07aa188edb89002519a6a51079d03adb214b814-updateinfo.xml.bz2 (IP: 136.145.244.40)
2024-02-20T06:16:26.459 INFO:teuthology.orchestra.run.smithi155.stderr:  - Curl error (7): Couldn't connect to server for http://epel.stl.us.ssimn.org/8/Everything/x86_64/repodata/062a51a268ef517f7991f81cfd6b1bf55e21912a9515aa68c52a8587a73c6d8d-filelists.xml.gz [Failed to connect to epel.stl.us.ssimn.org port 80: Connection timed out]
2024-02-20T06:16:26.459 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for http://ftp-osl.osuosl.org/pub/fedora-epel/8/Everything/x86_64/repodata/062a51a268ef517f7991f81cfd6b1bf55e21912a9515aa68c52a8587a73c6d8d-filelists.xml.gz (IP: 140.211.166.134)
2024-02-20T06:16:26.460 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for https://ftp-osl.osuosl.org/pub/fedora-epel/8/Everything/x86_64/repodata/3041b357f5493087f52f1ce0f07aa188edb89002519a6a51079d03adb214b814-updateinfo.xml.bz2 (IP: 140.211.166.134)
2024-02-20T06:16:26.460 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for https://epel.mirror.constant.com/8/Everything/x86_64/repodata/3041b357f5493087f52f1ce0f07aa188edb89002519a6a51079d03adb214b814-updateinfo.xml.bz2 (IP: 108.61.5.85)
2024-02-20T06:16:26.460 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for http://mirror.servaxnet.com/epel/8/Everything/x86_64/repodata/e7ac9d048a02398eacc82d04cc0e9dde94c5f2715c0a63a762a0216fcba42e8d-primary.xml.gz (IP: 162.255.226.75)
2024-02-20T06:16:26.460 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for http://ftp-nyc.osuosl.org/pub/fedora-epel/8/Everything/x86_64/repodata/062a51a268ef517f7991f81cfd6b1bf55e21912a9515aa68c52a8587a73c6d8d-filelists.xml.gz (IP: 64.50.233.100)
2024-02-20T06:16:26.460 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for http://mirrors.sonic.net/epel/8/Everything/x86_64/repodata/e7ac9d048a02398eacc82d04cc0e9dde94c5f2715c0a63a762a0216fcba42e8d-primary.xml.gz (IP: 157.131.224.201)
2024-02-20T06:16:26.460 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for http://mirror.dal.nexril.net/fedora-epel/8/Everything/x86_64/repodata/062a51a268ef517f7991f81cfd6b1bf55e21912a9515aa68c52a8587a73c6d8d-filelists.xml.gz (IP: 161.129.154.250)
2024-02-20T06:16:26.460 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for http://pubmirror2.math.uh.edu/fedora-buffet/epel/8/Everything/x86_64/repodata/3041b357f5493087f52f1ce0f07aa188edb89002519a6a51079d03adb214b814-updateinfo.xml.bz2 (IP: 129.7.128.190)
2024-02-20T06:16:26.460 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for https://mirrors.wcupa.edu/epel/8/Everything/x86_64/repodata/3041b357f5493087f52f1ce0f07aa188edb89002519a6a51079d03adb214b814-updateinfo.xml.bz2 (IP: 144.26.0.246)
2024-02-20T06:16:26.460 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for https://mirrors.upr.edu/epel/8/Everything/x86_64/repodata/3041b357f5493087f52f1ce0f07aa188edb89002519a6a51079d03adb214b814-updateinfo.xml.bz2 (IP: 136.145.244.40)
2024-02-20T06:16:26.460 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for https://dl.fedoraproject.org/pub/epel/8/Everything/x86_64/repodata/3041b357f5493087f52f1ce0f07aa188edb89002519a6a51079d03adb214b814-updateinfo.xml.bz2 (IP: 38.145.60.23)
2024-02-20T06:16:26.460 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for http://mirrors.vcea.wsu.edu/epel/8/Everything/x86_64/repodata/3041b357f5493087f52f1ce0f07aa188edb89002519a6a51079d03adb214b814-updateinfo.xml.bz2 (IP: 69.166.55.80)
2024-02-20T06:16:26.460 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for http://repos.eggycrew.com/epel/8/Everything/x86_64/repodata/3041b357f5493087f52f1ce0f07aa188edb89002519a6a51079d03adb214b814-updateinfo.xml.bz2 (IP: 104.167.241.199)
2024-02-20T06:16:26.460 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for http://mirror.dal.nexril.net/fedora-epel/8/Everything/x86_64/repodata/7a1ac7e0bc8f7c2f7213c6370e54fff456d13df7b9ff311d8979ad88e8e14b63-prestodelta.xml.xz (IP: 161.129.154.250)
2024-02-20T06:16:26.460 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for http://dl.fedoraproject.org/pub/epel/8/Everything/x86_64/repodata/7a1ac7e0bc8f7c2f7213c6370e54fff456d13df7b9ff311d8979ad88e8e14b63-prestodelta.xml.xz (IP: 38.145.60.22)
2024-02-20T06:16:26.460 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for https://repos.eggycrew.com/epel/8/Everything/x86_64/repodata/e7ac9d048a02398eacc82d04cc0e9dde94c5f2715c0a63a762a0216fcba42e8d-primary.xml.gz (IP: 104.167.241.199)
2024-02-20T06:16:26.461 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for http://mirrors.wcupa.edu/epel/8/Everything/x86_64/repodata/e7ac9d048a02398eacc82d04cc0e9dde94c5f2715c0a63a762a0216fcba42e8d-primary.xml.gz (IP: 144.26.0.246)
2024-02-20T06:16:26.461 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for https://pubmirror2.math.uh.edu/fedora-buffet/epel/8/Everything/x86_64/repodata/062a51a268ef517f7991f81cfd6b1bf55e21912a9515aa68c52a8587a73c6d8d-filelists.xml.gz (IP: 129.7.128.190)
2024-02-20T06:16:26.461 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for https://mirror.servaxnet.com/epel/8/Everything/x86_64/repodata/062a51a268ef517f7991f81cfd6b1bf55e21912a9515aa68c52a8587a73c6d8d-filelists.xml.gz (IP: 162.255.226.75)
2024-02-20T06:16:26.461 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for https://pubmirror3.math.uh.edu/fedora-buffet/epel/8/Everything/x86_64/repodata/7a1ac7e0bc8f7c2f7213c6370e54fff456d13df7b9ff311d8979ad88e8e14b63-prestodelta.xml.xz (IP: 129.7.128.191)
2024-02-20T06:16:26.461 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for https://mirrors.wcupa.edu/epel/8/Everything/x86_64/repodata/e7ac9d048a02398eacc82d04cc0e9dde94c5f2715c0a63a762a0216fcba42e8d-primary.xml.gz (IP: 144.26.0.246)
2024-02-20T06:16:26.461 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for https://repos.eggycrew.com/epel/8/Everything/x86_64/repodata/3041b357f5493087f52f1ce0f07aa188edb89002519a6a51079d03adb214b814-updateinfo.xml.bz2 (IP: 104.167.241.199)
2024-02-20T06:16:26.461 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for https://mirror.dst.ca/fedora-linux/epel/8/Everything/x86_64/repodata/e7ac9d048a02398eacc82d04cc0e9dde94c5f2715c0a63a762a0216fcba42e8d-primary.xml.gz (IP: 208.89.84.55)
2024-02-20T06:16:26.461 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for http://pubmirror2.math.uh.edu/fedora-buffet/epel/8/Everything/x86_64/repodata/e7ac9d048a02398eacc82d04cc0e9dde94c5f2715c0a63a762a0216fcba42e8d-primary.xml.gz (IP: 129.7.128.190)
2024-02-20T06:16:26.461 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for https://sjc.mirror.rackspace.com/epel/8/Everything/x86_64/repodata/e7ac9d048a02398eacc82d04cc0e9dde94c5f2715c0a63a762a0216fcba42e8d-primary.xml.gz (IP: 159.135.194.176)
2024-02-20T06:16:26.461 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for https://pubmirror1.math.uh.edu/fedora-buffet/epel/8/Everything/x86_64/repodata/3041b357f5493087f52f1ce0f07aa188edb89002519a6a51079d03adb214b814-updateinfo.xml.bz2 (IP: 129.7.128.189)
2024-02-20T06:16:26.462 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for https://ftp-osl.osuosl.org/pub/fedora-epel/8/Everything/x86_64/repodata/e7ac9d048a02398eacc82d04cc0e9dde94c5f2715c0a63a762a0216fcba42e8d-primary.xml.gz (IP: 140.211.166.134)
2024-02-20T06:16:26.462 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for https://mirror.dal.nexril.net/fedora-epel/8/Everything/x86_64/repodata/e7ac9d048a02398eacc82d04cc0e9dde94c5f2715c0a63a762a0216fcba42e8d-primary.xml.gz (IP: 161.129.154.250)
2024-02-20T06:16:26.462 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for http://mirrors.wcupa.edu/epel/8/Everything/x86_64/repodata/062a51a268ef517f7991f81cfd6b1bf55e21912a9515aa68c52a8587a73c6d8d-filelists.xml.gz (IP: 144.26.0.246)
2024-02-20T06:16:26.462 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for https://mirror.dst.ca/fedora-linux/epel/8/Everything/x86_64/repodata/7a1ac7e0bc8f7c2f7213c6370e54fff456d13df7b9ff311d8979ad88e8e14b63-prestodelta.xml.xz (IP: 208.89.84.55)
2024-02-20T06:16:26.462 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for https://d2lzkl7pfhq30w.cloudfront.net/pub/epel/8/Everything/x86_64/repodata/3041b357f5493087f52f1ce0f07aa188edb89002519a6a51079d03adb214b814-updateinfo.xml.bz2 (IP: 99.86.227.83)
2024-02-20T06:16:26.462 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for http://mirrors.wcupa.edu/epel/8/Everything/x86_64/repodata/3041b357f5493087f52f1ce0f07aa188edb89002519a6a51079d03adb214b814-updateinfo.xml.bz2 (IP: 144.26.0.246)
2024-02-20T06:16:26.462 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for https://ftp-osl.osuosl.org/pub/fedora-epel/8/Everything/x86_64/repodata/7a1ac7e0bc8f7c2f7213c6370e54fff456d13df7b9ff311d8979ad88e8e14b63-prestodelta.xml.xz (IP: 140.211.166.134)
2024-02-20T06:16:26.462 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for https://mirror.arizona.edu/fedora-epel/8/Everything/x86_64/repodata/062a51a268ef517f7991f81cfd6b1bf55e21912a9515aa68c52a8587a73c6d8d-filelists.xml.gz (IP: 128.196.204.204)
2024-02-20T06:16:26.462 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for https://d2lzkl7pfhq30w.cloudfront.net/pub/epel/8/Everything/x86_64/repodata/7a1ac7e0bc8f7c2f7213c6370e54fff456d13df7b9ff311d8979ad88e8e14b63-prestodelta.xml.xz (IP: 99.86.227.83)
2024-02-20T06:16:26.462 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for http://mirrors.vcea.wsu.edu/epel/8/Everything/x86_64/repodata/062a51a268ef517f7991f81cfd6b1bf55e21912a9515aa68c52a8587a73c6d8d-filelists.xml.gz (IP: 69.166.55.80)
2024-02-20T06:16:26.462 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for http://mirror.arizona.edu/fedora-epel/8/Everything/x86_64/repodata/3041b357f5493087f52f1ce0f07aa188edb89002519a6a51079d03adb214b814-updateinfo.xml.bz2 (IP: 128.196.204.204)
2024-02-20T06:16:26.462 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for http://pubmirror1.math.uh.edu/fedora-buffet/epel/8/Everything/x86_64/repodata/062a51a268ef517f7991f81cfd6b1bf55e21912a9515aa68c52a8587a73c6d8d-filelists.xml.gz (IP: 129.7.128.189)
2024-02-20T06:16:26.462 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for http://sjc.mirror.rackspace.com/epel/8/Everything/x86_64/repodata/7a1ac7e0bc8f7c2f7213c6370e54fff456d13df7b9ff311d8979ad88e8e14b63-prestodelta.xml.xz (IP: 159.135.194.176)
2024-02-20T06:16:26.462 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for https://pubmirror1.math.uh.edu/fedora-buffet/epel/8/Everything/x86_64/repodata/062a51a268ef517f7991f81cfd6b1bf55e21912a9515aa68c52a8587a73c6d8d-filelists.xml.gz (IP: 129.7.128.189)
2024-02-20T06:16:26.462 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for http://mirror.servaxnet.com/epel/8/Everything/x86_64/repodata/062a51a268ef517f7991f81cfd6b1bf55e21912a9515aa68c52a8587a73c6d8d-filelists.xml.gz (IP: 162.255.226.75)
2024-02-20T06:16:26.462 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for https://mirrors.sonic.net/epel/8/Everything/x86_64/repodata/062a51a268ef517f7991f81cfd6b1bf55e21912a9515aa68c52a8587a73c6d8d-filelists.xml.gz (IP: 157.131.224.201)
2024-02-20T06:16:26.463 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for https://pubmirror1.math.uh.edu/fedora-buffet/epel/8/Everything/x86_64/repodata/e7ac9d048a02398eacc82d04cc0e9dde94c5f2715c0a63a762a0216fcba42e8d-primary.xml.gz (IP: 129.7.128.189)
2024-02-20T06:16:26.463 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for https://mirror.arizona.edu/fedora-epel/8/Everything/x86_64/repodata/7a1ac7e0bc8f7c2f7213c6370e54fff456d13df7b9ff311d8979ad88e8e14b63-prestodelta.xml.xz (IP: 128.196.204.204)
2024-02-20T06:16:26.463 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for https://mirrors.sonic.net/epel/8/Everything/x86_64/repodata/e7ac9d048a02398eacc82d04cc0e9dde94c5f2715c0a63a762a0216fcba42e8d-primary.xml.gz (IP: 157.131.224.201)
2024-02-20T06:16:26.463 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for http://mirror.dst.ca/fedora-linux/epel/8/Everything/x86_64/repodata/7a1ac7e0bc8f7c2f7213c6370e54fff456d13df7b9ff311d8979ad88e8e14b63-prestodelta.xml.xz (IP: 208.89.84.55)
2024-02-20T06:16:26.463 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for http://epel.mirror.constant.com/8/Everything/x86_64/repodata/e7ac9d048a02398eacc82d04cc0e9dde94c5f2715c0a63a762a0216fcba42e8d-primary.xml.gz (IP: 108.61.5.85)
2024-02-20T06:16:26.463 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for http://epel.mirror.constant.com/8/Everything/x86_64/repodata/062a51a268ef517f7991f81cfd6b1bf55e21912a9515aa68c52a8587a73c6d8d-filelists.xml.gz (IP: 108.61.5.85)
2024-02-20T06:16:26.463 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for http://mirror.arizona.edu/fedora-epel/8/Everything/x86_64/repodata/062a51a268ef517f7991f81cfd6b1bf55e21912a9515aa68c52a8587a73c6d8d-filelists.xml.gz (IP: 128.196.204.204)
2024-02-20T06:16:26.463 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for https://ftp-nyc.osuosl.org/pub/fedora-epel/8/Everything/x86_64/repodata/062a51a268ef517f7991f81cfd6b1bf55e21912a9515aa68c52a8587a73c6d8d-filelists.xml.gz (IP: 64.50.233.100)
2024-02-20T06:16:26.463 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for https://mirror.servaxnet.com/epel/8/Everything/x86_64/repodata/3041b357f5493087f52f1ce0f07aa188edb89002519a6a51079d03adb214b814-updateinfo.xml.bz2 (IP: 162.255.226.75)
2024-02-20T06:16:26.463 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for https://pubmirror1.math.uh.edu/fedora-buffet/epel/8/Everything/x86_64/repodata/7a1ac7e0bc8f7c2f7213c6370e54fff456d13df7b9ff311d8979ad88e8e14b63-prestodelta.xml.xz (IP: 129.7.128.189)
2024-02-20T06:16:26.464 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for http://pubmirror3.math.uh.edu/fedora-buffet/epel/8/Everything/x86_64/repodata/062a51a268ef517f7991f81cfd6b1bf55e21912a9515aa68c52a8587a73c6d8d-filelists.xml.gz (IP: 129.7.128.191)
2024-02-20T06:16:26.464 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for http://mirrors.vcea.wsu.edu/epel/8/Everything/x86_64/repodata/e7ac9d048a02398eacc82d04cc0e9dde94c5f2715c0a63a762a0216fcba42e8d-primary.xml.gz (IP: 69.166.55.80)
2024-02-20T06:16:26.464 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for https://pubmirror2.math.uh.edu/fedora-buffet/epel/8/Everything/x86_64/repodata/7a1ac7e0bc8f7c2f7213c6370e54fff456d13df7b9ff311d8979ad88e8e14b63-prestodelta.xml.xz (IP: 129.7.128.190)
2024-02-20T06:16:26.464 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for http://pubmirror3.math.uh.edu/fedora-buffet/epel/8/Everything/x86_64/repodata/7a1ac7e0bc8f7c2f7213c6370e54fff456d13df7b9ff311d8979ad88e8e14b63-prestodelta.xml.xz (IP: 129.7.128.191)
2024-02-20T06:16:26.464 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for http://mirrors.upr.edu/epel/8/Everything/x86_64/repodata/e7ac9d048a02398eacc82d04cc0e9dde94c5f2715c0a63a762a0216fcba42e8d-primary.xml.gz (IP: 136.145.244.40)
2024-02-20T06:16:26.464 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for https://mirror.arizona.edu/fedora-epel/8/Everything/x86_64/repodata/e7ac9d048a02398eacc82d04cc0e9dde94c5f2715c0a63a762a0216fcba42e8d-primary.xml.gz (IP: 128.196.204.204)
2024-02-20T06:16:26.464 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for http://mirror.arizona.edu/fedora-epel/8/Everything/x86_64/repodata/7a1ac7e0bc8f7c2f7213c6370e54fff456d13df7b9ff311d8979ad88e8e14b63-prestodelta.xml.xz (IP: 128.196.204.204)
2024-02-20T06:16:26.464 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for https://mirror.dst.ca/fedora-linux/epel/8/Everything/x86_64/repodata/3041b357f5493087f52f1ce0f07aa188edb89002519a6a51079d03adb214b814-updateinfo.xml.bz2 (IP: 208.89.84.55)
2024-02-20T06:16:26.464 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for http://mirrors.wcupa.edu/epel/8/Everything/x86_64/repodata/7a1ac7e0bc8f7c2f7213c6370e54fff456d13df7b9ff311d8979ad88e8e14b63-prestodelta.xml.xz (IP: 144.26.0.246)
2024-02-20T06:16:26.464 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for http://ftp-osl.osuosl.org/pub/fedora-epel/8/Everything/x86_64/repodata/7a1ac7e0bc8f7c2f7213c6370e54fff456d13df7b9ff311d8979ad88e8e14b63-prestodelta.xml.xz (IP: 140.211.166.134)
2024-02-20T06:16:26.465 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for http://ftp-osl.osuosl.org/pub/fedora-epel/8/Everything/x86_64/repodata/e7ac9d048a02398eacc82d04cc0e9dde94c5f2715c0a63a762a0216fcba42e8d-primary.xml.gz (IP: 140.211.166.134)
2024-02-20T06:16:26.465 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for http://dl.fedoraproject.org/pub/epel/8/Everything/x86_64/repodata/e7ac9d048a02398eacc82d04cc0e9dde94c5f2715c0a63a762a0216fcba42e8d-primary.xml.gz (IP: 38.145.60.22)
2024-02-20T06:16:26.465 INFO:teuthology.orchestra.run.smithi155.stderr:  - Curl error (7): Couldn't connect to server for https://epel.stl.us.ssimn.org/8/Everything/x86_64/repodata/b3c4416ce481fc571b6500701fbf2a24c7b2dec695d891ffaeb66433dd7d9574-comps-Everything.x86_64.xml [Failed to connect to epel.stl.us.ssimn.org port 443: Connection timed out]
2024-02-20T06:16:26.465 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for https://mirrors.wcupa.edu/epel/8/Everything/x86_64/repodata/062a51a268ef517f7991f81cfd6b1bf55e21912a9515aa68c52a8587a73c6d8d-filelists.xml.gz (IP: 144.26.0.246)
2024-02-20T06:16:26.465 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for http://epel.mirror.constant.com/8/Everything/x86_64/repodata/7a1ac7e0bc8f7c2f7213c6370e54fff456d13df7b9ff311d8979ad88e8e14b63-prestodelta.xml.xz (IP: 108.61.5.85)
2024-02-20T06:16:26.465 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for https://sjc.mirror.rackspace.com/epel/8/Everything/x86_64/repodata/7a1ac7e0bc8f7c2f7213c6370e54fff456d13df7b9ff311d8979ad88e8e14b63-prestodelta.xml.xz (IP: 159.135.194.176)
2024-02-20T06:16:26.465 INFO:teuthology.orchestra.run.smithi155.stderr:  - Curl error (7): Couldn't connect to server for https://epel.stl.us.ssimn.org/8/Everything/x86_64/repodata/e7ac9d048a02398eacc82d04cc0e9dde94c5f2715c0a63a762a0216fcba42e8d-primary.xml.gz [Failed to connect to epel.stl.us.ssimn.org port 443: Connection timed out]
2024-02-20T06:16:26.465 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for https://d2lzkl7pfhq30w.cloudfront.net/pub/epel/8/Everything/x86_64/repodata/e7ac9d048a02398eacc82d04cc0e9dde94c5f2715c0a63a762a0216fcba42e8d-primary.xml.gz (IP: 99.86.227.15)
2024-02-20T06:16:26.465 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for http://mirror.servaxnet.com/epel/8/Everything/x86_64/repodata/3041b357f5493087f52f1ce0f07aa188edb89002519a6a51079d03adb214b814-updateinfo.xml.bz2 (IP: 162.255.226.75)
2024-02-20T06:16:26.465 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for http://ftp-nyc.osuosl.org/pub/fedora-epel/8/Everything/x86_64/repodata/3041b357f5493087f52f1ce0f07aa188edb89002519a6a51079d03adb214b814-updateinfo.xml.bz2 (IP: 64.50.233.100)
2024-02-20T06:16:26.465 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for http://pubmirror2.math.uh.edu/fedora-buffet/epel/8/Everything/x86_64/repodata/7a1ac7e0bc8f7c2f7213c6370e54fff456d13df7b9ff311d8979ad88e8e14b63-prestodelta.xml.xz (IP: 129.7.128.190)
2024-02-20T06:16:26.465 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for http://repos.eggycrew.com/epel/8/Everything/x86_64/repodata/7a1ac7e0bc8f7c2f7213c6370e54fff456d13df7b9ff311d8979ad88e8e14b63-prestodelta.xml.xz (IP: 104.167.241.199)
2024-02-20T06:16:26.466 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for https://mirror.dal.nexril.net/fedora-epel/8/Everything/x86_64/repodata/3041b357f5493087f52f1ce0f07aa188edb89002519a6a51079d03adb214b814-updateinfo.xml.bz2 (IP: 161.129.154.250)
2024-02-20T06:16:26.466 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for http://mirror.servaxnet.com/epel/8/Everything/x86_64/repodata/7a1ac7e0bc8f7c2f7213c6370e54fff456d13df7b9ff311d8979ad88e8e14b63-prestodelta.xml.xz (IP: 162.255.226.75)
2024-02-20T06:16:26.466 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for http://mirrors.sonic.net/epel/8/Everything/x86_64/repodata/3041b357f5493087f52f1ce0f07aa188edb89002519a6a51079d03adb214b814-updateinfo.xml.bz2 (IP: 157.131.224.201)
2024-02-20T06:16:26.466 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for http://pubmirror1.math.uh.edu/fedora-buffet/epel/8/Everything/x86_64/repodata/3041b357f5493087f52f1ce0f07aa188edb89002519a6a51079d03adb214b814-updateinfo.xml.bz2 (IP: 129.7.128.189)
2024-02-20T06:16:26.466 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for http://mirrors.sonic.net/epel/8/Everything/x86_64/repodata/062a51a268ef517f7991f81cfd6b1bf55e21912a9515aa68c52a8587a73c6d8d-filelists.xml.gz (IP: 157.131.224.201)
2024-02-20T06:16:26.466 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for http://dl.fedoraproject.org/pub/epel/8/Everything/x86_64/repodata/3041b357f5493087f52f1ce0f07aa188edb89002519a6a51079d03adb214b814-updateinfo.xml.bz2 (IP: 38.145.60.22)
2024-02-20T06:16:26.466 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for http://pubmirror1.math.uh.edu/fedora-buffet/epel/8/Everything/x86_64/repodata/7a1ac7e0bc8f7c2f7213c6370e54fff456d13df7b9ff311d8979ad88e8e14b63-prestodelta.xml.xz (IP: 129.7.128.189)
2024-02-20T06:16:26.466 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for http://mirrors.vcea.wsu.edu/epel/8/Everything/x86_64/repodata/7a1ac7e0bc8f7c2f7213c6370e54fff456d13df7b9ff311d8979ad88e8e14b63-prestodelta.xml.xz (IP: 69.166.55.80)
2024-02-20T06:16:26.466 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for http://sjc.mirror.rackspace.com/epel/8/Everything/x86_64/repodata/e7ac9d048a02398eacc82d04cc0e9dde94c5f2715c0a63a762a0216fcba42e8d-primary.xml.gz (IP: 159.135.194.176)
2024-02-20T06:16:26.466 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for http://mirrors.sonic.net/epel/8/Everything/x86_64/repodata/7a1ac7e0bc8f7c2f7213c6370e54fff456d13df7b9ff311d8979ad88e8e14b63-prestodelta.xml.xz (IP: 157.131.224.201)
2024-02-20T06:16:26.466 INFO:teuthology.orchestra.run.smithi155.stderr:  - Curl error (7): Couldn't connect to server for http://epel.stl.us.ssimn.org/8/Everything/x86_64/repodata/e7ac9d048a02398eacc82d04cc0e9dde94c5f2715c0a63a762a0216fcba42e8d-primary.xml.gz [Failed to connect to epel.stl.us.ssimn.org port 80: Connection timed out]
2024-02-20T06:16:26.466 INFO:teuthology.orchestra.run.smithi155.stderr:  - Curl error (35): SSL connect error for https://mirrors.sonic.net/epel/8/Everything/x86_64/repodata/7a1ac7e0bc8f7c2f7213c6370e54fff456d13df7b9ff311d8979ad88e8e14b63-prestodelta.xml.xz [OpenSSL SSL_connect: SSL_ERROR_SYSCALL in connection to mirrors.sonic.net:443 ]
2024-02-20T06:16:26.466 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for http://mirrors.upr.edu/epel/8/Everything/x86_64/repodata/7a1ac7e0bc8f7c2f7213c6370e54fff456d13df7b9ff311d8979ad88e8e14b63-prestodelta.xml.xz (IP: 136.145.244.40)
2024-02-20T06:16:26.466 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for https://ftp-nyc.osuosl.org/pub/fedora-epel/8/Everything/x86_64/repodata/7a1ac7e0bc8f7c2f7213c6370e54fff456d13df7b9ff311d8979ad88e8e14b63-prestodelta.xml.xz (IP: 64.50.233.100)
2024-02-20T06:16:26.466 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for https://mirror.dal.nexril.net/fedora-epel/8/Everything/x86_64/repodata/7a1ac7e0bc8f7c2f7213c6370e54fff456d13df7b9ff311d8979ad88e8e14b63-prestodelta.xml.xz (IP: 161.129.154.250)
2024-02-20T06:16:26.467 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for https://mirror.servaxnet.com/epel/8/Everything/x86_64/repodata/7a1ac7e0bc8f7c2f7213c6370e54fff456d13df7b9ff311d8979ad88e8e14b63-prestodelta.xml.xz (IP: 162.255.226.75)
2024-02-20T06:16:26.467 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for https://dl.fedoraproject.org/pub/epel/8/Everything/x86_64/repodata/e7ac9d048a02398eacc82d04cc0e9dde94c5f2715c0a63a762a0216fcba42e8d-primary.xml.gz (IP: 38.145.60.22)
2024-02-20T06:16:26.467 INFO:teuthology.orchestra.run.smithi155.stderr:  - Curl error (7): Couldn't connect to server for http://epel.stl.us.ssimn.org/8/Everything/x86_64/repodata/7a1ac7e0bc8f7c2f7213c6370e54fff456d13df7b9ff311d8979ad88e8e14b63-prestodelta.xml.xz [Failed to connect to epel.stl.us.ssimn.org port 80: Connection timed out]
2024-02-20T06:16:26.467 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for http://ftp-nyc.osuosl.org/pub/fedora-epel/8/Everything/x86_64/repodata/e7ac9d048a02398eacc82d04cc0e9dde94c5f2715c0a63a762a0216fcba42e8d-primary.xml.gz (IP: 64.50.233.100)
2024-02-20T06:16:26.467 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for http://pubmirror3.math.uh.edu/fedora-buffet/epel/8/Everything/x86_64/repodata/e7ac9d048a02398eacc82d04cc0e9dde94c5f2715c0a63a762a0216fcba42e8d-primary.xml.gz (IP: 129.7.128.191)
2024-02-20T06:16:26.467 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for https://mirrors.upr.edu/epel/8/Everything/x86_64/repodata/7a1ac7e0bc8f7c2f7213c6370e54fff456d13df7b9ff311d8979ad88e8e14b63-prestodelta.xml.xz (IP: 136.145.244.40)
2024-02-20T06:16:26.467 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for https://mirrors.upr.edu/epel/8/Everything/x86_64/repodata/e7ac9d048a02398eacc82d04cc0e9dde94c5f2715c0a63a762a0216fcba42e8d-primary.xml.gz (IP: 136.145.244.40)
2024-02-20T06:16:26.467 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for http://repos.eggycrew.com/epel/8/Everything/x86_64/repodata/e7ac9d048a02398eacc82d04cc0e9dde94c5f2715c0a63a762a0216fcba42e8d-primary.xml.gz (IP: 104.167.241.199)
2024-02-20T06:16:26.467 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for https://mirror.dal.nexril.net/fedora-epel/8/Everything/x86_64/repodata/062a51a268ef517f7991f81cfd6b1bf55e21912a9515aa68c52a8587a73c6d8d-filelists.xml.gz (IP: 161.129.154.250)
2024-02-20T06:16:26.467 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for https://ftp-nyc.osuosl.org/pub/fedora-epel/8/Everything/x86_64/repodata/3041b357f5493087f52f1ce0f07aa188edb89002519a6a51079d03adb214b814-updateinfo.xml.bz2 (IP: 64.50.233.100)
2024-02-20T06:16:26.467 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for https://repos.eggycrew.com/epel/8/Everything/x86_64/repodata/7a1ac7e0bc8f7c2f7213c6370e54fff456d13df7b9ff311d8979ad88e8e14b63-prestodelta.xml.xz (IP: 104.167.241.199)
2024-02-20T06:16:26.467 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for http://ftp-nyc.osuosl.org/pub/fedora-epel/8/Everything/x86_64/repodata/7a1ac7e0bc8f7c2f7213c6370e54fff456d13df7b9ff311d8979ad88e8e14b63-prestodelta.xml.xz (IP: 64.50.233.100)
2024-02-20T06:16:26.467 INFO:teuthology.orchestra.run.smithi155.stderr:  - Curl error (7): Couldn't connect to server for http://epel.stl.us.ssimn.org/8/Everything/x86_64/repodata/3041b357f5493087f52f1ce0f07aa188edb89002519a6a51079d03adb214b814-updateinfo.xml.bz2 [Failed to connect to epel.stl.us.ssimn.org port 80: Connection timed out]
2024-02-20T06:16:26.467 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for https://dl.fedoraproject.org/pub/epel/8/Everything/x86_64/repodata/7a1ac7e0bc8f7c2f7213c6370e54fff456d13df7b9ff311d8979ad88e8e14b63-prestodelta.xml.xz (IP: 38.145.60.23)
2024-02-20T06:16:26.467 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for https://pubmirror3.math.uh.edu/fedora-buffet/epel/8/Everything/x86_64/repodata/062a51a268ef517f7991f81cfd6b1bf55e21912a9515aa68c52a8587a73c6d8d-filelists.xml.gz (IP: 129.7.128.191)
2024-02-20T06:16:26.467 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for https://pubmirror2.math.uh.edu/fedora-buffet/epel/8/Everything/x86_64/repodata/3041b357f5493087f52f1ce0f07aa188edb89002519a6a51079d03adb214b814-updateinfo.xml.bz2 (IP: 129.7.128.190)
2024-02-20T06:16:26.468 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for http://mirror.dal.nexril.net/fedora-epel/8/Everything/x86_64/repodata/e7ac9d048a02398eacc82d04cc0e9dde94c5f2715c0a63a762a0216fcba42e8d-primary.xml.gz (IP: 161.129.154.250)
2024-02-20T06:16:26.468 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for https://epel.mirror.constant.com/8/Everything/x86_64/repodata/7a1ac7e0bc8f7c2f7213c6370e54fff456d13df7b9ff311d8979ad88e8e14b63-prestodelta.xml.xz (IP: 108.61.5.85)
2024-02-20T06:16:26.468 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for http://sjc.mirror.rackspace.com/epel/8/Everything/x86_64/repodata/3041b357f5493087f52f1ce0f07aa188edb89002519a6a51079d03adb214b814-updateinfo.xml.bz2 (IP: 159.135.194.176)
2024-02-20T06:16:26.468 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for http://epel.mirror.constant.com/8/Everything/x86_64/repodata/3041b357f5493087f52f1ce0f07aa188edb89002519a6a51079d03adb214b814-updateinfo.xml.bz2 (IP: 108.61.5.85)
2024-02-20T06:16:26.468 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for https://ftp-nyc.osuosl.org/pub/fedora-epel/8/Everything/x86_64/repodata/e7ac9d048a02398eacc82d04cc0e9dde94c5f2715c0a63a762a0216fcba42e8d-primary.xml.gz (IP: 64.50.233.100)
2024-02-20T06:16:26.468 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for https://mirrors.sonic.net/epel/8/Everything/x86_64/repodata/3041b357f5493087f52f1ce0f07aa188edb89002519a6a51079d03adb214b814-updateinfo.xml.bz2 (IP: 157.131.224.201)
2024-02-20T06:16:26.468 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for https://pubmirror3.math.uh.edu/fedora-buffet/epel/8/Everything/x86_64/repodata/3041b357f5493087f52f1ce0f07aa188edb89002519a6a51079d03adb214b814-updateinfo.xml.bz2 (IP: 129.7.128.191)
2024-02-20T06:16:26.468 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for http://mirror.dal.nexril.net/fedora-epel/8/Everything/x86_64/repodata/3041b357f5493087f52f1ce0f07aa188edb89002519a6a51079d03adb214b814-updateinfo.xml.bz2 (IP: 161.129.154.250)
2024-02-20T06:16:26.468 INFO:teuthology.orchestra.run.smithi155.stderr:  - Curl error (7): Couldn't connect to server for https://epel.stl.us.ssimn.org/8/Everything/x86_64/repodata/3041b357f5493087f52f1ce0f07aa188edb89002519a6a51079d03adb214b814-updateinfo.xml.bz2 [Failed to connect to epel.stl.us.ssimn.org port 443: Connection timed out]
2024-02-20T06:16:26.468 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for https://pubmirror2.math.uh.edu/fedora-buffet/epel/8/Everything/x86_64/repodata/e7ac9d048a02398eacc82d04cc0e9dde94c5f2715c0a63a762a0216fcba42e8d-primary.xml.gz (IP: 129.7.128.190)
2024-02-20T06:16:26.468 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for https://epel.mirror.constant.com/8/Everything/x86_64/repodata/e7ac9d048a02398eacc82d04cc0e9dde94c5f2715c0a63a762a0216fcba42e8d-primary.xml.gz (IP: 108.61.5.85)
2024-02-20T06:16:26.468 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for https://mirror.servaxnet.com/epel/8/Everything/x86_64/repodata/e7ac9d048a02398eacc82d04cc0e9dde94c5f2715c0a63a762a0216fcba42e8d-primary.xml.gz (IP: 162.255.226.75)
2024-02-20T06:16:26.468 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for http://pubmirror3.math.uh.edu/fedora-buffet/epel/8/Everything/x86_64/repodata/3041b357f5493087f52f1ce0f07aa188edb89002519a6a51079d03adb214b814-updateinfo.xml.bz2 (IP: 129.7.128.191)
2024-02-20T06:16:26.468 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for https://epel.mirror.constant.com/8/Everything/x86_64/repodata/062a51a268ef517f7991f81cfd6b1bf55e21912a9515aa68c52a8587a73c6d8d-filelists.xml.gz (IP: 108.61.5.85)
2024-02-20T06:16:26.469 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for http://ftp-osl.osuosl.org/pub/fedora-epel/8/Everything/x86_64/repodata/3041b357f5493087f52f1ce0f07aa188edb89002519a6a51079d03adb214b814-updateinfo.xml.bz2 (IP: 140.211.166.134)
2024-02-20T06:16:26.469 INFO:teuthology.orchestra.run.smithi155.stderr:  - Status code: 404 for https://pubmirror3.math.uh.edu/fedora-buffet/epel/8/Everything/x86_64/repodata/e7ac9d048a02398eacc82d04cc0e9dde94c5f2715c0a63a762a0216fcba42e8d-primary.xml.gz (IP: 129.7.128.191)
2024-02-20T06:16:26.488 INFO:teuthology.orchestra.run.smithi155.stderr:Error: Failed to download metadata for repo 'epel': Yum repo downloading error: Downloading error(s): repodata/e7ac9d048a02398eacc82d04cc0e9dde94c5f2715c0a63a762a0216fcba42e8d-primary.xml.gz - Cannot download, all mirrors were already tried without success; repodata/7a1ac7e0bc8f7c2f7213c6370e54fff456d13df7b9ff311d8979ad88e8e14b63-prestodelta.xml.xz - Cannot download, all mirrors were already tried without success; repodata/3041b357f5493087f52f1ce0f07aa188edb89002519a6a51079d03adb214b814-updateinfo.xml.bz2 - Cannot download, all mirrors were already tried without success
2024-02-20T06:16:26.566 DEBUG:teuthology.orchestra.run:got remote process result: 1
2024-02-20T06:16:26.568 ERROR:teuthology.run_tasks:Saw exception from tasks.
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 109, in run_tasks
    manager.__enter__()
  File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__
    return next(self.gen)
  File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/kernel.py", line 1238, in task
    p.spawn(process_role, ctx, config, timeout, role, role_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/kernel.py", line 1270, in process_role
    version = need_to_install_distro(role_remote, role_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/kernel.py", line 761, in need_to_install_distro
    install_stdout = remote.sh(
  File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/remote.py", line 97, in sh
    proc = self.run(**kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/remote.py", line 523, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 455, in run
    r.wait()
  File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait
    self._raise_for_status()
  File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status
    raise CommandFailedError(
teuthology.exceptions.CommandFailedError: Command failed on smithi155 with status 1: 'sudo yum install -y kernel'
2024-02-20T06:16:26.791 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=ea0e3336f6ee4dcaa581f58d5b57d7a4
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 109, in run_tasks
    manager.__enter__()
  File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__
    return next(self.gen)
  File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/kernel.py", line 1238, in task
    p.spawn(process_role, ctx, config, timeout, role, role_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/kernel.py", line 1270, in process_role
    version = need_to_install_distro(role_remote, role_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/kernel.py", line 761, in need_to_install_distro
    install_stdout = remote.sh(
  File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/remote.py", line 97, in sh
    proc = self.run(**kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/remote.py", line 523, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 455, in run
    r.wait()
  File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait
    self._raise_for_status()
  File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status
    raise CommandFailedError(
teuthology.exceptions.CommandFailedError: Command failed on smithi155 with status 1: 'sudo yum install -y kernel'
2024-02-20T06:16:26.795 DEBUG:teuthology.run_tasks:Unwinding manager kernel
2024-02-20T06:16:26.825 DEBUG:teuthology.run_tasks:Unwinding manager console_log
2024-02-20T06:16:26.843 INFO:teuthology.nuke:Checking targets against current locks
2024-02-20T06:16:26.890 DEBUG:teuthology.nuke:shortname: smithi138
2024-02-20T06:16:26.891 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-02-20T06:16:26.916 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi138.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-19_20:17:41-rbd-wip-yuri5-testing-2024-02-16-1120-quincy-distro-default-smithi/7567340', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-20 06:00:29.520636', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHIk2XW09za2VTSWHaTwKT5ATuGuXn5vrVEiQEorKwO/QSQMkZ6Y591t5smG2XodTDsI6JQRs9oTFD1PVoZ14eQ='}
2024-02-20T06:16:26.920 DEBUG:teuthology.nuke:shortname: smithi155
2024-02-20T06:16:26.920 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-02-20T06:16:26.944 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi155.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-19_20:17:41-rbd-wip-yuri5-testing-2024-02-16-1120-quincy-distro-default-smithi/7567340', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-20 06:00:29.518910', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBExYPO6y8hksL+0GPL1laa3hl4XTKlSoTn5vCV/CKNuxo3zW7C/fvwaJgZSFFYf0dh//CdksE63WUghFRT0MF7U='}
2024-02-20T06:16:26.970 INFO:teuthology.orchestra.console.smithi138:Power off
2024-02-20T06:16:26.970 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-20T06:16:26.997 DEBUG:teuthology.orchestra.console.smithi138:power off output: Chassis Power Control: Down/Off
2024-02-20T06:16:26.997 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-20T06:16:27.013 INFO:teuthology.orchestra.console.smithi155:Power off
2024-02-20T06:16:27.014 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-20T06:16:27.024 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is on
2024-02-20T06:16:27.038 DEBUG:teuthology.orchestra.console.smithi155:power off output: Chassis Power Control: Down/Off
2024-02-20T06:16:27.038 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-20T06:16:27.061 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is on
2024-02-20T06:16:31.026 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-20T06:16:31.063 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-20T06:16:31.136 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is on
2024-02-20T06:16:31.177 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is on
2024-02-20T06:16:35.140 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-20T06:16:35.178 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-20T06:16:35.250 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is off
2024-02-20T06:16:35.288 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is on
2024-02-20T06:16:35.352 INFO:teuthology.orchestra.console.smithi138:Power off completed
2024-02-20T06:16:39.292 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-20T06:16:39.401 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is off
2024-02-20T06:16:39.502 INFO:teuthology.orchestra.console.smithi155:Power off completed
2024-02-20T06:16:39.607 INFO:teuthology.run:Summary data:
description: rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node
  openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-comp-snappy
  supported-random-distro$/{rhel_8} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus}
failure_reason: 'Command failed on smithi155 with status 1: ''sudo yum install -y
  kernel'''
owner: scheduled_yuriw@teuthology
sentry_event: https://sentry.ceph.com/organizations/ceph/?query=ea0e3336f6ee4dcaa581f58d5b57d7a4
status: fail
success: false

2024-02-20T06:16:39.607 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T06:16:39.683 INFO:teuthology.run:FAIL