2024-02-15T17:12:39.019 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55
2024-02-15T17:12:39.020 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/lflores-2024-02-15_16:35:54-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7561397 --name lflores-2024-02-15_16:35:54-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi --description rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} --owner scheduled_lflores@teuthology --verbose -- /home/teuthworker/archive/lflores-2024-02-15_16:35:54-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7561397/orig.config.yaml
2024-02-15T17:12:39.047 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-15T17:12:39.124 INFO:teuthology.run:Config:
  archive_path: /home/teuthworker/archive/lflores-2024-02-15_16:35:54-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7561397
  branch: wip-yuri10-testing-2024-02-08-0854-pacific
  description: rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/connectivity
    start}
  email: null
  first_in_suite: false
  job_id: '7561397'
  kernel:
    kdb: true
    sha1: distro
  last_in_suite: false
  machine_type: smithi
  name: lflores-2024-02-15_16:35:54-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi
  no_nested_subset: false
  nuke-on-error: true
  openstack:
  - volumes:
      count: 4
      size: 10
  os_type: ubuntu
  os_version: '18.04'
  overrides:
    admin_socket:
      branch: wip-yuri10-testing-2024-02-08-0854-pacific
    ceph:
      conf:
        global:
          mon election default strategy: 3
        mgr:
          debug mgr: 20
          debug ms: 1
        mon:
          debug mon: 20
          debug ms: 1
          debug paxos: 20
        osd:
          debug ms: 1
          debug osd: 20
          osd shutdown pgref assert: true
      flavor: default
      log-ignorelist:
      - \(MDS_ALL_DOWN\)
      - \(MDS_UP_LESS_THAN_MAX\)
      sha1: 0e714d9a4bd2a821113e6318adb87bd06cf81ec1
    ceph-deploy:
      conf:
        client:
          log file: /var/log/ceph/ceph-$name.$pid.log
        mon:
          osd default pool size: 2
    install:
      ceph:
        flavor: default
        sha1: 0e714d9a4bd2a821113e6318adb87bd06cf81ec1
    workunit:
      branch: wip-yuri10-testing-2024-02-08-0854-pacific
      sha1: 0e714d9a4bd2a821113e6318adb87bd06cf81ec1
  owner: scheduled_lflores@teuthology
  priority: 25
  repo: https://git.ceph.com/ceph-ci.git
  roles:
  - - mon.a
    - mon.c
    - mgr.y
    - osd.0
    - osd.1
    - osd.2
    - osd.3
    - client.0
    - ceph.rgw.foo.a
    - node-exporter.a
    - alertmanager.a
  - - mon.b
    - mgr.x
    - osd.4
    - osd.5
    - osd.6
    - osd.7
    - client.1
    - prometheus.a
    - grafana.a
    - node-exporter.b
    - ceph.iscsi.iscsi.a
  seed: 964
  sha1: 0e714d9a4bd2a821113e6318adb87bd06cf81ec1
  sleep_before_teardown: 0
  subset: 111/120000
  suite: rados
  suite_branch: wip-yuri10-testing-2024-02-08-0854-pacific
  suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_0e714d9a4bd2a821113e6318adb87bd06cf81ec1/qa
  suite_relpath: qa
  suite_repo: https://git.ceph.com/ceph-ci.git
  suite_sha1: 0e714d9a4bd2a821113e6318adb87bd06cf81ec1
  targets:
    smithi138.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHSAlWjESMc0Gra5f/6dvvbjuYJc2qVK13Ztw1gt4S0hdg9pLl/eAcLsaHQz3OAGEzcbKS0DF4bknjuwe5HHhPE=
    smithi152.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHSAlWjESMc0Gra5f/6dvvbjuYJc2qVK13Ztw1gt4S0hdg9pLl/eAcLsaHQz3OAGEzcbKS0DF4bknjuwe5HHhPE=
  tasks:
  - nvme_loop: null
  - cephadm:
      conf:
        mgr:
          debug mgr: 20
          debug ms: 1
  - cephadm.shell:
      mon.a:
      - stat -c '%u %g' /var/log/ceph | grep '167 167'
      - ceph orch status
      - ceph orch ps
      - ceph orch ls
      - ceph orch host ls
      - ceph orch device ls
      - ceph orch ls --format yaml
      - ceph orch ls | grep '^osd '
  teuthology:
    fragments_dropped: []
    meta: {}
    postmerge: []
  teuthology_branch: main
  teuthology_sha1: b1dac5519c57c269ea98a22fb7729016a1d0e4d2
  timestamp: 2024-02-15_16:35:54
  tube: smithi
  user: lflores
  verbose: true
  worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885
2024-02-15T17:12:39.125 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_0e714d9a4bd2a821113e6318adb87bd06cf81ec1/qa; will attempt to use it
2024-02-15T17:12:39.125 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_0e714d9a4bd2a821113e6318adb87bd06cf81ec1/qa/tasks
2024-02-15T17:12:39.126 INFO:teuthology.run_tasks:Running task internal.check_packages...
2024-02-15T17:12:39.127 INFO:teuthology.task.internal:Checking packages...
2024-02-15T17:12:39.152 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '0e714d9a4bd2a821113e6318adb87bd06cf81ec1'
2024-02-15T17:12:39.152 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch
2024-02-15T17:12:39.152 INFO:teuthology.packaging:ref: None
2024-02-15T17:12:39.152 INFO:teuthology.packaging:tag: None
2024-02-15T17:12:39.152 INFO:teuthology.packaging:branch: wip-yuri10-testing-2024-02-08-0854-pacific
2024-02-15T17:12:39.152 INFO:teuthology.packaging:sha1: 0e714d9a4bd2a821113e6318adb87bd06cf81ec1
2024-02-15T17:12:39.152 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&ref=wip-yuri10-testing-2024-02-08-0854-pacific
2024-02-15T17:12:39.291 INFO:teuthology.task.internal:Found packages for ceph version 16.2.14-521-g0e714d9a-1bionic
2024-02-15T17:12:39.292 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep...
2024-02-15T17:12:39.300 INFO:teuthology.task.internal:no buildpackages task found
2024-02-15T17:12:39.300 INFO:teuthology.run_tasks:Running task internal.save_config...
2024-02-15T17:12:39.306 INFO:teuthology.task.internal:Saving configuration
2024-02-15T17:12:39.317 INFO:teuthology.run_tasks:Running task internal.check_lock...
2024-02-15T17:12:39.323 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-02-15T17:12:39.349 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi138.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2024-02-15_16:35:54-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7561397', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '18.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-15 17:06:53.579542', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAII4U6ItCfOdoN1WdROC3KO40lcw/kzXeIM8M8q950kfL'}
2024-02-15T17:12:39.372 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi152.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2024-02-15_16:35:54-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7561397', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '18.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-15 17:06:53.581025', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAII4U6ItCfOdoN1WdROC3KO40lcw/kzXeIM8M8q950kfL'}
2024-02-15T17:12:39.372 INFO:teuthology.run_tasks:Running task internal.add_remotes...
2024-02-15T17:12:39.378 INFO:teuthology.task.internal:roles: ubuntu@smithi138.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'ceph.rgw.foo.a', 'node-exporter.a', 'alertmanager.a']
2024-02-15T17:12:39.378 INFO:teuthology.task.internal:roles: ubuntu@smithi152.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b', 'ceph.iscsi.iscsi.a']
2024-02-15T17:12:39.378 INFO:teuthology.run_tasks:Running task console_log...
2024-02-15T17:12:39.452 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f264f89a790>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f264f3f04c0>, signals=[15])
2024-02-15T17:12:39.452 INFO:teuthology.run_tasks:Running task internal.connect...
2024-02-15T17:12:39.458 INFO:teuthology.task.internal:Opening connections...
2024-02-15T17:12:39.458 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi138.front.sepia.ceph.com
2024-02-15T17:12:39.460 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T17:12:39.538 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi152.front.sepia.ceph.com
2024-02-15T17:12:39.539 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T17:12:39.660 INFO:teuthology.run_tasks:Running task internal.push_inventory...
2024-02-15T17:12:39.667 DEBUG:teuthology.orchestra.run.smithi138:> uname -m
2024-02-15T17:12:39.673 INFO:teuthology.orchestra.run.smithi138.stdout:x86_64
2024-02-15T17:12:39.673 DEBUG:teuthology.orchestra.run.smithi138:> cat /etc/os-release
2024-02-15T17:12:39.722 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="Ubuntu"
2024-02-15T17:12:39.722 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="18.04.6 LTS (Bionic Beaver)"
2024-02-15T17:12:39.722 INFO:teuthology.orchestra.run.smithi138.stdout:ID=ubuntu
2024-02-15T17:12:39.723 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE=debian
2024-02-15T17:12:39.723 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="Ubuntu 18.04.6 LTS"
2024-02-15T17:12:39.723 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="18.04"
2024-02-15T17:12:39.723 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://www.ubuntu.com/"
2024-02-15T17:12:39.723 INFO:teuthology.orchestra.run.smithi138.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-02-15T17:12:39.723 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-02-15T17:12:39.723 INFO:teuthology.orchestra.run.smithi138.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-02-15T17:12:39.723 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_CODENAME=bionic
2024-02-15T17:12:39.723 INFO:teuthology.orchestra.run.smithi138.stdout:UBUNTU_CODENAME=bionic
2024-02-15T17:12:39.724 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server
2024-02-15T17:12:39.746 DEBUG:teuthology.orchestra.run.smithi152:> uname -m
2024-02-15T17:12:39.783 INFO:teuthology.orchestra.run.smithi152.stdout:x86_64
2024-02-15T17:12:39.783 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release
2024-02-15T17:12:39.831 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="Ubuntu"
2024-02-15T17:12:39.831 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="18.04.6 LTS (Bionic Beaver)"
2024-02-15T17:12:39.831 INFO:teuthology.orchestra.run.smithi152.stdout:ID=ubuntu
2024-02-15T17:12:39.831 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE=debian
2024-02-15T17:12:39.831 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="Ubuntu 18.04.6 LTS"
2024-02-15T17:12:39.831 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="18.04"
2024-02-15T17:12:39.831 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://www.ubuntu.com/"
2024-02-15T17:12:39.831 INFO:teuthology.orchestra.run.smithi152.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-02-15T17:12:39.831 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-02-15T17:12:39.831 INFO:teuthology.orchestra.run.smithi152.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-02-15T17:12:39.832 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_CODENAME=bionic
2024-02-15T17:12:39.832 INFO:teuthology.orchestra.run.smithi152.stdout:UBUNTU_CODENAME=bionic
2024-02-15T17:12:39.832 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server
2024-02-15T17:12:39.854 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles...
2024-02-15T17:12:39.864 INFO:teuthology.run_tasks:Running task internal.check_conflict...
2024-02-15T17:12:39.876 INFO:teuthology.task.internal:Checking for old test directory...
2024-02-15T17:12:39.876 DEBUG:teuthology.orchestra.run.smithi138:> test '!' -e /home/ubuntu/cephtest
2024-02-15T17:12:39.878 DEBUG:teuthology.orchestra.run.smithi152:> test '!' -e /home/ubuntu/cephtest
2024-02-15T17:12:39.883 INFO:teuthology.run_tasks:Running task internal.check_ceph_data...
2024-02-15T17:12:39.889 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph...
2024-02-15T17:12:39.889 DEBUG:teuthology.orchestra.run.smithi138:> test -z $(ls -A /var/lib/ceph)
2024-02-15T17:12:39.927 DEBUG:teuthology.orchestra.run.smithi152:> test -z $(ls -A /var/lib/ceph)
2024-02-15T17:12:39.946 INFO:teuthology.run_tasks:Running task internal.vm_setup...
2024-02-15T17:12:40.003 INFO:teuthology.run_tasks:Running task kernel...
2024-02-15T17:12:40.025 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'}
2024-02-15T17:12:40.025 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300
2024-02-15T17:12:40.025 DEBUG:teuthology.orchestra.run.smithi138:> test -f /run/.containerenv -o -f /.dockerenv
2024-02-15T17:12:40.026 DEBUG:teuthology.orchestra.run.smithi152:> test -f /run/.containerenv -o -f /.dockerenv
2024-02-15T17:12:40.031 DEBUG:teuthology.orchestra.run:got remote process result: 1
2024-02-15T17:12:40.031 DEBUG:teuthology.orchestra.run.smithi138:> uname -r
2024-02-15T17:12:40.032 DEBUG:teuthology.orchestra.run:got remote process result: 1
2024-02-15T17:12:40.032 DEBUG:teuthology.orchestra.run.smithi152:> uname -r
2024-02-15T17:12:40.078 INFO:teuthology.orchestra.run.smithi138.stdout:4.15.0-200-generic
2024-02-15T17:12:40.078 INFO:teuthology.task.kernel:Running kernel on smithi138: 4.15.0-200-generic
2024-02-15T17:12:40.078 DEBUG:teuthology.orchestra.run.smithi138:> sudo apt-get clean
2024-02-15T17:12:40.079 INFO:teuthology.orchestra.run.smithi152.stdout:4.15.0-200-generic
2024-02-15T17:12:40.080 INFO:teuthology.task.kernel:Running kernel on smithi152: 4.15.0-200-generic
2024-02-15T17:12:40.080 DEBUG:teuthology.orchestra.run.smithi152:> sudo apt-get clean
2024-02-15T17:12:40.176 DEBUG:teuthology.orchestra.run.smithi152:> sudo apt-get update
2024-02-15T17:12:40.187 DEBUG:teuthology.orchestra.run.smithi138:> sudo apt-get update
2024-02-15T17:12:40.493 INFO:teuthology.orchestra.run.smithi138.stdout:Get:1 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB]
2024-02-15T17:12:40.604 INFO:teuthology.orchestra.run.smithi152.stdout:Get:1 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB]
2024-02-15T17:12:40.605 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease
2024-02-15T17:12:40.625 INFO:teuthology.orchestra.run.smithi152.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease
2024-02-15T17:12:40.686 INFO:teuthology.orchestra.run.smithi152.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB]
2024-02-15T17:12:40.687 INFO:teuthology.orchestra.run.smithi138.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB]
2024-02-15T17:12:40.805 INFO:teuthology.orchestra.run.smithi138.stdout:Get:4 http://security.ubuntu.com/ubuntu bionic-security/main i386 Packages [1,379 kB]
2024-02-15T17:12:40.974 INFO:teuthology.orchestra.run.smithi138.stdout:Get:5 http://security.ubuntu.com/ubuntu bionic-security/main amd64 Packages [2,717 kB]
2024-02-15T17:12:41.015 INFO:teuthology.orchestra.run.smithi138.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [83.3 kB]
2024-02-15T17:12:41.017 INFO:teuthology.orchestra.run.smithi152.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [83.3 kB]
2024-02-15T17:12:41.047 INFO:teuthology.orchestra.run.smithi138.stdout:Get:7 http://security.ubuntu.com/ubuntu bionic-security/main Translation-en [467 kB]
2024-02-15T17:12:41.057 INFO:teuthology.orchestra.run.smithi138.stdout:Get:8 http://security.ubuntu.com/ubuntu bionic-security/restricted i386 Packages [33.0 kB]
2024-02-15T17:12:41.057 INFO:teuthology.orchestra.run.smithi138.stdout:Get:9 http://security.ubuntu.com/ubuntu bionic-security/restricted amd64 Packages [1,317 kB]
2024-02-15T17:12:41.074 INFO:teuthology.orchestra.run.smithi152.stdout:Get:5 http://security.ubuntu.com/ubuntu bionic-security/main amd64 Packages [2,717 kB]
2024-02-15T17:12:41.082 INFO:teuthology.orchestra.run.smithi138.stdout:Get:10 http://security.ubuntu.com/ubuntu bionic-security/restricted Translation-en [182 kB]
2024-02-15T17:12:41.086 INFO:teuthology.orchestra.run.smithi138.stdout:Get:11 http://security.ubuntu.com/ubuntu bionic-security/universe amd64 Packages [1,303 kB]
2024-02-15T17:12:41.108 INFO:teuthology.orchestra.run.smithi138.stdout:Get:12 http://security.ubuntu.com/ubuntu bionic-security/universe i386 Packages [1,078 kB]
2024-02-15T17:12:41.125 INFO:teuthology.orchestra.run.smithi138.stdout:Get:13 http://security.ubuntu.com/ubuntu bionic-security/universe Translation-en [308 kB]
2024-02-15T17:12:41.131 INFO:teuthology.orchestra.run.smithi138.stdout:Get:14 http://security.ubuntu.com/ubuntu bionic-security/multiverse amd64 Packages [19.8 kB]
2024-02-15T17:12:41.131 INFO:teuthology.orchestra.run.smithi138.stdout:Get:15 http://security.ubuntu.com/ubuntu bionic-security/multiverse i386 Packages [6,008 B]
2024-02-15T17:12:41.131 INFO:teuthology.orchestra.run.smithi138.stdout:Get:16 http://security.ubuntu.com/ubuntu bionic-security/multiverse Translation-en [3,928 B]
2024-02-15T17:12:41.163 INFO:teuthology.orchestra.run.smithi138.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic-updates/main i386 Packages [1,665 kB]
2024-02-15T17:12:41.203 INFO:teuthology.orchestra.run.smithi152.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages [3,045 kB]
2024-02-15T17:12:41.526 INFO:teuthology.orchestra.run.smithi138.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages [3,045 kB]
2024-02-15T17:12:41.621 INFO:teuthology.orchestra.run.smithi152.stdout:Get:7 http://security.ubuntu.com/ubuntu bionic-security/main i386 Packages [1,379 kB]
2024-02-15T17:12:41.648 INFO:teuthology.orchestra.run.smithi138.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic-updates/main Translation-en [554 kB]
2024-02-15T17:12:41.649 INFO:teuthology.orchestra.run.smithi152.stdout:Get:8 http://security.ubuntu.com/ubuntu bionic-security/main Translation-en [467 kB]
2024-02-15T17:12:41.659 INFO:teuthology.orchestra.run.smithi152.stdout:Get:9 http://security.ubuntu.com/ubuntu bionic-security/restricted i386 Packages [33.0 kB]
2024-02-15T17:12:41.660 INFO:teuthology.orchestra.run.smithi152.stdout:Get:10 http://security.ubuntu.com/ubuntu bionic-security/restricted amd64 Packages [1,317 kB]
2024-02-15T17:12:41.661 INFO:teuthology.orchestra.run.smithi138.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic-updates/restricted i386 Packages [39.7 kB]
2024-02-15T17:12:41.681 INFO:teuthology.orchestra.run.smithi138.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic-updates/restricted amd64 Packages [1,347 kB]
2024-02-15T17:12:41.705 INFO:teuthology.orchestra.run.smithi138.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic-updates/restricted Translation-en [187 kB]
2024-02-15T17:12:41.707 INFO:teuthology.orchestra.run.smithi138.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic-updates/universe i386 Packages [1,663 kB]
2024-02-15T17:12:41.712 INFO:teuthology.orchestra.run.smithi152.stdout:Get:11 http://security.ubuntu.com/ubuntu bionic-security/restricted Translation-en [182 kB]
2024-02-15T17:12:41.715 INFO:teuthology.orchestra.run.smithi152.stdout:Get:12 http://security.ubuntu.com/ubuntu bionic-security/universe i386 Packages [1,078 kB]
2024-02-15T17:12:41.717 INFO:teuthology.orchestra.run.smithi152.stdout:Get:13 http://archive.ubuntu.com/ubuntu bionic-updates/main i386 Packages [1,665 kB]
2024-02-15T17:12:41.739 INFO:teuthology.orchestra.run.smithi152.stdout:Get:14 http://security.ubuntu.com/ubuntu bionic-security/universe amd64 Packages [1,303 kB]
2024-02-15T17:12:41.748 INFO:teuthology.orchestra.run.smithi152.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic-updates/main Translation-en [554 kB]
2024-02-15T17:12:41.758 INFO:teuthology.orchestra.run.smithi152.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic-updates/restricted amd64 Packages [1,347 kB]
2024-02-15T17:12:41.762 INFO:teuthology.orchestra.run.smithi152.stdout:Get:17 http://security.ubuntu.com/ubuntu bionic-security/universe Translation-en [308 kB]
2024-02-15T17:12:41.763 INFO:teuthology.orchestra.run.smithi138.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,915 kB]
2024-02-15T17:12:41.788 INFO:teuthology.orchestra.run.smithi152.stdout:Get:18 http://security.ubuntu.com/ubuntu bionic-security/multiverse i386 Packages [6,008 B]
2024-02-15T17:12:41.811 INFO:teuthology.orchestra.run.smithi152.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic-updates/restricted i386 Packages [39.7 kB]
2024-02-15T17:12:41.811 INFO:teuthology.orchestra.run.smithi152.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic-updates/restricted Translation-en [187 kB]
2024-02-15T17:12:41.813 INFO:teuthology.orchestra.run.smithi152.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,915 kB]
2024-02-15T17:12:41.854 INFO:teuthology.orchestra.run.smithi152.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic-updates/universe i386 Packages [1,663 kB]
2024-02-15T17:12:41.959 INFO:teuthology.orchestra.run.smithi138.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic-updates/universe Translation-en [421 kB]
2024-02-15T17:12:42.482 INFO:teuthology.orchestra.run.smithi138.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse amd64 Packages [25.6 kB]
2024-02-15T17:12:42.485 INFO:teuthology.orchestra.run.smithi138.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse i386 Packages [11.2 kB]
2024-02-15T17:12:42.487 INFO:teuthology.orchestra.run.smithi138.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse Translation-en [6,088 B]
2024-02-15T17:12:42.488 INFO:teuthology.orchestra.run.smithi138.stdout:Get:29 http://archive.ubuntu.com/ubuntu bionic-backports/main amd64 Packages [53.3 kB]
2024-02-15T17:12:42.495 INFO:teuthology.orchestra.run.smithi138.stdout:Get:30 http://archive.ubuntu.com/ubuntu bionic-backports/main i386 Packages [53.2 kB]
2024-02-15T17:12:42.502 INFO:teuthology.orchestra.run.smithi138.stdout:Get:31 http://archive.ubuntu.com/ubuntu bionic-backports/universe amd64 Packages [18.2 kB]
2024-02-15T17:12:42.505 INFO:teuthology.orchestra.run.smithi138.stdout:Get:32 http://archive.ubuntu.com/ubuntu bionic-backports/universe i386 Packages [18.1 kB]
2024-02-15T17:12:42.508 INFO:teuthology.orchestra.run.smithi152.stdout:Get:23 http://security.ubuntu.com/ubuntu bionic-security/multiverse amd64 Packages [19.8 kB]
2024-02-15T17:12:42.510 INFO:teuthology.orchestra.run.smithi152.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic-updates/universe Translation-en [421 kB]
2024-02-15T17:12:42.679 INFO:teuthology.orchestra.run.smithi152.stdout:Get:25 http://security.ubuntu.com/ubuntu bionic-security/multiverse Translation-en [3,928 B]
2024-02-15T17:12:43.037 INFO:teuthology.orchestra.run.smithi152.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse amd64 Packages [25.6 kB]
2024-02-15T17:12:43.040 INFO:teuthology.orchestra.run.smithi152.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse i386 Packages [11.2 kB]
2024-02-15T17:12:43.041 INFO:teuthology.orchestra.run.smithi152.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse Translation-en [6,088 B]
2024-02-15T17:12:43.042 INFO:teuthology.orchestra.run.smithi152.stdout:Get:29 http://archive.ubuntu.com/ubuntu bionic-backports/main amd64 Packages [53.3 kB]
2024-02-15T17:12:43.050 INFO:teuthology.orchestra.run.smithi152.stdout:Get:30 http://archive.ubuntu.com/ubuntu bionic-backports/main i386 Packages [53.2 kB]
2024-02-15T17:12:43.057 INFO:teuthology.orchestra.run.smithi152.stdout:Get:31 http://archive.ubuntu.com/ubuntu bionic-backports/universe i386 Packages [18.1 kB]
2024-02-15T17:12:43.085 INFO:teuthology.orchestra.run.smithi152.stdout:Get:32 http://archive.ubuntu.com/ubuntu bionic-backports/universe amd64 Packages [18.2 kB]
2024-02-15T17:12:43.737 INFO:teuthology.orchestra.run.smithi138.stdout:Fetched 20.1 MB in 3s (6,078 kB/s)
2024-02-15T17:12:44.314 INFO:teuthology.orchestra.run.smithi152.stdout:Fetched 20.1 MB in 4s (5,175 kB/s)
2024-02-15T17:12:45.539 INFO:teuthology.orchestra.run.smithi138.stdout:Reading package lists...
2024-02-15T17:12:45.590 DEBUG:teuthology.orchestra.run.smithi138:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic
2024-02-15T17:12:45.673 INFO:teuthology.orchestra.run.smithi138.stdout:Reading package lists...
2024-02-15T17:12:45.938 INFO:teuthology.orchestra.run.smithi138.stdout:Building dependency tree...
2024-02-15T17:12:45.938 INFO:teuthology.orchestra.run.smithi138.stdout:Reading state information...
2024-02-15T17:12:46.093 INFO:teuthology.orchestra.run.smithi152.stdout:Reading package lists...
2024-02-15T17:12:46.143 DEBUG:teuthology.orchestra.run.smithi152:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic
2024-02-15T17:12:46.155 INFO:teuthology.orchestra.run.smithi138.stdout:The following additional packages will be installed:
2024-02-15T17:12:46.155 INFO:teuthology.orchestra.run.smithi138.stdout:  linux-generic linux-headers-4.15.0-213 linux-headers-4.15.0-213-generic
2024-02-15T17:12:46.156 INFO:teuthology.orchestra.run.smithi138.stdout:  linux-headers-generic linux-image-4.15.0-213-generic
2024-02-15T17:12:46.156 INFO:teuthology.orchestra.run.smithi138.stdout:  linux-modules-4.15.0-213-generic linux-modules-extra-4.15.0-213-generic
2024-02-15T17:12:46.158 INFO:teuthology.orchestra.run.smithi138.stdout:Suggested packages:
2024-02-15T17:12:46.158 INFO:teuthology.orchestra.run.smithi138.stdout:  fdutils linux-doc-4.15.0 | linux-source-4.15.0 linux-tools
2024-02-15T17:12:46.158 INFO:teuthology.orchestra.run.smithi138.stdout:Recommended packages:
2024-02-15T17:12:46.158 INFO:teuthology.orchestra.run.smithi138.stdout:  thermald
2024-02-15T17:12:46.219 INFO:teuthology.orchestra.run.smithi152.stdout:Reading package lists...
2024-02-15T17:12:46.220 INFO:teuthology.orchestra.run.smithi138.stdout:The following NEW packages will be installed:
2024-02-15T17:12:46.220 INFO:teuthology.orchestra.run.smithi138.stdout:  linux-headers-4.15.0-213 linux-headers-4.15.0-213-generic
2024-02-15T17:12:46.220 INFO:teuthology.orchestra.run.smithi138.stdout:  linux-image-4.15.0-213-generic linux-modules-4.15.0-213-generic
2024-02-15T17:12:46.221 INFO:teuthology.orchestra.run.smithi138.stdout:  linux-modules-extra-4.15.0-213-generic
2024-02-15T17:12:46.223 INFO:teuthology.orchestra.run.smithi138.stdout:The following packages will be upgraded:
2024-02-15T17:12:46.223 INFO:teuthology.orchestra.run.smithi138.stdout:  linux-generic linux-headers-generic linux-image-generic
2024-02-15T17:12:46.313 INFO:teuthology.orchestra.run.smithi138.stdout:3 upgraded, 5 newly installed, 0 to remove and 165 not upgraded.
2024-02-15T17:12:46.313 INFO:teuthology.orchestra.run.smithi138.stdout:Need to get 67.4 MB of archives.
2024-02-15T17:12:46.313 INFO:teuthology.orchestra.run.smithi138.stdout:After this operation, 351 MB of additional disk space will be used.
2024-02-15T17:12:46.313 INFO:teuthology.orchestra.run.smithi138.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-4.15.0-213-generic amd64 4.15.0-213.224 [13.4 MB]
2024-02-15T17:12:46.481 INFO:teuthology.orchestra.run.smithi152.stdout:Building dependency tree...
2024-02-15T17:12:46.481 INFO:teuthology.orchestra.run.smithi152.stdout:Reading state information...
2024-02-15T17:12:46.699 INFO:teuthology.orchestra.run.smithi152.stdout:The following additional packages will be installed:
2024-02-15T17:12:46.699 INFO:teuthology.orchestra.run.smithi152.stdout:  linux-generic linux-headers-4.15.0-213 linux-headers-4.15.0-213-generic
2024-02-15T17:12:46.699 INFO:teuthology.orchestra.run.smithi152.stdout:  linux-headers-generic linux-image-4.15.0-213-generic
2024-02-15T17:12:46.699 INFO:teuthology.orchestra.run.smithi152.stdout:  linux-modules-4.15.0-213-generic linux-modules-extra-4.15.0-213-generic
2024-02-15T17:12:46.702 INFO:teuthology.orchestra.run.smithi152.stdout:Suggested packages:
2024-02-15T17:12:46.702 INFO:teuthology.orchestra.run.smithi152.stdout:  fdutils linux-doc-4.15.0 | linux-source-4.15.0 linux-tools
2024-02-15T17:12:46.702 INFO:teuthology.orchestra.run.smithi152.stdout:Recommended packages:
2024-02-15T17:12:46.702 INFO:teuthology.orchestra.run.smithi152.stdout:  thermald
2024-02-15T17:12:46.766 INFO:teuthology.orchestra.run.smithi152.stdout:The following NEW packages will be installed:
2024-02-15T17:12:46.766 INFO:teuthology.orchestra.run.smithi152.stdout:  linux-headers-4.15.0-213 linux-headers-4.15.0-213-generic
2024-02-15T17:12:46.766 INFO:teuthology.orchestra.run.smithi152.stdout:  linux-image-4.15.0-213-generic linux-modules-4.15.0-213-generic
2024-02-15T17:12:46.766 INFO:teuthology.orchestra.run.smithi152.stdout:  linux-modules-extra-4.15.0-213-generic
2024-02-15T17:12:46.768 INFO:teuthology.orchestra.run.smithi152.stdout:The following packages will be upgraded:
2024-02-15T17:12:46.769 INFO:teuthology.orchestra.run.smithi152.stdout:  linux-generic linux-headers-generic linux-image-generic
2024-02-15T17:12:46.872 INFO:teuthology.orchestra.run.smithi152.stdout:3 upgraded, 5 newly installed, 0 to remove and 165 not upgraded.
2024-02-15T17:12:46.872 INFO:teuthology.orchestra.run.smithi152.stdout:Need to get 67.4 MB of archives.
2024-02-15T17:12:46.872 INFO:teuthology.orchestra.run.smithi152.stdout:After this operation, 351 MB of additional disk space will be used.
2024-02-15T17:12:46.872 INFO:teuthology.orchestra.run.smithi152.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-4.15.0-213-generic amd64 4.15.0-213.224 [13.4 MB]
2024-02-15T17:12:46.930 INFO:teuthology.orchestra.run.smithi138.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-4.15.0-213-generic amd64 4.15.0-213.224 [8,111 kB]
2024-02-15T17:12:47.062 INFO:teuthology.orchestra.run.smithi138.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-extra-4.15.0-213-generic amd64 4.15.0-213.224 [33.7 MB]
2024-02-15T17:12:47.670 INFO:teuthology.orchestra.run.smithi152.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-4.15.0-213-generic amd64 4.15.0-213.224 [8,111 kB]
2024-02-15T17:12:47.859 INFO:teuthology.orchestra.run.smithi138.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-generic amd64 4.15.0.213.196 [1,864 B]
2024-02-15T17:12:47.859 INFO:teuthology.orchestra.run.smithi138.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-generic amd64 4.15.0.213.196 [2,460 B]
2024-02-15T17:12:47.859 INFO:teuthology.orchestra.run.smithi138.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-213 all 4.15.0-213.224 [11.0 MB]
2024-02-15T17:12:47.863 INFO:teuthology.orchestra.run.smithi152.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-extra-4.15.0-213-generic amd64 4.15.0-213.224 [33.7 MB]
2024-02-15T17:12:48.161 INFO:teuthology.orchestra.run.smithi138.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-213-generic amd64 4.15.0-213.224 [1,250 kB]
2024-02-15T17:12:48.176 INFO:teuthology.orchestra.run.smithi138.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-generic amd64 4.15.0.213.196 [2,360 B]
2024-02-15T17:12:48.403 INFO:teuthology.orchestra.run.smithi152.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-generic amd64 4.15.0.213.196 [1,864 B]
2024-02-15T17:12:48.404 INFO:teuthology.orchestra.run.smithi152.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-generic amd64 4.15.0.213.196 [2,460 B]
2024-02-15T17:12:48.404 INFO:teuthology.orchestra.run.smithi152.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-213 all 4.15.0-213.224 [11.0 MB]
2024-02-15T17:12:48.577 INFO:teuthology.orchestra.run.smithi152.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-213-generic amd64 4.15.0-213.224 [1,250 kB]
2024-02-15T17:12:48.591 INFO:teuthology.orchestra.run.smithi152.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-generic amd64 4.15.0.213.196 [2,360 B]
2024-02-15T17:12:48.890 INFO:teuthology.orchestra.run.smithi138.stdout:Fetched 67.4 MB in 2s (34.8 MB/s)
2024-02-15T17:12:49.065 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package linux-modules-4.15.0-213-generic.
2024-02-15T17:12:49.266 INFO:teuthology.orchestra.run.smithi152.stdout:Fetched 67.4 MB in 2s (37.4 MB/s)
2024-02-15T17:12:49.453 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package linux-modules-4.15.0-213-generic.
2024-02-15T17:12:50.091 INFO:teuthology.orchestra.run.smithi138.stdout:(Reading database ... 
(Reading database ... 5%
(Reading database ... 10%
(Reading database ... 15%
(Reading database ... 20%
(Reading database ... 25%
(Reading database ... 30%
(Reading database ... 35%
(Reading database ... 40%
(Reading database ... 45%
(Reading database ... 50%
(Reading database ... 55%
(Reading database ... 60%
(Reading database ... 65%
(Reading database ... 70%
(Reading database ... 75%
(Reading database ... 80%
(Reading database ... 85%
(Reading database ... 90%
(Reading database ... 95%
(Reading database ... 100%
(Reading database ... 135963 files and directories currently installed.)
2024-02-15T17:12:50.095 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../0-linux-modules-4.15.0-213-generic_4.15.0-213.224_amd64.deb ...
2024-02-15T17:12:50.203 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-modules-4.15.0-213-generic (4.15.0-213.224) ...
2024-02-15T17:12:50.438 INFO:teuthology.orchestra.run.smithi152.stdout:(Reading database ... 
(Reading database ... 5%
(Reading database ... 10%
(Reading database ... 15%
(Reading database ... 20%
(Reading database ... 25%
(Reading database ... 30%
(Reading database ... 35%
(Reading database ... 40%
(Reading database ... 45%
(Reading database ... 50%
(Reading database ... 55%
(Reading database ... 60%
(Reading database ... 65%
(Reading database ... 70%
(Reading database ... 75%
(Reading database ... 80%
(Reading database ... 85%
(Reading database ... 90%
(Reading database ... 95%
(Reading database ... 100%
(Reading database ... 135963 files and directories currently installed.)
2024-02-15T17:12:50.442 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../0-linux-modules-4.15.0-213-generic_4.15.0-213.224_amd64.deb ...
2024-02-15T17:12:50.525 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking linux-modules-4.15.0-213-generic (4.15.0-213.224) ...
2024-02-15T17:12:51.965 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package linux-image-4.15.0-213-generic.
2024-02-15T17:12:51.981 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../1-linux-image-4.15.0-213-generic_4.15.0-213.224_amd64.deb ...
2024-02-15T17:12:52.082 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-image-4.15.0-213-generic (4.15.0-213.224) ...
2024-02-15T17:12:52.220 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package linux-image-4.15.0-213-generic.
2024-02-15T17:12:52.234 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../1-linux-image-4.15.0-213-generic_4.15.0-213.224_amd64.deb ...
2024-02-15T17:12:52.339 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking linux-image-4.15.0-213-generic (4.15.0-213.224) ...
2024-02-15T17:12:52.610 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package linux-modules-extra-4.15.0-213-generic.
2024-02-15T17:12:52.625 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../2-linux-modules-extra-4.15.0-213-generic_4.15.0-213.224_amd64.deb ...
2024-02-15T17:12:52.668 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-modules-extra-4.15.0-213-generic (4.15.0-213.224) ...
2024-02-15T17:12:52.815 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package linux-modules-extra-4.15.0-213-generic.
2024-02-15T17:12:52.829 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../2-linux-modules-extra-4.15.0-213-generic_4.15.0-213.224_amd64.deb ...
2024-02-15T17:12:52.865 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking linux-modules-extra-4.15.0-213-generic (4.15.0-213.224) ...
2024-02-15T17:12:56.640 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../3-linux-generic_4.15.0.213.196_amd64.deb ...
2024-02-15T17:12:56.756 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../3-linux-generic_4.15.0.213.196_amd64.deb ...
2024-02-15T17:12:56.767 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-generic (4.15.0.213.196) over (4.15.0.200.183) ...
2024-02-15T17:12:56.883 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking linux-generic (4.15.0.213.196) over (4.15.0.200.183) ...
2024-02-15T17:12:57.094 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../4-linux-image-generic_4.15.0.213.196_amd64.deb ...
2024-02-15T17:12:57.167 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../4-linux-image-generic_4.15.0.213.196_amd64.deb ...
2024-02-15T17:12:57.221 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-image-generic (4.15.0.213.196) over (4.15.0.200.183) ...
2024-02-15T17:12:57.278 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking linux-image-generic (4.15.0.213.196) over (4.15.0.200.183) ...
2024-02-15T17:12:57.557 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package linux-headers-4.15.0-213.
2024-02-15T17:12:57.570 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../5-linux-headers-4.15.0-213_4.15.0-213.224_all.deb ...
2024-02-15T17:12:57.607 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-headers-4.15.0-213 (4.15.0-213.224) ...
2024-02-15T17:12:57.623 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package linux-headers-4.15.0-213.
2024-02-15T17:12:57.637 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../5-linux-headers-4.15.0-213_4.15.0-213.224_all.deb ...
2024-02-15T17:12:57.682 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking linux-headers-4.15.0-213 (4.15.0-213.224) ...
2024-02-15T17:13:02.348 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package linux-headers-4.15.0-213-generic.
2024-02-15T17:13:02.372 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../6-linux-headers-4.15.0-213-generic_4.15.0-213.224_amd64.deb ...
2024-02-15T17:13:02.415 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-headers-4.15.0-213-generic (4.15.0-213.224) ...
2024-02-15T17:13:02.530 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package linux-headers-4.15.0-213-generic.
2024-02-15T17:13:02.556 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../6-linux-headers-4.15.0-213-generic_4.15.0-213.224_amd64.deb ...
2024-02-15T17:13:02.597 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking linux-headers-4.15.0-213-generic (4.15.0-213.224) ...
2024-02-15T17:13:04.875 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../7-linux-headers-generic_4.15.0.213.196_amd64.deb ...
2024-02-15T17:13:05.027 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-headers-generic (4.15.0.213.196) over (4.15.0.200.183) ...
2024-02-15T17:13:05.061 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../7-linux-headers-generic_4.15.0.213.196_amd64.deb ...
2024-02-15T17:13:05.164 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking linux-headers-generic (4.15.0.213.196) over (4.15.0.200.183) ...
2024-02-15T17:13:05.348 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-modules-4.15.0-213-generic (4.15.0-213.224) ...
2024-02-15T17:13:05.511 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up linux-modules-4.15.0-213-generic (4.15.0-213.224) ...
2024-02-15T17:13:06.027 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-image-4.15.0-213-generic (4.15.0-213.224) ...
2024-02-15T17:13:06.120 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up linux-image-4.15.0-213-generic (4.15.0-213.224) ...
2024-02-15T17:13:06.516 INFO:teuthology.orchestra.run.smithi138.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-4.15.0-200-generic
2024-02-15T17:13:06.516 INFO:teuthology.orchestra.run.smithi138.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-4.15.0-200-generic
2024-02-15T17:13:06.516 INFO:teuthology.orchestra.run.smithi138.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-4.15.0-213-generic
2024-02-15T17:13:06.517 INFO:teuthology.orchestra.run.smithi138.stdout:I: /initrd.img is now a symlink to boot/initrd.img-4.15.0-213-generic
2024-02-15T17:13:06.614 INFO:teuthology.orchestra.run.smithi152.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-4.15.0-200-generic
2024-02-15T17:13:06.614 INFO:teuthology.orchestra.run.smithi152.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-4.15.0-200-generic
2024-02-15T17:13:06.614 INFO:teuthology.orchestra.run.smithi152.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-4.15.0-213-generic
2024-02-15T17:13:06.614 INFO:teuthology.orchestra.run.smithi152.stdout:I: /initrd.img is now a symlink to boot/initrd.img-4.15.0-213-generic
2024-02-15T17:13:06.654 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-modules-extra-4.15.0-213-generic (4.15.0-213.224) ...
2024-02-15T17:13:06.739 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up linux-modules-extra-4.15.0-213-generic (4.15.0-213.224) ...
2024-02-15T17:13:07.189 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-headers-4.15.0-213 (4.15.0-213.224) ...
2024-02-15T17:13:07.282 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up linux-headers-4.15.0-213 (4.15.0-213.224) ...
2024-02-15T17:13:07.341 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-image-generic (4.15.0.213.196) ...
2024-02-15T17:13:07.408 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up linux-image-generic (4.15.0.213.196) ...
2024-02-15T17:13:07.467 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-headers-4.15.0-213-generic (4.15.0-213.224) ...
2024-02-15T17:13:07.559 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up linux-headers-4.15.0-213-generic (4.15.0-213.224) ...
2024-02-15T17:13:07.601 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-headers-generic (4.15.0.213.196) ...
2024-02-15T17:13:07.685 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up linux-headers-generic (4.15.0.213.196) ...
2024-02-15T17:13:07.744 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-generic (4.15.0.213.196) ...
2024-02-15T17:13:07.810 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up linux-generic (4.15.0.213.196) ...
2024-02-15T17:13:07.871 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for linux-image-4.15.0-213-generic (4.15.0-213.224) ...
2024-02-15T17:13:07.937 INFO:teuthology.orchestra.run.smithi152.stdout:Processing triggers for linux-image-4.15.0-213-generic (4.15.0-213.224) ...
2024-02-15T17:13:08.074 INFO:teuthology.orchestra.run.smithi138.stdout:/etc/kernel/postinst.d/initramfs-tools:
2024-02-15T17:13:08.074 INFO:teuthology.orchestra.run.smithi138.stdout:update-initramfs: Generating /boot/initrd.img-4.15.0-213-generic
2024-02-15T17:13:08.146 INFO:teuthology.orchestra.run.smithi152.stdout:/etc/kernel/postinst.d/initramfs-tools:
2024-02-15T17:13:08.146 INFO:teuthology.orchestra.run.smithi152.stdout:update-initramfs: Generating /boot/initrd.img-4.15.0-213-generic
2024-02-15T17:13:23.817 INFO:teuthology.orchestra.run.smithi138.stdout:/etc/kernel/postinst.d/zz-update-grub:
2024-02-15T17:13:23.817 INFO:teuthology.orchestra.run.smithi138.stdout:Sourcing file `/etc/default/grub'
2024-02-15T17:13:23.837 INFO:teuthology.orchestra.run.smithi138.stdout:Generating grub configuration file ...
2024-02-15T17:13:24.303 INFO:teuthology.orchestra.run.smithi138.stdout:Found linux image: /boot/vmlinuz-4.15.0-213-generic
2024-02-15T17:13:24.337 INFO:teuthology.orchestra.run.smithi138.stdout:Found initrd image: /boot/initrd.img-4.15.0-213-generic
2024-02-15T17:13:24.375 INFO:teuthology.orchestra.run.smithi152.stdout:/etc/kernel/postinst.d/zz-update-grub:
2024-02-15T17:13:24.376 INFO:teuthology.orchestra.run.smithi152.stdout:Sourcing file `/etc/default/grub'
2024-02-15T17:13:24.399 INFO:teuthology.orchestra.run.smithi152.stdout:Generating grub configuration file ...
2024-02-15T17:13:24.770 INFO:teuthology.orchestra.run.smithi138.stdout:Found linux image: /boot/vmlinuz-4.15.0-200-generic
2024-02-15T17:13:24.816 INFO:teuthology.orchestra.run.smithi138.stdout:Found initrd image: /boot/initrd.img-4.15.0-200-generic
2024-02-15T17:13:24.878 INFO:teuthology.orchestra.run.smithi152.stdout:Found linux image: /boot/vmlinuz-4.15.0-213-generic
2024-02-15T17:13:24.894 INFO:teuthology.orchestra.run.smithi138.stdout:Found linux image: /boot/vmlinuz-4.15.0-194-generic
2024-02-15T17:13:24.918 INFO:teuthology.orchestra.run.smithi138.stdout:Found initrd image: /boot/initrd.img-4.15.0-194-generic
2024-02-15T17:13:24.920 INFO:teuthology.orchestra.run.smithi152.stdout:Found initrd image: /boot/initrd.img-4.15.0-213-generic
2024-02-15T17:13:25.353 INFO:teuthology.orchestra.run.smithi152.stdout:Found linux image: /boot/vmlinuz-4.15.0-200-generic
2024-02-15T17:13:25.381 INFO:teuthology.orchestra.run.smithi152.stdout:Found initrd image: /boot/initrd.img-4.15.0-200-generic
2024-02-15T17:13:25.453 INFO:teuthology.orchestra.run.smithi152.stdout:Found linux image: /boot/vmlinuz-4.15.0-194-generic
2024-02-15T17:13:25.477 INFO:teuthology.orchestra.run.smithi152.stdout:Found initrd image: /boot/initrd.img-4.15.0-194-generic
2024-02-15T17:13:26.210 INFO:teuthology.orchestra.run.smithi138.stdout:done
2024-02-15T17:13:26.690 DEBUG:teuthology.orchestra.run.smithi138:> dpkg -s linux-image-generic
2024-02-15T17:13:26.702 INFO:teuthology.orchestra.run.smithi152.stdout:done
2024-02-15T17:13:26.707 INFO:teuthology.orchestra.run.smithi138.stdout:Package: linux-image-generic
2024-02-15T17:13:26.707 INFO:teuthology.orchestra.run.smithi138.stdout:Status: install ok installed
2024-02-15T17:13:26.707 INFO:teuthology.orchestra.run.smithi138.stdout:Priority: optional
2024-02-15T17:13:26.707 INFO:teuthology.orchestra.run.smithi138.stdout:Section: kernel
2024-02-15T17:13:26.707 INFO:teuthology.orchestra.run.smithi138.stdout:Installed-Size: 18
2024-02-15T17:13:26.707 INFO:teuthology.orchestra.run.smithi138.stdout:Maintainer: Ubuntu Kernel Team <kernel-team@lists.ubuntu.com>
2024-02-15T17:13:26.707 INFO:teuthology.orchestra.run.smithi138.stdout:Architecture: amd64
2024-02-15T17:13:26.707 INFO:teuthology.orchestra.run.smithi138.stdout:Source: linux-meta
2024-02-15T17:13:26.707 INFO:teuthology.orchestra.run.smithi138.stdout:Version: 4.15.0.213.196
2024-02-15T17:13:26.707 INFO:teuthology.orchestra.run.smithi138.stdout:Provides: wireguard-modules (= 1.0.20201112-1~18.04.4), zfs-modules (= 0.7.5-1ubuntu16.12)
2024-02-15T17:13:26.707 INFO:teuthology.orchestra.run.smithi138.stdout:Depends: linux-image-4.15.0-213-generic, linux-modules-extra-4.15.0-213-generic, linux-firmware, intel-microcode, amd64-microcode
2024-02-15T17:13:26.707 INFO:teuthology.orchestra.run.smithi138.stdout:Recommends: thermald
2024-02-15T17:13:26.708 INFO:teuthology.orchestra.run.smithi138.stdout:Description: Generic Linux kernel image
2024-02-15T17:13:26.708 INFO:teuthology.orchestra.run.smithi138.stdout: This package will always depend on the latest generic kernel image
2024-02-15T17:13:26.708 INFO:teuthology.orchestra.run.smithi138.stdout: available.
2024-02-15T17:13:26.708 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.15.0-200-generic Expected: 4.15.0-213-generic
2024-02-15T17:13:26.708 INFO:teuthology.task.kernel:Skipping firmware on distro kernel
2024-02-15T17:13:26.708 DEBUG:teuthology.task.kernel:src is distro, skipping download
2024-02-15T17:13:26.708 INFO:teuthology.task.kernel:Installing distro kernel on mon.a...
2024-02-15T17:13:26.708 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi138.front.sepia.ceph.com, path=None, version=distro)
2024-02-15T17:13:26.709 DEBUG:teuthology.orchestra.run.smithi138:> sudo apt-get clean
2024-02-15T17:13:26.812 DEBUG:teuthology.orchestra.run.smithi138:> sudo apt-get update
2024-02-15T17:13:26.944 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:1 http://archive.ubuntu.com/ubuntu bionic InRelease
2024-02-15T17:13:26.944 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:2 http://security.ubuntu.com/ubuntu bionic-security InRelease
2024-02-15T17:13:26.953 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease
2024-02-15T17:13:26.974 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease
2024-02-15T17:13:27.171 DEBUG:teuthology.orchestra.run.smithi152:> dpkg -s linux-image-generic
2024-02-15T17:13:27.194 INFO:teuthology.orchestra.run.smithi152.stdout:Package: linux-image-generic
2024-02-15T17:13:27.194 INFO:teuthology.orchestra.run.smithi152.stdout:Status: install ok installed
2024-02-15T17:13:27.194 INFO:teuthology.orchestra.run.smithi152.stdout:Priority: optional
2024-02-15T17:13:27.194 INFO:teuthology.orchestra.run.smithi152.stdout:Section: kernel
2024-02-15T17:13:27.194 INFO:teuthology.orchestra.run.smithi152.stdout:Installed-Size: 18
2024-02-15T17:13:27.194 INFO:teuthology.orchestra.run.smithi152.stdout:Maintainer: Ubuntu Kernel Team <kernel-team@lists.ubuntu.com>
2024-02-15T17:13:27.195 INFO:teuthology.orchestra.run.smithi152.stdout:Architecture: amd64
2024-02-15T17:13:27.195 INFO:teuthology.orchestra.run.smithi152.stdout:Source: linux-meta
2024-02-15T17:13:27.195 INFO:teuthology.orchestra.run.smithi152.stdout:Version: 4.15.0.213.196
2024-02-15T17:13:27.195 INFO:teuthology.orchestra.run.smithi152.stdout:Provides: wireguard-modules (= 1.0.20201112-1~18.04.4), zfs-modules (= 0.7.5-1ubuntu16.12)
2024-02-15T17:13:27.195 INFO:teuthology.orchestra.run.smithi152.stdout:Depends: linux-image-4.15.0-213-generic, linux-modules-extra-4.15.0-213-generic, linux-firmware, intel-microcode, amd64-microcode
2024-02-15T17:13:27.195 INFO:teuthology.orchestra.run.smithi152.stdout:Recommends: thermald
2024-02-15T17:13:27.195 INFO:teuthology.orchestra.run.smithi152.stdout:Description: Generic Linux kernel image
2024-02-15T17:13:27.195 INFO:teuthology.orchestra.run.smithi152.stdout: This package will always depend on the latest generic kernel image
2024-02-15T17:13:27.195 INFO:teuthology.orchestra.run.smithi152.stdout: available.
2024-02-15T17:13:27.195 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.15.0-200-generic Expected: 4.15.0-213-generic
2024-02-15T17:13:27.195 INFO:teuthology.task.kernel:Skipping firmware on distro kernel
2024-02-15T17:13:27.195 DEBUG:teuthology.task.kernel:src is distro, skipping download
2024-02-15T17:13:27.195 INFO:teuthology.task.kernel:Installing distro kernel on mon.b...
2024-02-15T17:13:27.196 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi152.front.sepia.ceph.com, path=None, version=distro)
2024-02-15T17:13:27.196 DEBUG:teuthology.orchestra.run.smithi152:> sudo apt-get clean
2024-02-15T17:13:27.321 DEBUG:teuthology.orchestra.run.smithi152:> sudo apt-get update
2024-02-15T17:13:27.449 INFO:teuthology.orchestra.run.smithi152.stdout:Hit:1 http://archive.ubuntu.com/ubuntu bionic InRelease
2024-02-15T17:13:27.450 INFO:teuthology.orchestra.run.smithi152.stdout:Hit:2 http://security.ubuntu.com/ubuntu bionic-security InRelease
2024-02-15T17:13:27.457 INFO:teuthology.orchestra.run.smithi152.stdout:Hit:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease
2024-02-15T17:13:27.478 INFO:teuthology.orchestra.run.smithi152.stdout:Hit:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease
2024-02-15T17:13:29.058 INFO:teuthology.orchestra.run.smithi138.stdout:Reading package lists...
2024-02-15T17:13:29.109 DEBUG:teuthology.orchestra.run.smithi138:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic
2024-02-15T17:13:29.190 INFO:teuthology.orchestra.run.smithi138.stdout:Reading package lists...
2024-02-15T17:13:29.458 INFO:teuthology.orchestra.run.smithi138.stdout:Building dependency tree...
2024-02-15T17:13:29.459 INFO:teuthology.orchestra.run.smithi138.stdout:Reading state information...
2024-02-15T17:13:29.575 INFO:teuthology.orchestra.run.smithi152.stdout:Reading package lists...
2024-02-15T17:13:29.627 DEBUG:teuthology.orchestra.run.smithi152:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic
2024-02-15T17:13:29.667 INFO:teuthology.orchestra.run.smithi138.stdout:linux-image-generic is already the newest version (4.15.0.213.196).
2024-02-15T17:13:29.668 INFO:teuthology.orchestra.run.smithi138.stdout:The following packages were automatically installed and are no longer required:
2024-02-15T17:13:29.668 INFO:teuthology.orchestra.run.smithi138.stdout:  linux-headers-4.15.0-194 linux-headers-4.15.0-194-generic
2024-02-15T17:13:29.668 INFO:teuthology.orchestra.run.smithi138.stdout:  linux-image-4.15.0-194-generic linux-modules-4.15.0-194-generic
2024-02-15T17:13:29.668 INFO:teuthology.orchestra.run.smithi138.stdout:  linux-modules-extra-4.15.0-194-generic
2024-02-15T17:13:29.668 INFO:teuthology.orchestra.run.smithi138.stdout:Use 'sudo apt autoremove' to remove them.
2024-02-15T17:13:29.702 INFO:teuthology.orchestra.run.smithi152.stdout:Reading package lists...
2024-02-15T17:13:29.723 INFO:teuthology.orchestra.run.smithi138.stdout:0 upgraded, 0 newly installed, 0 to remove and 165 not upgraded.
2024-02-15T17:13:29.725 DEBUG:teuthology.orchestra.run.smithi138:> dpkg -s linux-image-generic
2024-02-15T17:13:29.790 INFO:teuthology.orchestra.run.smithi138.stdout:Package: linux-image-generic
2024-02-15T17:13:29.791 INFO:teuthology.orchestra.run.smithi138.stdout:Status: install ok installed
2024-02-15T17:13:29.791 INFO:teuthology.orchestra.run.smithi138.stdout:Priority: optional
2024-02-15T17:13:29.791 INFO:teuthology.orchestra.run.smithi138.stdout:Section: kernel
2024-02-15T17:13:29.791 INFO:teuthology.orchestra.run.smithi138.stdout:Installed-Size: 18
2024-02-15T17:13:29.791 INFO:teuthology.orchestra.run.smithi138.stdout:Maintainer: Ubuntu Kernel Team <kernel-team@lists.ubuntu.com>
2024-02-15T17:13:29.791 INFO:teuthology.orchestra.run.smithi138.stdout:Architecture: amd64
2024-02-15T17:13:29.791 INFO:teuthology.orchestra.run.smithi138.stdout:Source: linux-meta
2024-02-15T17:13:29.791 INFO:teuthology.orchestra.run.smithi138.stdout:Version: 4.15.0.213.196
2024-02-15T17:13:29.791 INFO:teuthology.orchestra.run.smithi138.stdout:Provides: wireguard-modules (= 1.0.20201112-1~18.04.4), zfs-modules (= 0.7.5-1ubuntu16.12)
2024-02-15T17:13:29.791 INFO:teuthology.orchestra.run.smithi138.stdout:Depends: linux-image-4.15.0-213-generic, linux-modules-extra-4.15.0-213-generic, linux-firmware, intel-microcode, amd64-microcode
2024-02-15T17:13:29.791 INFO:teuthology.orchestra.run.smithi138.stdout:Recommends: thermald
2024-02-15T17:13:29.791 INFO:teuthology.orchestra.run.smithi138.stdout:Description: Generic Linux kernel image
2024-02-15T17:13:29.791 INFO:teuthology.orchestra.run.smithi138.stdout: This package will always depend on the latest generic kernel image
2024-02-15T17:13:29.791 INFO:teuthology.orchestra.run.smithi138.stdout: available.
2024-02-15T17:13:29.792 DEBUG:teuthology.orchestra.run.smithi138:> mktemp
2024-02-15T17:13:29.838 INFO:teuthology.orchestra.run.smithi138.stdout:/tmp/tmp.TEZQcY3siJ
2024-02-15T17:13:29.838 DEBUG:teuthology.orchestra.run.smithi138:> sudo cp /boot/grub/grub.cfg /tmp/tmp.TEZQcY3siJ
2024-02-15T17:13:29.895 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 0666 /tmp/tmp.TEZQcY3siJ
2024-02-15T17:13:29.977 INFO:teuthology.orchestra.run.smithi152.stdout:Building dependency tree...
2024-02-15T17:13:29.977 INFO:teuthology.orchestra.run.smithi152.stdout:Reading state information...
2024-02-15T17:13:30.038 DEBUG:teuthology.orchestra.remote:smithi138:/tmp/tmp.TEZQcY3siJ is 10KB
2024-02-15T17:13:30.049 DEBUG:teuthology.orchestra.run.smithi138:> rm -fr /tmp/tmp.TEZQcY3siJ
2024-02-15T17:13:30.055 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f -- /etc/grub.d/01_ceph_kernel
2024-02-15T17:13:30.111 DEBUG:teuthology.orchestra.run.smithi138:> set -ex
2024-02-15T17:13:30.111 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/grub.d/01_ceph_kernel
2024-02-15T17:13:30.111 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 755 /etc/grub.d/01_ceph_kernel
2024-02-15T17:13:30.183 INFO:teuthology.task.kernel:Distro Kernel Version: 4.15.0-213-generic
2024-02-15T17:13:30.183 DEBUG:teuthology.orchestra.run.smithi138:> sudo update-grub
2024-02-15T17:13:30.185 INFO:teuthology.orchestra.run.smithi152.stdout:linux-image-generic is already the newest version (4.15.0.213.196).
2024-02-15T17:13:30.185 INFO:teuthology.orchestra.run.smithi152.stdout:The following packages were automatically installed and are no longer required:
2024-02-15T17:13:30.185 INFO:teuthology.orchestra.run.smithi152.stdout:  linux-headers-4.15.0-194 linux-headers-4.15.0-194-generic
2024-02-15T17:13:30.185 INFO:teuthology.orchestra.run.smithi152.stdout:  linux-image-4.15.0-194-generic linux-modules-4.15.0-194-generic
2024-02-15T17:13:30.186 INFO:teuthology.orchestra.run.smithi152.stdout:  linux-modules-extra-4.15.0-194-generic
2024-02-15T17:13:30.186 INFO:teuthology.orchestra.run.smithi152.stdout:Use 'sudo apt autoremove' to remove them.
2024-02-15T17:13:30.240 INFO:teuthology.orchestra.run.smithi152.stdout:0 upgraded, 0 newly installed, 0 to remove and 165 not upgraded.
2024-02-15T17:13:30.242 DEBUG:teuthology.orchestra.run.smithi152:> dpkg -s linux-image-generic
2024-02-15T17:13:30.261 INFO:teuthology.orchestra.run.smithi152.stdout:Package: linux-image-generic
2024-02-15T17:13:30.261 INFO:teuthology.orchestra.run.smithi152.stdout:Status: install ok installed
2024-02-15T17:13:30.261 INFO:teuthology.orchestra.run.smithi152.stdout:Priority: optional
2024-02-15T17:13:30.261 INFO:teuthology.orchestra.run.smithi152.stdout:Section: kernel
2024-02-15T17:13:30.261 INFO:teuthology.orchestra.run.smithi152.stdout:Installed-Size: 18
2024-02-15T17:13:30.262 INFO:teuthology.orchestra.run.smithi152.stdout:Maintainer: Ubuntu Kernel Team <kernel-team@lists.ubuntu.com>
2024-02-15T17:13:30.262 INFO:teuthology.orchestra.run.smithi152.stdout:Architecture: amd64
2024-02-15T17:13:30.262 INFO:teuthology.orchestra.run.smithi152.stdout:Source: linux-meta
2024-02-15T17:13:30.262 INFO:teuthology.orchestra.run.smithi152.stdout:Version: 4.15.0.213.196
2024-02-15T17:13:30.262 INFO:teuthology.orchestra.run.smithi152.stdout:Provides: wireguard-modules (= 1.0.20201112-1~18.04.4), zfs-modules (= 0.7.5-1ubuntu16.12)
2024-02-15T17:13:30.262 INFO:teuthology.orchestra.run.smithi152.stdout:Depends: linux-image-4.15.0-213-generic, linux-modules-extra-4.15.0-213-generic, linux-firmware, intel-microcode, amd64-microcode
2024-02-15T17:13:30.262 INFO:teuthology.orchestra.run.smithi152.stdout:Recommends: thermald
2024-02-15T17:13:30.262 INFO:teuthology.orchestra.run.smithi152.stdout:Description: Generic Linux kernel image
2024-02-15T17:13:30.262 INFO:teuthology.orchestra.run.smithi152.stdout: This package will always depend on the latest generic kernel image
2024-02-15T17:13:30.262 INFO:teuthology.orchestra.run.smithi152.stdout: available.
2024-02-15T17:13:30.262 DEBUG:teuthology.orchestra.run.smithi152:> mktemp
2024-02-15T17:13:30.307 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/tmp.HPQ12z2wSH
2024-02-15T17:13:30.308 DEBUG:teuthology.orchestra.run.smithi152:> sudo cp /boot/grub/grub.cfg /tmp/tmp.HPQ12z2wSH
2024-02-15T17:13:30.365 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 0666 /tmp/tmp.HPQ12z2wSH
2024-02-15T17:13:30.508 DEBUG:teuthology.orchestra.remote:smithi152:/tmp/tmp.HPQ12z2wSH is 10KB
2024-02-15T17:13:30.520 DEBUG:teuthology.orchestra.run.smithi152:> rm -fr /tmp/tmp.HPQ12z2wSH
2024-02-15T17:13:30.526 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f -- /etc/grub.d/01_ceph_kernel
2024-02-15T17:13:30.580 DEBUG:teuthology.orchestra.run.smithi152:> set -ex
2024-02-15T17:13:30.581 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/grub.d/01_ceph_kernel
2024-02-15T17:13:30.581 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 755 /etc/grub.d/01_ceph_kernel
2024-02-15T17:13:30.652 INFO:teuthology.task.kernel:Distro Kernel Version: 4.15.0-213-generic
2024-02-15T17:13:30.652 DEBUG:teuthology.orchestra.run.smithi152:> sudo update-grub
2024-02-15T17:13:31.708 INFO:teuthology.orchestra.run.smithi138.stderr:Sourcing file `/etc/default/grub'
2024-02-15T17:13:31.720 INFO:teuthology.orchestra.run.smithi138.stderr:Generating grub configuration file ...
2024-02-15T17:13:31.962 INFO:teuthology.orchestra.run.smithi138.stderr:Found linux image: /boot/vmlinuz-4.15.0-213-generic
2024-02-15T17:13:31.974 INFO:teuthology.orchestra.run.smithi138.stderr:Found initrd image: /boot/initrd.img-4.15.0-213-generic
2024-02-15T17:13:32.148 INFO:teuthology.orchestra.run.smithi152.stderr:Sourcing file `/etc/default/grub'
2024-02-15T17:13:32.159 INFO:teuthology.orchestra.run.smithi152.stderr:Generating grub configuration file ...
2024-02-15T17:13:32.393 INFO:teuthology.orchestra.run.smithi138.stderr:Found linux image: /boot/vmlinuz-4.15.0-200-generic
2024-02-15T17:13:32.406 INFO:teuthology.orchestra.run.smithi138.stderr:Found initrd image: /boot/initrd.img-4.15.0-200-generic
2024-02-15T17:13:32.478 INFO:teuthology.orchestra.run.smithi138.stderr:Found linux image: /boot/vmlinuz-4.15.0-194-generic
2024-02-15T17:13:32.489 INFO:teuthology.orchestra.run.smithi138.stderr:Found initrd image: /boot/initrd.img-4.15.0-194-generic
2024-02-15T17:13:32.513 INFO:teuthology.orchestra.run.smithi152.stderr:Found linux image: /boot/vmlinuz-4.15.0-213-generic
2024-02-15T17:13:32.525 INFO:teuthology.orchestra.run.smithi152.stderr:Found initrd image: /boot/initrd.img-4.15.0-213-generic
2024-02-15T17:13:32.949 INFO:teuthology.orchestra.run.smithi152.stderr:Found linux image: /boot/vmlinuz-4.15.0-200-generic
2024-02-15T17:13:32.962 INFO:teuthology.orchestra.run.smithi152.stderr:Found initrd image: /boot/initrd.img-4.15.0-200-generic
2024-02-15T17:13:33.038 INFO:teuthology.orchestra.run.smithi152.stderr:Found linux image: /boot/vmlinuz-4.15.0-194-generic
2024-02-15T17:13:33.051 INFO:teuthology.orchestra.run.smithi152.stderr:Found initrd image: /boot/initrd.img-4.15.0-194-generic
2024-02-15T17:13:33.371 INFO:teuthology.orchestra.run.smithi138.stderr:done
2024-02-15T17:13:33.373 DEBUG:teuthology.orchestra.run.smithi138:> sudo shutdown -r now
2024-02-15T17:13:33.928 INFO:teuthology.orchestra.run.smithi152.stderr:done
2024-02-15T17:13:33.930 DEBUG:teuthology.orchestra.run.smithi152:> sudo shutdown -r now
2024-02-15T17:14:03.400 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version...
2024-02-15T17:14:03.401 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com'
2024-02-15T17:14:03.402 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T17:14:03.933 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version...
2024-02-15T17:14:03.933 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com'
2024-02-15T17:14:03.934 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T17:14:38.017 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.138
2024-02-15T17:14:38.524 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.152
2024-02-15T17:14:47.022 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com'
2024-02-15T17:14:47.023 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T17:14:47.526 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com'
2024-02-15T17:14:47.526 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T17:15:05.404 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.138
2024-02-15T17:15:17.416 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com'
2024-02-15T17:15:17.417 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T17:15:17.510 DEBUG:teuthology.orchestra.run.smithi138:> true
2024-02-15T17:15:18.045 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi138.front.sepia.ceph.com'
2024-02-15T17:15:18.045 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.15.0-213-generic"...
2024-02-15T17:15:18.045 DEBUG:teuthology.orchestra.run.smithi138:> uname -r
2024-02-15T17:15:18.097 INFO:teuthology.orchestra.run.smithi138.stdout:4.15.0-213-generic
2024-02-15T17:15:18.097 DEBUG:teuthology.task.kernel:current kernel version is 4.15.0-213-generic vs 4.15.0-213-generic
2024-02-15T17:15:18.098 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install
2024-02-15T17:15:18.098 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu
2024-02-15T17:15:19.099 INFO:teuthology.task.kernel:Enabling kdb on mon.a...
2024-02-15T17:15:19.099 DEBUG:teuthology.orchestra.run.smithi138:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc
2024-02-15T17:15:19.135 INFO:teuthology.orchestra.run.smithi138.stdout:ttyS1
2024-02-15T17:15:19.163 DEBUG:teuthology.parallel:result is None
2024-02-15T17:15:47.529 DEBUG:teuthology.orchestra.remote:timed out
2024-02-15T17:15:59.530 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com'
2024-02-15T17:15:59.531 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T17:15:59.649 DEBUG:teuthology.orchestra.run.smithi152:> true
2024-02-15T17:15:59.953 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi152.front.sepia.ceph.com'
2024-02-15T17:15:59.953 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "4.15.0-213-generic"...
2024-02-15T17:15:59.953 DEBUG:teuthology.orchestra.run.smithi152:> uname -r
2024-02-15T17:16:00.002 INFO:teuthology.orchestra.run.smithi152.stdout:4.15.0-213-generic
2024-02-15T17:16:00.003 DEBUG:teuthology.task.kernel:current kernel version is 4.15.0-213-generic vs 4.15.0-213-generic
2024-02-15T17:16:00.003 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install
2024-02-15T17:16:00.003 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu
2024-02-15T17:16:01.004 INFO:teuthology.task.kernel:Enabling kdb on mon.b...
2024-02-15T17:16:01.005 DEBUG:teuthology.orchestra.run.smithi152:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc
2024-02-15T17:16:01.028 INFO:teuthology.orchestra.run.smithi152.stdout:ttyS1
2024-02-15T17:16:01.056 DEBUG:teuthology.parallel:result is None
2024-02-15T17:16:01.056 INFO:teuthology.run_tasks:Running task internal.base...
2024-02-15T17:16:01.064 INFO:teuthology.task.internal:Creating test directory...
2024-02-15T17:16:01.064 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -p -m0755 -- /home/ubuntu/cephtest
2024-02-15T17:16:01.066 DEBUG:teuthology.orchestra.run.smithi152:> mkdir -p -m0755 -- /home/ubuntu/cephtest
2024-02-15T17:16:01.104 INFO:teuthology.run_tasks:Running task internal.archive_upload...
2024-02-15T17:16:01.111 INFO:teuthology.run_tasks:Running task internal.archive...
2024-02-15T17:16:01.117 INFO:teuthology.task.internal:Creating archive directory...
2024-02-15T17:16:01.117 DEBUG:teuthology.orchestra.run.smithi138:> install -d -m0755 -- /home/ubuntu/cephtest/archive
2024-02-15T17:16:01.119 DEBUG:teuthology.orchestra.run.smithi152:> install -d -m0755 -- /home/ubuntu/cephtest/archive
2024-02-15T17:16:01.163 INFO:teuthology.run_tasks:Running task internal.coredump...
2024-02-15T17:16:01.170 INFO:teuthology.task.internal:Enabling coredump saving...
2024-02-15T17:16:01.170 DEBUG:teuthology.orchestra.run.smithi138:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf
2024-02-15T17:16:01.172 DEBUG:teuthology.orchestra.run.smithi152:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf
2024-02-15T17:16:01.193 INFO:teuthology.orchestra.run.smithi138.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core
2024-02-15T17:16:01.201 INFO:teuthology.orchestra.run.smithi138.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core
2024-02-15T17:16:01.226 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core
2024-02-15T17:16:01.234 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core
2024-02-15T17:16:01.235 INFO:teuthology.run_tasks:Running task internal.sudo...
2024-02-15T17:16:01.243 INFO:teuthology.task.internal:Configuring sudo...
2024-02-15T17:16:01.243 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers
2024-02-15T17:16:01.247 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers
2024-02-15T17:16:01.293 INFO:teuthology.run_tasks:Running task internal.syslog...
2024-02-15T17:16:01.302 INFO:teuthology.task.internal.syslog:Starting syslog monitoring...
2024-02-15T17:16:01.302 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog
2024-02-15T17:16:01.304 DEBUG:teuthology.orchestra.run.smithi152:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog
2024-02-15T17:16:01.339 DEBUG:teuthology.orchestra.run.smithi138:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log
2024-02-15T17:16:01.356 DEBUG:teuthology.orchestra.run.smithi138:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log
2024-02-15T17:16:01.404 DEBUG:teuthology.orchestra.run.smithi138:> set -ex
2024-02-15T17:16:01.404 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf
2024-02-15T17:16:01.475 DEBUG:teuthology.orchestra.run.smithi152:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log
2024-02-15T17:16:01.482 DEBUG:teuthology.orchestra.run.smithi152:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log
2024-02-15T17:16:01.532 DEBUG:teuthology.orchestra.run.smithi152:> set -ex
2024-02-15T17:16:01.532 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf
2024-02-15T17:16:01.597 DEBUG:teuthology.orchestra.run.smithi138:> sudo service rsyslog restart
2024-02-15T17:16:01.600 DEBUG:teuthology.orchestra.run.smithi152:> sudo service rsyslog restart
2024-02-15T17:16:01.682 INFO:teuthology.run_tasks:Running task internal.timer...
2024-02-15T17:16:01.690 INFO:teuthology.task.internal:Starting timer...
2024-02-15T17:16:01.690 INFO:teuthology.run_tasks:Running task pcp...
2024-02-15T17:16:01.743 INFO:teuthology.run_tasks:Running task selinux...
2024-02-15T17:16:01.751 DEBUG:teuthology.task.selinux:Excluding smithi138: OS 'ubuntu' does not support SELinux
2024-02-15T17:16:01.751 DEBUG:teuthology.task.selinux:Excluding smithi152: OS 'ubuntu' does not support SELinux
2024-02-15T17:16:01.751 DEBUG:teuthology.task.selinux:Getting current SELinux state
2024-02-15T17:16:01.751 DEBUG:teuthology.task.selinux:Existing SELinux modes: {}
2024-02-15T17:16:01.751 INFO:teuthology.task.selinux:Putting SELinux into permissive mode
2024-02-15T17:16:01.752 INFO:teuthology.run_tasks:Running task ansible.cephlab...
2024-02-15T17:16:01.767 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main
2024-02-15T17:16:01.783 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}]
2024-02-15T17:16:01.785 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi138.front.sepia.ceph.com,smithi152.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml
2024-02-15T17:21:25.955 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi138.front.sepia.ceph.com'), Remote(name='ubuntu@smithi152.front.sepia.ceph.com')]
2024-02-15T17:21:25.957 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com'
2024-02-15T17:21:25.958 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T17:21:26.040 DEBUG:teuthology.orchestra.run.smithi138:> true
2024-02-15T17:21:26.157 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi138.front.sepia.ceph.com'
2024-02-15T17:21:26.157 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com'
2024-02-15T17:21:26.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T17:21:26.234 DEBUG:teuthology.orchestra.run.smithi152:> true
2024-02-15T17:21:26.353 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi152.front.sepia.ceph.com'
2024-02-15T17:21:26.353 INFO:teuthology.run_tasks:Running task clock...
2024-02-15T17:21:26.366 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew...
2024-02-15T17:21:26.366 INFO:teuthology.orchestra.run:Running command with timeout 360
2024-02-15T17:21:26.366 DEBUG:teuthology.orchestra.run.smithi138:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true
2024-02-15T17:21:26.369 INFO:teuthology.orchestra.run:Running command with timeout 360
2024-02-15T17:21:26.369 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true
2024-02-15T17:21:26.411 INFO:teuthology.orchestra.run.smithi138.stdout:15 Feb 17:21:26 ntpd[14620]: ntpd 4.2.8p10@1.3728-o (1): Starting
2024-02-15T17:21:26.411 INFO:teuthology.orchestra.run.smithi138.stdout:15 Feb 17:21:26 ntpd[14620]: Command line: ntpd -gq
2024-02-15T17:21:26.412 INFO:teuthology.orchestra.run.smithi138.stdout:15 Feb 17:21:26 ntpd[14620]: proto: precision = 0.111 usec (-23)
2024-02-15T17:21:26.412 INFO:teuthology.orchestra.run.smithi138.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED.
2024-02-15T17:21:26.413 INFO:teuthology.orchestra.run.smithi138.stdout:15 Feb 17:21:26 ntpd[14620]: restrict 0.0.0.0: KOD does nothing without LIMITED.
2024-02-15T17:21:26.413 INFO:teuthology.orchestra.run.smithi138.stderr:restrict ::: KOD does nothing without LIMITED.
2024-02-15T17:21:26.414 INFO:teuthology.orchestra.run.smithi138.stdout:15 Feb 17:21:26 ntpd[14620]: restrict ::: KOD does nothing without LIMITED.
2024-02-15T17:21:26.414 INFO:teuthology.orchestra.run.smithi138.stdout:15 Feb 17:21:26 ntpd[14620]: Listen and drop on 0 v6wildcard [::]:123
2024-02-15T17:21:26.414 INFO:teuthology.orchestra.run.smithi138.stdout:15 Feb 17:21:26 ntpd[14620]: Listen and drop on 1 v4wildcard 0.0.0.0:123
2024-02-15T17:21:26.414 INFO:teuthology.orchestra.run.smithi138.stdout:15 Feb 17:21:26 ntpd[14620]: Listen normally on 2 lo 127.0.0.1:123
2024-02-15T17:21:26.414 INFO:teuthology.orchestra.run.smithi138.stdout:15 Feb 17:21:26 ntpd[14620]: Listen normally on 3 enp3s0f1 172.21.15.138:123
2024-02-15T17:21:26.414 INFO:teuthology.orchestra.run.smithi138.stdout:15 Feb 17:21:26 ntpd[14620]: Listen normally on 4 lo [::1]:123
2024-02-15T17:21:26.414 INFO:teuthology.orchestra.run.smithi138.stdout:15 Feb 17:21:26 ntpd[14620]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6f71%5]:123
2024-02-15T17:21:26.414 INFO:teuthology.orchestra.run.smithi138.stdout:15 Feb 17:21:26 ntpd[14620]: Listening on routing socket on fd #22 for interface updates
2024-02-15T17:21:26.453 INFO:teuthology.orchestra.run.smithi152.stdout:15 Feb 17:21:26 ntpd[14569]: ntpd 4.2.8p10@1.3728-o (1): Starting
2024-02-15T17:21:26.453 INFO:teuthology.orchestra.run.smithi152.stdout:15 Feb 17:21:26 ntpd[14569]: Command line: ntpd -gq
2024-02-15T17:21:26.454 INFO:teuthology.orchestra.run.smithi152.stdout:15 Feb 17:21:26 ntpd[14569]: proto: precision = 0.124 usec (-23)
2024-02-15T17:21:26.454 INFO:teuthology.orchestra.run.smithi152.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED.
2024-02-15T17:21:26.454 INFO:teuthology.orchestra.run.smithi152.stdout:15 Feb 17:21:26 ntpd[14569]: restrict 0.0.0.0: KOD does nothing without LIMITED.
2024-02-15T17:21:26.455 INFO:teuthology.orchestra.run.smithi152.stderr:restrict ::: KOD does nothing without LIMITED.
2024-02-15T17:21:26.456 INFO:teuthology.orchestra.run.smithi152.stdout:15 Feb 17:21:26 ntpd[14569]: restrict ::: KOD does nothing without LIMITED.
2024-02-15T17:21:26.456 INFO:teuthology.orchestra.run.smithi152.stdout:15 Feb 17:21:26 ntpd[14569]: Listen and drop on 0 v6wildcard [::]:123
2024-02-15T17:21:26.456 INFO:teuthology.orchestra.run.smithi152.stdout:15 Feb 17:21:26 ntpd[14569]: Listen and drop on 1 v4wildcard 0.0.0.0:123
2024-02-15T17:21:26.456 INFO:teuthology.orchestra.run.smithi152.stdout:15 Feb 17:21:26 ntpd[14569]: Listen normally on 2 lo 127.0.0.1:123
2024-02-15T17:21:26.456 INFO:teuthology.orchestra.run.smithi152.stdout:15 Feb 17:21:26 ntpd[14569]: Listen normally on 3 enp3s0f1 172.21.15.152:123
2024-02-15T17:21:26.456 INFO:teuthology.orchestra.run.smithi152.stdout:15 Feb 17:21:26 ntpd[14569]: Listen normally on 4 lo [::1]:123
2024-02-15T17:21:26.456 INFO:teuthology.orchestra.run.smithi152.stdout:15 Feb 17:21:26 ntpd[14569]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6de3%5]:123
2024-02-15T17:21:26.456 INFO:teuthology.orchestra.run.smithi152.stdout:15 Feb 17:21:26 ntpd[14569]: Listening on routing socket on fd #22 for interface updates
2024-02-15T17:21:27.412 INFO:teuthology.orchestra.run.smithi138.stderr:15 Feb 17:21:27 ntpd[14620]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied
2024-02-15T17:21:27.413 INFO:teuthology.orchestra.run.smithi138.stderr:15 Feb 17:21:27 ntpd[14620]: can't open /var/log/ntpstats/rawstats.20240215: Permission denied
2024-02-15T17:21:27.413 INFO:teuthology.orchestra.run.smithi138.stderr:15 Feb 17:21:27 ntpd[14620]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied
2024-02-15T17:21:27.413 INFO:teuthology.orchestra.run.smithi138.stderr:15 Feb 17:21:27 ntpd[14620]: can't open /var/log/ntpstats/peerstats.20240215: Permission denied
2024-02-15T17:21:27.453 INFO:teuthology.orchestra.run.smithi152.stderr:15 Feb 17:21:27 ntpd[14569]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied
2024-02-15T17:21:27.454 INFO:teuthology.orchestra.run.smithi152.stderr:15 Feb 17:21:27 ntpd[14569]: can't open /var/log/ntpstats/rawstats.20240215: Permission denied
2024-02-15T17:21:27.454 INFO:teuthology.orchestra.run.smithi152.stderr:15 Feb 17:21:27 ntpd[14569]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied
2024-02-15T17:21:27.454 INFO:teuthology.orchestra.run.smithi152.stderr:15 Feb 17:21:27 ntpd[14569]: can't open /var/log/ntpstats/peerstats.20240215: Permission denied
2024-02-15T17:21:28.453 INFO:teuthology.orchestra.run.smithi152.stderr:15 Feb 17:21:28 ntpd[14569]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied
2024-02-15T17:21:28.454 INFO:teuthology.orchestra.run.smithi152.stderr:15 Feb 17:21:28 ntpd[14569]: can't open /var/log/ntpstats/rawstats.20240215: Permission denied
2024-02-15T17:21:28.454 INFO:teuthology.orchestra.run.smithi152.stderr:15 Feb 17:21:28 ntpd[14569]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied
2024-02-15T17:21:28.454 INFO:teuthology.orchestra.run.smithi152.stderr:15 Feb 17:21:28 ntpd[14569]: can't open /var/log/ntpstats/peerstats.20240215: Permission denied
2024-02-15T17:21:29.413 INFO:teuthology.orchestra.run.smithi138.stderr:15 Feb 17:21:29 ntpd[14620]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied
2024-02-15T17:21:29.413 INFO:teuthology.orchestra.run.smithi138.stderr:15 Feb 17:21:29 ntpd[14620]: can't open /var/log/ntpstats/rawstats.20240215: Permission denied
2024-02-15T17:21:29.413 INFO:teuthology.orchestra.run.smithi138.stderr:15 Feb 17:21:29 ntpd[14620]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied
2024-02-15T17:21:29.413 INFO:teuthology.orchestra.run.smithi138.stderr:15 Feb 17:21:29 ntpd[14620]: can't open /var/log/ntpstats/peerstats.20240215: Permission denied
2024-02-15T17:21:29.413 INFO:teuthology.orchestra.run.smithi138.stderr:15 Feb 17:21:29 ntpd[14620]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied
2024-02-15T17:21:29.413 INFO:teuthology.orchestra.run.smithi138.stderr:15 Feb 17:21:29 ntpd[14620]: can't open /var/log/ntpstats/rawstats.20240215: Permission denied
2024-02-15T17:21:29.414 INFO:teuthology.orchestra.run.smithi138.stderr:15 Feb 17:21:29 ntpd[14620]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied
2024-02-15T17:21:29.414 INFO:teuthology.orchestra.run.smithi138.stderr:15 Feb 17:21:29 ntpd[14620]: can't open /var/log/ntpstats/peerstats.20240215: Permission denied
2024-02-15T17:21:29.414 INFO:teuthology.orchestra.run.smithi138.stderr:15 Feb 17:21:29 ntpd[14620]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied
2024-02-15T17:21:29.414 INFO:teuthology.orchestra.run.smithi138.stderr:15 Feb 17:21:29 ntpd[14620]: can't open /var/log/ntpstats/rawstats.20240215: Permission denied
2024-02-15T17:21:29.414 INFO:teuthology.orchestra.run.smithi138.stderr:15 Feb 17:21:29 ntpd[14620]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied
2024-02-15T17:21:29.414 INFO:teuthology.orchestra.run.smithi138.stderr:15 Feb 17:21:29 ntpd[14620]: can't open /var/log/ntpstats/peerstats.20240215: Permission denied
2024-02-15T17:21:29.454 INFO:teuthology.orchestra.run.smithi152.stderr:15 Feb 17:21:29 ntpd[14569]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied
2024-02-15T17:21:29.454 INFO:teuthology.orchestra.run.smithi152.stderr:15 Feb 17:21:29 ntpd[14569]: can't open /var/log/ntpstats/rawstats.20240215: Permission denied
2024-02-15T17:21:29.454 INFO:teuthology.orchestra.run.smithi152.stderr:15 Feb 17:21:29 ntpd[14569]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied
2024-02-15T17:21:29.454 INFO:teuthology.orchestra.run.smithi152.stderr:15 Feb 17:21:29 ntpd[14569]: can't open /var/log/ntpstats/peerstats.20240215: Permission denied
2024-02-15T17:21:29.454 INFO:teuthology.orchestra.run.smithi152.stderr:15 Feb 17:21:29 ntpd[14569]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied
2024-02-15T17:21:29.454 INFO:teuthology.orchestra.run.smithi152.stderr:15 Feb 17:21:29 ntpd[14569]: can't open /var/log/ntpstats/rawstats.20240215: Permission denied
2024-02-15T17:21:29.454 INFO:teuthology.orchestra.run.smithi152.stderr:15 Feb 17:21:29 ntpd[14569]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied
2024-02-15T17:21:29.454 INFO:teuthology.orchestra.run.smithi152.stderr:15 Feb 17:21:29 ntpd[14569]: can't open /var/log/ntpstats/peerstats.20240215: Permission denied
2024-02-15T17:21:30.453 INFO:teuthology.orchestra.run.smithi152.stderr:15 Feb 17:21:30 ntpd[14569]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied
2024-02-15T17:21:30.453 INFO:teuthology.orchestra.run.smithi152.stderr:15 Feb 17:21:30 ntpd[14569]: can't open /var/log/ntpstats/rawstats.20240215: Permission denied
2024-02-15T17:21:30.454 INFO:teuthology.orchestra.run.smithi152.stderr:15 Feb 17:21:30 ntpd[14569]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied
2024-02-15T17:21:30.454 INFO:teuthology.orchestra.run.smithi152.stderr:15 Feb 17:21:30 ntpd[14569]: can't open /var/log/ntpstats/peerstats.20240215: Permission denied
2024-02-15T17:21:31.413 INFO:teuthology.orchestra.run.smithi138.stderr:15 Feb 17:21:31 ntpd[14620]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied
2024-02-15T17:21:31.413 INFO:teuthology.orchestra.run.smithi138.stderr:15 Feb 17:21:31 ntpd[14620]: can't open /var/log/ntpstats/rawstats.20240215: Permission denied
2024-02-15T17:21:31.413 INFO:teuthology.orchestra.run.smithi138.stderr:15 Feb 17:21:31 ntpd[14620]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied
2024-02-15T17:21:31.413 INFO:teuthology.orchestra.run.smithi138.stderr:15 Feb 17:21:31 ntpd[14620]: can't open /var/log/ntpstats/peerstats.20240215: Permission denied
2024-02-15T17:21:31.413 INFO:teuthology.orchestra.run.smithi138.stderr:15 Feb 17:21:31 ntpd[14620]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied
2024-02-15T17:21:31.414 INFO:teuthology.orchestra.run.smithi138.stderr:15 Feb 17:21:31 ntpd[14620]: can't open /var/log/ntpstats/rawstats.20240215: Permission denied
2024-02-15T17:21:31.414 INFO:teuthology.orchestra.run.smithi138.stderr:15 Feb 17:21:31 ntpd[14620]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied
2024-02-15T17:21:31.414 INFO:teuthology.orchestra.run.smithi138.stderr:15 Feb 17:21:31 ntpd[14620]: can't open /var/log/ntpstats/peerstats.20240215: Permission denied
2024-02-15T17:21:31.414 INFO:teuthology.orchestra.run.smithi138.stderr:15 Feb 17:21:31 ntpd[14620]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied
2024-02-15T17:21:31.414 INFO:teuthology.orchestra.run.smithi138.stderr:15 Feb 17:21:31 ntpd[14620]: can't open /var/log/ntpstats/rawstats.20240215: Permission denied
2024-02-15T17:21:31.414 INFO:teuthology.orchestra.run.smithi138.stderr:15 Feb 17:21:31 ntpd[14620]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied
2024-02-15T17:21:31.414 INFO:teuthology.orchestra.run.smithi138.stderr:15 Feb 17:21:31 ntpd[14620]: can't open /var/log/ntpstats/peerstats.20240215: Permission denied
2024-02-15T17:21:31.454 INFO:teuthology.orchestra.run.smithi152.stderr:15 Feb 17:21:31 ntpd[14569]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied
2024-02-15T17:21:31.454 INFO:teuthology.orchestra.run.smithi152.stderr:15 Feb 17:21:31 ntpd[14569]: can't open /var/log/ntpstats/rawstats.20240215: Permission denied
2024-02-15T17:21:31.454 INFO:teuthology.orchestra.run.smithi152.stderr:15 Feb 17:21:31 ntpd[14569]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied
2024-02-15T17:21:31.454 INFO:teuthology.orchestra.run.smithi152.stderr:15 Feb 17:21:31 ntpd[14569]: can't open /var/log/ntpstats/peerstats.20240215: Permission denied
2024-02-15T17:21:31.454 INFO:teuthology.orchestra.run.smithi152.stderr:15 Feb 17:21:31 ntpd[14569]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied
2024-02-15T17:21:31.454 INFO:teuthology.orchestra.run.smithi152.stderr:15 Feb 17:21:31 ntpd[14569]: can't open /var/log/ntpstats/rawstats.20240215: Permission denied
2024-02-15T17:21:31.454 INFO:teuthology.orchestra.run.smithi152.stderr:15 Feb 17:21:31 ntpd[14569]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied
2024-02-15T17:21:31.454 INFO:teuthology.orchestra.run.smithi152.stderr:15 Feb 17:21:31 ntpd[14569]: can't open /var/log/ntpstats/peerstats.20240215: Permission denied
2024-02-15T17:21:32.453 INFO:teuthology.orchestra.run.smithi152.stderr:15 Feb 17:21:32 ntpd[14569]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied
2024-02-15T17:21:32.454 INFO:teuthology.orchestra.run.smithi152.stderr:15 Feb 17:21:32 ntpd[14569]: can't open /var/log/ntpstats/rawstats.20240215: Permission denied
2024-02-15T17:21:32.454 INFO:teuthology.orchestra.run.smithi152.stderr:15 Feb 17:21:32 ntpd[14569]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied
2024-02-15T17:21:32.454 INFO:teuthology.orchestra.run.smithi152.stderr:15 Feb 17:21:32 ntpd[14569]: can't open /var/log/ntpstats/peerstats.20240215: Permission denied
2024-02-15T17:21:33.412 INFO:teuthology.orchestra.run.smithi138.stderr:15 Feb 17:21:33 ntpd[14620]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied
2024-02-15T17:21:33.413 INFO:teuthology.orchestra.run.smithi138.stderr:15 Feb 17:21:33 ntpd[14620]: can't open /var/log/ntpstats/rawstats.20240215: Permission denied
2024-02-15T17:21:33.413 INFO:teuthology.orchestra.run.smithi138.stderr:15 Feb 17:21:33 ntpd[14620]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied
2024-02-15T17:21:33.413 INFO:teuthology.orchestra.run.smithi138.stderr:15 Feb 17:21:33 ntpd[14620]: can't open /var/log/ntpstats/peerstats.20240215: Permission denied
2024-02-15T17:21:33.413 INFO:teuthology.orchestra.run.smithi138.stderr:15 Feb 17:21:33 ntpd[14620]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied
2024-02-15T17:21:33.413 INFO:teuthology.orchestra.run.smithi138.stderr:15 Feb 17:21:33 ntpd[14620]: can't open /var/log/ntpstats/rawstats.20240215: Permission denied
2024-02-15T17:21:33.413 INFO:teuthology.orchestra.run.smithi138.stderr:15 Feb 17:21:33 ntpd[14620]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied
2024-02-15T17:21:33.413 INFO:teuthology.orchestra.run.smithi138.stderr:15 Feb 17:21:33 ntpd[14620]: can't open /var/log/ntpstats/peerstats.20240215: Permission denied
2024-02-15T17:21:33.413 INFO:teuthology.orchestra.run.smithi138.stdout:15 Feb 17:21:33 ntpd[14620]: ntpd: time slew -0.000970 s
2024-02-15T17:21:33.413 INFO:teuthology.orchestra.run.smithi138.stdout:ntpd: time slew -0.000970s
2024-02-15T17:21:33.414 INFO:teuthology.orchestra.run.smithi138.stderr:15 Feb 17:21:33 ntpd[14620]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied
2024-02-15T17:21:33.414 INFO:teuthology.orchestra.run.smithi138.stderr:15 Feb 17:21:33 ntpd[14620]: can't open /var/log/ntpstats/loopstats.20240215: Permission denied
2024-02-15T17:21:33.453 INFO:teuthology.orchestra.run.smithi152.stderr:15 Feb 17:21:33 ntpd[14569]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied
2024-02-15T17:21:33.454 INFO:teuthology.orchestra.run.smithi152.stderr:15 Feb 17:21:33 ntpd[14569]: can't open /var/log/ntpstats/rawstats.20240215: Permission denied
2024-02-15T17:21:33.454 INFO:teuthology.orchestra.run.smithi152.stderr:15 Feb 17:21:33 ntpd[14569]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied
2024-02-15T17:21:33.454 INFO:teuthology.orchestra.run.smithi152.stderr:15 Feb 17:21:33 ntpd[14569]: can't open /var/log/ntpstats/peerstats.20240215: Permission denied
2024-02-15T17:21:33.454 INFO:teuthology.orchestra.run.smithi152.stdout:15 Feb 17:21:33 ntpd[14569]: ntpd: time slew +0.005403 s
2024-02-15T17:21:33.454 INFO:teuthology.orchestra.run.smithi152.stdout:ntpd: time slew +0.005403s
2024-02-15T17:21:33.454 INFO:teuthology.orchestra.run.smithi152.stderr:15 Feb 17:21:33 ntpd[14569]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied
2024-02-15T17:21:33.454 INFO:teuthology.orchestra.run.smithi152.stderr:15 Feb 17:21:33 ntpd[14569]: can't open /var/log/ntpstats/loopstats.20240215: Permission denied
2024-02-15T17:21:33.509 INFO:teuthology.orchestra.run.smithi152.stdout:     remote           refid      st t when poll reach   delay   offset  jitter
2024-02-15T17:21:33.509 INFO:teuthology.orchestra.run.smithi152.stdout:==============================================================================
2024-02-15T17:21:33.509 INFO:teuthology.orchestra.run.smithi152.stdout: hv01.front.sepi .INIT.          16 u    -   64    0    0.000    0.000   0.000
2024-02-15T17:21:33.509 INFO:teuthology.orchestra.run.smithi152.stdout: hv02.front.sepi .INIT.          16 u    -   64    0    0.000    0.000   0.000
2024-02-15T17:21:33.509 INFO:teuthology.orchestra.run.smithi152.stdout: hv03.front.sepi .INIT.          16 u    -   64    0    0.000    0.000   0.000
2024-02-15T17:21:33.509 INFO:teuthology.orchestra.run.smithi152.stdout: hv04.front.sepi .INIT.          16 u    -   64    0    0.000    0.000   0.000
2024-02-15T17:21:33.546 INFO:teuthology.orchestra.run.smithi138.stdout:     remote           refid      st t when poll reach   delay   offset  jitter
2024-02-15T17:21:33.546 INFO:teuthology.orchestra.run.smithi138.stdout:==============================================================================
2024-02-15T17:21:33.546 INFO:teuthology.orchestra.run.smithi138.stdout: hv01.front.sepi .INIT.          16 u    -   64    0    0.000    0.000   0.000
2024-02-15T17:21:33.546 INFO:teuthology.orchestra.run.smithi138.stdout: hv02.front.sepi .INIT.          16 u    -   64    0    0.000    0.000   0.000
2024-02-15T17:21:33.546 INFO:teuthology.orchestra.run.smithi138.stdout: hv03.front.sepi .INIT.          16 u    -   64    0    0.000    0.000   0.000
2024-02-15T17:21:33.546 INFO:teuthology.orchestra.run.smithi138.stdout: hv04.front.sepi .INIT.          16 u    -   64    0    0.000    0.000   0.000
2024-02-15T17:21:33.547 INFO:teuthology.run_tasks:Running task nvme_loop...
2024-02-15T17:21:33.571 INFO:tasks.nvme_loop:Setting up nvme_loop on scratch devices...
2024-02-15T17:21:33.571 DEBUG:teuthology.orchestra.run.smithi138:> set -ex
2024-02-15T17:21:33.571 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/scratch_devs of=/dev/stdout
2024-02-15T17:21:33.594 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4']
2024-02-15T17:21:33.594 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_1
2024-02-15T17:21:33.643 INFO:teuthology.orchestra.run.smithi138.stdout:  File: /dev/vg_nvme/lv_1 -> ../dm-0
2024-02-15T17:21:33.643 INFO:teuthology.orchestra.run.smithi138.stdout:  Size: 7         	Blocks: 0          IO Block: 4096   symbolic link
2024-02-15T17:21:33.643 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 6h/6d	Inode: 340         Links: 1
2024-02-15T17:21:33.643 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx)  Uid: (    0/    root)   Gid: (    0/    root)
2024-02-15T17:21:33.643 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2024-02-15 17:19:57.954372463 +0000
2024-02-15T17:21:33.643 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-02-15 17:19:57.782376553 +0000
2024-02-15T17:21:33.643 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-02-15 17:19:57.782376553 +0000
2024-02-15T17:21:33.643 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: -
2024-02-15T17:21:33.644 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1
2024-02-15T17:21:33.701 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in
2024-02-15T17:21:33.701 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out
2024-02-15T17:21:33.701 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000393767 s, 1.3 MB/s
2024-02-15T17:21:33.702 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1
2024-02-15T17:21:33.751 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_2
2024-02-15T17:21:33.802 INFO:teuthology.orchestra.run.smithi138.stdout:  File: /dev/vg_nvme/lv_2 -> ../dm-1
2024-02-15T17:21:33.802 INFO:teuthology.orchestra.run.smithi138.stdout:  Size: 7         	Blocks: 0          IO Block: 4096   symbolic link
2024-02-15T17:21:33.802 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 6h/6d	Inode: 347         Links: 1
2024-02-15T17:21:33.802 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx)  Uid: (    0/    root)   Gid: (    0/    root)
2024-02-15T17:21:33.803 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2024-02-15 17:19:58.246365518 +0000
2024-02-15T17:21:33.803 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-02-15 17:19:58.110368753 +0000
2024-02-15T17:21:33.803 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-02-15 17:19:58.110368753 +0000
2024-02-15T17:21:33.803 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: -
2024-02-15T17:21:33.803 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1
2024-02-15T17:21:33.857 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in
2024-02-15T17:21:33.857 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out
2024-02-15T17:21:33.857 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000357765 s, 1.4 MB/s
2024-02-15T17:21:33.858 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2
2024-02-15T17:21:33.907 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_3
2024-02-15T17:21:33.958 INFO:teuthology.orchestra.run.smithi138.stdout:  File: /dev/vg_nvme/lv_3 -> ../dm-2
2024-02-15T17:21:33.958 INFO:teuthology.orchestra.run.smithi138.stdout:  Size: 7         	Blocks: 0          IO Block: 4096   symbolic link
2024-02-15T17:21:33.958 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 6h/6d	Inode: 353         Links: 1
2024-02-15T17:21:33.958 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx)  Uid: (    0/    root)   Gid: (    0/    root)
2024-02-15T17:21:33.959 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2024-02-15 17:19:58.530358763 +0000
2024-02-15T17:21:33.959 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-02-15 17:19:58.370362568 +0000
2024-02-15T17:21:33.959 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-02-15 17:19:58.370362568 +0000
2024-02-15T17:21:33.959 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: -
2024-02-15T17:21:33.959 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1
2024-02-15T17:21:34.013 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in
2024-02-15T17:21:34.013 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out
2024-02-15T17:21:34.013 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000344557 s, 1.5 MB/s
2024-02-15T17:21:34.014 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3
2024-02-15T17:21:34.064 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_4
2024-02-15T17:21:34.114 INFO:teuthology.orchestra.run.smithi138.stdout:  File: /dev/vg_nvme/lv_4 -> ../dm-3
2024-02-15T17:21:34.114 INFO:teuthology.orchestra.run.smithi138.stdout:  Size: 7         	Blocks: 0          IO Block: 4096   symbolic link
2024-02-15T17:21:34.114 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 6h/6d	Inode: 359         Links: 1
2024-02-15T17:21:34.114 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx)  Uid: (    0/    root)   Gid: (    0/    root)
2024-02-15T17:21:34.115 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2024-02-15 17:19:58.846351247 +0000
2024-02-15T17:21:34.115 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-02-15 17:19:58.682355147 +0000
2024-02-15T17:21:34.115 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-02-15 17:19:58.682355147 +0000
2024-02-15T17:21:34.115 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: -
2024-02-15T17:21:34.115 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1
2024-02-15T17:21:34.169 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in
2024-02-15T17:21:34.169 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out
2024-02-15T17:21:34.169 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000320018 s, 1.6 MB/s
2024-02-15T17:21:34.170 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4
2024-02-15T17:21:34.223 DEBUG:teuthology.orchestra.run.smithi138:> sudo modprobe nvme_loop && sudo mkdir -p /sys/kernel/config/nvmet/hosts/hostnqn && sudo mkdir -p /sys/kernel/config/nvmet/ports/1 && echo loop | sudo tee /sys/kernel/config/nvmet/ports/1/addr_trtype
2024-02-15T17:21:34.318 INFO:teuthology.orchestra.run.smithi138.stdout:loop
2024-02-15T17:21:34.319 INFO:tasks.nvme_loop:Connecting nvme_loop smithi138:/dev/vg_nvme/lv_1...
2024-02-15T17:21:34.319 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1 && echo -n /dev/vg_nvme/lv_1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_1 /sys/kernel/config/nvmet/ports/1/subsystems/lv_1 && sudo nvme connect -t loop -n lv_1 -q hostnqn
2024-02-15T17:21:34.338 INFO:teuthology.orchestra.run.smithi138.stdout:1
2024-02-15T17:21:34.365 INFO:teuthology.orchestra.run.smithi138.stdout:/dev/vg_nvme/lv_11
2024-02-15T17:21:34.389 INFO:tasks.nvme_loop:Connecting nvme_loop smithi138:/dev/vg_nvme/lv_2...
2024-02-15T17:21:34.389 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_2 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_2/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_2/namespaces/1 && echo -n /dev/vg_nvme/lv_2 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_2/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_2/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_2 /sys/kernel/config/nvmet/ports/1/subsystems/lv_2 && sudo nvme connect -t loop -n lv_2 -q hostnqn
2024-02-15T17:21:34.454 INFO:teuthology.orchestra.run.smithi138.stdout:1
2024-02-15T17:21:34.478 INFO:teuthology.orchestra.run.smithi138.stdout:/dev/vg_nvme/lv_21
2024-02-15T17:21:34.502 INFO:tasks.nvme_loop:Connecting nvme_loop smithi138:/dev/vg_nvme/lv_3...
2024-02-15T17:21:34.502 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_3 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_3/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_3/namespaces/1 && echo -n /dev/vg_nvme/lv_3 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_3/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_3/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_3 /sys/kernel/config/nvmet/ports/1/subsystems/lv_3 && sudo nvme connect -t loop -n lv_3 -q hostnqn
2024-02-15T17:21:34.557 INFO:teuthology.orchestra.run.smithi138.stdout:1
2024-02-15T17:21:34.579 INFO:teuthology.orchestra.run.smithi138.stdout:/dev/vg_nvme/lv_31
2024-02-15T17:21:34.596 INFO:tasks.nvme_loop:Connecting nvme_loop smithi138:/dev/vg_nvme/lv_4...
2024-02-15T17:21:34.596 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_4 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_4/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_4/namespaces/1 && echo -n /dev/vg_nvme/lv_4 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_4/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_4/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_4 /sys/kernel/config/nvmet/ports/1/subsystems/lv_4 && sudo nvme connect -t loop -n lv_4 -q hostnqn
2024-02-15T17:21:34.656 INFO:teuthology.orchestra.run.smithi138.stdout:1
2024-02-15T17:21:34.672 INFO:teuthology.orchestra.run.smithi138.stdout:/dev/vg_nvme/lv_41
2024-02-15T17:21:34.689 DEBUG:teuthology.orchestra.run.smithi138:> set -ex
2024-02-15T17:21:34.689 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/scratch_devs of=/dev/stdout
2024-02-15T17:21:34.738 DEBUG:teuthology.orchestra.run.smithi138:> sudo nvme list
2024-02-15T17:21:34.792 INFO:teuthology.orchestra.run.smithi138.stdout:Node             SN                   Model                                    Namespace Usage                      Format           FW Rev
2024-02-15T17:21:34.792 INFO:teuthology.orchestra.run.smithi138.stdout:---------------- -------------------- ---------------------------------------- --------- -------------------------- ---------------- --------
2024-02-15T17:21:34.792 INFO:teuthology.orchestra.run.smithi138.stdout:/dev/nvme0n1     CVFT6161003C400BGN   INTEL SSDPEDMD400G4                      1         400.09  GB / 400.09  GB    512   B +  0 B   8DV101H0
2024-02-15T17:21:34.792 INFO:teuthology.orchestra.run.smithi138.stdout:/dev/nvme1n1     b436d42918b743fb     Linux                                    1          96.00  GB /  96.00  GB    512   B +  0 B   4.15.0-2
2024-02-15T17:21:34.792 INFO:teuthology.orchestra.run.smithi138.stdout:/dev/nvme2n1     581742c1d874e496     Linux                                    1          96.00  GB /  96.00  GB    512   B +  0 B   4.15.0-2
2024-02-15T17:21:34.792 INFO:teuthology.orchestra.run.smithi138.stdout:/dev/nvme3n1     32fed1afcea55d07     Linux                                    1          96.00  GB /  96.00  GB    512   B +  0 B   4.15.0-2
2024-02-15T17:21:34.792 INFO:teuthology.orchestra.run.smithi138.stdout:/dev/nvme4n1     b115e8ef607d1c0b     Linux                                    1          96.00  GB /  96.00  GB    512   B +  0 B   4.15.0-2
2024-02-15T17:21:34.793 INFO:tasks.nvme_loop:new_devs ['/dev/nvme1n1', '/dev/nvme2n1', '/dev/nvme3n1', '/dev/nvme4n1']
2024-02-15T17:21:34.793 DEBUG:teuthology.orchestra.run.smithi138:> set -ex
2024-02-15T17:21:34.793 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/scratch_devs
2024-02-15T17:21:34.849 DEBUG:teuthology.orchestra.run.smithi152:> set -ex
2024-02-15T17:21:34.849 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/scratch_devs of=/dev/stdout
2024-02-15T17:21:34.856 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4']
2024-02-15T17:21:34.856 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_1
2024-02-15T17:21:34.903 INFO:teuthology.orchestra.run.smithi152.stdout:  File: /dev/vg_nvme/lv_1 -> ../dm-0
2024-02-15T17:21:34.904 INFO:teuthology.orchestra.run.smithi152.stdout:  Size: 7         	Blocks: 0          IO Block: 4096   symbolic link
2024-02-15T17:21:34.904 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 6h/6d	Inode: 343         Links: 1
2024-02-15T17:21:34.904 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx)  Uid: (    0/    root)   Gid: (    0/    root)
2024-02-15T17:21:34.904 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2024-02-15 17:20:04.510687605 +0000
2024-02-15T17:21:34.904 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2024-02-15 17:20:04.350713811 +0000
2024-02-15T17:21:34.904 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2024-02-15 17:20:04.350713811 +0000
2024-02-15T17:21:34.904 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: -
2024-02-15T17:21:34.904 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1
2024-02-15T17:21:34.958 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in
2024-02-15T17:21:34.958 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out
2024-02-15T17:21:34.958 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.00034845 s, 1.5 MB/s
2024-02-15T17:21:34.960 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1
2024-02-15T17:21:35.009 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_2
2024-02-15T17:21:35.060 INFO:teuthology.orchestra.run.smithi152.stdout:  File: /dev/vg_nvme/lv_2 -> ../dm-1
2024-02-15T17:21:35.060 INFO:teuthology.orchestra.run.smithi152.stdout:  Size: 7         	Blocks: 0          IO Block: 4096   symbolic link
2024-02-15T17:21:35.060 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 6h/6d	Inode: 350         Links: 1
2024-02-15T17:21:35.060 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx)  Uid: (    0/    root)   Gid: (    0/    root)
2024-02-15T17:21:35.060 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2024-02-15 17:20:04.810638469 +0000
2024-02-15T17:21:35.060 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2024-02-15 17:20:04.642665985 +0000
2024-02-15T17:21:35.060 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2024-02-15 17:20:04.642665985 +0000
2024-02-15T17:21:35.060 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: -
2024-02-15T17:21:35.060 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1
2024-02-15T17:21:35.114 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in
2024-02-15T17:21:35.114 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out
2024-02-15T17:21:35.114 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000356 s, 1.4 MB/s
2024-02-15T17:21:35.115 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2
2024-02-15T17:21:35.169 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_3
2024-02-15T17:21:35.219 INFO:teuthology.orchestra.run.smithi152.stdout:  File: /dev/vg_nvme/lv_3 -> ../dm-2
2024-02-15T17:21:35.219 INFO:teuthology.orchestra.run.smithi152.stdout:  Size: 7         	Blocks: 0          IO Block: 4096   symbolic link
2024-02-15T17:21:35.220 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 6h/6d	Inode: 356         Links: 1
2024-02-15T17:21:35.220 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx)  Uid: (    0/    root)   Gid: (    0/    root)
2024-02-15T17:21:35.220 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2024-02-15 17:20:05.102591135 +0000
2024-02-15T17:21:35.220 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2024-02-15 17:20:04.938617505 +0000
2024-02-15T17:21:35.220 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2024-02-15 17:20:04.938617505 +0000
2024-02-15T17:21:35.220 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: -
2024-02-15T17:21:35.220 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1
2024-02-15T17:21:35.274 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in
2024-02-15T17:21:35.274 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out
2024-02-15T17:21:35.274 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.00034865 s, 1.5 MB/s
2024-02-15T17:21:35.275 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3
2024-02-15T17:21:35.329 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_4
2024-02-15T17:21:35.379 INFO:teuthology.orchestra.run.smithi152.stdout:  File: /dev/vg_nvme/lv_4 -> ../dm-3
2024-02-15T17:21:35.379 INFO:teuthology.orchestra.run.smithi152.stdout:  Size: 7         	Blocks: 0          IO Block: 4096   symbolic link
2024-02-15T17:21:35.379 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 6h/6d	Inode: 362         Links: 1
2024-02-15T17:21:35.379 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx)  Uid: (    0/    root)   Gid: (    0/    root)
2024-02-15T17:21:35.379 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2024-02-15 17:20:05.406542866 +0000
2024-02-15T17:21:35.380 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2024-02-15 17:20:05.246568271 +0000
2024-02-15T17:21:35.380 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2024-02-15 17:20:05.246568271 +0000
2024-02-15T17:21:35.380 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: -
2024-02-15T17:21:35.380 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1
2024-02-15T17:21:35.434 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in
2024-02-15T17:21:35.434 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out
2024-02-15T17:21:35.434 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000316091 s, 1.6 MB/s
2024-02-15T17:21:35.435 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4
2024-02-15T17:21:35.484 DEBUG:teuthology.orchestra.run.smithi152:> sudo modprobe nvme_loop && sudo mkdir -p /sys/kernel/config/nvmet/hosts/hostnqn && sudo mkdir -p /sys/kernel/config/nvmet/ports/1 && echo loop | sudo tee /sys/kernel/config/nvmet/ports/1/addr_trtype
2024-02-15T17:21:35.576 INFO:teuthology.orchestra.run.smithi152.stdout:loop
2024-02-15T17:21:35.577 INFO:tasks.nvme_loop:Connecting nvme_loop smithi152:/dev/vg_nvme/lv_1...
2024-02-15T17:21:35.578 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1 && echo -n /dev/vg_nvme/lv_1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_1 /sys/kernel/config/nvmet/ports/1/subsystems/lv_1 && sudo nvme connect -t loop -n lv_1 -q hostnqn
2024-02-15T17:21:35.598 INFO:teuthology.orchestra.run.smithi152.stdout:1
2024-02-15T17:21:35.628 INFO:teuthology.orchestra.run.smithi152.stdout:/dev/vg_nvme/lv_11
2024-02-15T17:21:35.645 INFO:tasks.nvme_loop:Connecting nvme_loop smithi152:/dev/vg_nvme/lv_2...
2024-02-15T17:21:35.645 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_2 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_2/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_2/namespaces/1 && echo -n /dev/vg_nvme/lv_2 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_2/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_2/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_2 /sys/kernel/config/nvmet/ports/1/subsystems/lv_2 && sudo nvme connect -t loop -n lv_2 -q hostnqn
2024-02-15T17:21:35.712 INFO:teuthology.orchestra.run.smithi152.stdout:1
2024-02-15T17:21:35.739 INFO:teuthology.orchestra.run.smithi152.stdout:/dev/vg_nvme/lv_21
2024-02-15T17:21:35.760 INFO:tasks.nvme_loop:Connecting nvme_loop smithi152:/dev/vg_nvme/lv_3...
2024-02-15T17:21:35.760 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_3 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_3/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_3/namespaces/1 && echo -n /dev/vg_nvme/lv_3 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_3/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_3/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_3 /sys/kernel/config/nvmet/ports/1/subsystems/lv_3 && sudo nvme connect -t loop -n lv_3 -q hostnqn
2024-02-15T17:21:35.821 INFO:teuthology.orchestra.run.smithi152.stdout:1
2024-02-15T17:21:35.846 INFO:teuthology.orchestra.run.smithi152.stdout:/dev/vg_nvme/lv_31
2024-02-15T17:21:35.868 INFO:tasks.nvme_loop:Connecting nvme_loop smithi152:/dev/vg_nvme/lv_4...
2024-02-15T17:21:35.868 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_4 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_4/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_4/namespaces/1 && echo -n /dev/vg_nvme/lv_4 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_4/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_4/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_4 /sys/kernel/config/nvmet/ports/1/subsystems/lv_4 && sudo nvme connect -t loop -n lv_4 -q hostnqn
2024-02-15T17:21:35.929 INFO:teuthology.orchestra.run.smithi152.stdout:1
2024-02-15T17:21:35.961 INFO:teuthology.orchestra.run.smithi152.stdout:/dev/vg_nvme/lv_41
2024-02-15T17:21:35.978 DEBUG:teuthology.orchestra.run.smithi152:> set -ex
2024-02-15T17:21:35.979 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/scratch_devs of=/dev/stdout
2024-02-15T17:21:36.026 DEBUG:teuthology.orchestra.run.smithi152:> sudo nvme list
2024-02-15T17:21:36.082 INFO:teuthology.orchestra.run.smithi152.stdout:Node             SN                   Model                                    Namespace Usage                      Format           FW Rev
2024-02-15T17:21:36.082 INFO:teuthology.orchestra.run.smithi152.stdout:---------------- -------------------- ---------------------------------------- --------- -------------------------- ---------------- --------
2024-02-15T17:21:36.082 INFO:teuthology.orchestra.run.smithi152.stdout:/dev/nvme0n1     CVFT623300JT400BGN   INTEL SSDPEDMD400G4                      1         400.09  GB / 400.09  GB    512   B +  0 B   8DV101H0
2024-02-15T17:21:36.082 INFO:teuthology.orchestra.run.smithi152.stdout:/dev/nvme1n1     6fa452d5e98b1291     Linux                                    1          96.00  GB /  96.00  GB    512   B +  0 B   4.15.0-2
2024-02-15T17:21:36.082 INFO:teuthology.orchestra.run.smithi152.stdout:/dev/nvme2n1     64e7aaa5e74d0f5c     Linux                                    1          96.00  GB /  96.00  GB    512   B +  0 B   4.15.0-2
2024-02-15T17:21:36.082 INFO:teuthology.orchestra.run.smithi152.stdout:/dev/nvme3n1     20b5d15336dcf916     Linux                                    1          96.00  GB /  96.00  GB    512   B +  0 B   4.15.0-2
2024-02-15T17:21:36.082 INFO:teuthology.orchestra.run.smithi152.stdout:/dev/nvme4n1     8ab89516aa9c3e5a     Linux                                    1          96.00  GB /  96.00  GB    512   B +  0 B   4.15.0-2
2024-02-15T17:21:36.083 INFO:tasks.nvme_loop:new_devs ['/dev/nvme1n1', '/dev/nvme2n1', '/dev/nvme3n1', '/dev/nvme4n1']
2024-02-15T17:21:36.083 DEBUG:teuthology.orchestra.run.smithi152:> set -ex
2024-02-15T17:21:36.083 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/scratch_devs
2024-02-15T17:21:36.142 INFO:teuthology.run_tasks:Running task cephadm...
2024-02-15T17:21:36.215 INFO:tasks.cephadm:Config: {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'global': {'mon election default strategy': 3}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20, 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': '0e714d9a4bd2a821113e6318adb87bd06cf81ec1'}
2024-02-15T17:21:36.215 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1
2024-02-15T17:21:36.216 INFO:tasks.cephadm:Cluster fsid is ac090f44-cc26-11ee-95b9-87774f69a715
2024-02-15T17:21:36.216 INFO:tasks.cephadm:Choosing monitor IPs and ports...
2024-02-15T17:21:36.216 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.138', 'mon.c': '[v2:172.21.15.138:3301,v1:172.21.15.138:6790]', 'mon.b': '172.21.15.152'}
2024-02-15T17:21:36.216 INFO:tasks.cephadm:First mon is mon.a on smithi138
2024-02-15T17:21:36.216 INFO:tasks.cephadm:First mgr is y
2024-02-15T17:21:36.216 INFO:tasks.cephadm:Normalizing hostnames...
2024-02-15T17:21:36.217 DEBUG:teuthology.orchestra.run.smithi138:> sudo hostname $(hostname -s)
2024-02-15T17:21:36.233 DEBUG:teuthology.orchestra.run.smithi152:> sudo hostname $(hostname -s)
2024-02-15T17:21:36.249 INFO:tasks.cephadm:Downloading cephadm (repo https://git.ceph.com/ceph-ci.git ref 0e714d9a4bd2a821113e6318adb87bd06cf81ec1)...
2024-02-15T17:21:36.249 DEBUG:teuthology.orchestra.run.smithi138:> git clone https://git.ceph.com/ceph-ci.git testrepo && cd testrepo && git show 0e714d9a4bd2a821113e6318adb87bd06cf81ec1:src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm
2024-02-15T17:21:36.282 INFO:teuthology.orchestra.run.smithi138.stderr:Cloning into 'testrepo'...
2024-02-15T17:23:15.382 DEBUG:teuthology.exit:Got signal 15; running 1 handler...
2024-02-15T17:23:15.383 DEBUG:teuthology.task.console_log:Killing console logger for smithi138
2024-02-15T17:23:15.384 DEBUG:teuthology.task.console_log:Killing console logger for smithi152
2024-02-15T17:23:15.384 DEBUG:teuthology.exit:Finished running handlers