2021-06-21T19:37:29.945 INFO:root:teuthology version: 1.1.0-f359b10d 2021-06-21T19:37:29.947 DEBUG:teuthology.run:Teuthology command: teuthology --description krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{secure} thrashers/mon-thrasher thrashosds-health workloads/rbd_fio} --archive /home/teuthworker/archive/yuriw-2021-06-21_19:20:44-krbd-nautilus-testing-basic-smithi/6182980 --name yuriw-2021-06-21_19:20:44-krbd-nautilus-testing-basic-smithi --verbose --owner scheduled_yuriw@teuthology -- /home/teuthworker/archive/yuriw-2021-06-21_19:20:44-krbd-nautilus-testing-basic-smithi/6182980/orig.config.yaml 2021-06-21T19:37:29.996 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-06-21T19:37:30.050 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2021-06-21_19:20:44-krbd-nautilus-testing-basic-smithi/6182980 branch: nautilus description: krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{secure} thrashers/mon-thrasher thrashosds-health workloads/rbd_fio} email: null first_in_suite: false job_id: '6182980' kernel: flavor: basic kdb: true sha1: 59a52ddbc139cff701898f0e99b06b71bd00b6d2 last_in_suite: false machine_type: smithi name: yuriw-2021-06-21_19:20:44-krbd-nautilus-testing-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 10 overrides: admin_socket: branch: nautilus ceph: conf: client: rbd default features: 37 rbd default map options: ms_mode=secure global: ms die on skipped message: false mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(MON_DOWN\) - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request sha1: 22c2801c1bdab3cbcc2e006d68534e1574886c4e ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: sha1: 22c2801c1bdab3cbcc2e006d68534e1574886c4e thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: nautilus sha1: 22c2801c1bdab3cbcc2e006d68534e1574886c4e owner: scheduled_yuriw@teuthology priority: 79 repo: https://github.com/ceph/ceph.git roles: - - mon.a - mon.c - mgr.x - osd.0 - osd.1 - osd.2 - osd.3 - - mon.b - mgr.y - osd.4 - osd.5 - osd.6 - osd.7 - - client.0 sha1: 22c2801c1bdab3cbcc2e006d68534e1574886c4e sleep_before_teardown: 0 suite: krbd suite_branch: nautilus suite_path: /home/teuthworker/src/github.com_ceph_ceph_22c2801c1bdab3cbcc2e006d68534e1574886c4e/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph.git suite_sha1: 22c2801c1bdab3cbcc2e006d68534e1574886c4e targets: smithi019.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCzHyUi6wjAZy2aGCxUNprWC6tI9U/U52x1CkKqsV/WZPGD/biWsyCjD75QE0oNV4qnj7rcP1ZEnIn35V00o78VPbdzNTmS3BNph33B51GXUn+FOo6Hx9bV/GOfbj7FUlbwnCJ9Y67xFaX1oT4AQ3dz/5yzxtrYX5yPsN3wu7yVaVU8GqaULLKOvcN1Z9s5JcDO1cJX6VJ9Y1QRwpF9jHjQDDincjo5gl4mQsSZXM8wsLWhXP5L39jwBIdqQIgR0ANSScwi3p9s5y9hgnfF74P9c9OnoajiiugwBC9HHb3ZntJ8PGSoLtNCqmxcmXbylhWQmqBce2bbeM9x7yb7Obrl smithi114.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+UOAKPZ0GwDUEig4MFAj2CpIU/15ohCTaINotxpLFUV0oT2YRPYqoVZudIr55c/6dXQWvPF9tRrukT2RbPo38M3s9mf4yTSajEsioWVsye6FhhgHycLR3mcajshF73I9B6Ic48YTCjtmNyR9Z+rlG+o6an2KMRSZ7dmH1Fu28A9dCulTpckXzgrMXqASp+YdlB7Js+jUQ2nA2E3p6zjjBfRT+6DLOKGuf+i0iQoOFkmPw32z7aR4e+MfglQt0/W0z0/B5kT14dKoUbNl3BGZdOgzqIi9JrQAn1Gn3GOwB198T1g4Qhd4F2nc19HsyeVTwZ279Ypbq2jq/bCWxBrTp smithi116.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDD/gaPvdFRgZflrT7Go4eygqNkjfge9x6GAeMNK0KU14HRdW/Bb/8cQVD+KwuiZ6W1/nhEvsAIlkBhKYhXXnumuGLnJ6LA+DjTT8/PoNXK4il/8nbd8ijclozTAcPn4SMCaQ9jUB391Yj024A8RoOf5ghg7RkwGQLmt9155dplnD0eed4ysSFbO7h1SNMLBq691mij9yyIPCgF7/4F6CAfePWllEgwn2ZeaS0HZg0QOKl/62z5JF4xYZhYJGC2NmDMMOgd8B4PFGom6aKXtj4rtL1v+vU/+sUmd4bEc+huku5tCMY0tsNI2JqoemlNbUl/oefhBkyR6+fmH2x7GhzH tasks: - install: null - ceph: null - mon_thrash: revive_delay: 20 thrash_delay: 1 - rbd_fio: client.0: bs: 1024 features: - - layering - exclusive-lock fio-io-size: 100% formats: - 2 io-depth: 256 io-engine: libaio runtime: 1200 rw: randrw teuthology_branch: master teuthology_sha1: f359b10daba6e0103d42ccfc021bc797f3cd7edc timestamp: 2021-06-21_19:20:44 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.8274 2021-06-21T19:37:30.051 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph_22c2801c1bdab3cbcc2e006d68534e1574886c4e/qa; will attempt to use it 2021-06-21T19:37:30.052 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph_22c2801c1bdab3cbcc2e006d68534e1574886c4e/qa/tasks 2021-06-21T19:37:30.052 INFO:teuthology.run_tasks:Running task internal.check_packages... 2021-06-21T19:37:30.059 INFO:teuthology.task.internal:Checking packages... 2021-06-21T19:37:30.060 INFO:teuthology.task.internal:Checking packages skipped, missing os_type 'None' or ceph hash '22c2801c1bdab3cbcc2e006d68534e1574886c4e' 2021-06-21T19:37:30.060 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2021-06-21T19:37:30.075 INFO:teuthology.task.internal:no buildpackages task found 2021-06-21T19:37:30.076 INFO:teuthology.run_tasks:Running task internal.save_config... 2021-06-21T19:37:30.145 INFO:teuthology.task.internal:Saving configuration 2021-06-21T19:37:30.183 INFO:teuthology.run_tasks:Running task internal.check_lock... 2021-06-21T19:37:30.245 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-06-21T19:37:30.275 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-06-21 19:30:55.928560', 'description': '/home/teuthworker/archive/yuriw-2021-06-21_19:20:44-krbd-nautilus-testing-basic-smithi/6182980', 'locked_by': 'scheduled_yuriw@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAINGH5xHt/SLmdhTtryCwQ5q3g7SJcwCk6EouZXTV9rnc', 'os_version': '18.04', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi019.front.sepia.ceph.com'} 2021-06-21T19:37:30.301 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-06-21 19:32:17.586772', 'description': '/home/teuthworker/archive/yuriw-2021-06-21_19:20:44-krbd-nautilus-testing-basic-smithi/6182986', 'locked_by': 'scheduled_yuriw@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDlYV15HlyirTDvgiJ0LMf5V5kyu/v7SKMEZWXXXM9Mz', 'os_version': '18.04', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi114.front.sepia.ceph.com'} 2021-06-21T19:37:30.318 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-06-21 19:30:55.928538', 'description': '/home/teuthworker/archive/yuriw-2021-06-21_19:20:44-krbd-nautilus-testing-basic-smithi/6182980', 'locked_by': 'scheduled_yuriw@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGMOzFmh9PHCb3dOU3c95T9T1xpxkFzwPE4xZDgpWA9o', 'os_version': '18.04', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi116.front.sepia.ceph.com'} 2021-06-21T19:37:30.319 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2021-06-21T19:37:30.335 INFO:teuthology.task.internal:roles: ubuntu@smithi019.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2021-06-21T19:37:30.335 INFO:teuthology.task.internal:roles: ubuntu@smithi114.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2021-06-21T19:37:30.336 INFO:teuthology.task.internal:roles: ubuntu@smithi116.front.sepia.ceph.com - ['client.0'] 2021-06-21T19:37:30.336 INFO:teuthology.run_tasks:Running task console_log... 2021-06-21T19:37:30.536 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f461822e9d8>, signals=[15]) 2021-06-21T19:37:30.553 INFO:teuthology.run_tasks:Running task internal.connect... 2021-06-21T19:37:30.564 INFO:teuthology.task.internal:Opening connections... 2021-06-21T19:37:30.565 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi019.front.sepia.ceph.com 2021-06-21T19:37:30.567 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-06-21T19:37:30.647 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi114.front.sepia.ceph.com 2021-06-21T19:37:30.650 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-06-21T19:37:30.788 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi116.front.sepia.ceph.com 2021-06-21T19:37:30.789 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-06-21T19:37:30.895 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2021-06-21T19:37:30.908 DEBUG:teuthology.orchestra.run.smithi019:> uname -m 2021-06-21T19:37:30.916 INFO:teuthology.orchestra.run.smithi019.stdout:x86_64 2021-06-21T19:37:30.917 DEBUG:teuthology.orchestra.run.smithi019:> cat /etc/os-release 2021-06-21T19:37:30.973 INFO:teuthology.orchestra.run.smithi019.stdout:NAME="Ubuntu" 2021-06-21T19:37:30.973 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2021-06-21T19:37:30.973 INFO:teuthology.orchestra.run.smithi019.stdout:ID=ubuntu 2021-06-21T19:37:30.974 INFO:teuthology.orchestra.run.smithi019.stdout:ID_LIKE=debian 2021-06-21T19:37:30.975 INFO:teuthology.orchestra.run.smithi019.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2021-06-21T19:37:30.976 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION_ID="18.04" 2021-06-21T19:37:30.976 INFO:teuthology.orchestra.run.smithi019.stdout:HOME_URL="https://www.ubuntu.com/" 2021-06-21T19:37:30.976 INFO:teuthology.orchestra.run.smithi019.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-06-21T19:37:30.976 INFO:teuthology.orchestra.run.smithi019.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-06-21T19:37:30.976 INFO:teuthology.orchestra.run.smithi019.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-06-21T19:37:30.977 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION_CODENAME=bionic 2021-06-21T19:37:30.977 INFO:teuthology.orchestra.run.smithi019.stdout:UBUNTU_CODENAME=bionic 2021-06-21T19:37:30.978 INFO:teuthology.lock.ops:Updating smithi019.front.sepia.ceph.com on lock server 2021-06-21T19:37:30.996 DEBUG:teuthology.orchestra.run.smithi114:> uname -m 2021-06-21T19:37:31.010 INFO:teuthology.orchestra.run.smithi114.stdout:x86_64 2021-06-21T19:37:31.010 DEBUG:teuthology.orchestra.run.smithi114:> cat /etc/os-release 2021-06-21T19:37:31.061 INFO:teuthology.orchestra.run.smithi114.stdout:NAME="Ubuntu" 2021-06-21T19:37:31.062 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2021-06-21T19:37:31.062 INFO:teuthology.orchestra.run.smithi114.stdout:ID=ubuntu 2021-06-21T19:37:31.062 INFO:teuthology.orchestra.run.smithi114.stdout:ID_LIKE=debian 2021-06-21T19:37:31.062 INFO:teuthology.orchestra.run.smithi114.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2021-06-21T19:37:31.063 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_ID="18.04" 2021-06-21T19:37:31.063 INFO:teuthology.orchestra.run.smithi114.stdout:HOME_URL="https://www.ubuntu.com/" 2021-06-21T19:37:31.063 INFO:teuthology.orchestra.run.smithi114.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-06-21T19:37:31.063 INFO:teuthology.orchestra.run.smithi114.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-06-21T19:37:31.063 INFO:teuthology.orchestra.run.smithi114.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-06-21T19:37:31.064 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_CODENAME=bionic 2021-06-21T19:37:31.064 INFO:teuthology.orchestra.run.smithi114.stdout:UBUNTU_CODENAME=bionic 2021-06-21T19:37:31.065 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server 2021-06-21T19:37:31.097 DEBUG:teuthology.orchestra.run.smithi116:> uname -m 2021-06-21T19:37:31.104 INFO:teuthology.orchestra.run.smithi116.stdout:x86_64 2021-06-21T19:37:31.105 DEBUG:teuthology.orchestra.run.smithi116:> cat /etc/os-release 2021-06-21T19:37:31.174 INFO:teuthology.orchestra.run.smithi116.stdout:NAME="Ubuntu" 2021-06-21T19:37:31.174 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2021-06-21T19:37:31.174 INFO:teuthology.orchestra.run.smithi116.stdout:ID=ubuntu 2021-06-21T19:37:31.175 INFO:teuthology.orchestra.run.smithi116.stdout:ID_LIKE=debian 2021-06-21T19:37:31.175 INFO:teuthology.orchestra.run.smithi116.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2021-06-21T19:37:31.175 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_ID="18.04" 2021-06-21T19:37:31.175 INFO:teuthology.orchestra.run.smithi116.stdout:HOME_URL="https://www.ubuntu.com/" 2021-06-21T19:37:31.175 INFO:teuthology.orchestra.run.smithi116.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-06-21T19:37:31.176 INFO:teuthology.orchestra.run.smithi116.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-06-21T19:37:31.176 INFO:teuthology.orchestra.run.smithi116.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-06-21T19:37:31.176 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_CODENAME=bionic 2021-06-21T19:37:31.176 INFO:teuthology.orchestra.run.smithi116.stdout:UBUNTU_CODENAME=bionic 2021-06-21T19:37:31.177 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2021-06-21T19:37:31.197 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2021-06-21T19:37:31.218 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2021-06-21T19:37:31.261 INFO:teuthology.task.internal:Checking for old test directory... 2021-06-21T19:37:31.262 DEBUG:teuthology.orchestra.run.smithi019:> test '!' -e /home/ubuntu/cephtest 2021-06-21T19:37:31.267 DEBUG:teuthology.orchestra.run.smithi114:> test '!' -e /home/ubuntu/cephtest 2021-06-21T19:37:31.272 DEBUG:teuthology.orchestra.run.smithi116:> test '!' -e /home/ubuntu/cephtest 2021-06-21T19:37:31.279 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2021-06-21T19:37:31.391 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2021-06-21T19:37:31.391 DEBUG:teuthology.orchestra.run.smithi019:> test -z $(ls -A /var/lib/ceph) 2021-06-21T19:37:31.395 DEBUG:teuthology.orchestra.run.smithi114:> test -z $(ls -A /var/lib/ceph) 2021-06-21T19:37:31.398 DEBUG:teuthology.orchestra.run.smithi116:> test -z $(ls -A /var/lib/ceph) 2021-06-21T19:37:31.407 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2021-06-21T19:37:31.525 INFO:teuthology.run_tasks:Running task kernel... 2021-06-21T19:37:31.642 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'flavor': 'basic', 'kdb': True, 'sha1': '59a52ddbc139cff701898f0e99b06b71bd00b6d2'}, 'mon.c': {'flavor': 'basic', 'kdb': True, 'sha1': '59a52ddbc139cff701898f0e99b06b71bd00b6d2'}, 'mgr.x': {'flavor': 'basic', 'kdb': True, 'sha1': '59a52ddbc139cff701898f0e99b06b71bd00b6d2'}, 'osd.0': {'flavor': 'basic', 'kdb': True, 'sha1': '59a52ddbc139cff701898f0e99b06b71bd00b6d2'}, 'osd.1': {'flavor': 'basic', 'kdb': True, 'sha1': '59a52ddbc139cff701898f0e99b06b71bd00b6d2'}, 'osd.2': {'flavor': 'basic', 'kdb': True, 'sha1': '59a52ddbc139cff701898f0e99b06b71bd00b6d2'}, 'osd.3': {'flavor': 'basic', 'kdb': True, 'sha1': '59a52ddbc139cff701898f0e99b06b71bd00b6d2'}, 'mon.b': {'flavor': 'basic', 'kdb': True, 'sha1': '59a52ddbc139cff701898f0e99b06b71bd00b6d2'}, 'mgr.y': {'flavor': 'basic', 'kdb': True, 'sha1': '59a52ddbc139cff701898f0e99b06b71bd00b6d2'}, 'osd.4': {'flavor': 'basic', 'kdb': True, 'sha1': '59a52ddbc139cff701898f0e99b06b71bd00b6d2'}, 'osd.5': {'flavor': 'basic', 'kdb': True, 'sha1': '59a52ddbc139cff701898f0e99b06b71bd00b6d2'}, 'osd.6': {'flavor': 'basic', 'kdb': True, 'sha1': '59a52ddbc139cff701898f0e99b06b71bd00b6d2'}, 'osd.7': {'flavor': 'basic', 'kdb': True, 'sha1': '59a52ddbc139cff701898f0e99b06b71bd00b6d2'}, 'client.0': {'flavor': 'basic', 'kdb': True, 'sha1': '59a52ddbc139cff701898f0e99b06b71bd00b6d2'}} 2021-06-21T19:37:31.643 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'basic', 'kdb': True, 'sha1': '59a52ddbc139cff701898f0e99b06b71bd00b6d2'}, 'mon.b': {'flavor': 'basic', 'kdb': True, 'sha1': '59a52ddbc139cff701898f0e99b06b71bd00b6d2'}, 'client.0': {'flavor': 'basic', 'kdb': True, 'sha1': '59a52ddbc139cff701898f0e99b06b71bd00b6d2'}}, timeout 300 2021-06-21T19:37:31.644 DEBUG:teuthology.orchestra.run.smithi019:> sudo lsb_release -is 2021-06-21T19:37:31.703 INFO:teuthology.orchestra.run.smithi019.stdout:Ubuntu 2021-06-21T19:37:31.709 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-06-21T19:37:31.709 DEBUG:teuthology.task.kernel:sha1 for mon.a is 59a52ddbc139cff701898f0e99b06b71bd00b6d2 2021-06-21T19:37:31.710 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "59a52ddbc139cff701898f0e99b06b71bd00b6d2"... 2021-06-21T19:37:31.710 DEBUG:teuthology.orchestra.run.smithi019:> uname -r 2021-06-21T19:37:31.758 INFO:teuthology.orchestra.run.smithi019.stdout:4.15.0-136-generic 2021-06-21T19:37:31.759 DEBUG:teuthology.task.kernel:current kernel version is 4.15.0-136-generic vs 59a52ddbc139cff701898f0e99b06b71bd00b6d2 2021-06-21T19:37:31.760 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2021-06-21T19:37:31.760 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=59a52ddbc139cff701898f0e99b06b71bd00b6d2 2021-06-21T19:37:31.919 DEBUG:teuthology.orchestra.run.smithi114:> sudo lsb_release -is 2021-06-21T19:37:31.972 INFO:teuthology.orchestra.run.smithi114.stdout:Ubuntu 2021-06-21T19:37:31.979 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-06-21T19:37:31.981 DEBUG:teuthology.task.kernel:sha1 for mon.b is 59a52ddbc139cff701898f0e99b06b71bd00b6d2 2021-06-21T19:37:31.981 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "59a52ddbc139cff701898f0e99b06b71bd00b6d2"... 2021-06-21T19:37:31.982 DEBUG:teuthology.orchestra.run.smithi114:> uname -r 2021-06-21T19:37:31.990 INFO:teuthology.orchestra.run.smithi114.stdout:4.15.0-136-generic 2021-06-21T19:37:31.990 DEBUG:teuthology.task.kernel:current kernel version is 4.15.0-136-generic vs 59a52ddbc139cff701898f0e99b06b71bd00b6d2 2021-06-21T19:37:31.991 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2021-06-21T19:37:31.991 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=59a52ddbc139cff701898f0e99b06b71bd00b6d2 2021-06-21T19:37:32.150 DEBUG:teuthology.orchestra.run.smithi116:> sudo lsb_release -is 2021-06-21T19:37:32.201 INFO:teuthology.orchestra.run.smithi116.stdout:Ubuntu 2021-06-21T19:37:32.204 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-06-21T19:37:32.206 DEBUG:teuthology.task.kernel:sha1 for client.0 is 59a52ddbc139cff701898f0e99b06b71bd00b6d2 2021-06-21T19:37:32.206 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "59a52ddbc139cff701898f0e99b06b71bd00b6d2"... 2021-06-21T19:37:32.206 DEBUG:teuthology.orchestra.run.smithi116:> uname -r 2021-06-21T19:37:32.213 INFO:teuthology.orchestra.run.smithi116.stdout:4.15.0-136-generic 2021-06-21T19:37:32.213 DEBUG:teuthology.task.kernel:current kernel version is 4.15.0-136-generic vs 59a52ddbc139cff701898f0e99b06b71bd00b6d2 2021-06-21T19:37:32.214 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2021-06-21T19:37:32.214 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=59a52ddbc139cff701898f0e99b06b71bd00b6d2 2021-06-21T19:37:32.368 INFO:teuthology.task.kernel:Installing linux-firmware on mon.a... 2021-06-21T19:37:32.369 DEBUG:teuthology.orchestra.run.smithi019:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2021-06-21T19:37:32.400 INFO:teuthology.orchestra.run.smithi019.stdout:Reinitialized existing Git repository in /lib/firmware/updates/.git/ 2021-06-21T19:37:32.401 DEBUG:teuthology.orchestra.run.smithi019:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2021-06-21T19:37:32.479 DEBUG:teuthology.orchestra.run.smithi019:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2021-06-21T19:37:32.539 DEBUG:teuthology.orchestra.run.smithi019:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/master 2021-06-21T19:38:05.745 INFO:teuthology.orchestra.run.smithi019.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2021-06-21T19:38:05.745 INFO:teuthology.orchestra.run.smithi019.stderr: * [new branch] main -> origin/main 2021-06-21T19:38:05.745 INFO:teuthology.orchestra.run.smithi019.stderr: * [new branch] master -> origin/master 2021-06-21T19:38:06.134 INFO:teuthology.orchestra.run.smithi019.stdout:HEAD is now at 0f66b74 cypress: update firmware for cyw54591 pcie 2021-06-21T19:38:06.135 INFO:teuthology.task.kernel:Installing linux-firmware on mon.b... 2021-06-21T19:38:06.136 DEBUG:teuthology.orchestra.run.smithi114:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2021-06-21T19:38:06.152 INFO:teuthology.orchestra.run.smithi114.stderr:bash: line 0: cd: /lib/firmware/updates: No such file or directory 2021-06-21T19:38:06.326 INFO:teuthology.orchestra.run.smithi114.stdout:Initialized empty Git repository in /lib/firmware/updates/.git/ 2021-06-21T19:38:06.326 DEBUG:teuthology.orchestra.run.smithi114:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2021-06-21T19:38:06.416 DEBUG:teuthology.orchestra.run.smithi114:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2021-06-21T19:38:06.493 DEBUG:teuthology.orchestra.run.smithi114:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/master 2021-06-21T19:38:42.421 INFO:teuthology.orchestra.run.smithi114.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2021-06-21T19:38:42.421 INFO:teuthology.orchestra.run.smithi114.stderr: * [new branch] main -> origin/main 2021-06-21T19:38:42.422 INFO:teuthology.orchestra.run.smithi114.stderr: * [new branch] master -> origin/master 2021-06-21T19:38:42.453 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20190312 -> 20190312 2021-06-21T19:38:42.453 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20190416 -> 20190416 2021-06-21T19:38:42.454 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20190514 -> 20190514 2021-06-21T19:38:42.454 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20190618 -> 20190618 2021-06-21T19:38:42.454 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20190717 -> 20190717 2021-06-21T19:38:42.454 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20190815 -> 20190815 2021-06-21T19:38:42.454 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20190923 -> 20190923 2021-06-21T19:38:42.455 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20191022 -> 20191022 2021-06-21T19:38:42.455 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20191215 -> 20191215 2021-06-21T19:38:42.456 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20200122 -> 20200122 2021-06-21T19:38:42.456 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20200316 -> 20200316 2021-06-21T19:38:42.456 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20200421 -> 20200421 2021-06-21T19:38:42.456 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20200519 -> 20200519 2021-06-21T19:38:42.457 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20200619 -> 20200619 2021-06-21T19:38:42.457 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20200721 -> 20200721 2021-06-21T19:38:42.457 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20200817 -> 20200817 2021-06-21T19:38:42.458 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20200918 -> 20200918 2021-06-21T19:38:42.458 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20201022 -> 20201022 2021-06-21T19:38:42.458 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20201118 -> 20201118 2021-06-21T19:38:42.458 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20201218 -> 20201218 2021-06-21T19:38:42.459 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20210208 -> 20210208 2021-06-21T19:38:42.459 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20210315 -> 20210315 2021-06-21T19:38:42.459 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20210511 -> 20210511 2021-06-21T19:38:44.826 INFO:teuthology.orchestra.run.smithi114.stderr:Checking out files: 52% (1308/2498) Checking out files: 53% (1324/2498) Checking out files: 54% (1349/2498) Checking out files: 55% (1374/2498) Checking out files: 56% (1399/2498) Checking out files: 57% (1424/2498) Checking out files: 58% (1449/2498) Checking out files: 59% (1474/2498) Checking out files: 60% (1499/2498) Checking out files: 61% (1524/2498) Checking out files: 62% (1549/2498) Checking out files: 63% (1574/2498) Checking out files: 64% (1599/2498) Checking out files: 65% (1624/2498) Checking out files: 66% (1649/2498) Checking out files: 67% (1674/2498) Checking out files: 68% (1699/2498) Checking out files: 69% (1724/2498) Checking out files: 70% (1749/2498) Checking out files: 71% (1774/2498) Checking out files: 72% (1799/2498) Checking out files: 73% (1824/2498) Checking out files: 74% (1849/2498) Checking out files: 75% (1874/2498) Checking out files: 76% (1899/2498) Checking out files: 76% (1920/2498) Checking out files: 77% (1924/2498) Checking out files: 78% (1949/2498) Checking out files: 79% (1974/2498) Checking out files: 80% (1999/2498) Checking out files: 81% (2024/2498) Checking out files: 82% (2049/2498) Checking out files: 83% (2074/2498) Checking out files: 84% (2099/2498) Checking out files: 85% (2124/2498) Checking out files: 86% (2149/2498) Checking out files: 87% (2174/2498) Checking out files: 88% (2199/2498) Checking out files: 89% (2224/2498) Checking out files: 90% (2249/2498) Checking out files: 91% (2274/2498) Checking out files: 92% (2299/2498) Checking out files: 93% (2324/2498) Checking out files: 94% (2349/2498) Checking out files: 95% (2374/2498) Checking out files: 96% (2399/2498) Checking out files: 97% (2424/2498) Checking out files: 98% (2449/2498) Checking out files: 99% (2474/2498) Checking out files: 100% (2498/2498) Checking out files: 100% (2498/2498), done. 2021-06-21T19:38:44.828 INFO:teuthology.orchestra.run.smithi114.stdout:HEAD is now at 0f66b74 cypress: update firmware for cyw54591 pcie 2021-06-21T19:38:44.839 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2021-06-21T19:38:44.840 DEBUG:teuthology.orchestra.run.smithi116:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2021-06-21T19:38:44.966 INFO:teuthology.orchestra.run.smithi116.stderr:bash: line 0: cd: /lib/firmware/updates: No such file or directory 2021-06-21T19:38:45.147 INFO:teuthology.orchestra.run.smithi116.stdout:Initialized empty Git repository in /lib/firmware/updates/.git/ 2021-06-21T19:38:45.149 DEBUG:teuthology.orchestra.run.smithi116:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2021-06-21T19:38:45.187 DEBUG:teuthology.orchestra.run.smithi116:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2021-06-21T19:38:45.246 DEBUG:teuthology.orchestra.run.smithi116:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/master 2021-06-21T19:39:18.316 INFO:teuthology.orchestra.run.smithi116.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2021-06-21T19:39:18.317 INFO:teuthology.orchestra.run.smithi116.stderr: * [new branch] main -> origin/main 2021-06-21T19:39:18.317 INFO:teuthology.orchestra.run.smithi116.stderr: * [new branch] master -> origin/master 2021-06-21T19:39:18.351 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20190312 -> 20190312 2021-06-21T19:39:18.352 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20190416 -> 20190416 2021-06-21T19:39:18.352 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20190514 -> 20190514 2021-06-21T19:39:18.353 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20190618 -> 20190618 2021-06-21T19:39:18.353 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20190717 -> 20190717 2021-06-21T19:39:18.353 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20190815 -> 20190815 2021-06-21T19:39:18.353 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20190923 -> 20190923 2021-06-21T19:39:18.354 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20191022 -> 20191022 2021-06-21T19:39:18.354 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20191215 -> 20191215 2021-06-21T19:39:18.354 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20200122 -> 20200122 2021-06-21T19:39:18.354 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20200316 -> 20200316 2021-06-21T19:39:18.354 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20200421 -> 20200421 2021-06-21T19:39:18.355 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20200519 -> 20200519 2021-06-21T19:39:18.355 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20200619 -> 20200619 2021-06-21T19:39:18.355 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20200721 -> 20200721 2021-06-21T19:39:18.355 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20200817 -> 20200817 2021-06-21T19:39:18.356 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20200918 -> 20200918 2021-06-21T19:39:18.356 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20201022 -> 20201022 2021-06-21T19:39:18.356 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20201118 -> 20201118 2021-06-21T19:39:18.356 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20201218 -> 20201218 2021-06-21T19:39:18.356 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20210208 -> 20210208 2021-06-21T19:39:18.357 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20210315 -> 20210315 2021-06-21T19:39:18.357 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20210511 -> 20210511 2021-06-21T19:39:20.832 INFO:teuthology.orchestra.run.smithi116.stderr:Checking out files: 51% (1282/2498) Checking out files: 52% (1299/2498) Checking out files: 53% (1324/2498) Checking out files: 54% (1349/2498) Checking out files: 55% (1374/2498) Checking out files: 56% (1399/2498) Checking out files: 57% (1424/2498) Checking out files: 58% (1449/2498) Checking out files: 59% (1474/2498) Checking out files: 60% (1499/2498) Checking out files: 61% (1524/2498) Checking out files: 62% (1549/2498) Checking out files: 63% (1574/2498) Checking out files: 64% (1599/2498) Checking out files: 65% (1624/2498) Checking out files: 66% (1649/2498) Checking out files: 67% (1674/2498) Checking out files: 68% (1699/2498) Checking out files: 69% (1724/2498) Checking out files: 70% (1749/2498) Checking out files: 71% (1774/2498) Checking out files: 72% (1799/2498) Checking out files: 73% (1824/2498) Checking out files: 74% (1849/2498) Checking out files: 75% (1874/2498) Checking out files: 76% (1899/2498) Checking out files: 76% (1911/2498) Checking out files: 77% (1924/2498) Checking out files: 78% (1949/2498) Checking out files: 79% (1974/2498) Checking out files: 80% (1999/2498) Checking out files: 81% (2024/2498) Checking out files: 82% (2049/2498) Checking out files: 83% (2074/2498) Checking out files: 84% (2099/2498) Checking out files: 85% (2124/2498) Checking out files: 86% (2149/2498) Checking out files: 87% (2174/2498) Checking out files: 88% (2199/2498) Checking out files: 89% (2224/2498) Checking out files: 90% (2249/2498) Checking out files: 91% (2274/2498) Checking out files: 92% (2299/2498) Checking out files: 93% (2324/2498) Checking out files: 94% (2349/2498) Checking out files: 95% (2374/2498) Checking out files: 96% (2399/2498) Checking out files: 97% (2424/2498) Checking out files: 98% (2449/2498) Checking out files: 99% (2474/2498) Checking out files: 100% (2498/2498) Checking out files: 100% (2498/2498), done. 2021-06-21T19:39:20.834 INFO:teuthology.orchestra.run.smithi116.stdout:HEAD is now at 0f66b74 cypress: update firmware for cyw54591 pcie 2021-06-21T19:39:20.846 INFO:teuthology.task.kernel:Downloading kernel 59a52ddbc139cff701898f0e99b06b71bd00b6d2 on mon.a... 2021-06-21T19:39:20.846 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-06-21T19:39:20.847 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-06-21T19:39:23.915 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.19 2021-06-21T19:39:23.916 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/run_tasks.py", line 91, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/run_tasks.py", line 70, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/task/kernel.py", line 1338, in task download_kernel(ctx, need_install) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/task/kernel.py", line 373, in download_kernel remote=role_remote, File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/packaging.py", line 853, in __init__ super(ShamanProject, self).__init__(project, job_config, ctx, remote) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/packaging.py", line 460, in __init__ self._init_from_remote() File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/packaging.py", line 474, in _init_from_remote self.pkg_type = self.remote.system_type File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/orchestra/remote.py", line 488, in system_type return misc.get_system_type(self) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/misc.py", line 1185, in get_system_type system_value = remote.sh('sudo lsb_release -is').strip() File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/orchestra/remote.py", line 96, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/orchestra/remote.py", line 509, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/orchestra/run.py", line 438, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi019 was lost: 'sudo lsb_release -is' 2021-06-21T19:39:24.015 ERROR:teuthology.run_tasks: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=5fa6853f204a48db840dc38e21a10108 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/run_tasks.py", line 91, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/run_tasks.py", line 70, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/task/kernel.py", line 1338, in task download_kernel(ctx, need_install) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/task/kernel.py", line 373, in download_kernel remote=role_remote, File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/packaging.py", line 853, in __init__ super(ShamanProject, self).__init__(project, job_config, ctx, remote) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/packaging.py", line 460, in __init__ self._init_from_remote() File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/packaging.py", line 474, in _init_from_remote self.pkg_type = self.remote.system_type File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/orchestra/remote.py", line 488, in system_type return misc.get_system_type(self) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/misc.py", line 1185, in get_system_type system_value = remote.sh('sudo lsb_release -is').strip() File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/orchestra/remote.py", line 96, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/orchestra/remote.py", line 509, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/orchestra/run.py", line 438, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi019 was lost: 'sudo lsb_release -is' 2021-06-21T19:39:24.019 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2021-06-21T19:39:24.189 INFO:teuthology.nuke:Checking targets against current locks 2021-06-21T19:39:24.282 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/virtualenv/bin/teuthology", line 33, in sys.exit(load_entry_point('teuthology', 'console_scripts', 'teuthology')()) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/scripts/run.py", line 38, in main teuthology.run.main(args) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/run.py", line 414, in main report_outcome(config, archive, fake_ctx.summary, fake_ctx) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/run.py", line 271, in report_outcome nuke(fake_ctx, fake_ctx.lock) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/nuke/__init__.py", line 250, in nuke if ctx.name not in lock['description']: TypeError: argument of type 'NoneType' is not iterable