2021-09-29T09:24:37.254 INFO:root:teuthology version: 1.1.0-f08b273e
2021-09-29T09:24:37.363 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi022.front.sepia.ceph.com' reimaging
2021-09-29T09:24:37.364 INFO:teuthology.lock.ops:Updating [ubuntu@smithi022.front.sepia.ceph.com]: reset os type and version on server
2021-09-29T09:24:37.364 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server
2021-09-29T09:24:37.383 INFO:teuthology.lock.ops:Node 'ubuntu@smithi022.front.sepia.ceph.com' reimaging is complete
2021-09-29T09:24:37.386 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi157.front.sepia.ceph.com' reimaging
2021-09-29T09:24:37.386 INFO:teuthology.lock.ops:Updating [ubuntu@smithi157.front.sepia.ceph.com]: reset os type and version on server
2021-09-29T09:24:37.387 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server
2021-09-29T09:24:37.407 INFO:teuthology.lock.ops:Node 'ubuntu@smithi157.front.sepia.ceph.com' reimaging is complete
2021-09-29T09:24:37.596 INFO:teuthology.provision.fog.smithi022:Scheduling deploy of centos 8.3
2021-09-29T09:24:37.615 INFO:teuthology.provision.fog.smithi157:Scheduling deploy of centos 8.3
2021-09-29T09:24:38.063 INFO:teuthology.orchestra.console:Power off smithi022
2021-09-29T09:24:38.102 INFO:teuthology.orchestra.console:Power off smithi157
2021-09-29T09:24:38.213 INFO:teuthology.orchestra.console:Power off for smithi022 completed
2021-09-29T09:24:38.245 INFO:teuthology.orchestra.console:Power off for smithi157 completed
2021-09-29T09:24:38.314 INFO:teuthology.orchestra.console:Power on smithi022
2021-09-29T09:24:38.346 INFO:teuthology.orchestra.console:Power on smithi157
2021-09-29T09:24:42.570 INFO:teuthology.orchestra.console:Power on for smithi022 completed
2021-09-29T09:24:42.671 INFO:teuthology.provision.fog.smithi022:Waiting for deploy to finish
2021-09-29T09:24:46.717 INFO:teuthology.orchestra.console:Power on for smithi157 completed
2021-09-29T09:24:46.818 INFO:teuthology.provision.fog.smithi157:Waiting for deploy to finish
2021-09-29T09:29:24.333 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-09-29T09:29:24.665 INFO:teuthology.provision.fog.smithi022:Node is ready
2021-09-29T09:29:24.681 INFO:teuthology.orchestra.run.smithi022.stdout:smithi022.front.sepia.ceph.com
2021-09-29T09:29:24.737 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022
2021-09-29T09:29:25.080 INFO:teuthology.provision.fog.smithi022:Deploy complete!
2021-09-29T09:30:07.744 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-09-29T09:30:08.094 INFO:teuthology.provision.fog.smithi157:Node is ready
2021-09-29T09:30:08.110 INFO:teuthology.orchestra.run.smithi157.stdout:smithi157.front.sepia.ceph.com
2021-09-29T09:30:08.166 INFO:teuthology.orchestra.run.smithi157.stdout:172.21.15.157 smithi157.front.sepia.ceph.com smithi157
2021-09-29T09:30:08.495 INFO:teuthology.provision.fog.smithi157:Deploy complete!
2021-09-29T09:30:08.642 INFO:teuthology.lock.ops:Checking smithi022.front.sepia.ceph.com
2021-09-29T09:30:08.643 INFO:teuthology.lock.ops:New key found. Updating...
2021-09-29T09:30:08.663 INFO:teuthology.lock.ops:Checking smithi157.front.sepia.ceph.com
2021-09-29T09:30:08.663 INFO:teuthology.lock.ops:New key found. Updating...
2021-09-29T09:30:08.681 INFO:teuthology.lock.ops:Updating [smithi022.front.sepia.ceph.com]: set os type and version on server
2021-09-29T09:30:08.682 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com'
2021-09-29T09:30:08.961 INFO:teuthology.orchestra.run.smithi022.stdout:x86_64
2021-09-29T09:30:09.016 INFO:teuthology.orchestra.run.smithi022.stdout:NAME="CentOS Linux"
2021-09-29T09:30:09.017 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION="8"
2021-09-29T09:30:09.017 INFO:teuthology.orchestra.run.smithi022.stdout:ID="centos"
2021-09-29T09:30:09.017 INFO:teuthology.orchestra.run.smithi022.stdout:ID_LIKE="rhel fedora"
2021-09-29T09:30:09.017 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_ID="8"
2021-09-29T09:30:09.018 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM_ID="platform:el8"
2021-09-29T09:30:09.018 INFO:teuthology.orchestra.run.smithi022.stdout:PRETTY_NAME="CentOS Linux 8"
2021-09-29T09:30:09.018 INFO:teuthology.orchestra.run.smithi022.stdout:ANSI_COLOR="0;31"
2021-09-29T09:30:09.018 INFO:teuthology.orchestra.run.smithi022.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-09-29T09:30:09.019 INFO:teuthology.orchestra.run.smithi022.stdout:HOME_URL="https://centos.org/"
2021-09-29T09:30:09.019 INFO:teuthology.orchestra.run.smithi022.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-09-29T09:30:09.019 INFO:teuthology.orchestra.run.smithi022.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-09-29T09:30:09.019 INFO:teuthology.orchestra.run.smithi022.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-09-29T09:30:09.021 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server
2021-09-29T09:30:09.038 INFO:teuthology.lock.ops:Updating [smithi157.front.sepia.ceph.com]: set os type and version on server
2021-09-29T09:30:09.039 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com'
2021-09-29T09:30:09.294 INFO:teuthology.orchestra.run.smithi157.stdout:x86_64
2021-09-29T09:30:09.348 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="CentOS Linux"
2021-09-29T09:30:09.348 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="8"
2021-09-29T09:30:09.349 INFO:teuthology.orchestra.run.smithi157.stdout:ID="centos"
2021-09-29T09:30:09.349 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="rhel fedora"
2021-09-29T09:30:09.349 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="8"
2021-09-29T09:30:09.349 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el8"
2021-09-29T09:30:09.350 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="CentOS Linux 8"
2021-09-29T09:30:09.350 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31"
2021-09-29T09:30:09.350 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-09-29T09:30:09.350 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://centos.org/"
2021-09-29T09:30:09.351 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-09-29T09:30:09.351 INFO:teuthology.orchestra.run.smithi157.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-09-29T09:30:09.351 INFO:teuthology.orchestra.run.smithi157.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-09-29T09:30:09.352 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server
2021-09-29T09:30:09.439 INFO:teuthology.dispatcher.supervisor:Running job 6413347
2021-09-29T09:30:09.439 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_f08b273eeec75318a83a4e8d7fb51841e4d71be0/virtualenv/bin/teuthology -v --owner scheduled_rzarzynski@teuthology --archive /home/teuthworker/archive/rzarzynski-2021-09-29_09:20:21-rados-master-distro-basic-smithi/6413347 --name rzarzynski-2021-09-29_09:20:21-rados-master-distro-basic-smithi --description rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/small-objects-balanced} -- /home/teuthworker/archive/rzarzynski-2021-09-29_09:20:21-rados-master-distro-basic-smithi/6413347/orig.config.yaml
2021-09-29T09:30:09.442 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rzarzynski-2021-09-29_09:20:21-rados-master-distro-basic-smithi/6413347
2021-09-29T09:30:09.443 INFO:teuthology.dispatcher.supervisor:Job PID: 8885
2021-09-29T09:30:09.443 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-09-29T16:56:39.303 ERROR:teuthology.report:POST to http://paddles.front.sepia.ceph.com/runs/rzarzynski-2021-09-29_09:20:21-rados-master-distro-basic-smithi/jobs/ failed with status 500: A server error occurred.  Please contact the administrator.
2021-09-29T21:31:00.533 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-09-29T21:31:00.732 INFO:teuthology.kill:Killing Pids: {8885}
2021-09-29T21:31:02.501 INFO:teuthology.task.internal:roles: ubuntu@smithi022.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a']
2021-09-29T21:31:02.502 INFO:teuthology.task.internal:roles: ubuntu@smithi157.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']
2021-09-29T21:31:02.502 INFO:teuthology.misc:Compressing logs...
2021-09-29T21:31:02.503 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com'
2021-09-29T21:31:02.720 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com'
2021-09-29T21:31:03.153 INFO:teuthology.misc:Compressing logs...
2021-09-29T21:31:04.263 INFO:teuthology.orchestra.run.smithi157.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2021-09-29T21:31:04.333 INFO:teuthology.orchestra.run.smithi022.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2021-09-29T22:19:59.676 INFO:teuthology.misc:Compressing logs...
2021-09-29T22:20:17.448 INFO:teuthology.orchestra.run.smithi022.stderr:gzip: /var/log/ceph/ceph-client.0.38115.log: file size changed while zipping
2021-09-29T22:20:32.429 INFO:teuthology.kill:No teuthology processes running
2021-09-29T22:20:33.616 INFO:teuthology.kill:Nuking machines: ['smithi022', 'smithi157']
2021-09-29T22:20:34.578 INFO:teuthology.kill:2021-09-29 22:20:34,577.577 INFO:teuthology.nuke:targets:
2021-09-29T22:20:34.579 INFO:teuthology.kill:  smithi022.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDHm4cdvUb8YpGLAraaQmM8KSQ62BSVfbva5DvP72+WTY0APkMyEeQH1JfGaSgTbObm+dKuD427tJAGiMn3Huojhf5zC7bmPOkol7KlGkiIBmIGLIscOxXwWyEgzlbL5BJ73WB0M+6m8Bq2HJYfuEIajO0f8dRQM9O+fAfwu0Vuhw1/DrHhXU8gXl12PyXwmuEo6kJHLWTh1bHD4fa2SwRi6e2A2iSCJqeEuY3hYwcxG/1ZEoSX1n9spjrqtvPnCMn9UjWo+xNz854w3FEv3DvmWv9hmJPfZsgPD+ZTU+5z6x2lqc9OlumFxBtyBY5QvbhGTFLdtOkwsw+RM33h7VquEXf9Wm+I/xGZqYzIdHDhxX335FrPoByXGCOKrwaxNxrhwuufiABD2hDXAeaokxvsbaOeOGVF4NUuqRqgSF0Y0n+VD/XoXJtMSMgxxLgVyqRbzg1BaD7WN2dDckPLHgIvL6eU+PcDczWIDA8yzX90/V5kVGVpzxp/e+9RyTcJljc=
2021-09-29T22:20:34.579 INFO:teuthology.kill:  smithi157.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDOXUD5tpgAoVStut0TTAtpOmky2AXeGzpSK70QlQzXoF7egyo8X5/DHhn7PHg6XQhZc5IcM2z+cj24SpAk93ttQYMNHYR1tihOVmYb32visujhr8NgsAa2UBIHhr1sUvCTpgBMJjxOtO83U5wB9lHo+AKNzJB/FjUTc1zAGJcObZxLGds285xB/odIcI8tzV68fXEK1//3m8ypQNb6ZMhfm2d58J3K4TsD1jX7e1ODc4Rn4kZS52a2WUa3E9NfUov3MTs3zaVFc6qf1EcW3IGmTE/OSz1ltMKQztVImlgzJjz5wq8VFwYMB6fS6KVRBD4aVa4CwMn3Nz187e8UTv0yu2ToyKjgBP79Sz89eNylIuM4aLDBSob3hu2AB7nrrFBsUfW6Lt/+6hpR4LwAA5QFCCw7zBZLgqnjPGUW8wPFj49E1kxl697vnrqXvKCXb0ls3HZy4qU/VZA8cwFsxNKOwIB6LzSjaDH8/aPCNoOTBTAGRfwIYJpZllQKZCFV5Kk=
2021-09-29T22:20:34.604 INFO:teuthology.kill:2021-09-29 22:20:34,604.604 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-09-29T22:20:34.608 INFO:teuthology.kill:2021-09-29 22:20:34,607.607 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-09-29T22:20:34.676 INFO:teuthology.kill:2021-09-29 22:20:34,675.675 INFO:teuthology.orchestra.console:Power off smithi157
2021-09-29T22:20:34.691 INFO:teuthology.kill:2021-09-29 22:20:34,691.691 INFO:teuthology.orchestra.console:Power off smithi022
2021-09-29T22:20:43.051 INFO:teuthology.kill:2021-09-29 22:20:43,050.050 INFO:teuthology.orchestra.console:Power off for smithi157 completed
2021-09-29T22:20:43.197 INFO:teuthology.kill:2021-09-29 22:20:43,196.196 INFO:teuthology.lock.ops:unlocked: smithi157.front.sepia.ceph.com
2021-09-29T22:20:47.167 INFO:teuthology.kill:2021-09-29 22:20:47,167.167 INFO:teuthology.orchestra.console:Power off for smithi022 completed
2021-09-29T22:20:47.313 INFO:teuthology.kill:2021-09-29 22:20:47,313.313 INFO:teuthology.lock.ops:unlocked: smithi022.front.sepia.ceph.com
2021-09-29T22:22:52.597 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-09-29T22:22:52.703 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2021-09-29T22:22:52.704 INFO:teuthology.nuke:Checking targets against current locks
2021-09-29T22:22:52.830 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f08b273eeec75318a83a4e8d7fb51841e4d71be0/virtualenv/bin/teuthology-dispatcher", line 33, in <module>
    sys.exit(load_entry_point('teuthology', 'console_scripts', 'teuthology-dispatcher')())
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f08b273eeec75318a83a4e8d7fb51841e4d71be0/scripts/dispatcher.py", line 33, in main
    teuthology.dispatcher.main(args)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f08b273eeec75318a83a4e8d7fb51841e4d71be0/teuthology/dispatcher/__init__.py", line 61, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f08b273eeec75318a83a4e8d7fb51841e4d71be0/teuthology/dispatcher/supervisor.py", line 59, in main
    verbose
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f08b273eeec75318a83a4e8d7fb51841e4d71be0/teuthology/dispatcher/supervisor.py", line 152, in run_job
    unlock_targets(job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f08b273eeec75318a83a4e8d7fb51841e4d71be0/teuthology/dispatcher/supervisor.py", line 196, in unlock_targets
    nuke(fake_ctx, True)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f08b273eeec75318a83a4e8d7fb51841e4d71be0/teuthology/nuke/__init__.py", line 250, in nuke
    if ctx.name not in lock['description']:
TypeError: argument of type 'NoneType' is not iterable