2021-03-22T13:05:31.363 INFO:root:teuthology version: 1.1.0-6b3150e9
2021-03-22T13:05:31.489 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi013.front.sepia.ceph.com' reimaging
2021-03-22T13:05:31.490 INFO:teuthology.lock.ops:Updating [ubuntu@smithi013.front.sepia.ceph.com]: reset os type and version on server
2021-03-22T13:05:31.490 INFO:teuthology.lock.ops:Updating smithi013.front.sepia.ceph.com on lock server
2021-03-22T13:05:31.505 INFO:teuthology.lock.ops:Node 'ubuntu@smithi013.front.sepia.ceph.com' reimaging is complete
2021-03-22T13:05:31.505 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi117.front.sepia.ceph.com' reimaging
2021-03-22T13:05:31.506 INFO:teuthology.lock.ops:Updating [ubuntu@smithi117.front.sepia.ceph.com]: reset os type and version on server
2021-03-22T13:05:31.506 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server
2021-03-22T13:05:31.519 INFO:teuthology.lock.ops:Node 'ubuntu@smithi117.front.sepia.ceph.com' reimaging is complete
2021-03-22T13:05:31.519 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi180.front.sepia.ceph.com' reimaging
2021-03-22T13:05:31.519 INFO:teuthology.lock.ops:Updating [ubuntu@smithi180.front.sepia.ceph.com]: reset os type and version on server
2021-03-22T13:05:31.519 INFO:teuthology.lock.ops:Updating smithi180.front.sepia.ceph.com on lock server
2021-03-22T13:05:31.533 INFO:teuthology.lock.ops:Node 'ubuntu@smithi180.front.sepia.ceph.com' reimaging is complete
2021-03-22T13:05:31.706 INFO:teuthology.provision.fog.smithi013:Scheduling deploy of centos 8.2
2021-03-22T13:05:31.713 INFO:teuthology.provision.fog.smithi117:Scheduling deploy of centos 8.2
2021-03-22T13:05:31.727 INFO:teuthology.provision.fog.smithi180:Scheduling deploy of centos 8.2
2021-03-22T13:05:32.041 INFO:teuthology.orchestra.console:Power off smithi117
2021-03-22T13:05:32.058 INFO:teuthology.orchestra.console:Power off smithi180
2021-03-22T13:05:32.069 INFO:teuthology.orchestra.console:Power off smithi013
2021-03-22T13:05:32.211 INFO:teuthology.orchestra.console:Power off for smithi117 completed
2021-03-22T13:05:32.216 INFO:teuthology.orchestra.console:Power off for smithi180 completed
2021-03-22T13:05:32.312 INFO:teuthology.orchestra.console:Power on smithi117
2021-03-22T13:05:32.320 INFO:teuthology.orchestra.console:Power on smithi180
2021-03-22T13:05:40.674 INFO:teuthology.orchestra.console:Power on for smithi117 completed
2021-03-22T13:05:40.686 INFO:teuthology.orchestra.console:Power on for smithi180 completed
2021-03-22T13:05:40.775 INFO:teuthology.provision.fog.smithi117:Waiting for deploy to finish
2021-03-22T13:05:40.788 INFO:teuthology.provision.fog.smithi180:Waiting for deploy to finish
2021-03-22T13:05:44.565 INFO:teuthology.orchestra.console:Power off for smithi013 completed
2021-03-22T13:05:44.666 INFO:teuthology.orchestra.console:Power on smithi013
2021-03-22T13:05:48.919 INFO:teuthology.orchestra.console:Power on for smithi013 completed
2021-03-22T13:05:49.020 INFO:teuthology.provision.fog.smithi013:Waiting for deploy to finish
2021-03-22T13:09:53.788 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-03-22T13:09:54.116 INFO:teuthology.provision.fog.smithi013:Node is ready
2021-03-22T13:09:54.160 INFO:teuthology.orchestra.run.smithi013.stdout:smithi013.front.sepia.ceph.com
2021-03-22T13:09:54.215 INFO:teuthology.orchestra.run.smithi013.stdout:172.21.15.13 smithi013.front.sepia.ceph.com smithi013
2021-03-22T13:09:54.560 INFO:teuthology.provision.fog.smithi013:Deploy complete!
2021-03-22T13:10:09.834 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-03-22T13:10:10.047 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-03-22T13:10:10.125 INFO:teuthology.provision.fog.smithi117:Node is ready
2021-03-22T13:10:10.140 INFO:teuthology.orchestra.run.smithi117.stdout:smithi117.front.sepia.ceph.com
2021-03-22T13:10:10.199 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117 smithi117.front.sepia.ceph.com smithi117
2021-03-22T13:10:10.358 INFO:teuthology.provision.fog.smithi180:Node is ready
2021-03-22T13:10:10.375 INFO:teuthology.orchestra.run.smithi180.stdout:smithi180.front.sepia.ceph.com
2021-03-22T13:10:10.431 INFO:teuthology.orchestra.run.smithi180.stdout:172.21.15.180 smithi180.front.sepia.ceph.com smithi180
2021-03-22T13:10:10.544 INFO:teuthology.provision.fog.smithi117:Deploy complete!
2021-03-22T13:10:10.761 INFO:teuthology.provision.fog.smithi180:Deploy complete!
2021-03-22T13:10:10.920 INFO:teuthology.lock.ops:Checking smithi013.front.sepia.ceph.com
2021-03-22T13:10:10.921 INFO:teuthology.lock.ops:New key found. Updating...
2021-03-22T13:10:10.937 INFO:teuthology.lock.ops:Checking smithi117.front.sepia.ceph.com
2021-03-22T13:10:10.937 INFO:teuthology.lock.ops:New key found. Updating...
2021-03-22T13:10:10.949 INFO:teuthology.lock.ops:Checking smithi180.front.sepia.ceph.com
2021-03-22T13:10:10.949 INFO:teuthology.lock.ops:New key found. Updating...
2021-03-22T13:10:10.963 INFO:teuthology.lock.ops:Updating [smithi013.front.sepia.ceph.com]: set os type and version on server
2021-03-22T13:10:10.963 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-03-22T13:10:11.243 INFO:teuthology.orchestra.run.smithi013.stdout:x86_64
2021-03-22T13:10:11.299 INFO:teuthology.orchestra.run.smithi013.stdout:NAME="CentOS Linux"
2021-03-22T13:10:11.299 INFO:teuthology.orchestra.run.smithi013.stdout:VERSION="8 (Core)"
2021-03-22T13:10:11.299 INFO:teuthology.orchestra.run.smithi013.stdout:ID="centos"
2021-03-22T13:10:11.299 INFO:teuthology.orchestra.run.smithi013.stdout:ID_LIKE="rhel fedora"
2021-03-22T13:10:11.299 INFO:teuthology.orchestra.run.smithi013.stdout:VERSION_ID="8"
2021-03-22T13:10:11.299 INFO:teuthology.orchestra.run.smithi013.stdout:PLATFORM_ID="platform:el8"
2021-03-22T13:10:11.299 INFO:teuthology.orchestra.run.smithi013.stdout:PRETTY_NAME="CentOS Linux 8 (Core)"
2021-03-22T13:10:11.299 INFO:teuthology.orchestra.run.smithi013.stdout:ANSI_COLOR="0;31"
2021-03-22T13:10:11.299 INFO:teuthology.orchestra.run.smithi013.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-03-22T13:10:11.299 INFO:teuthology.orchestra.run.smithi013.stdout:HOME_URL="https://www.centos.org/"
2021-03-22T13:10:11.300 INFO:teuthology.orchestra.run.smithi013.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-03-22T13:10:11.300 INFO:teuthology.orchestra.run.smithi013.stdout:
2021-03-22T13:10:11.300 INFO:teuthology.orchestra.run.smithi013.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-03-22T13:10:11.300 INFO:teuthology.orchestra.run.smithi013.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-03-22T13:10:11.300 INFO:teuthology.orchestra.run.smithi013.stdout:REDHAT_SUPPORT_PRODUCT="centos"
2021-03-22T13:10:11.300 INFO:teuthology.orchestra.run.smithi013.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8"
2021-03-22T13:10:11.300 INFO:teuthology.orchestra.run.smithi013.stdout:
2021-03-22T13:10:11.301 INFO:teuthology.lock.ops:Updating smithi013.front.sepia.ceph.com on lock server
2021-03-22T13:10:11.316 INFO:teuthology.lock.ops:Updating [smithi117.front.sepia.ceph.com]: set os type and version on server
2021-03-22T13:10:11.316 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-03-22T13:10:11.586 INFO:teuthology.orchestra.run.smithi117.stdout:x86_64
2021-03-22T13:10:11.640 INFO:teuthology.orchestra.run.smithi117.stdout:NAME="CentOS Linux"
2021-03-22T13:10:11.640 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION="8 (Core)"
2021-03-22T13:10:11.640 INFO:teuthology.orchestra.run.smithi117.stdout:ID="centos"
2021-03-22T13:10:11.640 INFO:teuthology.orchestra.run.smithi117.stdout:ID_LIKE="rhel fedora"
2021-03-22T13:10:11.640 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_ID="8"
2021-03-22T13:10:11.640 INFO:teuthology.orchestra.run.smithi117.stdout:PLATFORM_ID="platform:el8"
2021-03-22T13:10:11.640 INFO:teuthology.orchestra.run.smithi117.stdout:PRETTY_NAME="CentOS Linux 8 (Core)"
2021-03-22T13:10:11.641 INFO:teuthology.orchestra.run.smithi117.stdout:ANSI_COLOR="0;31"
2021-03-22T13:10:11.641 INFO:teuthology.orchestra.run.smithi117.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-03-22T13:10:11.641 INFO:teuthology.orchestra.run.smithi117.stdout:HOME_URL="https://www.centos.org/"
2021-03-22T13:10:11.641 INFO:teuthology.orchestra.run.smithi117.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-03-22T13:10:11.641 INFO:teuthology.orchestra.run.smithi117.stdout:
2021-03-22T13:10:11.641 INFO:teuthology.orchestra.run.smithi117.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-03-22T13:10:11.641 INFO:teuthology.orchestra.run.smithi117.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-03-22T13:10:11.641 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT="centos"
2021-03-22T13:10:11.641 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8"
2021-03-22T13:10:11.641 INFO:teuthology.orchestra.run.smithi117.stdout:
2021-03-22T13:10:11.642 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server
2021-03-22T13:10:11.658 INFO:teuthology.lock.ops:Updating [smithi180.front.sepia.ceph.com]: set os type and version on server
2021-03-22T13:10:11.658 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-03-22T13:10:11.928 INFO:teuthology.orchestra.run.smithi180.stdout:x86_64
2021-03-22T13:10:11.983 INFO:teuthology.orchestra.run.smithi180.stdout:NAME="CentOS Linux"
2021-03-22T13:10:11.983 INFO:teuthology.orchestra.run.smithi180.stdout:VERSION="8 (Core)"
2021-03-22T13:10:11.983 INFO:teuthology.orchestra.run.smithi180.stdout:ID="centos"
2021-03-22T13:10:11.983 INFO:teuthology.orchestra.run.smithi180.stdout:ID_LIKE="rhel fedora"
2021-03-22T13:10:11.983 INFO:teuthology.orchestra.run.smithi180.stdout:VERSION_ID="8"
2021-03-22T13:10:11.983 INFO:teuthology.orchestra.run.smithi180.stdout:PLATFORM_ID="platform:el8"
2021-03-22T13:10:11.983 INFO:teuthology.orchestra.run.smithi180.stdout:PRETTY_NAME="CentOS Linux 8 (Core)"
2021-03-22T13:10:11.983 INFO:teuthology.orchestra.run.smithi180.stdout:ANSI_COLOR="0;31"
2021-03-22T13:10:11.983 INFO:teuthology.orchestra.run.smithi180.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-03-22T13:10:11.983 INFO:teuthology.orchestra.run.smithi180.stdout:HOME_URL="https://www.centos.org/"
2021-03-22T13:10:11.983 INFO:teuthology.orchestra.run.smithi180.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-03-22T13:10:11.984 INFO:teuthology.orchestra.run.smithi180.stdout:
2021-03-22T13:10:11.984 INFO:teuthology.orchestra.run.smithi180.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-03-22T13:10:11.984 INFO:teuthology.orchestra.run.smithi180.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-03-22T13:10:11.984 INFO:teuthology.orchestra.run.smithi180.stdout:REDHAT_SUPPORT_PRODUCT="centos"
2021-03-22T13:10:11.984 INFO:teuthology.orchestra.run.smithi180.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8"
2021-03-22T13:10:11.984 INFO:teuthology.orchestra.run.smithi180.stdout:
2021-03-22T13:10:11.984 INFO:teuthology.lock.ops:Updating smithi180.front.sepia.ceph.com on lock server
2021-03-22T13:10:12.078 INFO:teuthology.dispatcher.supervisor:Running job 5987439
2021-03-22T13:10:12.078 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2021-03-22_04:17:03-fs-pacific-distro-basic-smithi/5987439 --name teuthology-2021-03-22_04:17:03-fs-pacific-distro-basic-smithi --description fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no tasks/{0-check-counter workunit/direct_io}} -- /home/teuthworker/archive/teuthology-2021-03-22_04:17:03-fs-pacific-distro-basic-smithi/5987439/orig.config.yaml
2021-03-22T13:10:12.084 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2021-03-22_04:17:03-fs-pacific-distro-basic-smithi/5987439
2021-03-22T13:10:12.084 INFO:teuthology.dispatcher.supervisor:Job PID: 3191
2021-03-22T13:10:12.084 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-03-22T17:44:30.714 ERROR:teuthology.report:Could not report results to http://paddles.front.sepia.ceph.com/
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/report.py", line 498, in try_push_job_info
    push_job_info(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/report.py", line 463, in push_job_info
    reporter.report_job(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/report.py", line 320, in report_job
    response.raise_for_status()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/virtualenv/lib/python3.6/site-packages/requests/models.py", line 943, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http://paddles.front.sepia.ceph.com/runs/teuthology-2021-03-22_04:17:03-fs-pacific-distro-basic-smithi/jobs/5987439/
2021-03-22T22:30:50.510 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-03-22T22:30:50.706 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2021-03-22T22:30:50.707 INFO:teuthology.nuke:Checking targets against current locks
2021-03-22T22:30:50.779 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/virtualenv/bin/teuthology-dispatcher", line 33, in <module>
    sys.exit(load_entry_point('teuthology', 'console_scripts', 'teuthology-dispatcher')())
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/scripts/dispatcher.py", line 33, in main
    teuthology.dispatcher.main(args)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/dispatcher/__init__.py", line 61, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/dispatcher/supervisor.py", line 59, in main
    verbose
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/dispatcher/supervisor.py", line 152, in run_job
    unlock_targets(job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/dispatcher/supervisor.py", line 196, in unlock_targets
    nuke(fake_ctx, True)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/nuke/__init__.py", line 250, in nuke
    if ctx.name not in lock['description']:
TypeError: argument of type 'NoneType' is not iterable