2021-08-25T16:54:49.719 INFO:root:teuthology version: 1.1.0-321319b1 2021-08-25T16:54:49.835 INFO:teuthology.lock.ops:Start node 'ubuntu@gibba002.front.sepia.ceph.com' reimaging 2021-08-25T16:54:49.837 INFO:teuthology.lock.ops:Updating [ubuntu@gibba002.front.sepia.ceph.com]: reset os type and version on server 2021-08-25T16:54:49.837 INFO:teuthology.lock.ops:Updating gibba002.front.sepia.ceph.com on lock server 2021-08-25T16:54:49.852 INFO:teuthology.lock.ops:Node 'ubuntu@gibba002.front.sepia.ceph.com' reimaging is complete 2021-08-25T16:54:49.852 INFO:teuthology.lock.ops:Start node 'ubuntu@gibba014.front.sepia.ceph.com' reimaging 2021-08-25T16:54:49.852 INFO:teuthology.lock.ops:Updating [ubuntu@gibba014.front.sepia.ceph.com]: reset os type and version on server 2021-08-25T16:54:49.853 INFO:teuthology.lock.ops:Updating gibba014.front.sepia.ceph.com on lock server 2021-08-25T16:54:49.868 INFO:teuthology.lock.ops:Node 'ubuntu@gibba014.front.sepia.ceph.com' reimaging is complete 2021-08-25T16:54:49.869 INFO:teuthology.lock.ops:Start node 'ubuntu@gibba040.front.sepia.ceph.com' reimaging 2021-08-25T16:54:49.869 INFO:teuthology.lock.ops:Updating [ubuntu@gibba040.front.sepia.ceph.com]: reset os type and version on server 2021-08-25T16:54:49.869 INFO:teuthology.lock.ops:Updating gibba040.front.sepia.ceph.com on lock server 2021-08-25T16:54:49.883 INFO:teuthology.lock.ops:Node 'ubuntu@gibba040.front.sepia.ceph.com' reimaging is complete 2021-08-25T16:54:50.084 INFO:teuthology.provision.fog.gibba002:Scheduling deploy of rhel 8.4 2021-08-25T16:54:50.110 INFO:teuthology.provision.fog.gibba014:Scheduling deploy of rhel 8.4 2021-08-25T16:54:50.113 INFO:teuthology.provision.fog.gibba040:Scheduling deploy of rhel 8.4 2021-08-25T16:54:50.548 INFO:teuthology.orchestra.console:Power off gibba002 2021-08-25T16:54:50.604 INFO:teuthology.orchestra.console:Power off gibba014 2021-08-25T16:54:50.617 INFO:teuthology.orchestra.console:Power off gibba040 2021-08-25T16:54:50.697 INFO:teuthology.orchestra.console:Power off for gibba002 completed 2021-08-25T16:54:50.752 INFO:teuthology.orchestra.console:Power off for gibba014 completed 2021-08-25T16:54:50.762 INFO:teuthology.orchestra.console:Power off for gibba040 completed 2021-08-25T16:54:50.798 INFO:teuthology.orchestra.console:Power on gibba002 2021-08-25T16:54:50.854 INFO:teuthology.orchestra.console:Power on gibba014 2021-08-25T16:54:50.862 INFO:teuthology.orchestra.console:Power on gibba040 2021-08-25T16:54:59.172 INFO:teuthology.orchestra.console:Power on for gibba002 completed 2021-08-25T16:54:59.224 INFO:teuthology.orchestra.console:Power on for gibba014 completed 2021-08-25T16:54:59.230 INFO:teuthology.orchestra.console:Power on for gibba040 completed 2021-08-25T16:54:59.274 INFO:teuthology.provision.fog.gibba002:Waiting for deploy to finish 2021-08-25T16:54:59.325 INFO:teuthology.provision.fog.gibba014:Waiting for deploy to finish 2021-08-25T16:54:59.341 INFO:teuthology.provision.fog.gibba040:Waiting for deploy to finish 2021-08-25T16:59:02.707 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-08-25T16:59:12.672 INFO:teuthology.provision.fog.gibba014:Node is ready 2021-08-25T16:59:12.686 INFO:teuthology.orchestra.run.gibba014.stdout:gibba014.front.sepia.ceph.com 2021-08-25T16:59:12.737 INFO:teuthology.orchestra.run.gibba014.stdout:172.21.2.114 gibba014.front.sepia.ceph.com gibba014 2021-08-25T16:59:13.079 INFO:teuthology.provision.fog.gibba014:Deploy complete! 2021-08-25T16:59:27.415 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-08-25T16:59:27.441 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-08-25T16:59:27.599 INFO:teuthology.provision.fog.gibba002:Node is ready 2021-08-25T16:59:27.610 INFO:teuthology.orchestra.run.gibba002.stdout:gibba002.front.sepia.ceph.com 2021-08-25T16:59:27.662 INFO:teuthology.orchestra.run.gibba002.stdout:172.21.2.102 gibba002.front.sepia.ceph.com gibba002 2021-08-25T16:59:27.674 INFO:teuthology.provision.fog.gibba040:Node is ready 2021-08-25T16:59:27.685 INFO:teuthology.orchestra.run.gibba040.stdout:gibba040.front.sepia.ceph.com 2021-08-25T16:59:27.737 INFO:teuthology.orchestra.run.gibba040.stdout:172.21.2.140 gibba040.front.sepia.ceph.com gibba040 2021-08-25T16:59:27.956 INFO:teuthology.provision.fog.gibba002:Deploy complete! 2021-08-25T16:59:28.055 INFO:teuthology.provision.fog.gibba040:Deploy complete! 2021-08-25T16:59:28.202 INFO:teuthology.lock.ops:Checking gibba002.front.sepia.ceph.com 2021-08-25T16:59:28.203 INFO:teuthology.lock.ops:New key found. Updating... 2021-08-25T16:59:28.221 INFO:teuthology.lock.ops:Checking gibba014.front.sepia.ceph.com 2021-08-25T16:59:28.222 INFO:teuthology.lock.ops:New key found. Updating... 2021-08-25T16:59:28.236 INFO:teuthology.lock.ops:Checking gibba040.front.sepia.ceph.com 2021-08-25T16:59:28.237 INFO:teuthology.lock.ops:New key found. Updating... 2021-08-25T16:59:28.252 INFO:teuthology.lock.ops:Updating [gibba002.front.sepia.ceph.com]: set os type and version on server 2021-08-25T16:59:28.253 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-08-25T16:59:28.458 INFO:teuthology.orchestra.run.gibba002.stdout:x86_64 2021-08-25T16:59:28.509 INFO:teuthology.orchestra.run.gibba002.stdout:NAME="Red Hat Enterprise Linux" 2021-08-25T16:59:28.509 INFO:teuthology.orchestra.run.gibba002.stdout:VERSION="8.4 (Ootpa)" 2021-08-25T16:59:28.510 INFO:teuthology.orchestra.run.gibba002.stdout:ID="rhel" 2021-08-25T16:59:28.510 INFO:teuthology.orchestra.run.gibba002.stdout:ID_LIKE="fedora" 2021-08-25T16:59:28.510 INFO:teuthology.orchestra.run.gibba002.stdout:VERSION_ID="8.4" 2021-08-25T16:59:28.510 INFO:teuthology.orchestra.run.gibba002.stdout:PLATFORM_ID="platform:el8" 2021-08-25T16:59:28.511 INFO:teuthology.orchestra.run.gibba002.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2021-08-25T16:59:28.511 INFO:teuthology.orchestra.run.gibba002.stdout:ANSI_COLOR="0;31" 2021-08-25T16:59:28.511 INFO:teuthology.orchestra.run.gibba002.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2021-08-25T16:59:28.511 INFO:teuthology.orchestra.run.gibba002.stdout:HOME_URL="https://www.redhat.com/" 2021-08-25T16:59:28.511 INFO:teuthology.orchestra.run.gibba002.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2021-08-25T16:59:28.512 INFO:teuthology.orchestra.run.gibba002.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-08-25T16:59:28.512 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-08-25T16:59:28.513 INFO:teuthology.orchestra.run.gibba002.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2021-08-25T16:59:28.513 INFO:teuthology.orchestra.run.gibba002.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2021-08-25T16:59:28.513 INFO:teuthology.orchestra.run.gibba002.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-08-25T16:59:28.514 INFO:teuthology.orchestra.run.gibba002.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2021-08-25T16:59:28.515 INFO:teuthology.lock.ops:Updating gibba002.front.sepia.ceph.com on lock server 2021-08-25T16:59:28.528 INFO:teuthology.lock.ops:Updating [gibba014.front.sepia.ceph.com]: set os type and version on server 2021-08-25T16:59:28.529 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-08-25T16:59:28.733 INFO:teuthology.orchestra.run.gibba014.stdout:x86_64 2021-08-25T16:59:28.783 INFO:teuthology.orchestra.run.gibba014.stdout:NAME="Red Hat Enterprise Linux" 2021-08-25T16:59:28.784 INFO:teuthology.orchestra.run.gibba014.stdout:VERSION="8.4 (Ootpa)" 2021-08-25T16:59:28.784 INFO:teuthology.orchestra.run.gibba014.stdout:ID="rhel" 2021-08-25T16:59:28.784 INFO:teuthology.orchestra.run.gibba014.stdout:ID_LIKE="fedora" 2021-08-25T16:59:28.784 INFO:teuthology.orchestra.run.gibba014.stdout:VERSION_ID="8.4" 2021-08-25T16:59:28.784 INFO:teuthology.orchestra.run.gibba014.stdout:PLATFORM_ID="platform:el8" 2021-08-25T16:59:28.785 INFO:teuthology.orchestra.run.gibba014.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2021-08-25T16:59:28.785 INFO:teuthology.orchestra.run.gibba014.stdout:ANSI_COLOR="0;31" 2021-08-25T16:59:28.785 INFO:teuthology.orchestra.run.gibba014.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2021-08-25T16:59:28.785 INFO:teuthology.orchestra.run.gibba014.stdout:HOME_URL="https://www.redhat.com/" 2021-08-25T16:59:28.786 INFO:teuthology.orchestra.run.gibba014.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2021-08-25T16:59:28.786 INFO:teuthology.orchestra.run.gibba014.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-08-25T16:59:28.786 INFO:teuthology.orchestra.run.gibba014.stdout: 2021-08-25T16:59:28.786 INFO:teuthology.orchestra.run.gibba014.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2021-08-25T16:59:28.787 INFO:teuthology.orchestra.run.gibba014.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2021-08-25T16:59:28.787 INFO:teuthology.orchestra.run.gibba014.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-08-25T16:59:28.787 INFO:teuthology.orchestra.run.gibba014.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2021-08-25T16:59:28.788 INFO:teuthology.lock.ops:Updating gibba014.front.sepia.ceph.com on lock server 2021-08-25T16:59:28.809 INFO:teuthology.lock.ops:Updating [gibba040.front.sepia.ceph.com]: set os type and version on server 2021-08-25T16:59:28.809 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-08-25T16:59:29.013 INFO:teuthology.orchestra.run.gibba040.stdout:x86_64 2021-08-25T16:59:29.065 INFO:teuthology.orchestra.run.gibba040.stdout:NAME="Red Hat Enterprise Linux" 2021-08-25T16:59:29.065 INFO:teuthology.orchestra.run.gibba040.stdout:VERSION="8.4 (Ootpa)" 2021-08-25T16:59:29.065 INFO:teuthology.orchestra.run.gibba040.stdout:ID="rhel" 2021-08-25T16:59:29.066 INFO:teuthology.orchestra.run.gibba040.stdout:ID_LIKE="fedora" 2021-08-25T16:59:29.066 INFO:teuthology.orchestra.run.gibba040.stdout:VERSION_ID="8.4" 2021-08-25T16:59:29.066 INFO:teuthology.orchestra.run.gibba040.stdout:PLATFORM_ID="platform:el8" 2021-08-25T16:59:29.066 INFO:teuthology.orchestra.run.gibba040.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2021-08-25T16:59:29.067 INFO:teuthology.orchestra.run.gibba040.stdout:ANSI_COLOR="0;31" 2021-08-25T16:59:29.067 INFO:teuthology.orchestra.run.gibba040.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2021-08-25T16:59:29.067 INFO:teuthology.orchestra.run.gibba040.stdout:HOME_URL="https://www.redhat.com/" 2021-08-25T16:59:29.067 INFO:teuthology.orchestra.run.gibba040.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2021-08-25T16:59:29.068 INFO:teuthology.orchestra.run.gibba040.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-08-25T16:59:29.068 INFO:teuthology.orchestra.run.gibba040.stdout: 2021-08-25T16:59:29.068 INFO:teuthology.orchestra.run.gibba040.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2021-08-25T16:59:29.068 INFO:teuthology.orchestra.run.gibba040.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2021-08-25T16:59:29.068 INFO:teuthology.orchestra.run.gibba040.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-08-25T16:59:29.069 INFO:teuthology.orchestra.run.gibba040.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2021-08-25T16:59:29.069 INFO:teuthology.lock.ops:Updating gibba040.front.sepia.ceph.com on lock server 2021-08-25T16:59:29.147 INFO:teuthology.dispatcher.supervisor:Running job 6355165 2021-08-25T16:59:29.147 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_321319b12ea4ff9b63c7655015a3156de2c3b279/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2021-08-24_03:15:03-fs-master-distro-basic-gibba/6355165 --name teuthology-2021-08-24_03:15:03-fs-master-distro-basic-gibba --description fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/kernel_untar_build} wsync/{no}} -- /home/teuthworker/archive/teuthology-2021-08-24_03:15:03-fs-master-distro-basic-gibba/6355165/orig.config.yaml 2021-08-25T16:59:29.151 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2021-08-24_03:15:03-fs-master-distro-basic-gibba/6355165 2021-08-25T16:59:29.152 INFO:teuthology.dispatcher.supervisor:Job PID: 25288 2021-08-25T16:59:29.152 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-08-25T17:09:29.877 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2021-08-25T17:09:30.117 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2021-08-25T17:09:30.118 INFO:teuthology.nuke:Checking targets against current locks 2021-08-25T17:09:30.234 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_321319b12ea4ff9b63c7655015a3156de2c3b279/virtualenv/bin/teuthology-dispatcher", line 33, in sys.exit(load_entry_point('teuthology', 'console_scripts', 'teuthology-dispatcher')()) File "/home/teuthworker/src/git.ceph.com_git_teuthology_321319b12ea4ff9b63c7655015a3156de2c3b279/scripts/dispatcher.py", line 33, in main teuthology.dispatcher.main(args) File "/home/teuthworker/src/git.ceph.com_git_teuthology_321319b12ea4ff9b63c7655015a3156de2c3b279/teuthology/dispatcher/__init__.py", line 61, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_git_teuthology_321319b12ea4ff9b63c7655015a3156de2c3b279/teuthology/dispatcher/supervisor.py", line 59, in main verbose File "/home/teuthworker/src/git.ceph.com_git_teuthology_321319b12ea4ff9b63c7655015a3156de2c3b279/teuthology/dispatcher/supervisor.py", line 152, in run_job unlock_targets(job_config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_321319b12ea4ff9b63c7655015a3156de2c3b279/teuthology/dispatcher/supervisor.py", line 196, in unlock_targets nuke(fake_ctx, True) File "/home/teuthworker/src/git.ceph.com_git_teuthology_321319b12ea4ff9b63c7655015a3156de2c3b279/teuthology/nuke/__init__.py", line 250, in nuke if ctx.name not in lock['description']: TypeError: argument of type 'NoneType' is not iterable