2022-07-01T20:40:32.542 INFO:root:teuthology version: 1.1.1.dev379+gf58709e3 2022-07-01T20:40:32.760 INFO:teuthology.lock.ops:Start node 'smithi097.front.sepia.ceph.com' reimaging 2022-07-01T20:40:32.762 INFO:teuthology.lock.ops:Updating [smithi097.front.sepia.ceph.com]: reset os type and version on server 2022-07-01T20:40:32.763 INFO:teuthology.lock.ops:Updating smithi097.front.sepia.ceph.com on lock server 2022-07-01T20:40:32.793 INFO:teuthology.lock.ops:Node 'smithi097.front.sepia.ceph.com' reimaging is complete 2022-07-01T20:40:32.794 INFO:teuthology.lock.ops:Start node 'smithi157.front.sepia.ceph.com' reimaging 2022-07-01T20:40:32.794 INFO:teuthology.lock.ops:Updating [smithi157.front.sepia.ceph.com]: reset os type and version on server 2022-07-01T20:40:32.795 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2022-07-01T20:40:32.833 INFO:teuthology.lock.ops:Node 'smithi157.front.sepia.ceph.com' reimaging is complete 2022-07-01T20:40:32.834 INFO:teuthology.lock.ops:Start node 'smithi201.front.sepia.ceph.com' reimaging 2022-07-01T20:40:32.834 INFO:teuthology.lock.ops:Updating [smithi201.front.sepia.ceph.com]: reset os type and version on server 2022-07-01T20:40:32.834 INFO:teuthology.lock.ops:Updating smithi201.front.sepia.ceph.com on lock server 2022-07-01T20:40:32.855 INFO:teuthology.lock.ops:Node 'smithi201.front.sepia.ceph.com' reimaging is complete 2022-07-01T20:40:33.031 INFO:teuthology.provision.fog.smithi097:Scheduling deploy of ubuntu 20.04 2022-07-01T20:40:33.060 INFO:teuthology.provision.fog.smithi157:Scheduling deploy of ubuntu 20.04 2022-07-01T20:40:33.102 INFO:teuthology.provision.fog.smithi201:Scheduling deploy of ubuntu 20.04 2022-07-01T20:40:33.460 INFO:teuthology.orchestra.console:Power off smithi097 2022-07-01T20:40:33.479 INFO:teuthology.orchestra.console:Power off smithi157 2022-07-01T20:40:33.609 INFO:teuthology.orchestra.console:Power off smithi201 2022-07-01T20:40:41.876 INFO:teuthology.orchestra.console:Power off for smithi097 completed 2022-07-01T20:40:41.933 INFO:teuthology.orchestra.console:Power off for smithi157 completed 2022-07-01T20:40:41.978 INFO:teuthology.orchestra.console:Power on smithi097 2022-07-01T20:40:42.047 INFO:teuthology.orchestra.console:Power on smithi157 2022-07-01T20:40:46.188 INFO:teuthology.orchestra.console:Power off for smithi201 completed 2022-07-01T20:40:46.291 INFO:teuthology.orchestra.console:Power on smithi201 2022-07-01T20:40:50.586 INFO:teuthology.orchestra.console:Power on for smithi097 completed 2022-07-01T20:40:50.642 INFO:teuthology.orchestra.console:Power on for smithi157 completed 2022-07-01T20:40:50.696 INFO:teuthology.provision.fog.smithi097:Waiting for deploy to finish 2022-07-01T20:40:50.745 INFO:teuthology.provision.fog.smithi157:Waiting for deploy to finish 2022-07-01T20:40:54.777 INFO:teuthology.orchestra.console:Power on for smithi201 completed 2022-07-01T20:40:54.880 INFO:teuthology.provision.fog.smithi201:Waiting for deploy to finish 2022-07-01T20:45:47.065 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-07-01T20:45:47.170 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-07-01T20:45:47.652 INFO:teuthology.provision.fog.smithi201:Node is ready 2022-07-01T20:45:47.659 INFO:teuthology.orchestra.run.smithi201.stdout:smithi201.front.sepia.ceph.com 2022-07-01T20:45:47.712 INFO:teuthology.orchestra.run.smithi201.stdout:172.21.15.201 smithi201.front.sepia.ceph.com smithi201 2022-07-01T20:45:47.730 INFO:teuthology.provision.fog.smithi097:Node is ready 2022-07-01T20:45:47.763 INFO:teuthology.orchestra.run.smithi097.stdout:smithi097.front.sepia.ceph.com 2022-07-01T20:45:47.816 INFO:teuthology.orchestra.run.smithi097.stdout:172.21.15.97 smithi097.front.sepia.ceph.com smithi097 2022-07-01T20:45:47.971 INFO:teuthology.provision.fog.smithi201:Deploy complete! 2022-07-01T20:45:48.108 INFO:teuthology.provision.fog.smithi097:Deploy complete! 2022-07-01T20:46:32.912 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-07-01T20:46:33.437 INFO:teuthology.provision.fog.smithi157:Node is ready 2022-07-01T20:46:33.445 INFO:teuthology.orchestra.run.smithi157.stdout:smithi157.front.sepia.ceph.com 2022-07-01T20:46:33.455 INFO:teuthology.orchestra.run.smithi157.stdout:172.21.15.157 smithi157.front.sepia.ceph.com smithi157 2022-07-01T20:46:33.736 INFO:teuthology.provision.fog.smithi157:Deploy complete! 2022-07-01T20:46:34.063 INFO:teuthology.lock.ops:Checking smithi097.front.sepia.ceph.com 2022-07-01T20:46:34.064 INFO:teuthology.lock.ops:New key found. Updating... 2022-07-01T20:46:34.104 INFO:teuthology.lock.ops:Checking smithi157.front.sepia.ceph.com 2022-07-01T20:46:34.105 INFO:teuthology.lock.ops:New key found. Updating... 2022-07-01T20:46:34.128 INFO:teuthology.lock.ops:Checking smithi201.front.sepia.ceph.com 2022-07-01T20:46:34.129 INFO:teuthology.lock.ops:New key found. Updating... 2022-07-01T20:46:34.156 INFO:teuthology.lock.ops:Updating [smithi097.front.sepia.ceph.com]: set os type and version on server 2022-07-01T20:46:34.158 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2022-07-01T20:46:34.523 INFO:teuthology.orchestra.run.smithi097.stdout:x86_64 2022-07-01T20:46:34.530 INFO:teuthology.orchestra.run.smithi097.stdout:NAME="Ubuntu" 2022-07-01T20:46:34.531 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2022-07-01T20:46:34.531 INFO:teuthology.orchestra.run.smithi097.stdout:ID=ubuntu 2022-07-01T20:46:34.532 INFO:teuthology.orchestra.run.smithi097.stdout:ID_LIKE=debian 2022-07-01T20:46:34.533 INFO:teuthology.orchestra.run.smithi097.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2022-07-01T20:46:34.533 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_ID="20.04" 2022-07-01T20:46:34.534 INFO:teuthology.orchestra.run.smithi097.stdout:HOME_URL="https://www.ubuntu.com/" 2022-07-01T20:46:34.534 INFO:teuthology.orchestra.run.smithi097.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-07-01T20:46:34.535 INFO:teuthology.orchestra.run.smithi097.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-07-01T20:46:34.535 INFO:teuthology.orchestra.run.smithi097.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-07-01T20:46:34.535 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_CODENAME=focal 2022-07-01T20:46:34.536 INFO:teuthology.orchestra.run.smithi097.stdout:UBUNTU_CODENAME=focal 2022-07-01T20:46:34.538 INFO:teuthology.lock.ops:Updating smithi097.front.sepia.ceph.com on lock server 2022-07-01T20:46:34.567 INFO:teuthology.lock.ops:Updating [smithi157.front.sepia.ceph.com]: set os type and version on server 2022-07-01T20:46:34.568 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2022-07-01T20:46:34.868 INFO:teuthology.orchestra.run.smithi157.stdout:x86_64 2022-07-01T20:46:34.875 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="Ubuntu" 2022-07-01T20:46:34.875 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2022-07-01T20:46:34.875 INFO:teuthology.orchestra.run.smithi157.stdout:ID=ubuntu 2022-07-01T20:46:34.876 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE=debian 2022-07-01T20:46:34.876 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2022-07-01T20:46:34.876 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="20.04" 2022-07-01T20:46:34.876 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://www.ubuntu.com/" 2022-07-01T20:46:34.877 INFO:teuthology.orchestra.run.smithi157.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-07-01T20:46:34.877 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-07-01T20:46:34.877 INFO:teuthology.orchestra.run.smithi157.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-07-01T20:46:34.877 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_CODENAME=focal 2022-07-01T20:46:34.878 INFO:teuthology.orchestra.run.smithi157.stdout:UBUNTU_CODENAME=focal 2022-07-01T20:46:34.879 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2022-07-01T20:46:34.905 INFO:teuthology.lock.ops:Updating [smithi201.front.sepia.ceph.com]: set os type and version on server 2022-07-01T20:46:34.906 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi201.front.sepia.ceph.com' 2022-07-01T20:46:35.281 INFO:teuthology.orchestra.run.smithi201.stdout:x86_64 2022-07-01T20:46:35.337 INFO:teuthology.orchestra.run.smithi201.stdout:NAME="Ubuntu" 2022-07-01T20:46:35.339 INFO:teuthology.orchestra.run.smithi201.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2022-07-01T20:46:35.340 INFO:teuthology.orchestra.run.smithi201.stdout:ID=ubuntu 2022-07-01T20:46:35.340 INFO:teuthology.orchestra.run.smithi201.stdout:ID_LIKE=debian 2022-07-01T20:46:35.341 INFO:teuthology.orchestra.run.smithi201.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2022-07-01T20:46:35.341 INFO:teuthology.orchestra.run.smithi201.stdout:VERSION_ID="20.04" 2022-07-01T20:46:35.342 INFO:teuthology.orchestra.run.smithi201.stdout:HOME_URL="https://www.ubuntu.com/" 2022-07-01T20:46:35.342 INFO:teuthology.orchestra.run.smithi201.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-07-01T20:46:35.342 INFO:teuthology.orchestra.run.smithi201.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-07-01T20:46:35.343 INFO:teuthology.orchestra.run.smithi201.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-07-01T20:46:35.343 INFO:teuthology.orchestra.run.smithi201.stdout:VERSION_CODENAME=focal 2022-07-01T20:46:35.344 INFO:teuthology.orchestra.run.smithi201.stdout:UBUNTU_CODENAME=focal 2022-07-01T20:46:35.345 INFO:teuthology.lock.ops:Updating smithi201.front.sepia.ceph.com on lock server 2022-07-01T20:46:35.542 INFO:teuthology.dispatcher.supervisor:Running job 6909880 2022-07-01T20:46:35.542 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-07-01_20:38:05-rbd-wip-yuri6-testing-2022-06-30-1717-octopus-distro-default-smithi/6909880 --name yuriw-2022-07-01_20:38:05-rbd-wip-yuri6-testing-2022-06-30-1717-octopus-distro-default-smithi --description rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-bitmap qemu/xfstests supported-random-distro$/{ubuntu_latest} workloads/rebuild_object_map} -- /home/teuthworker/archive/yuriw-2022-07-01_20:38:05-rbd-wip-yuri6-testing-2022-06-30-1717-octopus-distro-default-smithi/6909880/orig.config.yaml 2022-07-01T20:46:35.557 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-07-01_20:38:05-rbd-wip-yuri6-testing-2022-06-30-1717-octopus-distro-default-smithi/6909880 2022-07-01T20:46:35.559 INFO:teuthology.dispatcher.supervisor:Job PID: 22587 2022-07-01T20:46:35.560 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-07-01T20:48:35.753 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-07-01T20:48:35.931 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2022-07-01T20:48:35.932 INFO:teuthology.nuke:Checking targets against current locks 2022-07-01T20:48:36.030 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-07-01T20:48:36.096 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-07-01T20:48:36.139 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-07-01T20:48:36.231 INFO:teuthology.orchestra.console:Power off smithi097 2022-07-01T20:48:36.304 INFO:teuthology.orchestra.console:Power off smithi157 2022-07-01T20:48:36.346 INFO:teuthology.orchestra.console:Power off smithi201 2022-07-01T20:48:40.647 INFO:teuthology.orchestra.console:Power off for smithi097 completed 2022-07-01T20:48:40.662 INFO:teuthology.orchestra.console:Power off for smithi157 completed 2022-07-01T20:48:40.851 INFO:teuthology.lock.ops:unlocked: smithi157.front.sepia.ceph.com 2022-07-01T20:48:44.800 INFO:teuthology.orchestra.console:Power off for smithi201 completed 2022-07-01T20:49:08.105 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/virtualenv/bin/teuthology-dispatcher", line 33, in sys.exit(load_entry_point('teuthology', 'console_scripts', 'teuthology-dispatcher')()) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/teuthology/dispatcher/__init__.py", line 61, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/teuthology/dispatcher/supervisor.py", line 61, in main verbose File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/teuthology/dispatcher/supervisor.py", line 156, in run_job unlock_targets(job_config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/teuthology/dispatcher/supervisor.py", line 255, in unlock_targets nuke(fake_ctx, True) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/teuthology/nuke/__init__.py", line 268, in nuke for unnuked in p: File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/teuthology/nuke/__init__.py", line 299, in nuke_one unlock_one(ctx, list(target.keys())[0], ctx.owner) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/teuthology/lock/ops.py", line 209, in unlock_one while proceed(): File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/teuthology/contextutil.py", line 133, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: 'unlock smithi097.front.sepia.ceph.com' reached maximum tries (10) after waiting for 32.5 seconds