2021-04-22T11:09:53.783 INFO:root:teuthology version: 1.1.0-2713a3cd 2021-04-22T11:09:53.984 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi068.front.sepia.ceph.com' reimaging 2021-04-22T11:09:53.985 INFO:teuthology.lock.ops:Updating [ubuntu@smithi068.front.sepia.ceph.com]: reset os type and version on server 2021-04-22T11:09:53.985 INFO:teuthology.lock.ops:Updating smithi068.front.sepia.ceph.com on lock server 2021-04-22T11:09:54.003 INFO:teuthology.lock.ops:Node 'ubuntu@smithi068.front.sepia.ceph.com' reimaging is complete 2021-04-22T11:09:54.003 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi076.front.sepia.ceph.com' reimaging 2021-04-22T11:09:54.003 INFO:teuthology.lock.ops:Updating [ubuntu@smithi076.front.sepia.ceph.com]: reset os type and version on server 2021-04-22T11:09:54.003 INFO:teuthology.lock.ops:Updating smithi076.front.sepia.ceph.com on lock server 2021-04-22T11:09:54.021 INFO:teuthology.lock.ops:Node 'ubuntu@smithi076.front.sepia.ceph.com' reimaging is complete 2021-04-22T11:09:54.022 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi077.front.sepia.ceph.com' reimaging 2021-04-22T11:09:54.022 INFO:teuthology.lock.ops:Updating [ubuntu@smithi077.front.sepia.ceph.com]: reset os type and version on server 2021-04-22T11:09:54.022 INFO:teuthology.lock.ops:Updating smithi077.front.sepia.ceph.com on lock server 2021-04-22T11:09:54.041 INFO:teuthology.lock.ops:Node 'ubuntu@smithi077.front.sepia.ceph.com' reimaging is complete 2021-04-22T11:09:54.041 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi125.front.sepia.ceph.com' reimaging 2021-04-22T11:09:54.041 INFO:teuthology.lock.ops:Updating [ubuntu@smithi125.front.sepia.ceph.com]: reset os type and version on server 2021-04-22T11:09:54.041 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server 2021-04-22T11:09:54.057 INFO:teuthology.lock.ops:Node 'ubuntu@smithi125.front.sepia.ceph.com' reimaging is complete 2021-04-22T11:09:54.257 INFO:teuthology.provision.fog.smithi068:Scheduling deploy of ubuntu 18.04 2021-04-22T11:09:54.316 INFO:teuthology.provision.fog.smithi077:Scheduling deploy of ubuntu 18.04 2021-04-22T11:09:54.320 INFO:teuthology.provision.fog.smithi076:Scheduling deploy of ubuntu 18.04 2021-04-22T11:09:54.325 INFO:teuthology.provision.fog.smithi125:Scheduling deploy of ubuntu 18.04 2021-04-22T11:09:54.745 INFO:teuthology.orchestra.console:Power off smithi068 2021-04-22T11:09:54.864 INFO:teuthology.orchestra.console:Power off smithi077 2021-04-22T11:09:54.908 INFO:teuthology.orchestra.console:Power off smithi076 2021-04-22T11:09:54.950 INFO:teuthology.orchestra.console:Power off smithi125 2021-04-22T11:10:03.157 INFO:teuthology.orchestra.console:Power off for smithi068 completed 2021-04-22T11:10:03.247 INFO:teuthology.orchestra.console:Power off for smithi077 completed 2021-04-22T11:10:03.258 INFO:teuthology.orchestra.console:Power on smithi068 2021-04-22T11:10:03.286 INFO:teuthology.orchestra.console:Power off for smithi076 completed 2021-04-22T11:10:03.324 INFO:teuthology.orchestra.console:Power off for smithi125 completed 2021-04-22T11:10:03.348 INFO:teuthology.orchestra.console:Power on smithi077 2021-04-22T11:10:03.387 INFO:teuthology.orchestra.console:Power on smithi076 2021-04-22T11:10:03.425 INFO:teuthology.orchestra.console:Power on smithi125 2021-04-22T11:10:11.621 INFO:teuthology.orchestra.console:Power on for smithi068 completed 2021-04-22T11:10:11.717 INFO:teuthology.orchestra.console:Power on for smithi077 completed 2021-04-22T11:10:11.723 INFO:teuthology.provision.fog.smithi068:Waiting for deploy to finish 2021-04-22T11:10:11.797 INFO:teuthology.orchestra.console:Power on for smithi076 completed 2021-04-22T11:10:11.819 INFO:teuthology.provision.fog.smithi077:Waiting for deploy to finish 2021-04-22T11:10:11.872 INFO:teuthology.orchestra.console:Power on for smithi125 completed 2021-04-22T11:10:11.898 INFO:teuthology.provision.fog.smithi076:Waiting for deploy to finish 2021-04-22T11:10:11.973 INFO:teuthology.provision.fog.smithi125:Waiting for deploy to finish 2021-04-22T11:15:07.509 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-04-22T11:15:07.531 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-04-22T11:15:07.892 INFO:teuthology.provision.fog.smithi077:Node is ready 2021-04-22T11:15:07.933 INFO:teuthology.provision.fog.smithi125:Node is ready 2021-04-22T11:15:07.942 INFO:teuthology.orchestra.run.smithi077.stdout:smithi077.front.sepia.ceph.com 2021-04-22T11:15:07.983 INFO:teuthology.orchestra.run.smithi125.stdout:smithi125.front.sepia.ceph.com 2021-04-22T11:15:07.990 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77 smithi077.front.sepia.ceph.com smithi077 2021-04-22T11:15:08.031 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.15.125 smithi125.front.sepia.ceph.com smithi125 2021-04-22T11:15:08.319 INFO:teuthology.provision.fog.smithi125:Deploy complete! 2021-04-22T11:15:08.324 INFO:teuthology.provision.fog.smithi077:Deploy complete! 2021-04-22T11:15:22.536 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-04-22T11:15:22.917 INFO:teuthology.provision.fog.smithi068:Node is ready 2021-04-22T11:15:22.967 INFO:teuthology.orchestra.run.smithi068.stdout:smithi068.front.sepia.ceph.com 2021-04-22T11:15:23.015 INFO:teuthology.orchestra.run.smithi068.stdout:172.21.15.68 smithi068.front.sepia.ceph.com smithi068 2021-04-22T11:15:23.306 INFO:teuthology.provision.fog.smithi068:Deploy complete! 2021-04-22T11:15:37.717 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-04-22T11:15:38.153 INFO:teuthology.provision.fog.smithi076:Node is ready 2021-04-22T11:15:38.200 INFO:teuthology.orchestra.run.smithi076.stdout:smithi076.front.sepia.ceph.com 2021-04-22T11:15:38.249 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76 smithi076.front.sepia.ceph.com smithi076 2021-04-22T11:15:38.596 INFO:teuthology.provision.fog.smithi076:Deploy complete! 2021-04-22T11:15:38.794 INFO:teuthology.lock.ops:Checking smithi068.front.sepia.ceph.com 2021-04-22T11:15:38.794 INFO:teuthology.lock.ops:New key found. Updating... 2021-04-22T11:15:38.814 INFO:teuthology.lock.ops:Checking smithi076.front.sepia.ceph.com 2021-04-22T11:15:38.814 INFO:teuthology.lock.ops:New key found. Updating... 2021-04-22T11:15:38.829 INFO:teuthology.lock.ops:Checking smithi077.front.sepia.ceph.com 2021-04-22T11:15:38.829 INFO:teuthology.lock.ops:New key found. Updating... 2021-04-22T11:15:38.844 INFO:teuthology.lock.ops:Checking smithi125.front.sepia.ceph.com 2021-04-22T11:15:38.844 INFO:teuthology.lock.ops:New key found. Updating... 2021-04-22T11:15:38.860 INFO:teuthology.lock.ops:Updating [smithi068.front.sepia.ceph.com]: set os type and version on server 2021-04-22T11:15:38.860 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-22T11:15:39.223 INFO:teuthology.orchestra.run.smithi068.stdout:x86_64 2021-04-22T11:15:39.274 INFO:teuthology.orchestra.run.smithi068.stdout:NAME="Ubuntu" 2021-04-22T11:15:39.274 INFO:teuthology.orchestra.run.smithi068.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2021-04-22T11:15:39.274 INFO:teuthology.orchestra.run.smithi068.stdout:ID=ubuntu 2021-04-22T11:15:39.274 INFO:teuthology.orchestra.run.smithi068.stdout:ID_LIKE=debian 2021-04-22T11:15:39.274 INFO:teuthology.orchestra.run.smithi068.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2021-04-22T11:15:39.274 INFO:teuthology.orchestra.run.smithi068.stdout:VERSION_ID="18.04" 2021-04-22T11:15:39.275 INFO:teuthology.orchestra.run.smithi068.stdout:HOME_URL="https://www.ubuntu.com/" 2021-04-22T11:15:39.275 INFO:teuthology.orchestra.run.smithi068.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-04-22T11:15:39.275 INFO:teuthology.orchestra.run.smithi068.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-04-22T11:15:39.275 INFO:teuthology.orchestra.run.smithi068.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-04-22T11:15:39.275 INFO:teuthology.orchestra.run.smithi068.stdout:VERSION_CODENAME=bionic 2021-04-22T11:15:39.275 INFO:teuthology.orchestra.run.smithi068.stdout:UBUNTU_CODENAME=bionic 2021-04-22T11:15:39.276 INFO:teuthology.lock.ops:Updating smithi068.front.sepia.ceph.com on lock server 2021-04-22T11:15:39.297 INFO:teuthology.lock.ops:Updating [smithi076.front.sepia.ceph.com]: set os type and version on server 2021-04-22T11:15:39.297 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-22T11:15:39.717 INFO:teuthology.orchestra.run.smithi076.stdout:x86_64 2021-04-22T11:15:39.765 INFO:teuthology.orchestra.run.smithi076.stdout:NAME="Ubuntu" 2021-04-22T11:15:39.766 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2021-04-22T11:15:39.766 INFO:teuthology.orchestra.run.smithi076.stdout:ID=ubuntu 2021-04-22T11:15:39.766 INFO:teuthology.orchestra.run.smithi076.stdout:ID_LIKE=debian 2021-04-22T11:15:39.766 INFO:teuthology.orchestra.run.smithi076.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2021-04-22T11:15:39.766 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION_ID="18.04" 2021-04-22T11:15:39.767 INFO:teuthology.orchestra.run.smithi076.stdout:HOME_URL="https://www.ubuntu.com/" 2021-04-22T11:15:39.767 INFO:teuthology.orchestra.run.smithi076.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-04-22T11:15:39.767 INFO:teuthology.orchestra.run.smithi076.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-04-22T11:15:39.767 INFO:teuthology.orchestra.run.smithi076.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-04-22T11:15:39.767 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION_CODENAME=bionic 2021-04-22T11:15:39.768 INFO:teuthology.orchestra.run.smithi076.stdout:UBUNTU_CODENAME=bionic 2021-04-22T11:15:39.768 INFO:teuthology.lock.ops:Updating smithi076.front.sepia.ceph.com on lock server 2021-04-22T11:15:39.785 INFO:teuthology.lock.ops:Updating [smithi077.front.sepia.ceph.com]: set os type and version on server 2021-04-22T11:15:39.785 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-22T11:15:40.109 INFO:teuthology.orchestra.run.smithi077.stdout:x86_64 2021-04-22T11:15:40.157 INFO:teuthology.orchestra.run.smithi077.stdout:NAME="Ubuntu" 2021-04-22T11:15:40.157 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2021-04-22T11:15:40.157 INFO:teuthology.orchestra.run.smithi077.stdout:ID=ubuntu 2021-04-22T11:15:40.157 INFO:teuthology.orchestra.run.smithi077.stdout:ID_LIKE=debian 2021-04-22T11:15:40.158 INFO:teuthology.orchestra.run.smithi077.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2021-04-22T11:15:40.158 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_ID="18.04" 2021-04-22T11:15:40.158 INFO:teuthology.orchestra.run.smithi077.stdout:HOME_URL="https://www.ubuntu.com/" 2021-04-22T11:15:40.158 INFO:teuthology.orchestra.run.smithi077.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-04-22T11:15:40.158 INFO:teuthology.orchestra.run.smithi077.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-04-22T11:15:40.158 INFO:teuthology.orchestra.run.smithi077.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-04-22T11:15:40.158 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_CODENAME=bionic 2021-04-22T11:15:40.158 INFO:teuthology.orchestra.run.smithi077.stdout:UBUNTU_CODENAME=bionic 2021-04-22T11:15:40.158 INFO:teuthology.lock.ops:Updating smithi077.front.sepia.ceph.com on lock server 2021-04-22T11:15:40.189 INFO:teuthology.lock.ops:Updating [smithi125.front.sepia.ceph.com]: set os type and version on server 2021-04-22T11:15:40.189 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-22T11:15:40.543 INFO:teuthology.orchestra.run.smithi125.stdout:x86_64 2021-04-22T11:15:40.591 INFO:teuthology.orchestra.run.smithi125.stdout:NAME="Ubuntu" 2021-04-22T11:15:40.592 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2021-04-22T11:15:40.592 INFO:teuthology.orchestra.run.smithi125.stdout:ID=ubuntu 2021-04-22T11:15:40.592 INFO:teuthology.orchestra.run.smithi125.stdout:ID_LIKE=debian 2021-04-22T11:15:40.592 INFO:teuthology.orchestra.run.smithi125.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2021-04-22T11:15:40.592 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_ID="18.04" 2021-04-22T11:15:40.592 INFO:teuthology.orchestra.run.smithi125.stdout:HOME_URL="https://www.ubuntu.com/" 2021-04-22T11:15:40.592 INFO:teuthology.orchestra.run.smithi125.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-04-22T11:15:40.592 INFO:teuthology.orchestra.run.smithi125.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-04-22T11:15:40.592 INFO:teuthology.orchestra.run.smithi125.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-04-22T11:15:40.592 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_CODENAME=bionic 2021-04-22T11:15:40.593 INFO:teuthology.orchestra.run.smithi125.stdout:UBUNTU_CODENAME=bionic 2021-04-22T11:15:40.593 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server 2021-04-22T11:15:41.084 INFO:teuthology.dispatcher.supervisor:Running job 6062601 2021-04-22T11:15:41.085 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2021-04-21_16:43:37-fs-wip-yuri7-testing-2021-04-20-0729-octopus-distro-basic-smithi/6062601 --name yuriw-2021-04-21_16:43:37-fs-wip-yuri7-testing-2021-04-20-0729-octopus-distro-basic-smithi --description fs/multiclient/{begin clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cephfs_misc_tests} -- /home/teuthworker/archive/yuriw-2021-04-21_16:43:37-fs-wip-yuri7-testing-2021-04-20-0729-octopus-distro-basic-smithi/6062601/orig.config.yaml 2021-04-22T11:15:41.088 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2021-04-21_16:43:37-fs-wip-yuri7-testing-2021-04-20-0729-octopus-distro-basic-smithi/6062601 2021-04-22T11:15:41.089 INFO:teuthology.dispatcher.supervisor:Job PID: 21797 2021-04-22T11:15:41.089 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-04-22T17:14:40.181 ERROR:teuthology.report:POST to http://paddles.front.sepia.ceph.com/runs/yuriw-2021-04-21_16:43:37-fs-wip-yuri7-testing-2021-04-20-0729-octopus-distro-basic-smithi/jobs/ failed with status 504: 504 Gateway Time-out

504 Gateway Time-out


nginx/1.10.3 (Ubuntu)
2021-04-22T23:16:52.852 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2021-04-22T23:16:53.080 INFO:teuthology.kill:Killing Pids: {21797} 2021-04-22T23:16:54.188 INFO:teuthology.kill:Nuking machines: ['smithi068', 'smithi076', 'smithi077', 'smithi125'] 2021-04-22T23:16:55.095 INFO:teuthology.kill:2021-04-22 23:16:55,094.094 INFO:teuthology.nuke:targets: 2021-04-22T23:16:55.095 INFO:teuthology.kill: smithi068.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVrG6EV42zmKV+mCK/U0guWlMNfsjOiU22G1UtuhShbiSqw3kZRS+bzwS3Cr6n3x+OnU5rhXiOisLw78DmYSYlWQFDn7PNjgHKYsktO+cYx9o+f8dj9cKNCcIv9/eAKfsjMSz9X1EiyLjFMXGTWTCVKgk2DO2Dsfn8ZyWLObdORRb7cZ6rbVse1/1EH5KkveXvr62FHsptjf2AP7y1A2YEaTrobGRGSgWMZXHhlAz4R57UXSP4biRct1dsQISsSN/l4p19Q/WinYyCimM9gOg1zaq7enMGiBR97HMRxNjqBiTDUU/yR4E3C8pOI3r5Rr2/KFRBZK65JQWh4DKM9A7f 2021-04-22T23:16:55.095 INFO:teuthology.kill: smithi076.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtXQOoFxY4kmi+cC9pqbT0za63T+/eljRlxN1w2UNxYhPeT0468jrJX3UsUWKZMKMXYjYRB1CvYn1KqMwixMmWt+g1w4s7XVyP1KWuc6r+ynOHxcwGLxJPugGLbFi3ch7LqTJ+uv6vz+TzwJ2B1WkkNsvNA0LqzF/nv8Z/zUk67JSMepnz9nzSzwhXXqtMyIEZMcee5mREFJHbmwNKYeb9tSaZdFmvHNzUeF6I3arh5YZuAs/HS0WIccFwkEgVwxEhT6F4NlccynzfaCG4CQcQ/8BhXARy2lI7AbaMsxKfYIP29wN3rziNfzKLxYyrPqW32UxnSwF8ql5nN3+a/5wn 2021-04-22T23:16:55.095 INFO:teuthology.kill: smithi077.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC7WyAZWOfs4gqBUXWaFQqc1SgOGLplvqSARY9yGF4ZqPoO1O9HQep3x2slw3hzzb+sWFbvJDTjOn/0Mhvqo722ppSgMATOJM4fav47zfHGTzn5+/RkOY8JTuzRMb5O+R9YDYeOJAm1lngkl7VRDWDw8E1I6xFUK9SsRlT8IsM0DCz4xQG5yEDGqPsd8i+SEagHCUtxsvOavgcjVUvVlq9Ttj6GHxtm5u8ohcWJrpu4oUIibB7QhmeGQ8UOS+ApWMc/eAtM3U6NiszmJBM2rLGMyrsvjrNVTATZMK3mNFvfpcXRl+BBAX2w7IAJHIHNq+s2k4lJbF2DtNjolu5BD4o3 2021-04-22T23:16:55.095 INFO:teuthology.kill: smithi125.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCe0zs6FbSgsrRY4kucnEzhwED8XF4fvFDmkE9G0Okw01HmdqlXNKpqdZW4v0E1lnBJPh/E2lMopAHXbw88xT2Va45N1bM69F/OnY26fMm8GLBl/0HvJOaaOxBnRlrNGjMqs/X9H8MhilJpWmIqOX9a8/W+r8iR8sdUAy/Nm/SUNaTJ+ygezdqP56E2deFEp87J5z3XKQ1CIFVuUeE9CMQKSgWaTvETXbXu4kWCdNYuVEW3ywcLFWiCMICDBNjjs/Fm30F68f069nkiM2iMB9dXN6ME+87kse4i/SsxhCoFOdGC1OeDN+8HRQaQgtXvP7H0DXQEd+CV6hifQbQVQOw5 2021-04-22T23:16:55.095 INFO:teuthology.kill:2021-04-22 23:16:55,095.095 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-04-22T23:16:55.097 INFO:teuthology.kill:2021-04-22 23:16:55,097.097 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-04-22T23:16:55.098 INFO:teuthology.kill:2021-04-22 23:16:55,098.098 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-04-22T23:16:55.100 INFO:teuthology.kill:2021-04-22 23:16:55,099.099 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-04-22T23:16:55.232 INFO:teuthology.kill:2021-04-22 23:16:55,232.232 INFO:teuthology.orchestra.console:Power off smithi077 2021-04-22T23:16:55.246 INFO:teuthology.kill:2021-04-22 23:16:55,246.246 INFO:teuthology.orchestra.console:Power off smithi076 2021-04-22T23:16:55.284 INFO:teuthology.kill:2021-04-22 23:16:55,284.284 INFO:teuthology.orchestra.console:Power off smithi068 2021-04-22T23:16:55.298 INFO:teuthology.kill:2021-04-22 23:16:55,297.297 INFO:teuthology.orchestra.console:Power off smithi125 2021-04-22T23:17:03.621 INFO:teuthology.kill:2021-04-22 23:17:03,620.620 INFO:teuthology.orchestra.console:Power off for smithi076 completed 2021-04-22T23:17:03.642 INFO:teuthology.kill:2021-04-22 23:17:03,642.642 INFO:teuthology.orchestra.console:Power off for smithi068 completed 2021-04-22T23:17:07.714 INFO:teuthology.kill:2021-04-22 23:17:07,714.714 INFO:teuthology.orchestra.console:Power off for smithi077 completed 2021-04-22T23:17:07.768 INFO:teuthology.kill:2021-04-22 23:17:07,767.767 INFO:teuthology.orchestra.console:Power off for smithi125 completed 2021-04-22T23:17:07.991 INFO:teuthology.task.internal:roles: ubuntu@smithi068.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2021-04-22T23:17:07.991 INFO:teuthology.task.internal:roles: ubuntu@smithi076.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2021-04-22T23:17:07.991 INFO:teuthology.task.internal:roles: ubuntu@smithi077.front.sepia.ceph.com - ['client.0'] 2021-04-22T23:17:07.992 INFO:teuthology.task.internal:roles: ubuntu@smithi125.front.sepia.ceph.com - ['client.1'] 2021-04-22T23:17:07.992 INFO:teuthology.misc:Compressing logs... 2021-04-22T23:17:07.992 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-22T23:18:08.036 ERROR:teuthology.dispatcher.supervisor:Could not save logs Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog teuth_config.archive_base, job_config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives compress_logs(ctx, log_path) File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/misc.py", line 1378, in compress_logs wait=False, File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/orchestra/cluster.py", line 64, in run return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/orchestra/cluster.py", line 64, in return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/orchestra/remote.py", line 215, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/orchestra/run.py", line 434, in run transport = client.get_transport() AttributeError: 'NoneType' object has no attribute 'get_transport' 2021-04-22T23:18:08.109 INFO:teuthology.kill:No teuthology processes running 2021-04-22T23:18:26.849 INFO:teuthology.kill:Nuking machines: ['smithi068', 'smithi076', 'smithi077', 'smithi125'] 2021-04-22T23:18:27.853 INFO:teuthology.kill:2021-04-22 23:18:27,852.852 INFO:teuthology.nuke:targets: 2021-04-22T23:18:27.853 INFO:teuthology.kill: smithi068.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVrG6EV42zmKV+mCK/U0guWlMNfsjOiU22G1UtuhShbiSqw3kZRS+bzwS3Cr6n3x+OnU5rhXiOisLw78DmYSYlWQFDn7PNjgHKYsktO+cYx9o+f8dj9cKNCcIv9/eAKfsjMSz9X1EiyLjFMXGTWTCVKgk2DO2Dsfn8ZyWLObdORRb7cZ6rbVse1/1EH5KkveXvr62FHsptjf2AP7y1A2YEaTrobGRGSgWMZXHhlAz4R57UXSP4biRct1dsQISsSN/l4p19Q/WinYyCimM9gOg1zaq7enMGiBR97HMRxNjqBiTDUU/yR4E3C8pOI3r5Rr2/KFRBZK65JQWh4DKM9A7f 2021-04-22T23:18:27.853 INFO:teuthology.kill: smithi076.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtXQOoFxY4kmi+cC9pqbT0za63T+/eljRlxN1w2UNxYhPeT0468jrJX3UsUWKZMKMXYjYRB1CvYn1KqMwixMmWt+g1w4s7XVyP1KWuc6r+ynOHxcwGLxJPugGLbFi3ch7LqTJ+uv6vz+TzwJ2B1WkkNsvNA0LqzF/nv8Z/zUk67JSMepnz9nzSzwhXXqtMyIEZMcee5mREFJHbmwNKYeb9tSaZdFmvHNzUeF6I3arh5YZuAs/HS0WIccFwkEgVwxEhT6F4NlccynzfaCG4CQcQ/8BhXARy2lI7AbaMsxKfYIP29wN3rziNfzKLxYyrPqW32UxnSwF8ql5nN3+a/5wn 2021-04-22T23:18:27.853 INFO:teuthology.kill: smithi077.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC7WyAZWOfs4gqBUXWaFQqc1SgOGLplvqSARY9yGF4ZqPoO1O9HQep3x2slw3hzzb+sWFbvJDTjOn/0Mhvqo722ppSgMATOJM4fav47zfHGTzn5+/RkOY8JTuzRMb5O+R9YDYeOJAm1lngkl7VRDWDw8E1I6xFUK9SsRlT8IsM0DCz4xQG5yEDGqPsd8i+SEagHCUtxsvOavgcjVUvVlq9Ttj6GHxtm5u8ohcWJrpu4oUIibB7QhmeGQ8UOS+ApWMc/eAtM3U6NiszmJBM2rLGMyrsvjrNVTATZMK3mNFvfpcXRl+BBAX2w7IAJHIHNq+s2k4lJbF2DtNjolu5BD4o3 2021-04-22T23:18:27.853 INFO:teuthology.kill: smithi125.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCe0zs6FbSgsrRY4kucnEzhwED8XF4fvFDmkE9G0Okw01HmdqlXNKpqdZW4v0E1lnBJPh/E2lMopAHXbw88xT2Va45N1bM69F/OnY26fMm8GLBl/0HvJOaaOxBnRlrNGjMqs/X9H8MhilJpWmIqOX9a8/W+r8iR8sdUAy/Nm/SUNaTJ+ygezdqP56E2deFEp87J5z3XKQ1CIFVuUeE9CMQKSgWaTvETXbXu4kWCdNYuVEW3ywcLFWiCMICDBNjjs/Fm30F68f069nkiM2iMB9dXN6ME+87kse4i/SsxhCoFOdGC1OeDN+8HRQaQgtXvP7H0DXQEd+CV6hifQbQVQOw5 2021-04-22T23:18:27.880 INFO:teuthology.kill:2021-04-22 23:18:27,880.880 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-04-22T23:18:27.892 INFO:teuthology.kill:2021-04-22 23:18:27,892.892 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-04-22T23:18:27.904 INFO:teuthology.kill:2021-04-22 23:18:27,904.904 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-04-22T23:18:27.915 INFO:teuthology.kill:2021-04-22 23:18:27,915.915 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-04-22T23:18:28.057 INFO:teuthology.kill:2021-04-22 23:18:28,057.057 INFO:teuthology.orchestra.console:Power off smithi077 2021-04-22T23:18:28.073 INFO:teuthology.kill:2021-04-22 23:18:28,073.073 INFO:teuthology.orchestra.console:Power off smithi076 2021-04-22T23:18:28.088 INFO:teuthology.kill:2021-04-22 23:18:28,087.087 INFO:teuthology.orchestra.console:Power off smithi068 2021-04-22T23:18:28.102 INFO:teuthology.kill:2021-04-22 23:18:28,101.101 INFO:teuthology.orchestra.console:Power off smithi125 2021-04-22T23:18:28.236 INFO:teuthology.kill:2021-04-22 23:18:28,235.235 INFO:teuthology.orchestra.console:Power off for smithi068 completed 2021-04-22T23:18:28.236 INFO:teuthology.kill:2021-04-22 23:18:28,236.236 INFO:teuthology.orchestra.console:Power off for smithi077 completed 2021-04-22T23:18:28.241 INFO:teuthology.kill:2021-04-22 23:18:28,241.241 INFO:teuthology.orchestra.console:Power off for smithi076 completed 2021-04-22T23:18:28.248 INFO:teuthology.kill:2021-04-22 23:18:28,248.248 INFO:teuthology.orchestra.console:Power off for smithi125 completed 2021-04-22T23:18:28.415 INFO:teuthology.kill:2021-04-22 23:18:28,414.414 INFO:teuthology.lock.ops:unlocked smithi068.front.sepia.ceph.com 2021-04-22T23:18:28.431 INFO:teuthology.kill:2021-04-22 23:18:28,431.431 INFO:teuthology.lock.ops:unlocked smithi077.front.sepia.ceph.com 2021-04-22T23:18:28.447 INFO:teuthology.kill:2021-04-22 23:18:28,446.446 INFO:teuthology.lock.ops:unlocked smithi076.front.sepia.ceph.com 2021-04-22T23:18:28.465 INFO:teuthology.kill:2021-04-22 23:18:28,465.465 INFO:teuthology.lock.ops:unlocked smithi125.front.sepia.ceph.com 2021-04-22T23:20:28.759 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2021-04-22T23:20:28.879 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2021-04-22T23:20:28.879 INFO:teuthology.nuke:Checking targets against current locks 2021-04-22T23:20:28.988 INFO:teuthology.nuke:Not nuking smithi076.front.sepia.ceph.com because description doesn't match 2021-04-22T23:20:28.988 INFO:teuthology.nuke:Not nuking smithi077.front.sepia.ceph.com because description doesn't match 2021-04-22T23:20:28.988 INFO:teuthology.nuke:Not nuking smithi125.front.sepia.ceph.com because description doesn't match 2021-04-22T23:20:28.988 INFO:teuthology.nuke:Not nuking smithi068.front.sepia.ceph.com because description doesn't match