2021-12-11T13:27:12.657 INFO:root:teuthology version: 1.1.0-95a7d479 2021-12-11T13:27:12.817 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi148.front.sepia.ceph.com' reimaging 2021-12-11T13:27:12.819 INFO:teuthology.lock.ops:Updating [ubuntu@smithi148.front.sepia.ceph.com]: reset os type and version on server 2021-12-11T13:27:12.819 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server 2021-12-11T13:27:12.840 INFO:teuthology.lock.ops:Node 'ubuntu@smithi148.front.sepia.ceph.com' reimaging is complete 2021-12-11T13:27:12.841 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi167.front.sepia.ceph.com' reimaging 2021-12-11T13:27:12.841 INFO:teuthology.lock.ops:Updating [ubuntu@smithi167.front.sepia.ceph.com]: reset os type and version on server 2021-12-11T13:27:12.841 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2021-12-11T13:27:12.864 INFO:teuthology.lock.ops:Node 'ubuntu@smithi167.front.sepia.ceph.com' reimaging is complete 2021-12-11T13:27:12.864 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi183.front.sepia.ceph.com' reimaging 2021-12-11T13:27:12.865 INFO:teuthology.lock.ops:Updating [ubuntu@smithi183.front.sepia.ceph.com]: reset os type and version on server 2021-12-11T13:27:12.865 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server 2021-12-11T13:27:12.887 INFO:teuthology.lock.ops:Node 'ubuntu@smithi183.front.sepia.ceph.com' reimaging is complete 2021-12-11T13:27:13.067 INFO:teuthology.provision.fog.smithi148:Scheduling deploy of ubuntu 20.04 2021-12-11T13:27:13.090 INFO:teuthology.provision.fog.smithi167:Scheduling deploy of ubuntu 20.04 2021-12-11T13:27:13.101 INFO:teuthology.provision.fog.smithi183:Scheduling deploy of ubuntu 20.04 2021-12-11T13:27:13.401 INFO:teuthology.orchestra.console:Power off smithi148 2021-12-11T13:27:13.421 INFO:teuthology.orchestra.console:Power off smithi167 2021-12-11T13:27:13.434 INFO:teuthology.orchestra.console:Power off smithi183 2021-12-11T13:27:25.915 INFO:teuthology.orchestra.console:Power off for smithi148 completed 2021-12-11T13:27:25.922 INFO:teuthology.orchestra.console:Power off for smithi167 completed 2021-12-11T13:27:25.929 INFO:teuthology.orchestra.console:Power off for smithi183 completed 2021-12-11T13:27:26.017 INFO:teuthology.orchestra.console:Power on smithi148 2021-12-11T13:27:26.026 INFO:teuthology.orchestra.console:Power on smithi167 2021-12-11T13:27:26.033 INFO:teuthology.orchestra.console:Power on smithi183 2021-12-11T13:27:30.282 INFO:teuthology.orchestra.console:Power on for smithi148 completed 2021-12-11T13:27:30.384 INFO:teuthology.provision.fog.smithi148:Waiting for deploy to finish 2021-12-11T13:27:34.402 INFO:teuthology.orchestra.console:Power on for smithi167 completed 2021-12-11T13:27:34.426 INFO:teuthology.orchestra.console:Power on for smithi183 completed 2021-12-11T13:27:34.504 INFO:teuthology.provision.fog.smithi167:Waiting for deploy to finish 2021-12-11T13:27:34.528 INFO:teuthology.provision.fog.smithi183:Waiting for deploy to finish 2021-12-11T13:33:19.357 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-12-11T13:33:19.883 INFO:teuthology.provision.fog.smithi148:Node is ready 2021-12-11T13:33:19.889 INFO:teuthology.orchestra.run.smithi148.stdout:smithi148.front.sepia.ceph.com 2021-12-11T13:33:19.898 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148 smithi148.front.sepia.ceph.com smithi148 2021-12-11T13:33:20.082 INFO:teuthology.provision.fog.smithi148:Deploy complete! 2021-12-11T13:33:21.467 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-12-11T13:33:22.034 INFO:teuthology.provision.fog.smithi183:Node is ready 2021-12-11T13:33:22.083 INFO:teuthology.orchestra.run.smithi183.stdout:smithi183.front.sepia.ceph.com 2021-12-11T13:33:22.090 INFO:teuthology.orchestra.run.smithi183.stdout:172.21.15.183 smithi183.front.sepia.ceph.com smithi183 2021-12-11T13:33:22.248 INFO:teuthology.provision.fog.smithi183:Deploy complete! 2021-12-11T13:33:24.577 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-12-11T13:33:25.150 INFO:teuthology.provision.fog.smithi167:Node is ready 2021-12-11T13:33:25.157 INFO:teuthology.orchestra.run.smithi167.stdout:smithi167.front.sepia.ceph.com 2021-12-11T13:33:25.164 INFO:teuthology.orchestra.run.smithi167.stdout:172.21.15.167 smithi167.front.sepia.ceph.com smithi167 2021-12-11T13:33:25.373 INFO:teuthology.provision.fog.smithi167:Deploy complete! 2021-12-11T13:33:25.605 INFO:teuthology.lock.ops:Checking smithi148.front.sepia.ceph.com 2021-12-11T13:33:25.606 INFO:teuthology.lock.ops:New key found. Updating... 2021-12-11T13:33:25.632 INFO:teuthology.lock.ops:Checking smithi167.front.sepia.ceph.com 2021-12-11T13:33:25.632 INFO:teuthology.lock.ops:New key found. Updating... 2021-12-11T13:33:25.651 INFO:teuthology.lock.ops:Checking smithi183.front.sepia.ceph.com 2021-12-11T13:33:25.652 INFO:teuthology.lock.ops:New key found. Updating... 2021-12-11T13:33:25.670 INFO:teuthology.lock.ops:Updating [smithi148.front.sepia.ceph.com]: set os type and version on server 2021-12-11T13:33:25.671 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2021-12-11T13:33:25.842 INFO:teuthology.orchestra.run.smithi148.stdout:x86_64 2021-12-11T13:33:25.849 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="Ubuntu" 2021-12-11T13:33:25.849 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2021-12-11T13:33:25.849 INFO:teuthology.orchestra.run.smithi148.stdout:ID=ubuntu 2021-12-11T13:33:25.849 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE=debian 2021-12-11T13:33:25.850 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2021-12-11T13:33:25.850 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="20.04" 2021-12-11T13:33:25.850 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://www.ubuntu.com/" 2021-12-11T13:33:25.850 INFO:teuthology.orchestra.run.smithi148.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-12-11T13:33:25.851 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-12-11T13:33:25.851 INFO:teuthology.orchestra.run.smithi148.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-12-11T13:33:25.851 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_CODENAME=focal 2021-12-11T13:33:25.851 INFO:teuthology.orchestra.run.smithi148.stdout:UBUNTU_CODENAME=focal 2021-12-11T13:33:25.853 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server 2021-12-11T13:33:25.874 INFO:teuthology.lock.ops:Updating [smithi167.front.sepia.ceph.com]: set os type and version on server 2021-12-11T13:33:25.875 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2021-12-11T13:33:26.059 INFO:teuthology.orchestra.run.smithi167.stdout:x86_64 2021-12-11T13:33:26.065 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="Ubuntu" 2021-12-11T13:33:26.065 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2021-12-11T13:33:26.065 INFO:teuthology.orchestra.run.smithi167.stdout:ID=ubuntu 2021-12-11T13:33:26.065 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE=debian 2021-12-11T13:33:26.066 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2021-12-11T13:33:26.066 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="20.04" 2021-12-11T13:33:26.066 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://www.ubuntu.com/" 2021-12-11T13:33:26.066 INFO:teuthology.orchestra.run.smithi167.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-12-11T13:33:26.067 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-12-11T13:33:26.067 INFO:teuthology.orchestra.run.smithi167.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-12-11T13:33:26.067 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_CODENAME=focal 2021-12-11T13:33:26.067 INFO:teuthology.orchestra.run.smithi167.stdout:UBUNTU_CODENAME=focal 2021-12-11T13:33:26.068 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2021-12-11T13:33:26.088 INFO:teuthology.lock.ops:Updating [smithi183.front.sepia.ceph.com]: set os type and version on server 2021-12-11T13:33:26.088 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com' 2021-12-11T13:33:26.279 INFO:teuthology.orchestra.run.smithi183.stdout:x86_64 2021-12-11T13:33:26.327 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="Ubuntu" 2021-12-11T13:33:26.328 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2021-12-11T13:33:26.328 INFO:teuthology.orchestra.run.smithi183.stdout:ID=ubuntu 2021-12-11T13:33:26.329 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE=debian 2021-12-11T13:33:26.329 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2021-12-11T13:33:26.330 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="20.04" 2021-12-11T13:33:26.330 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://www.ubuntu.com/" 2021-12-11T13:33:26.330 INFO:teuthology.orchestra.run.smithi183.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-12-11T13:33:26.331 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-12-11T13:33:26.331 INFO:teuthology.orchestra.run.smithi183.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-12-11T13:33:26.332 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_CODENAME=focal 2021-12-11T13:33:26.332 INFO:teuthology.orchestra.run.smithi183.stdout:UBUNTU_CODENAME=focal 2021-12-11T13:33:26.333 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server 2021-12-11T13:33:26.434 INFO:teuthology.dispatcher.supervisor:Running job 6558255 2021-12-11T13:33:26.434 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2021-12-11_13:15:03-multimds-octopus-distro-default-smithi/6558255 --name teuthology-2021-12-11_13:15:03-multimds-octopus-distro-default-smithi --description multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_kernel_untar_build} -- /home/teuthworker/archive/teuthology-2021-12-11_13:15:03-multimds-octopus-distro-default-smithi/6558255/orig.config.yaml 2021-12-11T13:33:26.437 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2021-12-11_13:15:03-multimds-octopus-distro-default-smithi/6558255 2021-12-11T13:33:26.438 INFO:teuthology.dispatcher.supervisor:Job PID: 15033 2021-12-11T13:33:26.438 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-12-12T01:34:15.546 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2021-12-12T01:34:15.706 INFO:teuthology.kill:Killing Pids: {15033} 2021-12-12T01:34:16.908 INFO:teuthology.task.internal:roles: ubuntu@smithi148.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'mds.a', 'mds.b', 'mds.c', 'mds.d', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2021-12-12T01:34:16.909 INFO:teuthology.task.internal:roles: ubuntu@smithi167.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'mds.e', 'mds.f', 'mds.g', 'mds.h', 'mds.i', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2021-12-12T01:34:16.909 INFO:teuthology.task.internal:roles: ubuntu@smithi183.front.sepia.ceph.com - ['client.0', 'client.1'] 2021-12-12T01:34:16.910 INFO:teuthology.misc:Compressing logs... 2021-12-12T01:34:16.910 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2021-12-12T01:34:17.410 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2021-12-12T01:34:17.730 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com' 2021-12-12T01:34:18.382 INFO:teuthology.kill:No teuthology processes running 2021-12-12T01:34:19.426 INFO:teuthology.kill:Nuking machines: ['smithi148', 'smithi167', 'smithi183'] 2021-12-12T01:34:20.343 INFO:teuthology.kill:2021-12-12 01:34:20,343.343 INFO:teuthology.nuke:targets: 2021-12-12T01:34:20.344 INFO:teuthology.kill: smithi148.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFtSNI/Z11SNs5S/CQZMhKPkpRzvl0Kj8kAjfS6CiNhHYlCd4onKJtp+q73mbxqnQbEKw92zCieUJjC7lrC/+KwvjJ6JUbYw6QT99kqu6ydUa9Yq7zwHDthSbyaLDuQI3Y4HWMBAxUz0cMdZAFpFpCi5R8qR4BWGC0JQ2wPsORmOl+d34ksQByNx0+EnO57Yha4IucZFfJk06AO4JI/d176BRJCLUwfCRAWOUQpsFLj0w3eEwWu/RYwlQQFsPYNDgVEbmfYT6mUc5NO3gU6Kb8lAgylS+/eVN+j2Bnvx6NFV9uIwDoxD0f+PIKqlix57UwDd2IonCczQHR/BfM37+Ie4ukQExwMg4XQbI0fhw6FktG/yyYTS3gYXgTa+9RXlD+u0ZyBYXO3BqHmH1syzsWjNMPer6/JpodP5YqoLDniVUfMykveLwGugPUp7WORReMXlelZkZePW0Wb3Ed1hGqht5bAoaN5dCrEu4SQmq8NEQjWHYFvEwjLBRLIwPL0SM= 2021-12-12T01:34:20.344 INFO:teuthology.kill: smithi167.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDe+qQFGIuLaIHQ1vqjekIfxsbhTFFsP4BXD3gDuNMxMg8dx9bjx2WWUm32PZRIqzcoFcPRmpp7GbdGHyAI4AiSAqxzWStboLIxy2NyP0zfSsYlzsyxgacWF7mStbYl0YTsSqj+yoKgtT37Xw39666C6FsbPbyy48MMiTqjN+D5PZt99uDqCPYZtO5rNgQ1a02wXPYKSigQ6ePGNtVArG+rT/PKDSOv1UyJp6JY/cLgubgbU/T5ZZ0qpA+vVc2bTHVB5b3txSkQZ0HyxGPPrvFSJ+y+6rPWSNFH6KKP/MxdJXl75jt6DzT6ibRNnSpKRFtGWJ7t+AKKkyMDL0i3LQLdKM+kOoyViV22viWxEe25cdk4EkahGb7SB5VsHnsFsg4Qtp2DE5f9L717uMSbuqs3M1Npg5LO/lqLYZI/7cS9n+mGFG5TXMPyu1/LDrlfoTPbqf8voAlpMQZlS3qRwcxAp/Divz426b5NbBVqbcWw00H7yDW5uUaPAFEp8GmtNWE= 2021-12-12T01:34:20.345 INFO:teuthology.kill: smithi183.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDIzLzUN+SANHZswFYZE7Jo4IGhTR+Mkmm6q0dol9zqJgCvigXraSowdw00STgtrneGlggoF2K8vb1N8I/rPji15mQbUwmBzyCE/yNSo8DzvuMGv/2pwsKP0196l7urE3+A+TulFKNe1hN0KEDqx+Vv9usm0dxWObg/UBbeGxgMXQjupcPlJPVmLGMNqeTnqaZSbkml2Xj45WDono51Da65o8xVpunH7NE5OOGdcwasGUN+9ssENEQNJM376jwXeyK3OHEkzr8ycRaaqRhiA4By9YoxKknUHQuojLrjYtcdNMNMsgHD7PevJMiwl6pvsesE07XtpAuuTY1d+bExoV8P96LIYwnL01ji47uGsdxs3XULqOzxj9pAX/O7IVIGtA2k4a5fui7405rL7m5TvkszBciKv8F5M+2ODxvY8fOJRYQ05FEIoU9LohHQ5lWfOWwHxKZ3x68S/e/cNu8KVbEs6mdFuOrUCgwzLB3TLqUvRsNpVecEmASgDN9gUDpkAN8= 2021-12-12T01:34:20.375 INFO:teuthology.kill:2021-12-12 01:34:20,374.374 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-12-12T01:34:20.380 INFO:teuthology.kill:2021-12-12 01:34:20,380.380 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-12-12T01:34:20.383 INFO:teuthology.kill:2021-12-12 01:34:20,383.383 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-12-12T01:34:20.459 INFO:teuthology.kill:2021-12-12 01:34:20,459.459 INFO:teuthology.orchestra.console:Power off smithi183 2021-12-12T01:34:20.471 INFO:teuthology.kill:2021-12-12 01:34:20,471.471 INFO:teuthology.orchestra.console:Power off smithi148 2021-12-12T01:34:20.485 INFO:teuthology.kill:2021-12-12 01:34:20,484.484 INFO:teuthology.orchestra.console:Power off smithi167 2021-12-12T01:34:28.851 INFO:teuthology.kill:2021-12-12 01:34:28,850.850 INFO:teuthology.orchestra.console:Power off for smithi167 completed 2021-12-12T01:34:29.004 INFO:teuthology.kill:2021-12-12 01:34:29,003.003 INFO:teuthology.lock.ops:unlocked: smithi167.front.sepia.ceph.com 2021-12-12T01:34:32.953 INFO:teuthology.kill:2021-12-12 01:34:32,953.953 INFO:teuthology.orchestra.console:Power off for smithi183 completed 2021-12-12T01:34:32.958 INFO:teuthology.kill:2021-12-12 01:34:32,958.958 INFO:teuthology.orchestra.console:Power off for smithi148 completed 2021-12-12T01:34:33.109 INFO:teuthology.kill:2021-12-12 01:34:33,109.109 INFO:teuthology.lock.ops:unlocked: smithi183.front.sepia.ceph.com 2021-12-12T01:34:33.113 INFO:teuthology.kill:2021-12-12 01:34:33,113.113 INFO:teuthology.lock.ops:unlocked: smithi148.front.sepia.ceph.com 2021-12-12T01:36:33.439 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15