2022-03-14T06:12:49.846 INFO:root:teuthology version: 1.1.0-fbfc7b38 2022-03-14T06:12:49.993 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi089.front.sepia.ceph.com' reimaging 2022-03-14T06:12:49.994 INFO:teuthology.lock.ops:Updating [ubuntu@smithi089.front.sepia.ceph.com]: reset os type and version on server 2022-03-14T06:12:49.994 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server 2022-03-14T06:12:50.012 INFO:teuthology.lock.ops:Node 'ubuntu@smithi089.front.sepia.ceph.com' reimaging is complete 2022-03-14T06:12:50.012 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi105.front.sepia.ceph.com' reimaging 2022-03-14T06:12:50.013 INFO:teuthology.lock.ops:Updating [ubuntu@smithi105.front.sepia.ceph.com]: reset os type and version on server 2022-03-14T06:12:50.013 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server 2022-03-14T06:12:50.031 INFO:teuthology.lock.ops:Node 'ubuntu@smithi105.front.sepia.ceph.com' reimaging is complete 2022-03-14T06:12:50.031 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi185.front.sepia.ceph.com' reimaging 2022-03-14T06:12:50.032 INFO:teuthology.lock.ops:Updating [ubuntu@smithi185.front.sepia.ceph.com]: reset os type and version on server 2022-03-14T06:12:50.032 INFO:teuthology.lock.ops:Updating smithi185.front.sepia.ceph.com on lock server 2022-03-14T06:12:50.050 INFO:teuthology.lock.ops:Node 'ubuntu@smithi185.front.sepia.ceph.com' reimaging is complete 2022-03-14T06:12:50.237 INFO:teuthology.provision.fog.smithi105:Scheduling deploy of ubuntu 20.04 2022-03-14T06:12:50.260 INFO:teuthology.provision.fog.smithi089:Scheduling deploy of ubuntu 20.04 2022-03-14T06:12:50.266 INFO:teuthology.provision.fog.smithi185:Scheduling deploy of ubuntu 20.04 2022-03-14T06:12:50.659 INFO:teuthology.orchestra.console:Power off smithi105 2022-03-14T06:12:50.674 INFO:teuthology.orchestra.console:Power off smithi089 2022-03-14T06:12:50.716 INFO:teuthology.orchestra.console:Power off smithi185 2022-03-14T06:13:03.144 INFO:teuthology.orchestra.console:Power off for smithi105 completed 2022-03-14T06:13:03.149 INFO:teuthology.orchestra.console:Power off for smithi089 completed 2022-03-14T06:13:03.177 INFO:teuthology.orchestra.console:Power off for smithi185 completed 2022-03-14T06:13:03.245 INFO:teuthology.orchestra.console:Power on smithi105 2022-03-14T06:13:03.252 INFO:teuthology.orchestra.console:Power on smithi089 2022-03-14T06:13:03.278 INFO:teuthology.orchestra.console:Power on smithi185 2022-03-14T06:13:07.498 INFO:teuthology.orchestra.console:Power on for smithi105 completed 2022-03-14T06:13:07.504 INFO:teuthology.orchestra.console:Power on for smithi089 completed 2022-03-14T06:13:07.525 INFO:teuthology.orchestra.console:Power on for smithi185 completed 2022-03-14T06:13:07.600 INFO:teuthology.provision.fog.smithi105:Waiting for deploy to finish 2022-03-14T06:13:07.604 INFO:teuthology.provision.fog.smithi089:Waiting for deploy to finish 2022-03-14T06:13:07.626 INFO:teuthology.provision.fog.smithi185:Waiting for deploy to finish 2022-03-14T06:18:06.119 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-03-14T06:18:06.604 INFO:teuthology.provision.fog.smithi089:Node is ready 2022-03-14T06:18:06.652 INFO:teuthology.orchestra.run.smithi089.stdout:smithi089.front.sepia.ceph.com 2022-03-14T06:18:06.662 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89 smithi089.front.sepia.ceph.com smithi089 2022-03-14T06:18:06.881 INFO:teuthology.provision.fog.smithi089:Deploy complete! 2022-03-14T06:18:14.051 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-03-14T06:18:14.079 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-03-14T06:18:14.536 INFO:teuthology.provision.fog.smithi105:Node is ready 2022-03-14T06:18:14.538 INFO:teuthology.provision.fog.smithi185:Node is ready 2022-03-14T06:18:14.545 INFO:teuthology.orchestra.run.smithi185.stdout:smithi185.front.sepia.ceph.com 2022-03-14T06:18:14.584 INFO:teuthology.orchestra.run.smithi105.stdout:smithi105.front.sepia.ceph.com 2022-03-14T06:18:14.591 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.15.105 smithi105.front.sepia.ceph.com smithi105 2022-03-14T06:18:14.593 INFO:teuthology.orchestra.run.smithi185.stdout:172.21.15.185 smithi185.front.sepia.ceph.com smithi185 2022-03-14T06:18:14.789 INFO:teuthology.provision.fog.smithi185:Deploy complete! 2022-03-14T06:18:14.791 INFO:teuthology.provision.fog.smithi105:Deploy complete! 2022-03-14T06:18:15.062 INFO:teuthology.lock.ops:Checking smithi089.front.sepia.ceph.com 2022-03-14T06:18:15.063 INFO:teuthology.lock.ops:New key found. Updating... 2022-03-14T06:18:15.081 INFO:teuthology.lock.ops:Checking smithi105.front.sepia.ceph.com 2022-03-14T06:18:15.082 INFO:teuthology.lock.ops:New key found. Updating... 2022-03-14T06:18:15.101 INFO:teuthology.lock.ops:Checking smithi185.front.sepia.ceph.com 2022-03-14T06:18:15.101 INFO:teuthology.lock.ops:New key found. Updating... 2022-03-14T06:18:15.121 INFO:teuthology.lock.ops:Updating [smithi089.front.sepia.ceph.com]: set os type and version on server 2022-03-14T06:18:15.121 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2022-03-14T06:18:15.303 INFO:teuthology.orchestra.run.smithi089.stdout:x86_64 2022-03-14T06:18:15.351 INFO:teuthology.orchestra.run.smithi089.stdout:NAME="Ubuntu" 2022-03-14T06:18:15.352 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2022-03-14T06:18:15.352 INFO:teuthology.orchestra.run.smithi089.stdout:ID=ubuntu 2022-03-14T06:18:15.352 INFO:teuthology.orchestra.run.smithi089.stdout:ID_LIKE=debian 2022-03-14T06:18:15.352 INFO:teuthology.orchestra.run.smithi089.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2022-03-14T06:18:15.353 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_ID="20.04" 2022-03-14T06:18:15.353 INFO:teuthology.orchestra.run.smithi089.stdout:HOME_URL="https://www.ubuntu.com/" 2022-03-14T06:18:15.353 INFO:teuthology.orchestra.run.smithi089.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-03-14T06:18:15.353 INFO:teuthology.orchestra.run.smithi089.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-03-14T06:18:15.353 INFO:teuthology.orchestra.run.smithi089.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-03-14T06:18:15.354 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_CODENAME=focal 2022-03-14T06:18:15.354 INFO:teuthology.orchestra.run.smithi089.stdout:UBUNTU_CODENAME=focal 2022-03-14T06:18:15.355 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server 2022-03-14T06:18:15.374 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: set os type and version on server 2022-03-14T06:18:15.374 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com' 2022-03-14T06:18:15.556 INFO:teuthology.orchestra.run.smithi105.stdout:x86_64 2022-03-14T06:18:15.563 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="Ubuntu" 2022-03-14T06:18:15.564 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2022-03-14T06:18:15.564 INFO:teuthology.orchestra.run.smithi105.stdout:ID=ubuntu 2022-03-14T06:18:15.565 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE=debian 2022-03-14T06:18:15.565 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2022-03-14T06:18:15.565 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="20.04" 2022-03-14T06:18:15.565 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://www.ubuntu.com/" 2022-03-14T06:18:15.565 INFO:teuthology.orchestra.run.smithi105.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-03-14T06:18:15.566 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-03-14T06:18:15.566 INFO:teuthology.orchestra.run.smithi105.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-03-14T06:18:15.566 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_CODENAME=focal 2022-03-14T06:18:15.566 INFO:teuthology.orchestra.run.smithi105.stdout:UBUNTU_CODENAME=focal 2022-03-14T06:18:15.567 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server 2022-03-14T06:18:15.589 INFO:teuthology.lock.ops:Updating [smithi185.front.sepia.ceph.com]: set os type and version on server 2022-03-14T06:18:15.590 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi185.front.sepia.ceph.com' 2022-03-14T06:18:15.764 INFO:teuthology.orchestra.run.smithi185.stdout:x86_64 2022-03-14T06:18:15.815 INFO:teuthology.orchestra.run.smithi185.stdout:NAME="Ubuntu" 2022-03-14T06:18:15.815 INFO:teuthology.orchestra.run.smithi185.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2022-03-14T06:18:15.816 INFO:teuthology.orchestra.run.smithi185.stdout:ID=ubuntu 2022-03-14T06:18:15.816 INFO:teuthology.orchestra.run.smithi185.stdout:ID_LIKE=debian 2022-03-14T06:18:15.816 INFO:teuthology.orchestra.run.smithi185.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2022-03-14T06:18:15.816 INFO:teuthology.orchestra.run.smithi185.stdout:VERSION_ID="20.04" 2022-03-14T06:18:15.817 INFO:teuthology.orchestra.run.smithi185.stdout:HOME_URL="https://www.ubuntu.com/" 2022-03-14T06:18:15.818 INFO:teuthology.orchestra.run.smithi185.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-03-14T06:18:15.818 INFO:teuthology.orchestra.run.smithi185.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-03-14T06:18:15.818 INFO:teuthology.orchestra.run.smithi185.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-03-14T06:18:15.818 INFO:teuthology.orchestra.run.smithi185.stdout:VERSION_CODENAME=focal 2022-03-14T06:18:15.818 INFO:teuthology.orchestra.run.smithi185.stdout:UBUNTU_CODENAME=focal 2022-03-14T06:18:15.819 INFO:teuthology.lock.ops:Updating smithi185.front.sepia.ceph.com on lock server 2022-03-14T06:18:15.911 INFO:teuthology.dispatcher.supervisor:Running job 6735418 2022-03-14T06:18:15.912 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_fbfc7b381c1d662565abb9d3552d468766bf123c/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2022-03-14_06:07:02-rbd-pacific-distro-default-smithi/6735418 --name teuthology-2022-03-14_06:07:02-rbd-pacific-distro-default-smithi --description rbd/qemu/{cache/none clusters/{fixed-3 openstack} features/journaling msgr-failures/few objectstore/bluestore-stupid pool/replicated-data-pool supported-random-distro$/{ubuntu_latest} workloads/qemu_xfstests} -- /home/teuthworker/archive/teuthology-2022-03-14_06:07:02-rbd-pacific-distro-default-smithi/6735418/orig.config.yaml 2022-03-14T06:18:15.915 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2022-03-14_06:07:02-rbd-pacific-distro-default-smithi/6735418 2022-03-14T06:18:15.916 INFO:teuthology.dispatcher.supervisor:Job PID: 11817 2022-03-14T06:18:15.916 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-03-14T12:48:45.089 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-03-14T12:48:45.253 INFO:teuthology.kill:Killing Pids: {11817} 2022-03-14T12:48:46.460 INFO:teuthology.task.internal:roles: ubuntu@smithi089.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2022-03-14T12:48:46.461 INFO:teuthology.task.internal:roles: ubuntu@smithi105.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2022-03-14T12:48:46.461 INFO:teuthology.task.internal:roles: ubuntu@smithi185.front.sepia.ceph.com - ['client.0'] 2022-03-14T12:48:46.461 INFO:teuthology.misc:Compressing logs... 2022-03-14T12:48:46.462 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2022-03-14T12:48:46.934 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com' 2022-03-14T12:48:47.288 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi185.front.sepia.ceph.com' 2022-03-14T12:48:47.644 INFO:teuthology.misc:Compressing logs... 2022-03-14T12:48:47.799 INFO:teuthology.misc:Compressing logs... 2022-03-14T12:57:17.423 INFO:teuthology.kill:No teuthology processes running 2022-03-14T12:57:18.530 INFO:teuthology.kill:Nuking machines: ['smithi089', 'smithi105', 'smithi185'] 2022-03-14T12:57:19.452 INFO:teuthology.kill:2022-03-14 12:57:19,451.451 INFO:teuthology.nuke:targets: 2022-03-14T12:57:19.453 INFO:teuthology.kill: smithi089.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDC/FMmuyWOVJ2dGkI9kRSdb85aSjnuvFkTfewz5KbkNNlPlpqDf7xK98p6db2jMzoZiCSy5TDVtC+yUQ5maYWWGOZzmYN3p17h5+snrwTY8HQUKvq0UO9hRDE1OgPzbWPFD0rX0L9aOm3WzFoPGXTPjmZm7FZWY6oKPLzF0MrNlYUBs2abexnhh1cH5IbC9eW8O6Ccn1FNP2N0ddfe9zzJcCLa+lTUQ2Wd6miOQG8/ayGIaB0ln5f8RHHu2cQDbG/UrfbTOeqFh7XNP0bdgJ8qP2sHZplZD5CxpikinsjZYlJLYvkjp7Yxzh4KdTC2tWJM8OB8v8xTkuTsz7lc2cqvO0MkdvRv3epLLUaL9ovR4yyU/pU/vxVX2/Q/hDqeVMpxATgz6vT0i0ZPlbSKCAZ0bmD3T0ktOY1JPjQ7iIw3I10aGZMau2RG9sfiCImanZTUp7kzoRjwVEq8YR9Aw0tEm0cbK5FiYX6v51ibJHCXUnCqXkCD1S95KS+0+rmSQGc= 2022-03-14T12:57:19.453 INFO:teuthology.kill: smithi105.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDVwW6Hqa3xQUptFSP6btbbzzXdyepBpv0+SGmavSlyGoaXgKjyBmDgeptjtqwivXlQDKIUguosTwAgV3zjLC7b0SH0gM0R4pcqzks/AWusJlIKePBNv52pbJQ671x2vyTLX1k4ZjNk1l8z7xVRHEArbxz1SZB0QZA3GBDmx9RiK2h9t15usrUaKrgy3rs/1l/ceyHpDM1K5wSHawq3CcDbawFN9bVVo4R2pmxnOuFNaB2eUwXxougpkLn00SspvXCyHAjqyt8z/iTFWDbXaUgEQjXVdJgO0WL20zkJynWztV8X7Bbub3Z7jTnOMFT0u25nILEbCmPuRmvofj5DG2TbSyJhf6U7MDc7P+SNLM6K6+xEsw9GORw2gSAP5CE/8ju8bttohyGAmpXs6BRwTnweuVXRbtiXxHY2CFjB0N0ewwXsmxB6Ag1AvPdiFlBToGSYXxs2TN3PjY+H7UeQYQ1t1yStBA2Vp08W0xB0pJvkz4/qHT2UpYDvT7LTYMfMwVs= 2022-03-14T12:57:19.453 INFO:teuthology.kill: smithi185.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD82sDeWHPKRdyowX5vL+mHw2f3NJyHw8qUAjY+YBsFrtrhUIEkvi/hbeOY8EqY/gcVOforhO64Oq1fRb3/0RCpxT0l1/oEZ+yFDSexXvOwi1q6/7VuQxowIyCK15eAXmEou0IkiBdOwXd3FeP19YMIDNTDAJFHyijKcB5VrdhDQmERi5YDauYgU1mUGbVIgx8hRqEV/pwwlUagpJqTfH3eKKzOjQhZYGzUgt/6kduXF64AfPRUANC7ycD/0nhN7kw7yIHWYc4vOzcXosdgXgUdc/ZjNcdKpBZfvPI6nv48fOZYScghjQqcI0O/7a080vr0y7gazQFTQ0MbEcw8ZhTnhmv2SSQQfMa1JIQaPjuLtRH4DCtrxZRI8RYKT44hdjnC/H41sHVTpwtc6lemTymJTayDIJRsKLwbxyokRK7ktPj77swuddpsweqq0GQBPZeVjCVPkRIt9yqRVY6cT/FTltYLbeTwQ942NtHwZ240BWEMv8Z674njbYvRvGr9y6M= 2022-03-14T12:57:19.481 INFO:teuthology.kill:2022-03-14 12:57:19,481.481 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-03-14T12:57:19.485 INFO:teuthology.kill:2022-03-14 12:57:19,485.485 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-03-14T12:57:19.486 INFO:teuthology.kill:2022-03-14 12:57:19,486.486 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-03-14T12:57:19.569 INFO:teuthology.kill:2022-03-14 12:57:19,569.569 INFO:teuthology.orchestra.console:Power off smithi185 2022-03-14T12:57:19.582 INFO:teuthology.kill:2022-03-14 12:57:19,582.582 INFO:teuthology.orchestra.console:Power off smithi089 2022-03-14T12:57:19.594 INFO:teuthology.kill:2022-03-14 12:57:19,594.594 INFO:teuthology.orchestra.console:Power off smithi105 2022-03-14T12:57:27.958 INFO:teuthology.kill:2022-03-14 12:57:27,958.958 INFO:teuthology.orchestra.console:Power off for smithi089 completed 2022-03-14T12:57:28.103 INFO:teuthology.kill:2022-03-14 12:57:28,102.102 INFO:teuthology.lock.ops:unlocked: smithi089.front.sepia.ceph.com 2022-03-14T12:57:32.065 INFO:teuthology.kill:2022-03-14 12:57:32,065.065 INFO:teuthology.orchestra.console:Power off for smithi185 completed 2022-03-14T12:57:32.071 INFO:teuthology.kill:2022-03-14 12:57:32,071.071 INFO:teuthology.orchestra.console:Power off for smithi105 completed 2022-03-14T12:57:32.216 INFO:teuthology.kill:2022-03-14 12:57:32,216.216 INFO:teuthology.lock.ops:unlocked: smithi105.front.sepia.ceph.com 2022-03-14T12:57:32.219 INFO:teuthology.kill:2022-03-14 12:57:32,219.219 INFO:teuthology.lock.ops:unlocked: smithi185.front.sepia.ceph.com 2022-03-14T12:59:32.520 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-03-14T12:59:32.641 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi089 but it was locked by another job: /home/teuthworker/archive/adking-2022-03-14_12:43:51-orch:cephadm:mds_upgrade_sequence-wip-adk2-testing-2022-03-11-1538-distro-basic-smithi/6736062 2022-03-14T12:59:32.642 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi105 but it was locked by another job: /home/teuthworker/archive/adking-2022-03-14_12:43:51-orch:cephadm:mds_upgrade_sequence-wip-adk2-testing-2022-03-11-1538-distro-basic-smithi/6736061 2022-03-14T12:59:32.642 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi185 but it was locked by another job: /home/teuthworker/archive/adking-2022-03-14_12:43:51-orch:cephadm:mds_upgrade_sequence-wip-adk2-testing-2022-03-11-1538-distro-basic-smithi/6736061