2022-10-28T16:33:44.779 INFO:root:teuthology version: 1.1.1.dev427+g35ea38a9 2022-10-28T16:33:44.935 INFO:teuthology.lock.ops:Start node 'smithi079.front.sepia.ceph.com' reimaging 2022-10-28T16:33:44.936 INFO:teuthology.lock.ops:Updating [smithi079.front.sepia.ceph.com]: reset os type and version on server 2022-10-28T16:33:44.936 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2022-10-28T16:33:44.957 INFO:teuthology.lock.ops:Node 'smithi079.front.sepia.ceph.com' reimaging is complete 2022-10-28T16:33:44.957 INFO:teuthology.lock.ops:Start node 'smithi138.front.sepia.ceph.com' reimaging 2022-10-28T16:33:44.957 INFO:teuthology.lock.ops:Updating [smithi138.front.sepia.ceph.com]: reset os type and version on server 2022-10-28T16:33:44.958 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server 2022-10-28T16:33:44.977 INFO:teuthology.lock.ops:Node 'smithi138.front.sepia.ceph.com' reimaging is complete 2022-10-28T16:33:44.977 INFO:teuthology.lock.ops:Start node 'smithi156.front.sepia.ceph.com' reimaging 2022-10-28T16:33:44.977 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: reset os type and version on server 2022-10-28T16:33:44.978 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2022-10-28T16:33:44.997 INFO:teuthology.lock.ops:Node 'smithi156.front.sepia.ceph.com' reimaging is complete 2022-10-28T16:33:45.195 INFO:teuthology.provision.fog.smithi138:Scheduling deploy of ubuntu 20.04 2022-10-28T16:33:45.214 INFO:teuthology.provision.fog.smithi156:Scheduling deploy of ubuntu 20.04 2022-10-28T16:33:45.220 INFO:teuthology.provision.fog.smithi079:Scheduling deploy of ubuntu 20.04 2022-10-28T16:33:45.677 INFO:teuthology.orchestra.console:Power off smithi138 2022-10-28T16:33:45.710 INFO:teuthology.orchestra.console:Power off smithi079 2022-10-28T16:33:45.750 INFO:teuthology.orchestra.console:Power off smithi156 2022-10-28T16:33:45.819 INFO:teuthology.orchestra.console:Power off for smithi138 completed 2022-10-28T16:33:45.858 INFO:teuthology.orchestra.console:Power off for smithi079 completed 2022-10-28T16:33:45.886 INFO:teuthology.orchestra.console:Power off for smithi156 completed 2022-10-28T16:33:45.920 INFO:teuthology.orchestra.console:Power on smithi138 2022-10-28T16:33:45.959 INFO:teuthology.orchestra.console:Power on smithi079 2022-10-28T16:33:45.988 INFO:teuthology.orchestra.console:Power on smithi156 2022-10-28T16:33:54.292 INFO:teuthology.orchestra.console:Power on for smithi138 completed 2022-10-28T16:33:54.334 INFO:teuthology.orchestra.console:Power on for smithi079 completed 2022-10-28T16:33:54.339 INFO:teuthology.orchestra.console:Power on for smithi156 completed 2022-10-28T16:33:54.393 INFO:teuthology.provision.fog.smithi138:Waiting for deploy to finish 2022-10-28T16:33:54.435 INFO:teuthology.provision.fog.smithi079:Waiting for deploy to finish 2022-10-28T16:33:54.440 INFO:teuthology.provision.fog.smithi156:Waiting for deploy to finish 2022-10-28T16:36:56.805 ERROR:teuthology.orchestra.connection:Error authenticating with smithi156.front.sepia.ceph.com: Authentication failed. 2022-10-28T16:38:50.164 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-10-28T16:38:50.585 INFO:teuthology.provision.fog.smithi079:Node is ready 2022-10-28T16:38:50.591 INFO:teuthology.orchestra.run.smithi079.stdout:smithi079.front.sepia.ceph.com 2022-10-28T16:38:50.639 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79 smithi079.front.sepia.ceph.com smithi079 2022-10-28T16:38:50.820 INFO:teuthology.provision.fog.smithi079:Deploy complete! 2022-10-28T16:39:02.430 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-10-28T16:39:02.855 INFO:teuthology.provision.fog.smithi138:Node is ready 2022-10-28T16:39:02.861 INFO:teuthology.orchestra.run.smithi138.stdout:smithi138.front.sepia.ceph.com 2022-10-28T16:39:02.867 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138 smithi138.front.sepia.ceph.com smithi138 2022-10-28T16:39:03.007 INFO:teuthology.provision.fog.smithi138:Deploy complete! 2022-10-28T16:39:06.549 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-10-28T16:39:07.034 INFO:teuthology.provision.fog.smithi156:Node is ready 2022-10-28T16:39:07.045 INFO:teuthology.orchestra.run.smithi156.stdout:smithi156.front.sepia.ceph.com 2022-10-28T16:39:07.095 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.15.156 smithi156.front.sepia.ceph.com smithi156 2022-10-28T16:39:07.269 INFO:teuthology.provision.fog.smithi156:Deploy complete! 2022-10-28T16:39:07.596 INFO:teuthology.lock.ops:Checking smithi079.front.sepia.ceph.com 2022-10-28T16:39:07.597 INFO:teuthology.lock.ops:New key found. Updating... 2022-10-28T16:39:07.627 INFO:teuthology.lock.ops:Checking smithi138.front.sepia.ceph.com 2022-10-28T16:39:07.627 INFO:teuthology.lock.ops:New key found. Updating... 2022-10-28T16:39:07.645 INFO:teuthology.lock.ops:Checking smithi156.front.sepia.ceph.com 2022-10-28T16:39:07.645 INFO:teuthology.lock.ops:New key found. Updating... 2022-10-28T16:39:07.666 INFO:teuthology.lock.ops:Updating [smithi079.front.sepia.ceph.com]: set os type and version on server 2022-10-28T16:39:07.666 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2022-10-28T16:39:07.922 INFO:teuthology.orchestra.run.smithi079.stdout:x86_64 2022-10-28T16:39:07.928 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="Ubuntu" 2022-10-28T16:39:07.929 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="20.04.5 LTS (Focal Fossa)" 2022-10-28T16:39:07.929 INFO:teuthology.orchestra.run.smithi079.stdout:ID=ubuntu 2022-10-28T16:39:07.929 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE=debian 2022-10-28T16:39:07.929 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="Ubuntu 20.04.5 LTS" 2022-10-28T16:39:07.930 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="20.04" 2022-10-28T16:39:07.930 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://www.ubuntu.com/" 2022-10-28T16:39:07.930 INFO:teuthology.orchestra.run.smithi079.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-10-28T16:39:07.930 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-10-28T16:39:07.931 INFO:teuthology.orchestra.run.smithi079.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-10-28T16:39:07.931 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_CODENAME=focal 2022-10-28T16:39:07.931 INFO:teuthology.orchestra.run.smithi079.stdout:UBUNTU_CODENAME=focal 2022-10-28T16:39:07.932 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2022-10-28T16:39:07.951 INFO:teuthology.lock.ops:Updating [smithi138.front.sepia.ceph.com]: set os type and version on server 2022-10-28T16:39:07.951 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2022-10-28T16:39:08.165 INFO:teuthology.orchestra.run.smithi138.stdout:x86_64 2022-10-28T16:39:08.172 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="Ubuntu" 2022-10-28T16:39:08.172 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="20.04.5 LTS (Focal Fossa)" 2022-10-28T16:39:08.172 INFO:teuthology.orchestra.run.smithi138.stdout:ID=ubuntu 2022-10-28T16:39:08.173 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE=debian 2022-10-28T16:39:08.173 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="Ubuntu 20.04.5 LTS" 2022-10-28T16:39:08.173 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="20.04" 2022-10-28T16:39:08.173 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://www.ubuntu.com/" 2022-10-28T16:39:08.173 INFO:teuthology.orchestra.run.smithi138.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-10-28T16:39:08.174 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-10-28T16:39:08.174 INFO:teuthology.orchestra.run.smithi138.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-10-28T16:39:08.174 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_CODENAME=focal 2022-10-28T16:39:08.174 INFO:teuthology.orchestra.run.smithi138.stdout:UBUNTU_CODENAME=focal 2022-10-28T16:39:08.175 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server 2022-10-28T16:39:08.193 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: set os type and version on server 2022-10-28T16:39:08.194 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2022-10-28T16:39:08.446 INFO:teuthology.orchestra.run.smithi156.stdout:x86_64 2022-10-28T16:39:08.452 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="Ubuntu" 2022-10-28T16:39:08.453 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="20.04.5 LTS (Focal Fossa)" 2022-10-28T16:39:08.453 INFO:teuthology.orchestra.run.smithi156.stdout:ID=ubuntu 2022-10-28T16:39:08.453 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE=debian 2022-10-28T16:39:08.453 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="Ubuntu 20.04.5 LTS" 2022-10-28T16:39:08.454 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="20.04" 2022-10-28T16:39:08.454 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://www.ubuntu.com/" 2022-10-28T16:39:08.454 INFO:teuthology.orchestra.run.smithi156.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-10-28T16:39:08.454 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-10-28T16:39:08.455 INFO:teuthology.orchestra.run.smithi156.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-10-28T16:39:08.455 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_CODENAME=focal 2022-10-28T16:39:08.455 INFO:teuthology.orchestra.run.smithi156.stdout:UBUNTU_CODENAME=focal 2022-10-28T16:39:08.456 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2022-10-28T16:39:08.548 INFO:teuthology.dispatcher.supervisor:Running job 7080971 2022-10-28T16:39:08.548 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_35ea38a9840006713a3d42472a2c536a25e88c15/virtualenv/bin/teuthology -v --owner scheduled_dis@teuthology --archive /home/teuthworker/archive/dis-2022-10-25_23:10:37-rbd-wip-dis-testing-distro-default-smithi/7080971 --name dis-2022-10-25_23:10:37-rbd-wip-dis-testing-distro-default-smithi --description rbd/librbd/{cache/writeback clusters/{fixed-3 openstack} config/none min-compat-client/octopus msgr-failures/few objectstore/bluestore-comp-snappy pool/replicated-data-pool supported-random-distro$/{ubuntu_latest} workloads/python_api_tests_with_defaults} -- /home/teuthworker/archive/dis-2022-10-25_23:10:37-rbd-wip-dis-testing-distro-default-smithi/7080971/orig.config.yaml 2022-10-28T16:39:08.552 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/dis-2022-10-25_23:10:37-rbd-wip-dis-testing-distro-default-smithi/7080971 2022-10-28T16:39:08.554 INFO:teuthology.dispatcher.supervisor:Job PID: 16161 2022-10-28T16:39:08.554 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-10-29T04:39:28.643 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-10-29T04:39:28.822 INFO:teuthology.kill:Killing Pids: {16161} 2022-10-29T04:39:30.074 INFO:teuthology.task.internal:roles: ubuntu@smithi079.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2022-10-29T04:39:30.075 INFO:teuthology.task.internal:roles: ubuntu@smithi138.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2022-10-29T04:39:30.076 INFO:teuthology.task.internal:roles: ubuntu@smithi156.front.sepia.ceph.com - ['client.0'] 2022-10-29T04:39:30.076 INFO:teuthology.misc:Compressing logs... 2022-10-29T04:39:30.077 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2022-10-29T04:39:30.334 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2022-10-29T04:39:30.553 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2022-10-29T04:39:31.023 INFO:teuthology.kill:No teuthology processes running 2022-10-29T04:39:32.165 INFO:teuthology.kill:Nuking machines: ['smithi079', 'smithi138', 'smithi156'] 2022-10-29T04:39:33.246 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_35ea38a9840006713a3d42472a2c536a25e88c15/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-10-29T04:39:33.247 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-10-29T04:39:33.247 INFO:teuthology.kill:2022-10-29 04:39:33,246.246 INFO:teuthology.nuke:targets: 2022-10-29T04:39:33.248 INFO:teuthology.kill: smithi079.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDdKCvVa+gPxQ6DPHk7DhqazE8uTNQPKLAmfR2ZRKAgqJ3fGHSuoehim1miUjAohHv0fS4Ttte4JW5EMXz48XDi+u97oWQP4w/txOIFI4gExLc151rvvTSab7I5usmvJz1gwGXogT02cPC+jpn0XO0Mj/4msig9wx3dra5rkSgQzIgmPKLbjwXVi8vjkLbbwMSsKoRnTnL1Gyym8TNq+FuF7qQHjhQaER2TzWD7Ec37yTqA/zDt5e9kFcwqcu1I6CkzY1UNPQyibbOXhSblSGLMhPk8mBHxtJQL1WJUAc298A78RyPY8+MCcvMHDrdLs+h3oUN++Yi27eGvV7d1XBCITwpW6qb9fB9nncgk+yU8SurlXONufwGtBv3NfKb3lAnUlkEZ4y/Vx0q83Gqbj4D4TROb+I6vF5YJakjOoZJjbKkc3Tn650vabbwsUggY22Oo8uq48cPG996McbPqFumex+U+hs3xiF1FhPHHJcqxcUa0rqEC4hPigl+qrEiLCLs= 2022-10-29T04:39:33.248 INFO:teuthology.kill: smithi138.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpOQm4Q0CG8IepQrquvN6HZxK1nfn26bVwaNv5UFTvgQP/r5rt/AZ9kNOTLYJAYfn8nw+80sSeXsLmeWMJJ6eMGuesItZQKq1ckrZXoZOowoJsACMLq36bbgH+NBkWlaXa0z6L+uvp3lnETMMvxRvo4OlMAoYFajVLGzdhQIqu7ieQBEhzAZs7Qxy5yS1T0HTRSiNqm4g1iyFIPa2skiOGF8NITngDbtWydieUjW72sfALc6brWfLPR/qxSG1KK6THDpo+RkEWDG4Uql5vF272eqUzi2qLwuJ5wMM0Dliux0CwcI+xKwSitUZqlkwHiMvYe3Q2FE9FRnm+YNZuzk+LJXOF71Wo7+cm3bmguxjn9Vni1+xN7lQjN3Azu4XOhhhJ2BOfZizaonH1WPE2U6yGFNQqfe4/I1+ZaI49OonPO2mUAtWaqCU7hVST/jhsegxZilGtfcmRiznjRoE57jSB8TENOyVZgHuw1kTqMF9C7nhrAJJjr2N0K85Aa0zN4Sc= 2022-10-29T04:39:33.248 INFO:teuthology.kill: smithi156.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4DhRZ5D3G0r8W61QCn5z7xY1t7q4sPEnaE+QsyHMVbdUgCDQMFS94EsKnKDaskjIQx3QgPEWPobcsx3kAGg/dn5BMaR/qw97uSY15r3ARPDQyc9MrIbkS7xSZtCdkzfdIecT+FqTMVA5t9ZJuIfYgUhsAviZx0+ayF4gkkkl4/9+ijkw1qp7jBJQwfiDN+C+86VfS9m14c5OLWdoMM6g/lyFKYGGnM6X7Zop8yN/DHnF0WQAZmr1TM/2WtZNk45FzrhmMO/jv4/LFPdjjvGK85Z77osYqPxuWoP3yzMScAjK7m9CRq7Q7KntpzGxvWsWTHO1BmRf1+Xe7hEnk6LdC/nZJBUmHpukFStr2voi5R8qZH0ncgXPJUv1GlGBN752msjXZcjbd8/myPW6F5ODxXSZgfXrq/I8VEcvfH501QzNzNBSHtdP3PHC/1wg11aO2c1M1NejrgkkrHHyjwsBAK5d38fEJwHxpa4OEOpF6gAtLeX2HPK4BELkOSFPjMp0= 2022-10-29T04:39:33.248 INFO:teuthology.kill:2022-10-29 04:39:33,246.246 INFO:teuthology.nuke:Checking targets against current locks 2022-10-29T04:39:33.300 INFO:teuthology.kill:2022-10-29 04:39:33,300.300 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-10-29T04:39:33.327 INFO:teuthology.kill:2022-10-29 04:39:33,326.326 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-10-29T04:39:33.345 INFO:teuthology.kill:2022-10-29 04:39:33,345.345 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-10-29T04:39:33.373 INFO:teuthology.kill:2022-10-29 04:39:33,373.373 INFO:teuthology.orchestra.console:Power off smithi079 2022-10-29T04:39:33.414 INFO:teuthology.kill:2022-10-29 04:39:33,414.414 INFO:teuthology.orchestra.console:Power off smithi138 2022-10-29T04:39:33.445 INFO:teuthology.kill:2022-10-29 04:39:33,445.445 INFO:teuthology.orchestra.console:Power off smithi156 2022-10-29T04:39:41.747 INFO:teuthology.kill:2022-10-29 04:39:41,747.747 INFO:teuthology.orchestra.console:Power off for smithi079 completed 2022-10-29T04:39:41.766 INFO:teuthology.kill:2022-10-29 04:39:41,766.766 INFO:teuthology.orchestra.console:Power off for smithi138 completed 2022-10-29T04:39:41.897 INFO:teuthology.kill:2022-10-29 04:39:41,896.896 INFO:teuthology.lock.ops:unlocked: smithi079.front.sepia.ceph.com 2022-10-29T04:39:41.916 INFO:teuthology.kill:2022-10-29 04:39:41,916.916 INFO:teuthology.lock.ops:unlocked: smithi138.front.sepia.ceph.com 2022-10-29T04:39:45.906 INFO:teuthology.kill:2022-10-29 04:39:45,906.906 INFO:teuthology.orchestra.console:Power off for smithi156 completed 2022-10-29T04:39:46.051 INFO:teuthology.kill:2022-10-29 04:39:46,051.051 INFO:teuthology.lock.ops:unlocked: smithi156.front.sepia.ceph.com 2022-10-29T04:41:46.276 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-10-29T04:41:46.382 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi079 but it was locked by another job: /home/teuthworker/archive/dis-2022-10-25_23:10:37-rbd-wip-dis-testing-distro-default-smithi/7081007 2022-10-29T04:41:46.382 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi138 but it was locked by another job: /home/teuthworker/archive/dis-2022-10-25_23:10:37-rbd-wip-dis-testing-distro-default-smithi/7081007 2022-10-29T04:41:46.382 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi156 but it was locked by another job: /home/teuthworker/archive/dis-2022-10-25_23:10:37-rbd-wip-dis-testing-distro-default-smithi/7081008