2022-10-29T06:57:28.606 INFO:root:teuthology version: 1.1.1.dev427+g35ea38a9 2022-10-29T06:57:28.761 INFO:teuthology.lock.ops:Start node 'smithi003.front.sepia.ceph.com' reimaging 2022-10-29T06:57:28.762 INFO:teuthology.lock.ops:Updating [smithi003.front.sepia.ceph.com]: reset os type and version on server 2022-10-29T06:57:28.763 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server 2022-10-29T06:57:28.783 INFO:teuthology.lock.ops:Node 'smithi003.front.sepia.ceph.com' reimaging is complete 2022-10-29T06:57:28.784 INFO:teuthology.lock.ops:Start node 'smithi018.front.sepia.ceph.com' reimaging 2022-10-29T06:57:28.784 INFO:teuthology.lock.ops:Updating [smithi018.front.sepia.ceph.com]: reset os type and version on server 2022-10-29T06:57:28.784 INFO:teuthology.lock.ops:Updating smithi018.front.sepia.ceph.com on lock server 2022-10-29T06:57:28.803 INFO:teuthology.lock.ops:Node 'smithi018.front.sepia.ceph.com' reimaging is complete 2022-10-29T06:57:28.804 INFO:teuthology.lock.ops:Start node 'smithi032.front.sepia.ceph.com' reimaging 2022-10-29T06:57:28.804 INFO:teuthology.lock.ops:Updating [smithi032.front.sepia.ceph.com]: reset os type and version on server 2022-10-29T06:57:28.804 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server 2022-10-29T06:57:28.822 INFO:teuthology.lock.ops:Node 'smithi032.front.sepia.ceph.com' reimaging is complete 2022-10-29T06:57:28.996 INFO:teuthology.provision.fog.smithi003:Scheduling deploy of ubuntu 20.04 2022-10-29T06:57:29.013 INFO:teuthology.provision.fog.smithi018:Scheduling deploy of ubuntu 20.04 2022-10-29T06:57:29.039 INFO:teuthology.provision.fog.smithi032:Scheduling deploy of ubuntu 20.04 2022-10-29T06:57:29.356 INFO:teuthology.orchestra.console:Power off smithi018 2022-10-29T06:57:29.372 INFO:teuthology.orchestra.console:Power off smithi003 2022-10-29T06:57:29.384 INFO:teuthology.orchestra.console:Power off smithi032 2022-10-29T06:57:29.514 INFO:teuthology.orchestra.console:Power off for smithi018 completed 2022-10-29T06:57:29.518 INFO:teuthology.orchestra.console:Power off for smithi003 completed 2022-10-29T06:57:29.526 INFO:teuthology.orchestra.console:Power off for smithi032 completed 2022-10-29T06:57:29.615 INFO:teuthology.orchestra.console:Power on smithi018 2022-10-29T06:57:29.622 INFO:teuthology.orchestra.console:Power on smithi003 2022-10-29T06:57:29.628 INFO:teuthology.orchestra.console:Power on smithi032 2022-10-29T06:57:37.987 INFO:teuthology.orchestra.console:Power on for smithi018 completed 2022-10-29T06:57:37.996 INFO:teuthology.orchestra.console:Power on for smithi003 completed 2022-10-29T06:57:38.002 INFO:teuthology.orchestra.console:Power on for smithi032 completed 2022-10-29T06:57:38.088 INFO:teuthology.provision.fog.smithi018:Waiting for deploy to finish 2022-10-29T06:57:38.097 INFO:teuthology.provision.fog.smithi003:Waiting for deploy to finish 2022-10-29T06:57:38.103 INFO:teuthology.provision.fog.smithi032:Waiting for deploy to finish 2022-10-29T07:02:13.925 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-10-29T07:02:13.964 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-10-29T07:02:14.044 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-10-29T07:02:14.396 INFO:teuthology.provision.fog.smithi003:Node is ready 2022-10-29T07:02:14.403 INFO:teuthology.orchestra.run.smithi003.stdout:smithi003.front.sepia.ceph.com 2022-10-29T07:02:14.409 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3 smithi003.front.sepia.ceph.com smithi003 2022-10-29T07:02:14.469 INFO:teuthology.provision.fog.smithi018:Node is ready 2022-10-29T07:02:14.475 INFO:teuthology.orchestra.run.smithi018.stdout:smithi018.front.sepia.ceph.com 2022-10-29T07:02:14.483 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18 smithi018.front.sepia.ceph.com smithi018 2022-10-29T07:02:14.595 INFO:teuthology.provision.fog.smithi003:Deploy complete! 2022-10-29T07:02:14.614 INFO:teuthology.provision.fog.smithi032:Node is ready 2022-10-29T07:02:14.622 INFO:teuthology.orchestra.run.smithi032.stdout:smithi032.front.sepia.ceph.com 2022-10-29T07:02:14.673 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32 smithi032.front.sepia.ceph.com smithi032 2022-10-29T07:02:14.698 INFO:teuthology.provision.fog.smithi018:Deploy complete! 2022-10-29T07:02:14.851 INFO:teuthology.provision.fog.smithi032:Deploy complete! 2022-10-29T07:02:15.214 INFO:teuthology.lock.ops:Checking smithi003.front.sepia.ceph.com 2022-10-29T07:02:15.215 INFO:teuthology.lock.ops:New key found. Updating... 2022-10-29T07:02:15.236 INFO:teuthology.lock.ops:Checking smithi018.front.sepia.ceph.com 2022-10-29T07:02:15.236 INFO:teuthology.lock.ops:New key found. Updating... 2022-10-29T07:02:15.254 INFO:teuthology.lock.ops:Checking smithi032.front.sepia.ceph.com 2022-10-29T07:02:15.255 INFO:teuthology.lock.ops:New key found. Updating... 2022-10-29T07:02:15.273 INFO:teuthology.lock.ops:Updating [smithi003.front.sepia.ceph.com]: set os type and version on server 2022-10-29T07:02:15.274 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com' 2022-10-29T07:02:15.541 INFO:teuthology.orchestra.run.smithi003.stdout:x86_64 2022-10-29T07:02:15.547 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="Ubuntu" 2022-10-29T07:02:15.547 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="20.04.5 LTS (Focal Fossa)" 2022-10-29T07:02:15.547 INFO:teuthology.orchestra.run.smithi003.stdout:ID=ubuntu 2022-10-29T07:02:15.548 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE=debian 2022-10-29T07:02:15.548 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="Ubuntu 20.04.5 LTS" 2022-10-29T07:02:15.548 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="20.04" 2022-10-29T07:02:15.548 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://www.ubuntu.com/" 2022-10-29T07:02:15.549 INFO:teuthology.orchestra.run.smithi003.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-10-29T07:02:15.549 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-10-29T07:02:15.549 INFO:teuthology.orchestra.run.smithi003.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-10-29T07:02:15.549 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_CODENAME=focal 2022-10-29T07:02:15.550 INFO:teuthology.orchestra.run.smithi003.stdout:UBUNTU_CODENAME=focal 2022-10-29T07:02:15.551 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server 2022-10-29T07:02:15.574 INFO:teuthology.lock.ops:Updating [smithi018.front.sepia.ceph.com]: set os type and version on server 2022-10-29T07:02:15.575 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2022-10-29T07:02:15.841 INFO:teuthology.orchestra.run.smithi018.stdout:x86_64 2022-10-29T07:02:15.848 INFO:teuthology.orchestra.run.smithi018.stdout:NAME="Ubuntu" 2022-10-29T07:02:15.848 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION="20.04.5 LTS (Focal Fossa)" 2022-10-29T07:02:15.849 INFO:teuthology.orchestra.run.smithi018.stdout:ID=ubuntu 2022-10-29T07:02:15.849 INFO:teuthology.orchestra.run.smithi018.stdout:ID_LIKE=debian 2022-10-29T07:02:15.849 INFO:teuthology.orchestra.run.smithi018.stdout:PRETTY_NAME="Ubuntu 20.04.5 LTS" 2022-10-29T07:02:15.849 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION_ID="20.04" 2022-10-29T07:02:15.850 INFO:teuthology.orchestra.run.smithi018.stdout:HOME_URL="https://www.ubuntu.com/" 2022-10-29T07:02:15.850 INFO:teuthology.orchestra.run.smithi018.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-10-29T07:02:15.850 INFO:teuthology.orchestra.run.smithi018.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-10-29T07:02:15.850 INFO:teuthology.orchestra.run.smithi018.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-10-29T07:02:15.851 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION_CODENAME=focal 2022-10-29T07:02:15.851 INFO:teuthology.orchestra.run.smithi018.stdout:UBUNTU_CODENAME=focal 2022-10-29T07:02:15.851 INFO:teuthology.lock.ops:Updating smithi018.front.sepia.ceph.com on lock server 2022-10-29T07:02:15.870 INFO:teuthology.lock.ops:Updating [smithi032.front.sepia.ceph.com]: set os type and version on server 2022-10-29T07:02:15.870 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2022-10-29T07:02:16.090 INFO:teuthology.orchestra.run.smithi032.stdout:x86_64 2022-10-29T07:02:16.096 INFO:teuthology.orchestra.run.smithi032.stdout:NAME="Ubuntu" 2022-10-29T07:02:16.097 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION="20.04.5 LTS (Focal Fossa)" 2022-10-29T07:02:16.097 INFO:teuthology.orchestra.run.smithi032.stdout:ID=ubuntu 2022-10-29T07:02:16.097 INFO:teuthology.orchestra.run.smithi032.stdout:ID_LIKE=debian 2022-10-29T07:02:16.097 INFO:teuthology.orchestra.run.smithi032.stdout:PRETTY_NAME="Ubuntu 20.04.5 LTS" 2022-10-29T07:02:16.098 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_ID="20.04" 2022-10-29T07:02:16.098 INFO:teuthology.orchestra.run.smithi032.stdout:HOME_URL="https://www.ubuntu.com/" 2022-10-29T07:02:16.098 INFO:teuthology.orchestra.run.smithi032.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-10-29T07:02:16.099 INFO:teuthology.orchestra.run.smithi032.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-10-29T07:02:16.099 INFO:teuthology.orchestra.run.smithi032.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-10-29T07:02:16.099 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_CODENAME=focal 2022-10-29T07:02:16.099 INFO:teuthology.orchestra.run.smithi032.stdout:UBUNTU_CODENAME=focal 2022-10-29T07:02:16.100 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server 2022-10-29T07:02:16.193 INFO:teuthology.dispatcher.supervisor:Running job 7081021 2022-10-29T07:02:16.194 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_35ea38a9840006713a3d42472a2c536a25e88c15/virtualenv/bin/teuthology -v --owner scheduled_dis@teuthology --archive /home/teuthworker/archive/dis-2022-10-25_23:10:37-rbd-wip-dis-testing-distro-default-smithi/7081021 --name dis-2022-10-25_23:10:37-rbd-wip-dis-testing-distro-default-smithi --description rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} thrashers/cache thrashosds-health workloads/rbd_nbd} -- /home/teuthworker/archive/dis-2022-10-25_23:10:37-rbd-wip-dis-testing-distro-default-smithi/7081021/orig.config.yaml 2022-10-29T07:02:16.198 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/dis-2022-10-25_23:10:37-rbd-wip-dis-testing-distro-default-smithi/7081021 2022-10-29T07:02:16.199 INFO:teuthology.dispatcher.supervisor:Job PID: 16041 2022-10-29T07:02:16.199 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-10-29T19:03:00.681 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-10-29T19:03:01.031 INFO:teuthology.kill:Killing Pids: {16041} 2022-10-29T19:03:02.334 INFO:teuthology.task.internal:roles: ubuntu@smithi003.front.sepia.ceph.com - ['mon.a', 'mon.c', 'osd.0', 'osd.1', 'osd.2'] 2022-10-29T19:03:02.335 INFO:teuthology.task.internal:roles: ubuntu@smithi018.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.3', 'osd.4', 'osd.5'] 2022-10-29T19:03:02.335 INFO:teuthology.task.internal:roles: ubuntu@smithi032.front.sepia.ceph.com - ['client.0'] 2022-10-29T19:03:02.336 INFO:teuthology.misc:Compressing logs... 2022-10-29T19:03:02.336 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com' 2022-10-29T19:03:02.562 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2022-10-29T19:03:02.793 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2022-10-29T19:03:03.180 INFO:teuthology.kill:No teuthology processes running 2022-10-29T19:03:04.397 INFO:teuthology.kill:Nuking machines: ['smithi003', 'smithi018', 'smithi032'] 2022-10-29T19:03:05.489 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_35ea38a9840006713a3d42472a2c536a25e88c15/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-10-29T19:03:05.490 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-10-29T19:03:05.490 INFO:teuthology.kill:2022-10-29 19:03:05,489.489 INFO:teuthology.nuke:targets: 2022-10-29T19:03:05.491 INFO:teuthology.kill: smithi003.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCzmo+xFO7ms19QbLFJ7l9+zZ53N5AZ56I9VKhrVbkvW1qO9KTJkFO7ZwnL+TB8uftYaQr0hivKr64ES7gVByQtmQyQRE65e44ZG1knTrFONbYcRz3tQyipNxg1+VI8KyrH2KpQF7/ocYJEWS03BrNKWGTQ6guZC/K4Af18hyJExHVCEsg99FZ3F7LZiQDjN4QgYsikV53pKo4aQPiUTeL8jAcRWsX9p0n2vrTy+PtgL1LFcOxgssgshED9Luves++Jt9DeJJ8RVh/EZEhfx0NdAE8rU9lNM874dfwEIkxE08Yj6MCx9TmFdYICoH7wxHN0oILib32ezZEK/6tidPO6KuCIUfSHvFMUcpNIxwjGFULW66FkpGYHhaiLzOQqnSrQFQWs/j/h6xIuFt9mw+9iGdmYNrBoclXVDxiW++t4NFYRoWfY65XIuIZe3WZWMPwgrEi+Q5pN+Bam/8547p+hNmDkJniHoj/Qs3ffJgel8HYNZw4iX+DhN+2uQCo3zjc= 2022-10-29T19:03:05.491 INFO:teuthology.kill: smithi018.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDCz03mVHVVnHEEOrfhwsMBhvTKMZ56hBtCCHCFmO8IiEIuYN8HPx2WYrElxJCH/8o/iNYuI8ei/VWAizwFVyJIch2E9f+TGYBQ4KdKMShBTl+H0blnwKchSTmoKzfvwOT2i5Z12pYJdtKQMeSXy3qoOZfJTCTCdiLHjMsWhmsYE46TQ3HnmOW/4MJOHXNe81nCY14PVO/XpLnuGznNMdGfDi5awa3l+loyyZzH0rFNh4mXCnoIW8X3OXy0ls7bkGiQJuiJUoULEEsoR514qfpvawcnFyFjiDNaO3UIOdg7Z+PLIZUCJjDJz21/DIUIRG9tR8bVuRfcvJ/kz8XZMGY0rSd4ywi4yBpR7gD9FbCEGyPuYXAyjXKAtqyYMxC72O2BInXPSjCORDIxnBFhlLHO3JajZVmaFyeRzCVKqxx1cdLLP5NHYBBPqR/25G9B4oFO3nrL45hYTywNkOgbZl/fQbBROY6aiOmUpQJBgQpbodHO1lVEsCwgLXdGY8ZSHB8= 2022-10-29T19:03:05.491 INFO:teuthology.kill: smithi032.front.sepia.ceph.com: ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILjzM29W6L+ghQcxZ9IM+Q93sCQMtW4I5dCUsLgrRTR2 2022-10-29T19:03:05.492 INFO:teuthology.kill:2022-10-29 19:03:05,489.489 INFO:teuthology.nuke:Checking targets against current locks 2022-10-29T19:03:05.537 INFO:teuthology.kill:2022-10-29 19:03:05,537.537 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-10-29T19:03:05.566 INFO:teuthology.kill:2022-10-29 19:03:05,566.566 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-10-29T19:03:05.595 INFO:teuthology.kill:2022-10-29 19:03:05,594.594 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-10-29T19:03:05.623 INFO:teuthology.kill:2022-10-29 19:03:05,623.623 INFO:teuthology.orchestra.console:Power off smithi003 2022-10-29T19:03:05.668 INFO:teuthology.kill:2022-10-29 19:03:05,667.667 INFO:teuthology.orchestra.console:Power off smithi018 2022-10-29T19:03:05.708 INFO:teuthology.kill:2022-10-29 19:03:05,708.708 INFO:teuthology.orchestra.console:Power off smithi032 2022-10-29T19:03:14.032 INFO:teuthology.kill:2022-10-29 19:03:14,032.032 INFO:teuthology.orchestra.console:Power off for smithi018 completed 2022-10-29T19:03:14.179 INFO:teuthology.kill:2022-10-29 19:03:14,178.178 INFO:teuthology.lock.ops:unlocked: smithi018.front.sepia.ceph.com 2022-10-29T19:03:18.120 INFO:teuthology.kill:2022-10-29 19:03:18,119.119 INFO:teuthology.orchestra.console:Power off for smithi003 completed 2022-10-29T19:03:18.172 INFO:teuthology.kill:2022-10-29 19:03:18,172.172 INFO:teuthology.orchestra.console:Power off for smithi032 completed 2022-10-29T19:03:18.270 INFO:teuthology.kill:2022-10-29 19:03:18,270.270 INFO:teuthology.lock.ops:unlocked: smithi003.front.sepia.ceph.com 2022-10-29T19:03:18.319 INFO:teuthology.kill:2022-10-29 19:03:18,318.318 INFO:teuthology.lock.ops:unlocked: smithi032.front.sepia.ceph.com 2022-10-29T19:05:18.680 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-10-29T19:05:18.799 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi003 but it was locked by another job: /home/teuthworker/archive/dis-2022-10-25_23:10:37-rbd-wip-dis-testing-distro-default-smithi/7081060 2022-10-29T19:05:18.799 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi018 but it was locked by another job: /home/teuthworker/archive/dis-2022-10-25_23:10:37-rbd-wip-dis-testing-distro-default-smithi/7081061 2022-10-29T19:05:18.799 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi032 but it was locked by another job: /home/teuthworker/archive/dis-2022-10-25_23:10:37-rbd-wip-dis-testing-distro-default-smithi/7081060