2022-05-30T03:57:01.327 INFO:root:teuthology version: 1.1.1.dev341+g1b30281f 2022-05-30T03:57:01.495 INFO:teuthology.lock.ops:Start node 'smithi033.front.sepia.ceph.com' reimaging 2022-05-30T03:57:01.495 INFO:teuthology.lock.ops:Updating [smithi033.front.sepia.ceph.com]: reset os type and version on server 2022-05-30T03:57:01.496 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server 2022-05-30T03:57:01.515 INFO:teuthology.lock.ops:Node 'smithi033.front.sepia.ceph.com' reimaging is complete 2022-05-30T03:57:01.515 INFO:teuthology.lock.ops:Start node 'smithi036.front.sepia.ceph.com' reimaging 2022-05-30T03:57:01.515 INFO:teuthology.lock.ops:Updating [smithi036.front.sepia.ceph.com]: reset os type and version on server 2022-05-30T03:57:01.515 INFO:teuthology.lock.ops:Updating smithi036.front.sepia.ceph.com on lock server 2022-05-30T03:57:01.533 INFO:teuthology.lock.ops:Node 'smithi036.front.sepia.ceph.com' reimaging is complete 2022-05-30T03:57:01.533 INFO:teuthology.lock.ops:Start node 'smithi101.front.sepia.ceph.com' reimaging 2022-05-30T03:57:01.533 INFO:teuthology.lock.ops:Updating [smithi101.front.sepia.ceph.com]: reset os type and version on server 2022-05-30T03:57:01.533 INFO:teuthology.lock.ops:Updating smithi101.front.sepia.ceph.com on lock server 2022-05-30T03:57:01.551 INFO:teuthology.lock.ops:Node 'smithi101.front.sepia.ceph.com' reimaging is complete 2022-05-30T03:57:01.731 INFO:teuthology.provision.fog.smithi033:Scheduling deploy of ubuntu 20.04 2022-05-30T03:57:01.771 INFO:teuthology.provision.fog.smithi101:Scheduling deploy of ubuntu 20.04 2022-05-30T03:57:01.782 INFO:teuthology.provision.fog.smithi036:Scheduling deploy of ubuntu 20.04 2022-05-30T03:57:02.125 INFO:teuthology.orchestra.console:Power off smithi033 2022-05-30T03:57:02.161 INFO:teuthology.orchestra.console:Power off smithi101 2022-05-30T03:57:02.228 INFO:teuthology.orchestra.console:Power off smithi036 2022-05-30T03:57:10.494 INFO:teuthology.orchestra.console:Power off for smithi033 completed 2022-05-30T03:57:10.523 INFO:teuthology.orchestra.console:Power off for smithi101 completed 2022-05-30T03:57:10.593 INFO:teuthology.orchestra.console:Power off for smithi036 completed 2022-05-30T03:57:10.595 INFO:teuthology.orchestra.console:Power on smithi033 2022-05-30T03:57:10.624 INFO:teuthology.orchestra.console:Power on smithi101 2022-05-30T03:57:10.694 INFO:teuthology.orchestra.console:Power on smithi036 2022-05-30T03:57:18.964 INFO:teuthology.orchestra.console:Power on for smithi033 completed 2022-05-30T03:57:18.987 INFO:teuthology.orchestra.console:Power on for smithi101 completed 2022-05-30T03:57:19.065 INFO:teuthology.provision.fog.smithi033:Waiting for deploy to finish 2022-05-30T03:57:19.088 INFO:teuthology.orchestra.console:Power on for smithi036 completed 2022-05-30T03:57:19.088 INFO:teuthology.provision.fog.smithi101:Waiting for deploy to finish 2022-05-30T03:57:19.188 INFO:teuthology.provision.fog.smithi036:Waiting for deploy to finish 2022-05-30T04:01:54.024 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-05-30T04:01:54.062 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-05-30T04:01:54.473 INFO:teuthology.provision.fog.smithi036:Node is ready 2022-05-30T04:01:54.479 INFO:teuthology.orchestra.run.smithi036.stdout:smithi036.front.sepia.ceph.com 2022-05-30T04:01:54.487 INFO:teuthology.orchestra.run.smithi036.stdout:172.21.15.36 smithi036.front.sepia.ceph.com smithi036 2022-05-30T04:01:54.494 INFO:teuthology.provision.fog.smithi033:Node is ready 2022-05-30T04:01:54.500 INFO:teuthology.orchestra.run.smithi033.stdout:smithi033.front.sepia.ceph.com 2022-05-30T04:01:54.508 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33 smithi033.front.sepia.ceph.com smithi033 2022-05-30T04:01:54.680 INFO:teuthology.provision.fog.smithi036:Deploy complete! 2022-05-30T04:01:54.687 INFO:teuthology.provision.fog.smithi033:Deploy complete! 2022-05-30T04:02:10.839 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-05-30T04:02:11.388 INFO:teuthology.provision.fog.smithi101:Node is ready 2022-05-30T04:02:11.395 INFO:teuthology.orchestra.run.smithi101.stdout:smithi101.front.sepia.ceph.com 2022-05-30T04:02:11.402 INFO:teuthology.orchestra.run.smithi101.stdout:172.21.15.101 smithi101.front.sepia.ceph.com smithi101 2022-05-30T04:02:11.558 INFO:teuthology.provision.fog.smithi101:Deploy complete! 2022-05-30T04:02:11.812 INFO:teuthology.lock.ops:Checking smithi033.front.sepia.ceph.com 2022-05-30T04:02:11.813 INFO:teuthology.lock.ops:New key found. Updating... 2022-05-30T04:02:11.834 INFO:teuthology.lock.ops:Checking smithi036.front.sepia.ceph.com 2022-05-30T04:02:11.834 INFO:teuthology.lock.ops:New key found. Updating... 2022-05-30T04:02:11.854 INFO:teuthology.lock.ops:Checking smithi101.front.sepia.ceph.com 2022-05-30T04:02:11.854 INFO:teuthology.lock.ops:New key found. Updating... 2022-05-30T04:02:11.874 INFO:teuthology.lock.ops:Updating [smithi033.front.sepia.ceph.com]: set os type and version on server 2022-05-30T04:02:11.874 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2022-05-30T04:02:12.193 INFO:teuthology.orchestra.run.smithi033.stdout:x86_64 2022-05-30T04:02:12.199 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="Ubuntu" 2022-05-30T04:02:12.200 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2022-05-30T04:02:12.200 INFO:teuthology.orchestra.run.smithi033.stdout:ID=ubuntu 2022-05-30T04:02:12.200 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE=debian 2022-05-30T04:02:12.200 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2022-05-30T04:02:12.200 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="20.04" 2022-05-30T04:02:12.200 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://www.ubuntu.com/" 2022-05-30T04:02:12.200 INFO:teuthology.orchestra.run.smithi033.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-05-30T04:02:12.200 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-05-30T04:02:12.200 INFO:teuthology.orchestra.run.smithi033.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-05-30T04:02:12.201 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_CODENAME=focal 2022-05-30T04:02:12.201 INFO:teuthology.orchestra.run.smithi033.stdout:UBUNTU_CODENAME=focal 2022-05-30T04:02:12.202 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server 2022-05-30T04:02:12.224 INFO:teuthology.lock.ops:Updating [smithi036.front.sepia.ceph.com]: set os type and version on server 2022-05-30T04:02:12.224 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi036.front.sepia.ceph.com' 2022-05-30T04:02:12.533 INFO:teuthology.orchestra.run.smithi036.stdout:x86_64 2022-05-30T04:02:12.539 INFO:teuthology.orchestra.run.smithi036.stdout:NAME="Ubuntu" 2022-05-30T04:02:12.539 INFO:teuthology.orchestra.run.smithi036.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2022-05-30T04:02:12.539 INFO:teuthology.orchestra.run.smithi036.stdout:ID=ubuntu 2022-05-30T04:02:12.540 INFO:teuthology.orchestra.run.smithi036.stdout:ID_LIKE=debian 2022-05-30T04:02:12.540 INFO:teuthology.orchestra.run.smithi036.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2022-05-30T04:02:12.540 INFO:teuthology.orchestra.run.smithi036.stdout:VERSION_ID="20.04" 2022-05-30T04:02:12.540 INFO:teuthology.orchestra.run.smithi036.stdout:HOME_URL="https://www.ubuntu.com/" 2022-05-30T04:02:12.540 INFO:teuthology.orchestra.run.smithi036.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-05-30T04:02:12.540 INFO:teuthology.orchestra.run.smithi036.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-05-30T04:02:12.540 INFO:teuthology.orchestra.run.smithi036.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-05-30T04:02:12.540 INFO:teuthology.orchestra.run.smithi036.stdout:VERSION_CODENAME=focal 2022-05-30T04:02:12.540 INFO:teuthology.orchestra.run.smithi036.stdout:UBUNTU_CODENAME=focal 2022-05-30T04:02:12.541 INFO:teuthology.lock.ops:Updating smithi036.front.sepia.ceph.com on lock server 2022-05-30T04:02:12.561 INFO:teuthology.lock.ops:Updating [smithi101.front.sepia.ceph.com]: set os type and version on server 2022-05-30T04:02:12.562 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi101.front.sepia.ceph.com' 2022-05-30T04:02:12.781 INFO:teuthology.orchestra.run.smithi101.stdout:x86_64 2022-05-30T04:02:12.786 INFO:teuthology.orchestra.run.smithi101.stdout:NAME="Ubuntu" 2022-05-30T04:02:12.786 INFO:teuthology.orchestra.run.smithi101.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2022-05-30T04:02:12.786 INFO:teuthology.orchestra.run.smithi101.stdout:ID=ubuntu 2022-05-30T04:02:12.786 INFO:teuthology.orchestra.run.smithi101.stdout:ID_LIKE=debian 2022-05-30T04:02:12.786 INFO:teuthology.orchestra.run.smithi101.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2022-05-30T04:02:12.787 INFO:teuthology.orchestra.run.smithi101.stdout:VERSION_ID="20.04" 2022-05-30T04:02:12.787 INFO:teuthology.orchestra.run.smithi101.stdout:HOME_URL="https://www.ubuntu.com/" 2022-05-30T04:02:12.787 INFO:teuthology.orchestra.run.smithi101.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-05-30T04:02:12.787 INFO:teuthology.orchestra.run.smithi101.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-05-30T04:02:12.787 INFO:teuthology.orchestra.run.smithi101.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-05-30T04:02:12.787 INFO:teuthology.orchestra.run.smithi101.stdout:VERSION_CODENAME=focal 2022-05-30T04:02:12.787 INFO:teuthology.orchestra.run.smithi101.stdout:UBUNTU_CODENAME=focal 2022-05-30T04:02:12.787 INFO:teuthology.lock.ops:Updating smithi101.front.sepia.ceph.com on lock server 2022-05-30T04:02:12.938 INFO:teuthology.dispatcher.supervisor:Running job 6852848 2022-05-30T04:02:12.938 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_1b30281f276b97a8186594b7f92fe1f728418ada/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852848 --name teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi --description rbd/qemu/{cache/writethrough clusters/{fixed-3 openstack} features/journaling msgr-failures/few objectstore/bluestore-hybrid pool/none supported-random-distro$/{ubuntu_latest} workloads/qemu_xfstests} -- /home/teuthworker/archive/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852848/orig.config.yaml 2022-05-30T04:02:12.944 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852848 2022-05-30T04:02:12.944 INFO:teuthology.dispatcher.supervisor:Job PID: 25553 2022-05-30T04:02:12.944 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-05-30T10:32:43.768 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-05-30T10:32:44.122 INFO:teuthology.kill:Killing Pids: {25553} 2022-05-30T10:32:45.638 INFO:teuthology.task.internal:roles: ubuntu@smithi033.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2022-05-30T10:32:45.639 INFO:teuthology.task.internal:roles: ubuntu@smithi036.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2022-05-30T10:32:45.639 INFO:teuthology.task.internal:roles: ubuntu@smithi101.front.sepia.ceph.com - ['client.0'] 2022-05-30T10:32:45.639 INFO:teuthology.misc:Compressing logs... 2022-05-30T10:32:45.639 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2022-05-30T10:32:46.129 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi036.front.sepia.ceph.com' 2022-05-30T10:32:46.601 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi101.front.sepia.ceph.com' 2022-05-30T10:32:47.007 INFO:teuthology.misc:Compressing logs... 2022-05-30T10:32:47.151 INFO:teuthology.misc:Compressing logs... 2022-05-30T10:44:41.227 INFO:teuthology.kill:No teuthology processes running 2022-05-30T10:44:42.661 INFO:teuthology.kill:Nuking machines: ['smithi033', 'smithi036', 'smithi101'] 2022-05-30T10:44:43.740 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_1b30281f276b97a8186594b7f92fe1f728418ada/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-05-30T10:44:43.741 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-05-30T10:44:43.741 INFO:teuthology.kill:2022-05-30 10:44:43,740.740 INFO:teuthology.nuke:targets: 2022-05-30T10:44:43.741 INFO:teuthology.kill: smithi033.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDPvc1K4RBKkO3eW1gMP6dI98/ODLjtJ0NI348me0QGLqCHnT0TzVpKaqOSuSg3acbtfSlzr+utplT7e8B0kQMTH3ETxlPTW1y2899W2dackz2K+Cd2weebgP7tts0RKkMYXnauWWnTVtBKpEe53Ic1agk7BA/7sa4rXnkZql4xosQTE5wbXV+07oRpjQeGLGefH8yCVHFWYwFFhl3D8cqqNoyDEUXTIuO9KSKiMXvjhVx2gqwjEgiOlC1A7d4+GadqWclWNB1v5IVoirhPUM8/8cgHLFci1aWp8dYegyOwB72oSU7w9SdK12RHSqmKCZaktsxXvHLiFsYBw5F5NWOX7CISa4jp1vlHJjIA5AIlVeYTLeAMGBDytkHOCicsxOfGdlX+y60EJGcP0t4lQZAMgs9xp7GRY9qU9UbmQDfibNsPxyFgiaELXAtnWXGZJM5DrmGX5xyhCvqtgPuSN7zDqpiuzNHskaMBpLUV5co8YoL+bG115KaGLsaj55zHWnU= 2022-05-30T10:44:43.741 INFO:teuthology.kill: smithi036.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDRbNkRFPm8KXIpPN5QP/VLCJG5z0uASHgP1vWjghah3/2uy2TOdXbY2x+haNgVLEmf9DPyD7R8O3HCkg89QKL8FYD/JLwkhBaCXgrBeMWoLUnJOnnwcQWxDvPPlyme5zHbXQpv2RAsX8gH7DfFWoXndmDIxe2Gl57jy6K6U9oozFQyCK4XYy8qPSKIAi5DLcBtupSzU215v8LJb+n7BLxbpGaazehvv5p5sFEkT6n9+Tan/DrL+8bv1rM6tvgaPYMD/EtUv5HhcZG3t9slKTglthZaCpFH6orX6vDWQr6URfHFg5y6CJwqD8oSaimb2nx5GRa9tfkB8VoKWCbW5FFK2iOxeA1i8XdceX0zCOHB7cNZPoKum0g6nsSF8ZdH8dkCHX0tlVP2BEhGIQ9LB4bnPgqoSiM968uRZ7YSjZ/oUxYPr4X5cOVyD6KcGGZBvADxUeFsAaFJs65fBrNlyvZnS9yV0nntrch/Wq1Zjkl+2wuZ0Vkt7BQnaZVEySuYR5s= 2022-05-30T10:44:43.741 INFO:teuthology.kill: smithi101.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC55Gg++SHpJHFLqA+RC/MdN8J/n9fHGL0pq/8R28SXScilx65WdnqaSv3wOTsTTxLvPdwp+lP5m9NSgnOCBBXeaIS44va/0BvZpeDUZoqScLN4bHTjzA16CzvYyb71kyReUXmwjBI2FOTNDfFCaNads7oioNEesk1ciQMG0IykwaEttMWvpXRKwPBTjbV1Bor0l1ImMTYPTG7IB8iAwHV5NFT9FuIa5ode1beAUURjzaUfojEjjFQYncbBgClg2VOyBParGzHnDbcm1dhQ8428DSNKceZcfLBU0JiFkGMaPShV836m1PGBoKcYyU84fcNNnZtYE50fzWOCaom6hFtqBEd8TX4PMViP3+A4A6zs5JaZH9KvxlBPcq7GQaWW+0fgoIMmbO2LSFOlJ51eaHI+9q5Gnxs4Usx16jITA+ZmY5+vKR82iWZxzq6Kh5nOgUIgxejcWzSDopl3JeV6sO5IfTz2hjGJZ0jLZdsjT45WN1m+G/BnpIanYHIu3obfHh8= 2022-05-30T10:44:43.770 INFO:teuthology.kill:2022-05-30 10:44:43,770.770 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-05-30T10:44:43.776 INFO:teuthology.kill:2022-05-30 10:44:43,776.776 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-05-30T10:44:43.778 INFO:teuthology.kill:2022-05-30 10:44:43,778.778 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-05-30T10:44:43.853 INFO:teuthology.kill:2022-05-30 10:44:43,852.852 INFO:teuthology.orchestra.console:Power off smithi036 2022-05-30T10:44:43.867 INFO:teuthology.kill:2022-05-30 10:44:43,867.867 INFO:teuthology.orchestra.console:Power off smithi033 2022-05-30T10:44:43.879 INFO:teuthology.kill:2022-05-30 10:44:43,879.879 INFO:teuthology.orchestra.console:Power off smithi101 2022-05-30T10:44:52.244 INFO:teuthology.kill:2022-05-30 10:44:52,243.243 INFO:teuthology.orchestra.console:Power off for smithi033 completed 2022-05-30T10:44:52.251 INFO:teuthology.kill:2022-05-30 10:44:52,251.251 INFO:teuthology.orchestra.console:Power off for smithi101 completed 2022-05-30T10:44:52.397 INFO:teuthology.kill:2022-05-30 10:44:52,396.396 INFO:teuthology.lock.ops:unlocked: smithi033.front.sepia.ceph.com 2022-05-30T10:44:52.401 INFO:teuthology.kill:2022-05-30 10:44:52,401.401 INFO:teuthology.lock.ops:unlocked: smithi101.front.sepia.ceph.com 2022-05-30T10:44:56.351 INFO:teuthology.kill:2022-05-30 10:44:56,351.351 INFO:teuthology.orchestra.console:Power off for smithi036 completed 2022-05-30T10:44:56.498 INFO:teuthology.kill:2022-05-30 10:44:56,498.498 INFO:teuthology.lock.ops:unlocked: smithi036.front.sepia.ceph.com 2022-05-30T10:46:56.843 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-05-30T10:46:56.955 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi033 but it was locked by another job: /home/teuthworker/archive/rishabh-2022-05-30_09:46:45-fs-wip-vshankar-testing-20220527-073645-distro-basic-smithi/6853406 2022-05-30T10:46:56.956 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi036 but it was locked by another job: /home/teuthworker/archive/rishabh-2022-05-30_09:46:45-fs-wip-vshankar-testing-20220527-073645-distro-basic-smithi/6853407 2022-05-30T10:46:56.956 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi101 but it was locked by another job: /home/teuthworker/archive/rishabh-2022-05-30_09:46:45-fs-wip-vshankar-testing-20220527-073645-distro-basic-smithi/6853406