2022-04-11T19:54:49.828 INFO:root:teuthology version: 1.1.0-a347b2ac 2022-04-11T19:54:49.979 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi116.front.sepia.ceph.com' reimaging 2022-04-11T19:54:49.980 INFO:teuthology.lock.ops:Updating [ubuntu@smithi116.front.sepia.ceph.com]: reset os type and version on server 2022-04-11T19:54:49.980 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2022-04-11T19:54:50.000 INFO:teuthology.lock.ops:Node 'ubuntu@smithi116.front.sepia.ceph.com' reimaging is complete 2022-04-11T19:54:50.000 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi163.front.sepia.ceph.com' reimaging 2022-04-11T19:54:50.001 INFO:teuthology.lock.ops:Updating [ubuntu@smithi163.front.sepia.ceph.com]: reset os type and version on server 2022-04-11T19:54:50.001 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server 2022-04-11T19:54:50.017 INFO:teuthology.lock.ops:Node 'ubuntu@smithi163.front.sepia.ceph.com' reimaging is complete 2022-04-11T19:54:50.018 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi185.front.sepia.ceph.com' reimaging 2022-04-11T19:54:50.018 INFO:teuthology.lock.ops:Updating [ubuntu@smithi185.front.sepia.ceph.com]: reset os type and version on server 2022-04-11T19:54:50.018 INFO:teuthology.lock.ops:Updating smithi185.front.sepia.ceph.com on lock server 2022-04-11T19:54:50.035 INFO:teuthology.lock.ops:Node 'ubuntu@smithi185.front.sepia.ceph.com' reimaging is complete 2022-04-11T19:54:50.209 INFO:teuthology.provision.fog.smithi116:Scheduling deploy of ubuntu 20.04 2022-04-11T19:54:50.222 INFO:teuthology.provision.fog.smithi163:Scheduling deploy of ubuntu 20.04 2022-04-11T19:54:50.239 INFO:teuthology.provision.fog.smithi185:Scheduling deploy of ubuntu 20.04 2022-04-11T19:54:50.547 INFO:teuthology.orchestra.console:Power off smithi116 2022-04-11T19:54:50.563 INFO:teuthology.orchestra.console:Power off smithi163 2022-04-11T19:54:50.620 INFO:teuthology.orchestra.console:Power off smithi185 2022-04-11T19:54:58.927 INFO:teuthology.orchestra.console:Power off for smithi163 completed 2022-04-11T19:54:58.977 INFO:teuthology.orchestra.console:Power off for smithi185 completed 2022-04-11T19:54:59.029 INFO:teuthology.orchestra.console:Power on smithi163 2022-04-11T19:54:59.078 INFO:teuthology.orchestra.console:Power on smithi185 2022-04-11T19:55:03.032 INFO:teuthology.orchestra.console:Power off for smithi116 completed 2022-04-11T19:55:03.134 INFO:teuthology.orchestra.console:Power on smithi116 2022-04-11T19:55:07.384 INFO:teuthology.orchestra.console:Power on for smithi116 completed 2022-04-11T19:55:07.407 INFO:teuthology.orchestra.console:Power on for smithi163 completed 2022-04-11T19:55:07.433 INFO:teuthology.orchestra.console:Power on for smithi185 completed 2022-04-11T19:55:07.485 INFO:teuthology.provision.fog.smithi116:Waiting for deploy to finish 2022-04-11T19:55:07.509 INFO:teuthology.provision.fog.smithi163:Waiting for deploy to finish 2022-04-11T19:55:07.534 INFO:teuthology.provision.fog.smithi185:Waiting for deploy to finish 2022-04-11T20:00:05.233 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-04-11T20:00:05.734 INFO:teuthology.provision.fog.smithi116:Node is ready 2022-04-11T20:00:05.741 INFO:teuthology.orchestra.run.smithi116.stdout:smithi116.front.sepia.ceph.com 2022-04-11T20:00:05.792 INFO:teuthology.orchestra.run.smithi116.stdout:172.21.15.116 smithi116.front.sepia.ceph.com smithi116 2022-04-11T20:00:05.958 INFO:teuthology.provision.fog.smithi116:Deploy complete! 2022-04-11T20:00:20.144 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-04-11T20:00:20.646 INFO:teuthology.provision.fog.smithi185:Node is ready 2022-04-11T20:00:20.653 INFO:teuthology.orchestra.run.smithi185.stdout:smithi185.front.sepia.ceph.com 2022-04-11T20:00:20.661 INFO:teuthology.orchestra.run.smithi185.stdout:172.21.15.185 smithi185.front.sepia.ceph.com smithi185 2022-04-11T20:00:20.854 INFO:teuthology.provision.fog.smithi185:Deploy complete! 2022-04-11T20:00:48.922 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-04-11T20:00:49.354 INFO:teuthology.provision.fog.smithi163:Node is ready 2022-04-11T20:00:49.367 INFO:teuthology.orchestra.run.smithi163.stdout:smithi163.front.sepia.ceph.com 2022-04-11T20:00:49.418 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163 smithi163.front.sepia.ceph.com smithi163 2022-04-11T20:00:49.584 INFO:teuthology.provision.fog.smithi163:Deploy complete! 2022-04-11T20:00:49.814 INFO:teuthology.lock.ops:Checking smithi116.front.sepia.ceph.com 2022-04-11T20:00:49.815 INFO:teuthology.lock.ops:New key found. Updating... 2022-04-11T20:00:49.837 INFO:teuthology.lock.ops:Checking smithi163.front.sepia.ceph.com 2022-04-11T20:00:49.838 INFO:teuthology.lock.ops:New key found. Updating... 2022-04-11T20:00:49.855 INFO:teuthology.lock.ops:Checking smithi185.front.sepia.ceph.com 2022-04-11T20:00:49.856 INFO:teuthology.lock.ops:New key found. Updating... 2022-04-11T20:00:49.874 INFO:teuthology.lock.ops:Updating [smithi116.front.sepia.ceph.com]: set os type and version on server 2022-04-11T20:00:49.874 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2022-04-11T20:00:50.051 INFO:teuthology.orchestra.run.smithi116.stdout:x86_64 2022-04-11T20:00:50.056 INFO:teuthology.orchestra.run.smithi116.stdout:NAME="Ubuntu" 2022-04-11T20:00:50.056 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2022-04-11T20:00:50.057 INFO:teuthology.orchestra.run.smithi116.stdout:ID=ubuntu 2022-04-11T20:00:50.057 INFO:teuthology.orchestra.run.smithi116.stdout:ID_LIKE=debian 2022-04-11T20:00:50.057 INFO:teuthology.orchestra.run.smithi116.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2022-04-11T20:00:50.057 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_ID="20.04" 2022-04-11T20:00:50.057 INFO:teuthology.orchestra.run.smithi116.stdout:HOME_URL="https://www.ubuntu.com/" 2022-04-11T20:00:50.058 INFO:teuthology.orchestra.run.smithi116.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-04-11T20:00:50.058 INFO:teuthology.orchestra.run.smithi116.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-04-11T20:00:50.058 INFO:teuthology.orchestra.run.smithi116.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-04-11T20:00:50.058 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_CODENAME=focal 2022-04-11T20:00:50.059 INFO:teuthology.orchestra.run.smithi116.stdout:UBUNTU_CODENAME=focal 2022-04-11T20:00:50.060 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2022-04-11T20:00:50.077 INFO:teuthology.lock.ops:Updating [smithi163.front.sepia.ceph.com]: set os type and version on server 2022-04-11T20:00:50.077 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2022-04-11T20:00:50.293 INFO:teuthology.orchestra.run.smithi163.stdout:x86_64 2022-04-11T20:00:50.300 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="Ubuntu" 2022-04-11T20:00:50.300 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2022-04-11T20:00:50.300 INFO:teuthology.orchestra.run.smithi163.stdout:ID=ubuntu 2022-04-11T20:00:50.301 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE=debian 2022-04-11T20:00:50.301 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2022-04-11T20:00:50.301 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="20.04" 2022-04-11T20:00:50.301 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://www.ubuntu.com/" 2022-04-11T20:00:50.302 INFO:teuthology.orchestra.run.smithi163.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-04-11T20:00:50.302 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-04-11T20:00:50.302 INFO:teuthology.orchestra.run.smithi163.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-04-11T20:00:50.302 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_CODENAME=focal 2022-04-11T20:00:50.302 INFO:teuthology.orchestra.run.smithi163.stdout:UBUNTU_CODENAME=focal 2022-04-11T20:00:50.303 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server 2022-04-11T20:00:50.320 INFO:teuthology.lock.ops:Updating [smithi185.front.sepia.ceph.com]: set os type and version on server 2022-04-11T20:00:50.320 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi185.front.sepia.ceph.com' 2022-04-11T20:00:50.498 INFO:teuthology.orchestra.run.smithi185.stdout:x86_64 2022-04-11T20:00:50.505 INFO:teuthology.orchestra.run.smithi185.stdout:NAME="Ubuntu" 2022-04-11T20:00:50.505 INFO:teuthology.orchestra.run.smithi185.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2022-04-11T20:00:50.505 INFO:teuthology.orchestra.run.smithi185.stdout:ID=ubuntu 2022-04-11T20:00:50.506 INFO:teuthology.orchestra.run.smithi185.stdout:ID_LIKE=debian 2022-04-11T20:00:50.506 INFO:teuthology.orchestra.run.smithi185.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2022-04-11T20:00:50.506 INFO:teuthology.orchestra.run.smithi185.stdout:VERSION_ID="20.04" 2022-04-11T20:00:50.506 INFO:teuthology.orchestra.run.smithi185.stdout:HOME_URL="https://www.ubuntu.com/" 2022-04-11T20:00:50.507 INFO:teuthology.orchestra.run.smithi185.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-04-11T20:00:50.507 INFO:teuthology.orchestra.run.smithi185.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-04-11T20:00:50.507 INFO:teuthology.orchestra.run.smithi185.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-04-11T20:00:50.507 INFO:teuthology.orchestra.run.smithi185.stdout:VERSION_CODENAME=focal 2022-04-11T20:00:50.508 INFO:teuthology.orchestra.run.smithi185.stdout:UBUNTU_CODENAME=focal 2022-04-11T20:00:50.508 INFO:teuthology.lock.ops:Updating smithi185.front.sepia.ceph.com on lock server 2022-04-11T20:00:50.598 INFO:teuthology.dispatcher.supervisor:Running job 6787468 2022-04-11T20:00:50.598 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_a347b2ac5400a43ba76a678399b1deda7dae1a6c/virtualenv/bin/teuthology -v --owner scheduled_dis@teuthology --archive /home/teuthworker/archive/dis-2022-04-11_19:09:08-rbd-wip-dis-testing-1-distro-default-smithi/6787468 --name dis-2022-04-11_19:09:08-rbd-wip-dis-testing-1-distro-default-smithi --description rbd/qemu/{cache/none clusters/{fixed-3 openstack} features/journaling msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/ec-data-pool supported-random-distro$/{ubuntu_latest} workloads/qemu_xfstests} -- /home/teuthworker/archive/dis-2022-04-11_19:09:08-rbd-wip-dis-testing-1-distro-default-smithi/6787468/orig.config.yaml 2022-04-11T20:00:50.601 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/dis-2022-04-11_19:09:08-rbd-wip-dis-testing-1-distro-default-smithi/6787468 2022-04-11T20:00:50.602 INFO:teuthology.dispatcher.supervisor:Job PID: 7890 2022-04-11T20:00:50.602 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-04-12T02:31:18.512 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-04-12T02:31:18.654 INFO:teuthology.kill:Killing Pids: {7890} 2022-04-12T02:31:19.821 INFO:teuthology.task.internal:roles: ubuntu@smithi116.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2022-04-12T02:31:19.822 INFO:teuthology.task.internal:roles: ubuntu@smithi163.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2022-04-12T02:31:19.822 INFO:teuthology.task.internal:roles: ubuntu@smithi185.front.sepia.ceph.com - ['client.0'] 2022-04-12T02:31:19.822 INFO:teuthology.misc:Compressing logs... 2022-04-12T02:31:19.823 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2022-04-12T02:31:20.245 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2022-04-12T02:31:20.779 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi185.front.sepia.ceph.com' 2022-04-12T02:31:21.073 INFO:teuthology.misc:Compressing logs... 2022-04-12T02:31:21.231 INFO:teuthology.misc:Compressing logs... 2022-04-12T02:49:12.473 INFO:teuthology.kill:No teuthology processes running 2022-04-12T02:49:13.567 INFO:teuthology.kill:Nuking machines: ['smithi116', 'smithi163', 'smithi185'] 2022-04-12T02:49:14.480 INFO:teuthology.kill:2022-04-12 02:49:14,480.480 INFO:teuthology.nuke:targets: 2022-04-12T02:49:14.481 INFO:teuthology.kill: smithi116.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoFvz/je7DgKexoQtWKfbtUV229hsoHiwnaYeKfRdg8F64wYmigIsLV6QV19Lh4Kru0jnHYDgjP7L/1XKu7dSp8pRJ9C8Yo4NT+zHkXbd3R4iKOxWZNAUJEdAkyv5K3LxCHOOBG0pqp6B5ug+r+VUNBGSic2HZKv/beNFn4zG7/jF9d1FI/c44RI88imL35ya5uGmPlcajwpUSmZo/qtqg6JeRJdXkciZkECRuM6Fqt3RFrIlwLoBiJYtNDUg+wyXu0QWHwnqMTcXiZngD09BmO8LaGS8yOqMiZPk6G6iZ/51GNebnKvXHKYjUYa9N8tBEGSWSq6vwFC2wMInNIYxV0XhKQcTCkPk17MWEy3jiVnnU6UTITcMviiODmG7vTnfDCdmVbfqTkSP/A7pcAJpBfO/BkDUa5bNNW+FfjmfDfCM/fWZkOgeNkY8lPVH4w7Q0uVxPpIVtFZxYucdGCwFCQ0AOiQWlbHNs0oMY2XrkpWLysJp7KFzPOVg3JNEMSLs= 2022-04-12T02:49:14.482 INFO:teuthology.kill: smithi163.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCk6+CQJnUDbK+PLyVDPIlxTUnQvVhmkXHFAWWQ+en0en5GShZRAiGZNOxsik8h8synQPmZ45QrWNL+D9gQIBab4UbbeL9fSYgjRJxiGYcymkN8p/NWBtgOSB+wrgm+NV6soUWzatmLqhkWYIsF/1VPha39Rnn1W8U2YSVd5VLE6/KtzrJE7LJVfDrRI/Sme1O2OVWRbCWRBl/EUkv5Bh0jrJYklYagMKq5tATK1n0HGTOY0Cdki3kNKKe8HcNjv0yxWbbBH1GCR+iEd3MehKNd+xDny+GJziXKxqN4YDQAvYANnA+cLJJbt3+VMRbDewKucxknZpVSDgEpp/omYOvH4hZnhxogUvaNoD9KMfJqP6cRJ5oN9v2L6kSv9U/KXKCWZyAfFVsnUwPQ2c8BloL+XEf0Y9xq2e6lYzXU/9RSueouI63HtN+CK73WtSrBtySl/OS5nKUHvG/JRPBETSokn3q6NK2RnjJuheXEE8BESQyc0JGz0YCsAsTCpya2Mg8= 2022-04-12T02:49:14.482 INFO:teuthology.kill: smithi185.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFyvlcb+f/l0VWBj3Y7A2dpuJfza7GgVlc0f8pnevEvfEgv0X79Zpv+elz1NbzPh/IXNVQs6BRNe4k6iJmcYw+RXWtrEOt4eotgKoSZiDR7j31t7O+Jp44UXzVAHQhj80k7aozand72vpdef2XrZClbBaajNcWwpTV4xTWLk4Y1/FJ76TawATBSSi7Lh6b8fLL+5LHtP+NQ5w5xMlcRvhSgLgXDMh9l9oYdfXuDyEr+Zp93V6AiDp+veErO6qpipHZ99C9uLRKQxwjnN6+s0CtM/OfLVTtQpeTISzl7lUMEmxahaGg7vAoiZwpGA7WIm0xLFtf7UcQjvLG9S7Yy9MmIdAdOE7D+9b1yZaYVZ1B0MrFQKpxHtC/bN/bXsJkOBQGJbMNVJSZhoXXbOu25mOfVsT2V43USi1FYGETSOwt98O/+RiftQagct+C+sYIHGrseFB8U1hwVXHgwoKgQHOysguWMLuIHcfXWPPbWtcYhHk7MB/Odq+SadokwWVfCaE= 2022-04-12T02:49:14.509 INFO:teuthology.kill:2022-04-12 02:49:14,509.509 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-04-12T02:49:14.512 INFO:teuthology.kill:2022-04-12 02:49:14,512.512 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-04-12T02:49:14.514 INFO:teuthology.kill:2022-04-12 02:49:14,513.513 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-04-12T02:49:14.595 INFO:teuthology.kill:2022-04-12 02:49:14,595.595 INFO:teuthology.orchestra.console:Power off smithi163 2022-04-12T02:49:14.609 INFO:teuthology.kill:2022-04-12 02:49:14,608.608 INFO:teuthology.orchestra.console:Power off smithi116 2022-04-12T02:49:14.618 INFO:teuthology.kill:2022-04-12 02:49:14,618.618 INFO:teuthology.orchestra.console:Power off smithi185 2022-04-12T02:49:27.085 INFO:teuthology.kill:2022-04-12 02:49:27,085.085 INFO:teuthology.orchestra.console:Power off for smithi163 completed 2022-04-12T02:49:27.089 INFO:teuthology.kill:2022-04-12 02:49:27,089.089 INFO:teuthology.orchestra.console:Power off for smithi116 completed 2022-04-12T02:49:27.094 INFO:teuthology.kill:2022-04-12 02:49:27,094.094 INFO:teuthology.orchestra.console:Power off for smithi185 completed 2022-04-12T02:49:27.243 INFO:teuthology.kill:2022-04-12 02:49:27,242.242 INFO:teuthology.lock.ops:unlocked: smithi116.front.sepia.ceph.com 2022-04-12T02:49:27.246 INFO:teuthology.kill:2022-04-12 02:49:27,246.246 INFO:teuthology.lock.ops:unlocked: smithi185.front.sepia.ceph.com 2022-04-12T02:49:27.247 INFO:teuthology.kill:2022-04-12 02:49:27,247.247 INFO:teuthology.lock.ops:unlocked: smithi163.front.sepia.ceph.com 2022-04-12T02:51:27.539 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-04-12T02:51:27.650 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi116 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-04-11_21:21:54-rados-wip-yuri11-testing-2022-04-11-1138-quincy-distro-default-smithi/6787784 2022-04-12T02:51:27.650 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi163 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-04-11_21:21:54-rados-wip-yuri11-testing-2022-04-11-1138-quincy-distro-default-smithi/6787783 2022-04-12T02:51:27.650 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi185 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-04-11_21:21:54-rados-wip-yuri11-testing-2022-04-11-1138-quincy-distro-default-smithi/6787783