2021-12-01T12:42:00.766 INFO:root:teuthology version: 1.1.0-844d1377 2021-12-01T12:42:00.963 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi006.front.sepia.ceph.com' reimaging 2021-12-01T12:42:00.964 INFO:teuthology.lock.ops:Updating [ubuntu@smithi006.front.sepia.ceph.com]: reset os type and version on server 2021-12-01T12:42:00.965 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2021-12-01T12:42:00.993 INFO:teuthology.lock.ops:Node 'ubuntu@smithi006.front.sepia.ceph.com' reimaging is complete 2021-12-01T12:42:00.993 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi023.front.sepia.ceph.com' reimaging 2021-12-01T12:42:00.999 INFO:teuthology.lock.ops:Updating [ubuntu@smithi023.front.sepia.ceph.com]: reset os type and version on server 2021-12-01T12:42:00.999 INFO:teuthology.lock.ops:Updating smithi023.front.sepia.ceph.com on lock server 2021-12-01T12:42:01.025 INFO:teuthology.lock.ops:Node 'ubuntu@smithi023.front.sepia.ceph.com' reimaging is complete 2021-12-01T12:42:01.025 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi068.front.sepia.ceph.com' reimaging 2021-12-01T12:42:01.026 INFO:teuthology.lock.ops:Updating [ubuntu@smithi068.front.sepia.ceph.com]: reset os type and version on server 2021-12-01T12:42:01.026 INFO:teuthology.lock.ops:Updating smithi068.front.sepia.ceph.com on lock server 2021-12-01T12:42:01.046 INFO:teuthology.lock.ops:Node 'ubuntu@smithi068.front.sepia.ceph.com' reimaging is complete 2021-12-01T12:42:01.239 INFO:teuthology.provision.fog.smithi006:Scheduling deploy of ubuntu 18.04 2021-12-01T12:42:01.288 INFO:teuthology.provision.fog.smithi023:Scheduling deploy of ubuntu 18.04 2021-12-01T12:42:01.353 INFO:teuthology.provision.fog.smithi068:Scheduling deploy of ubuntu 18.04 2021-12-01T12:42:01.615 INFO:teuthology.orchestra.console:Power off smithi006 2021-12-01T12:42:01.670 INFO:teuthology.orchestra.console:Power off smithi023 2021-12-01T12:42:01.756 INFO:teuthology.orchestra.console:Power off smithi068 2021-12-01T12:42:14.177 INFO:teuthology.orchestra.console:Power off for smithi006 completed 2021-12-01T12:42:14.202 INFO:teuthology.orchestra.console:Power off for smithi023 completed 2021-12-01T12:42:14.271 INFO:teuthology.orchestra.console:Power off for smithi068 completed 2021-12-01T12:42:14.278 INFO:teuthology.orchestra.console:Power on smithi006 2021-12-01T12:42:14.307 INFO:teuthology.orchestra.console:Power on smithi023 2021-12-01T12:42:14.372 INFO:teuthology.orchestra.console:Power on smithi068 2021-12-01T12:42:18.622 INFO:teuthology.orchestra.console:Power on for smithi068 completed 2021-12-01T12:42:18.724 INFO:teuthology.provision.fog.smithi068:Waiting for deploy to finish 2021-12-01T12:42:22.648 INFO:teuthology.orchestra.console:Power on for smithi006 completed 2021-12-01T12:42:22.669 INFO:teuthology.orchestra.console:Power on for smithi023 completed 2021-12-01T12:42:22.750 INFO:teuthology.provision.fog.smithi006:Waiting for deploy to finish 2021-12-01T12:42:22.770 INFO:teuthology.provision.fog.smithi023:Waiting for deploy to finish 2021-12-01T12:47:27.319 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-12-01T12:47:27.572 INFO:teuthology.provision.fog.smithi006:Node is ready 2021-12-01T12:47:27.618 INFO:teuthology.orchestra.run.smithi006.stdout:smithi006.front.sepia.ceph.com 2021-12-01T12:47:27.667 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6 smithi006.front.sepia.ceph.com smithi006 2021-12-01T12:47:27.970 INFO:teuthology.provision.fog.smithi006:Deploy complete! 2021-12-01T12:47:38.655 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-12-01T12:47:38.948 INFO:teuthology.provision.fog.smithi068:Node is ready 2021-12-01T12:47:39.000 INFO:teuthology.orchestra.run.smithi068.stdout:smithi068.front.sepia.ceph.com 2021-12-01T12:47:39.047 INFO:teuthology.orchestra.run.smithi068.stdout:172.21.15.68 smithi068.front.sepia.ceph.com smithi068 2021-12-01T12:47:39.351 INFO:teuthology.provision.fog.smithi068:Deploy complete! 2021-12-01T12:47:57.614 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-12-01T12:47:57.888 INFO:teuthology.provision.fog.smithi023:Node is ready 2021-12-01T12:47:57.938 INFO:teuthology.orchestra.run.smithi023.stdout:smithi023.front.sepia.ceph.com 2021-12-01T12:47:57.985 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23 smithi023.front.sepia.ceph.com smithi023 2021-12-01T12:47:58.271 INFO:teuthology.provision.fog.smithi023:Deploy complete! 2021-12-01T12:47:58.476 INFO:teuthology.lock.ops:Checking smithi006.front.sepia.ceph.com 2021-12-01T12:47:58.477 INFO:teuthology.lock.ops:New key found. Updating... 2021-12-01T12:47:58.498 INFO:teuthology.lock.ops:Checking smithi023.front.sepia.ceph.com 2021-12-01T12:47:58.498 INFO:teuthology.lock.ops:New key found. Updating... 2021-12-01T12:47:58.516 INFO:teuthology.lock.ops:Checking smithi068.front.sepia.ceph.com 2021-12-01T12:47:58.517 INFO:teuthology.lock.ops:New key found. Updating... 2021-12-01T12:47:58.542 INFO:teuthology.lock.ops:Updating [smithi006.front.sepia.ceph.com]: set os type and version on server 2021-12-01T12:47:58.543 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2021-12-01T12:47:58.842 INFO:teuthology.orchestra.run.smithi006.stdout:x86_64 2021-12-01T12:47:58.890 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="Ubuntu" 2021-12-01T12:47:58.890 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="18.04.6 LTS (Bionic Beaver)" 2021-12-01T12:47:58.891 INFO:teuthology.orchestra.run.smithi006.stdout:ID=ubuntu 2021-12-01T12:47:58.891 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE=debian 2021-12-01T12:47:58.891 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="Ubuntu 18.04.6 LTS" 2021-12-01T12:47:58.892 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="18.04" 2021-12-01T12:47:58.892 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://www.ubuntu.com/" 2021-12-01T12:47:58.892 INFO:teuthology.orchestra.run.smithi006.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-12-01T12:47:58.892 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-12-01T12:47:58.893 INFO:teuthology.orchestra.run.smithi006.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-12-01T12:47:58.893 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_CODENAME=bionic 2021-12-01T12:47:58.893 INFO:teuthology.orchestra.run.smithi006.stdout:UBUNTU_CODENAME=bionic 2021-12-01T12:47:58.895 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2021-12-01T12:47:58.913 INFO:teuthology.lock.ops:Updating [smithi023.front.sepia.ceph.com]: set os type and version on server 2021-12-01T12:47:58.914 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi023.front.sepia.ceph.com' 2021-12-01T12:47:59.169 INFO:teuthology.orchestra.run.smithi023.stdout:x86_64 2021-12-01T12:47:59.217 INFO:teuthology.orchestra.run.smithi023.stdout:NAME="Ubuntu" 2021-12-01T12:47:59.217 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION="18.04.6 LTS (Bionic Beaver)" 2021-12-01T12:47:59.218 INFO:teuthology.orchestra.run.smithi023.stdout:ID=ubuntu 2021-12-01T12:47:59.218 INFO:teuthology.orchestra.run.smithi023.stdout:ID_LIKE=debian 2021-12-01T12:47:59.219 INFO:teuthology.orchestra.run.smithi023.stdout:PRETTY_NAME="Ubuntu 18.04.6 LTS" 2021-12-01T12:47:59.220 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION_ID="18.04" 2021-12-01T12:47:59.220 INFO:teuthology.orchestra.run.smithi023.stdout:HOME_URL="https://www.ubuntu.com/" 2021-12-01T12:47:59.220 INFO:teuthology.orchestra.run.smithi023.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-12-01T12:47:59.221 INFO:teuthology.orchestra.run.smithi023.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-12-01T12:47:59.221 INFO:teuthology.orchestra.run.smithi023.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-12-01T12:47:59.222 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION_CODENAME=bionic 2021-12-01T12:47:59.222 INFO:teuthology.orchestra.run.smithi023.stdout:UBUNTU_CODENAME=bionic 2021-12-01T12:47:59.223 INFO:teuthology.lock.ops:Updating smithi023.front.sepia.ceph.com on lock server 2021-12-01T12:47:59.243 INFO:teuthology.lock.ops:Updating [smithi068.front.sepia.ceph.com]: set os type and version on server 2021-12-01T12:47:59.244 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi068.front.sepia.ceph.com' 2021-12-01T12:47:59.492 INFO:teuthology.orchestra.run.smithi068.stdout:x86_64 2021-12-01T12:47:59.540 INFO:teuthology.orchestra.run.smithi068.stdout:NAME="Ubuntu" 2021-12-01T12:47:59.540 INFO:teuthology.orchestra.run.smithi068.stdout:VERSION="18.04.6 LTS (Bionic Beaver)" 2021-12-01T12:47:59.540 INFO:teuthology.orchestra.run.smithi068.stdout:ID=ubuntu 2021-12-01T12:47:59.541 INFO:teuthology.orchestra.run.smithi068.stdout:ID_LIKE=debian 2021-12-01T12:47:59.541 INFO:teuthology.orchestra.run.smithi068.stdout:PRETTY_NAME="Ubuntu 18.04.6 LTS" 2021-12-01T12:47:59.541 INFO:teuthology.orchestra.run.smithi068.stdout:VERSION_ID="18.04" 2021-12-01T12:47:59.541 INFO:teuthology.orchestra.run.smithi068.stdout:HOME_URL="https://www.ubuntu.com/" 2021-12-01T12:47:59.542 INFO:teuthology.orchestra.run.smithi068.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-12-01T12:47:59.542 INFO:teuthology.orchestra.run.smithi068.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-12-01T12:47:59.542 INFO:teuthology.orchestra.run.smithi068.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-12-01T12:47:59.542 INFO:teuthology.orchestra.run.smithi068.stdout:VERSION_CODENAME=bionic 2021-12-01T12:47:59.543 INFO:teuthology.orchestra.run.smithi068.stdout:UBUNTU_CODENAME=bionic 2021-12-01T12:47:59.543 INFO:teuthology.lock.ops:Updating smithi068.front.sepia.ceph.com on lock server 2021-12-01T12:47:59.648 INFO:teuthology.dispatcher.supervisor:Running job 6536783 2021-12-01T12:47:59.648 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_844d13778e221f3c1f3cb6626445c4bc2f71766d/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2021-11-30_23:32:04-rados-wip-yuri8-testing-2021-11-30-0825-octopus-distro-default-smithi/6536783 --name yuriw-2021-11-30_23:32:04-rados-wip-yuri8-testing-2021-11-30-0825-octopus-distro-default-smithi --description rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_18.04} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} -- /home/teuthworker/archive/yuriw-2021-11-30_23:32:04-rados-wip-yuri8-testing-2021-11-30-0825-octopus-distro-default-smithi/6536783/orig.config.yaml 2021-12-01T12:47:59.652 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2021-11-30_23:32:04-rados-wip-yuri8-testing-2021-11-30-0825-octopus-distro-default-smithi/6536783 2021-12-01T12:47:59.652 INFO:teuthology.dispatcher.supervisor:Job PID: 9355 2021-12-01T12:47:59.653 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-12-01T12:48:54.981 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2021-12-02T00:48:54.414 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2021-12-02T00:48:55.616 INFO:teuthology.kill:Killing Pids: {9355} 2021-12-02T00:48:56.905 INFO:teuthology.task.internal:roles: ubuntu@smithi006.front.sepia.ceph.com - ['osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'mon.a'] 2021-12-02T00:48:56.907 INFO:teuthology.task.internal:roles: ubuntu@smithi023.front.sepia.ceph.com - ['osd.4', 'osd.5', 'osd.6', 'osd.7', 'mon.b', 'mgr.x'] 2021-12-02T00:48:56.907 INFO:teuthology.task.internal:roles: ubuntu@smithi068.front.sepia.ceph.com - ['osd.8', 'osd.9', 'osd.10', 'osd.11', 'mon.c'] 2021-12-02T00:48:56.912 INFO:teuthology.misc:Compressing logs... 2021-12-02T00:48:56.922 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2021-12-02T00:48:58.091 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi023.front.sepia.ceph.com' 2021-12-02T00:48:58.900 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi068.front.sepia.ceph.com' 2021-12-02T00:49:00.980 INFO:teuthology.kill:No teuthology processes running 2021-12-02T00:49:02.115 INFO:teuthology.kill:Nuking machines: ['smithi006', 'smithi023', 'smithi068'] 2021-12-02T00:49:03.006 INFO:teuthology.kill:2021-12-02 00:49:03,006.006 INFO:teuthology.nuke:targets: 2021-12-02T00:49:03.007 INFO:teuthology.kill: smithi006.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC77hTnOj6cgX/9auNRRanppQq79GZkLaZnZiaY7iBwoOmH8vNvZuMIudNyu8ORuEi3NCAZ5aKFCc+MfP1oLHhHfmzBLnW/gmNX44+8dC9NqxMe7eJNmADk/l9XlmGhbC44FnC1dtj6Fb0wNt5kZbHfq593n7jpgYSRNE0CzD6I1Nk/AQ4TzFkTalUEfaGjeFYaYw9U++lYP4WgeksvvdONjcrmq7k5ZxUVUxDlUcNUqzsu5yDaw4fivmsnAgTJs3ejfI0QQZVdrh+Z4P815yRmOtf0NFoNNh9HwDwkDCGvNjEK7+mpittr0jqP0kIDRVBhp0lhBGqSv2GSdVX3w2ll 2021-12-02T00:49:03.008 INFO:teuthology.kill: smithi023.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCHyRlL4jt+Fpv0yzAcQVastHQXe4+jJpsS1yYkX7grMWTCEeM/c4Cdse2lxAWd/GAdumD1U2hI/FJffI8COCsMSr0rYCKn/qWhrtEVgMelXcXrEfRW9Okw8+k25Vo9NDzSHtvTn+9N12uhvhJAti5rubdEAaqAo/R0pKaKqksIZtoLgAA6z3he5JBzvZyW5TTI8KRIKHJGPfq/6RB9tqtY8NMmAMyslsH2P1v/16zGcfVZPIRsxrr39/bF9P0LJrkF4uafnRWG7R5jRiEkboZya73AeL6T+Qw2XhUl5fHn7pBmdYCt4hkgjLgSQu/37nXylFsxX4H48py6wyxz9pj 2021-12-02T00:49:03.008 INFO:teuthology.kill: smithi068.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIy938C3xsmwdQxuttdPeYQiDvGAJITZBmlgjNAixK7CR7WNFpRu+nYgAj63xgIqsy/M5qTN8ew0ha2NeacgEpjPx6ag3EVbYgnD97g2Yq3uWjI07UzKT0maxASVF0oP8xscgfBHFe/m8NcFNG07SrnQYlvXjCkr3SvdF1PNdcTYikwYlpTTF/6WP6qclPeDpUWqE07Xv6/DUwERClNhWFjBGXFhkKL19gJ8OmQmY0EirZOGLwqutz4l+dhaSv9DfKiK1gVnfhJfPXWOs/nCDP/fRNYWLljRPBx8eWdNSmdKEWmXD3ZwWeBPFu7m46lTEo3PXlyA+BUxYwUhtSbzmT 2021-12-02T00:49:03.035 INFO:teuthology.kill:2021-12-02 00:49:03,035.035 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-12-02T00:49:03.038 INFO:teuthology.kill:2021-12-02 00:49:03,038.038 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-12-02T00:49:03.041 INFO:teuthology.kill:2021-12-02 00:49:03,041.041 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-12-02T00:49:03.117 INFO:teuthology.kill:2021-12-02 00:49:03,117.117 INFO:teuthology.orchestra.console:Power off smithi006 2021-12-02T00:49:03.131 INFO:teuthology.kill:2021-12-02 00:49:03,131.131 INFO:teuthology.orchestra.console:Power off smithi068 2021-12-02T00:49:03.142 INFO:teuthology.kill:2021-12-02 00:49:03,141.141 INFO:teuthology.orchestra.console:Power off smithi023 2021-12-02T00:49:11.510 INFO:teuthology.kill:2021-12-02 00:49:11,509.509 INFO:teuthology.orchestra.console:Power off for smithi023 completed 2021-12-02T00:49:11.658 INFO:teuthology.kill:2021-12-02 00:49:11,657.657 INFO:teuthology.lock.ops:unlocked: smithi023.front.sepia.ceph.com 2021-12-02T00:49:15.609 INFO:teuthology.kill:2021-12-02 00:49:15,609.609 INFO:teuthology.orchestra.console:Power off for smithi006 completed 2021-12-02T00:49:15.615 INFO:teuthology.kill:2021-12-02 00:49:15,615.615 INFO:teuthology.orchestra.console:Power off for smithi068 completed 2021-12-02T00:49:15.757 INFO:teuthology.kill:2021-12-02 00:49:15,757.757 INFO:teuthology.lock.ops:unlocked: smithi068.front.sepia.ceph.com 2021-12-02T00:49:15.762 INFO:teuthology.kill:2021-12-02 00:49:15,762.762 INFO:teuthology.lock.ops:unlocked: smithi006.front.sepia.ceph.com 2021-12-02T00:51:16.063 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15