2021-10-25T22:03:15.597 INFO:root:teuthology version: 1.1.0-c56135d1 2021-10-25T22:03:15.786 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi007.front.sepia.ceph.com' reimaging 2021-10-25T22:03:15.788 INFO:teuthology.lock.ops:Updating [ubuntu@smithi007.front.sepia.ceph.com]: reset os type and version on server 2021-10-25T22:03:15.788 INFO:teuthology.lock.ops:Updating smithi007.front.sepia.ceph.com on lock server 2021-10-25T22:03:15.809 INFO:teuthology.lock.ops:Node 'ubuntu@smithi007.front.sepia.ceph.com' reimaging is complete 2021-10-25T22:03:15.810 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi022.front.sepia.ceph.com' reimaging 2021-10-25T22:03:15.810 INFO:teuthology.lock.ops:Updating [ubuntu@smithi022.front.sepia.ceph.com]: reset os type and version on server 2021-10-25T22:03:15.810 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server 2021-10-25T22:03:15.831 INFO:teuthology.lock.ops:Node 'ubuntu@smithi022.front.sepia.ceph.com' reimaging is complete 2021-10-25T22:03:15.832 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi134.front.sepia.ceph.com' reimaging 2021-10-25T22:03:15.832 INFO:teuthology.lock.ops:Updating [ubuntu@smithi134.front.sepia.ceph.com]: reset os type and version on server 2021-10-25T22:03:15.832 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2021-10-25T22:03:15.859 INFO:teuthology.lock.ops:Node 'ubuntu@smithi134.front.sepia.ceph.com' reimaging is complete 2021-10-25T22:03:16.025 INFO:teuthology.provision.fog.smithi007:Scheduling deploy of ubuntu 18.04 2021-10-25T22:03:16.057 INFO:teuthology.provision.fog.smithi022:Scheduling deploy of ubuntu 18.04 2021-10-25T22:03:16.071 INFO:teuthology.provision.fog.smithi134:Scheduling deploy of ubuntu 18.04 2021-10-25T22:03:16.384 INFO:teuthology.orchestra.console:Power off smithi007 2021-10-25T22:03:16.421 INFO:teuthology.orchestra.console:Power off smithi134 2021-10-25T22:03:16.436 INFO:teuthology.orchestra.console:Power off smithi022 2021-10-25T22:03:28.886 INFO:teuthology.orchestra.console:Power off for smithi007 completed 2021-10-25T22:03:28.897 INFO:teuthology.orchestra.console:Power off for smithi134 completed 2021-10-25T22:03:28.915 INFO:teuthology.orchestra.console:Power off for smithi022 completed 2021-10-25T22:03:28.988 INFO:teuthology.orchestra.console:Power on smithi007 2021-10-25T22:03:28.998 INFO:teuthology.orchestra.console:Power on smithi134 2021-10-25T22:03:29.017 INFO:teuthology.orchestra.console:Power on smithi022 2021-10-25T22:03:33.257 INFO:teuthology.orchestra.console:Power on for smithi134 completed 2021-10-25T22:03:33.358 INFO:teuthology.provision.fog.smithi134:Waiting for deploy to finish 2021-10-25T22:03:37.382 INFO:teuthology.orchestra.console:Power on for smithi022 completed 2021-10-25T22:03:37.409 INFO:teuthology.orchestra.console:Power on for smithi007 completed 2021-10-25T22:03:37.484 INFO:teuthology.provision.fog.smithi022:Waiting for deploy to finish 2021-10-25T22:03:37.510 INFO:teuthology.provision.fog.smithi007:Waiting for deploy to finish 2021-10-25T22:08:42.194 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-10-25T22:08:42.217 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-10-25T22:08:42.464 INFO:teuthology.provision.fog.smithi022:Node is ready 2021-10-25T22:08:42.510 INFO:teuthology.orchestra.run.smithi022.stdout:smithi022.front.sepia.ceph.com 2021-10-25T22:08:42.559 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2021-10-25T22:08:42.610 INFO:teuthology.provision.fog.smithi007:Node is ready 2021-10-25T22:08:42.616 INFO:teuthology.orchestra.run.smithi007.stdout:smithi007.front.sepia.ceph.com 2021-10-25T22:08:42.667 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7 smithi007.front.sepia.ceph.com smithi007 2021-10-25T22:08:42.846 INFO:teuthology.provision.fog.smithi022:Deploy complete! 2021-10-25T22:08:42.962 INFO:teuthology.provision.fog.smithi007:Deploy complete! 2021-10-25T22:08:53.140 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-10-25T22:08:53.369 INFO:teuthology.provision.fog.smithi134:Node is ready 2021-10-25T22:08:53.418 INFO:teuthology.orchestra.run.smithi134.stdout:smithi134.front.sepia.ceph.com 2021-10-25T22:08:53.466 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134 smithi134.front.sepia.ceph.com smithi134 2021-10-25T22:08:53.761 INFO:teuthology.provision.fog.smithi134:Deploy complete! 2021-10-25T22:08:53.961 INFO:teuthology.lock.ops:Checking smithi007.front.sepia.ceph.com 2021-10-25T22:08:53.962 INFO:teuthology.lock.ops:New key found. Updating... 2021-10-25T22:08:53.980 INFO:teuthology.lock.ops:Checking smithi022.front.sepia.ceph.com 2021-10-25T22:08:53.981 INFO:teuthology.lock.ops:New key found. Updating... 2021-10-25T22:08:53.997 INFO:teuthology.lock.ops:Checking smithi134.front.sepia.ceph.com 2021-10-25T22:08:53.998 INFO:teuthology.lock.ops:New key found. Updating... 2021-10-25T22:08:54.016 INFO:teuthology.lock.ops:Updating [smithi007.front.sepia.ceph.com]: set os type and version on server 2021-10-25T22:08:54.016 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2021-10-25T22:08:54.297 INFO:teuthology.orchestra.run.smithi007.stdout:x86_64 2021-10-25T22:08:54.345 INFO:teuthology.orchestra.run.smithi007.stdout:NAME="Ubuntu" 2021-10-25T22:08:54.346 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION="18.04.6 LTS (Bionic Beaver)" 2021-10-25T22:08:54.346 INFO:teuthology.orchestra.run.smithi007.stdout:ID=ubuntu 2021-10-25T22:08:54.346 INFO:teuthology.orchestra.run.smithi007.stdout:ID_LIKE=debian 2021-10-25T22:08:54.346 INFO:teuthology.orchestra.run.smithi007.stdout:PRETTY_NAME="Ubuntu 18.04.6 LTS" 2021-10-25T22:08:54.347 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION_ID="18.04" 2021-10-25T22:08:54.347 INFO:teuthology.orchestra.run.smithi007.stdout:HOME_URL="https://www.ubuntu.com/" 2021-10-25T22:08:54.347 INFO:teuthology.orchestra.run.smithi007.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-10-25T22:08:54.347 INFO:teuthology.orchestra.run.smithi007.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-10-25T22:08:54.348 INFO:teuthology.orchestra.run.smithi007.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-10-25T22:08:54.348 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION_CODENAME=bionic 2021-10-25T22:08:54.348 INFO:teuthology.orchestra.run.smithi007.stdout:UBUNTU_CODENAME=bionic 2021-10-25T22:08:54.349 INFO:teuthology.lock.ops:Updating smithi007.front.sepia.ceph.com on lock server 2021-10-25T22:08:54.368 INFO:teuthology.lock.ops:Updating [smithi022.front.sepia.ceph.com]: set os type and version on server 2021-10-25T22:08:54.368 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2021-10-25T22:08:54.651 INFO:teuthology.orchestra.run.smithi022.stdout:x86_64 2021-10-25T22:08:54.698 INFO:teuthology.orchestra.run.smithi022.stdout:NAME="Ubuntu" 2021-10-25T22:08:54.699 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION="18.04.6 LTS (Bionic Beaver)" 2021-10-25T22:08:54.699 INFO:teuthology.orchestra.run.smithi022.stdout:ID=ubuntu 2021-10-25T22:08:54.699 INFO:teuthology.orchestra.run.smithi022.stdout:ID_LIKE=debian 2021-10-25T22:08:54.699 INFO:teuthology.orchestra.run.smithi022.stdout:PRETTY_NAME="Ubuntu 18.04.6 LTS" 2021-10-25T22:08:54.700 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_ID="18.04" 2021-10-25T22:08:54.700 INFO:teuthology.orchestra.run.smithi022.stdout:HOME_URL="https://www.ubuntu.com/" 2021-10-25T22:08:54.700 INFO:teuthology.orchestra.run.smithi022.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-10-25T22:08:54.700 INFO:teuthology.orchestra.run.smithi022.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-10-25T22:08:54.701 INFO:teuthology.orchestra.run.smithi022.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-10-25T22:08:54.701 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_CODENAME=bionic 2021-10-25T22:08:54.701 INFO:teuthology.orchestra.run.smithi022.stdout:UBUNTU_CODENAME=bionic 2021-10-25T22:08:54.701 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server 2021-10-25T22:08:54.721 INFO:teuthology.lock.ops:Updating [smithi134.front.sepia.ceph.com]: set os type and version on server 2021-10-25T22:08:54.721 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2021-10-25T22:08:54.960 INFO:teuthology.orchestra.run.smithi134.stdout:x86_64 2021-10-25T22:08:55.008 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="Ubuntu" 2021-10-25T22:08:55.009 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="18.04.6 LTS (Bionic Beaver)" 2021-10-25T22:08:55.009 INFO:teuthology.orchestra.run.smithi134.stdout:ID=ubuntu 2021-10-25T22:08:55.009 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE=debian 2021-10-25T22:08:55.009 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="Ubuntu 18.04.6 LTS" 2021-10-25T22:08:55.010 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="18.04" 2021-10-25T22:08:55.010 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://www.ubuntu.com/" 2021-10-25T22:08:55.010 INFO:teuthology.orchestra.run.smithi134.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-10-25T22:08:55.010 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-10-25T22:08:55.010 INFO:teuthology.orchestra.run.smithi134.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-10-25T22:08:55.011 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_CODENAME=bionic 2021-10-25T22:08:55.011 INFO:teuthology.orchestra.run.smithi134.stdout:UBUNTU_CODENAME=bionic 2021-10-25T22:08:55.011 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2021-10-25T22:08:55.125 INFO:teuthology.dispatcher.supervisor:Running job 6460817 2021-10-25T22:08:55.126 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2021-10-25_18:45:55-rados-wip-yuri3-testing-2021-10-25-0843-octopus-distro-basic-smithi/6460817 --name yuriw-2021-10-25_18:45:55-rados-wip-yuri3-testing-2021-10-25-0843-octopus-distro-basic-smithi --description rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_18.04} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} -- /home/teuthworker/archive/yuriw-2021-10-25_18:45:55-rados-wip-yuri3-testing-2021-10-25-0843-octopus-distro-basic-smithi/6460817/orig.config.yaml 2021-10-25T22:08:55.129 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2021-10-25_18:45:55-rados-wip-yuri3-testing-2021-10-25-0843-octopus-distro-basic-smithi/6460817 2021-10-25T22:08:55.129 INFO:teuthology.dispatcher.supervisor:Job PID: 6775 2021-10-25T22:08:55.130 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-10-26T10:09:46.590 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2021-10-26T10:09:46.741 INFO:teuthology.kill:Killing Pids: {6775} 2021-10-26T10:09:47.831 INFO:teuthology.task.internal:roles: ubuntu@smithi007.front.sepia.ceph.com - ['osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'mon.a'] 2021-10-26T10:09:47.831 INFO:teuthology.task.internal:roles: ubuntu@smithi022.front.sepia.ceph.com - ['osd.4', 'osd.5', 'osd.6', 'osd.7', 'mon.b', 'mgr.x'] 2021-10-26T10:09:47.832 INFO:teuthology.task.internal:roles: ubuntu@smithi134.front.sepia.ceph.com - ['osd.8', 'osd.9', 'osd.10', 'osd.11', 'mon.c'] 2021-10-26T10:09:47.832 INFO:teuthology.misc:Compressing logs... 2021-10-26T10:09:47.833 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2021-10-26T10:09:48.276 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2021-10-26T10:09:48.919 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2021-10-26T10:09:50.392 INFO:teuthology.kill:No teuthology processes running 2021-10-26T10:09:51.367 INFO:teuthology.kill:Nuking machines: ['smithi007', 'smithi022', 'smithi134'] 2021-10-26T10:09:52.205 INFO:teuthology.kill:2021-10-26 10:09:52,204.204 INFO:teuthology.nuke:targets: 2021-10-26T10:09:52.205 INFO:teuthology.kill: smithi007.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+N7Dd0hd4f+2utJbxq/AxkFPHmHhmab9Bh4O3K+yUYIwc9uRNb3FVusWkcUiKiV1qofJW2qTzicSBn36vvuW44+cy0LLwK3JWPe89j62MXf5IIlhVmhKVhyqj5g0Rr/Y9/m65ot1/UIhxIYHJkqa7DjCk0MaCV+PW9haHU9l+WY7/YLdxmu+NXywYhZ/pmhegf15XK7CIzj88onghtB0qQCT4S4jT2oXCus0Dqj/rrrup/KuIxSZI4NIlNoW4UAGyUi0txiriUImxrQeoDSJhWQXSJuQ6y5G3Ai4lS0i+8vrlN3B+pcOduE5E7f4bUz1IGULEIMJCgpyX5oHQTFGb 2021-10-26T10:09:52.206 INFO:teuthology.kill: smithi022.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDLzAc+w9E3975c0tDrIihYwa7QxLEyX+EAVXljHr8sQPsh3eiE0LluebK6OYQXLoUdBjsjUttyeYzilIPXjEfl6Eou4Twlks+v1h11uExfJlCTXJxuwm13yzMkRQTE7Vty6rYgy7uf4rcWSgjvqDuLgcfc63Sg7r1xDt8OaSspI+jlvSW+mzFOIlevDlgvOpoGNIMPwrX+FeiLj/IL6GqER9GLUsMeFtcgoW+spGPSJqTM0Gdwf1MAz0HIlnLw7334ZSB4l1Kcmsb1db7VgjHmQzO2ikyH20Q6qkgStLSxpTWIRdOH3+PXF8FwRaUkaDB1UzMu5rV4h2ICjhvMlphF 2021-10-26T10:09:52.206 INFO:teuthology.kill: smithi134.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYc0SA8cMUZGMoQF4hYb6+COdn5kEMq/FgB63YvjVWBLM/3jDJtRWFqTNNfDLF7HopVX+t2pNHOtyFjOAHeu7KgLAHceZPFo2CdHXOdprE71R6jF84RwiZR8toKCnzDhfbPY/DnFIyevOvZ9oFYFOOoS4I+zflAqbbjWbm2qNemLVTSj2O4jxEyTA9QVdb/V3Of1iusAR5Fgb1dzDkOAQyIf9YbxPw5Jy1Ql8C6ov4s9tZoX4jDFnbyWbnNwrXynFjCX1aNoCU9ObdNcPF4QED/HTjXOfgGlWs0EHQsQayPMKbgals6B9is0MZEPiRIAJJiVYs6dabXfp46nLYkjEL 2021-10-26T10:09:52.233 INFO:teuthology.kill:2021-10-26 10:09:52,233.233 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-10-26T10:09:52.237 INFO:teuthology.kill:2021-10-26 10:09:52,237.237 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-10-26T10:09:52.238 INFO:teuthology.kill:2021-10-26 10:09:52,238.238 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-10-26T10:09:52.321 INFO:teuthology.kill:2021-10-26 10:09:52,320.320 INFO:teuthology.orchestra.console:Power off smithi022 2021-10-26T10:09:52.333 INFO:teuthology.kill:2021-10-26 10:09:52,333.333 INFO:teuthology.orchestra.console:Power off smithi007 2021-10-26T10:09:52.343 INFO:teuthology.kill:2021-10-26 10:09:52,343.343 INFO:teuthology.orchestra.console:Power off smithi134 2021-10-26T10:10:00.701 INFO:teuthology.kill:2021-10-26 10:10:00,701.701 INFO:teuthology.orchestra.console:Power off for smithi022 completed 2021-10-26T10:10:00.706 INFO:teuthology.kill:2021-10-26 10:10:00,706.706 INFO:teuthology.orchestra.console:Power off for smithi007 completed 2021-10-26T10:10:00.714 INFO:teuthology.kill:2021-10-26 10:10:00,714.714 INFO:teuthology.orchestra.console:Power off for smithi134 completed 2021-10-26T10:10:00.852 INFO:teuthology.kill:2021-10-26 10:10:00,851.851 INFO:teuthology.lock.ops:unlocked: smithi007.front.sepia.ceph.com 2021-10-26T10:10:00.856 INFO:teuthology.kill:2021-10-26 10:10:00,855.855 INFO:teuthology.lock.ops:unlocked: smithi022.front.sepia.ceph.com 2021-10-26T10:10:00.859 INFO:teuthology.kill:2021-10-26 10:10:00,858.858 INFO:teuthology.lock.ops:unlocked: smithi134.front.sepia.ceph.com 2021-10-26T10:12:01.102 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15