2021-12-09T09:00:28.997 INFO:root:teuthology version: 1.1.0-95a7d479
2021-12-09T09:00:29.165 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi087.front.sepia.ceph.com' reimaging
2021-12-09T09:00:29.166 INFO:teuthology.lock.ops:Updating [ubuntu@smithi087.front.sepia.ceph.com]: reset os type and version on server
2021-12-09T09:00:29.167 INFO:teuthology.lock.ops:Updating smithi087.front.sepia.ceph.com on lock server
2021-12-09T09:00:29.188 INFO:teuthology.lock.ops:Node 'ubuntu@smithi087.front.sepia.ceph.com' reimaging is complete
2021-12-09T09:00:29.188 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi125.front.sepia.ceph.com' reimaging
2021-12-09T09:00:29.189 INFO:teuthology.lock.ops:Updating [ubuntu@smithi125.front.sepia.ceph.com]: reset os type and version on server
2021-12-09T09:00:29.189 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server
2021-12-09T09:00:29.209 INFO:teuthology.lock.ops:Node 'ubuntu@smithi125.front.sepia.ceph.com' reimaging is complete
2021-12-09T09:00:29.209 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi142.front.sepia.ceph.com' reimaging
2021-12-09T09:00:29.209 INFO:teuthology.lock.ops:Updating [ubuntu@smithi142.front.sepia.ceph.com]: reset os type and version on server
2021-12-09T09:00:29.210 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server
2021-12-09T09:00:29.235 INFO:teuthology.lock.ops:Node 'ubuntu@smithi142.front.sepia.ceph.com' reimaging is complete
2021-12-09T09:00:29.422 INFO:teuthology.provision.fog.smithi125:Scheduling deploy of ubuntu 20.04
2021-12-09T09:00:29.423 INFO:teuthology.provision.fog.smithi087:Scheduling deploy of ubuntu 20.04
2021-12-09T09:00:29.449 INFO:teuthology.provision.fog.smithi142:Scheduling deploy of ubuntu 20.04
2021-12-09T09:00:29.771 INFO:teuthology.orchestra.console:Power off smithi087
2021-12-09T09:00:29.788 INFO:teuthology.orchestra.console:Power off smithi142
2021-12-09T09:00:29.799 INFO:teuthology.orchestra.console:Power off smithi125
2021-12-09T09:00:38.160 INFO:teuthology.orchestra.console:Power off for smithi142 completed
2021-12-09T09:00:38.261 INFO:teuthology.orchestra.console:Power on smithi142
2021-12-09T09:00:42.282 INFO:teuthology.orchestra.console:Power off for smithi087 completed
2021-12-09T09:00:42.286 INFO:teuthology.orchestra.console:Power off for smithi125 completed
2021-12-09T09:00:42.384 INFO:teuthology.orchestra.console:Power on smithi087
2021-12-09T09:00:42.391 INFO:teuthology.orchestra.console:Power on smithi125
2021-12-09T09:00:46.625 INFO:teuthology.orchestra.console:Power on for smithi142 completed
2021-12-09T09:00:46.636 INFO:teuthology.orchestra.console:Power on for smithi087 completed
2021-12-09T09:00:46.644 INFO:teuthology.orchestra.console:Power on for smithi125 completed
2021-12-09T09:00:46.727 INFO:teuthology.provision.fog.smithi142:Waiting for deploy to finish
2021-12-09T09:00:46.738 INFO:teuthology.provision.fog.smithi087:Waiting for deploy to finish
2021-12-09T09:00:46.745 INFO:teuthology.provision.fog.smithi125:Waiting for deploy to finish
2021-12-09T09:06:06.466 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-12-09T09:06:07.012 INFO:teuthology.provision.fog.smithi142:Node is ready
2021-12-09T09:06:07.019 INFO:teuthology.orchestra.run.smithi142.stdout:smithi142.front.sepia.ceph.com
2021-12-09T09:06:07.026 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142 smithi142.front.sepia.ceph.com smithi142
2021-12-09T09:06:07.233 INFO:teuthology.provision.fog.smithi142:Deploy complete!
2021-12-09T09:06:21.471 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-12-09T09:06:21.594 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-12-09T09:06:22.055 INFO:teuthology.provision.fog.smithi125:Node is ready
2021-12-09T09:06:22.062 INFO:teuthology.orchestra.run.smithi125.stdout:smithi125.front.sepia.ceph.com
2021-12-09T09:06:22.069 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.15.125 smithi125.front.sepia.ceph.com smithi125
2021-12-09T09:06:22.119 INFO:teuthology.provision.fog.smithi087:Node is ready
2021-12-09T09:06:22.125 INFO:teuthology.orchestra.run.smithi087.stdout:smithi087.front.sepia.ceph.com
2021-12-09T09:06:22.173 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87 smithi087.front.sepia.ceph.com smithi087
2021-12-09T09:06:22.216 INFO:teuthology.provision.fog.smithi125:Deploy complete!
2021-12-09T09:06:22.394 INFO:teuthology.provision.fog.smithi087:Deploy complete!
2021-12-09T09:06:22.650 INFO:teuthology.lock.ops:Checking smithi087.front.sepia.ceph.com
2021-12-09T09:06:22.651 INFO:teuthology.lock.ops:New key found. Updating...
2021-12-09T09:06:22.668 INFO:teuthology.lock.ops:Checking smithi125.front.sepia.ceph.com
2021-12-09T09:06:22.669 INFO:teuthology.lock.ops:New key found. Updating...
2021-12-09T09:06:22.687 INFO:teuthology.lock.ops:Checking smithi142.front.sepia.ceph.com
2021-12-09T09:06:22.688 INFO:teuthology.lock.ops:New key found. Updating...
2021-12-09T09:06:22.707 INFO:teuthology.lock.ops:Updating [smithi087.front.sepia.ceph.com]: set os type and version on server
2021-12-09T09:06:22.707 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com'
2021-12-09T09:06:22.898 INFO:teuthology.orchestra.run.smithi087.stdout:x86_64
2021-12-09T09:06:22.904 INFO:teuthology.orchestra.run.smithi087.stdout:NAME="Ubuntu"
2021-12-09T09:06:22.905 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION="20.04.3 LTS (Focal Fossa)"
2021-12-09T09:06:22.905 INFO:teuthology.orchestra.run.smithi087.stdout:ID=ubuntu
2021-12-09T09:06:22.905 INFO:teuthology.orchestra.run.smithi087.stdout:ID_LIKE=debian
2021-12-09T09:06:22.905 INFO:teuthology.orchestra.run.smithi087.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS"
2021-12-09T09:06:22.906 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_ID="20.04"
2021-12-09T09:06:22.906 INFO:teuthology.orchestra.run.smithi087.stdout:HOME_URL="https://www.ubuntu.com/"
2021-12-09T09:06:22.906 INFO:teuthology.orchestra.run.smithi087.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2021-12-09T09:06:22.906 INFO:teuthology.orchestra.run.smithi087.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2021-12-09T09:06:22.907 INFO:teuthology.orchestra.run.smithi087.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2021-12-09T09:06:22.907 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_CODENAME=focal
2021-12-09T09:06:22.907 INFO:teuthology.orchestra.run.smithi087.stdout:UBUNTU_CODENAME=focal
2021-12-09T09:06:22.908 INFO:teuthology.lock.ops:Updating smithi087.front.sepia.ceph.com on lock server
2021-12-09T09:06:22.927 INFO:teuthology.lock.ops:Updating [smithi125.front.sepia.ceph.com]: set os type and version on server
2021-12-09T09:06:22.927 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi125.front.sepia.ceph.com'
2021-12-09T09:06:23.094 INFO:teuthology.orchestra.run.smithi125.stdout:x86_64
2021-12-09T09:06:23.101 INFO:teuthology.orchestra.run.smithi125.stdout:NAME="Ubuntu"
2021-12-09T09:06:23.101 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION="20.04.3 LTS (Focal Fossa)"
2021-12-09T09:06:23.101 INFO:teuthology.orchestra.run.smithi125.stdout:ID=ubuntu
2021-12-09T09:06:23.101 INFO:teuthology.orchestra.run.smithi125.stdout:ID_LIKE=debian
2021-12-09T09:06:23.102 INFO:teuthology.orchestra.run.smithi125.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS"
2021-12-09T09:06:23.102 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_ID="20.04"
2021-12-09T09:06:23.103 INFO:teuthology.orchestra.run.smithi125.stdout:HOME_URL="https://www.ubuntu.com/"
2021-12-09T09:06:23.103 INFO:teuthology.orchestra.run.smithi125.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2021-12-09T09:06:23.104 INFO:teuthology.orchestra.run.smithi125.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2021-12-09T09:06:23.104 INFO:teuthology.orchestra.run.smithi125.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2021-12-09T09:06:23.105 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_CODENAME=focal
2021-12-09T09:06:23.105 INFO:teuthology.orchestra.run.smithi125.stdout:UBUNTU_CODENAME=focal
2021-12-09T09:06:23.105 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server
2021-12-09T09:06:23.124 INFO:teuthology.lock.ops:Updating [smithi142.front.sepia.ceph.com]: set os type and version on server
2021-12-09T09:06:23.124 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com'
2021-12-09T09:06:23.387 INFO:teuthology.orchestra.run.smithi142.stdout:x86_64
2021-12-09T09:06:23.393 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="Ubuntu"
2021-12-09T09:06:23.394 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="20.04.3 LTS (Focal Fossa)"
2021-12-09T09:06:23.395 INFO:teuthology.orchestra.run.smithi142.stdout:ID=ubuntu
2021-12-09T09:06:23.395 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE=debian
2021-12-09T09:06:23.395 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS"
2021-12-09T09:06:23.395 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="20.04"
2021-12-09T09:06:23.395 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://www.ubuntu.com/"
2021-12-09T09:06:23.396 INFO:teuthology.orchestra.run.smithi142.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2021-12-09T09:06:23.396 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2021-12-09T09:06:23.396 INFO:teuthology.orchestra.run.smithi142.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2021-12-09T09:06:23.396 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_CODENAME=focal
2021-12-09T09:06:23.397 INFO:teuthology.orchestra.run.smithi142.stdout:UBUNTU_CODENAME=focal
2021-12-09T09:06:23.397 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server
2021-12-09T09:06:23.510 INFO:teuthology.dispatcher.supervisor:Running job 6553474
2021-12-09T09:06:23.511 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/bin/teuthology -v --owner scheduled_benhanokh@teuthology --archive /home/teuthworker/archive/benhanokh-2021-12-08_20:57:58-rados-WIP_GBH_safe_fast_shutdown_6-distro-basic-smithi/6553474 --name benhanokh-2021-12-08_20:57:58-rados-WIP_GBH_safe_fast_shutdown_6-distro-basic-smithi --description rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} -- /home/teuthworker/archive/benhanokh-2021-12-08_20:57:58-rados-WIP_GBH_safe_fast_shutdown_6-distro-basic-smithi/6553474/orig.config.yaml
2021-12-09T09:06:23.514 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/benhanokh-2021-12-08_20:57:58-rados-WIP_GBH_safe_fast_shutdown_6-distro-basic-smithi/6553474
2021-12-09T09:06:23.515 INFO:teuthology.dispatcher.supervisor:Job PID: 13859
2021-12-09T09:06:23.516 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-12-09T21:07:18.425 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-12-09T21:07:18.556 INFO:teuthology.kill:Killing Pids: {13859}
2021-12-09T21:07:19.771 INFO:teuthology.task.internal:roles: ubuntu@smithi087.front.sepia.ceph.com - ['osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'mon.a']
2021-12-09T21:07:19.772 INFO:teuthology.task.internal:roles: ubuntu@smithi125.front.sepia.ceph.com - ['osd.4', 'osd.5', 'osd.6', 'osd.7', 'mon.b', 'mgr.x']
2021-12-09T21:07:19.772 INFO:teuthology.task.internal:roles: ubuntu@smithi142.front.sepia.ceph.com - ['osd.8', 'osd.9', 'osd.10', 'osd.11', 'mon.c']
2021-12-09T21:07:19.773 INFO:teuthology.misc:Compressing logs...
2021-12-09T21:07:19.773 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com'
2021-12-09T21:07:19.954 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi125.front.sepia.ceph.com'
2021-12-09T21:07:20.135 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com'
2021-12-09T21:07:20.401 INFO:teuthology.misc:Compressing logs...
2021-12-09T21:07:21.495 INFO:teuthology.misc:Compressing logs...
2021-12-09T21:07:33.604 INFO:teuthology.kill:No teuthology processes running
2021-12-09T21:07:34.919 INFO:teuthology.kill:Nuking machines: ['smithi087', 'smithi125', 'smithi142']
2021-12-09T21:07:35.941 INFO:teuthology.kill:2021-12-09 21:07:35,941.941 INFO:teuthology.nuke:targets:
2021-12-09T21:07:35.942 INFO:teuthology.kill:  smithi087.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC7TL9dK775uWMILpj7FcrPWCVaHLlD2F9jl6+ymS79NgtQbP5UyvqbSKChYaEiwIvxKxqoLlWdgzqScZW1Kf9O2uObQ33PV4Oh6IZuaPhpLHhUDC8qXrWZyD2Uz4LP6Gm6IIDKYVnt04BOikM3kwqf4US9psiE2CMHEvvAsF/gGL6Xv38cPWLd2d7aOwyhNf9QeOE/vpjOM+usxlD/R9DNXHTff98Hv7i575E/R8A2ImFnXIma3SUwGscsH3yOwV7KjitGOa7FtZHIKtZnnBaIpL8IA0mPtm3FkJKid8pXq2JEFNR3WxFffCKLoVyniypQ/PJIssme7i0VnCLexJhoorDbULOGwt1XJvUCbpGRcEZ+pZOKFn4J3997xw6p+R/u0kbwc8kHWJ62d+j/EAUgUnZMw1hr6sc6gdswttUZYzzlGxTW+xtatK7sptzpwDMCpky824PsNKN7uXZToYHTSvci51NfXfa6ldIIt6kl4I2ATqfIJZ811/PKMuUUb58=
2021-12-09T21:07:35.942 INFO:teuthology.kill:  smithi125.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCsoZSi/p7fxSIflJAJTfcyrIWVCZpSWRLIazPR3mX4fz2WIka9RUI6Ud1EHkU+W/L9JOCRhwiQo1oKPIxXgB2PvoO6Y7x8jjokPHULN9LlbjrIGTfa6U1fXmug2JU1ic3Qn2+anoKnceKaHIN/dOIozeiA+mQRPGbxoZ67jiqjIuIkKw/PMlxYhXiJ/k91HPzDwUcSJTC7+ouvdEprJNipkTMbdiaue375LTmncc322PDqnyThpQLWJw9pQN28as9RLiCp/Mc4QPVHFE0AEse4W50ag6fXA2sUGxcBn5roAkrHrI21cIUnzLkOELXoXeMWe97eAGmodzDWnJJEBP/0GWBsbWELQGIX46YL4waBk2c0Ld/eI6T8BISbRnlN2cFqknP3JiEwsYjA1zQpD1oLz1pWnbWpwxYMRlqPPP1U+PDWzrkmE162ixT1QNdq1lDb5SxvjroCjkn45Qaf+/E59O9OnxyF14U5Jug582kea75qxUjnHpZcdSrOPLuKkfM=
2021-12-09T21:07:35.942 INFO:teuthology.kill:  smithi142.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAPTOzj+DTFwbqFWyhJ8IW7bbXm6rUQegFoCcqgrDEblmiQPwSb9tdYnR2MuKE168X/Vq1NMqkZz0FDMWRhsuZbCOktUZKEHAa+YaR7TIavmtdEgSFKNqzFT0jdp0h3TlKUT1TbPW5iuyjWXskZ/c50cTOaSbZemu5AmXoYtppODUFj8gbOP3V1oi6FIoB3qNC6r/jaxJ/X8Fm80PjvwedFFYi/iT4yIHxV52kEI8JMDMf4BeDOvEz0gpLTd0B9L9lfZ7/iFDCkdK8gbfJK26YX8NqVzP3OqOdRmLQM5xsyihIS9K8VFLnKHWqkELRovj/EVRV/G1nOaNdUimXBq0ZFgz+ovuVpLPvAQZKCumwkqZBBy8wKCy9igbEYHc76ymacMUcnevlQrwp+55eqvDImRiy9r2kVf/WsHdKUam19YgnHGqecl8M1vDIlnZfueJuaznoS/F0i/iCdkiWQKotonbJbSLjoQe1npFhYhN/wmVvM+6U06Igq8pOUUW9yHU=
2021-12-09T21:07:35.970 INFO:teuthology.kill:2021-12-09 21:07:35,970.970 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-12-09T21:07:35.974 INFO:teuthology.kill:2021-12-09 21:07:35,974.974 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-12-09T21:07:35.978 INFO:teuthology.kill:2021-12-09 21:07:35,978.978 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-12-09T21:07:36.053 INFO:teuthology.kill:2021-12-09 21:07:36,053.053 INFO:teuthology.orchestra.console:Power off smithi142
2021-12-09T21:07:36.070 INFO:teuthology.kill:2021-12-09 21:07:36,069.069 INFO:teuthology.orchestra.console:Power off smithi087
2021-12-09T21:07:36.083 INFO:teuthology.kill:2021-12-09 21:07:36,083.083 INFO:teuthology.orchestra.console:Power off smithi125
2021-12-09T21:07:44.453 INFO:teuthology.kill:2021-12-09 21:07:44,452.452 INFO:teuthology.orchestra.console:Power off for smithi125 completed
2021-12-09T21:07:44.615 INFO:teuthology.kill:2021-12-09 21:07:44,614.614 INFO:teuthology.lock.ops:unlocked: smithi125.front.sepia.ceph.com
2021-12-09T21:07:48.554 INFO:teuthology.kill:2021-12-09 21:07:48,553.553 INFO:teuthology.orchestra.console:Power off for smithi142 completed
2021-12-09T21:07:48.558 INFO:teuthology.kill:2021-12-09 21:07:48,558.558 INFO:teuthology.orchestra.console:Power off for smithi087 completed
2021-12-09T21:07:48.706 INFO:teuthology.kill:2021-12-09 21:07:48,706.706 INFO:teuthology.lock.ops:unlocked: smithi142.front.sepia.ceph.com
2021-12-09T21:07:48.709 INFO:teuthology.kill:2021-12-09 21:07:48,708.708 INFO:teuthology.lock.ops:unlocked: smithi087.front.sepia.ceph.com
2021-12-09T21:09:49.020 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-12-09T21:09:49.140 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi087 but it was locked by another job: /home/teuthworker/archive/yuriw-2021-12-09_16:11:17-rados-wip-yuri7-testing-2021-12-08-1714-octopus-distro-default-smithi/6555606
2021-12-09T21:09:49.140 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi125 but it was locked by another job: /home/teuthworker/archive/yuriw-2021-12-09_16:11:17-rados-wip-yuri7-testing-2021-12-08-1714-octopus-distro-default-smithi/6555607
2021-12-09T21:09:49.140 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi142 but it was locked by another job: /home/teuthworker/archive/yuriw-2021-12-09_16:11:17-rados-wip-yuri7-testing-2021-12-08-1714-octopus-distro-default-smithi/6555607