2022-02-20T16:19:58.519 INFO:root:teuthology version: 1.1.0-eea25212
2022-02-20T16:19:58.687 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi002.front.sepia.ceph.com' reimaging
2022-02-20T16:19:58.688 INFO:teuthology.lock.ops:Updating [ubuntu@smithi002.front.sepia.ceph.com]: reset os type and version on server
2022-02-20T16:19:58.689 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server
2022-02-20T16:19:58.708 INFO:teuthology.lock.ops:Node 'ubuntu@smithi002.front.sepia.ceph.com' reimaging is complete
2022-02-20T16:19:58.709 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi141.front.sepia.ceph.com' reimaging
2022-02-20T16:19:58.709 INFO:teuthology.lock.ops:Updating [ubuntu@smithi141.front.sepia.ceph.com]: reset os type and version on server
2022-02-20T16:19:58.709 INFO:teuthology.lock.ops:Updating smithi141.front.sepia.ceph.com on lock server
2022-02-20T16:19:58.731 INFO:teuthology.lock.ops:Node 'ubuntu@smithi141.front.sepia.ceph.com' reimaging is complete
2022-02-20T16:19:58.732 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi181.front.sepia.ceph.com' reimaging
2022-02-20T16:19:58.732 INFO:teuthology.lock.ops:Updating [ubuntu@smithi181.front.sepia.ceph.com]: reset os type and version on server
2022-02-20T16:19:58.733 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server
2022-02-20T16:19:58.755 INFO:teuthology.lock.ops:Node 'ubuntu@smithi181.front.sepia.ceph.com' reimaging is complete
2022-02-20T16:19:58.924 INFO:teuthology.provision.fog.smithi002:Scheduling deploy of ubuntu 20.04
2022-02-20T16:19:58.950 INFO:teuthology.provision.fog.smithi141:Scheduling deploy of ubuntu 20.04
2022-02-20T16:19:58.972 INFO:teuthology.provision.fog.smithi181:Scheduling deploy of ubuntu 20.04
2022-02-20T16:19:59.269 INFO:teuthology.orchestra.console:Power off smithi141
2022-02-20T16:19:59.312 INFO:teuthology.orchestra.console:Power off smithi181
2022-02-20T16:19:59.324 INFO:teuthology.orchestra.console:Power off smithi002
2022-02-20T16:20:07.675 INFO:teuthology.orchestra.console:Power off for smithi181 completed
2022-02-20T16:20:07.698 INFO:teuthology.orchestra.console:Power off for smithi002 completed
2022-02-20T16:20:07.777 INFO:teuthology.orchestra.console:Power on smithi181
2022-02-20T16:20:07.805 INFO:teuthology.orchestra.console:Power on smithi002
2022-02-20T16:20:11.768 INFO:teuthology.orchestra.console:Power off for smithi141 completed
2022-02-20T16:20:11.870 INFO:teuthology.orchestra.console:Power on smithi141
2022-02-20T16:20:16.140 INFO:teuthology.orchestra.console:Power on for smithi181 completed
2022-02-20T16:20:16.168 INFO:teuthology.orchestra.console:Power on for smithi002 completed
2022-02-20T16:20:16.241 INFO:teuthology.provision.fog.smithi181:Waiting for deploy to finish
2022-02-20T16:20:16.269 INFO:teuthology.provision.fog.smithi002:Waiting for deploy to finish
2022-02-20T16:20:20.235 INFO:teuthology.orchestra.console:Power on for smithi141 completed
2022-02-20T16:20:20.336 INFO:teuthology.provision.fog.smithi141:Waiting for deploy to finish
2022-02-20T16:24:54.570 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-02-20T16:24:55.126 INFO:teuthology.provision.fog.smithi002:Node is ready
2022-02-20T16:24:55.133 INFO:teuthology.orchestra.run.smithi002.stdout:smithi002.front.sepia.ceph.com
2022-02-20T16:24:55.182 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2 smithi002.front.sepia.ceph.com smithi002
2022-02-20T16:24:55.348 INFO:teuthology.provision.fog.smithi002:Deploy complete!
2022-02-20T16:25:11.145 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-02-20T16:25:11.585 INFO:teuthology.provision.fog.smithi181:Node is ready
2022-02-20T16:25:11.592 INFO:teuthology.orchestra.run.smithi181.stdout:smithi181.front.sepia.ceph.com
2022-02-20T16:25:11.642 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.15.181 smithi181.front.sepia.ceph.com smithi181
2022-02-20T16:25:11.780 INFO:teuthology.provision.fog.smithi181:Deploy complete!
2022-02-20T16:25:13.392 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-02-20T16:25:13.830 INFO:teuthology.provision.fog.smithi141:Node is ready
2022-02-20T16:25:13.836 INFO:teuthology.orchestra.run.smithi141.stdout:smithi141.front.sepia.ceph.com
2022-02-20T16:25:13.844 INFO:teuthology.orchestra.run.smithi141.stdout:172.21.15.141 smithi141.front.sepia.ceph.com smithi141
2022-02-20T16:25:14.070 INFO:teuthology.provision.fog.smithi141:Deploy complete!
2022-02-20T16:25:14.291 INFO:teuthology.lock.ops:Checking smithi002.front.sepia.ceph.com
2022-02-20T16:25:14.292 INFO:teuthology.lock.ops:New key found. Updating...
2022-02-20T16:25:14.316 INFO:teuthology.lock.ops:Checking smithi141.front.sepia.ceph.com
2022-02-20T16:25:14.316 INFO:teuthology.lock.ops:New key found. Updating...
2022-02-20T16:25:14.333 INFO:teuthology.lock.ops:Checking smithi181.front.sepia.ceph.com
2022-02-20T16:25:14.334 INFO:teuthology.lock.ops:New key found. Updating...
2022-02-20T16:25:14.351 INFO:teuthology.lock.ops:Updating [smithi002.front.sepia.ceph.com]: set os type and version on server
2022-02-20T16:25:14.352 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com'
2022-02-20T16:25:14.610 INFO:teuthology.orchestra.run.smithi002.stdout:x86_64
2022-02-20T16:25:14.618 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="Ubuntu"
2022-02-20T16:25:14.618 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="20.04.3 LTS (Focal Fossa)"
2022-02-20T16:25:14.618 INFO:teuthology.orchestra.run.smithi002.stdout:ID=ubuntu
2022-02-20T16:25:14.619 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE=debian
2022-02-20T16:25:14.619 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS"
2022-02-20T16:25:14.619 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="20.04"
2022-02-20T16:25:14.619 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://www.ubuntu.com/"
2022-02-20T16:25:14.619 INFO:teuthology.orchestra.run.smithi002.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2022-02-20T16:25:14.620 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2022-02-20T16:25:14.620 INFO:teuthology.orchestra.run.smithi002.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2022-02-20T16:25:14.620 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_CODENAME=focal
2022-02-20T16:25:14.620 INFO:teuthology.orchestra.run.smithi002.stdout:UBUNTU_CODENAME=focal
2022-02-20T16:25:14.621 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server
2022-02-20T16:25:14.640 INFO:teuthology.lock.ops:Updating [smithi141.front.sepia.ceph.com]: set os type and version on server
2022-02-20T16:25:14.641 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com'
2022-02-20T16:25:14.822 INFO:teuthology.orchestra.run.smithi141.stdout:x86_64
2022-02-20T16:25:14.829 INFO:teuthology.orchestra.run.smithi141.stdout:NAME="Ubuntu"
2022-02-20T16:25:14.829 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION="20.04.3 LTS (Focal Fossa)"
2022-02-20T16:25:14.829 INFO:teuthology.orchestra.run.smithi141.stdout:ID=ubuntu
2022-02-20T16:25:14.830 INFO:teuthology.orchestra.run.smithi141.stdout:ID_LIKE=debian
2022-02-20T16:25:14.830 INFO:teuthology.orchestra.run.smithi141.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS"
2022-02-20T16:25:14.830 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION_ID="20.04"
2022-02-20T16:25:14.830 INFO:teuthology.orchestra.run.smithi141.stdout:HOME_URL="https://www.ubuntu.com/"
2022-02-20T16:25:14.830 INFO:teuthology.orchestra.run.smithi141.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2022-02-20T16:25:14.831 INFO:teuthology.orchestra.run.smithi141.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2022-02-20T16:25:14.831 INFO:teuthology.orchestra.run.smithi141.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2022-02-20T16:25:14.831 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION_CODENAME=focal
2022-02-20T16:25:14.831 INFO:teuthology.orchestra.run.smithi141.stdout:UBUNTU_CODENAME=focal
2022-02-20T16:25:14.832 INFO:teuthology.lock.ops:Updating smithi141.front.sepia.ceph.com on lock server
2022-02-20T16:25:14.851 INFO:teuthology.lock.ops:Updating [smithi181.front.sepia.ceph.com]: set os type and version on server
2022-02-20T16:25:14.852 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com'
2022-02-20T16:25:15.035 INFO:teuthology.orchestra.run.smithi181.stdout:x86_64
2022-02-20T16:25:15.041 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="Ubuntu"
2022-02-20T16:25:15.042 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="20.04.3 LTS (Focal Fossa)"
2022-02-20T16:25:15.042 INFO:teuthology.orchestra.run.smithi181.stdout:ID=ubuntu
2022-02-20T16:25:15.042 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE=debian
2022-02-20T16:25:15.042 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS"
2022-02-20T16:25:15.043 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="20.04"
2022-02-20T16:25:15.043 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://www.ubuntu.com/"
2022-02-20T16:25:15.043 INFO:teuthology.orchestra.run.smithi181.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2022-02-20T16:25:15.043 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2022-02-20T16:25:15.044 INFO:teuthology.orchestra.run.smithi181.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2022-02-20T16:25:15.044 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_CODENAME=focal
2022-02-20T16:25:15.044 INFO:teuthology.orchestra.run.smithi181.stdout:UBUNTU_CODENAME=focal
2022-02-20T16:25:15.044 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server
2022-02-20T16:25:15.148 INFO:teuthology.dispatcher.supervisor:Running job 6697239
2022-02-20T16:25:15.148 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_eea2521245e542c7c1a063d296779f572aa0255a/virtualenv/bin/teuthology -v --owner scheduled_benhanokh@teuthology --archive /home/teuthworker/archive/benhanokh-2022-02-20_16:17:42-rados-safe_shutdown_v2_FF-distro-basic-smithi/6697239 --name benhanokh-2022-02-20_16:17:42-rados-safe_shutdown_v2_FF-distro-basic-smithi --description rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} -- /home/teuthworker/archive/benhanokh-2022-02-20_16:17:42-rados-safe_shutdown_v2_FF-distro-basic-smithi/6697239/orig.config.yaml
2022-02-20T16:25:15.151 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/benhanokh-2022-02-20_16:17:42-rados-safe_shutdown_v2_FF-distro-basic-smithi/6697239
2022-02-20T16:25:15.152 INFO:teuthology.dispatcher.supervisor:Job PID: 17068
2022-02-20T16:25:15.152 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-02-20T22:55:44.129 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-02-20T22:55:44.256 INFO:teuthology.kill:Killing Pids: {17068}
2022-02-20T22:55:45.421 INFO:teuthology.task.internal:roles: ubuntu@smithi002.front.sepia.ceph.com - ['osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'mon.a']
2022-02-20T22:55:45.422 INFO:teuthology.task.internal:roles: ubuntu@smithi141.front.sepia.ceph.com - ['osd.4', 'osd.5', 'osd.6', 'osd.7', 'mon.b', 'mgr.x']
2022-02-20T22:55:45.422 INFO:teuthology.task.internal:roles: ubuntu@smithi181.front.sepia.ceph.com - ['osd.8', 'osd.9', 'osd.10', 'osd.11', 'mon.c']
2022-02-20T22:55:45.422 INFO:teuthology.misc:Compressing logs...
2022-02-20T22:55:45.423 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com'
2022-02-20T22:55:45.646 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com'
2022-02-20T22:55:45.825 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com'
2022-02-20T22:55:46.114 INFO:teuthology.misc:Compressing logs...
2022-02-20T23:03:22.874 INFO:teuthology.misc:Compressing logs...
2022-02-20T23:04:27.699 INFO:teuthology.orchestra.run.smithi002.stderr:tar: .: file changed as we read it
2022-02-20T23:04:48.857 INFO:teuthology.kill:No teuthology processes running
2022-02-20T23:04:50.050 INFO:teuthology.kill:Nuking machines: ['smithi002', 'smithi141', 'smithi181']
2022-02-20T23:04:51.073 INFO:teuthology.kill:2022-02-20 23:04:51,073.073 INFO:teuthology.nuke:targets:
2022-02-20T23:04:51.074 INFO:teuthology.kill:  smithi002.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCclyNiLsimAzlKWIOhUHBt8m0nxFGnkvrI209ZS0geiO9i8Vfp4et3szpyOZv0N9Eh6iLxM/UJcHbEaT6fImhVQpcHtGEljZLgWANR0gm3Ykm5jMMFunm7s3udSiSXMbKF6/5pUCzXgs89IrkL08okbakZocsdTHlbYHkyxqxSPKHO39+DUKKyjHxqrRZql41zz0QM/BT8x9EhJtGvre6lyerMZn7EN6EdYYb8VIwY+RnEDTflVvHeABDGe277MYnRWASyXUJ2AYGNFaOFxx7OaD9lmVtOX4Ht7JW1KMStnemq01MKn+FggQU5BiGyzobje5xllOEfSnXl9uBZeLtXnig5wLV8WiuUicOjkqWMYKj7YYyc0PVX9hT7Kbi8G8T3UKAopYF72r8lccCx5rdFMFAqSgJRCxm08Oxa1AWQdm/tyd+qqwnpz4Yn1lqulsBjJ3zSqee3G96u8KtGtWIrhDOPad8DgqioYVb81QTvpvyrG3PgK0/UkxpOdTcKFIc=
2022-02-20T23:04:51.075 INFO:teuthology.kill:  smithi141.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDlCChvqNq7RXvNtkqzfwejto2qJRQ+rxR0ijHPA6y3GomvFXd89E7DDoGlUBgu6/jze54zPsGx2KQaloPWkfhIEw9cq4g1XGzkSgZiippFDh1fasDi4/l/shkr/mB4mVOEqbotWU/odG1Z55Buaem7uuPcz9BVEoG+f6x6rkzprsvYj9f/ggvdK3uDlzXhgghN56RBogy30b4WURMXaPwufrW3GR++IMtBowyQDAPXac9EAe6yO7nUYl9kg3Uh1EAI8LdKJUdi/x3maUv+yDtE84PH0nLpaA/EYdj3wBcvVvsPn/sjCUgykbH9AIaH3JysGxK4J3IOf6BLCAQQbh/hYiHjpoZR6n1nbZgLO+qcfsNTsRA5J2f5+GIhZclk3gE7c+ia3hvDppkRYlaDRb82uIGmhntyPalImifkg0IGaJ9uLCv5vFTRoKZesSrCI0Af/32ke50mItFxgiPmZ7h35+LzHAoJeFKorK8Bfbnyu0d5oO7xhej1NCJh5wkPG2c=
2022-02-20T23:04:51.075 INFO:teuthology.kill:  smithi181.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDIJDIKAfM1sVOsH9GNnNbpWP2zl+a9/OQ1Qeh27CcdgN9v+OsGfjPCXR3dIQTtNFxz78QjQQYGxA7DlC1PI6fkKXLyuGFmkOngIM5w42IDgfjGtp6yKvvJaRvFNMbQf86skITIxn/Zr6VqsUrpWKUOpbxJK0Q0whTvWPEjiMCcxoKiL01HInUDEK18hVPl+JX+xOtc3MFXx2nfI/8ncuDqOXCnTjewqLLTjTL5AAQrzQfxWeCn56la7qziBJpPEOyveQcOQovj2dlKDwpFzWzF3GxgZ2Jz0zIWYm7qHQCC89cL/DKWe7jtaHwG+jbUIfBhr676ceoVVqqSPrvEKzo67LCM5nlbgLwEfQKZK3lpf+HCNLTBvrFOw3xvyOKNU1HhIRITfZSQuXtl1WgzWBr39Qs2Yhvu43joJ9wBvmhJMRSBq5mIuLiB1bbRwtfgjhLwgkPCW01zby5uoJ4AKpm6IGzOGejXHgrBF3itVAaUXn7ES/MS9um8WTCW3NYI55k=
2022-02-20T23:04:51.103 INFO:teuthology.kill:2022-02-20 23:04:51,103.103 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-02-20T23:04:51.107 INFO:teuthology.kill:2022-02-20 23:04:51,107.107 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-02-20T23:04:51.108 INFO:teuthology.kill:2022-02-20 23:04:51,108.108 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-02-20T23:04:51.191 INFO:teuthology.kill:2022-02-20 23:04:51,191.191 INFO:teuthology.orchestra.console:Power off smithi002
2022-02-20T23:04:51.205 INFO:teuthology.kill:2022-02-20 23:04:51,205.205 INFO:teuthology.orchestra.console:Power off smithi141
2022-02-20T23:04:51.216 INFO:teuthology.kill:2022-02-20 23:04:51,216.216 INFO:teuthology.orchestra.console:Power off smithi181
2022-02-20T23:04:59.573 INFO:teuthology.kill:2022-02-20 23:04:59,572.572 INFO:teuthology.orchestra.console:Power off for smithi002 completed
2022-02-20T23:04:59.720 INFO:teuthology.kill:2022-02-20 23:04:59,719.719 INFO:teuthology.lock.ops:unlocked: smithi002.front.sepia.ceph.com
2022-02-20T23:05:03.694 INFO:teuthology.kill:2022-02-20 23:05:03,693.693 INFO:teuthology.orchestra.console:Power off for smithi141 completed
2022-02-20T23:05:03.700 INFO:teuthology.kill:2022-02-20 23:05:03,700.700 INFO:teuthology.orchestra.console:Power off for smithi181 completed
2022-02-20T23:05:03.849 INFO:teuthology.kill:2022-02-20 23:05:03,848.848 INFO:teuthology.lock.ops:unlocked: smithi181.front.sepia.ceph.com
2022-02-20T23:05:03.853 INFO:teuthology.kill:2022-02-20 23:05:03,853.853 INFO:teuthology.lock.ops:unlocked: smithi141.front.sepia.ceph.com
2022-02-20T23:07:04.189 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-02-20T23:07:04.307 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi002 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-02-15_04:17:03-fs-pacific-distro-default-smithi/6684378
2022-02-20T23:07:04.308 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi141 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-02-15_04:17:03-fs-pacific-distro-default-smithi/6684377
2022-02-20T23:07:04.308 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi181 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-02-15_04:17:03-fs-pacific-distro-default-smithi/6684377