2022-03-01T18:43:19.726 INFO:root:teuthology version: 1.1.0-cb5b1a75
2022-03-01T18:43:19.889 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi038.front.sepia.ceph.com' reimaging
2022-03-01T18:43:19.890 INFO:teuthology.lock.ops:Updating [ubuntu@smithi038.front.sepia.ceph.com]: reset os type and version on server
2022-03-01T18:43:19.890 INFO:teuthology.lock.ops:Updating smithi038.front.sepia.ceph.com on lock server
2022-03-01T18:43:19.910 INFO:teuthology.lock.ops:Node 'ubuntu@smithi038.front.sepia.ceph.com' reimaging is complete
2022-03-01T18:43:19.911 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi053.front.sepia.ceph.com' reimaging
2022-03-01T18:43:19.911 INFO:teuthology.lock.ops:Updating [ubuntu@smithi053.front.sepia.ceph.com]: reset os type and version on server
2022-03-01T18:43:19.911 INFO:teuthology.lock.ops:Updating smithi053.front.sepia.ceph.com on lock server
2022-03-01T18:43:19.932 INFO:teuthology.lock.ops:Node 'ubuntu@smithi053.front.sepia.ceph.com' reimaging is complete
2022-03-01T18:43:19.933 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi062.front.sepia.ceph.com' reimaging
2022-03-01T18:43:19.933 INFO:teuthology.lock.ops:Updating [ubuntu@smithi062.front.sepia.ceph.com]: reset os type and version on server
2022-03-01T18:43:19.933 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server
2022-03-01T18:43:19.954 INFO:teuthology.lock.ops:Node 'ubuntu@smithi062.front.sepia.ceph.com' reimaging is complete
2022-03-01T18:43:20.161 INFO:teuthology.provision.fog.smithi053:Scheduling deploy of ubuntu 20.04
2022-03-01T18:43:20.164 INFO:teuthology.provision.fog.smithi038:Scheduling deploy of ubuntu 20.04
2022-03-01T18:43:20.185 INFO:teuthology.provision.fog.smithi062:Scheduling deploy of ubuntu 20.04
2022-03-01T18:43:20.570 INFO:teuthology.orchestra.console:Power off smithi053
2022-03-01T18:43:20.619 INFO:teuthology.orchestra.console:Power off smithi038
2022-03-01T18:43:20.635 INFO:teuthology.orchestra.console:Power off smithi062
2022-03-01T18:43:20.743 INFO:teuthology.orchestra.console:Power off for smithi053 completed
2022-03-01T18:43:20.780 INFO:teuthology.orchestra.console:Power off for smithi062 completed
2022-03-01T18:43:20.845 INFO:teuthology.orchestra.console:Power on smithi053
2022-03-01T18:43:20.882 INFO:teuthology.orchestra.console:Power on smithi062
2022-03-01T18:43:25.105 INFO:teuthology.orchestra.console:Power on for smithi053 completed
2022-03-01T18:43:25.207 INFO:teuthology.provision.fog.smithi053:Waiting for deploy to finish
2022-03-01T18:43:29.386 INFO:teuthology.orchestra.console:Power on for smithi062 completed
2022-03-01T18:43:29.487 INFO:teuthology.provision.fog.smithi062:Waiting for deploy to finish
2022-03-01T18:43:33.109 INFO:teuthology.orchestra.console:Power off for smithi038 completed
2022-03-01T18:43:33.210 INFO:teuthology.orchestra.console:Power on smithi038
2022-03-01T18:43:37.467 INFO:teuthology.orchestra.console:Power on for smithi038 completed
2022-03-01T18:43:37.568 INFO:teuthology.provision.fog.smithi038:Waiting for deploy to finish
2022-03-01T18:48:03.055 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-01T18:48:03.642 INFO:teuthology.provision.fog.smithi053:Node is ready
2022-03-01T18:48:03.648 INFO:teuthology.orchestra.run.smithi053.stdout:smithi053.front.sepia.ceph.com
2022-03-01T18:48:03.656 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53 smithi053.front.sepia.ceph.com smithi053
2022-03-01T18:48:03.882 INFO:teuthology.provision.fog.smithi053:Deploy complete!
2022-03-01T18:48:24.395 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-01T18:48:24.895 INFO:teuthology.provision.fog.smithi038:Node is ready
2022-03-01T18:48:24.902 INFO:teuthology.orchestra.run.smithi038.stdout:smithi038.front.sepia.ceph.com
2022-03-01T18:48:24.908 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38 smithi038.front.sepia.ceph.com smithi038
2022-03-01T18:48:25.118 INFO:teuthology.provision.fog.smithi038:Deploy complete!
2022-03-01T18:48:26.817 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-01T18:48:27.301 INFO:teuthology.provision.fog.smithi062:Node is ready
2022-03-01T18:48:27.308 INFO:teuthology.orchestra.run.smithi062.stdout:smithi062.front.sepia.ceph.com
2022-03-01T18:48:27.315 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62 smithi062.front.sepia.ceph.com smithi062
2022-03-01T18:48:27.481 INFO:teuthology.provision.fog.smithi062:Deploy complete!
2022-03-01T18:48:27.701 INFO:teuthology.lock.ops:Checking smithi038.front.sepia.ceph.com
2022-03-01T18:48:27.702 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-01T18:48:27.721 INFO:teuthology.lock.ops:Checking smithi053.front.sepia.ceph.com
2022-03-01T18:48:27.721 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-01T18:48:27.736 INFO:teuthology.lock.ops:Checking smithi062.front.sepia.ceph.com
2022-03-01T18:48:27.736 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-01T18:48:27.753 INFO:teuthology.lock.ops:Updating [smithi038.front.sepia.ceph.com]: set os type and version on server
2022-03-01T18:48:27.754 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com'
2022-03-01T18:48:27.942 INFO:teuthology.orchestra.run.smithi038.stdout:x86_64
2022-03-01T18:48:27.949 INFO:teuthology.orchestra.run.smithi038.stdout:NAME="Ubuntu"
2022-03-01T18:48:27.949 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION="20.04.3 LTS (Focal Fossa)"
2022-03-01T18:48:27.949 INFO:teuthology.orchestra.run.smithi038.stdout:ID=ubuntu
2022-03-01T18:48:27.950 INFO:teuthology.orchestra.run.smithi038.stdout:ID_LIKE=debian
2022-03-01T18:48:27.950 INFO:teuthology.orchestra.run.smithi038.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS"
2022-03-01T18:48:27.950 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_ID="20.04"
2022-03-01T18:48:27.950 INFO:teuthology.orchestra.run.smithi038.stdout:HOME_URL="https://www.ubuntu.com/"
2022-03-01T18:48:27.951 INFO:teuthology.orchestra.run.smithi038.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2022-03-01T18:48:27.951 INFO:teuthology.orchestra.run.smithi038.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2022-03-01T18:48:27.951 INFO:teuthology.orchestra.run.smithi038.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2022-03-01T18:48:27.951 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_CODENAME=focal
2022-03-01T18:48:27.952 INFO:teuthology.orchestra.run.smithi038.stdout:UBUNTU_CODENAME=focal
2022-03-01T18:48:27.953 INFO:teuthology.lock.ops:Updating smithi038.front.sepia.ceph.com on lock server
2022-03-01T18:48:27.971 INFO:teuthology.lock.ops:Updating [smithi053.front.sepia.ceph.com]: set os type and version on server
2022-03-01T18:48:27.971 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com'
2022-03-01T18:48:28.242 INFO:teuthology.orchestra.run.smithi053.stdout:x86_64
2022-03-01T18:48:28.249 INFO:teuthology.orchestra.run.smithi053.stdout:NAME="Ubuntu"
2022-03-01T18:48:28.249 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION="20.04.3 LTS (Focal Fossa)"
2022-03-01T18:48:28.250 INFO:teuthology.orchestra.run.smithi053.stdout:ID=ubuntu
2022-03-01T18:48:28.250 INFO:teuthology.orchestra.run.smithi053.stdout:ID_LIKE=debian
2022-03-01T18:48:28.250 INFO:teuthology.orchestra.run.smithi053.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS"
2022-03-01T18:48:28.250 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION_ID="20.04"
2022-03-01T18:48:28.251 INFO:teuthology.orchestra.run.smithi053.stdout:HOME_URL="https://www.ubuntu.com/"
2022-03-01T18:48:28.251 INFO:teuthology.orchestra.run.smithi053.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2022-03-01T18:48:28.251 INFO:teuthology.orchestra.run.smithi053.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2022-03-01T18:48:28.251 INFO:teuthology.orchestra.run.smithi053.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2022-03-01T18:48:28.252 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION_CODENAME=focal
2022-03-01T18:48:28.252 INFO:teuthology.orchestra.run.smithi053.stdout:UBUNTU_CODENAME=focal
2022-03-01T18:48:28.252 INFO:teuthology.lock.ops:Updating smithi053.front.sepia.ceph.com on lock server
2022-03-01T18:48:28.269 INFO:teuthology.lock.ops:Updating [smithi062.front.sepia.ceph.com]: set os type and version on server
2022-03-01T18:48:28.270 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com'
2022-03-01T18:48:28.446 INFO:teuthology.orchestra.run.smithi062.stdout:x86_64
2022-03-01T18:48:28.494 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="Ubuntu"
2022-03-01T18:48:28.494 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="20.04.3 LTS (Focal Fossa)"
2022-03-01T18:48:28.495 INFO:teuthology.orchestra.run.smithi062.stdout:ID=ubuntu
2022-03-01T18:48:28.495 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE=debian
2022-03-01T18:48:28.495 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS"
2022-03-01T18:48:28.495 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="20.04"
2022-03-01T18:48:28.496 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://www.ubuntu.com/"
2022-03-01T18:48:28.496 INFO:teuthology.orchestra.run.smithi062.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2022-03-01T18:48:28.496 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2022-03-01T18:48:28.496 INFO:teuthology.orchestra.run.smithi062.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2022-03-01T18:48:28.496 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_CODENAME=focal
2022-03-01T18:48:28.497 INFO:teuthology.orchestra.run.smithi062.stdout:UBUNTU_CODENAME=focal
2022-03-01T18:48:28.497 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server
2022-03-01T18:48:28.599 INFO:teuthology.dispatcher.supervisor:Running job 6715080
2022-03-01T18:48:28.600 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_cb5b1a75970b7aa81700a0ab081943b3146d40d0/virtualenv/bin/teuthology -v --owner scheduled_nojha@teuthology --archive /home/teuthworker/archive/nojha-2022-03-01_18:30:45-rados-wip-yuri6-testing-2022-02-14-1456-distro-basic-smithi/6715080 --name nojha-2022-03-01_18:30:45-rados-wip-yuri6-testing-2022-02-14-1456-distro-basic-smithi --description rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} -- /home/teuthworker/archive/nojha-2022-03-01_18:30:45-rados-wip-yuri6-testing-2022-02-14-1456-distro-basic-smithi/6715080/orig.config.yaml
2022-03-01T18:48:28.605 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/nojha-2022-03-01_18:30:45-rados-wip-yuri6-testing-2022-02-14-1456-distro-basic-smithi/6715080
2022-03-01T18:48:28.605 INFO:teuthology.dispatcher.supervisor:Job PID: 17119
2022-03-01T18:48:28.606 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-03-02T01:18:58.211 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-03-02T01:18:58.379 INFO:teuthology.kill:Killing Pids: {17119}
2022-03-02T01:18:59.537 INFO:teuthology.task.internal:roles: ubuntu@smithi038.front.sepia.ceph.com - ['osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'mon.a']
2022-03-02T01:18:59.538 INFO:teuthology.task.internal:roles: ubuntu@smithi053.front.sepia.ceph.com - ['osd.4', 'osd.5', 'osd.6', 'osd.7', 'mon.b', 'mgr.x']
2022-03-02T01:18:59.539 INFO:teuthology.task.internal:roles: ubuntu@smithi062.front.sepia.ceph.com - ['osd.8', 'osd.9', 'osd.10', 'osd.11', 'mon.c']
2022-03-02T01:18:59.539 INFO:teuthology.misc:Compressing logs...
2022-03-02T01:18:59.540 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com'
2022-03-02T01:18:59.769 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com'
2022-03-02T01:18:59.990 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com'
2022-03-02T01:19:00.265 INFO:teuthology.misc:Compressing logs...
2022-03-02T01:19:00.967 INFO:teuthology.misc:Compressing logs...
2022-03-02T01:20:52.774 INFO:teuthology.kill:No teuthology processes running
2022-03-02T01:20:53.957 INFO:teuthology.kill:Nuking machines: ['smithi038', 'smithi053', 'smithi062']
2022-03-02T01:20:55.031 INFO:teuthology.kill:2022-03-02 01:20:55,031.031 INFO:teuthology.nuke:targets:
2022-03-02T01:20:55.032 INFO:teuthology.kill:  smithi038.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCnLxYXWXDR4teLPz+DzM1H73wUPJvO6ahWLNSk+8A3q1k0uryHrD7w5xrI9zWjHt//NDftO7b4mwMLy/LZVtsU6+lC+vYYHZJlrJ9EQsbqZoqolcwOfknRG8KzT8RWA0ULDGsGDYRrcIh2qyb6nQbSCGBmS//HsX5JLVbGEwO7D2+aNEXy5SJIJzVvrlG2QQEEchyinIC122Q2PM7W17MWZyPkIxBN6n/bknIIjjzhNZMTckXSPBw2jzKqk4hYqfhWKg6m58PZWuztcxjpcX3cQz5KtgXU2y0WxGm8WLEOT2lFKREbMkyCVO5cbAcMV0WLV9KTmUqS4jz9jhocZ5ajT3RqSuTP2nwCYuHkdtrcNlUKffvWj9DVUJfKu7rwQrs1qT1qxz0AcOhlz/4EbeN0ZpjN4/+2fRwIDqV3vYa9yyGSLIKviQmNCTQYHuhjti/KmkGto2XuaDqyM+vanseq3PIKeaFagY+c0wNR2L7nHGGjHEp+PEzAyP6Dii0q0R8=
2022-03-02T01:20:55.033 INFO:teuthology.kill:  smithi053.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDPQYJj5MzebkjTe8nqX3j6bmHmIsOq8EQSdhYsc8lajkMi//lI+dlg0EzNnuA0SHB5SSfybNkiCPc6blyYRAT0fjKiJ52JWnS05Jir4a6hwQepkUG1YlcyZl9TqliYC2jJNVbXGwvfmPHn+8Wym+8h8bjR4eHrGMDwwYIdTAimPui1ECWlAt+9i63oBMg9zbJPs3xaHpaTdn4vOq1z92LIJAI97TIO07kC4SZ2+/Fez0al5UKty6cuz7NBIVJPDZh7URVU5pT/FTCDs13kAl98YWq3XMPM7ZCWK4IfE4Cs9Gq6pE1u71byh7QGcNfCNAPnjX+RPsTe7BRibW8AwbjrQLMJheN5k1VuCkMmWu9PGo6r7XMrgetHaAQtelKtF4pMqRwCd8/QvP/8BjznOJIf0YAIWcAYWUCSvHT2AfwiL33DKZSddFaO9nwUGm3KvLWTC2lhBfAPLtYe3y+uBF4IkoYTvQpUtpQABLyHr/IRwJVIeEpjJc7/6eEVo5KCgec=
2022-03-02T01:20:55.033 INFO:teuthology.kill:  smithi062.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDF8ng0AKuExhnm0QF5uo2zu3X75WSah0XmfAm7FnCyMYzhUiFCCClcoX5LP4LyUvY5UBpY7gsATXE0ieprlhjx2kP3W6I/jPe73IKuohqVFqj3fWqJPsdOI8rBTFdlEeToQclDXtIVANOYbJHuxlfMTMmfrgzsKs79SfBoFXgOMmVN48jUU/QuciHLVGT8XegB5QEiMR4M+oV6TVO6JkGTb+cPIgZtGss6QnjoKzJCB2BP2IYwmw4+MYLOGGgngk8YMHmyuU/lDbmClt4yIcQ1zYZ2EBBNEeGBcmW20vz8R+WqOcxiAU/1jF2Arl0ywqXwmjwEBVmTi+3KhRkSG2uWnaBpgGBQWafa0UJvwC7RfstrAdnh10LJ8xSZV7NjE57UMDSvQTvOJw2Kj7rlIWNKjVwmBrx6C92P6YbjF6JnlVeLXhCA+hr0MPReZ+wdOI7f/KvCHMU3bNc2KaUyE09abIl8vzh1sInwCCCQjp+RHGBf9Cxu0upd5WTXWUUFG28=
2022-03-02T01:20:55.066 INFO:teuthology.kill:2022-03-02 01:20:55,066.066 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-02T01:20:55.072 INFO:teuthology.kill:2022-03-02 01:20:55,071.071 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-02T01:20:55.074 INFO:teuthology.kill:2022-03-02 01:20:55,074.074 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-02T01:20:55.168 INFO:teuthology.kill:2022-03-02 01:20:55,168.168 INFO:teuthology.orchestra.console:Power off smithi062
2022-03-02T01:20:55.184 INFO:teuthology.kill:2022-03-02 01:20:55,184.184 INFO:teuthology.orchestra.console:Power off smithi038
2022-03-02T01:20:55.195 INFO:teuthology.kill:2022-03-02 01:20:55,195.195 INFO:teuthology.orchestra.console:Power off smithi053
2022-03-02T01:21:07.757 INFO:teuthology.kill:2022-03-02 01:21:07,756.756 INFO:teuthology.orchestra.console:Power off for smithi053 completed
2022-03-02T01:21:07.781 INFO:teuthology.kill:2022-03-02 01:21:07,781.781 INFO:teuthology.orchestra.console:Power off for smithi038 completed
2022-03-02T01:21:07.856 INFO:teuthology.kill:2022-03-02 01:21:07,856.856 INFO:teuthology.orchestra.console:Power off for smithi062 completed
2022-03-02T01:21:07.913 INFO:teuthology.kill:2022-03-02 01:21:07,912.912 INFO:teuthology.lock.ops:unlocked: smithi053.front.sepia.ceph.com
2022-03-02T01:21:07.933 INFO:teuthology.kill:2022-03-02 01:21:07,933.933 INFO:teuthology.lock.ops:unlocked: smithi038.front.sepia.ceph.com
2022-03-02T01:21:08.005 INFO:teuthology.kill:2022-03-02 01:21:08,003.003 INFO:teuthology.lock.ops:unlocked: smithi062.front.sepia.ceph.com
2022-03-02T01:23:08.386 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-03-02T01:23:08.508 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi038 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-03-01_22:42:19-rados-wip-yuri4-testing-2022-03-01-1206-distro-default-smithi/6715458
2022-03-02T01:23:08.508 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi053 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-03-01_22:42:19-rados-wip-yuri4-testing-2022-03-01-1206-distro-default-smithi/6715459
2022-03-02T01:23:08.509 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi062 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-03-01_22:42:19-rados-wip-yuri4-testing-2022-03-01-1206-distro-default-smithi/6715458