2022-02-16T00:57:29.436 INFO:root:teuthology version: 1.1.0-65c38a8a
2022-02-16T00:57:29.590 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi007.front.sepia.ceph.com' reimaging
2022-02-16T00:57:29.591 INFO:teuthology.lock.ops:Updating [ubuntu@smithi007.front.sepia.ceph.com]: reset os type and version on server
2022-02-16T00:57:29.592 INFO:teuthology.lock.ops:Updating smithi007.front.sepia.ceph.com on lock server
2022-02-16T00:57:29.615 INFO:teuthology.lock.ops:Node 'ubuntu@smithi007.front.sepia.ceph.com' reimaging is complete
2022-02-16T00:57:29.616 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi016.front.sepia.ceph.com' reimaging
2022-02-16T00:57:29.616 INFO:teuthology.lock.ops:Updating [ubuntu@smithi016.front.sepia.ceph.com]: reset os type and version on server
2022-02-16T00:57:29.616 INFO:teuthology.lock.ops:Updating smithi016.front.sepia.ceph.com on lock server
2022-02-16T00:57:29.642 INFO:teuthology.lock.ops:Node 'ubuntu@smithi016.front.sepia.ceph.com' reimaging is complete
2022-02-16T00:57:29.642 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi060.front.sepia.ceph.com' reimaging
2022-02-16T00:57:29.643 INFO:teuthology.lock.ops:Updating [ubuntu@smithi060.front.sepia.ceph.com]: reset os type and version on server
2022-02-16T00:57:29.643 INFO:teuthology.lock.ops:Updating smithi060.front.sepia.ceph.com on lock server
2022-02-16T00:57:29.661 INFO:teuthology.lock.ops:Node 'ubuntu@smithi060.front.sepia.ceph.com' reimaging is complete
2022-02-16T00:57:29.832 INFO:teuthology.provision.fog.smithi007:Scheduling deploy of ubuntu 20.04
2022-02-16T00:57:29.871 INFO:teuthology.provision.fog.smithi016:Scheduling deploy of ubuntu 20.04
2022-02-16T00:57:29.873 INFO:teuthology.provision.fog.smithi060:Scheduling deploy of ubuntu 20.04
2022-02-16T00:57:30.201 INFO:teuthology.orchestra.console:Power off smithi007
2022-02-16T00:57:30.250 INFO:teuthology.orchestra.console:Power off smithi016
2022-02-16T00:57:30.264 INFO:teuthology.orchestra.console:Power off smithi060
2022-02-16T00:57:38.593 INFO:teuthology.orchestra.console:Power off for smithi007 completed
2022-02-16T00:57:38.618 INFO:teuthology.orchestra.console:Power off for smithi016 completed
2022-02-16T00:57:38.640 INFO:teuthology.orchestra.console:Power off for smithi060 completed
2022-02-16T00:57:38.695 INFO:teuthology.orchestra.console:Power on smithi007
2022-02-16T00:57:38.723 INFO:teuthology.orchestra.console:Power on smithi016
2022-02-16T00:57:38.748 INFO:teuthology.orchestra.console:Power on smithi060
2022-02-16T00:57:47.060 INFO:teuthology.orchestra.console:Power on for smithi007 completed
2022-02-16T00:57:47.108 INFO:teuthology.orchestra.console:Power on for smithi060 completed
2022-02-16T00:57:47.124 INFO:teuthology.orchestra.console:Power on for smithi016 completed
2022-02-16T00:57:47.164 INFO:teuthology.provision.fog.smithi007:Waiting for deploy to finish
2022-02-16T00:57:47.209 INFO:teuthology.provision.fog.smithi060:Waiting for deploy to finish
2022-02-16T00:57:47.225 INFO:teuthology.provision.fog.smithi016:Waiting for deploy to finish
2022-02-16T01:02:25.324 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-02-16T01:02:25.356 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-02-16T01:02:25.398 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-02-16T01:02:25.811 INFO:teuthology.provision.fog.smithi060:Node is ready
2022-02-16T01:02:25.818 INFO:teuthology.orchestra.run.smithi060.stdout:smithi060.front.sepia.ceph.com
2022-02-16T01:02:25.847 INFO:teuthology.provision.fog.smithi016:Node is ready
2022-02-16T01:02:25.854 INFO:teuthology.orchestra.run.smithi016.stdout:smithi016.front.sepia.ceph.com
2022-02-16T01:02:25.867 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60 smithi060.front.sepia.ceph.com smithi060
2022-02-16T01:02:25.902 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16 smithi016.front.sepia.ceph.com smithi016
2022-02-16T01:02:25.996 INFO:teuthology.provision.fog.smithi007:Node is ready
2022-02-16T01:02:26.002 INFO:teuthology.orchestra.run.smithi007.stdout:smithi007.front.sepia.ceph.com
2022-02-16T01:02:26.034 INFO:teuthology.provision.fog.smithi060:Deploy complete!
2022-02-16T01:02:26.053 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7 smithi007.front.sepia.ceph.com smithi007
2022-02-16T01:02:26.080 INFO:teuthology.provision.fog.smithi016:Deploy complete!
2022-02-16T01:02:26.237 INFO:teuthology.provision.fog.smithi007:Deploy complete!
2022-02-16T01:02:26.464 INFO:teuthology.lock.ops:Checking smithi007.front.sepia.ceph.com
2022-02-16T01:02:26.465 INFO:teuthology.lock.ops:New key found. Updating...
2022-02-16T01:02:26.491 INFO:teuthology.lock.ops:Checking smithi016.front.sepia.ceph.com
2022-02-16T01:02:26.492 INFO:teuthology.lock.ops:New key found. Updating...
2022-02-16T01:02:26.511 INFO:teuthology.lock.ops:Checking smithi060.front.sepia.ceph.com
2022-02-16T01:02:26.511 INFO:teuthology.lock.ops:New key found. Updating...
2022-02-16T01:02:26.531 INFO:teuthology.lock.ops:Updating [smithi007.front.sepia.ceph.com]: set os type and version on server
2022-02-16T01:02:26.531 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com'
2022-02-16T01:02:26.714 INFO:teuthology.orchestra.run.smithi007.stdout:x86_64
2022-02-16T01:02:26.722 INFO:teuthology.orchestra.run.smithi007.stdout:NAME="Ubuntu"
2022-02-16T01:02:26.722 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION="20.04.3 LTS (Focal Fossa)"
2022-02-16T01:02:26.722 INFO:teuthology.orchestra.run.smithi007.stdout:ID=ubuntu
2022-02-16T01:02:26.722 INFO:teuthology.orchestra.run.smithi007.stdout:ID_LIKE=debian
2022-02-16T01:02:26.723 INFO:teuthology.orchestra.run.smithi007.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS"
2022-02-16T01:02:26.723 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION_ID="20.04"
2022-02-16T01:02:26.723 INFO:teuthology.orchestra.run.smithi007.stdout:HOME_URL="https://www.ubuntu.com/"
2022-02-16T01:02:26.723 INFO:teuthology.orchestra.run.smithi007.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2022-02-16T01:02:26.724 INFO:teuthology.orchestra.run.smithi007.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2022-02-16T01:02:26.724 INFO:teuthology.orchestra.run.smithi007.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2022-02-16T01:02:26.724 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION_CODENAME=focal
2022-02-16T01:02:26.724 INFO:teuthology.orchestra.run.smithi007.stdout:UBUNTU_CODENAME=focal
2022-02-16T01:02:26.725 INFO:teuthology.lock.ops:Updating smithi007.front.sepia.ceph.com on lock server
2022-02-16T01:02:26.744 INFO:teuthology.lock.ops:Updating [smithi016.front.sepia.ceph.com]: set os type and version on server
2022-02-16T01:02:26.744 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com'
2022-02-16T01:02:26.961 INFO:teuthology.orchestra.run.smithi016.stdout:x86_64
2022-02-16T01:02:26.968 INFO:teuthology.orchestra.run.smithi016.stdout:NAME="Ubuntu"
2022-02-16T01:02:26.968 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION="20.04.3 LTS (Focal Fossa)"
2022-02-16T01:02:26.968 INFO:teuthology.orchestra.run.smithi016.stdout:ID=ubuntu
2022-02-16T01:02:26.969 INFO:teuthology.orchestra.run.smithi016.stdout:ID_LIKE=debian
2022-02-16T01:02:26.969 INFO:teuthology.orchestra.run.smithi016.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS"
2022-02-16T01:02:26.969 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_ID="20.04"
2022-02-16T01:02:26.969 INFO:teuthology.orchestra.run.smithi016.stdout:HOME_URL="https://www.ubuntu.com/"
2022-02-16T01:02:26.969 INFO:teuthology.orchestra.run.smithi016.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2022-02-16T01:02:26.970 INFO:teuthology.orchestra.run.smithi016.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2022-02-16T01:02:26.970 INFO:teuthology.orchestra.run.smithi016.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2022-02-16T01:02:26.970 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_CODENAME=focal
2022-02-16T01:02:26.970 INFO:teuthology.orchestra.run.smithi016.stdout:UBUNTU_CODENAME=focal
2022-02-16T01:02:26.971 INFO:teuthology.lock.ops:Updating smithi016.front.sepia.ceph.com on lock server
2022-02-16T01:02:26.989 INFO:teuthology.lock.ops:Updating [smithi060.front.sepia.ceph.com]: set os type and version on server
2022-02-16T01:02:26.990 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com'
2022-02-16T01:02:27.174 INFO:teuthology.orchestra.run.smithi060.stdout:x86_64
2022-02-16T01:02:27.181 INFO:teuthology.orchestra.run.smithi060.stdout:NAME="Ubuntu"
2022-02-16T01:02:27.181 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION="20.04.3 LTS (Focal Fossa)"
2022-02-16T01:02:27.181 INFO:teuthology.orchestra.run.smithi060.stdout:ID=ubuntu
2022-02-16T01:02:27.181 INFO:teuthology.orchestra.run.smithi060.stdout:ID_LIKE=debian
2022-02-16T01:02:27.182 INFO:teuthology.orchestra.run.smithi060.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS"
2022-02-16T01:02:27.182 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION_ID="20.04"
2022-02-16T01:02:27.182 INFO:teuthology.orchestra.run.smithi060.stdout:HOME_URL="https://www.ubuntu.com/"
2022-02-16T01:02:27.182 INFO:teuthology.orchestra.run.smithi060.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2022-02-16T01:02:27.182 INFO:teuthology.orchestra.run.smithi060.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2022-02-16T01:02:27.183 INFO:teuthology.orchestra.run.smithi060.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2022-02-16T01:02:27.183 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION_CODENAME=focal
2022-02-16T01:02:27.183 INFO:teuthology.orchestra.run.smithi060.stdout:UBUNTU_CODENAME=focal
2022-02-16T01:02:27.184 INFO:teuthology.lock.ops:Updating smithi060.front.sepia.ceph.com on lock server
2022-02-16T01:02:27.283 INFO:teuthology.dispatcher.supervisor:Running job 6686166
2022-02-16T01:02:27.283 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_65c38a8ac6d6694ef8ab9ff2325a7faf73afdc22/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-02-15_22:35:42-rados-wip-yuri8-testing-2022-02-15-1214-distro-default-smithi/6686166 --name yuriw-2022-02-15_22:35:42-rados-wip-yuri8-testing-2022-02-15-1214-distro-default-smithi --description rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} -- /home/teuthworker/archive/yuriw-2022-02-15_22:35:42-rados-wip-yuri8-testing-2022-02-15-1214-distro-default-smithi/6686166/orig.config.yaml
2022-02-16T01:02:27.288 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-02-15_22:35:42-rados-wip-yuri8-testing-2022-02-15-1214-distro-default-smithi/6686166
2022-02-16T01:02:27.288 INFO:teuthology.dispatcher.supervisor:Job PID: 27724
2022-02-16T01:02:27.289 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-02-16T07:32:57.148 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-02-16T07:32:58.464 INFO:teuthology.kill:Killing Pids: {27724}
2022-02-16T07:32:59.767 INFO:teuthology.task.internal:roles: ubuntu@smithi007.front.sepia.ceph.com - ['osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'mon.a']
2022-02-16T07:32:59.768 INFO:teuthology.task.internal:roles: ubuntu@smithi016.front.sepia.ceph.com - ['osd.4', 'osd.5', 'osd.6', 'osd.7', 'mon.b', 'mgr.x']
2022-02-16T07:32:59.768 INFO:teuthology.task.internal:roles: ubuntu@smithi060.front.sepia.ceph.com - ['osd.8', 'osd.9', 'osd.10', 'osd.11', 'mon.c']
2022-02-16T07:32:59.769 INFO:teuthology.misc:Compressing logs...
2022-02-16T07:32:59.769 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com'
2022-02-16T07:32:59.995 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com'
2022-02-16T07:33:00.175 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com'
2022-02-16T07:33:00.443 INFO:teuthology.misc:Compressing logs...
2022-02-16T07:33:01.192 INFO:teuthology.misc:Compressing logs...
2022-02-16T07:35:45.329 INFO:teuthology.kill:No teuthology processes running
2022-02-16T07:35:46.545 INFO:teuthology.kill:Nuking machines: ['smithi007', 'smithi016', 'smithi060']
2022-02-16T07:35:47.523 INFO:teuthology.kill:2022-02-16 07:35:47,523.523 INFO:teuthology.nuke:targets:
2022-02-16T07:35:47.524 INFO:teuthology.kill:  smithi007.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJuiWeZJ756JcYug1YcyYK/xrQUuG+McnbQ2mBjeoBto0mSGi8iE9xQJ+sB//uxaAcbRpNecFTNTVB/b/JFMNppMnDJXmYbF9BkIea0DIzLjRi6Naalb8yZvcXqPfb2PA2ePyxYvYQFNAoveO2FplZ8GGQ3zXUYTMGeqnMypdwjxyEtagSZjfDJxazKhPV0NEa60YoH24Xypu2B+FMHVicW1e2t2SbcAOjtorsPz3QshhhHPqrgoN+dnDjMMbwN4ozwFjAyoHKqFUC6wqZ3VxkqSsHEWLMo89TvXsdXCIYCC70GDTOi/xWFe4s8Pc1F6wJKeSnJpiFenBKzQIyZTJUQSxq4Xaj8PpYrWZa9jiXpvIy9YELiJva8RHsnQUgRq11L8Tp4To+yA482tjXCPd/Gz/fjBhSYAKKHcoOLmOqidHzr2n/2ZaJQkX0QBfH1LmsMVhuqO2/A1v6X02JE6eBvYtIhB3dGUJg7Ac8bXn6aWuxwQgEFKCe97ERNd1MRBk=
2022-02-16T07:35:47.525 INFO:teuthology.kill:  smithi016.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAf/Kg+VQte7tQppbKVWvePwPi7Qq8LAQdujxIz2SF2vO3cC3DofT0s/qn5Gql1NkNoetU+vph63ZewzbyQeHf7XdbWPR11U5TbOL2jdFT7pdvOVz163QzlSRGKSyBE/cWKcaCYdaUeepctfFIlUMxiydOPW4sT4va++DsSTrmUscHqtft0/Se6xqDUh4LlMD+WZp+q6emYZeBVBM9jNmC2gxnLynerE7pJy+M1E+/LAkC1tZhCQBOGUQcMdwPFDOHNdzynzhY8XFh/xaUU8k+TQplyTabzE/a8mehD0w3N7TyFdYSG5juZ5hqDMZXQBTe0Y5jfpu9ZYPjPCiMAMyzOD+9/w7LBub8RG+sVP1Gsj0a5KVYf/Id9Jxy20NT6O0q3OhlBJwRvmBwErNN76Zlu4JdQYKUNOd88P9R11h01PfMZX652aZE+t7zvw8mTDpcVee3xQ+SXRkrT9MWBU7EdEDkM7r+VDjULwlNHT1ExarFpa1LgGrAgLGwuJh7cpM=
2022-02-16T07:35:47.525 INFO:teuthology.kill:  smithi060.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC12DE0/c3rLC8ibLzxmzBPNvDiBudHvhiWMz5oBWVYKLdsS3rgh1VrVCt+mt/bK9vBLAp3Afd7E8FK1TgoM3ltiksVJ8FpQeahcGDnWvbt1b3SSNZjHyNEmZyj89eUxxZ/mv2ngCQPJTl6NxEARiSXpo1ya9QW2Q6hzAmfsd+tgu7UFOduIm/FJRK+8vOdkhYWggvEbWqMq5qZEBuYPU8XB31Zkc51NTNEReamysalt6Qsq3m10EDB2RPxWTRuLGvkidRlYdgpTh1jVMHDeGVgS1IpwbW1A5CD4sjs9ZedR5x0VkcrscYHyxqdteHbCVC967jdK5Su9RTsqvAcGyyzoMY0X7MS14cyaaxt2mK6zfqC1LXkEsA2PGOKOaSKJsItqIFDH9HNZmOBq28FVshy19/dIFs4HGGA8WyjdVMvYUUwBXPKW/0JLOjWwT/DeU/QOoRiuw0KiwLkSCKiTLwI3zeD4RlIhfoSLkzUa/NKpU8pQk26tlaUuzDXnEO3VlM=
2022-02-16T07:35:47.556 INFO:teuthology.kill:2022-02-16 07:35:47,555.555 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-02-16T07:35:47.560 INFO:teuthology.kill:2022-02-16 07:35:47,559.559 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-02-16T07:35:47.563 INFO:teuthology.kill:2022-02-16 07:35:47,563.563 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-02-16T07:35:47.650 INFO:teuthology.kill:2022-02-16 07:35:47,650.650 INFO:teuthology.orchestra.console:Power off smithi016
2022-02-16T07:35:47.665 INFO:teuthology.kill:2022-02-16 07:35:47,664.664 INFO:teuthology.orchestra.console:Power off smithi060
2022-02-16T07:35:47.676 INFO:teuthology.kill:2022-02-16 07:35:47,675.675 INFO:teuthology.orchestra.console:Power off smithi007
2022-02-16T07:35:56.040 INFO:teuthology.kill:2022-02-16 07:35:56,040.040 INFO:teuthology.orchestra.console:Power off for smithi016 completed
2022-02-16T07:35:56.185 INFO:teuthology.kill:2022-02-16 07:35:56,184.184 INFO:teuthology.lock.ops:unlocked: smithi016.front.sepia.ceph.com
2022-02-16T07:36:00.158 INFO:teuthology.kill:2022-02-16 07:36:00,157.157 INFO:teuthology.orchestra.console:Power off for smithi060 completed
2022-02-16T07:36:00.164 INFO:teuthology.kill:2022-02-16 07:36:00,164.164 INFO:teuthology.orchestra.console:Power off for smithi007 completed
2022-02-16T07:36:00.309 INFO:teuthology.kill:2022-02-16 07:36:00,309.309 INFO:teuthology.lock.ops:unlocked: smithi007.front.sepia.ceph.com
2022-02-16T07:36:00.312 INFO:teuthology.kill:2022-02-16 07:36:00,312.312 INFO:teuthology.lock.ops:unlocked: smithi060.front.sepia.ceph.com
2022-02-16T07:38:00.652 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-02-16T07:38:00.804 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi007 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-02-15_22:41:10-rados-wip-yuri10-testing-2022-02-15-1102-pacific-distro-default-smithi/6686864
2022-02-16T07:38:00.805 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi016 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-02-15_22:41:10-rados-wip-yuri10-testing-2022-02-15-1102-pacific-distro-default-smithi/6686866
2022-02-16T07:38:00.806 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi060 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-02-15_22:41:10-rados-wip-yuri10-testing-2022-02-15-1102-pacific-distro-default-smithi/6686864