2022-02-03T01:04:15.658 INFO:root:teuthology version: 1.1.0-0f634dc1
2022-02-03T01:04:15.822 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi136.front.sepia.ceph.com' reimaging
2022-02-03T01:04:15.824 INFO:teuthology.lock.ops:Updating [ubuntu@smithi136.front.sepia.ceph.com]: reset os type and version on server
2022-02-03T01:04:15.824 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server
2022-02-03T01:04:15.844 INFO:teuthology.lock.ops:Node 'ubuntu@smithi136.front.sepia.ceph.com' reimaging is complete
2022-02-03T01:04:15.845 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi157.front.sepia.ceph.com' reimaging
2022-02-03T01:04:15.845 INFO:teuthology.lock.ops:Updating [ubuntu@smithi157.front.sepia.ceph.com]: reset os type and version on server
2022-02-03T01:04:15.846 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server
2022-02-03T01:04:15.865 INFO:teuthology.lock.ops:Node 'ubuntu@smithi157.front.sepia.ceph.com' reimaging is complete
2022-02-03T01:04:15.865 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi198.front.sepia.ceph.com' reimaging
2022-02-03T01:04:15.865 INFO:teuthology.lock.ops:Updating [ubuntu@smithi198.front.sepia.ceph.com]: reset os type and version on server
2022-02-03T01:04:15.866 INFO:teuthology.lock.ops:Updating smithi198.front.sepia.ceph.com on lock server
2022-02-03T01:04:15.890 INFO:teuthology.lock.ops:Node 'ubuntu@smithi198.front.sepia.ceph.com' reimaging is complete
2022-02-03T01:04:16.065 INFO:teuthology.provision.fog.smithi136:Scheduling deploy of ubuntu 18.04
2022-02-03T01:04:16.076 INFO:teuthology.provision.fog.smithi157:Scheduling deploy of ubuntu 18.04
2022-02-03T01:04:16.090 INFO:teuthology.provision.fog.smithi198:Scheduling deploy of ubuntu 18.04
2022-02-03T01:04:16.514 INFO:teuthology.orchestra.console:Power off smithi136
2022-02-03T01:04:16.529 INFO:teuthology.orchestra.console:Power off smithi157
2022-02-03T01:04:16.587 INFO:teuthology.orchestra.console:Power off smithi198
2022-02-03T01:04:29.000 INFO:teuthology.orchestra.console:Power off for smithi136 completed
2022-02-03T01:04:29.005 INFO:teuthology.orchestra.console:Power off for smithi157 completed
2022-02-03T01:04:29.067 INFO:teuthology.orchestra.console:Power off for smithi198 completed
2022-02-03T01:04:29.101 INFO:teuthology.orchestra.console:Power on smithi136
2022-02-03T01:04:29.112 INFO:teuthology.orchestra.console:Power on smithi157
2022-02-03T01:04:29.169 INFO:teuthology.orchestra.console:Power on smithi198
2022-02-03T01:04:33.358 INFO:teuthology.orchestra.console:Power on for smithi136 completed
2022-02-03T01:04:33.460 INFO:teuthology.provision.fog.smithi136:Waiting for deploy to finish
2022-02-03T01:04:37.477 INFO:teuthology.orchestra.console:Power on for smithi157 completed
2022-02-03T01:04:37.541 INFO:teuthology.orchestra.console:Power on for smithi198 completed
2022-02-03T01:04:37.578 INFO:teuthology.provision.fog.smithi157:Waiting for deploy to finish
2022-02-03T01:04:37.642 INFO:teuthology.provision.fog.smithi198:Waiting for deploy to finish
2022-02-03T01:09:02.147 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2022-02-03T01:09:03.271 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2022-02-03T01:09:08.162 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2022-02-03T01:09:09.284 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2022-02-03T01:09:14.178 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2022-02-03T01:09:15.299 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2022-02-03T01:09:20.195 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2022-02-03T01:09:21.313 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2022-02-03T01:09:26.210 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2022-02-03T01:09:27.326 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2022-02-03T01:09:32.373 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-02-03T01:09:32.620 INFO:teuthology.provision.fog.smithi198:Node is ready
2022-02-03T01:09:32.669 INFO:teuthology.orchestra.run.smithi198.stdout:smithi198.front.sepia.ceph.com
2022-02-03T01:09:32.723 INFO:teuthology.orchestra.run.smithi198.stdout:172.21.15.198 smithi198.front.sepia.ceph.com smithi198
2022-02-03T01:09:33.013 INFO:teuthology.provision.fog.smithi198:Deploy complete!
2022-02-03T01:09:33.496 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-02-03T01:09:33.756 INFO:teuthology.provision.fog.smithi136:Node is ready
2022-02-03T01:09:33.804 INFO:teuthology.orchestra.run.smithi136.stdout:smithi136.front.sepia.ceph.com
2022-02-03T01:09:33.851 INFO:teuthology.orchestra.run.smithi136.stdout:172.21.15.136 smithi136.front.sepia.ceph.com smithi136
2022-02-03T01:09:34.128 INFO:teuthology.provision.fog.smithi136:Deploy complete!
2022-02-03T01:09:50.405 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2022-02-03T01:09:56.422 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2022-02-03T01:10:02.437 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2022-02-03T01:10:08.453 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2022-02-03T01:10:14.585 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-02-03T01:10:14.828 INFO:teuthology.provision.fog.smithi157:Node is ready
2022-02-03T01:10:14.877 INFO:teuthology.orchestra.run.smithi157.stdout:smithi157.front.sepia.ceph.com
2022-02-03T01:10:14.930 INFO:teuthology.orchestra.run.smithi157.stdout:172.21.15.157 smithi157.front.sepia.ceph.com smithi157
2022-02-03T01:10:15.239 INFO:teuthology.provision.fog.smithi157:Deploy complete!
2022-02-03T01:10:15.448 INFO:teuthology.lock.ops:Checking smithi136.front.sepia.ceph.com
2022-02-03T01:10:15.449 INFO:teuthology.lock.ops:New key found. Updating...
2022-02-03T01:10:15.470 INFO:teuthology.lock.ops:Checking smithi157.front.sepia.ceph.com
2022-02-03T01:10:15.470 INFO:teuthology.lock.ops:New key found. Updating...
2022-02-03T01:10:15.490 INFO:teuthology.lock.ops:Checking smithi198.front.sepia.ceph.com
2022-02-03T01:10:15.490 INFO:teuthology.lock.ops:New key found. Updating...
2022-02-03T01:10:15.509 INFO:teuthology.lock.ops:Updating [smithi136.front.sepia.ceph.com]: set os type and version on server
2022-02-03T01:10:15.510 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com'
2022-02-03T01:10:15.801 INFO:teuthology.orchestra.run.smithi136.stdout:x86_64
2022-02-03T01:10:15.848 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="Ubuntu"
2022-02-03T01:10:15.849 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="18.04.6 LTS (Bionic Beaver)"
2022-02-03T01:10:15.849 INFO:teuthology.orchestra.run.smithi136.stdout:ID=ubuntu
2022-02-03T01:10:15.849 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE=debian
2022-02-03T01:10:15.850 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="Ubuntu 18.04.6 LTS"
2022-02-03T01:10:15.850 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="18.04"
2022-02-03T01:10:15.850 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://www.ubuntu.com/"
2022-02-03T01:10:15.851 INFO:teuthology.orchestra.run.smithi136.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2022-02-03T01:10:15.851 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2022-02-03T01:10:15.851 INFO:teuthology.orchestra.run.smithi136.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2022-02-03T01:10:15.851 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_CODENAME=bionic
2022-02-03T01:10:15.851 INFO:teuthology.orchestra.run.smithi136.stdout:UBUNTU_CODENAME=bionic
2022-02-03T01:10:15.853 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server
2022-02-03T01:10:15.871 INFO:teuthology.lock.ops:Updating [smithi157.front.sepia.ceph.com]: set os type and version on server
2022-02-03T01:10:15.872 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com'
2022-02-03T01:10:16.108 INFO:teuthology.orchestra.run.smithi157.stdout:x86_64
2022-02-03T01:10:16.156 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="Ubuntu"
2022-02-03T01:10:16.156 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="18.04.6 LTS (Bionic Beaver)"
2022-02-03T01:10:16.156 INFO:teuthology.orchestra.run.smithi157.stdout:ID=ubuntu
2022-02-03T01:10:16.157 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE=debian
2022-02-03T01:10:16.157 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="Ubuntu 18.04.6 LTS"
2022-02-03T01:10:16.157 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="18.04"
2022-02-03T01:10:16.157 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://www.ubuntu.com/"
2022-02-03T01:10:16.158 INFO:teuthology.orchestra.run.smithi157.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2022-02-03T01:10:16.158 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2022-02-03T01:10:16.158 INFO:teuthology.orchestra.run.smithi157.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2022-02-03T01:10:16.158 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_CODENAME=bionic
2022-02-03T01:10:16.159 INFO:teuthology.orchestra.run.smithi157.stdout:UBUNTU_CODENAME=bionic
2022-02-03T01:10:16.159 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server
2022-02-03T01:10:16.178 INFO:teuthology.lock.ops:Updating [smithi198.front.sepia.ceph.com]: set os type and version on server
2022-02-03T01:10:16.179 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi198.front.sepia.ceph.com'
2022-02-03T01:10:16.466 INFO:teuthology.orchestra.run.smithi198.stdout:x86_64
2022-02-03T01:10:16.514 INFO:teuthology.orchestra.run.smithi198.stdout:NAME="Ubuntu"
2022-02-03T01:10:16.514 INFO:teuthology.orchestra.run.smithi198.stdout:VERSION="18.04.6 LTS (Bionic Beaver)"
2022-02-03T01:10:16.514 INFO:teuthology.orchestra.run.smithi198.stdout:ID=ubuntu
2022-02-03T01:10:16.515 INFO:teuthology.orchestra.run.smithi198.stdout:ID_LIKE=debian
2022-02-03T01:10:16.515 INFO:teuthology.orchestra.run.smithi198.stdout:PRETTY_NAME="Ubuntu 18.04.6 LTS"
2022-02-03T01:10:16.515 INFO:teuthology.orchestra.run.smithi198.stdout:VERSION_ID="18.04"
2022-02-03T01:10:16.515 INFO:teuthology.orchestra.run.smithi198.stdout:HOME_URL="https://www.ubuntu.com/"
2022-02-03T01:10:16.516 INFO:teuthology.orchestra.run.smithi198.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2022-02-03T01:10:16.516 INFO:teuthology.orchestra.run.smithi198.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2022-02-03T01:10:16.516 INFO:teuthology.orchestra.run.smithi198.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2022-02-03T01:10:16.516 INFO:teuthology.orchestra.run.smithi198.stdout:VERSION_CODENAME=bionic
2022-02-03T01:10:16.516 INFO:teuthology.orchestra.run.smithi198.stdout:UBUNTU_CODENAME=bionic
2022-02-03T01:10:16.517 INFO:teuthology.lock.ops:Updating smithi198.front.sepia.ceph.com on lock server
2022-02-03T01:10:16.625 INFO:teuthology.dispatcher.supervisor:Running job 6656321
2022-02-03T01:10:16.625 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-02-02_21:17:56-rados-wip-yuri3-testing-2022-02-02-0833-octopus-distro-default-smithi/6656321 --name yuriw-2022-02-02_21:17:56-rados-wip-yuri3-testing-2022-02-02-0833-octopus-distro-default-smithi --description rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_18.04} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} -- /home/teuthworker/archive/yuriw-2022-02-02_21:17:56-rados-wip-yuri3-testing-2022-02-02-0833-octopus-distro-default-smithi/6656321/orig.config.yaml
2022-02-03T01:10:16.628 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-02-02_21:17:56-rados-wip-yuri3-testing-2022-02-02-0833-octopus-distro-default-smithi/6656321
2022-02-03T01:10:16.629 INFO:teuthology.dispatcher.supervisor:Job PID: 5344
2022-02-03T01:10:16.630 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-02-03T07:40:46.539 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-02-03T07:40:46.721 INFO:teuthology.kill:Killing Pids: {5344}
2022-02-03T07:40:47.937 INFO:teuthology.task.internal:roles: ubuntu@smithi136.front.sepia.ceph.com - ['osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'mon.a']
2022-02-03T07:40:47.938 INFO:teuthology.task.internal:roles: ubuntu@smithi157.front.sepia.ceph.com - ['osd.4', 'osd.5', 'osd.6', 'osd.7', 'mon.b', 'mgr.x']
2022-02-03T07:40:47.938 INFO:teuthology.task.internal:roles: ubuntu@smithi198.front.sepia.ceph.com - ['osd.8', 'osd.9', 'osd.10', 'osd.11', 'mon.c']
2022-02-03T07:40:47.939 INFO:teuthology.misc:Compressing logs...
2022-02-03T07:40:47.939 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com'
2022-02-03T07:40:48.187 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com'
2022-02-03T07:40:48.477 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi198.front.sepia.ceph.com'
2022-02-03T07:40:49.283 INFO:teuthology.kill:No teuthology processes running
2022-02-03T07:40:50.415 INFO:teuthology.kill:Nuking machines: ['smithi136', 'smithi157', 'smithi198']
2022-02-03T07:40:51.412 INFO:teuthology.kill:2022-02-03 07:40:51,412.412 INFO:teuthology.nuke:targets:
2022-02-03T07:40:51.413 INFO:teuthology.kill:  smithi136.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDl3ihnmV0XG9dO2iwknst+8xAfPoOYk9jkoxal963O+lcC7FlW8uUFFBZPaMzCGbK87vVem0FeWzbHge7lLaZfd8gUlpb3BQ6Y4JG16f3x7A4ELUu3IW+kvxNRTN6h4lhMLGboO6W3f3szAYak4BJaTaUukDo3ti4ZdYsv7XKYXGF91W6HFL9a8QnXomV1HxhZI/MpEnAVBOXRZeqviF5i0GcYf8IwUEaEg6XUPFeY3kbO8IWi7E4KUQcCrsr27WlwIqMDmLWhmuOFeJjiJV5e4uTuN1hF/3i/do265YNzLMNcX3RF+QA3tpmbLd4HZlMgC7AMe5So1OeoiYkGavV3
2022-02-03T07:40:51.414 INFO:teuthology.kill:  smithi157.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCZfy5okJAI7J4Q6hD+WEiNxi/MmupKMtcCo6X6UmeeiT/jPskTKYv/N0PpmtwB8Ip9FroOETDSaWEyOxFUJdbq7qhwLm3f0c3WFbCqG9KI8vEJHrn6i7zQknxxcAAUIWG3lq41v+2EWz/LAXY7oVtcvOJZPvJjK9CybaHVtloo8i+SrF3l/4D904/qCHOJaF8fKR/OGkO0WoElVtJdXDPzdB5WgIY/UgtnjyJkZ5NvBeKk9IM/D3alkw5VMQ+AgJuYqJ0KYUL96LMAt5X6XyCPQY+RxKY1I1LG9Imtku/sQoCP2n4GS1wDeDHYYL4rt8x50g1dMZYJz0/d9K+5GqyX
2022-02-03T07:40:51.414 INFO:teuthology.kill:  smithi198.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdUareSp6HEQibk8Me9cO87SFiZQwwp4lowsNg/upQBYg2er6LX4PzQJFed72/8gaX+Layu69RfG5naKoPHRDbrRdH3VjLkQ+QpDAXD16JFYmI674ymL3Yiu0y9KKIjymc2tak+XqZ07tb6qdgPuC+nbs9NVuWXeCwXJQhkaRd3G80YWPBaPqB31jG2lyUldbvzqDiI7JpN1Gj2Je07iXcjD2J13sK6Q9hi8liP5pEYaY6oC0mlBPynCQGL1OqWnImVk9r7T4GJ2ngFudvyR0VVrTfyIrK+s3aG5kFL8U5qz/i0xAtbXeyRAS9SHLouaJM5FyOB49vzFHvBK90VRCB
2022-02-03T07:40:51.442 INFO:teuthology.kill:2022-02-03 07:40:51,442.442 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-02-03T07:40:51.446 INFO:teuthology.kill:2022-02-03 07:40:51,446.446 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-02-03T07:40:51.447 INFO:teuthology.kill:2022-02-03 07:40:51,447.447 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-02-03T07:40:51.534 INFO:teuthology.kill:2022-02-03 07:40:51,534.534 INFO:teuthology.orchestra.console:Power off smithi198
2022-02-03T07:40:51.552 INFO:teuthology.kill:2022-02-03 07:40:51,551.551 INFO:teuthology.orchestra.console:Power off smithi136
2022-02-03T07:40:51.564 INFO:teuthology.kill:2022-02-03 07:40:51,564.564 INFO:teuthology.orchestra.console:Power off smithi157
2022-02-03T07:40:59.987 INFO:teuthology.kill:2022-02-03 07:40:59,987.987 INFO:teuthology.orchestra.console:Power off for smithi198 completed
2022-02-03T07:41:00.138 INFO:teuthology.kill:2022-02-03 07:41:00,137.137 INFO:teuthology.lock.ops:unlocked: smithi198.front.sepia.ceph.com
2022-02-03T07:41:04.077 INFO:teuthology.kill:2022-02-03 07:41:04,077.077 INFO:teuthology.orchestra.console:Power off for smithi136 completed
2022-02-03T07:41:04.109 INFO:teuthology.kill:2022-02-03 07:41:04,109.109 INFO:teuthology.orchestra.console:Power off for smithi157 completed
2022-02-03T07:41:04.222 INFO:teuthology.kill:2022-02-03 07:41:04,222.222 INFO:teuthology.lock.ops:unlocked: smithi136.front.sepia.ceph.com
2022-02-03T07:41:04.252 INFO:teuthology.kill:2022-02-03 07:41:04,252.252 INFO:teuthology.lock.ops:unlocked: smithi157.front.sepia.ceph.com
2022-02-03T07:43:04.557 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-02-03T07:43:04.686 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi136 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-02-03_01:31:10-rados-wip-yuri2-testing-2022-02-02-1556-pacific-distro-default-smithi/6656915
2022-02-03T07:43:04.688 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi157 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-02-03_01:31:10-rados-wip-yuri2-testing-2022-02-02-1556-pacific-distro-default-smithi/6656915
2022-02-03T07:43:04.688 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi198 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-02-03_01:31:10-rados-wip-yuri2-testing-2022-02-02-1556-pacific-distro-default-smithi/6656917