2023-01-29T13:39:08.745 INFO:root:teuthology version: 0.0.1.dev22+g8e1bba1
2023-01-29T13:39:08.855 INFO:teuthology.lock.ops:Start node 'smithi123.front.sepia.ceph.com' reimaging
2023-01-29T13:39:08.856 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: reset os type and version on server
2023-01-29T13:39:08.857 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server
2023-01-29T13:39:08.872 INFO:teuthology.lock.ops:Node 'smithi123.front.sepia.ceph.com' reimaging is complete
2023-01-29T13:39:08.872 INFO:teuthology.lock.ops:Start node 'smithi161.front.sepia.ceph.com' reimaging
2023-01-29T13:39:08.872 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: reset os type and version on server
2023-01-29T13:39:08.873 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server
2023-01-29T13:39:08.890 INFO:teuthology.lock.ops:Node 'smithi161.front.sepia.ceph.com' reimaging is complete
2023-01-29T13:39:09.033 INFO:teuthology.provision.fog.smithi123:Scheduling deploy of ubuntu 20.04
2023-01-29T13:39:09.050 INFO:teuthology.provision.fog.smithi161:Scheduling deploy of ubuntu 20.04
2023-01-29T13:39:09.266 INFO:teuthology.orchestra.console:Power off smithi123
2023-01-29T13:39:09.279 INFO:teuthology.orchestra.console:Power off smithi161
2023-01-29T13:39:21.741 INFO:teuthology.orchestra.console:Power off for smithi123 completed
2023-01-29T13:39:21.748 INFO:teuthology.orchestra.console:Power off for smithi161 completed
2023-01-29T13:39:21.843 INFO:teuthology.orchestra.console:Power on smithi123
2023-01-29T13:39:21.850 INFO:teuthology.orchestra.console:Power on smithi161
2023-01-29T13:39:26.093 INFO:teuthology.orchestra.console:Power on for smithi123 completed
2023-01-29T13:39:26.194 INFO:teuthology.provision.fog.smithi123:Waiting for deploy to finish
2023-01-29T13:39:30.213 INFO:teuthology.orchestra.console:Power on for smithi161 completed
2023-01-29T13:39:30.314 INFO:teuthology.provision.fog.smithi161:Waiting for deploy to finish
2023-01-29T13:43:30.668 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.123
2023-01-29T13:43:34.764 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-01-29T13:43:39.752 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.123
2023-01-29T13:43:43.820 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-01-29T13:43:48.812 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.123
2023-01-29T13:43:52.872 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-01-29T13:43:57.868 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.123
2023-01-29T13:44:01.928 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-01-29T13:44:06.952 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.123
2023-01-29T13:44:10.988 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-01-29T13:44:35.432 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-01-29T13:44:44.492 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-01-29T13:44:45.089 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-01-29T13:44:51.694 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-01-29T13:45:06.444 INFO:teuthology.provision.fog.smithi123:Node is ready
2023-01-29T13:45:06.451 INFO:teuthology.orchestra.run.smithi123.stdout:smithi123.front.sepia.ceph.com
2023-01-29T13:45:06.458 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123 smithi123.front.sepia.ceph.com smithi123
2023-01-29T13:45:06.649 INFO:teuthology.provision.fog.smithi123:Deploy complete!
2023-01-29T13:45:13.108 INFO:teuthology.provision.fog.smithi161:Node is ready
2023-01-29T13:45:13.115 INFO:teuthology.orchestra.run.smithi161.stdout:smithi161.front.sepia.ceph.com
2023-01-29T13:45:13.165 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.15.161 smithi161.front.sepia.ceph.com smithi161
2023-01-29T13:45:13.505 INFO:teuthology.provision.fog.smithi161:Deploy complete!
2023-01-29T13:45:13.747 INFO:teuthology.lock.ops:Checking smithi123.front.sepia.ceph.com
2023-01-29T13:45:13.748 INFO:teuthology.lock.ops:New key found. Updating...
2023-01-29T13:45:13.768 INFO:teuthology.lock.ops:Checking smithi161.front.sepia.ceph.com
2023-01-29T13:45:13.768 INFO:teuthology.lock.ops:New key found. Updating...
2023-01-29T13:45:13.784 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: set os type and version on server
2023-01-29T13:45:13.784 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com'
2023-01-29T13:45:13.963 INFO:teuthology.orchestra.run.smithi123.stdout:x86_64
2023-01-29T13:45:13.969 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="Ubuntu"
2023-01-29T13:45:13.969 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="20.04.4 LTS (Focal Fossa)"
2023-01-29T13:45:13.969 INFO:teuthology.orchestra.run.smithi123.stdout:ID=ubuntu
2023-01-29T13:45:13.969 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE=debian
2023-01-29T13:45:13.970 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS"
2023-01-29T13:45:13.970 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="20.04"
2023-01-29T13:45:13.970 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://www.ubuntu.com/"
2023-01-29T13:45:13.970 INFO:teuthology.orchestra.run.smithi123.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-01-29T13:45:13.970 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-01-29T13:45:13.971 INFO:teuthology.orchestra.run.smithi123.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-01-29T13:45:13.971 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_CODENAME=focal
2023-01-29T13:45:13.971 INFO:teuthology.orchestra.run.smithi123.stdout:UBUNTU_CODENAME=focal
2023-01-29T13:45:13.972 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server
2023-01-29T13:45:13.992 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: set os type and version on server
2023-01-29T13:45:13.993 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com'
2023-01-29T13:45:14.167 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64
2023-01-29T13:45:14.174 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="Ubuntu"
2023-01-29T13:45:14.174 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="20.04.4 LTS (Focal Fossa)"
2023-01-29T13:45:14.174 INFO:teuthology.orchestra.run.smithi161.stdout:ID=ubuntu
2023-01-29T13:45:14.175 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE=debian
2023-01-29T13:45:14.175 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS"
2023-01-29T13:45:14.175 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="20.04"
2023-01-29T13:45:14.175 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://www.ubuntu.com/"
2023-01-29T13:45:14.175 INFO:teuthology.orchestra.run.smithi161.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-01-29T13:45:14.176 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-01-29T13:45:14.176 INFO:teuthology.orchestra.run.smithi161.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-01-29T13:45:14.176 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_CODENAME=focal
2023-01-29T13:45:14.176 INFO:teuthology.orchestra.run.smithi161.stdout:UBUNTU_CODENAME=focal
2023-01-29T13:45:14.177 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server
2023-01-29T13:45:14.261 INFO:teuthology.dispatcher.supervisor:Running job 7136506
2023-01-29T13:45:14.261 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8e1bba12e584b7ae912e92e94afe9c075ab51fa3/virtualenv/bin/teuthology -v --owner scheduled_lflores@teuthology --archive /home/teuthworker/archive/lflores-2023-01-24_21:45:32-rados-main-distro-default-smithi/7136506 --name lflores-2023-01-24_21:45:32-rados-main-distro-default-smithi --description rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} -- /home/teuthworker/archive/lflores-2023-01-24_21:45:32-rados-main-distro-default-smithi/7136506/orig.config.yaml
2023-01-29T13:45:14.264 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/lflores-2023-01-24_21:45:32-rados-main-distro-default-smithi/7136506
2023-01-29T13:45:14.265 INFO:teuthology.dispatcher.supervisor:Job PID: 29308
2023-01-29T13:45:14.265 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-01-30T01:46:07.168 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2023-01-30T01:46:07.320 INFO:teuthology.kill:Killing Pids: {29308}
2023-01-30T01:46:16.426 INFO:teuthology.task.internal:roles: ubuntu@smithi123.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a']
2023-01-30T01:46:16.426 INFO:teuthology.task.internal:roles: ubuntu@smithi161.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']
2023-01-30T01:46:16.427 INFO:teuthology.misc:Compressing logs...
2023-01-30T01:46:16.427 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com'
2023-01-30T01:46:16.632 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com'
2023-01-30T01:46:16.879 INFO:teuthology.misc:Compressing logs...
2023-01-30T01:46:18.158 INFO:teuthology.misc:Compressing logs...
2023-01-30T01:51:04.349 INFO:teuthology.kill:No teuthology processes running
2023-01-30T01:51:05.020 INFO:teuthology.kill:Nuking machines: ['smithi123', 'smithi161']
2023-01-30T01:51:05.771 INFO:teuthology.kill:2023-01-30 01:51:05,771.771 INFO:teuthology.nuke:targets:
2023-01-30T01:51:05.772 INFO:teuthology.kill:  smithi123.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=
2023-01-30T01:51:05.773 INFO:teuthology.kill:  smithi161.front.sepia.ceph.com: ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw
2023-01-30T01:51:05.773 INFO:teuthology.kill:2023-01-30 01:51:05,771.771 INFO:teuthology.nuke:Checking targets against current locks
2023-01-30T01:51:05.822 INFO:teuthology.kill:2023-01-30 01:51:05,822.822 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-01-30T01:51:05.848 INFO:teuthology.kill:2023-01-30 01:51:05,848.848 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-01-30T01:51:05.897 INFO:teuthology.kill:2023-01-30 01:51:05,897.897 INFO:teuthology.orchestra.console:Power off smithi123
2023-01-30T01:51:05.929 INFO:teuthology.kill:2023-01-30 01:51:05,928.928 INFO:teuthology.orchestra.console:Power off smithi161
2023-01-30T01:51:14.261 INFO:teuthology.kill:2023-01-30 01:51:14,261.261 INFO:teuthology.orchestra.console:Power off for smithi123 completed
2023-01-30T01:51:14.426 INFO:teuthology.kill:2023-01-30 01:51:14,426.426 INFO:teuthology.lock.ops:unlocked: smithi123.front.sepia.ceph.com
2023-01-30T01:51:18.396 INFO:teuthology.kill:2023-01-30 01:51:18,396.396 INFO:teuthology.orchestra.console:Power off for smithi161 completed
2023-01-30T01:51:18.536 INFO:teuthology.kill:2023-01-30 01:51:18,536.536 INFO:teuthology.lock.ops:unlocked: smithi161.front.sepia.ceph.com
2023-01-30T01:53:18.802 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2023-01-30T01:53:18.884 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi123 but it was locked by another job: /home/teuthworker/archive/teuthology-2023-01-28_14:23:02-upgrade:nautilus-x-pacific-distro-default-smithi/7143318
2023-01-30T01:53:18.885 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi161 but it was locked by another job: /home/teuthworker/archive/teuthology-2023-01-28_14:23:02-upgrade:nautilus-x-pacific-distro-default-smithi/7143318