2024-01-14T14:17:43.142 INFO:root:teuthology version: 0.0.1.dev249+gcd45576
2024-01-14T14:17:43.152 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-14T14:17:43.532 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fafb93f6f70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fafba45cc10>, signals=[15])
2024-01-14T14:17:43.533 INFO:teuthology.lock.ops:Start node 'smithi043.front.sepia.ceph.com' reimaging
2024-01-14T14:17:43.533 INFO:teuthology.lock.ops:Updating [smithi043.front.sepia.ceph.com]: reset os type and version on server
2024-01-14T14:17:43.533 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server
2024-01-14T14:17:43.556 INFO:teuthology.lock.ops:Start node 'smithi050.front.sepia.ceph.com' reimaging
2024-01-14T14:17:43.556 INFO:teuthology.lock.ops:Updating [smithi050.front.sepia.ceph.com]: reset os type and version on server
2024-01-14T14:17:43.557 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server
2024-01-14T14:17:43.580 INFO:teuthology.lock.ops:Start node 'smithi192.front.sepia.ceph.com' reimaging
2024-01-14T14:17:43.580 INFO:teuthology.lock.ops:Updating [smithi192.front.sepia.ceph.com]: reset os type and version on server
2024-01-14T14:17:43.580 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server
2024-01-14T14:17:43.711 DEBUG:teuthology.provision.fog.smithi050:Requesting image smithi_ubuntu_22.04 (ID 6)
2024-01-14T14:17:43.715 DEBUG:teuthology.provision.fog.smithi043:Requesting image smithi_ubuntu_22.04 (ID 6)
2024-01-14T14:17:43.736 DEBUG:teuthology.provision.fog.smithi192:Requesting image smithi_ubuntu_22.04 (ID 6)
2024-01-14T14:17:43.752 INFO:teuthology.provision.fog.smithi050:Scheduling deploy of ubuntu 22.04
2024-01-14T14:17:43.762 INFO:teuthology.provision.fog.smithi043:Scheduling deploy of ubuntu 22.04
2024-01-14T14:17:43.782 INFO:teuthology.provision.fog.smithi192:Scheduling deploy of ubuntu 22.04
2024-01-14T14:17:43.796 DEBUG:teuthology.provision.fog.smithi050:Canceling deploy task with ID 715271
2024-01-14T14:17:43.813 DEBUG:teuthology.provision.fog.smithi043:Canceling deploy task with ID 715270
2024-01-14T14:17:44.185 INFO:teuthology.orchestra.console.smithi192:Power off
2024-01-14T14:17:44.185 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-14T14:17:44.244 INFO:teuthology.orchestra.console.smithi050:Power off
2024-01-14T14:17:44.244 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-14T14:17:44.280 DEBUG:teuthology.orchestra.console.smithi192:power off output: Chassis Power Control: Down/Off
2024-01-14T14:17:44.280 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-14T14:17:44.293 DEBUG:teuthology.orchestra.console.smithi050:power off output: Chassis Power Control: Down/Off
2024-01-14T14:17:44.294 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-14T14:17:44.352 INFO:teuthology.orchestra.console.smithi043:Power off
2024-01-14T14:17:44.353 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-14T14:17:44.380 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off
2024-01-14T14:17:44.389 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is off
2024-01-14T14:17:44.432 DEBUG:teuthology.orchestra.console.smithi043:power off output: Chassis Power Control: Down/Off
2024-01-14T14:17:44.432 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-14T14:17:44.476 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is off
2024-01-14T14:17:44.481 INFO:teuthology.orchestra.console.smithi192:Power off completed
2024-01-14T14:17:44.491 INFO:teuthology.orchestra.console.smithi050:Power off completed
2024-01-14T14:17:44.577 INFO:teuthology.orchestra.console.smithi043:Power off completed
2024-01-14T14:17:44.582 INFO:teuthology.orchestra.console.smithi192:Power on
2024-01-14T14:17:44.582 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-14T14:17:44.621 INFO:teuthology.orchestra.console.smithi050:Power on
2024-01-14T14:17:44.621 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-14T14:17:44.649 DEBUG:teuthology.orchestra.console.smithi192:power on output: Chassis Power Control: Up/On
2024-01-14T14:17:44.649 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-14T14:17:44.691 INFO:teuthology.orchestra.console.smithi043:Power on
2024-01-14T14:17:44.691 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-14T14:17:44.734 DEBUG:teuthology.orchestra.console.smithi050:power on output: Chassis Power Control: Up/On
2024-01-14T14:17:44.734 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-14T14:17:44.755 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off
2024-01-14T14:17:44.764 DEBUG:teuthology.orchestra.console.smithi043:power on output: Chassis Power Control: Up/On
2024-01-14T14:17:44.764 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-14T14:17:44.833 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is off
2024-01-14T14:17:44.852 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is off
2024-01-14T14:17:48.760 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-14T14:17:48.835 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-14T14:17:48.880 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-14T14:17:48.902 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on
2024-01-14T14:17:48.982 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is on
2024-01-14T14:17:49.001 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is off
2024-01-14T14:17:49.004 INFO:teuthology.orchestra.console.smithi192:Power on completed
2024-01-14T14:17:49.083 INFO:teuthology.orchestra.console.smithi050:Power on completed
2024-01-14T14:17:49.108 INFO:teuthology.provision.fog.smithi192:Waiting for deploy to finish
2024-01-14T14:17:49.186 INFO:teuthology.provision.fog.smithi050:Waiting for deploy to finish
2024-01-14T14:17:53.004 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-14T14:17:53.231 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is on
2024-01-14T14:17:53.333 INFO:teuthology.orchestra.console.smithi043:Power on completed
2024-01-14T14:17:53.433 INFO:teuthology.provision.fog.smithi043:Waiting for deploy to finish
2024-01-14T14:20:54.195 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-14T14:21:05.038 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-14T14:21:05.042 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-14T14:21:08.092 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192
2024-01-14T14:21:12.636 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43
2024-01-14T14:21:14.094 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-14T14:21:17.148 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192
2024-01-14T14:21:18.639 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-14T14:21:21.692 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43
2024-01-14T14:21:23.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-14T14:21:23.388 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50
2024-01-14T14:21:26.204 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192
2024-01-14T14:21:27.694 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-14T14:21:27.836 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43
2024-01-14T14:21:29.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-14T14:21:31.932 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50
2024-01-14T14:21:32.206 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-14T14:21:33.839 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-14T14:21:35.260 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192
2024-01-14T14:21:36.892 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43
2024-01-14T14:21:37.934 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-14T14:21:40.988 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50
2024-01-14T14:21:41.261 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-14T14:21:42.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-14T14:21:44.316 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192
2024-01-14T14:21:45.952 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43
2024-01-14T14:21:46.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-14T14:21:47.136 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50
2024-01-14T14:21:50.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-14T14:21:51.955 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-14T14:21:53.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-14T14:21:53.376 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192
2024-01-14T14:21:56.188 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50
2024-01-14T14:21:59.380 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-14T14:22:02.192 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-14T14:22:05.244 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50
2024-01-14T14:22:11.249 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-14T14:22:52.001 WARNING:teuthology.provision.fog.smithi043:timed out
2024-01-14T14:22:58.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-14T14:22:58.556 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-14T14:22:58.557 DEBUG:teuthology.orchestra.run.smithi043:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-14T14:22:59.015 INFO:teuthology.provision.fog.smithi043:Node is ready
2024-01-14T14:22:59.015 DEBUG:teuthology.orchestra.run.smithi043:> hostname
2024-01-14T14:22:59.063 INFO:teuthology.orchestra.run.smithi043.stdout:smithi043.front.sepia.ceph.com
2024-01-14T14:22:59.063 DEBUG:teuthology.orchestra.run.smithi043:> grep smithi043.front.sepia.ceph.com /etc/hosts
2024-01-14T14:22:59.111 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43 smithi043.front.sepia.ceph.com smithi043
2024-01-14T14:22:59.111 DEBUG:teuthology.orchestra.run.smithi043:> sudo hostname smithi043
2024-01-14T14:22:59.258 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i -e 's/smithi043.front.sepia.ceph.com/smithi043/g' /etc/hosts
2024-01-14T14:22:59.269 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i -e 's/172.21.15.43/172.21.15.43/g' /etc/hosts
2024-01-14T14:22:59.322 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i -e 's/smithi043.front.sepia.ceph.com/smithi043/g' /etc/hostname
2024-01-14T14:22:59.374 DEBUG:teuthology.orchestra.run.smithi043:> sudo hostname smithi043
2024-01-14T14:22:59.384 WARNING:teuthology.provision.fog.smithi192:timed out
2024-01-14T14:22:59.430 DEBUG:teuthology.orchestra.run.smithi043:> cat /etc/os-release
2024-01-14T14:22:59.479 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-01-14T14:22:59.480 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="Ubuntu"
2024-01-14T14:22:59.480 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="22.04"
2024-01-14T14:22:59.480 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-01-14T14:22:59.480 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_CODENAME=jammy
2024-01-14T14:22:59.480 INFO:teuthology.orchestra.run.smithi043.stdout:ID=ubuntu
2024-01-14T14:22:59.480 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE=debian
2024-01-14T14:22:59.480 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://www.ubuntu.com/"
2024-01-14T14:22:59.480 INFO:teuthology.orchestra.run.smithi043.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-01-14T14:22:59.480 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-01-14T14:22:59.481 INFO:teuthology.orchestra.run.smithi043.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-01-14T14:22:59.481 INFO:teuthology.orchestra.run.smithi043.stdout:UBUNTU_CODENAME=jammy
2024-01-14T14:22:59.481 INFO:teuthology.provision.fog.smithi043:Deploy complete!
2024-01-14T14:22:59.483 DEBUG:teuthology.parallel:result is None
2024-01-14T14:23:05.388 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-14T14:23:05.573 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-14T14:23:05.573 DEBUG:teuthology.orchestra.run.smithi192:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-14T14:23:06.002 INFO:teuthology.provision.fog.smithi192:Node is ready
2024-01-14T14:23:06.002 DEBUG:teuthology.orchestra.run.smithi192:> hostname
2024-01-14T14:23:06.050 INFO:teuthology.orchestra.run.smithi192.stdout:smithi192.front.sepia.ceph.com
2024-01-14T14:23:06.051 DEBUG:teuthology.orchestra.run.smithi192:> grep smithi192.front.sepia.ceph.com /etc/hosts
2024-01-14T14:23:06.100 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.15.192 smithi192.front.sepia.ceph.com smithi192
2024-01-14T14:23:06.101 DEBUG:teuthology.orchestra.run.smithi192:> sudo hostname smithi192
2024-01-14T14:23:06.239 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/smithi192.front.sepia.ceph.com/smithi192/g' /etc/hosts
2024-01-14T14:23:06.252 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/172.21.15.192/172.21.15.192/g' /etc/hosts
2024-01-14T14:23:06.310 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/smithi192.front.sepia.ceph.com/smithi192/g' /etc/hostname
2024-01-14T14:23:06.365 DEBUG:teuthology.orchestra.run.smithi192:> sudo hostname smithi192
2024-01-14T14:23:06.417 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release
2024-01-14T14:23:06.462 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-01-14T14:23:06.462 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="Ubuntu"
2024-01-14T14:23:06.462 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="22.04"
2024-01-14T14:23:06.462 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-01-14T14:23:06.462 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_CODENAME=jammy
2024-01-14T14:23:06.463 INFO:teuthology.orchestra.run.smithi192.stdout:ID=ubuntu
2024-01-14T14:23:06.463 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE=debian
2024-01-14T14:23:06.463 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://www.ubuntu.com/"
2024-01-14T14:23:06.463 INFO:teuthology.orchestra.run.smithi192.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-01-14T14:23:06.463 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-01-14T14:23:06.463 INFO:teuthology.orchestra.run.smithi192.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-01-14T14:23:06.463 INFO:teuthology.orchestra.run.smithi192.stdout:UBUNTU_CODENAME=jammy
2024-01-14T14:23:06.463 INFO:teuthology.provision.fog.smithi192:Deploy complete!
2024-01-14T14:23:06.464 DEBUG:teuthology.parallel:result is None
2024-01-14T14:23:11.257 WARNING:teuthology.provision.fog.smithi050:timed out
2024-01-14T14:23:17.264 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-14T14:23:17.482 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-14T14:23:17.482 DEBUG:teuthology.orchestra.run.smithi050:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-14T14:23:17.914 INFO:teuthology.provision.fog.smithi050:Node is ready
2024-01-14T14:23:17.914 DEBUG:teuthology.orchestra.run.smithi050:> hostname
2024-01-14T14:23:17.962 INFO:teuthology.orchestra.run.smithi050.stdout:smithi050.front.sepia.ceph.com
2024-01-14T14:23:17.962 DEBUG:teuthology.orchestra.run.smithi050:> grep smithi050.front.sepia.ceph.com /etc/hosts
2024-01-14T14:23:18.010 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50 smithi050.front.sepia.ceph.com smithi050
2024-01-14T14:23:18.011 DEBUG:teuthology.orchestra.run.smithi050:> sudo hostname smithi050
2024-01-14T14:23:18.154 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i -e 's/smithi050.front.sepia.ceph.com/smithi050/g' /etc/hosts
2024-01-14T14:23:18.165 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i -e 's/172.21.15.50/172.21.15.50/g' /etc/hosts
2024-01-14T14:23:18.217 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i -e 's/smithi050.front.sepia.ceph.com/smithi050/g' /etc/hostname
2024-01-14T14:23:18.268 DEBUG:teuthology.orchestra.run.smithi050:> sudo hostname smithi050
2024-01-14T14:23:18.323 DEBUG:teuthology.orchestra.run.smithi050:> cat /etc/os-release
2024-01-14T14:23:18.370 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-01-14T14:23:18.370 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="Ubuntu"
2024-01-14T14:23:18.370 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="22.04"
2024-01-14T14:23:18.370 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-01-14T14:23:18.370 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_CODENAME=jammy
2024-01-14T14:23:18.370 INFO:teuthology.orchestra.run.smithi050.stdout:ID=ubuntu
2024-01-14T14:23:18.370 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE=debian
2024-01-14T14:23:18.370 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://www.ubuntu.com/"
2024-01-14T14:23:18.370 INFO:teuthology.orchestra.run.smithi050.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-01-14T14:23:18.371 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-01-14T14:23:18.371 INFO:teuthology.orchestra.run.smithi050.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-01-14T14:23:18.371 INFO:teuthology.orchestra.run.smithi050.stdout:UBUNTU_CODENAME=jammy
2024-01-14T14:23:18.371 INFO:teuthology.provision.fog.smithi050:Deploy complete!
2024-01-14T14:23:18.371 DEBUG:teuthology.parallel:result is None
2024-01-14T14:23:19.482 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/dispatcher/supervisor.py", line 232, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/lock/ops.py", line 326, in reimage_machines
    reimaged = do_update_keys(list(reimaged.keys()))[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/lock/ops.py", line 290, in do_update_keys
    keys_dict = misc.ssh_keyscan(machines, _raise=_raise)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1108, in ssh_keyscan
    key = _ssh_keyscan(hostname)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1145, in _ssh_keyscan
    return sorted(keys)[0]
IndexError: list index out of range
2024-01-14T14:23:19.484 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-14T14:23:19.765 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=79aaf35cff2c419d95acaffa11f504cc
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/dispatcher/supervisor.py", line 232, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/lock/ops.py", line 326, in reimage_machines
    reimaged = do_update_keys(list(reimaged.keys()))[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/lock/ops.py", line 290, in do_update_keys
    keys_dict = misc.ssh_keyscan(machines, _raise=_raise)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1108, in ssh_keyscan
    key = _ssh_keyscan(hostname)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1145, in _ssh_keyscan
    return sorted(keys)[0]
IndexError: list index out of range
2024-01-14T14:23:19.767 INFO:teuthology.nuke:Checking targets against current locks
2024-01-14T14:23:19.803 INFO:teuthology.nuke:Not nuking smithi043.front.sepia.ceph.com because description doesn't match: dis-2024-01-14_14:02:30-rbd-wip-dis-testing-1-distro-default-smithi != None
2024-01-14T14:23:19.852 DEBUG:teuthology.nuke:shortname: smithi050
2024-01-14T14:23:19.852 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-14T14:23:19.877 DEBUG:teuthology.nuke:shortname: smithi192
2024-01-14T14:23:19.877 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-14T14:23:19.881 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi050.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dis-2024-01-14_14:02:30-rbd-wip-dis-testing-1-distro-default-smithi/7516530', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-14 14:17:40.524144', 'locked_by': 'scheduled_dis@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFmju1gUmO8YuW05ZUhuLsDH7StfCN4HYD9RnMbFYswr'}
2024-01-14T14:23:19.926 INFO:teuthology.orchestra.console.smithi050:Power off
2024-01-14T14:23:19.926 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-14T14:23:19.938 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi192.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dis-2024-01-14_14:02:30-rbd-wip-dis-testing-1-distro-default-smithi/7516530', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-14 14:17:40.525791', 'locked_by': 'scheduled_dis@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOBkQtTM4HWZ3Vzo6A33zFJLolU3L9gG41j43TBcFKcSgGvyVW3/OlrTSR334C1uoXT9tag/jyCAJH6qWSAVpaQ='}
2024-01-14T14:23:19.950 DEBUG:teuthology.orchestra.console.smithi050:power off output: Chassis Power Control: Down/Off
2024-01-14T14:23:19.950 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-14T14:23:19.976 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is on
2024-01-14T14:23:19.993 INFO:teuthology.orchestra.console.smithi192:Power off
2024-01-14T14:23:19.994 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-14T14:23:20.016 DEBUG:teuthology.orchestra.console.smithi192:power off output: Chassis Power Control: Down/Off
2024-01-14T14:23:20.016 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-14T14:23:20.039 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on
2024-01-14T14:23:23.979 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-14T14:23:24.040 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-14T14:23:24.088 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is on
2024-01-14T14:23:24.148 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on
2024-01-14T14:23:28.092 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-14T14:23:28.149 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-14T14:23:28.202 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is off
2024-01-14T14:23:28.259 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on
2024-01-14T14:23:28.303 INFO:teuthology.orchestra.console.smithi050:Power off completed
2024-01-14T14:23:28.457 INFO:teuthology.lock.ops:unlocked: smithi050.front.sepia.ceph.com
2024-01-14T14:23:32.264 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-14T14:23:32.373 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off
2024-01-14T14:23:32.474 INFO:teuthology.orchestra.console.smithi192:Power off completed
2024-01-14T14:23:32.649 INFO:teuthology.lock.ops:unlocked: smithi192.front.sepia.ceph.com
2024-01-14T14:23:32.651 ERROR:teuthology.nuke:Could not nuke the following targets:
targets:
  smithi043.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCYBqJr6CY5Q34Xm57S3TcF4T6mgvhEnoE9XVb/bJXNChzOs7bUw6V78Di8bfdImH8PA8Zt6NWLCQ1lcHcUhavg=
2024-01-14T14:23:33.010 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/bin/teuthology-dispatcher", line 8, in <module>
    sys.exit(main())
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/scripts/dispatcher.py", line 35, in main
    sys.exit(teuthology.dispatcher.main(args))
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/dispatcher/__init__.py", line 69, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/dispatcher/supervisor.py", line 58, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/dispatcher/supervisor.py", line 232, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/lock/ops.py", line 326, in reimage_machines
    reimaged = do_update_keys(list(reimaged.keys()))[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/lock/ops.py", line 290, in do_update_keys
    keys_dict = misc.ssh_keyscan(machines, _raise=_raise)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1108, in ssh_keyscan
    key = _ssh_keyscan(hostname)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1145, in _ssh_keyscan
    return sorted(keys)[0]
IndexError: list index out of range