2023-12-13T20:07:19.970 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e
2023-12-13T20:07:19.971 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-13T20:07:20.149 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f7820a2a310>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f7821980940>, signals=[15])
2023-12-13T20:07:20.150 INFO:teuthology.lock.ops:Start node 'smithi019.front.sepia.ceph.com' reimaging
2023-12-13T20:07:20.150 INFO:teuthology.lock.ops:Updating [smithi019.front.sepia.ceph.com]: reset os type and version on server
2023-12-13T20:07:20.150 INFO:teuthology.lock.ops:Updating smithi019.front.sepia.ceph.com on lock server
2023-12-13T20:07:20.179 INFO:teuthology.lock.ops:Start node 'smithi039.front.sepia.ceph.com' reimaging
2023-12-13T20:07:20.180 INFO:teuthology.lock.ops:Updating [smithi039.front.sepia.ceph.com]: reset os type and version on server
2023-12-13T20:07:20.180 INFO:teuthology.lock.ops:Updating smithi039.front.sepia.ceph.com on lock server
2023-12-13T20:07:20.203 INFO:teuthology.lock.ops:Start node 'smithi195.front.sepia.ceph.com' reimaging
2023-12-13T20:07:20.204 INFO:teuthology.lock.ops:Updating [smithi195.front.sepia.ceph.com]: reset os type and version on server
2023-12-13T20:07:20.204 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server
2023-12-13T20:07:20.296 DEBUG:teuthology.provision.fog.smithi019:Requesting image smithi_centos_8.stream (ID 3)
2023-12-13T20:07:20.311 DEBUG:teuthology.provision.fog.smithi039:Requesting image smithi_centos_8.stream (ID 3)
2023-12-13T20:07:20.343 DEBUG:teuthology.provision.fog.smithi195:Requesting image smithi_centos_8.stream (ID 3)
2023-12-13T20:07:20.347 INFO:teuthology.provision.fog.smithi019:Scheduling deploy of centos 8.stream
2023-12-13T20:07:20.354 INFO:teuthology.provision.fog.smithi039:Scheduling deploy of centos 8.stream
2023-12-13T20:07:20.384 INFO:teuthology.provision.fog.smithi195:Scheduling deploy of centos 8.stream
2023-12-13T20:07:20.612 INFO:teuthology.orchestra.console.smithi039:Power off
2023-12-13T20:07:20.612 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-13T20:07:20.627 INFO:teuthology.orchestra.console.smithi019:Power off
2023-12-13T20:07:20.627 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-13T20:07:20.640 DEBUG:teuthology.orchestra.console.smithi039:power off output: Chassis Power Control: Down/Off
2023-12-13T20:07:20.641 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T20:07:20.650 DEBUG:teuthology.orchestra.console.smithi019:power off output: Chassis Power Control: Down/Off
2023-12-13T20:07:20.651 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T20:07:20.663 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is on
2023-12-13T20:07:20.677 INFO:teuthology.orchestra.console.smithi195:Power off
2023-12-13T20:07:20.677 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-13T20:07:20.686 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is on
2023-12-13T20:07:20.698 DEBUG:teuthology.orchestra.console.smithi195:power off output: Chassis Power Control: Down/Off
2023-12-13T20:07:20.698 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T20:07:20.723 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on
2023-12-13T20:07:24.666 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T20:07:24.688 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T20:07:24.724 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T20:07:24.774 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is on
2023-12-13T20:07:24.796 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is on
2023-12-13T20:07:24.833 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on
2023-12-13T20:07:28.778 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T20:07:28.798 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T20:07:28.834 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T20:07:28.886 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is off
2023-12-13T20:07:28.908 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is on
2023-12-13T20:07:28.943 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off
2023-12-13T20:07:28.989 INFO:teuthology.orchestra.console.smithi039:Power off completed
2023-12-13T20:07:29.045 INFO:teuthology.orchestra.console.smithi195:Power off completed
2023-12-13T20:07:29.090 INFO:teuthology.orchestra.console.smithi039:Power on
2023-12-13T20:07:29.091 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-13T20:07:29.115 DEBUG:teuthology.orchestra.console.smithi039:power on output: Chassis Power Control: Up/On
2023-12-13T20:07:29.115 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T20:07:29.140 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is off
2023-12-13T20:07:29.146 INFO:teuthology.orchestra.console.smithi195:Power on
2023-12-13T20:07:29.146 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-13T20:07:29.170 DEBUG:teuthology.orchestra.console.smithi195:power on output: Chassis Power Control: Up/On
2023-12-13T20:07:29.171 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T20:07:29.193 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off
2023-12-13T20:07:32.911 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T20:07:33.020 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is off
2023-12-13T20:07:33.121 INFO:teuthology.orchestra.console.smithi019:Power off completed
2023-12-13T20:07:33.142 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T20:07:33.194 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T20:07:33.226 INFO:teuthology.orchestra.console.smithi019:Power on
2023-12-13T20:07:33.226 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-13T20:07:33.248 DEBUG:teuthology.orchestra.console.smithi019:power on output: Chassis Power Control: Up/On
2023-12-13T20:07:33.248 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T20:07:33.256 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is off
2023-12-13T20:07:33.269 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is off
2023-12-13T20:07:33.304 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off
2023-12-13T20:07:37.260 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T20:07:37.270 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T20:07:37.305 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T20:07:37.370 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is on
2023-12-13T20:07:37.379 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is on
2023-12-13T20:07:37.414 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on
2023-12-13T20:07:37.471 INFO:teuthology.orchestra.console.smithi039:Power on completed
2023-12-13T20:07:37.480 INFO:teuthology.orchestra.console.smithi019:Power on completed
2023-12-13T20:07:37.514 INFO:teuthology.orchestra.console.smithi195:Power on completed
2023-12-13T20:07:37.573 INFO:teuthology.provision.fog.smithi039:Waiting for deploy to finish
2023-12-13T20:07:37.581 INFO:teuthology.provision.fog.smithi019:Waiting for deploy to finish
2023-12-13T20:07:37.615 INFO:teuthology.provision.fog.smithi195:Waiting for deploy to finish
2023-12-13T20:07:37.668 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T20:08:12.134 WARNING:teuthology.provision.fog.smithi019:[Errno None] Unable to connect to port 22 on 172.21.15.19
2023-12-13T20:08:18.141 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T20:08:21.218 WARNING:teuthology.provision.fog.smithi019:[Errno None] Unable to connect to port 22 on 172.21.15.19
2023-12-13T20:08:27.222 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T20:08:30.274 WARNING:teuthology.provision.fog.smithi019:[Errno None] Unable to connect to port 22 on 172.21.15.19
2023-12-13T20:08:36.279 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T20:09:07.760 ERROR:teuthology.orchestra.connection:Error authenticating with smithi019.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-13T20:09:11.840 ERROR:teuthology.orchestra.connection:Error authenticating with smithi019.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-13T20:09:18.919 ERROR:teuthology.orchestra.connection:Error authenticating with smithi019.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-13T20:09:23.289 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T20:09:26.374 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39
2023-12-13T20:09:29.000 ERROR:teuthology.orchestra.connection:Error authenticating with smithi019.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-13T20:09:32.376 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T20:09:35.430 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39
2023-12-13T20:09:41.431 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T20:09:42.081 ERROR:teuthology.orchestra.connection:Error authenticating with smithi019.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-13T20:09:44.486 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39
2023-12-13T20:09:50.488 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T20:09:53.574 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39
2023-12-13T20:09:58.162 ERROR:teuthology.orchestra.connection:Error authenticating with smithi019.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-13T20:09:59.575 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T20:10:02.627 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39
2023-12-13T20:10:08.487 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T20:10:08.628 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T20:10:11.554 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195
2023-12-13T20:10:11.682 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39
2023-12-13T20:10:17.282 ERROR:teuthology.orchestra.connection:Error authenticating with smithi019.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-13T20:10:17.557 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T20:10:17.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T20:10:20.614 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195
2023-12-13T20:10:20.738 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39
2023-12-13T20:10:26.617 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T20:10:26.739 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T20:10:29.702 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195
2023-12-13T20:10:29.794 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39
2023-12-13T20:10:35.703 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T20:10:35.798 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T20:10:38.754 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195
2023-12-13T20:10:38.854 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39
2023-12-13T20:10:39.400 ERROR:teuthology.orchestra.connection:Error authenticating with smithi019.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-13T20:10:44.756 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T20:10:44.856 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T20:10:47.814 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195
2023-12-13T20:10:47.906 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39
2023-12-13T20:10:53.815 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T20:10:53.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T20:10:56.866 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195
2023-12-13T20:10:56.966 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39
2023-12-13T20:11:02.867 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T20:11:02.968 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T20:11:34.579 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-13T20:11:34.580 DEBUG:teuthology.orchestra.run.smithi195:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-13T20:11:59.748 INFO:teuthology.provision.fog.smithi195:Node is ready
2023-12-13T20:11:59.749 DEBUG:teuthology.orchestra.run.smithi195:> hostname
2023-12-13T20:11:59.773 INFO:teuthology.orchestra.run.smithi195.stdout:smithi195.front.sepia.ceph.com
2023-12-13T20:11:59.773 DEBUG:teuthology.orchestra.run.smithi195:> grep smithi195.front.sepia.ceph.com /etc/hosts
2023-12-13T20:11:59.834 INFO:teuthology.orchestra.run.smithi195.stdout:172.21.15.195 smithi195.front.sepia.ceph.com smithi195
2023-12-13T20:11:59.834 DEBUG:teuthology.orchestra.run.smithi195:> sudo hostname smithi195
2023-12-13T20:11:59.953 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/smithi195.front.sepia.ceph.com/smithi195/g' /etc/hosts
2023-12-13T20:11:59.983 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/172.21.15.195/172.21.15.195/g' /etc/hosts
2023-12-13T20:12:00.052 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/smithi195.front.sepia.ceph.com/smithi195/g' /etc/hostname
2023-12-13T20:12:00.121 DEBUG:teuthology.orchestra.run.smithi195:> sudo hostname smithi195
2023-12-13T20:12:00.191 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release
2023-12-13T20:12:00.251 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="CentOS Stream"
2023-12-13T20:12:00.252 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="8"
2023-12-13T20:12:00.252 INFO:teuthology.orchestra.run.smithi195.stdout:ID="centos"
2023-12-13T20:12:00.252 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE="rhel fedora"
2023-12-13T20:12:00.252 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="8"
2023-12-13T20:12:00.252 INFO:teuthology.orchestra.run.smithi195.stdout:PLATFORM_ID="platform:el8"
2023-12-13T20:12:00.252 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="CentOS Stream 8"
2023-12-13T20:12:00.252 INFO:teuthology.orchestra.run.smithi195.stdout:ANSI_COLOR="0;31"
2023-12-13T20:12:00.252 INFO:teuthology.orchestra.run.smithi195.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-12-13T20:12:00.252 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://centos.org/"
2023-12-13T20:12:00.252 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-13T20:12:00.252 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-13T20:12:00.253 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-13T20:12:00.253 INFO:teuthology.provision.fog.smithi195:Deploy complete!
2023-12-13T20:12:00.255 DEBUG:teuthology.parallel:result is None
2023-12-13T20:12:02.970 WARNING:teuthology.provision.fog.smithi039:timed out
2023-12-13T20:12:04.404 WARNING:teuthology.provision.fog.smithi019:timed out
2023-12-13T20:12:08.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T20:12:09.056 ERROR:teuthology.orchestra.connection:Error authenticating with smithi039.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-13T20:12:10.405 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T20:12:13.181 ERROR:teuthology.orchestra.connection:Error authenticating with smithi039.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-13T20:12:16.518 WARNING:teuthology.provision.fog.smithi019:[Errno None] Unable to connect to port 22 on 172.21.15.19
2023-12-13T20:12:20.303 ERROR:teuthology.orchestra.connection:Error authenticating with smithi039.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-13T20:12:22.520 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T20:12:22.754 WARNING:teuthology.provision.fog.smithi019:[Errno None] Unable to connect to port 22 on 172.21.15.19
2023-12-13T20:12:28.756 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T20:12:30.385 ERROR:teuthology.orchestra.connection:Error authenticating with smithi039.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-13T20:12:31.814 WARNING:teuthology.provision.fog.smithi019:[Errno None] Unable to connect to port 22 on 172.21.15.19
2023-12-13T20:12:37.815 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T20:12:40.866 WARNING:teuthology.provision.fog.smithi019:[Errno None] Unable to connect to port 22 on 172.21.15.19
2023-12-13T20:12:46.867 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T20:12:47.078 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-13T20:12:47.078 DEBUG:teuthology.orchestra.run.smithi019:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-13T20:12:47.648 INFO:teuthology.provision.fog.smithi019:Node is ready
2023-12-13T20:12:47.649 DEBUG:teuthology.orchestra.run.smithi019:> hostname
2023-12-13T20:12:47.654 INFO:teuthology.orchestra.run.smithi019.stdout:smithi019.front.sepia.ceph.com
2023-12-13T20:12:47.655 DEBUG:teuthology.orchestra.run.smithi019:> grep smithi019.front.sepia.ceph.com /etc/hosts
2023-12-13T20:12:47.661 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19 smithi019.front.sepia.ceph.com smithi019
2023-12-13T20:12:47.661 DEBUG:teuthology.orchestra.run.smithi019:> sudo hostname smithi019
2023-12-13T20:12:47.753 DEBUG:teuthology.orchestra.run.smithi019:> sudo sed -i -e 's/smithi019.front.sepia.ceph.com/smithi019/g' /etc/hosts
2023-12-13T20:12:47.767 DEBUG:teuthology.orchestra.run.smithi019:> sudo sed -i -e 's/172.21.15.19/172.21.15.19/g' /etc/hosts
2023-12-13T20:12:47.782 DEBUG:teuthology.orchestra.run.smithi019:> sudo sed -i -e 's/smithi019.front.sepia.ceph.com/smithi019/g' /etc/hostname
2023-12-13T20:12:47.793 DEBUG:teuthology.orchestra.run.smithi019:> sudo hostname smithi019
2023-12-13T20:12:47.849 DEBUG:teuthology.orchestra.run.smithi019:> cat /etc/os-release
2023-12-13T20:12:47.854 INFO:teuthology.orchestra.run.smithi019.stdout:NAME="Ubuntu"
2023-12-13T20:12:47.855 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION="20.04.4 LTS (Focal Fossa)"
2023-12-13T20:12:47.855 INFO:teuthology.orchestra.run.smithi019.stdout:ID=ubuntu
2023-12-13T20:12:47.855 INFO:teuthology.orchestra.run.smithi019.stdout:ID_LIKE=debian
2023-12-13T20:12:47.855 INFO:teuthology.orchestra.run.smithi019.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS"
2023-12-13T20:12:47.855 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION_ID="20.04"
2023-12-13T20:12:47.855 INFO:teuthology.orchestra.run.smithi019.stdout:HOME_URL="https://www.ubuntu.com/"
2023-12-13T20:12:47.855 INFO:teuthology.orchestra.run.smithi019.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-12-13T20:12:47.855 INFO:teuthology.orchestra.run.smithi019.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-12-13T20:12:47.855 INFO:teuthology.orchestra.run.smithi019.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-12-13T20:12:47.855 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION_CODENAME=focal
2023-12-13T20:12:47.855 INFO:teuthology.orchestra.run.smithi019.stdout:UBUNTU_CODENAME=focal
2023-12-13T20:12:47.857 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/dispatcher/supervisor.py", line 232, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/provision/fog.py", line 347, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi019's OS to be centos 8 but found ubuntu 20.04
2023-12-13T20:12:47.859 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-13T20:12:47.996 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=066f39475d3948bea40cb6e6fc73abed
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/dispatcher/supervisor.py", line 232, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/provision/fog.py", line 347, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi019's OS to be centos 8 but found ubuntu 20.04
2023-12-13T20:12:47.998 INFO:teuthology.nuke:Checking targets against current locks
2023-12-13T20:12:48.060 DEBUG:teuthology.nuke:shortname: smithi019
2023-12-13T20:12:48.061 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-13T20:12:48.089 DEBUG:teuthology.nuke:shortname: smithi039
2023-12-13T20:12:48.090 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-13T20:12:48.095 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi019.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-13_18:37:52-rbd-wip-yuri4-testing-2023-12-13-0748-quincy-distro-default-smithi/7490382', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-13 20:07:19.464357', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}
2023-12-13T20:12:48.117 DEBUG:teuthology.nuke:shortname: smithi195
2023-12-13T20:12:48.117 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-13T20:12:48.121 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi039.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-13_18:37:52-rbd-wip-yuri4-testing-2023-12-13-0748-quincy-distro-default-smithi/7490383', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-13 20:09:22.037406', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPAr+ppYNQJ4IfU1UsJUIUxJ/E2u7VpKgOJMhCTRceE/jqRfsOA2MkWCkxy4wCSi42IK8qBg1BD5gppxsJwKhsY='}
2023-12-13T20:12:48.141 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi195.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-13_18:37:52-rbd-wip-yuri4-testing-2023-12-13-0748-quincy-distro-default-smithi/7490381', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-13 20:07:19.051694', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC5ZdY66av9707vQld0jHxcx2RIeK7kpSpEnZse6YdxMqIIj6BTWPuwai62rgkQgemkLg0Me3X2WVIf29TaPyOo='}
2023-12-13T20:12:48.154 INFO:teuthology.orchestra.console.smithi019:Power off
2023-12-13T20:12:48.155 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-13T20:12:48.173 INFO:teuthology.orchestra.console.smithi039:Power off
2023-12-13T20:12:48.174 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-13T20:12:48.185 DEBUG:teuthology.orchestra.console.smithi019:power off output: Chassis Power Control: Down/Off
2023-12-13T20:12:48.185 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T20:12:48.198 DEBUG:teuthology.orchestra.console.smithi039:power off output: Chassis Power Control: Down/Off
2023-12-13T20:12:48.199 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T20:12:48.214 INFO:teuthology.orchestra.console.smithi195:Power off
2023-12-13T20:12:48.215 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-13T20:12:48.225 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is on
2023-12-13T20:12:48.225 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is on
2023-12-13T20:12:48.239 DEBUG:teuthology.orchestra.console.smithi195:power off output: Chassis Power Control: Down/Off
2023-12-13T20:12:48.239 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T20:12:48.262 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on
2023-12-13T20:12:52.226 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T20:12:52.234 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T20:12:52.263 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T20:12:52.337 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is on
2023-12-13T20:12:52.343 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is on
2023-12-13T20:12:52.373 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on
2023-12-13T20:12:56.338 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T20:12:56.346 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T20:12:56.374 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T20:12:56.448 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is on
2023-12-13T20:12:56.456 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is off
2023-12-13T20:12:56.483 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off
2023-12-13T20:12:56.557 INFO:teuthology.orchestra.console.smithi019:Power off completed
2023-12-13T20:12:56.584 INFO:teuthology.orchestra.console.smithi195:Power off completed
2023-12-13T20:12:56.717 INFO:teuthology.lock.ops:unlocked: smithi019.front.sepia.ceph.com
2023-12-13T20:12:56.735 INFO:teuthology.lock.ops:unlocked: smithi195.front.sepia.ceph.com
2023-12-13T20:13:00.449 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T20:13:00.560 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is off
2023-12-13T20:13:00.662 INFO:teuthology.orchestra.console.smithi039:Power off completed
2023-12-13T20:13:00.817 INFO:teuthology.lock.ops:unlocked: smithi039.front.sepia.ceph.com
2023-12-13T20:13:01.181 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology-dispatcher", line 8, in <module>
    sys.exit(main())
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/scripts/dispatcher.py", line 35, in main
    sys.exit(teuthology.dispatcher.main(args))
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/dispatcher/__init__.py", line 69, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/dispatcher/supervisor.py", line 58, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/dispatcher/supervisor.py", line 232, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/provision/fog.py", line 347, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi019's OS to be centos 8 but found ubuntu 20.04