2023-11-06T03:51:02.004 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2
2023-11-06T03:51:02.005 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-06T03:51:02.138 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f313dad5b50>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f313e5da670>, signals=[15])
2023-11-06T03:51:02.140 INFO:teuthology.lock.ops:Start node 'smithi073.front.sepia.ceph.com' reimaging
2023-11-06T03:51:02.140 INFO:teuthology.lock.ops:Updating [smithi073.front.sepia.ceph.com]: reset os type and version on server
2023-11-06T03:51:02.140 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server
2023-11-06T03:51:02.159 INFO:teuthology.lock.ops:Start node 'smithi152.front.sepia.ceph.com' reimaging
2023-11-06T03:51:02.159 INFO:teuthology.lock.ops:Updating [smithi152.front.sepia.ceph.com]: reset os type and version on server
2023-11-06T03:51:02.160 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server
2023-11-06T03:51:02.161 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /host {"name": "smithi073"}
2023-11-06T03:51:02.184 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /host {"name": "smithi152"}
2023-11-06T03:51:02.236 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-11-06T03:51:02.242 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-11-06T03:51:02.275 DEBUG:teuthology.provision.fog.smithi073:Requesting image smithi_centos_8.stream (ID 3)
2023-11-06T03:51:02.276 DEBUG:teuthology.provision.fog.smithi073:FOG request: PUT /host/178 {"imageID": 3}
2023-11-06T03:51:02.281 DEBUG:teuthology.provision.fog.smithi152:Requesting image smithi_centos_8.stream (ID 3)
2023-11-06T03:51:02.282 DEBUG:teuthology.provision.fog.smithi152:FOG request: PUT /host/257 {"imageID": 3}
2023-11-06T03:51:02.319 INFO:teuthology.provision.fog.smithi073:Scheduling deploy of centos 8.stream
2023-11-06T03:51:02.319 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None
2023-11-06T03:51:02.322 INFO:teuthology.provision.fog.smithi152:Scheduling deploy of centos 8.stream
2023-11-06T03:51:02.323 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None
2023-11-06T03:51:02.392 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /tasktype {"name": "deploy"}
2023-11-06T03:51:02.394 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /tasktype {"name": "deploy"}
2023-11-06T03:51:02.428 DEBUG:teuthology.provision.fog.smithi152:FOG request: POST /host/257/task {"taskTypeID": 1}
2023-11-06T03:51:02.431 DEBUG:teuthology.provision.fog.smithi073:FOG request: POST /host/178/task {"taskTypeID": 1}
2023-11-06T03:51:02.482 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None
2023-11-06T03:51:02.498 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None
2023-11-06T03:51:02.582 INFO:teuthology.orchestra.console.smithi152:Power off
2023-11-06T03:51:02.583 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-06T03:51:02.603 INFO:teuthology.orchestra.console.smithi073:Power off
2023-11-06T03:51:02.604 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-06T03:51:02.611 DEBUG:teuthology.orchestra.console.smithi152:power off output: Chassis Power Control: Down/Off
2023-11-06T03:51:02.612 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-06T03:51:02.624 DEBUG:teuthology.orchestra.console.smithi073:power off output: Chassis Power Control: Down/Off
2023-11-06T03:51:02.625 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-06T03:51:02.632 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on
2023-11-06T03:51:02.647 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on
2023-11-06T03:51:06.638 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-06T03:51:06.648 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-06T03:51:06.747 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on
2023-11-06T03:51:06.758 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on
2023-11-06T03:51:10.750 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-06T03:51:10.760 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-06T03:51:10.860 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off
2023-11-06T03:51:10.869 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is off
2023-11-06T03:51:10.962 INFO:teuthology.orchestra.console.smithi152:Power off completed
2023-11-06T03:51:10.970 INFO:teuthology.orchestra.console.smithi073:Power off completed
2023-11-06T03:51:11.063 INFO:teuthology.orchestra.console.smithi152:Power on
2023-11-06T03:51:11.064 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-06T03:51:11.071 INFO:teuthology.orchestra.console.smithi073:Power on
2023-11-06T03:51:11.072 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-06T03:51:11.085 DEBUG:teuthology.orchestra.console.smithi152:power on output: Chassis Power Control: Up/On
2023-11-06T03:51:11.085 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-06T03:51:11.094 DEBUG:teuthology.orchestra.console.smithi073:power on output: Chassis Power Control: Up/On
2023-11-06T03:51:11.094 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-06T03:51:11.106 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off
2023-11-06T03:51:11.114 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is off
2023-11-06T03:51:15.110 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-06T03:51:15.117 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-06T03:51:15.219 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off
2023-11-06T03:51:15.226 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is off
2023-11-06T03:51:19.223 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-06T03:51:19.229 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-06T03:51:19.331 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on
2023-11-06T03:51:19.374 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on
2023-11-06T03:51:19.433 INFO:teuthology.orchestra.console.smithi152:Power on completed
2023-11-06T03:51:19.476 INFO:teuthology.orchestra.console.smithi073:Power on completed
2023-11-06T03:51:19.535 INFO:teuthology.provision.fog.smithi152:Waiting for deploy to finish
2023-11-06T03:51:19.535 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None
2023-11-06T03:51:19.577 INFO:teuthology.provision.fog.smithi073:Waiting for deploy to finish
2023-11-06T03:51:19.578 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None
2023-11-06T03:51:34.630 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None
2023-11-06T03:51:34.657 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None
2023-11-06T03:51:34.722 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T03:51:49.750 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None
2023-11-06T03:51:53.210 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152
2023-11-06T03:51:59.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T03:52:02.266 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152
2023-11-06T03:52:04.833 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None
2023-11-06T03:52:08.270 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T03:52:11.322 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152
2023-11-06T03:52:17.326 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T03:52:19.922 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None
2023-11-06T03:52:20.378 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152
2023-11-06T03:52:26.385 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T03:52:29.470 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152
2023-11-06T03:52:34.995 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None
2023-11-06T03:52:35.472 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T03:52:38.526 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152
2023-11-06T03:52:44.531 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T03:52:47.610 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152
2023-11-06T03:52:50.066 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None
2023-11-06T03:52:53.614 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T03:53:05.154 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None
2023-11-06T03:53:12.062 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152
2023-11-06T03:53:18.067 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T03:53:20.250 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None
2023-11-06T03:53:21.150 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152
2023-11-06T03:53:27.157 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T03:53:27.276 ERROR:teuthology.orchestra.connection:Error authenticating with smithi152.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-11-06T03:53:31.396 ERROR:teuthology.orchestra.connection:Error authenticating with smithi152.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-11-06T03:53:35.324 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None
2023-11-06T03:53:38.476 ERROR:teuthology.orchestra.connection:Error authenticating with smithi152.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-11-06T03:53:48.558 ERROR:teuthology.orchestra.connection:Error authenticating with smithi152.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-11-06T03:53:50.407 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None
2023-11-06T03:54:01.638 ERROR:teuthology.orchestra.connection:Error authenticating with smithi152.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-11-06T03:54:05.490 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None
2023-11-06T03:54:05.558 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T03:54:17.718 ERROR:teuthology.orchestra.connection:Error authenticating with smithi152.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-11-06T03:54:23.994 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73
2023-11-06T03:54:29.996 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T03:54:33.050 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73
2023-11-06T03:54:36.840 ERROR:teuthology.orchestra.connection:Error authenticating with smithi152.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-11-06T03:54:39.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T03:54:42.106 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73
2023-11-06T03:54:48.107 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T03:54:51.162 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73
2023-11-06T03:54:57.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T03:55:15.706 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73
2023-11-06T03:55:21.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T03:55:24.766 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73
2023-11-06T03:55:30.767 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T03:55:30.814 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152
2023-11-06T03:55:32.952 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-06T03:55:32.953 DEBUG:teuthology.orchestra.run.smithi073:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-06T03:55:36.815 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T03:55:39.870 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152
2023-11-06T03:55:45.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T03:55:48.922 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152
2023-11-06T03:55:54.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T03:55:57.948 INFO:teuthology.provision.fog.smithi073:Node is ready
2023-11-06T03:55:57.949 DEBUG:teuthology.orchestra.run.smithi073:> hostname
2023-11-06T03:55:57.972 INFO:teuthology.orchestra.run.smithi073.stdout:smithi073.front.sepia.ceph.com
2023-11-06T03:55:57.973 DEBUG:teuthology.orchestra.run.smithi073:> grep smithi073.front.sepia.ceph.com /etc/hosts
2023-11-06T03:55:57.978 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152
2023-11-06T03:55:58.033 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73 smithi073.front.sepia.ceph.com smithi073
2023-11-06T03:55:58.034 DEBUG:teuthology.orchestra.run.smithi073:> sudo hostname smithi073
2023-11-06T03:55:58.159 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i -e 's/smithi073.front.sepia.ceph.com/smithi073/g' /etc/hosts
2023-11-06T03:55:58.190 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i -e 's/172.21.15.73/172.21.15.73/g' /etc/hosts
2023-11-06T03:55:58.259 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i -e 's/smithi073.front.sepia.ceph.com/smithi073/g' /etc/hostname
2023-11-06T03:55:58.329 DEBUG:teuthology.orchestra.run.smithi073:> sudo hostname smithi073
2023-11-06T03:55:58.396 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release
2023-11-06T03:55:58.454 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="CentOS Stream"
2023-11-06T03:55:58.454 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="8"
2023-11-06T03:55:58.454 INFO:teuthology.orchestra.run.smithi073.stdout:ID="centos"
2023-11-06T03:55:58.455 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="rhel fedora"
2023-11-06T03:55:58.455 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="8"
2023-11-06T03:55:58.455 INFO:teuthology.orchestra.run.smithi073.stdout:PLATFORM_ID="platform:el8"
2023-11-06T03:55:58.455 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="CentOS Stream 8"
2023-11-06T03:55:58.455 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31"
2023-11-06T03:55:58.455 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-11-06T03:55:58.456 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://centos.org/"
2023-11-06T03:55:58.456 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-06T03:55:58.456 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-06T03:55:58.456 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-06T03:55:58.457 INFO:teuthology.provision.fog.smithi073:Deploy complete!
2023-11-06T03:55:58.458 DEBUG:teuthology.parallel:result is None
2023-11-06T03:56:03.979 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T03:57:03.982 WARNING:teuthology.provision.fog.smithi152:timed out
2023-11-06T03:57:09.984 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T03:57:10.261 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-06T03:57:10.262 DEBUG:teuthology.orchestra.run.smithi152:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-06T03:57:10.702 INFO:teuthology.provision.fog.smithi152:Node is ready
2023-11-06T03:57:10.703 DEBUG:teuthology.orchestra.run.smithi152:> hostname
2023-11-06T03:57:10.753 INFO:teuthology.orchestra.run.smithi152.stdout:smithi152.front.sepia.ceph.com
2023-11-06T03:57:10.753 DEBUG:teuthology.orchestra.run.smithi152:> grep smithi152.front.sepia.ceph.com /etc/hosts
2023-11-06T03:57:10.805 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152 smithi152.front.sepia.ceph.com smithi152
2023-11-06T03:57:10.806 DEBUG:teuthology.orchestra.run.smithi152:> sudo hostname smithi152
2023-11-06T03:57:10.957 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/smithi152.front.sepia.ceph.com/smithi152/g' /etc/hosts
2023-11-06T03:57:10.971 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/172.21.15.152/172.21.15.152/g' /etc/hosts
2023-11-06T03:57:11.024 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/smithi152.front.sepia.ceph.com/smithi152/g' /etc/hostname
2023-11-06T03:57:11.075 DEBUG:teuthology.orchestra.run.smithi152:> sudo hostname smithi152
2023-11-06T03:57:11.130 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release
2023-11-06T03:57:11.177 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-11-06T03:57:11.177 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="Ubuntu"
2023-11-06T03:57:11.177 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="22.04"
2023-11-06T03:57:11.177 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-11-06T03:57:11.178 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_CODENAME=jammy
2023-11-06T03:57:11.178 INFO:teuthology.orchestra.run.smithi152.stdout:ID=ubuntu
2023-11-06T03:57:11.178 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE=debian
2023-11-06T03:57:11.178 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://www.ubuntu.com/"
2023-11-06T03:57:11.178 INFO:teuthology.orchestra.run.smithi152.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-11-06T03:57:11.179 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-11-06T03:57:11.179 INFO:teuthology.orchestra.run.smithi152.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-11-06T03:57:11.179 INFO:teuthology.orchestra.run.smithi152.stdout:UBUNTU_CODENAME=jammy
2023-11-06T03:57:11.180 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/dispatcher/supervisor.py", line 228, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/provision/fog.py", line 348, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi152's OS to be centos 8 but found ubuntu 22.04
2023-11-06T03:57:11.181 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-06T03:57:11.400 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=d8f66a624d554da3b01b1f3be3e472d1
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/dispatcher/supervisor.py", line 228, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/provision/fog.py", line 348, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi152's OS to be centos 8 but found ubuntu 22.04
2023-11-06T03:57:11.402 INFO:teuthology.nuke:Checking targets against current locks
2023-11-06T03:57:11.476 DEBUG:teuthology.nuke:shortname: smithi073
2023-11-06T03:57:11.477 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-06T03:57:11.506 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi073.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-05_23:48:16-rbd-reef-release-distro-default-smithi/7448808', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-06 03:51:01.149362', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}
2023-11-06T03:57:11.511 DEBUG:teuthology.nuke:shortname: smithi152
2023-11-06T03:57:11.511 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-06T03:57:11.538 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi152.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-05_23:48:16-rbd-reef-release-distro-default-smithi/7448809', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-06 03:51:21.563189', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJIQPOr0JDdCC/UlRUrVE0LNJ9AdV2NqkoFwl8ys8Op0fk2MKGNMEcBHkGZ6/AdI9v78DzzMSoF8V3H34PYgZRM='}
2023-11-06T03:57:11.567 INFO:teuthology.orchestra.console.smithi073:Power off
2023-11-06T03:57:11.568 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-06T03:57:11.590 DEBUG:teuthology.orchestra.console.smithi073:power off output: Chassis Power Control: Down/Off
2023-11-06T03:57:11.591 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-06T03:57:11.604 INFO:teuthology.orchestra.console.smithi152:Power off
2023-11-06T03:57:11.605 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-06T03:57:11.613 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on
2023-11-06T03:57:11.626 DEBUG:teuthology.orchestra.console.smithi152:power off output: Chassis Power Control: Down/Off
2023-11-06T03:57:11.626 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-06T03:57:11.647 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on
2023-11-06T03:57:15.614 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-06T03:57:15.648 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-06T03:57:15.724 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on
2023-11-06T03:57:15.756 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on
2023-11-06T03:57:19.726 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-06T03:57:19.757 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-06T03:57:19.835 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is off
2023-11-06T03:57:19.866 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on
2023-11-06T03:57:19.936 INFO:teuthology.orchestra.console.smithi073:Power off completed
2023-11-06T03:57:20.100 INFO:teuthology.lock.ops:unlocked: smithi073.front.sepia.ceph.com
2023-11-06T03:57:23.868 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-06T03:57:23.978 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off
2023-11-06T03:57:24.079 INFO:teuthology.orchestra.console.smithi152:Power off completed
2023-11-06T03:57:24.229 INFO:teuthology.lock.ops:unlocked: smithi152.front.sepia.ceph.com
2023-11-06T03:57:24.444 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology-dispatcher", line 8, in <module>
    sys.exit(main())
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/scripts/dispatcher.py", line 35, in main
    sys.exit(teuthology.dispatcher.main(args))
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/dispatcher/__init__.py", line 69, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/dispatcher/supervisor.py", line 58, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/dispatcher/supervisor.py", line 228, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/provision/fog.py", line 348, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi152's OS to be centos 8 but found ubuntu 22.04