2023-07-15T22:46:54.312 INFO:root:teuthology version: 0.0.1.dev147+gff9991b 2023-07-15T22:46:54.314 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-15T22:46:54.315 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-15T22:46:54.545 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f26764da820>, signals=[15]) 2023-07-15T22:46:54.547 INFO:teuthology.lock.ops:Start node 'smithi138.front.sepia.ceph.com' reimaging 2023-07-15T22:46:54.547 INFO:teuthology.lock.ops:Updating [smithi138.front.sepia.ceph.com]: reset os type and version on server 2023-07-15T22:46:54.547 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server 2023-07-15T22:46:54.572 INFO:teuthology.lock.ops:Start node 'smithi152.front.sepia.ceph.com' reimaging 2023-07-15T22:46:54.572 INFO:teuthology.lock.ops:Updating [smithi152.front.sepia.ceph.com]: reset os type and version on server 2023-07-15T22:46:54.573 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server 2023-07-15T22:46:54.575 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /host {"name": "smithi138"} 2023-07-15T22:47:03.177 INFO:teuthology.lock.ops:Start node 'smithi178.front.sepia.ceph.com' reimaging 2023-07-15T22:47:03.177 INFO:teuthology.lock.ops:Updating [smithi178.front.sepia.ceph.com]: reset os type and version on server 2023-07-15T22:47:03.178 INFO:teuthology.lock.ops:Updating smithi178.front.sepia.ceph.com on lock server 2023-07-15T22:47:03.179 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /host {"name": "smithi152"} 2023-07-15T22:47:08.217 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-07-15T22:47:08.227 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /host {"name": "smithi178"} 2023-07-15T22:47:08.257 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-07-15T22:47:08.270 DEBUG:teuthology.provision.fog.smithi138:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-07-15T22:47:08.270 DEBUG:teuthology.provision.fog.smithi138:FOG request: PUT /host/243 {"imageID": 2} 2023-07-15T22:47:08.297 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-07-15T22:47:08.316 DEBUG:teuthology.provision.fog.smithi152:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-07-15T22:47:08.316 DEBUG:teuthology.provision.fog.smithi152:FOG request: PUT /host/257 {"imageID": 2} 2023-07-15T22:47:08.365 INFO:teuthology.provision.fog.smithi138:Scheduling deploy of ubuntu 20.04 2023-07-15T22:47:08.365 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None 2023-07-15T22:47:08.416 INFO:teuthology.provision.fog.smithi152:Scheduling deploy of ubuntu 20.04 2023-07-15T22:47:08.417 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-07-15T22:47:13.424 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /tasktype {"name": "deploy"} 2023-07-15T22:47:13.426 DEBUG:teuthology.provision.fog.smithi178:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-07-15T22:47:13.426 DEBUG:teuthology.provision.fog.smithi178:FOG request: PUT /host/283 {"imageID": 2} 2023-07-15T22:47:18.512 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /tasktype {"name": "deploy"} 2023-07-15T22:47:23.518 INFO:teuthology.provision.fog.smithi178:Scheduling deploy of ubuntu 20.04 2023-07-15T22:47:23.518 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-07-15T22:47:23.519 DEBUG:teuthology.provision.fog.smithi138:FOG request: POST /host/243/task {"taskTypeID": 1} 2023-07-15T22:47:28.581 DEBUG:teuthology.provision.fog.smithi152:FOG request: POST /host/257/task {"taskTypeID": 1} 2023-07-15T22:47:28.612 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /tasktype {"name": "deploy"} 2023-07-15T22:47:33.618 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-07-15T22:47:33.619 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None 2023-07-15T22:47:33.686 DEBUG:teuthology.provision.fog.smithi178:FOG request: POST /host/283/task {"taskTypeID": 1} 2023-07-15T22:47:38.746 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-07-15T22:47:43.715 INFO:teuthology.orchestra.console:Power off smithi138 2023-07-15T22:47:43.717 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-15T22:47:43.733 INFO:teuthology.orchestra.console:Power off smithi152 2023-07-15T22:47:43.733 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-15T22:47:53.749 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T22:47:53.757 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T22:47:53.778 INFO:teuthology.orchestra.console:Power off smithi178 2023-07-15T22:47:53.779 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-15T22:47:57.793 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T22:47:58.768 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T22:47:58.803 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T22:48:02.904 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T22:48:03.814 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T22:48:03.881 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T22:48:08.019 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T22:48:08.924 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T22:48:08.992 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T22:48:09.203 INFO:teuthology.orchestra.console:Power off for smithi152 completed 2023-07-15T22:48:09.305 INFO:teuthology.orchestra.console:Power on smithi152 2023-07-15T22:48:09.305 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-15T22:48:09.326 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T22:48:13.129 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T22:48:13.339 INFO:teuthology.orchestra.console:Power off for smithi138 completed 2023-07-15T22:48:13.347 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T22:48:13.440 INFO:teuthology.orchestra.console:Power on smithi138 2023-07-15T22:48:13.441 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-15T22:48:13.464 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T22:48:14.036 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T22:48:17.460 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T22:48:17.490 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T22:48:19.146 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T22:48:21.600 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T22:48:21.811 INFO:teuthology.orchestra.console:Power on for smithi138 completed 2023-07-15T22:48:21.912 INFO:teuthology.provision.fog.smithi138:Waiting for deploy to finish 2023-07-15T22:48:21.913 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None 2023-07-15T22:48:24.361 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T22:48:24.368 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T22:48:24.449 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T22:48:29.557 INFO:teuthology.orchestra.console:Power off for smithi178 completed 2023-07-15T22:48:29.658 INFO:teuthology.orchestra.console:Power on smithi178 2023-07-15T22:48:29.659 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-15T22:48:32.528 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2023-07-15T22:48:34.458 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T22:48:34.683 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T22:48:38.533 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T22:48:43.538 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T22:48:43.547 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T22:48:46.608 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2023-07-15T22:48:48.651 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T22:48:48.658 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T22:48:52.613 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T22:48:57.617 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T22:48:57.625 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T22:48:58.731 INFO:teuthology.orchestra.console:Power on for smithi178 completed 2023-07-15T22:48:58.832 INFO:teuthology.provision.fog.smithi178:Waiting for deploy to finish 2023-07-15T22:48:58.833 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-07-15T22:48:58.939 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T22:49:00.692 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2023-07-15T22:49:02.000 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-07-15T22:49:02.727 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T22:49:06.697 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T22:49:11.702 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T22:49:11.711 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T22:49:16.718 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2023-07-15T22:49:19.792 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-07-15T22:49:21.720 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T22:49:22.720 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T22:49:27.726 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T22:49:32.733 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2023-07-15T22:49:35.792 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-07-15T22:49:36.735 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T22:49:36.946 INFO:teuthology.orchestra.console:Power on for smithi152 completed 2023-07-15T22:49:37.047 INFO:teuthology.provision.fog.smithi152:Waiting for deploy to finish 2023-07-15T22:49:37.047 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-07-15T22:49:42.055 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T22:49:47.061 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T22:49:52.112 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T22:49:55.120 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-07-15T22:49:55.184 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-07-15T22:50:01.127 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T22:50:06.133 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T22:50:11.509 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-15T22:50:11.510 DEBUG:teuthology.orchestra.run.smithi152:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-15T22:50:12.574 INFO:teuthology.provision.fog.smithi152:Node is ready 2023-07-15T22:50:12.574 DEBUG:teuthology.orchestra.run.smithi152:> hostname 2023-07-15T22:50:12.580 INFO:teuthology.orchestra.run.smithi152.stdout:smithi152.front.sepia.ceph.com 2023-07-15T22:50:12.580 DEBUG:teuthology.orchestra.run.smithi152:> grep smithi152.front.sepia.ceph.com /etc/hosts 2023-07-15T22:50:12.587 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152 smithi152.front.sepia.ceph.com smithi152 2023-07-15T22:50:12.587 DEBUG:teuthology.orchestra.run.smithi152:> sudo hostname smithi152 2023-07-15T22:50:13.094 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/smithi152.front.sepia.ceph.com/smithi152/g' /etc/hosts 2023-07-15T22:50:13.111 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/172.21.15.152/172.21.15.152/g' /etc/hosts 2023-07-15T22:50:13.127 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/smithi152.front.sepia.ceph.com/smithi152/g' /etc/hostname 2023-07-15T22:50:13.186 DEBUG:teuthology.orchestra.run.smithi152:> sudo hostname smithi152 2023-07-15T22:50:13.197 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release 2023-07-15T22:50:13.201 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="Ubuntu" 2023-07-15T22:50:13.201 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-15T22:50:13.201 INFO:teuthology.orchestra.run.smithi152.stdout:ID=ubuntu 2023-07-15T22:50:13.201 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE=debian 2023-07-15T22:50:13.201 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-15T22:50:13.202 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="20.04" 2023-07-15T22:50:13.202 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-15T22:50:13.202 INFO:teuthology.orchestra.run.smithi152.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-15T22:50:13.202 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-15T22:50:13.202 INFO:teuthology.orchestra.run.smithi152.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-15T22:50:13.202 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_CODENAME=focal 2023-07-15T22:50:13.202 INFO:teuthology.orchestra.run.smithi152.stdout:UBUNTU_CODENAME=focal 2023-07-15T22:50:13.203 INFO:teuthology.provision.fog.smithi152:Deploy complete! 2023-07-15T22:50:13.204 DEBUG:teuthology.parallel:result is None 2023-07-15T22:50:18.946 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-15T22:50:18.947 DEBUG:teuthology.orchestra.run.smithi138:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-15T22:50:19.210 INFO:teuthology.provision.fog.smithi138:Node is ready 2023-07-15T22:50:19.210 DEBUG:teuthology.orchestra.run.smithi138:> hostname 2023-07-15T22:50:19.228 INFO:teuthology.orchestra.run.smithi138.stdout:smithi138.front.sepia.ceph.com 2023-07-15T22:50:19.229 DEBUG:teuthology.orchestra.run.smithi138:> grep smithi138.front.sepia.ceph.com /etc/hosts 2023-07-15T22:50:19.287 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138 smithi138.front.sepia.ceph.com smithi138 2023-07-15T22:50:19.287 DEBUG:teuthology.orchestra.run.smithi138:> sudo hostname smithi138 2023-07-15T22:50:19.415 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i -e 's/smithi138.front.sepia.ceph.com/smithi138/g' /etc/hosts 2023-07-15T22:50:19.443 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i -e 's/172.21.15.138/172.21.15.138/g' /etc/hosts 2023-07-15T22:50:19.511 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i -e 's/smithi138.front.sepia.ceph.com/smithi138/g' /etc/hostname 2023-07-15T22:50:19.582 DEBUG:teuthology.orchestra.run.smithi138:> sudo hostname smithi138 2023-07-15T22:50:19.648 DEBUG:teuthology.orchestra.run.smithi138:> cat /etc/os-release 2023-07-15T22:50:19.706 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="Red Hat Enterprise Linux" 2023-07-15T22:50:19.706 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="8.6 (Ootpa)" 2023-07-15T22:50:19.706 INFO:teuthology.orchestra.run.smithi138.stdout:ID="rhel" 2023-07-15T22:50:19.706 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE="fedora" 2023-07-15T22:50:19.707 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="8.6" 2023-07-15T22:50:19.707 INFO:teuthology.orchestra.run.smithi138.stdout:PLATFORM_ID="platform:el8" 2023-07-15T22:50:19.707 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-15T22:50:19.707 INFO:teuthology.orchestra.run.smithi138.stdout:ANSI_COLOR="0;31" 2023-07-15T22:50:19.707 INFO:teuthology.orchestra.run.smithi138.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-15T22:50:19.707 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://www.redhat.com/" 2023-07-15T22:50:19.707 INFO:teuthology.orchestra.run.smithi138.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-15T22:50:19.708 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-15T22:50:19.708 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-07-15T22:50:19.708 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-15T22:50:19.708 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-15T22:50:19.708 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-15T22:50:19.708 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-15T22:50:19.711 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/fog.py", line 348, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi138's OS to be ubuntu 20.04 but found rhel 8.6 2023-07-15T22:50:19.711 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-15T22:50:19.712 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-15T22:50:24.715 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-07-15T22:50:24.797 INFO:teuthology.nuke:Checking targets against current locks 2023-07-15T22:50:25.797 DEBUG:teuthology.nuke:shortname: smithi138 2023-07-15T22:50:25.798 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-15T22:50:25.825 DEBUG:teuthology.nuke:shortname: smithi152 2023-07-15T22:50:25.825 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-15T22:50:25.830 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi138.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-14_23:49:32-rbd-reef-distro-default-smithi/7339713', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-15 22:46:53.446920', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-15T22:50:25.853 DEBUG:teuthology.nuke:shortname: smithi178 2023-07-15T22:50:25.853 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-15T22:50:25.856 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi152.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-14_23:49:32-rbd-reef-distro-default-smithi/7339713', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-15 22:46:53.448576', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='} 2023-07-15T22:50:25.881 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi178.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-14_23:49:32-rbd-reef-distro-default-smithi/7339713', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-15 22:46:53.445029', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-15T22:50:25.887 INFO:teuthology.orchestra.console:Power off smithi138 2023-07-15T22:50:25.888 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-15T22:50:25.911 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T22:50:25.931 INFO:teuthology.orchestra.console:Power off smithi152 2023-07-15T22:50:25.932 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-15T22:50:25.954 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T22:50:25.968 INFO:teuthology.orchestra.console:Power off smithi178 2023-07-15T22:50:25.968 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-15T22:50:25.996 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T22:50:29.943 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T22:50:29.979 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T22:50:30.021 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T22:50:30.718 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T22:50:33.776 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-07-15T22:50:35.054 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T22:50:35.089 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T22:50:35.135 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T22:50:39.781 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T22:50:40.165 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T22:50:40.201 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T22:50:40.244 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T22:50:40.413 INFO:teuthology.orchestra.console:Power off for smithi152 completed 2023-07-15T22:50:40.456 INFO:teuthology.orchestra.console:Power off for smithi178 completed 2023-07-15T22:50:45.522 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-07-15T22:50:50.529 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T22:50:51.890 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T22:50:51.919 INFO:teuthology.lock.ops:unlocked: smithi178.front.sepia.ceph.com 2023-07-15T22:50:51.952 INFO:teuthology.lock.ops:unlocked: smithi152.front.sepia.ceph.com 2023-07-15T22:50:54.960 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-07-15T22:50:56.896 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T22:51:00.965 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T22:51:05.969 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T22:51:07.107 INFO:teuthology.orchestra.console:Power off for smithi138 completed 2023-07-15T22:51:12.216 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-07-15T22:51:17.282 INFO:teuthology.lock.ops:unlocked: smithi138.front.sepia.ceph.com 2023-07-15T22:51:20.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T22:51:23.744 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/dispatcher/supervisor.py", line 57, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/fog.py", line 348, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi138's OS to be ubuntu 20.04 but found rhel 8.6