2023-11-16T17:22:14.706 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-16T17:22:14.707 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T17:22:14.837 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f9622c9d670>, signals=[15]) 2023-11-16T17:22:14.838 INFO:teuthology.lock.ops:Start node 'smithi053.front.sepia.ceph.com' reimaging 2023-11-16T17:22:14.838 INFO:teuthology.lock.ops:Updating [smithi053.front.sepia.ceph.com]: reset os type and version on server 2023-11-16T17:22:14.838 INFO:teuthology.lock.ops:Updating smithi053.front.sepia.ceph.com on lock server 2023-11-16T17:22:14.859 INFO:teuthology.lock.ops:Start node 'smithi159.front.sepia.ceph.com' reimaging 2023-11-16T17:22:14.859 INFO:teuthology.lock.ops:Updating [smithi159.front.sepia.ceph.com]: reset os type and version on server 2023-11-16T17:22:14.859 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server 2023-11-16T17:22:14.860 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /host {"name": "smithi053"} 2023-11-16T17:22:14.884 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /host {"name": "smithi159"} 2023-11-16T17:22:14.931 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-11-16T17:22:14.946 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-11-16T17:22:14.976 DEBUG:teuthology.provision.fog.smithi053:Requesting image smithi_centos_8.stream (ID 3) 2023-11-16T17:22:14.976 DEBUG:teuthology.provision.fog.smithi053:FOG request: PUT /host/158 {"imageID": 3} 2023-11-16T17:22:14.990 DEBUG:teuthology.provision.fog.smithi159:Requesting image smithi_centos_8.stream (ID 3) 2023-11-16T17:22:14.990 DEBUG:teuthology.provision.fog.smithi159:FOG request: PUT /host/264 {"imageID": 3} 2023-11-16T17:22:15.026 INFO:teuthology.provision.fog.smithi159:Scheduling deploy of centos 8.stream 2023-11-16T17:22:15.027 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-11-16T17:22:15.029 INFO:teuthology.provision.fog.smithi053:Scheduling deploy of centos 8.stream 2023-11-16T17:22:15.029 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-11-16T17:22:15.104 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /tasktype {"name": "deploy"} 2023-11-16T17:22:15.108 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /tasktype {"name": "deploy"} 2023-11-16T17:22:15.141 DEBUG:teuthology.provision.fog.smithi159:FOG request: POST /host/264/task {"taskTypeID": 1} 2023-11-16T17:22:15.149 DEBUG:teuthology.provision.fog.smithi053:FOG request: POST /host/158/task {"taskTypeID": 1} 2023-11-16T17:22:15.208 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-11-16T17:22:15.210 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-11-16T17:22:15.322 INFO:teuthology.orchestra.console.smithi053:Power off 2023-11-16T17:22:15.322 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-16T17:22:15.334 INFO:teuthology.orchestra.console.smithi159:Power off 2023-11-16T17:22:15.334 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-16T17:22:15.343 DEBUG:teuthology.orchestra.console.smithi053:power off output: Chassis Power Control: Down/Off 2023-11-16T17:22:15.343 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T17:22:15.355 DEBUG:teuthology.orchestra.console.smithi159:power off output: Chassis Power Control: Down/Off 2023-11-16T17:22:15.356 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T17:22:15.365 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is off 2023-11-16T17:22:15.377 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is off 2023-11-16T17:22:15.466 INFO:teuthology.orchestra.console.smithi053:Power off completed 2023-11-16T17:22:15.477 INFO:teuthology.orchestra.console.smithi159:Power off completed 2023-11-16T17:22:15.567 INFO:teuthology.orchestra.console.smithi053:Power on 2023-11-16T17:22:15.567 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-16T17:22:15.578 INFO:teuthology.orchestra.console.smithi159:Power on 2023-11-16T17:22:15.578 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-16T17:22:15.590 DEBUG:teuthology.orchestra.console.smithi053:power on output: Chassis Power Control: Up/On 2023-11-16T17:22:15.590 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T17:22:15.599 DEBUG:teuthology.orchestra.console.smithi159:power on output: Chassis Power Control: Up/On 2023-11-16T17:22:15.599 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T17:22:15.610 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is off 2023-11-16T17:22:15.619 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is off 2023-11-16T17:22:19.615 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T17:22:19.621 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T17:22:19.723 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is on 2023-11-16T17:22:19.763 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is off 2023-11-16T17:22:19.862 INFO:teuthology.orchestra.console.smithi053:Power on completed 2023-11-16T17:22:19.963 INFO:teuthology.provision.fog.smithi053:Waiting for deploy to finish 2023-11-16T17:22:19.963 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-11-16T17:22:23.768 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T17:22:23.876 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is on 2023-11-16T17:22:23.977 INFO:teuthology.orchestra.console.smithi159:Power on completed 2023-11-16T17:22:24.077 INFO:teuthology.provision.fog.smithi159:Waiting for deploy to finish 2023-11-16T17:22:24.077 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-11-16T17:22:35.084 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-11-16T17:22:39.188 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-11-16T17:22:50.196 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-11-16T17:22:54.293 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-11-16T17:23:05.344 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-11-16T17:23:15.658 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-11-16T17:23:20.457 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-11-16T17:23:30.838 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-11-16T17:23:35.572 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-11-16T17:23:45.999 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-11-16T17:23:50.673 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-11-16T17:24:01.194 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-11-16T17:24:05.780 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-11-16T17:24:16.350 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-11-16T17:24:20.920 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-11-16T17:24:31.562 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-11-16T17:24:36.068 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-11-16T17:24:46.774 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-11-16T17:24:51.198 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-11-16T17:24:59.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T17:25:01.905 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-11-16T17:25:17.022 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-11-16T17:25:17.562 WARNING:teuthology.provision.fog.smithi053:[Errno None] Unable to connect to port 22 on 172.21.15.53 2023-11-16T17:25:23.569 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T17:25:26.650 WARNING:teuthology.provision.fog.smithi053:[Errno None] Unable to connect to port 22 on 172.21.15.53 2023-11-16T17:25:32.130 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-11-16T17:25:32.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T17:25:47.237 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-11-16T17:26:02.322 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-11-16T17:26:02.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T17:26:20.795 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-11-16T17:26:26.797 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T17:26:29.855 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-11-16T17:26:32.657 WARNING:teuthology.provision.fog.smithi053:timed out 2023-11-16T17:26:35.861 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T17:26:38.661 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T17:26:38.908 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-16T17:26:38.909 DEBUG:teuthology.orchestra.run.smithi053:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-16T17:26:38.938 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-11-16T17:26:39.150 INFO:teuthology.provision.fog.smithi053:Node is ready 2023-11-16T17:26:39.151 DEBUG:teuthology.orchestra.run.smithi053:> hostname 2023-11-16T17:26:39.170 INFO:teuthology.orchestra.run.smithi053.stdout:smithi053.front.sepia.ceph.com 2023-11-16T17:26:39.170 DEBUG:teuthology.orchestra.run.smithi053:> grep smithi053.front.sepia.ceph.com /etc/hosts 2023-11-16T17:26:39.230 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53 smithi053.front.sepia.ceph.com smithi053 2023-11-16T17:26:39.231 DEBUG:teuthology.orchestra.run.smithi053:> sudo hostname smithi053 2023-11-16T17:26:39.341 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i -e 's/smithi053.front.sepia.ceph.com/smithi053/g' /etc/hosts 2023-11-16T17:26:39.371 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i -e 's/172.21.15.53/172.21.15.53/g' /etc/hosts 2023-11-16T17:26:39.441 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i -e 's/smithi053.front.sepia.ceph.com/smithi053/g' /etc/hostname 2023-11-16T17:26:39.510 DEBUG:teuthology.orchestra.run.smithi053:> sudo hostname smithi053 2023-11-16T17:26:39.578 DEBUG:teuthology.orchestra.run.smithi053:> cat /etc/os-release 2023-11-16T17:26:39.635 INFO:teuthology.orchestra.run.smithi053.stdout:NAME="CentOS Stream" 2023-11-16T17:26:39.635 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION="8" 2023-11-16T17:26:39.636 INFO:teuthology.orchestra.run.smithi053.stdout:ID="centos" 2023-11-16T17:26:39.636 INFO:teuthology.orchestra.run.smithi053.stdout:ID_LIKE="rhel fedora" 2023-11-16T17:26:39.636 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION_ID="8" 2023-11-16T17:26:39.636 INFO:teuthology.orchestra.run.smithi053.stdout:PLATFORM_ID="platform:el8" 2023-11-16T17:26:39.636 INFO:teuthology.orchestra.run.smithi053.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-16T17:26:39.636 INFO:teuthology.orchestra.run.smithi053.stdout:ANSI_COLOR="0;31" 2023-11-16T17:26:39.636 INFO:teuthology.orchestra.run.smithi053.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-16T17:26:39.636 INFO:teuthology.orchestra.run.smithi053.stdout:HOME_URL="https://centos.org/" 2023-11-16T17:26:39.636 INFO:teuthology.orchestra.run.smithi053.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-16T17:26:39.636 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-16T17:26:39.636 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-16T17:26:39.637 INFO:teuthology.provision.fog.smithi053:Deploy complete! 2023-11-16T17:26:39.638 DEBUG:teuthology.parallel:result is None 2023-11-16T17:26:44.941 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T17:26:47.994 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-11-16T17:26:54.001 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T17:27:17.118 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-11-16T17:27:23.122 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T17:27:26.202 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-11-16T17:27:32.206 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T17:27:34.193 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-16T17:27:34.193 DEBUG:teuthology.orchestra.run.smithi159:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-16T17:28:04.393 INFO:teuthology.provision.fog.smithi159:Node is ready 2023-11-16T17:28:04.393 DEBUG:teuthology.orchestra.run.smithi159:> hostname 2023-11-16T17:28:04.417 INFO:teuthology.orchestra.run.smithi159.stdout:smithi159.front.sepia.ceph.com 2023-11-16T17:28:04.418 DEBUG:teuthology.orchestra.run.smithi159:> grep smithi159.front.sepia.ceph.com /etc/hosts 2023-11-16T17:28:04.478 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159 smithi159.front.sepia.ceph.com smithi159 2023-11-16T17:28:04.479 DEBUG:teuthology.orchestra.run.smithi159:> sudo hostname smithi159 2023-11-16T17:28:04.643 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/smithi159.front.sepia.ceph.com/smithi159/g' /etc/hosts 2023-11-16T17:28:04.674 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/172.21.15.159/172.21.15.159/g' /etc/hosts 2023-11-16T17:28:04.744 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/smithi159.front.sepia.ceph.com/smithi159/g' /etc/hostname 2023-11-16T17:28:04.814 DEBUG:teuthology.orchestra.run.smithi159:> sudo hostname smithi159 2023-11-16T17:28:04.882 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release 2023-11-16T17:28:04.941 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="CentOS Stream" 2023-11-16T17:28:04.941 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="8" 2023-11-16T17:28:04.941 INFO:teuthology.orchestra.run.smithi159.stdout:ID="centos" 2023-11-16T17:28:04.941 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE="rhel fedora" 2023-11-16T17:28:04.941 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="8" 2023-11-16T17:28:04.941 INFO:teuthology.orchestra.run.smithi159.stdout:PLATFORM_ID="platform:el8" 2023-11-16T17:28:04.941 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-16T17:28:04.942 INFO:teuthology.orchestra.run.smithi159.stdout:ANSI_COLOR="0;31" 2023-11-16T17:28:04.942 INFO:teuthology.orchestra.run.smithi159.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-16T17:28:04.942 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://centos.org/" 2023-11-16T17:28:04.942 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-16T17:28:04.942 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-16T17:28:04.942 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-16T17:28:04.942 INFO:teuthology.provision.fog.smithi159:Deploy complete! 2023-11-16T17:28:04.943 DEBUG:teuthology.parallel:result is None 2023-11-16T17:28:05.121 INFO:teuthology.lock.ops:Checking smithi053.front.sepia.ceph.com 2023-11-16T17:28:05.122 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-16T17:28:05.144 INFO:teuthology.lock.ops:Checking smithi159.front.sepia.ceph.com 2023-11-16T17:28:05.144 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-16T17:28:05.170 INFO:teuthology.lock.ops:Updating [smithi053.front.sepia.ceph.com]: set os type and version on server 2023-11-16T17:28:05.170 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2023-11-16T17:28:05.171 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T17:28:05.241 DEBUG:teuthology.orchestra.run.smithi053:> true 2023-11-16T17:28:05.378 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi053.front.sepia.ceph.com' 2023-11-16T17:28:05.378 DEBUG:teuthology.orchestra.run.smithi053:> uname -m 2023-11-16T17:28:05.438 INFO:teuthology.orchestra.run.smithi053.stdout:x86_64 2023-11-16T17:28:05.438 DEBUG:teuthology.orchestra.run.smithi053:> cat /etc/os-release 2023-11-16T17:28:05.497 INFO:teuthology.orchestra.run.smithi053.stdout:NAME="CentOS Stream" 2023-11-16T17:28:05.497 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION="8" 2023-11-16T17:28:05.497 INFO:teuthology.orchestra.run.smithi053.stdout:ID="centos" 2023-11-16T17:28:05.497 INFO:teuthology.orchestra.run.smithi053.stdout:ID_LIKE="rhel fedora" 2023-11-16T17:28:05.497 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION_ID="8" 2023-11-16T17:28:05.497 INFO:teuthology.orchestra.run.smithi053.stdout:PLATFORM_ID="platform:el8" 2023-11-16T17:28:05.498 INFO:teuthology.orchestra.run.smithi053.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-16T17:28:05.498 INFO:teuthology.orchestra.run.smithi053.stdout:ANSI_COLOR="0;31" 2023-11-16T17:28:05.498 INFO:teuthology.orchestra.run.smithi053.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-16T17:28:05.498 INFO:teuthology.orchestra.run.smithi053.stdout:HOME_URL="https://centos.org/" 2023-11-16T17:28:05.498 INFO:teuthology.orchestra.run.smithi053.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-16T17:28:05.498 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-16T17:28:05.498 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-16T17:28:05.499 INFO:teuthology.lock.ops:Updating smithi053.front.sepia.ceph.com on lock server 2023-11-16T17:28:05.519 INFO:teuthology.lock.ops:Updating [smithi159.front.sepia.ceph.com]: set os type and version on server 2023-11-16T17:28:05.519 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2023-11-16T17:28:05.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T17:28:05.586 DEBUG:teuthology.orchestra.run.smithi159:> true 2023-11-16T17:28:05.654 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi159.front.sepia.ceph.com' 2023-11-16T17:28:05.654 DEBUG:teuthology.orchestra.run.smithi159:> uname -m 2023-11-16T17:28:05.714 INFO:teuthology.orchestra.run.smithi159.stdout:x86_64 2023-11-16T17:28:05.714 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release 2023-11-16T17:28:05.773 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="CentOS Stream" 2023-11-16T17:28:05.774 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="8" 2023-11-16T17:28:05.774 INFO:teuthology.orchestra.run.smithi159.stdout:ID="centos" 2023-11-16T17:28:05.774 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE="rhel fedora" 2023-11-16T17:28:05.774 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="8" 2023-11-16T17:28:05.774 INFO:teuthology.orchestra.run.smithi159.stdout:PLATFORM_ID="platform:el8" 2023-11-16T17:28:05.775 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-16T17:28:05.775 INFO:teuthology.orchestra.run.smithi159.stdout:ANSI_COLOR="0;31" 2023-11-16T17:28:05.775 INFO:teuthology.orchestra.run.smithi159.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-16T17:28:05.775 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://centos.org/" 2023-11-16T17:28:05.775 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-16T17:28:05.775 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-16T17:28:05.776 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-16T17:28:05.776 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server 2023-11-16T17:28:05.803 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T17:28:05.904 INFO:teuthology.dispatcher.supervisor:Running job 7460935 2023-11-16T17:28:05.905 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_adking@teuthology --archive /home/teuthworker/archive/adking-2023-11-16_17:22:00-orch:cephadm-wip-adk-testing-2023-11-16-0243-distro-default-smithi/7460935 --name adking-2023-11-16_17:22:00-orch:cephadm-wip-adk-testing-2023-11-16-0243-distro-default-smithi --description orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/classic} -- /home/teuthworker/archive/adking-2023-11-16_17:22:00-orch:cephadm-wip-adk-testing-2023-11-16-0243-distro-default-smithi/7460935/orig.config.yaml 2023-11-16T17:28:05.910 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/adking-2023-11-16_17:22:00-orch:cephadm-wip-adk-testing-2023-11-16-0243-distro-default-smithi/7460935 2023-11-16T17:28:05.910 INFO:teuthology.dispatcher.supervisor:Job PID: 958468 2023-11-16T17:28:05.911 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-16T17:30:06.011 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T17:32:06.167 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T17:34:06.342 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T17:36:06.534 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T17:38:06.703 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T17:40:06.874 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T17:42:07.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T17:44:07.184 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T17:46:07.346 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T17:48:07.482 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T17:50:07.643 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T17:52:07.815 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T17:54:07.984 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T17:56:08.080 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T17:58:09.975 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T18:00:10.139 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T18:02:10.295 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T18:04:10.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T18:06:10.631 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T18:08:10.807 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T18:10:11.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T18:12:11.204 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T18:14:11.411 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T18:14:11.548 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-11-16T18:14:12.042 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-16T18:14:12.042 INFO:teuthology.nuke:Checking targets against current locks 2023-11-16T18:14:12.104 DEBUG:teuthology.nuke:shortname: smithi053 2023-11-16T18:14:12.105 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-16T18:14:12.130 DEBUG:teuthology.nuke:shortname: smithi159 2023-11-16T18:14:12.130 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-16T18:14:12.135 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi053.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-11-16_17:22:00-orch:cephadm-wip-adk-testing-2023-11-16-0243-distro-default-smithi/7460935', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-16 17:22:13.925870', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLM6sPNfIFqvDSF4vE2IK0nR9rDrxDpqt5VeQqdZPGkhm4wDNkp+0sNgelJfodt0sbMAKozZF/j4t0H/HfZ+BCU='} 2023-11-16T18:14:12.165 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi159.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-11-16_17:22:00-orch:cephadm-wip-adk-testing-2023-11-16-0243-distro-default-smithi/7460935', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-16 17:22:13.924613', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM8De3HYOv3v+dtopkrFe+REp7xMwgJnZSi4+y/Dopg7KFIQj+fMi06bi5NlANKzGpFr0XBYkjNIuSHePVCHqo4='} 2023-11-16T18:14:12.258 INFO:teuthology.orchestra.console.smithi053:Power off 2023-11-16T18:14:12.259 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-16T18:14:12.377 INFO:teuthology.orchestra.console.smithi159:Power off 2023-11-16T18:14:12.378 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-16T18:14:12.467 DEBUG:teuthology.orchestra.console.smithi053:power off output: Chassis Power Control: Down/Off 2023-11-16T18:14:12.467 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T18:14:12.506 DEBUG:teuthology.orchestra.console.smithi159:power off output: Chassis Power Control: Down/Off 2023-11-16T18:14:12.506 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T18:14:12.610 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is off 2023-11-16T18:14:12.618 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is off 2023-11-16T18:14:12.711 INFO:teuthology.orchestra.console.smithi159:Power off completed 2023-11-16T18:14:12.723 INFO:teuthology.orchestra.console.smithi053:Power off completed 2023-11-16T18:14:12.912 INFO:teuthology.lock.ops:unlocked: smithi159.front.sepia.ceph.com 2023-11-16T18:14:12.920 INFO:teuthology.lock.ops:unlocked: smithi053.front.sepia.ceph.com