2023-08-10T21:23:26.370 INFO:root:teuthology version: 0.0.1.dev181+g7fda959 2023-08-10T21:23:26.372 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T21:23:26.519 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8681d40280>, signals=[15]) 2023-08-10T21:23:26.521 INFO:teuthology.lock.ops:Start node 'smithi141.front.sepia.ceph.com' reimaging 2023-08-10T21:23:26.521 INFO:teuthology.lock.ops:Updating [smithi141.front.sepia.ceph.com]: reset os type and version on server 2023-08-10T21:23:26.521 INFO:teuthology.lock.ops:Updating smithi141.front.sepia.ceph.com on lock server 2023-08-10T21:23:26.543 INFO:teuthology.lock.ops:Start node 'smithi145.front.sepia.ceph.com' reimaging 2023-08-10T21:23:26.543 INFO:teuthology.lock.ops:Updating [smithi145.front.sepia.ceph.com]: reset os type and version on server 2023-08-10T21:23:26.544 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server 2023-08-10T21:23:26.545 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /host {"name": "smithi141"} 2023-08-10T21:23:26.566 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /host {"name": "smithi145"} 2023-08-10T21:23:26.626 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-08-10T21:23:26.634 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-08-10T21:23:26.682 DEBUG:teuthology.provision.fog.smithi141:Requesting image smithi_centos_8.stream (ID 3) 2023-08-10T21:23:26.683 DEBUG:teuthology.provision.fog.smithi141:FOG request: PUT /host/246 {"imageID": 3} 2023-08-10T21:23:26.685 DEBUG:teuthology.provision.fog.smithi145:Requesting image smithi_centos_8.stream (ID 3) 2023-08-10T21:23:26.685 DEBUG:teuthology.provision.fog.smithi145:FOG request: PUT /host/250 {"imageID": 3} 2023-08-10T21:23:26.725 INFO:teuthology.provision.fog.smithi145:Scheduling deploy of centos 8.stream 2023-08-10T21:23:26.725 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-08-10T21:23:26.728 INFO:teuthology.provision.fog.smithi141:Scheduling deploy of centos 8.stream 2023-08-10T21:23:26.728 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-08-10T21:23:26.797 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /tasktype {"name": "deploy"} 2023-08-10T21:23:26.801 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /tasktype {"name": "deploy"} 2023-08-10T21:23:26.844 DEBUG:teuthology.provision.fog.smithi141:FOG request: POST /host/246/task {"taskTypeID": 1} 2023-08-10T21:23:26.851 DEBUG:teuthology.provision.fog.smithi145:FOG request: POST /host/250/task {"taskTypeID": 1} 2023-08-10T21:23:26.908 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-08-10T21:23:26.914 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-08-10T21:23:27.014 INFO:teuthology.orchestra.console.smithi141:Power off 2023-08-10T21:23:27.016 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-10T21:23:27.037 INFO:teuthology.orchestra.console.smithi145:Power off 2023-08-10T21:23:27.037 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-10T21:23:27.049 DEBUG:teuthology.orchestra.console.smithi141:power off output: Chassis Power Control: Down/Off 2023-08-10T21:23:27.049 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T21:23:27.063 DEBUG:teuthology.orchestra.console.smithi145:power off output: Chassis Power Control: Down/Off 2023-08-10T21:23:27.064 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T21:23:27.079 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is on 2023-08-10T21:23:27.092 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is on 2023-08-10T21:23:31.084 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T21:23:31.094 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T21:23:31.196 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is on 2023-08-10T21:23:31.206 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is on 2023-08-10T21:23:35.200 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T21:23:35.211 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T21:23:35.313 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is off 2023-08-10T21:23:35.324 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is off 2023-08-10T21:23:35.415 INFO:teuthology.orchestra.console.smithi141:Power off completed 2023-08-10T21:23:35.425 INFO:teuthology.orchestra.console.smithi145:Power off completed 2023-08-10T21:23:35.517 INFO:teuthology.orchestra.console.smithi141:Power on 2023-08-10T21:23:35.517 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-10T21:23:35.528 INFO:teuthology.orchestra.console.smithi145:Power on 2023-08-10T21:23:35.528 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-10T21:23:35.539 DEBUG:teuthology.orchestra.console.smithi141:power on output: Chassis Power Control: Up/On 2023-08-10T21:23:35.540 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T21:23:35.552 DEBUG:teuthology.orchestra.console.smithi145:power on output: Chassis Power Control: Up/On 2023-08-10T21:23:35.553 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T21:23:35.564 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is off 2023-08-10T21:23:35.576 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is off 2023-08-10T21:23:39.568 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T21:23:39.576 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T21:23:39.678 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is off 2023-08-10T21:23:39.686 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is off 2023-08-10T21:23:43.680 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T21:23:43.689 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T21:23:43.802 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is on 2023-08-10T21:23:43.892 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is on 2023-08-10T21:23:43.903 INFO:teuthology.orchestra.console.smithi145:Power on completed 2023-08-10T21:23:43.994 INFO:teuthology.orchestra.console.smithi141:Power on completed 2023-08-10T21:23:44.004 INFO:teuthology.provision.fog.smithi145:Waiting for deploy to finish 2023-08-10T21:23:44.005 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-08-10T21:23:44.095 INFO:teuthology.provision.fog.smithi141:Waiting for deploy to finish 2023-08-10T21:23:44.095 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-08-10T21:23:59.086 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-08-10T21:23:59.176 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-08-10T21:24:14.176 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-08-10T21:24:14.238 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-08-10T21:24:29.256 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-08-10T21:24:29.306 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-08-10T21:24:44.352 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-08-10T21:24:44.378 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-08-10T21:24:59.464 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-08-10T21:24:59.465 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-08-10T21:25:14.556 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-08-10T21:25:14.558 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-08-10T21:25:29.634 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-08-10T21:25:29.638 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-08-10T21:25:44.708 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-08-10T21:25:44.709 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-08-10T21:25:59.788 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-08-10T21:25:59.789 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-08-10T21:26:14.856 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-08-10T21:26:14.858 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-08-10T21:26:14.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T21:26:15.003 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-10T21:26:15.006 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-10T21:26:15.008 DEBUG:teuthology.orchestra.run.smithi141:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-10T21:26:15.009 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-10T21:26:29.929 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-08-10T21:26:30.001 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T21:26:33.072 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-08-10T21:26:39.073 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T21:26:42.128 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-08-10T21:26:48.130 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T21:26:51.184 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-08-10T21:26:57.186 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T21:27:00.240 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-08-10T21:27:06.242 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T21:27:09.296 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-08-10T21:27:15.298 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T21:27:18.352 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-08-10T21:27:24.354 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T21:28:06.512 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-08-10T21:28:06.514 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi141 2023-08-10T21:28:15.520 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-10T21:28:15.521 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T21:28:15.776 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-10T21:28:16.003 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-10T21:28:16.003 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-10T21:28:16.004 DEBUG:teuthology.orchestra.run.smithi141:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-10T21:28:16.062 INFO:teuthology.provision.fog.smithi141:Node is ready 2023-08-10T21:28:16.063 DEBUG:teuthology.orchestra.run.smithi141:> hostname 2023-08-10T21:28:16.121 INFO:teuthology.orchestra.run.smithi141.stdout:smithi141.front.sepia.ceph.com 2023-08-10T21:28:16.121 DEBUG:teuthology.orchestra.run.smithi141:> grep smithi141.front.sepia.ceph.com /etc/hosts 2023-08-10T21:28:16.179 INFO:teuthology.orchestra.run.smithi141.stdout:172.21.15.141 smithi141.front.sepia.ceph.com smithi141 2023-08-10T21:28:16.179 DEBUG:teuthology.orchestra.run.smithi141:> sudo hostname smithi141 2023-08-10T21:28:16.281 DEBUG:teuthology.orchestra.run.smithi141:> sudo sed -i -e 's/smithi141.front.sepia.ceph.com/smithi141/g' /etc/hosts 2023-08-10T21:28:16.310 DEBUG:teuthology.orchestra.run.smithi141:> sudo sed -i -e 's/172.21.15.141/172.21.15.141/g' /etc/hosts 2023-08-10T21:28:16.378 DEBUG:teuthology.orchestra.run.smithi141:> sudo sed -i -e 's/smithi141.front.sepia.ceph.com/smithi141/g' /etc/hostname 2023-08-10T21:28:16.445 DEBUG:teuthology.orchestra.run.smithi141:> sudo hostname smithi141 2023-08-10T21:28:16.512 DEBUG:teuthology.orchestra.run.smithi141:> cat /etc/os-release 2023-08-10T21:28:16.570 INFO:teuthology.orchestra.run.smithi141.stdout:NAME="CentOS Stream" 2023-08-10T21:28:16.570 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION="8" 2023-08-10T21:28:16.571 INFO:teuthology.orchestra.run.smithi141.stdout:ID="centos" 2023-08-10T21:28:16.571 INFO:teuthology.orchestra.run.smithi141.stdout:ID_LIKE="rhel fedora" 2023-08-10T21:28:16.571 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION_ID="8" 2023-08-10T21:28:16.571 INFO:teuthology.orchestra.run.smithi141.stdout:PLATFORM_ID="platform:el8" 2023-08-10T21:28:16.571 INFO:teuthology.orchestra.run.smithi141.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-10T21:28:16.571 INFO:teuthology.orchestra.run.smithi141.stdout:ANSI_COLOR="0;31" 2023-08-10T21:28:16.571 INFO:teuthology.orchestra.run.smithi141.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-10T21:28:16.572 INFO:teuthology.orchestra.run.smithi141.stdout:HOME_URL="https://centos.org/" 2023-08-10T21:28:16.572 INFO:teuthology.orchestra.run.smithi141.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-10T21:28:16.572 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-10T21:28:16.572 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-10T21:28:16.573 INFO:teuthology.provision.fog.smithi141:Deploy complete! 2023-08-10T21:28:16.574 DEBUG:teuthology.parallel:result is None 2023-08-10T21:28:24.355 WARNING:teuthology.provision.fog.smithi145:timed out 2023-08-10T21:28:30.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T21:28:30.584 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-10T21:28:30.584 DEBUG:teuthology.orchestra.run.smithi145:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-10T21:28:30.870 INFO:teuthology.provision.fog.smithi145:Node is ready 2023-08-10T21:28:30.871 DEBUG:teuthology.orchestra.run.smithi145:> hostname 2023-08-10T21:28:30.890 INFO:teuthology.orchestra.run.smithi145.stdout:smithi145.front.sepia.ceph.com 2023-08-10T21:28:30.890 DEBUG:teuthology.orchestra.run.smithi145:> grep smithi145.front.sepia.ceph.com /etc/hosts 2023-08-10T21:28:30.949 INFO:teuthology.orchestra.run.smithi145.stdout:172.21.15.145 smithi145.front.sepia.ceph.com smithi145 2023-08-10T21:28:30.950 DEBUG:teuthology.orchestra.run.smithi145:> sudo hostname smithi145 2023-08-10T21:28:31.055 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/smithi145.front.sepia.ceph.com/smithi145/g' /etc/hosts 2023-08-10T21:28:31.084 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/172.21.15.145/172.21.15.145/g' /etc/hosts 2023-08-10T21:28:31.152 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/smithi145.front.sepia.ceph.com/smithi145/g' /etc/hostname 2023-08-10T21:28:31.221 DEBUG:teuthology.orchestra.run.smithi145:> sudo hostname smithi145 2023-08-10T21:28:31.288 DEBUG:teuthology.orchestra.run.smithi145:> cat /etc/os-release 2023-08-10T21:28:31.346 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="CentOS Stream" 2023-08-10T21:28:31.346 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="8" 2023-08-10T21:28:31.346 INFO:teuthology.orchestra.run.smithi145.stdout:ID="centos" 2023-08-10T21:28:31.346 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE="rhel fedora" 2023-08-10T21:28:31.346 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="8" 2023-08-10T21:28:31.347 INFO:teuthology.orchestra.run.smithi145.stdout:PLATFORM_ID="platform:el8" 2023-08-10T21:28:31.347 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-10T21:28:31.347 INFO:teuthology.orchestra.run.smithi145.stdout:ANSI_COLOR="0;31" 2023-08-10T21:28:31.347 INFO:teuthology.orchestra.run.smithi145.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-10T21:28:31.347 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://centos.org/" 2023-08-10T21:28:31.347 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-10T21:28:31.347 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-10T21:28:31.347 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-10T21:28:31.348 INFO:teuthology.provision.fog.smithi145:Deploy complete! 2023-08-10T21:28:31.348 DEBUG:teuthology.parallel:result is None 2023-08-10T21:28:31.489 INFO:teuthology.lock.ops:Checking smithi141.front.sepia.ceph.com 2023-08-10T21:28:31.490 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-10T21:28:31.525 INFO:teuthology.lock.ops:Checking smithi145.front.sepia.ceph.com 2023-08-10T21:28:31.526 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-10T21:28:31.542 INFO:teuthology.lock.ops:Updating [smithi141.front.sepia.ceph.com]: set os type and version on server 2023-08-10T21:28:31.543 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-10T21:28:31.544 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T21:28:31.612 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-10T21:28:31.689 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-10T21:28:31.690 DEBUG:teuthology.orchestra.run.smithi141:> uname -m 2023-08-10T21:28:31.750 INFO:teuthology.orchestra.run.smithi141.stdout:x86_64 2023-08-10T21:28:31.751 DEBUG:teuthology.orchestra.run.smithi141:> cat /etc/os-release 2023-08-10T21:28:31.811 INFO:teuthology.orchestra.run.smithi141.stdout:NAME="CentOS Stream" 2023-08-10T21:28:31.811 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION="8" 2023-08-10T21:28:31.811 INFO:teuthology.orchestra.run.smithi141.stdout:ID="centos" 2023-08-10T21:28:31.811 INFO:teuthology.orchestra.run.smithi141.stdout:ID_LIKE="rhel fedora" 2023-08-10T21:28:31.811 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION_ID="8" 2023-08-10T21:28:31.812 INFO:teuthology.orchestra.run.smithi141.stdout:PLATFORM_ID="platform:el8" 2023-08-10T21:28:31.812 INFO:teuthology.orchestra.run.smithi141.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-10T21:28:31.812 INFO:teuthology.orchestra.run.smithi141.stdout:ANSI_COLOR="0;31" 2023-08-10T21:28:31.812 INFO:teuthology.orchestra.run.smithi141.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-10T21:28:31.812 INFO:teuthology.orchestra.run.smithi141.stdout:HOME_URL="https://centos.org/" 2023-08-10T21:28:31.812 INFO:teuthology.orchestra.run.smithi141.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-10T21:28:31.812 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-10T21:28:31.813 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-10T21:28:31.813 INFO:teuthology.lock.ops:Updating smithi141.front.sepia.ceph.com on lock server 2023-08-10T21:28:31.834 INFO:teuthology.lock.ops:Updating [smithi145.front.sepia.ceph.com]: set os type and version on server 2023-08-10T21:28:31.834 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2023-08-10T21:28:31.835 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T21:28:31.898 DEBUG:teuthology.orchestra.run.smithi145:> true 2023-08-10T21:28:31.966 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi145.front.sepia.ceph.com' 2023-08-10T21:28:31.966 DEBUG:teuthology.orchestra.run.smithi145:> uname -m 2023-08-10T21:28:32.024 INFO:teuthology.orchestra.run.smithi145.stdout:x86_64 2023-08-10T21:28:32.024 DEBUG:teuthology.orchestra.run.smithi145:> cat /etc/os-release 2023-08-10T21:28:32.081 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="CentOS Stream" 2023-08-10T21:28:32.082 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="8" 2023-08-10T21:28:32.082 INFO:teuthology.orchestra.run.smithi145.stdout:ID="centos" 2023-08-10T21:28:32.082 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE="rhel fedora" 2023-08-10T21:28:32.082 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="8" 2023-08-10T21:28:32.082 INFO:teuthology.orchestra.run.smithi145.stdout:PLATFORM_ID="platform:el8" 2023-08-10T21:28:32.083 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-10T21:28:32.083 INFO:teuthology.orchestra.run.smithi145.stdout:ANSI_COLOR="0;31" 2023-08-10T21:28:32.083 INFO:teuthology.orchestra.run.smithi145.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-10T21:28:32.083 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://centos.org/" 2023-08-10T21:28:32.083 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-10T21:28:32.083 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-10T21:28:32.083 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-10T21:28:32.084 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server 2023-08-10T21:28:32.109 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T21:28:32.197 INFO:teuthology.dispatcher.supervisor:Running job 7366516 2023-08-10T21:28:32.198 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/virtualenv/bin/teuthology -v --owner scheduled_gabrioux@teuthology --archive /home/teuthworker/archive/gabrioux-2023-08-10_21:15:25-orch:cephadm-wip-guits-testing-2-2023-08-10-1325-distro-default-smithi/7366516 --name gabrioux-2023-08-10_21:15:25-orch:cephadm-wip-guits-testing-2-2023-08-10-1325-distro-default-smithi --description orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} -- /home/teuthworker/archive/gabrioux-2023-08-10_21:15:25-orch:cephadm-wip-guits-testing-2-2023-08-10-1325-distro-default-smithi/7366516/orig.config.yaml 2023-08-10T21:28:32.201 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/gabrioux-2023-08-10_21:15:25-orch:cephadm-wip-guits-testing-2-2023-08-10-1325-distro-default-smithi/7366516 2023-08-10T21:28:32.202 INFO:teuthology.dispatcher.supervisor:Job PID: 13890 2023-08-10T21:28:32.202 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-10T21:30:32.216 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T21:32:32.375 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T21:34:32.535 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T21:36:32.701 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T21:38:32.874 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T21:40:33.038 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T21:42:33.205 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T21:44:33.370 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T21:46:33.537 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T21:48:33.699 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T21:50:33.873 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T21:52:34.073 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T21:54:34.221 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T21:56:34.381 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T21:58:34.554 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T22:00:34.739 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T22:02:34.905 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T22:04:35.073 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T22:06:35.246 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T22:08:35.412 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T22:10:35.581 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T22:12:35.745 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T22:14:35.912 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T22:16:36.070 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T22:18:36.264 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T22:20:36.431 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T22:22:36.599 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T22:22:36.665 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-10T22:22:36.850 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-10T22:22:36.850 INFO:teuthology.nuke:Checking targets against current locks 2023-08-10T22:22:36.893 DEBUG:teuthology.nuke:shortname: smithi141 2023-08-10T22:22:36.894 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-10T22:22:36.914 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi141.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-08-10_21:15:25-orch:cephadm-wip-guits-testing-2-2023-08-10-1325-distro-default-smithi/7366516', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-10 21:23:25.530100', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDGM60Ocqxy/YJ4TpO73Z85g/052dfCqllZ8jwyQeNUfcul9dqlz0IWzUPjzVT6pbyAaYOEuEXKO+IB7A/0vocyPWyzGy+Sg0O3+imxKEP6zeA2cT4ugiRfe4L+rJVMnNYms0w8eK4UuyUA+rQ4rrRY5j+pUqIZG9t6861e6BgdAHX6ejc1cP6YCz43kcR3G0vVVBJVVdxFNXkHNQYDDJ0yvx39vtZsWO4YgZsp5Bk7Uxj+kwaCwJEeHXW8fuptIzpdWVRHUtlxJZwpbsOa5tmRyNfr+VKTNkN+7Xwi+UYOy20621TuG1eiz4mF65Yfq6buKC3jHl5gx1ej2/9IdKcSSfQcjrl2jHkXqM0g3xoNiWIgoqja32ZoWtzlhk4hkMxhWQksGZX567mhMH152MFaC2XYEpFlFyMuvTcP5EghyaAqnJT/TUv7ZjAas8EsLX4PROVbG10qz8wUTa2lBlIQRE7IptYNRcG86dRwMDyd8cMW4x34hWUTr9ovu3gr1T8='} 2023-08-10T22:22:36.919 DEBUG:teuthology.nuke:shortname: smithi145 2023-08-10T22:22:36.919 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-10T22:22:36.939 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi145.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-08-10_21:15:25-orch:cephadm-wip-guits-testing-2-2023-08-10-1325-distro-default-smithi/7366516', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-10 21:23:25.531632', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCqQI3sg6zinFxb/cIAH8X/+F/aFuuCIuaTZ3CTut8AP9nXrlFNvrbZ1FU5mLB+TwOkauUu70eR/WR5JFuLQhup6c9KYWJ8MBj/2OUzIh0SUeKrDWWuFxucKbAZmOtMsPSauqoDznyfqSoYVDkjngdBVCbrUK9jb+Qk+B7jF+/1+lN0Yih3i94zFSyoS5zWs9ClxcOiqNF+6xeKl3g0CDkeAGB+pQaiYbSJMFrvHamJtbI5F5/WY50czCAXA5CZ9m0MKpBCGdKhQKFLzMwjCHlDjlxipoz4lQPPjv+P8jh0nqZ3a1pt84IS2HSknLgeV8eytxMOoYndOA5xjumX9bMJj65jF/pZJCW8IftP2pCdb4fRoRn7gxpvme5HhUKa6OtxYU8STTwZFlEeXf87moYTPaX2EKwzxfvPobdzmIcZPBF5zrAOioFQ4zWDcX7kZFIMc1mnIL9POeRK1SYb3DaUBW4sBQflYKBkMcY0aU4f8a2+mCMU7cLflwtzANIBryk='} 2023-08-10T22:22:36.958 INFO:teuthology.orchestra.console.smithi141:Power off 2023-08-10T22:22:36.959 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-10T22:22:36.983 DEBUG:teuthology.orchestra.console.smithi141:power off output: Chassis Power Control: Down/Off 2023-08-10T22:22:36.984 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T22:22:37.003 INFO:teuthology.orchestra.console.smithi145:Power off 2023-08-10T22:22:37.004 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-10T22:22:37.015 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is off 2023-08-10T22:22:37.026 DEBUG:teuthology.orchestra.console.smithi145:power off output: Chassis Power Control: Down/Off 2023-08-10T22:22:37.026 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T22:22:37.048 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is off 2023-08-10T22:22:37.116 INFO:teuthology.orchestra.console.smithi141:Power off completed 2023-08-10T22:22:37.150 INFO:teuthology.orchestra.console.smithi145:Power off completed 2023-08-10T22:22:37.273 INFO:teuthology.lock.ops:unlocked: smithi141.front.sepia.ceph.com 2023-08-10T22:22:37.290 INFO:teuthology.lock.ops:unlocked: smithi145.front.sepia.ceph.com