2023-10-19T14:36:02.811 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-19T14:36:02.836 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T14:36:03.053 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fac37865ee0>, signals=[15]) 2023-10-19T14:36:03.058 INFO:teuthology.lock.ops:Start node 'smithi049.front.sepia.ceph.com' reimaging 2023-10-19T14:36:03.058 INFO:teuthology.lock.ops:Updating [smithi049.front.sepia.ceph.com]: reset os type and version on server 2023-10-19T14:36:03.059 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server 2023-10-19T14:36:03.084 INFO:teuthology.lock.ops:Start node 'smithi187.front.sepia.ceph.com' reimaging 2023-10-19T14:36:03.085 INFO:teuthology.lock.ops:Updating [smithi187.front.sepia.ceph.com]: reset os type and version on server 2023-10-19T14:36:03.085 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2023-10-19T14:36:03.086 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /host {"name": "smithi049"} 2023-10-19T14:36:03.109 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /host {"name": "smithi187"} 2023-10-19T14:36:03.161 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-10-19T14:36:03.176 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-10-19T14:36:03.218 DEBUG:teuthology.provision.fog.smithi049:Requesting image smithi_centos_8.stream (ID 3) 2023-10-19T14:36:03.218 DEBUG:teuthology.provision.fog.smithi049:FOG request: PUT /host/154 {"imageID": 3} 2023-10-19T14:36:03.227 DEBUG:teuthology.provision.fog.smithi187:Requesting image smithi_centos_8.stream (ID 3) 2023-10-19T14:36:03.227 DEBUG:teuthology.provision.fog.smithi187:FOG request: PUT /host/292 {"imageID": 3} 2023-10-19T14:36:03.262 INFO:teuthology.provision.fog.smithi049:Scheduling deploy of centos 8.stream 2023-10-19T14:36:03.262 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-10-19T14:36:03.280 INFO:teuthology.provision.fog.smithi187:Scheduling deploy of centos 8.stream 2023-10-19T14:36:03.280 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-19T14:36:03.322 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /tasktype {"name": "deploy"} 2023-10-19T14:36:03.334 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /tasktype {"name": "deploy"} 2023-10-19T14:36:03.371 DEBUG:teuthology.provision.fog.smithi049:FOG request: POST /host/154/task {"taskTypeID": 1} 2023-10-19T14:36:03.375 DEBUG:teuthology.provision.fog.smithi187:FOG request: POST /host/292/task {"taskTypeID": 1} 2023-10-19T14:36:03.420 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-10-19T14:36:03.450 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-19T14:36:03.511 INFO:teuthology.orchestra.console.smithi049:Power off 2023-10-19T14:36:03.512 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-19T14:36:03.525 INFO:teuthology.orchestra.console.smithi187:Power off 2023-10-19T14:36:03.526 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-19T14:36:03.534 DEBUG:teuthology.orchestra.console.smithi049:power off output: Chassis Power Control: Down/Off 2023-10-19T14:36:03.534 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T14:36:03.545 DEBUG:teuthology.orchestra.console.smithi187:power off output: Chassis Power Control: Down/Off 2023-10-19T14:36:03.546 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T14:36:03.557 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is on 2023-10-19T14:36:03.567 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on 2023-10-19T14:36:07.562 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T14:36:07.572 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T14:36:07.675 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is on 2023-10-19T14:36:07.682 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on 2023-10-19T14:36:11.678 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T14:36:11.685 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T14:36:11.788 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off 2023-10-19T14:36:11.793 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on 2023-10-19T14:36:11.889 INFO:teuthology.orchestra.console.smithi049:Power off completed 2023-10-19T14:36:11.990 INFO:teuthology.orchestra.console.smithi049:Power on 2023-10-19T14:36:11.991 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-19T14:36:12.011 DEBUG:teuthology.orchestra.console.smithi049:power on output: Chassis Power Control: Up/On 2023-10-19T14:36:12.012 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T14:36:12.033 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off 2023-10-19T14:36:15.794 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T14:36:15.903 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off 2023-10-19T14:36:16.004 INFO:teuthology.orchestra.console.smithi187:Power off completed 2023-10-19T14:36:16.035 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T14:36:16.105 INFO:teuthology.orchestra.console.smithi187:Power on 2023-10-19T14:36:16.105 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-19T14:36:16.126 DEBUG:teuthology.orchestra.console.smithi187:power on output: Chassis Power Control: Up/On 2023-10-19T14:36:16.127 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T14:36:16.142 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off 2023-10-19T14:36:16.148 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off 2023-10-19T14:36:20.146 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T14:36:20.154 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T14:36:20.262 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on 2023-10-19T14:36:20.313 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is on 2023-10-19T14:36:20.363 INFO:teuthology.orchestra.console.smithi187:Power on completed 2023-10-19T14:36:20.414 INFO:teuthology.orchestra.console.smithi049:Power on completed 2023-10-19T14:36:20.465 INFO:teuthology.provision.fog.smithi187:Waiting for deploy to finish 2023-10-19T14:36:20.465 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-19T14:36:20.515 INFO:teuthology.provision.fog.smithi049:Waiting for deploy to finish 2023-10-19T14:36:20.515 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-10-19T14:36:35.528 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-19T14:36:35.568 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-10-19T14:36:50.598 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-19T14:36:50.618 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-10-19T14:37:05.674 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-19T14:37:05.676 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-10-19T14:37:20.754 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-19T14:37:20.756 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-10-19T14:37:35.826 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-10-19T14:37:35.828 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-19T14:37:50.898 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-10-19T14:37:50.900 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-19T14:38:05.966 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-19T14:38:06.050 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-10-19T14:38:21.046 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-19T14:38:21.106 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-10-19T14:38:36.118 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-19T14:38:36.160 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-10-19T14:38:51.198 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-19T14:38:51.214 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-10-19T14:39:06.402 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-10-19T14:39:06.404 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-19T14:39:06.461 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T14:39:21.478 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-10-19T14:39:24.794 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-10-19T14:39:30.814 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T14:39:33.886 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-10-19T14:39:36.538 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-10-19T14:39:39.891 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T14:39:42.970 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-10-19T14:39:48.975 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T14:39:51.606 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-10-19T14:39:51.664 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T14:39:52.030 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-10-19T14:39:58.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T14:40:01.114 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-10-19T14:40:07.118 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T14:40:10.110 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-10-19T14:40:16.114 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T14:40:19.194 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-10-19T14:40:25.201 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T14:40:28.282 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-10-19T14:40:34.287 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T14:40:37.338 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-10-19T14:40:43.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T14:40:46.394 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-10-19T14:40:52.401 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T14:40:55.482 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-10-19T14:41:01.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T14:41:04.538 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-10-19T14:41:07.122 WARNING:teuthology.provision.fog.smithi187:timed out 2023-10-19T14:41:10.542 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T14:41:13.162 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T14:41:13.457 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-19T14:41:13.458 DEBUG:teuthology.orchestra.run.smithi187:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-19T14:41:13.598 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-10-19T14:41:13.728 INFO:teuthology.provision.fog.smithi187:Node is ready 2023-10-19T14:41:13.729 DEBUG:teuthology.orchestra.run.smithi187:> hostname 2023-10-19T14:41:13.748 INFO:teuthology.orchestra.run.smithi187.stdout:smithi187.front.sepia.ceph.com 2023-10-19T14:41:13.749 DEBUG:teuthology.orchestra.run.smithi187:> grep smithi187.front.sepia.ceph.com /etc/hosts 2023-10-19T14:41:13.808 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.15.187 smithi187.front.sepia.ceph.com smithi187 2023-10-19T14:41:13.808 DEBUG:teuthology.orchestra.run.smithi187:> sudo hostname smithi187 2023-10-19T14:41:13.918 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/smithi187.front.sepia.ceph.com/smithi187/g' /etc/hosts 2023-10-19T14:41:13.949 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/172.21.15.187/172.21.15.187/g' /etc/hosts 2023-10-19T14:41:14.020 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/smithi187.front.sepia.ceph.com/smithi187/g' /etc/hostname 2023-10-19T14:41:14.090 DEBUG:teuthology.orchestra.run.smithi187:> sudo hostname smithi187 2023-10-19T14:41:14.159 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release 2023-10-19T14:41:14.218 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="CentOS Stream" 2023-10-19T14:41:14.218 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="8" 2023-10-19T14:41:14.218 INFO:teuthology.orchestra.run.smithi187.stdout:ID="centos" 2023-10-19T14:41:14.219 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE="rhel fedora" 2023-10-19T14:41:14.219 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="8" 2023-10-19T14:41:14.219 INFO:teuthology.orchestra.run.smithi187.stdout:PLATFORM_ID="platform:el8" 2023-10-19T14:41:14.219 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-19T14:41:14.219 INFO:teuthology.orchestra.run.smithi187.stdout:ANSI_COLOR="0;31" 2023-10-19T14:41:14.220 INFO:teuthology.orchestra.run.smithi187.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-19T14:41:14.220 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://centos.org/" 2023-10-19T14:41:14.220 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-19T14:41:14.220 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-19T14:41:14.220 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-19T14:41:14.221 INFO:teuthology.provision.fog.smithi187:Deploy complete! 2023-10-19T14:41:14.222 DEBUG:teuthology.parallel:result is None 2023-10-19T14:41:19.603 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T14:41:22.682 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-10-19T14:41:28.687 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T14:41:31.738 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-10-19T14:41:37.743 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T14:42:37.805 WARNING:teuthology.provision.fog.smithi049:timed out 2023-10-19T14:42:43.811 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T14:42:44.069 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-19T14:42:44.069 DEBUG:teuthology.orchestra.run.smithi049:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-19T14:42:44.325 INFO:teuthology.provision.fog.smithi049:Node is ready 2023-10-19T14:42:44.326 DEBUG:teuthology.orchestra.run.smithi049:> hostname 2023-10-19T14:42:44.345 INFO:teuthology.orchestra.run.smithi049.stdout:smithi049.front.sepia.ceph.com 2023-10-19T14:42:44.345 DEBUG:teuthology.orchestra.run.smithi049:> grep smithi049.front.sepia.ceph.com /etc/hosts 2023-10-19T14:42:44.406 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49 smithi049.front.sepia.ceph.com smithi049 2023-10-19T14:42:44.407 DEBUG:teuthology.orchestra.run.smithi049:> sudo hostname smithi049 2023-10-19T14:42:44.498 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i -e 's/smithi049.front.sepia.ceph.com/smithi049/g' /etc/hosts 2023-10-19T14:42:44.528 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i -e 's/172.21.15.49/172.21.15.49/g' /etc/hosts 2023-10-19T14:42:44.598 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i -e 's/smithi049.front.sepia.ceph.com/smithi049/g' /etc/hostname 2023-10-19T14:42:44.667 DEBUG:teuthology.orchestra.run.smithi049:> sudo hostname smithi049 2023-10-19T14:42:44.736 DEBUG:teuthology.orchestra.run.smithi049:> cat /etc/os-release 2023-10-19T14:42:44.795 INFO:teuthology.orchestra.run.smithi049.stdout:NAME="CentOS Stream" 2023-10-19T14:42:44.795 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION="8" 2023-10-19T14:42:44.796 INFO:teuthology.orchestra.run.smithi049.stdout:ID="centos" 2023-10-19T14:42:44.796 INFO:teuthology.orchestra.run.smithi049.stdout:ID_LIKE="rhel fedora" 2023-10-19T14:42:44.796 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_ID="8" 2023-10-19T14:42:44.796 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM_ID="platform:el8" 2023-10-19T14:42:44.797 INFO:teuthology.orchestra.run.smithi049.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-19T14:42:44.797 INFO:teuthology.orchestra.run.smithi049.stdout:ANSI_COLOR="0;31" 2023-10-19T14:42:44.797 INFO:teuthology.orchestra.run.smithi049.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-19T14:42:44.797 INFO:teuthology.orchestra.run.smithi049.stdout:HOME_URL="https://centos.org/" 2023-10-19T14:42:44.797 INFO:teuthology.orchestra.run.smithi049.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-19T14:42:44.797 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-19T14:42:44.798 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-19T14:42:44.798 INFO:teuthology.provision.fog.smithi049:Deploy complete! 2023-10-19T14:42:44.799 DEBUG:teuthology.parallel:result is None 2023-10-19T14:42:44.960 INFO:teuthology.lock.ops:Checking smithi049.front.sepia.ceph.com 2023-10-19T14:42:44.961 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-19T14:42:44.991 INFO:teuthology.lock.ops:Checking smithi187.front.sepia.ceph.com 2023-10-19T14:42:44.992 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-19T14:42:45.017 INFO:teuthology.lock.ops:Updating [smithi049.front.sepia.ceph.com]: set os type and version on server 2023-10-19T14:42:45.018 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2023-10-19T14:42:45.018 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T14:42:45.087 DEBUG:teuthology.orchestra.run.smithi049:> true 2023-10-19T14:42:45.156 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi049.front.sepia.ceph.com' 2023-10-19T14:42:45.156 DEBUG:teuthology.orchestra.run.smithi049:> uname -m 2023-10-19T14:42:45.215 INFO:teuthology.orchestra.run.smithi049.stdout:x86_64 2023-10-19T14:42:45.215 DEBUG:teuthology.orchestra.run.smithi049:> cat /etc/os-release 2023-10-19T14:42:45.274 INFO:teuthology.orchestra.run.smithi049.stdout:NAME="CentOS Stream" 2023-10-19T14:42:45.275 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION="8" 2023-10-19T14:42:45.275 INFO:teuthology.orchestra.run.smithi049.stdout:ID="centos" 2023-10-19T14:42:45.275 INFO:teuthology.orchestra.run.smithi049.stdout:ID_LIKE="rhel fedora" 2023-10-19T14:42:45.275 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_ID="8" 2023-10-19T14:42:45.276 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM_ID="platform:el8" 2023-10-19T14:42:45.276 INFO:teuthology.orchestra.run.smithi049.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-19T14:42:45.276 INFO:teuthology.orchestra.run.smithi049.stdout:ANSI_COLOR="0;31" 2023-10-19T14:42:45.276 INFO:teuthology.orchestra.run.smithi049.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-19T14:42:45.277 INFO:teuthology.orchestra.run.smithi049.stdout:HOME_URL="https://centos.org/" 2023-10-19T14:42:45.279 INFO:teuthology.orchestra.run.smithi049.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-19T14:42:45.280 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-19T14:42:45.280 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-19T14:42:45.281 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server 2023-10-19T14:42:45.308 INFO:teuthology.lock.ops:Updating [smithi187.front.sepia.ceph.com]: set os type and version on server 2023-10-19T14:42:45.309 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2023-10-19T14:42:45.309 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T14:42:45.435 DEBUG:teuthology.orchestra.run.smithi187:> true 2023-10-19T14:42:45.573 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi187.front.sepia.ceph.com' 2023-10-19T14:42:45.573 DEBUG:teuthology.orchestra.run.smithi187:> uname -m 2023-10-19T14:42:45.633 INFO:teuthology.orchestra.run.smithi187.stdout:x86_64 2023-10-19T14:42:45.633 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release 2023-10-19T14:42:45.693 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="CentOS Stream" 2023-10-19T14:42:45.693 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="8" 2023-10-19T14:42:45.693 INFO:teuthology.orchestra.run.smithi187.stdout:ID="centos" 2023-10-19T14:42:45.694 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE="rhel fedora" 2023-10-19T14:42:45.694 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="8" 2023-10-19T14:42:45.694 INFO:teuthology.orchestra.run.smithi187.stdout:PLATFORM_ID="platform:el8" 2023-10-19T14:42:45.694 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-19T14:42:45.694 INFO:teuthology.orchestra.run.smithi187.stdout:ANSI_COLOR="0;31" 2023-10-19T14:42:45.695 INFO:teuthology.orchestra.run.smithi187.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-19T14:42:45.695 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://centos.org/" 2023-10-19T14:42:45.695 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-19T14:42:45.695 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-19T14:42:45.695 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-19T14:42:45.696 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2023-10-19T14:42:45.725 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T14:42:45.829 INFO:teuthology.dispatcher.supervisor:Running job 7427550 2023-10-19T14:42:45.829 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2023-10-14_14:23:11-upgrade:quincy-x-reef-distro-default-smithi/7427550 --name teuthology-2023-10-14_14:23:11-upgrade:quincy-x-reef-distro-default-smithi --description upgrade:quincy-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} -- /home/teuthworker/archive/teuthology-2023-10-14_14:23:11-upgrade:quincy-x-reef-distro-default-smithi/7427550/orig.config.yaml 2023-10-19T14:42:45.857 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2023-10-14_14:23:11-upgrade:quincy-x-reef-distro-default-smithi/7427550 2023-10-19T14:42:45.857 INFO:teuthology.dispatcher.supervisor:Job PID: 3671732 2023-10-19T14:42:45.858 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-19T14:44:45.959 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T14:46:46.135 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T14:48:46.303 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T14:50:46.475 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T14:52:46.639 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T14:54:46.804 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T14:56:46.971 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T14:58:47.129 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T15:00:47.291 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T15:02:47.450 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T15:04:47.619 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T15:06:47.788 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T15:08:47.942 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T15:10:48.111 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T15:12:48.271 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T15:14:48.415 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T15:16:48.580 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T15:18:48.702 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T15:20:48.856 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T15:22:49.013 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T15:24:49.175 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T15:26:49.339 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T15:28:49.505 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T15:30:49.677 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T15:32:49.848 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T15:34:50.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T15:36:50.179 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T15:38:50.355 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T15:40:50.523 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T15:42:50.684 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T15:44:50.855 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T15:46:51.099 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T15:48:51.261 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T15:50:51.425 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T15:52:51.591 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T15:54:51.755 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T15:56:51.927 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T15:58:52.102 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T16:00:52.271 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T16:02:52.439 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T16:02:52.511 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-19T16:02:52.697 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-19T16:02:52.697 INFO:teuthology.nuke:Checking targets against current locks 2023-10-19T16:02:52.753 DEBUG:teuthology.nuke:shortname: smithi049 2023-10-19T16:02:52.754 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-19T16:02:52.774 DEBUG:teuthology.nuke:shortname: smithi187 2023-10-19T16:02:52.774 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-19T16:02:52.778 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi049.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-10-14_14:23:11-upgrade:quincy-x-reef-distro-default-smithi/7427550', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-19 14:35:51.334214', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD/3FtmBQaVC7EoaX2QUDvRoAzjD0l9qwKY3MDBeOVca5Ku/DiC511p0YSDoBmh0v1O+TM9jm5sgtVsvzFC7fHQ='} 2023-10-19T16:02:52.797 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi187.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-10-14_14:23:11-upgrade:quincy-x-reef-distro-default-smithi/7427550', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-19 14:35:51.332915', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB1SOWtjvRVRXOq//rCudvgsPonICLjedY/70xElN+CYgIdsGVvKgCQW1++PRzlqvEbSm9V5IjUD7af+Arc3Jmo='} 2023-10-19T16:02:52.827 INFO:teuthology.orchestra.console.smithi049:Power off 2023-10-19T16:02:52.828 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-19T16:02:52.850 DEBUG:teuthology.orchestra.console.smithi049:power off output: Chassis Power Control: Down/Off 2023-10-19T16:02:52.851 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T16:02:52.865 INFO:teuthology.orchestra.console.smithi187:Power off 2023-10-19T16:02:52.866 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-19T16:02:52.874 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off 2023-10-19T16:02:52.885 DEBUG:teuthology.orchestra.console.smithi187:power off output: Chassis Power Control: Down/Off 2023-10-19T16:02:52.886 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T16:02:52.907 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off 2023-10-19T16:02:52.975 INFO:teuthology.orchestra.console.smithi049:Power off completed 2023-10-19T16:02:53.009 INFO:teuthology.orchestra.console.smithi187:Power off completed 2023-10-19T16:02:53.127 INFO:teuthology.lock.ops:unlocked: smithi049.front.sepia.ceph.com 2023-10-19T16:02:53.151 INFO:teuthology.lock.ops:unlocked: smithi187.front.sepia.ceph.com