2023-10-25T05:56:05.154 INFO:root:teuthology version: 0.0.1.dev201+g202b180 2023-10-25T05:56:05.156 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T05:56:05.299 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f488ea0b670>, signals=[15]) 2023-10-25T05:56:05.300 INFO:teuthology.lock.ops:Start node 'smithi187.front.sepia.ceph.com' reimaging 2023-10-25T05:56:05.300 INFO:teuthology.lock.ops:Updating [smithi187.front.sepia.ceph.com]: reset os type and version on server 2023-10-25T05:56:05.301 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2023-10-25T05:56:05.322 INFO:teuthology.lock.ops:Start node 'smithi195.front.sepia.ceph.com' reimaging 2023-10-25T05:56:05.322 INFO:teuthology.lock.ops:Updating [smithi195.front.sepia.ceph.com]: reset os type and version on server 2023-10-25T05:56:05.322 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2023-10-25T05:56:05.323 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /host {"name": "smithi187"} 2023-10-25T05:56:05.346 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /host {"name": "smithi195"} 2023-10-25T05:56:05.404 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-10-25T05:56:05.413 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-10-25T05:56:05.447 DEBUG:teuthology.provision.fog.smithi187:Requesting image smithi_centos_9.stream (ID 10) 2023-10-25T05:56:05.448 DEBUG:teuthology.provision.fog.smithi187:FOG request: PUT /host/292 {"imageID": 10} 2023-10-25T05:56:05.452 DEBUG:teuthology.provision.fog.smithi195:Requesting image smithi_centos_9.stream (ID 10) 2023-10-25T05:56:05.453 DEBUG:teuthology.provision.fog.smithi195:FOG request: PUT /host/300 {"imageID": 10} 2023-10-25T05:56:05.496 INFO:teuthology.provision.fog.smithi187:Scheduling deploy of centos 9.stream 2023-10-25T05:56:05.497 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-25T05:56:05.500 INFO:teuthology.provision.fog.smithi195:Scheduling deploy of centos 9.stream 2023-10-25T05:56:05.500 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-10-25T05:56:05.549 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /tasktype {"name": "deploy"} 2023-10-25T05:56:05.554 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /tasktype {"name": "deploy"} 2023-10-25T05:56:05.600 DEBUG:teuthology.provision.fog.smithi187:FOG request: POST /host/292/task {"taskTypeID": 1} 2023-10-25T05:56:05.603 DEBUG:teuthology.provision.fog.smithi195:FOG request: POST /host/300/task {"taskTypeID": 1} 2023-10-25T05:56:05.656 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-10-25T05:56:05.659 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-25T05:56:05.760 INFO:teuthology.orchestra.console.smithi195:Power off 2023-10-25T05:56:05.761 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-25T05:56:05.775 INFO:teuthology.orchestra.console.smithi187:Power off 2023-10-25T05:56:05.775 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-25T05:56:05.784 DEBUG:teuthology.orchestra.console.smithi195:power off output: Chassis Power Control: Down/Off 2023-10-25T05:56:05.785 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T05:56:05.797 DEBUG:teuthology.orchestra.console.smithi187:power off output: Chassis Power Control: Down/Off 2023-10-25T05:56:05.798 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T05:56:05.806 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2023-10-25T05:56:05.819 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on 2023-10-25T05:56:05.907 INFO:teuthology.orchestra.console.smithi195:Power off completed 2023-10-25T05:56:06.008 INFO:teuthology.orchestra.console.smithi195:Power on 2023-10-25T05:56:06.009 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-25T05:56:06.032 DEBUG:teuthology.orchestra.console.smithi195:power on output: Chassis Power Control: Up/On 2023-10-25T05:56:06.033 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T05:56:06.054 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2023-10-25T05:56:09.823 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T05:56:09.932 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on 2023-10-25T05:56:10.056 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T05:56:10.165 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2023-10-25T05:56:13.936 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T05:56:14.044 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off 2023-10-25T05:56:14.145 INFO:teuthology.orchestra.console.smithi187:Power off completed 2023-10-25T05:56:14.166 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T05:56:14.247 INFO:teuthology.orchestra.console.smithi187:Power on 2023-10-25T05:56:14.248 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-25T05:56:14.269 DEBUG:teuthology.orchestra.console.smithi187:power on output: Chassis Power Control: Up/On 2023-10-25T05:56:14.270 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T05:56:14.278 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2023-10-25T05:56:14.293 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off 2023-10-25T05:56:14.380 INFO:teuthology.orchestra.console.smithi195:Power on completed 2023-10-25T05:56:14.481 INFO:teuthology.provision.fog.smithi195:Waiting for deploy to finish 2023-10-25T05:56:14.481 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-10-25T05:56:18.298 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T05:56:18.407 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off 2023-10-25T05:56:22.412 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T05:56:22.523 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on 2023-10-25T05:56:22.624 INFO:teuthology.orchestra.console.smithi187:Power on completed 2023-10-25T05:56:22.725 INFO:teuthology.provision.fog.smithi187:Waiting for deploy to finish 2023-10-25T05:56:22.725 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-25T05:56:29.558 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-10-25T05:56:37.796 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-25T05:56:44.630 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-10-25T05:56:52.862 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-25T05:56:59.690 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-10-25T05:57:07.933 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-25T05:57:14.760 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-10-25T05:57:22.998 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-25T05:57:29.826 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-10-25T05:57:38.062 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-25T05:57:44.898 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-10-25T05:57:53.126 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-25T05:57:59.979 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-10-25T05:58:08.196 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-25T05:58:15.046 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-10-25T05:58:23.270 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-25T05:58:30.118 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-10-25T05:58:38.342 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-25T05:58:45.188 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-10-25T05:58:45.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T05:58:53.413 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-25T05:58:53.478 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T05:58:54.482 ERROR:teuthology.orchestra.connection:Error authenticating with smithi187.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-10-25T05:59:03.802 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-10-25T05:59:09.804 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T05:59:12.862 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-10-25T05:59:18.863 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T05:59:21.946 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-10-25T05:59:27.948 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T05:59:31.002 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-10-25T05:59:37.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T05:59:58.487 WARNING:teuthology.provision.fog.smithi187:timed out 2023-10-25T06:00:04.489 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T06:00:22.906 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-10-25T06:00:28.907 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T06:00:31.962 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-10-25T06:00:37.007 WARNING:teuthology.provision.fog.smithi195:timed out 2023-10-25T06:00:37.964 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T06:00:38.501 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T06:00:38.502 DEBUG:teuthology.orchestra.run.smithi187:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-25T06:00:43.009 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T06:00:43.231 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T06:00:43.231 DEBUG:teuthology.orchestra.run.smithi195:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-25T06:00:43.555 INFO:teuthology.provision.fog.smithi195:Node is ready 2023-10-25T06:00:43.555 DEBUG:teuthology.orchestra.run.smithi195:> hostname 2023-10-25T06:00:43.570 INFO:teuthology.orchestra.run.smithi195.stdout:smithi195.front.sepia.ceph.com 2023-10-25T06:00:43.570 DEBUG:teuthology.orchestra.run.smithi195:> grep smithi195.front.sepia.ceph.com /etc/hosts 2023-10-25T06:00:43.626 INFO:teuthology.orchestra.run.smithi195.stdout:172.21.15.195 smithi195.front.sepia.ceph.com smithi195 2023-10-25T06:00:43.627 DEBUG:teuthology.orchestra.run.smithi195:> sudo hostname smithi195 2023-10-25T06:00:43.723 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/smithi195.front.sepia.ceph.com/smithi195/g' /etc/hosts 2023-10-25T06:00:43.751 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/172.21.15.195/172.21.15.195/g' /etc/hosts 2023-10-25T06:00:43.819 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/smithi195.front.sepia.ceph.com/smithi195/g' /etc/hostname 2023-10-25T06:00:43.886 DEBUG:teuthology.orchestra.run.smithi195:> sudo hostname smithi195 2023-10-25T06:00:43.952 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2023-10-25T06:00:44.007 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="CentOS Stream" 2023-10-25T06:00:44.007 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="9" 2023-10-25T06:00:44.007 INFO:teuthology.orchestra.run.smithi195.stdout:ID="centos" 2023-10-25T06:00:44.007 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE="rhel fedora" 2023-10-25T06:00:44.008 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="9" 2023-10-25T06:00:44.008 INFO:teuthology.orchestra.run.smithi195.stdout:PLATFORM_ID="platform:el9" 2023-10-25T06:00:44.008 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-25T06:00:44.008 INFO:teuthology.orchestra.run.smithi195.stdout:ANSI_COLOR="0;31" 2023-10-25T06:00:44.008 INFO:teuthology.orchestra.run.smithi195.stdout:LOGO="fedora-logo-icon" 2023-10-25T06:00:44.009 INFO:teuthology.orchestra.run.smithi195.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-25T06:00:44.009 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://centos.org/" 2023-10-25T06:00:44.009 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-25T06:00:44.009 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-25T06:00:44.009 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-25T06:00:44.010 INFO:teuthology.provision.fog.smithi195:Deploy complete! 2023-10-25T06:00:44.011 DEBUG:teuthology.parallel:result is None 2023-10-25T06:00:58.882 INFO:teuthology.provision.fog.smithi187:Node is ready 2023-10-25T06:00:58.883 DEBUG:teuthology.orchestra.run.smithi187:> hostname 2023-10-25T06:00:58.901 INFO:teuthology.orchestra.run.smithi187.stdout:smithi046 2023-10-25T06:00:58.902 DEBUG:teuthology.orchestra.run.smithi187:> grep smithi046 /etc/hosts 2023-10-25T06:00:58.959 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2023-10-25T06:00:58.959 DEBUG:teuthology.orchestra.run.smithi187:> sudo hostname smithi187 2023-10-25T06:00:59.131 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/smithi046/smithi187/g' /etc/hosts 2023-10-25T06:00:59.162 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/172.21.15.46/172.21.15.187/g' /etc/hosts 2023-10-25T06:00:59.231 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/smithi046/smithi187/g' /etc/hostname 2023-10-25T06:00:59.301 DEBUG:teuthology.orchestra.run.smithi187:> sudo hostname smithi187 2023-10-25T06:00:59.368 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release 2023-10-25T06:00:59.424 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="CentOS Stream" 2023-10-25T06:00:59.424 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="9" 2023-10-25T06:00:59.424 INFO:teuthology.orchestra.run.smithi187.stdout:ID="centos" 2023-10-25T06:00:59.425 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE="rhel fedora" 2023-10-25T06:00:59.425 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="9" 2023-10-25T06:00:59.425 INFO:teuthology.orchestra.run.smithi187.stdout:PLATFORM_ID="platform:el9" 2023-10-25T06:00:59.425 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-25T06:00:59.426 INFO:teuthology.orchestra.run.smithi187.stdout:ANSI_COLOR="0;31" 2023-10-25T06:00:59.426 INFO:teuthology.orchestra.run.smithi187.stdout:LOGO="fedora-logo-icon" 2023-10-25T06:00:59.426 INFO:teuthology.orchestra.run.smithi187.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-25T06:00:59.426 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://centos.org/" 2023-10-25T06:00:59.426 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-25T06:00:59.427 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-25T06:00:59.427 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-25T06:00:59.427 INFO:teuthology.provision.fog.smithi187:Deploy complete! 2023-10-25T06:00:59.428 DEBUG:teuthology.parallel:result is None 2023-10-25T06:00:59.615 INFO:teuthology.lock.ops:Checking smithi187.front.sepia.ceph.com 2023-10-25T06:00:59.616 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-25T06:00:59.635 INFO:teuthology.lock.ops:Checking smithi195.front.sepia.ceph.com 2023-10-25T06:00:59.636 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-25T06:00:59.653 INFO:teuthology.lock.ops:Updating [smithi187.front.sepia.ceph.com]: set os type and version on server 2023-10-25T06:00:59.653 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2023-10-25T06:00:59.654 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T06:00:59.739 DEBUG:teuthology.orchestra.run.smithi187:> true 2023-10-25T06:00:59.809 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi187.front.sepia.ceph.com' 2023-10-25T06:00:59.809 DEBUG:teuthology.orchestra.run.smithi187:> uname -m 2023-10-25T06:00:59.863 INFO:teuthology.orchestra.run.smithi187.stdout:x86_64 2023-10-25T06:00:59.863 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release 2023-10-25T06:00:59.917 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="CentOS Stream" 2023-10-25T06:00:59.917 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="9" 2023-10-25T06:00:59.918 INFO:teuthology.orchestra.run.smithi187.stdout:ID="centos" 2023-10-25T06:00:59.918 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE="rhel fedora" 2023-10-25T06:00:59.918 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="9" 2023-10-25T06:00:59.918 INFO:teuthology.orchestra.run.smithi187.stdout:PLATFORM_ID="platform:el9" 2023-10-25T06:00:59.918 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-25T06:00:59.919 INFO:teuthology.orchestra.run.smithi187.stdout:ANSI_COLOR="0;31" 2023-10-25T06:00:59.919 INFO:teuthology.orchestra.run.smithi187.stdout:LOGO="fedora-logo-icon" 2023-10-25T06:00:59.919 INFO:teuthology.orchestra.run.smithi187.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-25T06:00:59.919 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://centos.org/" 2023-10-25T06:00:59.919 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-25T06:00:59.920 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-25T06:00:59.920 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-25T06:00:59.920 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2023-10-25T06:00:59.936 INFO:teuthology.lock.ops:Updating [smithi195.front.sepia.ceph.com]: set os type and version on server 2023-10-25T06:00:59.936 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2023-10-25T06:00:59.937 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T06:01:00.019 DEBUG:teuthology.orchestra.run.smithi195:> true 2023-10-25T06:01:00.192 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi195.front.sepia.ceph.com' 2023-10-25T06:01:00.193 DEBUG:teuthology.orchestra.run.smithi195:> uname -m 2023-10-25T06:01:00.247 INFO:teuthology.orchestra.run.smithi195.stdout:x86_64 2023-10-25T06:01:00.247 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2023-10-25T06:01:00.302 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="CentOS Stream" 2023-10-25T06:01:00.303 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="9" 2023-10-25T06:01:00.303 INFO:teuthology.orchestra.run.smithi195.stdout:ID="centos" 2023-10-25T06:01:00.303 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE="rhel fedora" 2023-10-25T06:01:00.303 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="9" 2023-10-25T06:01:00.303 INFO:teuthology.orchestra.run.smithi195.stdout:PLATFORM_ID="platform:el9" 2023-10-25T06:01:00.304 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-25T06:01:00.304 INFO:teuthology.orchestra.run.smithi195.stdout:ANSI_COLOR="0;31" 2023-10-25T06:01:00.304 INFO:teuthology.orchestra.run.smithi195.stdout:LOGO="fedora-logo-icon" 2023-10-25T06:01:00.304 INFO:teuthology.orchestra.run.smithi195.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-25T06:01:00.304 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://centos.org/" 2023-10-25T06:01:00.305 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-25T06:01:00.305 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-25T06:01:00.305 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-25T06:01:00.306 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2023-10-25T06:01:00.327 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T06:01:00.416 INFO:teuthology.dispatcher.supervisor:Running job 7435760 2023-10-25T06:01:00.416 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-10-24_00:11:54-rados-wip-yuri4-testing-2023-10-23-0903-distro-default-smithi/7435760 --name yuriw-2023-10-24_00:11:54-rados-wip-yuri4-testing-2023-10-23-0903-distro-default-smithi --description rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} -- /home/teuthworker/archive/yuriw-2023-10-24_00:11:54-rados-wip-yuri4-testing-2023-10-23-0903-distro-default-smithi/7435760/orig.config.yaml 2023-10-25T06:01:00.419 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-10-24_00:11:54-rados-wip-yuri4-testing-2023-10-23-0903-distro-default-smithi/7435760 2023-10-25T06:01:00.420 INFO:teuthology.dispatcher.supervisor:Job PID: 2781585 2023-10-25T06:01:00.420 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-25T06:03:00.422 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T06:05:00.502 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T06:07:00.572 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T06:09:00.647 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T06:11:00.714 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T06:13:00.778 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T06:15:00.856 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T06:17:00.927 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T06:19:01.003 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T06:21:01.068 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T06:23:01.140 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T06:25:01.209 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T06:27:01.271 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T06:29:01.338 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T06:31:01.424 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T06:33:01.499 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T06:35:01.561 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T06:37:01.634 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T06:39:01.700 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T06:41:01.774 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T06:43:01.844 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T06:45:01.915 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T06:47:01.990 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T06:49:02.062 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T06:49:02.144 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-25T06:49:02.292 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-25T06:49:02.292 INFO:teuthology.nuke:Checking targets against current locks 2023-10-25T06:49:02.334 DEBUG:teuthology.nuke:shortname: smithi187 2023-10-25T06:49:02.334 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-25T06:49:02.355 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi187.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-24_00:11:54-rados-wip-yuri4-testing-2023-10-23-0903-distro-default-smithi/7435760', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-25 05:56:04.264596', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHGkbD7ryw4E5kJkI46y20hdmE853VE97w2koFwqUxysCiVY1y455fRpscZSZt9JDL7MATzE34cm6UQFsV8QElQ='} 2023-10-25T06:49:02.360 DEBUG:teuthology.nuke:shortname: smithi195 2023-10-25T06:49:02.360 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-25T06:49:02.381 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi195.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-24_00:11:54-rados-wip-yuri4-testing-2023-10-23-0903-distro-default-smithi/7435760', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-25 05:56:04.266383', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDPivF4QCU2e1EpMNtHjLMeto7AJIdoYMKxvghsSC+Xk6zfxA+Roq/DasYzNca/caeDYh+mF8H+oJ2QyaEv/NdU='} 2023-10-25T06:49:02.396 INFO:teuthology.orchestra.console.smithi187:Power off 2023-10-25T06:49:02.396 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-25T06:49:02.417 DEBUG:teuthology.orchestra.console.smithi187:power off output: Chassis Power Control: Down/Off 2023-10-25T06:49:02.417 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T06:49:02.430 INFO:teuthology.orchestra.console.smithi195:Power off 2023-10-25T06:49:02.430 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-25T06:49:02.439 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off 2023-10-25T06:49:02.451 DEBUG:teuthology.orchestra.console.smithi195:power off output: Chassis Power Control: Down/Off 2023-10-25T06:49:02.452 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T06:49:02.477 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2023-10-25T06:49:02.540 INFO:teuthology.orchestra.console.smithi187:Power off completed 2023-10-25T06:49:02.579 INFO:teuthology.orchestra.console.smithi195:Power off completed 2023-10-25T06:49:02.684 INFO:teuthology.lock.ops:unlocked: smithi187.front.sepia.ceph.com 2023-10-25T06:49:02.717 INFO:teuthology.lock.ops:unlocked: smithi195.front.sepia.ceph.com