2023-10-17T00:45:24.263 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-17T00:45:24.264 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T00:45:24.416 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff63a9cc670>, signals=[15]) 2023-10-17T00:45:24.417 INFO:teuthology.lock.ops:Start node 'smithi062.front.sepia.ceph.com' reimaging 2023-10-17T00:45:24.418 INFO:teuthology.lock.ops:Updating [smithi062.front.sepia.ceph.com]: reset os type and version on server 2023-10-17T00:45:24.418 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2023-10-17T00:45:24.444 INFO:teuthology.lock.ops:Start node 'smithi183.front.sepia.ceph.com' reimaging 2023-10-17T00:45:24.444 INFO:teuthology.lock.ops:Updating [smithi183.front.sepia.ceph.com]: reset os type and version on server 2023-10-17T00:45:24.444 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server 2023-10-17T00:45:24.446 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /host {"name": "smithi062"} 2023-10-17T00:45:24.469 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /host {"name": "smithi183"} 2023-10-17T00:45:24.520 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-10-17T00:45:24.539 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-10-17T00:45:24.564 DEBUG:teuthology.provision.fog.smithi062:Requesting image smithi_centos_8.stream (ID 3) 2023-10-17T00:45:24.564 DEBUG:teuthology.provision.fog.smithi062:FOG request: PUT /host/167 {"imageID": 3} 2023-10-17T00:45:24.580 DEBUG:teuthology.provision.fog.smithi183:Requesting image smithi_centos_8.stream (ID 3) 2023-10-17T00:45:24.580 DEBUG:teuthology.provision.fog.smithi183:FOG request: PUT /host/288 {"imageID": 3} 2023-10-17T00:45:24.619 INFO:teuthology.provision.fog.smithi062:Scheduling deploy of centos 8.stream 2023-10-17T00:45:24.619 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-10-17T00:45:24.626 INFO:teuthology.provision.fog.smithi183:Scheduling deploy of centos 8.stream 2023-10-17T00:45:24.626 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-17T00:45:24.659 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /tasktype {"name": "deploy"} 2023-10-17T00:45:24.667 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /tasktype {"name": "deploy"} 2023-10-17T00:45:24.701 DEBUG:teuthology.provision.fog.smithi062:FOG request: POST /host/167/task {"taskTypeID": 1} 2023-10-17T00:45:24.705 DEBUG:teuthology.provision.fog.smithi183:FOG request: POST /host/288/task {"taskTypeID": 1} 2023-10-17T00:45:24.769 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-17T00:45:24.778 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-10-17T00:45:24.859 INFO:teuthology.orchestra.console.smithi183:Power off 2023-10-17T00:45:24.860 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-17T00:45:24.873 INFO:teuthology.orchestra.console.smithi062:Power off 2023-10-17T00:45:24.874 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-17T00:45:24.882 DEBUG:teuthology.orchestra.console.smithi183:power off output: Chassis Power Control: Down/Off 2023-10-17T00:45:24.882 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-17T00:45:24.900 DEBUG:teuthology.orchestra.console.smithi062:power off output: Chassis Power Control: Down/Off 2023-10-17T00:45:24.900 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-17T00:45:24.909 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off 2023-10-17T00:45:24.922 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is on 2023-10-17T00:45:25.011 INFO:teuthology.orchestra.console.smithi183:Power off completed 2023-10-17T00:45:25.111 INFO:teuthology.orchestra.console.smithi183:Power on 2023-10-17T00:45:25.112 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-17T00:45:25.134 DEBUG:teuthology.orchestra.console.smithi183:power on output: Chassis Power Control: Up/On 2023-10-17T00:45:25.135 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-17T00:45:25.158 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off 2023-10-17T00:45:28.926 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-17T00:45:29.035 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is on 2023-10-17T00:45:29.160 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-17T00:45:29.268 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off 2023-10-17T00:45:33.039 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-17T00:45:33.147 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is off 2023-10-17T00:45:33.248 INFO:teuthology.orchestra.console.smithi062:Power off completed 2023-10-17T00:45:33.269 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-17T00:45:33.349 INFO:teuthology.orchestra.console.smithi062:Power on 2023-10-17T00:45:33.350 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-17T00:45:33.371 DEBUG:teuthology.orchestra.console.smithi062:power on output: Chassis Power Control: Up/On 2023-10-17T00:45:33.372 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-17T00:45:33.381 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on 2023-10-17T00:45:33.396 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is off 2023-10-17T00:45:33.482 INFO:teuthology.orchestra.console.smithi183:Power on completed 2023-10-17T00:45:33.583 INFO:teuthology.provision.fog.smithi183:Waiting for deploy to finish 2023-10-17T00:45:33.583 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-17T00:45:37.398 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-17T00:45:37.507 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is off 2023-10-17T00:45:41.510 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-17T00:45:41.619 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is on 2023-10-17T00:45:41.720 INFO:teuthology.orchestra.console.smithi062:Power on completed 2023-10-17T00:45:41.821 INFO:teuthology.provision.fog.smithi062:Waiting for deploy to finish 2023-10-17T00:45:41.821 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-10-17T00:45:48.654 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-17T00:45:56.894 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-10-17T00:46:03.719 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-17T00:46:11.958 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-10-17T00:46:18.784 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-17T00:46:27.023 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-10-17T00:46:33.842 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-17T00:46:42.089 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-10-17T00:46:48.904 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-17T00:46:57.163 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-10-17T00:47:03.975 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-17T00:47:12.238 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-10-17T00:47:19.046 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-17T00:47:27.313 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-10-17T00:47:34.132 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-17T00:47:42.398 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-10-17T00:47:49.201 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-17T00:47:57.478 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-10-17T00:48:04.266 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-17T00:48:04.360 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T00:48:12.554 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-10-17T00:48:12.612 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T00:48:22.906 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2023-10-17T00:48:28.914 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T00:48:31.098 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-10-17T00:48:31.994 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2023-10-17T00:48:37.102 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T00:48:37.997 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T00:48:40.154 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-10-17T00:48:41.054 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2023-10-17T00:48:46.161 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T00:48:47.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T00:48:49.246 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-10-17T00:48:50.138 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2023-10-17T00:48:55.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T00:48:56.141 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T00:48:58.334 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-10-17T00:48:59.194 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2023-10-17T00:49:04.338 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T00:49:05.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T00:49:07.418 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-10-17T00:49:13.425 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T00:50:05.251 WARNING:teuthology.provision.fog.smithi183:timed out 2023-10-17T00:50:11.259 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T00:50:11.517 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-17T00:50:11.518 DEBUG:teuthology.orchestra.run.smithi183:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-17T00:50:11.769 INFO:teuthology.provision.fog.smithi183:Node is ready 2023-10-17T00:50:11.769 DEBUG:teuthology.orchestra.run.smithi183:> hostname 2023-10-17T00:50:11.789 INFO:teuthology.orchestra.run.smithi183.stdout:smithi183.front.sepia.ceph.com 2023-10-17T00:50:11.790 DEBUG:teuthology.orchestra.run.smithi183:> grep smithi183.front.sepia.ceph.com /etc/hosts 2023-10-17T00:50:11.849 INFO:teuthology.orchestra.run.smithi183.stdout:172.21.15.183 smithi183.front.sepia.ceph.com smithi183 2023-10-17T00:50:11.849 DEBUG:teuthology.orchestra.run.smithi183:> sudo hostname smithi183 2023-10-17T00:50:11.960 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i -e 's/smithi183.front.sepia.ceph.com/smithi183/g' /etc/hosts 2023-10-17T00:50:11.990 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i -e 's/172.21.15.183/172.21.15.183/g' /etc/hosts 2023-10-17T00:50:12.058 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i -e 's/smithi183.front.sepia.ceph.com/smithi183/g' /etc/hostname 2023-10-17T00:50:12.126 DEBUG:teuthology.orchestra.run.smithi183:> sudo hostname smithi183 2023-10-17T00:50:12.194 DEBUG:teuthology.orchestra.run.smithi183:> cat /etc/os-release 2023-10-17T00:50:12.252 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="CentOS Stream" 2023-10-17T00:50:12.253 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="8" 2023-10-17T00:50:12.253 INFO:teuthology.orchestra.run.smithi183.stdout:ID="centos" 2023-10-17T00:50:12.253 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE="rhel fedora" 2023-10-17T00:50:12.253 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="8" 2023-10-17T00:50:12.253 INFO:teuthology.orchestra.run.smithi183.stdout:PLATFORM_ID="platform:el8" 2023-10-17T00:50:12.253 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-17T00:50:12.254 INFO:teuthology.orchestra.run.smithi183.stdout:ANSI_COLOR="0;31" 2023-10-17T00:50:12.254 INFO:teuthology.orchestra.run.smithi183.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-17T00:50:12.254 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://centos.org/" 2023-10-17T00:50:12.254 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-17T00:50:12.254 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-17T00:50:12.255 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-17T00:50:12.255 INFO:teuthology.provision.fog.smithi183:Deploy complete! 2023-10-17T00:50:12.257 DEBUG:teuthology.parallel:result is None 2023-10-17T00:50:13.429 WARNING:teuthology.provision.fog.smithi062:timed out 2023-10-17T00:50:19.435 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T00:50:19.621 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-17T00:50:19.621 DEBUG:teuthology.orchestra.run.smithi062:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-17T00:50:19.873 INFO:teuthology.provision.fog.smithi062:Node is ready 2023-10-17T00:50:19.874 DEBUG:teuthology.orchestra.run.smithi062:> hostname 2023-10-17T00:50:19.893 INFO:teuthology.orchestra.run.smithi062.stdout:smithi062.front.sepia.ceph.com 2023-10-17T00:50:19.894 DEBUG:teuthology.orchestra.run.smithi062:> grep smithi062.front.sepia.ceph.com /etc/hosts 2023-10-17T00:50:19.954 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62 smithi062.front.sepia.ceph.com smithi062 2023-10-17T00:50:19.954 DEBUG:teuthology.orchestra.run.smithi062:> sudo hostname smithi062 2023-10-17T00:50:20.071 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/smithi062.front.sepia.ceph.com/smithi062/g' /etc/hosts 2023-10-17T00:50:20.102 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/172.21.15.62/172.21.15.62/g' /etc/hosts 2023-10-17T00:50:20.171 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/smithi062.front.sepia.ceph.com/smithi062/g' /etc/hostname 2023-10-17T00:50:20.241 DEBUG:teuthology.orchestra.run.smithi062:> sudo hostname smithi062 2023-10-17T00:50:20.308 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release 2023-10-17T00:50:20.367 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="CentOS Stream" 2023-10-17T00:50:20.367 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="8" 2023-10-17T00:50:20.367 INFO:teuthology.orchestra.run.smithi062.stdout:ID="centos" 2023-10-17T00:50:20.368 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="rhel fedora" 2023-10-17T00:50:20.368 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="8" 2023-10-17T00:50:20.368 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM_ID="platform:el8" 2023-10-17T00:50:20.368 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-17T00:50:20.368 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31" 2023-10-17T00:50:20.369 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-17T00:50:20.369 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://centos.org/" 2023-10-17T00:50:20.369 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-17T00:50:20.369 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-17T00:50:20.369 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-17T00:50:20.370 INFO:teuthology.provision.fog.smithi062:Deploy complete! 2023-10-17T00:50:20.371 DEBUG:teuthology.parallel:result is None 2023-10-17T00:50:20.517 INFO:teuthology.lock.ops:Checking smithi062.front.sepia.ceph.com 2023-10-17T00:50:20.518 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-17T00:50:20.548 INFO:teuthology.lock.ops:Checking smithi183.front.sepia.ceph.com 2023-10-17T00:50:20.548 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-17T00:50:20.565 INFO:teuthology.lock.ops:Updating [smithi062.front.sepia.ceph.com]: set os type and version on server 2023-10-17T00:50:20.566 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2023-10-17T00:50:20.567 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T00:50:20.631 DEBUG:teuthology.orchestra.run.smithi062:> true 2023-10-17T00:50:20.700 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi062.front.sepia.ceph.com' 2023-10-17T00:50:20.700 DEBUG:teuthology.orchestra.run.smithi062:> uname -m 2023-10-17T00:50:20.757 INFO:teuthology.orchestra.run.smithi062.stdout:x86_64 2023-10-17T00:50:20.758 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release 2023-10-17T00:50:20.818 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="CentOS Stream" 2023-10-17T00:50:20.819 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="8" 2023-10-17T00:50:20.819 INFO:teuthology.orchestra.run.smithi062.stdout:ID="centos" 2023-10-17T00:50:20.819 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="rhel fedora" 2023-10-17T00:50:20.819 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="8" 2023-10-17T00:50:20.819 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM_ID="platform:el8" 2023-10-17T00:50:20.820 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-17T00:50:20.820 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31" 2023-10-17T00:50:20.820 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-17T00:50:20.820 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://centos.org/" 2023-10-17T00:50:20.820 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-17T00:50:20.820 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-17T00:50:20.821 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-17T00:50:20.821 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2023-10-17T00:50:20.840 INFO:teuthology.lock.ops:Updating [smithi183.front.sepia.ceph.com]: set os type and version on server 2023-10-17T00:50:20.841 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com' 2023-10-17T00:50:20.841 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T00:50:20.909 DEBUG:teuthology.orchestra.run.smithi183:> true 2023-10-17T00:50:20.983 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi183.front.sepia.ceph.com' 2023-10-17T00:50:20.983 DEBUG:teuthology.orchestra.run.smithi183:> uname -m 2023-10-17T00:50:21.043 INFO:teuthology.orchestra.run.smithi183.stdout:x86_64 2023-10-17T00:50:21.044 DEBUG:teuthology.orchestra.run.smithi183:> cat /etc/os-release 2023-10-17T00:50:21.103 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="CentOS Stream" 2023-10-17T00:50:21.104 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="8" 2023-10-17T00:50:21.104 INFO:teuthology.orchestra.run.smithi183.stdout:ID="centos" 2023-10-17T00:50:21.104 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE="rhel fedora" 2023-10-17T00:50:21.104 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="8" 2023-10-17T00:50:21.104 INFO:teuthology.orchestra.run.smithi183.stdout:PLATFORM_ID="platform:el8" 2023-10-17T00:50:21.104 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-17T00:50:21.105 INFO:teuthology.orchestra.run.smithi183.stdout:ANSI_COLOR="0;31" 2023-10-17T00:50:21.105 INFO:teuthology.orchestra.run.smithi183.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-17T00:50:21.105 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://centos.org/" 2023-10-17T00:50:21.105 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-17T00:50:21.105 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-17T00:50:21.106 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-17T00:50:21.106 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server 2023-10-17T00:50:21.123 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T00:50:21.232 INFO:teuthology.dispatcher.supervisor:Running job 7429579 2023-10-17T00:50:21.233 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-10-16_14:43:00-fs-wip-yuri4-testing-2023-10-11-0735-reef-distro-default-smithi/7429579 --name yuriw-2023-10-16_14:43:00-fs-wip-yuri4-testing-2023-10-11-0735-reef-distro-default-smithi --description fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_snaptests}} -- /home/teuthworker/archive/yuriw-2023-10-16_14:43:00-fs-wip-yuri4-testing-2023-10-11-0735-reef-distro-default-smithi/7429579/orig.config.yaml 2023-10-17T00:50:21.236 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-10-16_14:43:00-fs-wip-yuri4-testing-2023-10-11-0735-reef-distro-default-smithi/7429579 2023-10-17T00:50:21.237 INFO:teuthology.dispatcher.supervisor:Job PID: 3183216 2023-10-17T00:50:21.237 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-17T00:52:21.314 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T00:54:21.475 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T00:56:21.639 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T00:58:21.806 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T01:00:21.983 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T01:02:22.149 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T01:04:22.314 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T01:06:22.486 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T01:08:22.653 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T01:10:22.824 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T01:12:22.990 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T01:14:23.143 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T01:16:23.303 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T01:18:23.428 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T01:20:23.593 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T01:22:23.763 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T01:24:23.932 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T01:26:24.099 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T01:28:24.267 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T01:30:24.431 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T01:32:24.599 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T01:34:24.763 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T01:36:24.927 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T01:38:25.092 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T01:40:25.263 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T01:40:25.364 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-17T01:40:25.519 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-17T01:40:25.520 INFO:teuthology.nuke:Checking targets against current locks 2023-10-17T01:40:25.569 DEBUG:teuthology.nuke:shortname: smithi062 2023-10-17T01:40:25.570 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-17T01:40:25.587 DEBUG:teuthology.nuke:shortname: smithi183 2023-10-17T01:40:25.587 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-17T01:40:25.593 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi062.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-16_14:43:00-fs-wip-yuri4-testing-2023-10-11-0735-reef-distro-default-smithi/7429579', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-17 00:45:23.384372', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEboC5phqwwdyYIZm+nN5LxPIDNq4ieBKnh+g6fBCY0aU2ktN358s7XbCjGv112F6WfIE2dxF5I2z7gGrCNBbzs='} 2023-10-17T01:40:25.607 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi183.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-16_14:43:00-fs-wip-yuri4-testing-2023-10-11-0735-reef-distro-default-smithi/7429579', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-17 00:45:23.385847', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDne8uo3TNF0erWSdsuO/AfEVKtvOU6duUubcIzQWOd44B8V/M1zThHycor1BUOLh2nTrzgd/CVwUBEFjDTCmmw='} 2023-10-17T01:40:25.637 INFO:teuthology.orchestra.console.smithi062:Power off 2023-10-17T01:40:25.637 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-17T01:40:25.659 DEBUG:teuthology.orchestra.console.smithi062:power off output: Chassis Power Control: Down/Off 2023-10-17T01:40:25.659 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-17T01:40:25.672 INFO:teuthology.orchestra.console.smithi183:Power off 2023-10-17T01:40:25.672 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-17T01:40:25.682 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is off 2023-10-17T01:40:25.693 DEBUG:teuthology.orchestra.console.smithi183:power off output: Chassis Power Control: Down/Off 2023-10-17T01:40:25.693 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-17T01:40:25.714 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off 2023-10-17T01:40:25.784 INFO:teuthology.orchestra.console.smithi062:Power off completed 2023-10-17T01:40:25.815 INFO:teuthology.orchestra.console.smithi183:Power off completed 2023-10-17T01:40:25.929 INFO:teuthology.lock.ops:unlocked: smithi062.front.sepia.ceph.com 2023-10-17T01:40:25.963 INFO:teuthology.lock.ops:unlocked: smithi183.front.sepia.ceph.com