2023-11-08T00:33:25.950 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-08T00:33:25.952 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T00:33:26.102 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb6f497d670>, signals=[15]) 2023-11-08T00:33:26.103 INFO:teuthology.lock.ops:Start node 'smithi073.front.sepia.ceph.com' reimaging 2023-11-08T00:33:26.103 INFO:teuthology.lock.ops:Updating [smithi073.front.sepia.ceph.com]: reset os type and version on server 2023-11-08T00:33:26.104 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2023-11-08T00:33:26.123 INFO:teuthology.lock.ops:Start node 'smithi179.front.sepia.ceph.com' reimaging 2023-11-08T00:33:26.124 INFO:teuthology.lock.ops:Updating [smithi179.front.sepia.ceph.com]: reset os type and version on server 2023-11-08T00:33:26.124 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server 2023-11-08T00:33:26.125 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /host {"name": "smithi073"} 2023-11-08T00:33:26.148 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /host {"name": "smithi179"} 2023-11-08T00:33:26.206 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-11-08T00:33:26.210 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-11-08T00:33:26.250 DEBUG:teuthology.provision.fog.smithi179:Requesting image smithi_centos_8.stream (ID 3) 2023-11-08T00:33:26.250 DEBUG:teuthology.provision.fog.smithi179:FOG request: PUT /host/284 {"imageID": 3} 2023-11-08T00:33:26.253 DEBUG:teuthology.provision.fog.smithi073:Requesting image smithi_centos_8.stream (ID 3) 2023-11-08T00:33:26.254 DEBUG:teuthology.provision.fog.smithi073:FOG request: PUT /host/178 {"imageID": 3} 2023-11-08T00:33:26.292 INFO:teuthology.provision.fog.smithi073:Scheduling deploy of centos 8.stream 2023-11-08T00:33:26.293 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-11-08T00:33:26.296 INFO:teuthology.provision.fog.smithi179:Scheduling deploy of centos 8.stream 2023-11-08T00:33:26.297 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-11-08T00:33:26.342 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /tasktype {"name": "deploy"} 2023-11-08T00:33:26.345 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /tasktype {"name": "deploy"} 2023-11-08T00:33:26.381 DEBUG:teuthology.provision.fog.smithi179:FOG request: POST /host/284/task {"taskTypeID": 1} 2023-11-08T00:33:26.386 DEBUG:teuthology.provision.fog.smithi073:FOG request: POST /host/178/task {"taskTypeID": 1} 2023-11-08T00:33:26.436 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-11-08T00:33:26.443 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-11-08T00:33:26.517 INFO:teuthology.orchestra.console.smithi073:Power off 2023-11-08T00:33:26.518 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-08T00:33:26.531 INFO:teuthology.orchestra.console.smithi179:Power off 2023-11-08T00:33:26.532 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-08T00:33:26.541 DEBUG:teuthology.orchestra.console.smithi073:power off output: Chassis Power Control: Down/Off 2023-11-08T00:33:26.542 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T00:33:26.552 DEBUG:teuthology.orchestra.console.smithi179:power off output: Chassis Power Control: Down/Off 2023-11-08T00:33:26.553 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T00:33:26.564 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is off 2023-11-08T00:33:26.576 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2023-11-08T00:33:26.665 INFO:teuthology.orchestra.console.smithi073:Power off completed 2023-11-08T00:33:26.677 INFO:teuthology.orchestra.console.smithi179:Power off completed 2023-11-08T00:33:26.766 INFO:teuthology.orchestra.console.smithi073:Power on 2023-11-08T00:33:26.767 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-08T00:33:26.779 INFO:teuthology.orchestra.console.smithi179:Power on 2023-11-08T00:33:26.779 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-08T00:33:26.790 DEBUG:teuthology.orchestra.console.smithi073:power on output: Chassis Power Control: Up/On 2023-11-08T00:33:26.791 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T00:33:26.803 DEBUG:teuthology.orchestra.console.smithi179:power on output: Chassis Power Control: Up/On 2023-11-08T00:33:26.803 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T00:33:26.815 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is off 2023-11-08T00:33:26.827 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2023-11-08T00:33:30.818 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T00:33:30.828 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T00:33:30.927 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is off 2023-11-08T00:33:30.938 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2023-11-08T00:33:34.930 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T00:33:34.939 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T00:33:35.039 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on 2023-11-08T00:33:35.050 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2023-11-08T00:33:35.140 INFO:teuthology.orchestra.console.smithi073:Power on completed 2023-11-08T00:33:35.152 INFO:teuthology.orchestra.console.smithi179:Power on completed 2023-11-08T00:33:35.241 INFO:teuthology.provision.fog.smithi073:Waiting for deploy to finish 2023-11-08T00:33:35.242 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-11-08T00:33:35.253 INFO:teuthology.provision.fog.smithi179:Waiting for deploy to finish 2023-11-08T00:33:35.254 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-11-08T00:33:50.313 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-11-08T00:33:50.315 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-11-08T00:34:05.382 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-11-08T00:34:05.384 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-11-08T00:34:20.454 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-11-08T00:34:20.456 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-11-08T00:34:35.526 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-11-08T00:34:35.528 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-11-08T00:34:50.594 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-11-08T00:34:50.596 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-11-08T00:35:05.666 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-11-08T00:35:05.668 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-11-08T00:35:05.734 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T00:35:08.798 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-11-08T00:35:14.800 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T00:35:17.854 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-11-08T00:35:20.730 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-11-08T00:35:23.859 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T00:35:26.942 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-11-08T00:35:32.947 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T00:35:35.797 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-11-08T00:35:36.026 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-11-08T00:35:42.031 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T00:35:45.082 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-11-08T00:35:50.866 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-11-08T00:35:51.083 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T00:35:54.138 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-11-08T00:36:00.142 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T00:36:03.198 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-11-08T00:36:05.926 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-11-08T00:36:09.203 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T00:36:12.282 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-11-08T00:36:18.287 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T00:36:20.990 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-11-08T00:36:21.048 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T00:36:24.123 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-11-08T00:36:28.410 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-11-08T00:36:30.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T00:36:33.182 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-11-08T00:36:34.413 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T00:36:37.466 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-11-08T00:36:39.185 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T00:36:42.267 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-11-08T00:36:43.469 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T00:36:44.208 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-11-08T00:36:48.270 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T00:36:50.212 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T00:36:50.336 ERROR:teuthology.orchestra.connection:Error authenticating with smithi073.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-11-08T00:36:51.322 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-11-08T00:36:54.419 ERROR:teuthology.orchestra.connection:Error authenticating with smithi073.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-11-08T00:36:57.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T00:37:00.378 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-11-08T00:37:01.502 ERROR:teuthology.orchestra.connection:Error authenticating with smithi073.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-11-08T00:37:06.380 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T00:37:09.438 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-11-08T00:37:11.584 ERROR:teuthology.orchestra.connection:Error authenticating with smithi073.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-11-08T00:37:15.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T00:37:24.707 ERROR:teuthology.orchestra.connection:Error authenticating with smithi073.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-11-08T00:37:33.946 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-11-08T00:37:39.948 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T00:37:40.995 ERROR:teuthology.orchestra.connection:Error authenticating with smithi073.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-11-08T00:37:43.002 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-11-08T00:37:49.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T00:37:50.925 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-08T00:37:50.926 DEBUG:teuthology.orchestra.run.smithi179:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-08T00:38:16.389 INFO:teuthology.provision.fog.smithi179:Node is ready 2023-11-08T00:38:16.390 DEBUG:teuthology.orchestra.run.smithi179:> hostname 2023-11-08T00:38:16.456 INFO:teuthology.orchestra.run.smithi179.stdout:smithi179.front.sepia.ceph.com 2023-11-08T00:38:16.456 DEBUG:teuthology.orchestra.run.smithi179:> grep smithi179.front.sepia.ceph.com /etc/hosts 2023-11-08T00:38:16.516 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.15.179 smithi179.front.sepia.ceph.com smithi179 2023-11-08T00:38:16.517 DEBUG:teuthology.orchestra.run.smithi179:> sudo hostname smithi179 2023-11-08T00:38:16.645 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/smithi179.front.sepia.ceph.com/smithi179/g' /etc/hosts 2023-11-08T00:38:16.677 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/172.21.15.179/172.21.15.179/g' /etc/hosts 2023-11-08T00:38:16.748 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/smithi179.front.sepia.ceph.com/smithi179/g' /etc/hostname 2023-11-08T00:38:16.818 DEBUG:teuthology.orchestra.run.smithi179:> sudo hostname smithi179 2023-11-08T00:38:16.887 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release 2023-11-08T00:38:16.946 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="CentOS Stream" 2023-11-08T00:38:16.946 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="8" 2023-11-08T00:38:16.946 INFO:teuthology.orchestra.run.smithi179.stdout:ID="centos" 2023-11-08T00:38:16.947 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE="rhel fedora" 2023-11-08T00:38:16.947 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="8" 2023-11-08T00:38:16.947 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM_ID="platform:el8" 2023-11-08T00:38:16.947 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-08T00:38:16.947 INFO:teuthology.orchestra.run.smithi179.stdout:ANSI_COLOR="0;31" 2023-11-08T00:38:16.948 INFO:teuthology.orchestra.run.smithi179.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-08T00:38:16.948 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://centos.org/" 2023-11-08T00:38:16.948 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-08T00:38:16.948 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-08T00:38:16.948 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-08T00:38:16.949 INFO:teuthology.provision.fog.smithi179:Deploy complete! 2023-11-08T00:38:16.951 DEBUG:teuthology.parallel:result is None 2023-11-08T00:38:59.998 WARNING:teuthology.provision.fog.smithi073:timed out 2023-11-08T00:39:06.002 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T00:39:10.106 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-11-08T00:39:16.108 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T00:39:16.609 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-11-08T00:39:22.611 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T00:39:22.871 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-08T00:39:22.872 DEBUG:teuthology.orchestra.run.smithi073:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-08T00:39:43.471 INFO:teuthology.provision.fog.smithi073:Node is ready 2023-11-08T00:39:43.471 DEBUG:teuthology.orchestra.run.smithi073:> hostname 2023-11-08T00:39:43.493 INFO:teuthology.orchestra.run.smithi073.stdout:smithi193 2023-11-08T00:39:43.493 DEBUG:teuthology.orchestra.run.smithi073:> grep smithi193 /etc/hosts 2023-11-08T00:39:43.555 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.193 smithi193.front.sepia.ceph.com smithi193 2023-11-08T00:39:43.555 DEBUG:teuthology.orchestra.run.smithi073:> sudo hostname smithi073 2023-11-08T00:39:43.687 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i -e 's/smithi193/smithi073/g' /etc/hosts 2023-11-08T00:39:43.719 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i -e 's/172.21.15.193/172.21.15.73/g' /etc/hosts 2023-11-08T00:39:43.790 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i -e 's/smithi193/smithi073/g' /etc/hostname 2023-11-08T00:39:43.862 DEBUG:teuthology.orchestra.run.smithi073:> sudo hostname smithi073 2023-11-08T00:39:43.930 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release 2023-11-08T00:39:43.989 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="CentOS Stream" 2023-11-08T00:39:43.989 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="8" 2023-11-08T00:39:43.989 INFO:teuthology.orchestra.run.smithi073.stdout:ID="centos" 2023-11-08T00:39:43.989 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="rhel fedora" 2023-11-08T00:39:43.990 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="8" 2023-11-08T00:39:43.990 INFO:teuthology.orchestra.run.smithi073.stdout:PLATFORM_ID="platform:el8" 2023-11-08T00:39:43.990 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-08T00:39:43.990 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31" 2023-11-08T00:39:43.990 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-08T00:39:43.991 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://centos.org/" 2023-11-08T00:39:43.991 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-08T00:39:43.991 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-08T00:39:43.991 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-08T00:39:43.992 INFO:teuthology.provision.fog.smithi073:Deploy complete! 2023-11-08T00:39:43.992 DEBUG:teuthology.parallel:result is None 2023-11-08T00:39:44.144 INFO:teuthology.lock.ops:Checking smithi073.front.sepia.ceph.com 2023-11-08T00:39:44.145 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-08T00:39:44.168 INFO:teuthology.lock.ops:Checking smithi179.front.sepia.ceph.com 2023-11-08T00:39:44.169 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-08T00:39:44.186 INFO:teuthology.lock.ops:Updating [smithi073.front.sepia.ceph.com]: set os type and version on server 2023-11-08T00:39:44.186 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-11-08T00:39:44.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T00:39:44.261 DEBUG:teuthology.orchestra.run.smithi073:> true 2023-11-08T00:39:44.328 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-11-08T00:39:44.329 DEBUG:teuthology.orchestra.run.smithi073:> uname -m 2023-11-08T00:39:44.386 INFO:teuthology.orchestra.run.smithi073.stdout:x86_64 2023-11-08T00:39:44.386 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release 2023-11-08T00:39:44.444 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="CentOS Stream" 2023-11-08T00:39:44.444 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="8" 2023-11-08T00:39:44.444 INFO:teuthology.orchestra.run.smithi073.stdout:ID="centos" 2023-11-08T00:39:44.444 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="rhel fedora" 2023-11-08T00:39:44.445 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="8" 2023-11-08T00:39:44.445 INFO:teuthology.orchestra.run.smithi073.stdout:PLATFORM_ID="platform:el8" 2023-11-08T00:39:44.445 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-08T00:39:44.445 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31" 2023-11-08T00:39:44.446 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-08T00:39:44.446 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://centos.org/" 2023-11-08T00:39:44.446 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-08T00:39:44.446 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-08T00:39:44.446 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-08T00:39:44.447 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2023-11-08T00:39:44.470 INFO:teuthology.lock.ops:Updating [smithi179.front.sepia.ceph.com]: set os type and version on server 2023-11-08T00:39:44.470 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2023-11-08T00:39:44.471 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T00:39:44.539 DEBUG:teuthology.orchestra.run.smithi179:> true 2023-11-08T00:39:44.677 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi179.front.sepia.ceph.com' 2023-11-08T00:39:44.678 DEBUG:teuthology.orchestra.run.smithi179:> uname -m 2023-11-08T00:39:44.736 INFO:teuthology.orchestra.run.smithi179.stdout:x86_64 2023-11-08T00:39:44.736 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release 2023-11-08T00:39:44.795 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="CentOS Stream" 2023-11-08T00:39:44.795 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="8" 2023-11-08T00:39:44.796 INFO:teuthology.orchestra.run.smithi179.stdout:ID="centos" 2023-11-08T00:39:44.796 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE="rhel fedora" 2023-11-08T00:39:44.796 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="8" 2023-11-08T00:39:44.796 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM_ID="platform:el8" 2023-11-08T00:39:44.796 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-08T00:39:44.796 INFO:teuthology.orchestra.run.smithi179.stdout:ANSI_COLOR="0;31" 2023-11-08T00:39:44.797 INFO:teuthology.orchestra.run.smithi179.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-08T00:39:44.797 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://centos.org/" 2023-11-08T00:39:44.797 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-08T00:39:44.797 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-08T00:39:44.797 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-08T00:39:44.799 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server 2023-11-08T00:39:44.818 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T00:39:44.917 INFO:teuthology.dispatcher.supervisor:Running job 7451102 2023-11-08T00:39:44.917 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-11-07_19:34:21-rados-wip-yuri3-testing-2023-11-07-0801-pacific-distro-default-smithi/7451102 --name yuriw-2023-11-07_19:34:21-rados-wip-yuri3-testing-2023-11-07-0801-pacific-distro-default-smithi --description rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} -- /home/teuthworker/archive/yuriw-2023-11-07_19:34:21-rados-wip-yuri3-testing-2023-11-07-0801-pacific-distro-default-smithi/7451102/orig.config.yaml 2023-11-08T00:39:44.920 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-11-07_19:34:21-rados-wip-yuri3-testing-2023-11-07-0801-pacific-distro-default-smithi/7451102 2023-11-08T00:39:44.921 INFO:teuthology.dispatcher.supervisor:Job PID: 4007658 2023-11-08T00:39:44.921 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-08T00:41:44.923 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T00:41:44.989 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-11-08T00:41:45.089 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi073 but it was locked by another job: /home/teuthworker/archive/yuriw-2023-11-07_19:34:21-rados-wip-yuri3-testing-2023-11-07-0801-pacific-distro-default-smithi/7451104 2023-11-08T00:41:45.089 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-08T00:41:45.090 INFO:teuthology.nuke:Checking targets against current locks 2023-11-08T00:41:45.140 DEBUG:teuthology.nuke:shortname: smithi073 2023-11-08T00:41:45.140 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-08T00:41:45.159 DEBUG:teuthology.nuke:shortname: smithi179 2023-11-08T00:41:45.159 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-08T00:41:45.162 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi073.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-07_19:34:21-rados-wip-yuri3-testing-2023-11-07-0801-pacific-distro-default-smithi/7451104', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-08 00:34:56.050590', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGC8d6nskpb0wo49nKVDXmCOWLH11XgowcL22HAl8D25oCFaoACok4G0LSmX2UrD6bHdde+hnnCFWpU2coZ6LyM='} 2023-11-08T00:41:45.185 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi179.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-07_19:34:21-rados-wip-yuri3-testing-2023-11-07-0801-pacific-distro-default-smithi/7451102', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-08 00:33:25.110611', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBME3Hz8L1P2UNZ+SLGkXO+Gwo4DW38lhQO6TnDnGzGUTzV6ilZHvg8pLIkGWdVzbpeRN60qh8YExXtnJxs6LCJA='} 2023-11-08T00:41:45.209 INFO:teuthology.orchestra.console.smithi073:Power off 2023-11-08T00:41:45.209 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-08T00:41:45.231 DEBUG:teuthology.orchestra.console.smithi073:power off output: Chassis Power Control: Down/Off 2023-11-08T00:41:45.232 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T00:41:45.247 INFO:teuthology.orchestra.console.smithi179:Power off 2023-11-08T00:41:45.247 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-08T00:41:45.256 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is off 2023-11-08T00:41:45.269 DEBUG:teuthology.orchestra.console.smithi179:power off output: Chassis Power Control: Down/Off 2023-11-08T00:41:45.269 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T00:41:45.292 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2023-11-08T00:41:45.357 INFO:teuthology.orchestra.console.smithi073:Power off completed 2023-11-08T00:41:45.393 INFO:teuthology.orchestra.console.smithi179:Power off completed 2023-11-08T00:41:45.514 INFO:teuthology.lock.ops:unlocked: smithi073.front.sepia.ceph.com 2023-11-08T00:41:45.539 INFO:teuthology.lock.ops:unlocked: smithi179.front.sepia.ceph.com