2023-08-23T03:50:04.874 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-23T03:50:04.876 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T03:50:05.021 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fcf36fb4310>, signals=[15]) 2023-08-23T03:50:05.024 INFO:teuthology.lock.ops:Start node 'smithi179.front.sepia.ceph.com' reimaging 2023-08-23T03:50:05.024 INFO:teuthology.lock.ops:Updating [smithi179.front.sepia.ceph.com]: reset os type and version on server 2023-08-23T03:50:05.025 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server 2023-08-23T03:50:05.050 INFO:teuthology.lock.ops:Start node 'smithi192.front.sepia.ceph.com' reimaging 2023-08-23T03:50:05.050 INFO:teuthology.lock.ops:Updating [smithi192.front.sepia.ceph.com]: reset os type and version on server 2023-08-23T03:50:05.051 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2023-08-23T03:50:05.052 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /host {"name": "smithi179"} 2023-08-23T03:50:05.074 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /host {"name": "smithi192"} 2023-08-23T03:50:05.130 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-08-23T03:50:05.158 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-08-23T03:50:05.177 DEBUG:teuthology.provision.fog.smithi179:Requesting image smithi_centos_9.stream (ID 10) 2023-08-23T03:50:05.178 DEBUG:teuthology.provision.fog.smithi179:FOG request: PUT /host/284 {"imageID": 10} 2023-08-23T03:50:05.210 DEBUG:teuthology.provision.fog.smithi192:Requesting image smithi_centos_9.stream (ID 10) 2023-08-23T03:50:05.210 DEBUG:teuthology.provision.fog.smithi192:FOG request: PUT /host/297 {"imageID": 10} 2023-08-23T03:50:05.226 INFO:teuthology.provision.fog.smithi179:Scheduling deploy of centos 9.stream 2023-08-23T03:50:05.226 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-23T03:50:05.275 INFO:teuthology.provision.fog.smithi192:Scheduling deploy of centos 9.stream 2023-08-23T03:50:05.276 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-08-23T03:50:05.283 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /tasktype {"name": "deploy"} 2023-08-23T03:50:05.321 DEBUG:teuthology.provision.fog.smithi179:FOG request: POST /host/284/task {"taskTypeID": 1} 2023-08-23T03:50:05.325 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /tasktype {"name": "deploy"} 2023-08-23T03:50:05.356 DEBUG:teuthology.provision.fog.smithi192:FOG request: POST /host/297/task {"taskTypeID": 1} 2023-08-23T03:50:05.460 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-23T03:50:05.475 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-08-23T03:50:05.558 INFO:teuthology.orchestra.console.smithi179:Power off 2023-08-23T03:50:05.559 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-23T03:50:05.576 INFO:teuthology.orchestra.console.smithi192:Power off 2023-08-23T03:50:05.577 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-23T03:50:05.589 DEBUG:teuthology.orchestra.console.smithi179:power off output: Chassis Power Control: Down/Off 2023-08-23T03:50:05.590 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T03:50:05.603 DEBUG:teuthology.orchestra.console.smithi192:power off output: Chassis Power Control: Down/Off 2023-08-23T03:50:05.604 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T03:50:05.615 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2023-08-23T03:50:05.627 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on 2023-08-23T03:50:09.620 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T03:50:09.631 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T03:50:09.733 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2023-08-23T03:50:09.743 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on 2023-08-23T03:50:13.736 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T03:50:13.746 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T03:50:13.848 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2023-08-23T03:50:13.857 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on 2023-08-23T03:50:13.950 INFO:teuthology.orchestra.console.smithi179:Power off completed 2023-08-23T03:50:14.051 INFO:teuthology.orchestra.console.smithi179:Power on 2023-08-23T03:50:14.051 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-23T03:50:14.074 DEBUG:teuthology.orchestra.console.smithi179:power on output: Chassis Power Control: Up/On 2023-08-23T03:50:14.075 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T03:50:14.097 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2023-08-23T03:50:17.860 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T03:50:17.970 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off 2023-08-23T03:50:18.071 INFO:teuthology.orchestra.console.smithi192:Power off completed 2023-08-23T03:50:18.098 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T03:50:18.173 INFO:teuthology.orchestra.console.smithi192:Power on 2023-08-23T03:50:18.174 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-23T03:50:18.197 DEBUG:teuthology.orchestra.console.smithi192:power on output: Chassis Power Control: Up/On 2023-08-23T03:50:18.198 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T03:50:18.209 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2023-08-23T03:50:18.219 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off 2023-08-23T03:50:22.212 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T03:50:22.220 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T03:50:22.330 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off 2023-08-23T03:50:22.336 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2023-08-23T03:50:22.437 INFO:teuthology.orchestra.console.smithi179:Power on completed 2023-08-23T03:50:22.538 INFO:teuthology.provision.fog.smithi179:Waiting for deploy to finish 2023-08-23T03:50:22.539 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-23T03:50:26.332 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T03:50:26.563 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on 2023-08-23T03:50:26.664 INFO:teuthology.orchestra.console.smithi192:Power on completed 2023-08-23T03:50:26.764 INFO:teuthology.provision.fog.smithi192:Waiting for deploy to finish 2023-08-23T03:50:26.765 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-08-23T03:50:37.612 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-23T03:50:41.829 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-08-23T03:50:52.684 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-23T03:50:56.896 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-08-23T03:51:07.748 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-23T03:51:11.964 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-08-23T03:51:22.816 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-23T03:51:27.028 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-08-23T03:51:37.884 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-23T03:51:42.104 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-08-23T03:51:52.960 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-23T03:51:57.164 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-08-23T03:52:08.032 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-23T03:52:12.225 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-08-23T03:52:23.096 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-23T03:52:27.296 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-08-23T03:52:38.169 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-23T03:52:42.367 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-08-23T03:52:53.240 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-23T03:52:53.308 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T03:52:56.368 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-08-23T03:52:57.430 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-08-23T03:52:57.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T03:53:00.564 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-08-23T03:53:02.372 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T03:53:05.428 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-08-23T03:53:06.567 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T03:53:09.648 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-08-23T03:53:11.431 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T03:53:14.512 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-08-23T03:53:15.650 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T03:53:18.708 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-08-23T03:53:20.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T03:53:23.572 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-08-23T03:53:24.711 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T03:53:27.797 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-08-23T03:53:29.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T03:53:32.660 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-08-23T03:53:33.799 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T03:53:36.884 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-08-23T03:53:38.662 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T03:53:41.716 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-08-23T03:53:42.886 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T03:53:45.936 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-08-23T03:53:47.719 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T03:53:50.804 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-08-23T03:53:51.939 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T03:53:54.996 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-08-23T03:53:56.808 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T03:54:01.001 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T03:54:15.280 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-08-23T03:54:21.284 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T03:54:24.336 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-08-23T03:54:30.340 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T03:54:32.287 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-23T03:54:32.288 DEBUG:teuthology.orchestra.run.smithi179:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-23T03:54:57.435 INFO:teuthology.provision.fog.smithi179:Node is ready 2023-08-23T03:54:57.435 DEBUG:teuthology.orchestra.run.smithi179:> hostname 2023-08-23T03:54:57.455 INFO:teuthology.orchestra.run.smithi179.stdout:smithi179.front.sepia.ceph.com 2023-08-23T03:54:57.456 DEBUG:teuthology.orchestra.run.smithi179:> grep smithi179.front.sepia.ceph.com /etc/hosts 2023-08-23T03:54:57.512 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.15.179 smithi179.front.sepia.ceph.com smithi179 2023-08-23T03:54:57.513 DEBUG:teuthology.orchestra.run.smithi179:> sudo hostname smithi179 2023-08-23T03:54:57.651 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/smithi179.front.sepia.ceph.com/smithi179/g' /etc/hosts 2023-08-23T03:54:57.681 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/172.21.15.179/172.21.15.179/g' /etc/hosts 2023-08-23T03:54:57.751 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/smithi179.front.sepia.ceph.com/smithi179/g' /etc/hostname 2023-08-23T03:54:57.821 DEBUG:teuthology.orchestra.run.smithi179:> sudo hostname smithi179 2023-08-23T03:54:57.888 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release 2023-08-23T03:54:57.947 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="CentOS Stream" 2023-08-23T03:54:57.948 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="9" 2023-08-23T03:54:57.948 INFO:teuthology.orchestra.run.smithi179.stdout:ID="centos" 2023-08-23T03:54:57.948 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE="rhel fedora" 2023-08-23T03:54:57.948 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="9" 2023-08-23T03:54:57.948 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM_ID="platform:el9" 2023-08-23T03:54:57.949 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-23T03:54:57.949 INFO:teuthology.orchestra.run.smithi179.stdout:ANSI_COLOR="0;31" 2023-08-23T03:54:57.949 INFO:teuthology.orchestra.run.smithi179.stdout:LOGO="fedora-logo-icon" 2023-08-23T03:54:57.950 INFO:teuthology.orchestra.run.smithi179.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-23T03:54:57.950 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://centos.org/" 2023-08-23T03:54:57.950 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-23T03:54:57.950 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-23T03:54:57.951 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-23T03:54:57.952 INFO:teuthology.provision.fog.smithi179:Deploy complete! 2023-08-23T03:54:57.953 DEBUG:teuthology.parallel:result is None 2023-08-23T03:55:01.003 WARNING:teuthology.provision.fog.smithi192:timed out 2023-08-23T03:55:07.005 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T03:55:07.185 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-23T03:55:07.186 DEBUG:teuthology.orchestra.run.smithi192:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-23T03:55:07.482 INFO:teuthology.provision.fog.smithi192:Node is ready 2023-08-23T03:55:07.483 DEBUG:teuthology.orchestra.run.smithi192:> hostname 2023-08-23T03:55:07.498 INFO:teuthology.orchestra.run.smithi192.stdout:smithi192.front.sepia.ceph.com 2023-08-23T03:55:07.498 DEBUG:teuthology.orchestra.run.smithi192:> grep smithi192.front.sepia.ceph.com /etc/hosts 2023-08-23T03:55:07.550 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.15.192 smithi192.front.sepia.ceph.com smithi192 2023-08-23T03:55:07.550 DEBUG:teuthology.orchestra.run.smithi192:> sudo hostname smithi192 2023-08-23T03:55:07.671 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/smithi192.front.sepia.ceph.com/smithi192/g' /etc/hosts 2023-08-23T03:55:07.699 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/172.21.15.192/172.21.15.192/g' /etc/hosts 2023-08-23T03:55:07.765 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/smithi192.front.sepia.ceph.com/smithi192/g' /etc/hostname 2023-08-23T03:55:07.830 DEBUG:teuthology.orchestra.run.smithi192:> sudo hostname smithi192 2023-08-23T03:55:07.894 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release 2023-08-23T03:55:07.946 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="CentOS Stream" 2023-08-23T03:55:07.946 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="9" 2023-08-23T03:55:07.946 INFO:teuthology.orchestra.run.smithi192.stdout:ID="centos" 2023-08-23T03:55:07.946 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE="rhel fedora" 2023-08-23T03:55:07.947 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="9" 2023-08-23T03:55:07.947 INFO:teuthology.orchestra.run.smithi192.stdout:PLATFORM_ID="platform:el9" 2023-08-23T03:55:07.947 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-23T03:55:07.947 INFO:teuthology.orchestra.run.smithi192.stdout:ANSI_COLOR="0;31" 2023-08-23T03:55:07.948 INFO:teuthology.orchestra.run.smithi192.stdout:LOGO="fedora-logo-icon" 2023-08-23T03:55:07.948 INFO:teuthology.orchestra.run.smithi192.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-23T03:55:07.948 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://centos.org/" 2023-08-23T03:55:07.948 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-23T03:55:07.949 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-23T03:55:07.949 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-23T03:55:07.949 INFO:teuthology.provision.fog.smithi192:Deploy complete! 2023-08-23T03:55:07.950 DEBUG:teuthology.parallel:result is None 2023-08-23T03:55:08.128 INFO:teuthology.lock.ops:Checking smithi179.front.sepia.ceph.com 2023-08-23T03:55:08.129 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-23T03:55:08.146 INFO:teuthology.lock.ops:Checking smithi192.front.sepia.ceph.com 2023-08-23T03:55:08.146 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-23T03:55:08.164 INFO:teuthology.lock.ops:Updating [smithi179.front.sepia.ceph.com]: set os type and version on server 2023-08-23T03:55:08.165 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2023-08-23T03:55:08.166 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T03:55:08.248 DEBUG:teuthology.orchestra.run.smithi179:> true 2023-08-23T03:55:08.315 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi179.front.sepia.ceph.com' 2023-08-23T03:55:08.316 DEBUG:teuthology.orchestra.run.smithi179:> uname -m 2023-08-23T03:55:08.370 INFO:teuthology.orchestra.run.smithi179.stdout:x86_64 2023-08-23T03:55:08.371 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release 2023-08-23T03:55:08.425 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="CentOS Stream" 2023-08-23T03:55:08.425 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="9" 2023-08-23T03:55:08.425 INFO:teuthology.orchestra.run.smithi179.stdout:ID="centos" 2023-08-23T03:55:08.425 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE="rhel fedora" 2023-08-23T03:55:08.425 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="9" 2023-08-23T03:55:08.426 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM_ID="platform:el9" 2023-08-23T03:55:08.426 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-23T03:55:08.426 INFO:teuthology.orchestra.run.smithi179.stdout:ANSI_COLOR="0;31" 2023-08-23T03:55:08.426 INFO:teuthology.orchestra.run.smithi179.stdout:LOGO="fedora-logo-icon" 2023-08-23T03:55:08.426 INFO:teuthology.orchestra.run.smithi179.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-23T03:55:08.426 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://centos.org/" 2023-08-23T03:55:08.426 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-23T03:55:08.427 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-23T03:55:08.427 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-23T03:55:08.427 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server 2023-08-23T03:55:08.446 INFO:teuthology.lock.ops:Updating [smithi192.front.sepia.ceph.com]: set os type and version on server 2023-08-23T03:55:08.446 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2023-08-23T03:55:08.447 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T03:55:08.527 DEBUG:teuthology.orchestra.run.smithi192:> true 2023-08-23T03:55:08.595 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi192.front.sepia.ceph.com' 2023-08-23T03:55:08.595 DEBUG:teuthology.orchestra.run.smithi192:> uname -m 2023-08-23T03:55:08.649 INFO:teuthology.orchestra.run.smithi192.stdout:x86_64 2023-08-23T03:55:08.649 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release 2023-08-23T03:55:08.706 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="CentOS Stream" 2023-08-23T03:55:08.706 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="9" 2023-08-23T03:55:08.707 INFO:teuthology.orchestra.run.smithi192.stdout:ID="centos" 2023-08-23T03:55:08.707 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE="rhel fedora" 2023-08-23T03:55:08.707 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="9" 2023-08-23T03:55:08.707 INFO:teuthology.orchestra.run.smithi192.stdout:PLATFORM_ID="platform:el9" 2023-08-23T03:55:08.707 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-23T03:55:08.708 INFO:teuthology.orchestra.run.smithi192.stdout:ANSI_COLOR="0;31" 2023-08-23T03:55:08.708 INFO:teuthology.orchestra.run.smithi192.stdout:LOGO="fedora-logo-icon" 2023-08-23T03:55:08.708 INFO:teuthology.orchestra.run.smithi192.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-23T03:55:08.708 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://centos.org/" 2023-08-23T03:55:08.708 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-23T03:55:08.708 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-23T03:55:08.709 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-23T03:55:08.709 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2023-08-23T03:55:08.731 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T03:55:08.828 INFO:teuthology.dispatcher.supervisor:Running job 7375937 2023-08-23T03:55:08.829 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-08-22_10:22:57-fs-wip-vshankar-testing-20230822.061725-testing-default-smithi/7375937 --name vshankar-2023-08-22_10:22:57-fs-wip-vshankar-testing-20230822.061725-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/strays} -- /home/teuthworker/archive/vshankar-2023-08-22_10:22:57-fs-wip-vshankar-testing-20230822.061725-testing-default-smithi/7375937/orig.config.yaml 2023-08-23T03:55:08.833 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-08-22_10:22:57-fs-wip-vshankar-testing-20230822.061725-testing-default-smithi/7375937 2023-08-23T03:55:08.833 INFO:teuthology.dispatcher.supervisor:Job PID: 28032 2023-08-23T03:55:08.834 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-23T03:57:08.932 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T03:59:09.104 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T04:01:09.268 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T04:03:09.453 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T04:05:09.626 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T04:07:09.790 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T04:09:09.957 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T04:11:10.117 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T04:13:10.283 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T04:15:10.449 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T04:17:10.614 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T04:19:10.789 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T04:21:10.957 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T04:23:11.124 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T04:25:11.232 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T04:27:11.397 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T04:29:11.583 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T04:31:11.755 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T04:33:11.909 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T04:35:12.072 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T04:37:12.245 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T04:37:12.312 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-23T04:37:12.503 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-23T04:37:12.503 INFO:teuthology.nuke:Checking targets against current locks 2023-08-23T04:37:12.553 DEBUG:teuthology.nuke:shortname: smithi179 2023-08-23T04:37:12.554 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-23T04:37:12.572 DEBUG:teuthology.nuke:shortname: smithi192 2023-08-23T04:37:12.573 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-23T04:37:12.577 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi179.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-08-22_10:22:57-fs-wip-vshankar-testing-20230822.061725-testing-default-smithi/7375937', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-23 03:50:04.019020', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFwJaOd7unEFOF1CN//ynnO1/cZG6hYZEFuAQAn5x+0/6+FiPsMFH9rz3siBA03I3qmuu2xf2L7xZ1XjVpfBapg='} 2023-08-23T04:37:12.595 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi192.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-08-22_10:22:57-fs-wip-vshankar-testing-20230822.061725-testing-default-smithi/7375937', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-23 03:50:04.017027', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFm/xCsSqbhordf5khUOyHxtLoaHOhXVWz2oFEM9qQ31i50gJk1aY7VDKnbCJSaF/C+bH4Szfia7Rl1sXNarqu0='} 2023-08-23T04:37:12.622 INFO:teuthology.orchestra.console.smithi179:Power off 2023-08-23T04:37:12.622 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-23T04:37:12.646 DEBUG:teuthology.orchestra.console.smithi179:power off output: Chassis Power Control: Down/Off 2023-08-23T04:37:12.647 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T04:37:12.666 INFO:teuthology.orchestra.console.smithi192:Power off 2023-08-23T04:37:12.666 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-23T04:37:12.677 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2023-08-23T04:37:12.688 DEBUG:teuthology.orchestra.console.smithi192:power off output: Chassis Power Control: Down/Off 2023-08-23T04:37:12.689 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T04:37:12.709 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off 2023-08-23T04:37:12.778 INFO:teuthology.orchestra.console.smithi179:Power off completed 2023-08-23T04:37:12.811 INFO:teuthology.orchestra.console.smithi192:Power off completed 2023-08-23T04:37:12.926 INFO:teuthology.lock.ops:unlocked: smithi179.front.sepia.ceph.com 2023-08-23T04:37:12.961 INFO:teuthology.lock.ops:unlocked: smithi192.front.sepia.ceph.com