2023-08-08T01:54:03.146 INFO:root:teuthology version: 0.0.1.dev181+g7fda959 2023-08-08T01:54:03.148 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T01:54:03.277 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2e39f41ee0>, signals=[15]) 2023-08-08T01:54:03.278 INFO:teuthology.lock.ops:Start node 'smithi116.front.sepia.ceph.com' reimaging 2023-08-08T01:54:03.278 INFO:teuthology.lock.ops:Updating [smithi116.front.sepia.ceph.com]: reset os type and version on server 2023-08-08T01:54:03.279 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2023-08-08T01:54:03.306 INFO:teuthology.lock.ops:Start node 'smithi190.front.sepia.ceph.com' reimaging 2023-08-08T01:54:03.307 INFO:teuthology.lock.ops:Updating [smithi190.front.sepia.ceph.com]: reset os type and version on server 2023-08-08T01:54:03.307 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2023-08-08T01:54:03.308 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /host {"name": "smithi116"} 2023-08-08T01:54:03.331 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /host {"name": "smithi190"} 2023-08-08T01:54:03.381 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-08-08T01:54:03.397 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-08-08T01:54:03.421 DEBUG:teuthology.provision.fog.smithi116:Requesting image smithi_centos_9.stream (ID 10) 2023-08-08T01:54:03.421 DEBUG:teuthology.provision.fog.smithi116:FOG request: PUT /host/221 {"imageID": 10} 2023-08-08T01:54:03.435 DEBUG:teuthology.provision.fog.smithi190:Requesting image smithi_centos_9.stream (ID 10) 2023-08-08T01:54:03.436 DEBUG:teuthology.provision.fog.smithi190:FOG request: PUT /host/295 {"imageID": 10} 2023-08-08T01:54:03.482 INFO:teuthology.provision.fog.smithi116:Scheduling deploy of centos 9.stream 2023-08-08T01:54:03.483 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-08-08T01:54:03.491 INFO:teuthology.provision.fog.smithi190:Scheduling deploy of centos 9.stream 2023-08-08T01:54:03.491 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-08T01:54:03.531 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /tasktype {"name": "deploy"} 2023-08-08T01:54:03.534 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /tasktype {"name": "deploy"} 2023-08-08T01:54:03.560 DEBUG:teuthology.provision.fog.smithi190:FOG request: POST /host/295/task {"taskTypeID": 1} 2023-08-08T01:54:03.564 DEBUG:teuthology.provision.fog.smithi116:FOG request: POST /host/221/task {"taskTypeID": 1} 2023-08-08T01:54:03.610 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-08T01:54:03.613 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-08-08T01:54:03.701 INFO:teuthology.orchestra.console.smithi190:Power off 2023-08-08T01:54:03.702 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-08T01:54:03.714 INFO:teuthology.orchestra.console.smithi116:Power off 2023-08-08T01:54:03.715 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-08T01:54:03.724 DEBUG:teuthology.orchestra.console.smithi190:power off output: Chassis Power Control: Down/Off 2023-08-08T01:54:03.724 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T01:54:03.736 DEBUG:teuthology.orchestra.console.smithi116:power off output: Chassis Power Control: Down/Off 2023-08-08T01:54:03.736 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T01:54:03.748 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on 2023-08-08T01:54:03.756 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is on 2023-08-08T01:54:07.752 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T01:54:07.760 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T01:54:07.863 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on 2023-08-08T01:54:07.870 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is on 2023-08-08T01:54:11.868 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T01:54:11.876 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T01:54:11.978 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on 2023-08-08T01:54:11.987 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is off 2023-08-08T01:54:12.087 INFO:teuthology.orchestra.console.smithi116:Power off completed 2023-08-08T01:54:12.188 INFO:teuthology.orchestra.console.smithi116:Power on 2023-08-08T01:54:12.188 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-08T01:54:12.212 DEBUG:teuthology.orchestra.console.smithi116:power on output: Chassis Power Control: Up/On 2023-08-08T01:54:12.213 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T01:54:12.233 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is off 2023-08-08T01:54:15.980 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T01:54:16.090 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off 2023-08-08T01:54:16.191 INFO:teuthology.orchestra.console.smithi190:Power off completed 2023-08-08T01:54:16.234 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T01:54:16.291 INFO:teuthology.orchestra.console.smithi190:Power on 2023-08-08T01:54:16.292 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-08T01:54:16.315 DEBUG:teuthology.orchestra.console.smithi190:power on output: Chassis Power Control: Up/On 2023-08-08T01:54:16.316 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T01:54:16.338 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off 2023-08-08T01:54:16.345 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is off 2023-08-08T01:54:20.340 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T01:54:20.349 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T01:54:20.451 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on 2023-08-08T01:54:20.458 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is on 2023-08-08T01:54:20.553 INFO:teuthology.orchestra.console.smithi190:Power on completed 2023-08-08T01:54:20.559 INFO:teuthology.orchestra.console.smithi116:Power on completed 2023-08-08T01:54:20.654 INFO:teuthology.provision.fog.smithi190:Waiting for deploy to finish 2023-08-08T01:54:20.655 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-08T01:54:20.661 INFO:teuthology.provision.fog.smithi116:Waiting for deploy to finish 2023-08-08T01:54:20.661 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-08-08T01:54:35.728 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-08-08T01:54:35.730 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-08T01:54:50.797 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-08-08T01:54:50.799 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-08T01:55:05.872 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-08-08T01:55:05.874 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-08T01:55:20.944 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-08T01:55:20.946 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-08-08T01:55:36.019 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-08T01:55:36.021 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-08-08T01:55:51.092 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-08-08T01:55:51.093 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-08T01:56:06.172 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-08-08T01:56:06.173 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-08T01:56:21.252 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-08T01:56:21.253 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-08-08T01:56:36.332 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-08-08T01:56:36.333 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-08T01:56:51.408 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-08T01:56:51.409 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-08-08T01:56:51.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T01:56:54.544 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-08-08T01:57:00.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T01:57:03.600 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-08-08T01:57:06.492 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-08-08T01:57:06.571 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T01:57:09.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T01:57:09.648 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-08-08T01:57:12.656 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-08-08T01:57:15.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T01:57:18.660 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T01:57:18.704 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-08-08T01:57:21.712 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-08-08T01:57:24.709 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T01:57:27.716 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T01:57:27.760 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-08-08T01:57:30.768 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-08-08T01:57:33.764 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T01:57:36.773 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T01:57:36.816 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-08-08T01:57:39.824 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-08-08T01:57:42.820 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T01:57:45.828 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T01:57:45.872 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-08-08T01:57:51.876 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T01:57:54.928 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-08-08T01:58:00.932 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T01:58:45.872 WARNING:teuthology.provision.fog.smithi190:timed out 2023-08-08T01:58:51.880 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T01:58:52.185 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-08T01:58:52.186 DEBUG:teuthology.orchestra.run.smithi190:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-08T01:58:52.542 INFO:teuthology.provision.fog.smithi190:Node is ready 2023-08-08T01:58:52.542 DEBUG:teuthology.orchestra.run.smithi190:> hostname 2023-08-08T01:58:52.558 INFO:teuthology.orchestra.run.smithi190.stdout:smithi190.front.sepia.ceph.com 2023-08-08T01:58:52.558 DEBUG:teuthology.orchestra.run.smithi190:> grep smithi190.front.sepia.ceph.com /etc/hosts 2023-08-08T01:58:52.613 INFO:teuthology.orchestra.run.smithi190.stdout:172.21.15.190 smithi190.front.sepia.ceph.com smithi190 2023-08-08T01:58:52.614 DEBUG:teuthology.orchestra.run.smithi190:> sudo hostname smithi190 2023-08-08T01:58:52.742 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/smithi190.front.sepia.ceph.com/smithi190/g' /etc/hosts 2023-08-08T01:58:52.770 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/172.21.15.190/172.21.15.190/g' /etc/hosts 2023-08-08T01:58:52.838 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/smithi190.front.sepia.ceph.com/smithi190/g' /etc/hostname 2023-08-08T01:58:52.905 DEBUG:teuthology.orchestra.run.smithi190:> sudo hostname smithi190 2023-08-08T01:58:52.971 DEBUG:teuthology.orchestra.run.smithi190:> cat /etc/os-release 2023-08-08T01:58:53.026 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="CentOS Stream" 2023-08-08T01:58:53.026 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="9" 2023-08-08T01:58:53.026 INFO:teuthology.orchestra.run.smithi190.stdout:ID="centos" 2023-08-08T01:58:53.027 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE="rhel fedora" 2023-08-08T01:58:53.027 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="9" 2023-08-08T01:58:53.027 INFO:teuthology.orchestra.run.smithi190.stdout:PLATFORM_ID="platform:el9" 2023-08-08T01:58:53.027 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-08T01:58:53.027 INFO:teuthology.orchestra.run.smithi190.stdout:ANSI_COLOR="0;31" 2023-08-08T01:58:53.027 INFO:teuthology.orchestra.run.smithi190.stdout:LOGO="fedora-logo-icon" 2023-08-08T01:58:53.027 INFO:teuthology.orchestra.run.smithi190.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-08T01:58:53.027 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://centos.org/" 2023-08-08T01:58:53.028 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-08T01:58:53.028 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-08T01:58:53.028 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-08T01:58:53.029 INFO:teuthology.provision.fog.smithi190:Deploy complete! 2023-08-08T01:58:53.030 DEBUG:teuthology.parallel:result is None 2023-08-08T01:59:00.940 WARNING:teuthology.provision.fog.smithi116:timed out 2023-08-08T01:59:06.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T01:59:07.140 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-08T01:59:07.140 DEBUG:teuthology.orchestra.run.smithi116:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-08T01:59:07.433 INFO:teuthology.provision.fog.smithi116:Node is ready 2023-08-08T01:59:07.433 DEBUG:teuthology.orchestra.run.smithi116:> hostname 2023-08-08T01:59:07.448 INFO:teuthology.orchestra.run.smithi116.stdout:smithi116.front.sepia.ceph.com 2023-08-08T01:59:07.448 DEBUG:teuthology.orchestra.run.smithi116:> grep smithi116.front.sepia.ceph.com /etc/hosts 2023-08-08T01:59:07.504 INFO:teuthology.orchestra.run.smithi116.stdout:172.21.15.116 smithi116.front.sepia.ceph.com smithi116 2023-08-08T01:59:07.504 DEBUG:teuthology.orchestra.run.smithi116:> sudo hostname smithi116 2023-08-08T01:59:07.625 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i -e 's/smithi116.front.sepia.ceph.com/smithi116/g' /etc/hosts 2023-08-08T01:59:07.653 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i -e 's/172.21.15.116/172.21.15.116/g' /etc/hosts 2023-08-08T01:59:07.720 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i -e 's/smithi116.front.sepia.ceph.com/smithi116/g' /etc/hostname 2023-08-08T01:59:07.789 DEBUG:teuthology.orchestra.run.smithi116:> sudo hostname smithi116 2023-08-08T01:59:07.855 DEBUG:teuthology.orchestra.run.smithi116:> cat /etc/os-release 2023-08-08T01:59:07.910 INFO:teuthology.orchestra.run.smithi116.stdout:NAME="CentOS Stream" 2023-08-08T01:59:07.910 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION="9" 2023-08-08T01:59:07.910 INFO:teuthology.orchestra.run.smithi116.stdout:ID="centos" 2023-08-08T01:59:07.910 INFO:teuthology.orchestra.run.smithi116.stdout:ID_LIKE="rhel fedora" 2023-08-08T01:59:07.911 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_ID="9" 2023-08-08T01:59:07.911 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM_ID="platform:el9" 2023-08-08T01:59:07.911 INFO:teuthology.orchestra.run.smithi116.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-08T01:59:07.911 INFO:teuthology.orchestra.run.smithi116.stdout:ANSI_COLOR="0;31" 2023-08-08T01:59:07.911 INFO:teuthology.orchestra.run.smithi116.stdout:LOGO="fedora-logo-icon" 2023-08-08T01:59:07.911 INFO:teuthology.orchestra.run.smithi116.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-08T01:59:07.911 INFO:teuthology.orchestra.run.smithi116.stdout:HOME_URL="https://centos.org/" 2023-08-08T01:59:07.911 INFO:teuthology.orchestra.run.smithi116.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-08T01:59:07.912 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-08T01:59:07.912 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-08T01:59:07.912 INFO:teuthology.provision.fog.smithi116:Deploy complete! 2023-08-08T01:59:07.913 DEBUG:teuthology.parallel:result is None 2023-08-08T01:59:08.080 INFO:teuthology.lock.ops:Checking smithi116.front.sepia.ceph.com 2023-08-08T01:59:08.081 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-08T01:59:08.105 INFO:teuthology.lock.ops:Checking smithi190.front.sepia.ceph.com 2023-08-08T01:59:08.105 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-08T01:59:08.123 INFO:teuthology.lock.ops:Updating [smithi116.front.sepia.ceph.com]: set os type and version on server 2023-08-08T01:59:08.123 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2023-08-08T01:59:08.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T01:59:08.204 DEBUG:teuthology.orchestra.run.smithi116:> true 2023-08-08T01:59:08.273 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi116.front.sepia.ceph.com' 2023-08-08T01:59:08.274 DEBUG:teuthology.orchestra.run.smithi116:> uname -m 2023-08-08T01:59:08.327 INFO:teuthology.orchestra.run.smithi116.stdout:x86_64 2023-08-08T01:59:08.327 DEBUG:teuthology.orchestra.run.smithi116:> cat /etc/os-release 2023-08-08T01:59:08.381 INFO:teuthology.orchestra.run.smithi116.stdout:NAME="CentOS Stream" 2023-08-08T01:59:08.381 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION="9" 2023-08-08T01:59:08.381 INFO:teuthology.orchestra.run.smithi116.stdout:ID="centos" 2023-08-08T01:59:08.381 INFO:teuthology.orchestra.run.smithi116.stdout:ID_LIKE="rhel fedora" 2023-08-08T01:59:08.381 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_ID="9" 2023-08-08T01:59:08.382 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM_ID="platform:el9" 2023-08-08T01:59:08.382 INFO:teuthology.orchestra.run.smithi116.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-08T01:59:08.382 INFO:teuthology.orchestra.run.smithi116.stdout:ANSI_COLOR="0;31" 2023-08-08T01:59:08.382 INFO:teuthology.orchestra.run.smithi116.stdout:LOGO="fedora-logo-icon" 2023-08-08T01:59:08.382 INFO:teuthology.orchestra.run.smithi116.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-08T01:59:08.382 INFO:teuthology.orchestra.run.smithi116.stdout:HOME_URL="https://centos.org/" 2023-08-08T01:59:08.382 INFO:teuthology.orchestra.run.smithi116.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-08T01:59:08.383 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-08T01:59:08.383 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-08T01:59:08.383 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2023-08-08T01:59:08.405 INFO:teuthology.lock.ops:Updating [smithi190.front.sepia.ceph.com]: set os type and version on server 2023-08-08T01:59:08.406 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-08-08T01:59:08.406 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T01:59:08.488 DEBUG:teuthology.orchestra.run.smithi190:> true 2023-08-08T01:59:08.658 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-08-08T01:59:08.658 DEBUG:teuthology.orchestra.run.smithi190:> uname -m 2023-08-08T01:59:08.712 INFO:teuthology.orchestra.run.smithi190.stdout:x86_64 2023-08-08T01:59:08.713 DEBUG:teuthology.orchestra.run.smithi190:> cat /etc/os-release 2023-08-08T01:59:08.766 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="CentOS Stream" 2023-08-08T01:59:08.767 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="9" 2023-08-08T01:59:08.767 INFO:teuthology.orchestra.run.smithi190.stdout:ID="centos" 2023-08-08T01:59:08.767 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE="rhel fedora" 2023-08-08T01:59:08.767 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="9" 2023-08-08T01:59:08.767 INFO:teuthology.orchestra.run.smithi190.stdout:PLATFORM_ID="platform:el9" 2023-08-08T01:59:08.767 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-08T01:59:08.768 INFO:teuthology.orchestra.run.smithi190.stdout:ANSI_COLOR="0;31" 2023-08-08T01:59:08.768 INFO:teuthology.orchestra.run.smithi190.stdout:LOGO="fedora-logo-icon" 2023-08-08T01:59:08.768 INFO:teuthology.orchestra.run.smithi190.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-08T01:59:08.768 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://centos.org/" 2023-08-08T01:59:08.768 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-08T01:59:08.768 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-08T01:59:08.768 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-08T01:59:08.769 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2023-08-08T01:59:08.789 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T01:59:08.879 INFO:teuthology.dispatcher.supervisor:Running job 7361214 2023-08-08T01:59:08.879 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-08-04_18:23:51-fs-wip-rishabh-2023aug3-testing-default-smithi/7361214 --name rishabh-2023-08-04_18:23:51-fs-wip-rishabh-2023aug3-testing-default-smithi --description fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps} -- /home/teuthworker/archive/rishabh-2023-08-04_18:23:51-fs-wip-rishabh-2023aug3-testing-default-smithi/7361214/orig.config.yaml 2023-08-08T01:59:08.883 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-08-04_18:23:51-fs-wip-rishabh-2023aug3-testing-default-smithi/7361214 2023-08-08T01:59:08.883 INFO:teuthology.dispatcher.supervisor:Job PID: 9224 2023-08-08T01:59:08.884 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-08T02:01:08.984 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T02:03:09.172 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T02:05:09.333 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T02:07:09.497 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T02:09:09.681 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T02:11:09.837 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T02:13:10.005 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T02:15:10.177 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T02:17:10.341 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T02:19:10.517 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T02:21:10.677 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T02:23:10.828 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T02:23:10.893 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-08T02:23:10.994 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-08T02:23:10.995 INFO:teuthology.nuke:Checking targets against current locks 2023-08-08T02:23:11.040 DEBUG:teuthology.nuke:shortname: smithi116 2023-08-08T02:23:11.041 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-08T02:23:11.060 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi116.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-04_18:23:51-fs-wip-rishabh-2023aug3-testing-default-smithi/7361214', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-08 01:54:02.356702', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFtPFzJtLoCHmfVXFwdkOFekwtuEFAqqWn5UePy+iNKzPyJGDPK/1SyUELIJFDCx+uzaVgxNLDrfh05AYzqfTKo='} 2023-08-08T02:23:11.063 DEBUG:teuthology.nuke:shortname: smithi190 2023-08-08T02:23:11.063 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-08T02:23:11.078 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi190.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-04_18:23:51-fs-wip-rishabh-2023aug3-testing-default-smithi/7361214', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-08 01:54:02.354853', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDPE3LiJXblueujbZmnUKn5nobkfpUMuWVz5ys3HwLnTViGW9/aTpQYVsTkfQiLqXEGK+CYnT0W1POWI579zpj8='} 2023-08-08T02:23:11.097 INFO:teuthology.orchestra.console.smithi116:Power off 2023-08-08T02:23:11.098 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-08T02:23:11.120 DEBUG:teuthology.orchestra.console.smithi116:power off output: Chassis Power Control: Down/Off 2023-08-08T02:23:11.120 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T02:23:11.133 INFO:teuthology.orchestra.console.smithi190:Power off 2023-08-08T02:23:11.134 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-08T02:23:11.143 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is off 2023-08-08T02:23:11.156 DEBUG:teuthology.orchestra.console.smithi190:power off output: Chassis Power Control: Down/Off 2023-08-08T02:23:11.156 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T02:23:11.178 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off 2023-08-08T02:23:11.244 INFO:teuthology.orchestra.console.smithi116:Power off completed 2023-08-08T02:23:11.279 INFO:teuthology.orchestra.console.smithi190:Power off completed 2023-08-08T02:23:11.409 INFO:teuthology.lock.ops:unlocked: smithi116.front.sepia.ceph.com 2023-08-08T02:23:11.426 INFO:teuthology.lock.ops:unlocked: smithi190.front.sepia.ceph.com