2023-08-30T22:34:04.576 INFO:root:teuthology version: 0.0.1.dev192+gf9a8556 2023-08-30T22:34:04.577 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T22:34:04.950 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff87512bee0>, signals=[15]) 2023-08-30T22:34:04.959 INFO:teuthology.lock.ops:Start node 'smithi116.front.sepia.ceph.com' reimaging 2023-08-30T22:34:04.959 INFO:teuthology.lock.ops:Updating [smithi116.front.sepia.ceph.com]: reset os type and version on server 2023-08-30T22:34:04.977 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2023-08-30T22:34:04.999 INFO:teuthology.lock.ops:Start node 'smithi133.front.sepia.ceph.com' reimaging 2023-08-30T22:34:04.999 INFO:teuthology.lock.ops:Updating [smithi133.front.sepia.ceph.com]: reset os type and version on server 2023-08-30T22:34:05.000 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2023-08-30T22:34:05.008 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /host {"name": "smithi116"} 2023-08-30T22:34:05.031 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /host {"name": "smithi133"} 2023-08-30T22:34:05.115 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-08-30T22:34:05.150 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-08-30T22:34:05.172 DEBUG:teuthology.provision.fog.smithi116:Requesting image smithi_centos_8.stream (ID 3) 2023-08-30T22:34:05.173 DEBUG:teuthology.provision.fog.smithi116:FOG request: PUT /host/221 {"imageID": 3} 2023-08-30T22:34:05.232 DEBUG:teuthology.provision.fog.smithi133:Requesting image smithi_centos_8.stream (ID 3) 2023-08-30T22:34:05.233 DEBUG:teuthology.provision.fog.smithi133:FOG request: PUT /host/238 {"imageID": 3} 2023-08-30T22:34:05.241 INFO:teuthology.provision.fog.smithi116:Scheduling deploy of centos 8.stream 2023-08-30T22:34:05.242 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-08-30T22:34:05.305 INFO:teuthology.provision.fog.smithi133:Scheduling deploy of centos 8.stream 2023-08-30T22:34:05.305 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-08-30T22:34:05.331 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /tasktype {"name": "deploy"} 2023-08-30T22:34:05.374 DEBUG:teuthology.provision.fog.smithi116:FOG request: POST /host/221/task {"taskTypeID": 1} 2023-08-30T22:34:05.405 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /tasktype {"name": "deploy"} 2023-08-30T22:34:05.447 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-08-30T22:34:05.463 DEBUG:teuthology.provision.fog.smithi133:FOG request: POST /host/238/task {"taskTypeID": 1} 2023-08-30T22:34:05.566 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-08-30T22:34:05.631 INFO:teuthology.orchestra.console.smithi116:Power off 2023-08-30T22:34:05.632 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T22:34:05.680 DEBUG:teuthology.orchestra.console.smithi116:power off output: Chassis Power Control: Down/Off 2023-08-30T22:34:05.681 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T22:34:05.737 INFO:teuthology.orchestra.console.smithi133:Power off 2023-08-30T22:34:05.738 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T22:34:05.752 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is off 2023-08-30T22:34:05.768 DEBUG:teuthology.orchestra.console.smithi133:power off output: Chassis Power Control: Down/Off 2023-08-30T22:34:05.768 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T22:34:05.805 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2023-08-30T22:34:05.861 INFO:teuthology.orchestra.console.smithi116:Power off completed 2023-08-30T22:34:05.908 INFO:teuthology.orchestra.console.smithi133:Power off completed 2023-08-30T22:34:05.965 INFO:teuthology.orchestra.console.smithi116:Power on 2023-08-30T22:34:05.965 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-30T22:34:05.998 DEBUG:teuthology.orchestra.console.smithi116:power on output: Chassis Power Control: Up/On 2023-08-30T22:34:05.999 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T22:34:06.012 INFO:teuthology.orchestra.console.smithi133:Power on 2023-08-30T22:34:06.013 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-30T22:34:06.039 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is off 2023-08-30T22:34:06.044 DEBUG:teuthology.orchestra.console.smithi133:power on output: Chassis Power Control: Up/On 2023-08-30T22:34:06.044 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T22:34:06.105 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2023-08-30T22:34:10.046 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T22:34:10.110 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T22:34:10.171 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is on 2023-08-30T22:34:10.230 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2023-08-30T22:34:10.272 INFO:teuthology.orchestra.console.smithi116:Power on completed 2023-08-30T22:34:10.376 INFO:teuthology.provision.fog.smithi116:Waiting for deploy to finish 2023-08-30T22:34:10.376 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-08-30T22:34:14.234 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T22:34:14.355 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2023-08-30T22:34:14.458 INFO:teuthology.orchestra.console.smithi133:Power on completed 2023-08-30T22:34:14.571 INFO:teuthology.provision.fog.smithi133:Waiting for deploy to finish 2023-08-30T22:34:14.572 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-08-30T22:34:25.483 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-08-30T22:34:29.679 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-08-30T22:34:40.658 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-08-30T22:34:44.782 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-08-30T22:34:55.750 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-08-30T22:34:59.886 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-08-30T22:35:10.855 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-08-30T22:35:14.998 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-08-30T22:35:25.957 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-08-30T22:35:30.134 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-08-30T22:35:41.085 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-08-30T22:35:45.216 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-08-30T22:35:56.203 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-08-30T22:36:00.354 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-08-30T22:36:11.281 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-08-30T22:36:15.467 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-08-30T22:36:26.447 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-08-30T22:36:30.578 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-08-30T22:36:41.535 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-08-30T22:36:45.658 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-08-30T22:36:45.728 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:36:48.804 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2023-08-30T22:36:54.814 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:36:56.614 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-08-30T22:36:56.693 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:36:57.882 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2023-08-30T22:36:59.772 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-08-30T22:37:03.888 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:37:05.783 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:37:06.973 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2023-08-30T22:37:08.859 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-08-30T22:37:12.979 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:37:14.862 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:37:16.059 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2023-08-30T22:37:17.951 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-08-30T22:37:22.066 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:37:23.956 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:37:25.149 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2023-08-30T22:37:27.034 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-08-30T22:37:31.154 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:37:33.038 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:37:34.238 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2023-08-30T22:37:36.127 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-08-30T22:37:40.242 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:37:42.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:37:43.322 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2023-08-30T22:37:45.210 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-08-30T22:37:49.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:37:51.213 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:38:07.770 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2023-08-30T22:38:09.562 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-08-30T22:38:13.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:38:15.565 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:38:16.826 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2023-08-30T22:38:18.619 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-08-30T22:38:22.830 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:38:23.908 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-30T22:38:23.909 DEBUG:teuthology.orchestra.run.smithi133:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-30T22:38:24.621 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:38:25.739 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-30T22:38:25.740 DEBUG:teuthology.orchestra.run.smithi116:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-30T22:38:48.358 INFO:teuthology.provision.fog.smithi133:Node is ready 2023-08-30T22:38:48.358 DEBUG:teuthology.orchestra.run.smithi133:> hostname 2023-08-30T22:38:48.394 INFO:teuthology.orchestra.run.smithi133.stdout:smithi133.front.sepia.ceph.com 2023-08-30T22:38:48.395 DEBUG:teuthology.orchestra.run.smithi133:> grep smithi133.front.sepia.ceph.com /etc/hosts 2023-08-30T22:38:48.457 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.15.133 smithi133.front.sepia.ceph.com smithi133 2023-08-30T22:38:48.457 DEBUG:teuthology.orchestra.run.smithi133:> sudo hostname smithi133 2023-08-30T22:38:48.606 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/smithi133.front.sepia.ceph.com/smithi133/g' /etc/hosts 2023-08-30T22:38:48.642 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/172.21.15.133/172.21.15.133/g' /etc/hosts 2023-08-30T22:38:48.713 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/smithi133.front.sepia.ceph.com/smithi133/g' /etc/hostname 2023-08-30T22:38:48.784 DEBUG:teuthology.orchestra.run.smithi133:> sudo hostname smithi133 2023-08-30T22:38:48.856 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release 2023-08-30T22:38:48.917 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="CentOS Stream" 2023-08-30T22:38:48.918 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="8" 2023-08-30T22:38:48.918 INFO:teuthology.orchestra.run.smithi133.stdout:ID="centos" 2023-08-30T22:38:48.918 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE="rhel fedora" 2023-08-30T22:38:48.918 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="8" 2023-08-30T22:38:48.918 INFO:teuthology.orchestra.run.smithi133.stdout:PLATFORM_ID="platform:el8" 2023-08-30T22:38:48.919 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-30T22:38:48.919 INFO:teuthology.orchestra.run.smithi133.stdout:ANSI_COLOR="0;31" 2023-08-30T22:38:48.919 INFO:teuthology.orchestra.run.smithi133.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-30T22:38:48.919 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://centos.org/" 2023-08-30T22:38:48.919 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-30T22:38:48.920 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-30T22:38:48.920 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-30T22:38:48.920 INFO:teuthology.provision.fog.smithi133:Deploy complete! 2023-08-30T22:38:48.922 DEBUG:teuthology.parallel:result is None 2023-08-30T22:38:51.111 INFO:teuthology.provision.fog.smithi116:Node is ready 2023-08-30T22:38:51.113 DEBUG:teuthology.orchestra.run.smithi116:> hostname 2023-08-30T22:38:51.137 INFO:teuthology.orchestra.run.smithi116.stdout:smithi116.front.sepia.ceph.com 2023-08-30T22:38:51.138 DEBUG:teuthology.orchestra.run.smithi116:> grep smithi116.front.sepia.ceph.com /etc/hosts 2023-08-30T22:38:51.200 INFO:teuthology.orchestra.run.smithi116.stdout:172.21.15.116 smithi116.front.sepia.ceph.com smithi116 2023-08-30T22:38:51.201 DEBUG:teuthology.orchestra.run.smithi116:> sudo hostname smithi116 2023-08-30T22:38:51.319 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i -e 's/smithi116.front.sepia.ceph.com/smithi116/g' /etc/hosts 2023-08-30T22:38:51.350 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i -e 's/172.21.15.116/172.21.15.116/g' /etc/hosts 2023-08-30T22:38:51.421 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i -e 's/smithi116.front.sepia.ceph.com/smithi116/g' /etc/hostname 2023-08-30T22:38:51.500 DEBUG:teuthology.orchestra.run.smithi116:> sudo hostname smithi116 2023-08-30T22:38:51.569 DEBUG:teuthology.orchestra.run.smithi116:> cat /etc/os-release 2023-08-30T22:38:51.629 INFO:teuthology.orchestra.run.smithi116.stdout:NAME="CentOS Stream" 2023-08-30T22:38:51.629 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION="8" 2023-08-30T22:38:51.630 INFO:teuthology.orchestra.run.smithi116.stdout:ID="centos" 2023-08-30T22:38:51.630 INFO:teuthology.orchestra.run.smithi116.stdout:ID_LIKE="rhel fedora" 2023-08-30T22:38:51.630 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_ID="8" 2023-08-30T22:38:51.630 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM_ID="platform:el8" 2023-08-30T22:38:51.631 INFO:teuthology.orchestra.run.smithi116.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-30T22:38:51.631 INFO:teuthology.orchestra.run.smithi116.stdout:ANSI_COLOR="0;31" 2023-08-30T22:38:51.631 INFO:teuthology.orchestra.run.smithi116.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-30T22:38:51.631 INFO:teuthology.orchestra.run.smithi116.stdout:HOME_URL="https://centos.org/" 2023-08-30T22:38:51.631 INFO:teuthology.orchestra.run.smithi116.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-30T22:38:51.632 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-30T22:38:51.632 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-30T22:38:51.632 INFO:teuthology.provision.fog.smithi116:Deploy complete! 2023-08-30T22:38:51.633 DEBUG:teuthology.parallel:result is None 2023-08-30T22:38:51.831 INFO:teuthology.lock.ops:Checking smithi116.front.sepia.ceph.com 2023-08-30T22:38:51.832 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-30T22:38:51.866 INFO:teuthology.lock.ops:Checking smithi133.front.sepia.ceph.com 2023-08-30T22:38:51.867 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-30T22:38:51.893 INFO:teuthology.lock.ops:Updating [smithi116.front.sepia.ceph.com]: set os type and version on server 2023-08-30T22:38:51.894 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2023-08-30T22:38:51.895 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:38:52.008 DEBUG:teuthology.orchestra.run.smithi116:> true 2023-08-30T22:38:52.078 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi116.front.sepia.ceph.com' 2023-08-30T22:38:52.079 DEBUG:teuthology.orchestra.run.smithi116:> uname -m 2023-08-30T22:38:52.138 INFO:teuthology.orchestra.run.smithi116.stdout:x86_64 2023-08-30T22:38:52.139 DEBUG:teuthology.orchestra.run.smithi116:> cat /etc/os-release 2023-08-30T22:38:52.198 INFO:teuthology.orchestra.run.smithi116.stdout:NAME="CentOS Stream" 2023-08-30T22:38:52.198 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION="8" 2023-08-30T22:38:52.198 INFO:teuthology.orchestra.run.smithi116.stdout:ID="centos" 2023-08-30T22:38:52.198 INFO:teuthology.orchestra.run.smithi116.stdout:ID_LIKE="rhel fedora" 2023-08-30T22:38:52.199 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_ID="8" 2023-08-30T22:38:52.199 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM_ID="platform:el8" 2023-08-30T22:38:52.199 INFO:teuthology.orchestra.run.smithi116.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-30T22:38:52.200 INFO:teuthology.orchestra.run.smithi116.stdout:ANSI_COLOR="0;31" 2023-08-30T22:38:52.200 INFO:teuthology.orchestra.run.smithi116.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-30T22:38:52.200 INFO:teuthology.orchestra.run.smithi116.stdout:HOME_URL="https://centos.org/" 2023-08-30T22:38:52.200 INFO:teuthology.orchestra.run.smithi116.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-30T22:38:52.201 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-30T22:38:52.201 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-30T22:38:52.202 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2023-08-30T22:38:52.223 INFO:teuthology.lock.ops:Updating [smithi133.front.sepia.ceph.com]: set os type and version on server 2023-08-30T22:38:52.239 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2023-08-30T22:38:52.242 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:38:52.314 DEBUG:teuthology.orchestra.run.smithi133:> true 2023-08-30T22:38:52.391 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi133.front.sepia.ceph.com' 2023-08-30T22:38:52.391 DEBUG:teuthology.orchestra.run.smithi133:> uname -m 2023-08-30T22:38:52.458 INFO:teuthology.orchestra.run.smithi133.stdout:x86_64 2023-08-30T22:38:52.459 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release 2023-08-30T22:38:52.519 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="CentOS Stream" 2023-08-30T22:38:52.521 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="8" 2023-08-30T22:38:52.521 INFO:teuthology.orchestra.run.smithi133.stdout:ID="centos" 2023-08-30T22:38:52.521 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE="rhel fedora" 2023-08-30T22:38:52.522 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="8" 2023-08-30T22:38:52.522 INFO:teuthology.orchestra.run.smithi133.stdout:PLATFORM_ID="platform:el8" 2023-08-30T22:38:52.522 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-30T22:38:52.523 INFO:teuthology.orchestra.run.smithi133.stdout:ANSI_COLOR="0;31" 2023-08-30T22:38:52.524 INFO:teuthology.orchestra.run.smithi133.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-30T22:38:52.524 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://centos.org/" 2023-08-30T22:38:52.524 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-30T22:38:52.524 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-30T22:38:52.524 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-30T22:38:52.525 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2023-08-30T22:38:52.556 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T22:38:52.674 INFO:teuthology.dispatcher.supervisor:Running job 7384777 2023-08-30T22:38:52.674 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2023-08-30_22:19:08-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7384777 --name pdonnell-2023-08-30_22:19:08-fs-wip-batrick-testing-20230830.165602-distro-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{client-shutdown ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mds 2-workunit/fs/trivial_sync}} -- /home/teuthworker/archive/pdonnell-2023-08-30_22:19:08-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7384777/orig.config.yaml 2023-08-30T22:38:52.687 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2023-08-30_22:19:08-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7384777 2023-08-30T22:38:52.687 INFO:teuthology.dispatcher.supervisor:Job PID: 2803741 2023-08-30T22:38:52.689 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-30T22:40:52.690 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T22:42:52.781 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T22:44:52.849 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T22:46:52.914 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T22:48:52.985 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T22:50:53.053 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T22:52:53.127 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T22:54:53.198 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T22:56:53.286 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T22:56:53.354 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-30T22:56:53.524 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-30T22:56:53.524 INFO:teuthology.nuke:Checking targets against current locks 2023-08-30T22:56:53.577 DEBUG:teuthology.nuke:shortname: smithi116 2023-08-30T22:56:53.578 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-30T22:56:53.604 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi116.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-08-30_22:19:08-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7384777', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-30 22:34:02.211625', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCiQ7qe5PuufGhplBBi4+RBCn4KG6ZCPZVVr+MkSSTpY0KWME5EGYWpPXKeFv7j4OEbcsX2s96gBUs/Qbcbzk3/9BNgZKREAdnwCs5MLRmPC93eP//tiALNc0V4g4713q1y72/Si3kzAN7JfSZUQKNGUogooBUWZxNPTEz6JBjQLFkf9TMuw1s+I0ASZF+hchLYMEBzDoVJeVHt+KJtzn7L9nA4LLGCZe+U7rCCl9sb1aVFCf8/7RzRsXMAahFnPzrsucQS2VjBsinYCLED82iMIEuInuOdiiuxwrzRIh1fzMiplY9MHfc4enmFHZsdvI/VNO54P+Kqi8BbXnBcQlB+tGXDNwYnBrbVxmNODV9vHSC5NueJb8NwjRfS6C7h1iC7B97eOwupKlnR8CxIAS8vPB7vTVa531gIFwNJQTYHYWHJ5q5FEkJ7TZr7RXmsQ9CGBPFrbVhVPBb/DrY5AbEeoxFGfYESSJW6FLbg4zQHFazIncfgIKSEiYP/yzddOxs='} 2023-08-30T22:56:53.607 DEBUG:teuthology.nuke:shortname: smithi133 2023-08-30T22:56:53.608 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-30T22:56:53.629 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi133.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-08-30_22:19:08-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7384777', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-30 22:34:02.213072', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCzZL1kfKRGaRwNTSw7tFm0H7ySd8Nf38mui0fv4kQJa6n5pThGOlc0P0v8RcnB8Lwlqvx3s3Q/T9yV5gXD0xlEbelL+S77HcQCvBmUQVmrp3KEAElInhCGjBwTMAsXOvnCMpMtcfYV2Ke2YRr2fvk9BpUWBhWdlCxrqb2duuucavkZk7E8silnTst0It3dqrtAwhFDbH9hmxWc3jdnurC0YCo7JDvO6GARpxjMcwmzTAeENKFqyNWBBJ3SIt9FcINuFQf6Qcvi1vVLVWlFG5i8LobZ0IRibQdKpQHAeZ7K5O4JnwfA9Bm2VU/CKGSct+bU1rIc2Fg1nnNPsRlXbYyHJvpNo7BcjWJhi6/cSFrSIy7HgHiDgklmblQA+VawfsVSSnUNG06yC8qil+N/ebbKEir5Qb/TZo+M0odpxzS/0NDPm2VcCQpHBM23C0ZZTC+5NX51dNCR6f9++T7nR+E9EXtu+MvLLSS47Hcsx759bssgqzznxTT6cPh7E0MxNBk='} 2023-08-30T22:56:53.667 INFO:teuthology.orchestra.console.smithi116:Power off 2023-08-30T22:56:53.668 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T22:56:53.704 INFO:teuthology.orchestra.console.smithi133:Power off 2023-08-30T22:56:53.705 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T22:56:53.712 DEBUG:teuthology.orchestra.console.smithi116:power off output: Chassis Power Control: Down/Off 2023-08-30T22:56:53.713 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T22:56:53.725 DEBUG:teuthology.orchestra.console.smithi133:power off output: Chassis Power Control: Down/Off 2023-08-30T22:56:53.726 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T22:56:53.738 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is off 2023-08-30T22:56:53.750 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2023-08-30T22:56:53.841 INFO:teuthology.orchestra.console.smithi116:Power off completed 2023-08-30T22:56:53.853 INFO:teuthology.orchestra.console.smithi133:Power off completed 2023-08-30T22:56:54.004 INFO:teuthology.lock.ops:unlocked: smithi116.front.sepia.ceph.com 2023-08-30T22:56:54.009 INFO:teuthology.lock.ops:unlocked: smithi133.front.sepia.ceph.com