2023-08-08T02:31:01.067 INFO:root:teuthology version: 0.0.1.dev181+g7fda959 2023-08-08T02:31:01.068 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T02:31:01.215 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f345f713ee0>, signals=[15]) 2023-08-08T02:31:01.217 INFO:teuthology.lock.ops:Start node 'smithi005.front.sepia.ceph.com' reimaging 2023-08-08T02:31:01.217 INFO:teuthology.lock.ops:Updating [smithi005.front.sepia.ceph.com]: reset os type and version on server 2023-08-08T02:31:01.218 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server 2023-08-08T02:31:01.241 INFO:teuthology.lock.ops:Start node 'smithi146.front.sepia.ceph.com' reimaging 2023-08-08T02:31:01.241 INFO:teuthology.lock.ops:Updating [smithi146.front.sepia.ceph.com]: reset os type and version on server 2023-08-08T02:31:01.242 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server 2023-08-08T02:31:01.244 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /host {"name": "smithi005"} 2023-08-08T02:31:01.265 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /host {"name": "smithi146"} 2023-08-08T02:31:01.319 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-08-08T02:31:01.338 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-08-08T02:31:01.359 DEBUG:teuthology.provision.fog.smithi005:Requesting image smithi_centos_8.stream (ID 3) 2023-08-08T02:31:01.359 DEBUG:teuthology.provision.fog.smithi005:FOG request: PUT /host/111 {"imageID": 3} 2023-08-08T02:31:01.384 DEBUG:teuthology.provision.fog.smithi146:Requesting image smithi_centos_8.stream (ID 3) 2023-08-08T02:31:01.384 DEBUG:teuthology.provision.fog.smithi146:FOG request: PUT /host/251 {"imageID": 3} 2023-08-08T02:31:01.406 INFO:teuthology.provision.fog.smithi005:Scheduling deploy of centos 8.stream 2023-08-08T02:31:01.407 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /task/active None 2023-08-08T02:31:01.427 INFO:teuthology.provision.fog.smithi146:Scheduling deploy of centos 8.stream 2023-08-08T02:31:01.428 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-08-08T02:31:01.447 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /tasktype {"name": "deploy"} 2023-08-08T02:31:01.477 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /tasktype {"name": "deploy"} 2023-08-08T02:31:01.490 DEBUG:teuthology.provision.fog.smithi005:FOG request: POST /host/111/task {"taskTypeID": 1} 2023-08-08T02:31:01.513 DEBUG:teuthology.provision.fog.smithi146:FOG request: POST /host/251/task {"taskTypeID": 1} 2023-08-08T02:31:01.625 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /task/active None 2023-08-08T02:31:01.638 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-08-08T02:31:01.700 INFO:teuthology.orchestra.console.smithi005:Power off 2023-08-08T02:31:01.701 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-08T02:31:01.725 DEBUG:teuthology.orchestra.console.smithi005:power off output: Chassis Power Control: Down/Off 2023-08-08T02:31:01.726 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T02:31:01.743 INFO:teuthology.orchestra.console.smithi146:Power off 2023-08-08T02:31:01.744 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-08T02:31:01.755 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is on 2023-08-08T02:31:01.767 DEBUG:teuthology.orchestra.console.smithi146:power off output: Chassis Power Control: Down/Off 2023-08-08T02:31:01.768 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T02:31:01.789 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is off 2023-08-08T02:31:01.890 INFO:teuthology.orchestra.console.smithi146:Power off completed 2023-08-08T02:31:01.991 INFO:teuthology.orchestra.console.smithi146:Power on 2023-08-08T02:31:01.992 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-08T02:31:02.013 DEBUG:teuthology.orchestra.console.smithi146:power on output: Chassis Power Control: Up/On 2023-08-08T02:31:02.014 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T02:31:02.039 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is off 2023-08-08T02:31:05.760 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T02:31:05.871 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is on 2023-08-08T02:31:06.041 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T02:31:06.153 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is off 2023-08-08T02:31:09.872 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T02:31:09.982 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is off 2023-08-08T02:31:10.083 INFO:teuthology.orchestra.console.smithi005:Power off completed 2023-08-08T02:31:10.154 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T02:31:10.184 INFO:teuthology.orchestra.console.smithi005:Power on 2023-08-08T02:31:10.184 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-08T02:31:10.209 DEBUG:teuthology.orchestra.console.smithi005:power on output: Chassis Power Control: Up/On 2023-08-08T02:31:10.209 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T02:31:10.230 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is off 2023-08-08T02:31:10.328 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is on 2023-08-08T02:31:10.428 INFO:teuthology.orchestra.console.smithi146:Power on completed 2023-08-08T02:31:10.529 INFO:teuthology.provision.fog.smithi146:Waiting for deploy to finish 2023-08-08T02:31:10.530 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-08-08T02:31:14.234 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T02:31:14.343 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is off 2023-08-08T02:31:18.348 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T02:31:18.458 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is on 2023-08-08T02:31:18.559 INFO:teuthology.orchestra.console.smithi005:Power on completed 2023-08-08T02:31:18.660 INFO:teuthology.provision.fog.smithi005:Waiting for deploy to finish 2023-08-08T02:31:18.661 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /task/active None 2023-08-08T02:31:25.596 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-08-08T02:31:33.718 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /task/active None 2023-08-08T02:31:40.653 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-08-08T02:31:48.776 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /task/active None 2023-08-08T02:31:55.712 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-08-08T02:32:03.834 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /task/active None 2023-08-08T02:32:10.768 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-08-08T02:32:18.896 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /task/active None 2023-08-08T02:32:25.828 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-08-08T02:32:33.956 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /task/active None 2023-08-08T02:32:40.888 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-08-08T02:32:49.020 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /task/active None 2023-08-08T02:32:55.948 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-08-08T02:33:04.080 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /task/active None 2023-08-08T02:33:11.006 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-08-08T02:33:19.153 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /task/active None 2023-08-08T02:33:26.081 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-08-08T02:33:34.221 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /task/active None 2023-08-08T02:33:41.160 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-08-08T02:33:49.284 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /task/active None 2023-08-08T02:33:49.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T02:33:52.404 WARNING:teuthology.provision.fog.smithi005:[Errno None] Unable to connect to port 22 on 172.21.15.5 2023-08-08T02:33:56.224 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-08-08T02:33:56.287 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T02:33:58.408 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T02:33:59.344 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146 2023-08-08T02:34:01.488 WARNING:teuthology.provision.fog.smithi005:[Errno None] Unable to connect to port 22 on 172.21.15.5 2023-08-08T02:34:05.349 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T02:34:07.489 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T02:34:08.404 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146 2023-08-08T02:34:10.544 WARNING:teuthology.provision.fog.smithi005:[Errno None] Unable to connect to port 22 on 172.21.15.5 2023-08-08T02:34:14.409 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T02:34:16.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T02:34:17.492 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146 2023-08-08T02:34:19.600 WARNING:teuthology.provision.fog.smithi005:[Errno None] Unable to connect to port 22 on 172.21.15.5 2023-08-08T02:34:23.497 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T02:34:25.603 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T02:34:26.576 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146 2023-08-08T02:34:28.656 WARNING:teuthology.provision.fog.smithi005:[Errno None] Unable to connect to port 22 on 172.21.15.5 2023-08-08T02:34:32.580 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T02:34:34.660 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T02:34:35.632 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146 2023-08-08T02:34:41.636 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T02:34:44.688 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146 2023-08-08T02:34:50.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T02:34:53.748 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146 2023-08-08T02:34:59.754 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T02:35:34.696 WARNING:teuthology.provision.fog.smithi005:timed out 2023-08-08T02:35:40.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T02:35:40.982 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-08T02:35:40.983 DEBUG:teuthology.orchestra.run.smithi005:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-08T02:35:41.236 INFO:teuthology.provision.fog.smithi005:Node is ready 2023-08-08T02:35:41.236 DEBUG:teuthology.orchestra.run.smithi005:> hostname 2023-08-08T02:35:41.256 INFO:teuthology.orchestra.run.smithi005.stdout:smithi005.front.sepia.ceph.com 2023-08-08T02:35:41.257 DEBUG:teuthology.orchestra.run.smithi005:> grep smithi005.front.sepia.ceph.com /etc/hosts 2023-08-08T02:35:41.317 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5 smithi005.front.sepia.ceph.com smithi005 2023-08-08T02:35:41.317 DEBUG:teuthology.orchestra.run.smithi005:> sudo hostname smithi005 2023-08-08T02:35:41.431 DEBUG:teuthology.orchestra.run.smithi005:> sudo sed -i -e 's/smithi005.front.sepia.ceph.com/smithi005/g' /etc/hosts 2023-08-08T02:35:41.463 DEBUG:teuthology.orchestra.run.smithi005:> sudo sed -i -e 's/172.21.15.5/172.21.15.5/g' /etc/hosts 2023-08-08T02:35:41.534 DEBUG:teuthology.orchestra.run.smithi005:> sudo sed -i -e 's/smithi005.front.sepia.ceph.com/smithi005/g' /etc/hostname 2023-08-08T02:35:41.603 DEBUG:teuthology.orchestra.run.smithi005:> sudo hostname smithi005 2023-08-08T02:35:41.670 DEBUG:teuthology.orchestra.run.smithi005:> cat /etc/os-release 2023-08-08T02:35:41.728 INFO:teuthology.orchestra.run.smithi005.stdout:NAME="CentOS Stream" 2023-08-08T02:35:41.728 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION="8" 2023-08-08T02:35:41.728 INFO:teuthology.orchestra.run.smithi005.stdout:ID="centos" 2023-08-08T02:35:41.728 INFO:teuthology.orchestra.run.smithi005.stdout:ID_LIKE="rhel fedora" 2023-08-08T02:35:41.728 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_ID="8" 2023-08-08T02:35:41.729 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM_ID="platform:el8" 2023-08-08T02:35:41.729 INFO:teuthology.orchestra.run.smithi005.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-08T02:35:41.729 INFO:teuthology.orchestra.run.smithi005.stdout:ANSI_COLOR="0;31" 2023-08-08T02:35:41.729 INFO:teuthology.orchestra.run.smithi005.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-08T02:35:41.729 INFO:teuthology.orchestra.run.smithi005.stdout:HOME_URL="https://centos.org/" 2023-08-08T02:35:41.729 INFO:teuthology.orchestra.run.smithi005.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-08T02:35:41.729 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-08T02:35:41.730 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-08T02:35:41.730 INFO:teuthology.provision.fog.smithi005:Deploy complete! 2023-08-08T02:35:41.732 DEBUG:teuthology.parallel:result is None 2023-08-08T02:35:59.772 WARNING:teuthology.provision.fog.smithi146:timed out 2023-08-08T02:36:05.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T02:36:06.024 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-08T02:36:06.025 DEBUG:teuthology.orchestra.run.smithi146:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-08T02:36:06.275 INFO:teuthology.provision.fog.smithi146:Node is ready 2023-08-08T02:36:06.276 DEBUG:teuthology.orchestra.run.smithi146:> hostname 2023-08-08T02:36:06.336 INFO:teuthology.orchestra.run.smithi146.stdout:smithi146.front.sepia.ceph.com 2023-08-08T02:36:06.337 DEBUG:teuthology.orchestra.run.smithi146:> grep smithi146.front.sepia.ceph.com /etc/hosts 2023-08-08T02:36:06.397 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.15.146 smithi146.front.sepia.ceph.com smithi146 2023-08-08T02:36:06.398 DEBUG:teuthology.orchestra.run.smithi146:> sudo hostname smithi146 2023-08-08T02:36:06.482 DEBUG:teuthology.orchestra.run.smithi146:> sudo sed -i -e 's/smithi146.front.sepia.ceph.com/smithi146/g' /etc/hosts 2023-08-08T02:36:06.511 DEBUG:teuthology.orchestra.run.smithi146:> sudo sed -i -e 's/172.21.15.146/172.21.15.146/g' /etc/hosts 2023-08-08T02:36:06.579 DEBUG:teuthology.orchestra.run.smithi146:> sudo sed -i -e 's/smithi146.front.sepia.ceph.com/smithi146/g' /etc/hostname 2023-08-08T02:36:06.647 DEBUG:teuthology.orchestra.run.smithi146:> sudo hostname smithi146 2023-08-08T02:36:06.714 DEBUG:teuthology.orchestra.run.smithi146:> cat /etc/os-release 2023-08-08T02:36:06.772 INFO:teuthology.orchestra.run.smithi146.stdout:NAME="CentOS Stream" 2023-08-08T02:36:06.772 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION="8" 2023-08-08T02:36:06.772 INFO:teuthology.orchestra.run.smithi146.stdout:ID="centos" 2023-08-08T02:36:06.772 INFO:teuthology.orchestra.run.smithi146.stdout:ID_LIKE="rhel fedora" 2023-08-08T02:36:06.772 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_ID="8" 2023-08-08T02:36:06.772 INFO:teuthology.orchestra.run.smithi146.stdout:PLATFORM_ID="platform:el8" 2023-08-08T02:36:06.773 INFO:teuthology.orchestra.run.smithi146.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-08T02:36:06.773 INFO:teuthology.orchestra.run.smithi146.stdout:ANSI_COLOR="0;31" 2023-08-08T02:36:06.773 INFO:teuthology.orchestra.run.smithi146.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-08T02:36:06.773 INFO:teuthology.orchestra.run.smithi146.stdout:HOME_URL="https://centos.org/" 2023-08-08T02:36:06.773 INFO:teuthology.orchestra.run.smithi146.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-08T02:36:06.773 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-08T02:36:06.773 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-08T02:36:06.774 INFO:teuthology.provision.fog.smithi146:Deploy complete! 2023-08-08T02:36:06.774 DEBUG:teuthology.parallel:result is None 2023-08-08T02:36:06.918 INFO:teuthology.lock.ops:Checking smithi005.front.sepia.ceph.com 2023-08-08T02:36:06.919 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-08T02:36:06.938 INFO:teuthology.lock.ops:Checking smithi146.front.sepia.ceph.com 2023-08-08T02:36:06.939 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-08T02:36:06.965 INFO:teuthology.lock.ops:Updating [smithi005.front.sepia.ceph.com]: set os type and version on server 2023-08-08T02:36:06.965 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2023-08-08T02:36:06.966 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T02:36:07.033 DEBUG:teuthology.orchestra.run.smithi005:> true 2023-08-08T02:36:07.176 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi005.front.sepia.ceph.com' 2023-08-08T02:36:07.176 DEBUG:teuthology.orchestra.run.smithi005:> uname -m 2023-08-08T02:36:07.237 INFO:teuthology.orchestra.run.smithi005.stdout:x86_64 2023-08-08T02:36:07.237 DEBUG:teuthology.orchestra.run.smithi005:> cat /etc/os-release 2023-08-08T02:36:07.298 INFO:teuthology.orchestra.run.smithi005.stdout:NAME="CentOS Stream" 2023-08-08T02:36:07.298 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION="8" 2023-08-08T02:36:07.299 INFO:teuthology.orchestra.run.smithi005.stdout:ID="centos" 2023-08-08T02:36:07.299 INFO:teuthology.orchestra.run.smithi005.stdout:ID_LIKE="rhel fedora" 2023-08-08T02:36:07.299 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_ID="8" 2023-08-08T02:36:07.300 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM_ID="platform:el8" 2023-08-08T02:36:07.300 INFO:teuthology.orchestra.run.smithi005.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-08T02:36:07.300 INFO:teuthology.orchestra.run.smithi005.stdout:ANSI_COLOR="0;31" 2023-08-08T02:36:07.301 INFO:teuthology.orchestra.run.smithi005.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-08T02:36:07.301 INFO:teuthology.orchestra.run.smithi005.stdout:HOME_URL="https://centos.org/" 2023-08-08T02:36:07.301 INFO:teuthology.orchestra.run.smithi005.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-08T02:36:07.302 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-08T02:36:07.302 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-08T02:36:07.303 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server 2023-08-08T02:36:07.329 INFO:teuthology.lock.ops:Updating [smithi146.front.sepia.ceph.com]: set os type and version on server 2023-08-08T02:36:07.329 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2023-08-08T02:36:07.330 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T02:36:07.395 DEBUG:teuthology.orchestra.run.smithi146:> true 2023-08-08T02:36:07.462 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi146.front.sepia.ceph.com' 2023-08-08T02:36:07.463 DEBUG:teuthology.orchestra.run.smithi146:> uname -m 2023-08-08T02:36:07.521 INFO:teuthology.orchestra.run.smithi146.stdout:x86_64 2023-08-08T02:36:07.522 DEBUG:teuthology.orchestra.run.smithi146:> cat /etc/os-release 2023-08-08T02:36:07.580 INFO:teuthology.orchestra.run.smithi146.stdout:NAME="CentOS Stream" 2023-08-08T02:36:07.580 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION="8" 2023-08-08T02:36:07.581 INFO:teuthology.orchestra.run.smithi146.stdout:ID="centos" 2023-08-08T02:36:07.581 INFO:teuthology.orchestra.run.smithi146.stdout:ID_LIKE="rhel fedora" 2023-08-08T02:36:07.581 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_ID="8" 2023-08-08T02:36:07.581 INFO:teuthology.orchestra.run.smithi146.stdout:PLATFORM_ID="platform:el8" 2023-08-08T02:36:07.581 INFO:teuthology.orchestra.run.smithi146.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-08T02:36:07.581 INFO:teuthology.orchestra.run.smithi146.stdout:ANSI_COLOR="0;31" 2023-08-08T02:36:07.582 INFO:teuthology.orchestra.run.smithi146.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-08T02:36:07.582 INFO:teuthology.orchestra.run.smithi146.stdout:HOME_URL="https://centos.org/" 2023-08-08T02:36:07.582 INFO:teuthology.orchestra.run.smithi146.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-08T02:36:07.582 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-08T02:36:07.582 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-08T02:36:07.583 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server 2023-08-08T02:36:07.604 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T02:36:07.709 INFO:teuthology.dispatcher.supervisor:Running job 7362410 2023-08-08T02:36:07.710 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/virtualenv/bin/teuthology -v --owner scheduled_yingxin@teuthology --archive /home/teuthworker/archive/yingxin-2023-08-08_02:00:15-crimson-rados-wip-yingxin-crimson-cleanup-osd-sharddispatcher-distro-default-smithi/7362410 --name yingxin-2023-08-08_02:00:15-crimson-rados-wip-yingxin-crimson-cleanup-osd-sharddispatcher-distro-default-smithi --description crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} centos_8.stream clusters/{fixed-2} crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/small-objects} -- /home/teuthworker/archive/yingxin-2023-08-08_02:00:15-crimson-rados-wip-yingxin-crimson-cleanup-osd-sharddispatcher-distro-default-smithi/7362410/orig.config.yaml 2023-08-08T02:36:07.714 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yingxin-2023-08-08_02:00:15-crimson-rados-wip-yingxin-crimson-cleanup-osd-sharddispatcher-distro-default-smithi/7362410 2023-08-08T02:36:07.715 INFO:teuthology.dispatcher.supervisor:Job PID: 8803 2023-08-08T02:36:07.715 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-08T02:38:07.815 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T02:40:07.980 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T02:42:08.133 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T02:44:08.301 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T02:46:08.469 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T02:48:08.641 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T02:50:08.809 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T02:52:08.973 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T02:54:09.145 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T02:56:09.309 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T02:58:09.470 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T03:00:09.625 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T03:02:09.793 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T03:04:09.949 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T03:06:10.113 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T03:08:10.261 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T03:10:10.429 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T03:12:10.586 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T03:12:10.650 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-08T03:12:10.753 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-08T03:12:10.754 INFO:teuthology.nuke:Checking targets against current locks 2023-08-08T03:12:10.802 DEBUG:teuthology.nuke:shortname: smithi005 2023-08-08T03:12:10.803 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-08T03:12:10.816 DEBUG:teuthology.nuke:shortname: smithi146 2023-08-08T03:12:10.816 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-08T03:12:10.824 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi005.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yingxin-2023-08-08_02:00:15-crimson-rados-wip-yingxin-crimson-cleanup-osd-sharddispatcher-distro-default-smithi/7362410', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-08 02:31:00.247804', 'locked_by': 'scheduled_yingxin@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDyvK6ViA211H1U7gSfEj8ELHmn1EMKCLktg+kCUugexAl1SXzaelSZ6aMRkxLlgMUaL50RkbnttdnuOF7CElQDCZCYFyWVmZ5eXypmfHtz94xFjlQp3c5GVyv8cDXWvusRQyoj6e1QFK7HvxOn/hXbJPHCwUjhZf4cdHwfzJtqCk1Ur2gtCJ8kBUtWw5BP8pnwbZloO9nXdKvk0W2w/hJE3gNGvXLRpXRKakr5RKxwNtd/gBvRguYzhJxgXHgI6GLR8f6jgewyQWcbVaocKL6v9TPIDeiGmohcJFuH/culv30LNuZsYEEs0ODkPeF42khQwvsbtJxhHAMc2up0QF43tFfwOTJ9vf7FOHDVU6pEEsmWV9ZT9EabE6ozvZM49LhNX/AZoSLzBa74YqzIOAwT/VRO3Y2KmtwTcJiclz4T1Szn609dgn2A5cUXXdD9wBO+djeOqXVvQpyB6yTV4kU+dkjZ4DN4O6iDanVOL54r6V00uG0ly0vIhgzYhRJ6LZs='} 2023-08-08T03:12:10.837 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi146.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yingxin-2023-08-08_02:00:15-crimson-rados-wip-yingxin-crimson-cleanup-osd-sharddispatcher-distro-default-smithi/7362410', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-08 02:31:00.246601', 'locked_by': 'scheduled_yingxin@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoX7JbbZ3fegG3VWpMtVm1RGsQqRpz9eX/PNAmlr86nAKYVs8ipzfVFnhsHUc+FDypmyBMs08mn54YshW/CBlQ3rvDgzh1RrslZbLTruA5fD6UR/Iiu3WzxgoJy0uV6u5jp0MeFgZl3Y2njf5dh0hAz8jDjYRMP/UT8Sh+x4Py4OJ/+3bp6vLTM4wb1C/i8S/Sq/W21nKsSLthgKj+VW8/1/qc5jruTluVMuwC+QNB9yhC3YK9UVcA3guCqSSY/Uzw85cJY8sHy302z6IZfflL16xzdHkp1aaFO2vJHNdOOFznM1OK3d5+/fIqrcVhGOIN8P8cr1EjtJcLiR52mjb0ruIYbP3A7exwMJcAoz3mlGeL7UcPLv7CRWLIfnIZmdh6B69jXUbGG+jIn0tp3HeWz1d+wDj3PtYY/9NN0m5qOdnFkJ4GwRRc8iLAhx2eKikvdsEWWkEDVd8oz008sfDYszJVa2IpWlGC2SH12Uc5f9a/mpUkjYpsG3KQrJLTBZk='} 2023-08-08T03:12:10.872 INFO:teuthology.orchestra.console.smithi005:Power off 2023-08-08T03:12:10.873 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-08T03:12:10.886 INFO:teuthology.orchestra.console.smithi146:Power off 2023-08-08T03:12:10.887 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-08T03:12:10.896 DEBUG:teuthology.orchestra.console.smithi005:power off output: Chassis Power Control: Down/Off 2023-08-08T03:12:10.897 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T03:12:10.908 DEBUG:teuthology.orchestra.console.smithi146:power off output: Chassis Power Control: Down/Off 2023-08-08T03:12:10.909 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T03:12:10.920 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is off 2023-08-08T03:12:10.928 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is off 2023-08-08T03:12:11.021 INFO:teuthology.orchestra.console.smithi005:Power off completed 2023-08-08T03:12:11.029 INFO:teuthology.orchestra.console.smithi146:Power off completed 2023-08-08T03:12:11.166 INFO:teuthology.lock.ops:unlocked: smithi005.front.sepia.ceph.com 2023-08-08T03:12:11.174 INFO:teuthology.lock.ops:unlocked: smithi146.front.sepia.ceph.com