2023-11-09T02:49:42.149 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-09T02:49:42.150 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T02:49:42.296 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f99830cef70>, signals=[15]) 2023-11-09T02:49:42.297 INFO:teuthology.lock.ops:Start node 'smithi046.front.sepia.ceph.com' reimaging 2023-11-09T02:49:42.297 INFO:teuthology.lock.ops:Updating [smithi046.front.sepia.ceph.com]: reset os type and version on server 2023-11-09T02:49:42.298 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server 2023-11-09T02:49:42.315 INFO:teuthology.lock.ops:Start node 'smithi073.front.sepia.ceph.com' reimaging 2023-11-09T02:49:42.316 INFO:teuthology.lock.ops:Updating [smithi073.front.sepia.ceph.com]: reset os type and version on server 2023-11-09T02:49:42.316 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2023-11-09T02:49:42.317 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /host {"name": "smithi046"} 2023-11-09T02:49:42.340 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /host {"name": "smithi073"} 2023-11-09T02:49:42.391 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-11-09T02:49:42.414 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-11-09T02:49:42.432 DEBUG:teuthology.provision.fog.smithi046:Requesting image smithi_centos_8.stream (ID 3) 2023-11-09T02:49:42.432 DEBUG:teuthology.provision.fog.smithi046:FOG request: PUT /host/151 {"imageID": 3} 2023-11-09T02:49:42.453 DEBUG:teuthology.provision.fog.smithi073:Requesting image smithi_centos_8.stream (ID 3) 2023-11-09T02:49:42.454 DEBUG:teuthology.provision.fog.smithi073:FOG request: PUT /host/178 {"imageID": 3} 2023-11-09T02:49:42.491 INFO:teuthology.provision.fog.smithi046:Scheduling deploy of centos 8.stream 2023-11-09T02:49:42.491 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None 2023-11-09T02:49:42.495 INFO:teuthology.provision.fog.smithi073:Scheduling deploy of centos 8.stream 2023-11-09T02:49:42.495 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-11-09T02:49:42.563 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /tasktype {"name": "deploy"} 2023-11-09T02:49:42.568 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /tasktype {"name": "deploy"} 2023-11-09T02:49:42.603 DEBUG:teuthology.provision.fog.smithi073:FOG request: POST /host/178/task {"taskTypeID": 1} 2023-11-09T02:49:42.606 DEBUG:teuthology.provision.fog.smithi046:FOG request: POST /host/151/task {"taskTypeID": 1} 2023-11-09T02:49:42.652 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None 2023-11-09T02:49:42.665 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-11-09T02:49:42.768 INFO:teuthology.orchestra.console.smithi046:Power off 2023-11-09T02:49:42.769 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-09T02:49:42.788 INFO:teuthology.orchestra.console.smithi073:Power off 2023-11-09T02:49:42.789 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-09T02:49:42.797 DEBUG:teuthology.orchestra.console.smithi046:power off output: Chassis Power Control: Down/Off 2023-11-09T02:49:42.798 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T02:49:42.811 DEBUG:teuthology.orchestra.console.smithi073:power off output: Chassis Power Control: Down/Off 2023-11-09T02:49:42.812 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T02:49:42.824 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is on 2023-11-09T02:49:42.838 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on 2023-11-09T02:49:46.826 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T02:49:46.839 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T02:49:46.938 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is on 2023-11-09T02:49:46.950 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on 2023-11-09T02:49:50.942 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T02:49:50.951 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T02:49:51.052 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is off 2023-11-09T02:49:51.060 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on 2023-11-09T02:49:51.153 INFO:teuthology.orchestra.console.smithi046:Power off completed 2023-11-09T02:49:51.254 INFO:teuthology.orchestra.console.smithi046:Power on 2023-11-09T02:49:51.255 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-09T02:49:51.279 DEBUG:teuthology.orchestra.console.smithi046:power on output: Chassis Power Control: Up/On 2023-11-09T02:49:51.279 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T02:49:51.304 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is off 2023-11-09T02:49:55.062 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T02:49:55.171 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is off 2023-11-09T02:49:55.272 INFO:teuthology.orchestra.console.smithi073:Power off completed 2023-11-09T02:49:55.305 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T02:49:55.374 INFO:teuthology.orchestra.console.smithi073:Power on 2023-11-09T02:49:55.374 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-09T02:49:55.395 DEBUG:teuthology.orchestra.console.smithi073:power on output: Chassis Power Control: Up/On 2023-11-09T02:49:55.396 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T02:49:55.413 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is off 2023-11-09T02:49:55.416 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is off 2023-11-09T02:49:59.418 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T02:49:59.427 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T02:49:59.532 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is on 2023-11-09T02:49:59.538 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on 2023-11-09T02:49:59.634 INFO:teuthology.orchestra.console.smithi046:Power on completed 2023-11-09T02:49:59.639 INFO:teuthology.orchestra.console.smithi073:Power on completed 2023-11-09T02:49:59.735 INFO:teuthology.provision.fog.smithi046:Waiting for deploy to finish 2023-11-09T02:49:59.736 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None 2023-11-09T02:49:59.740 INFO:teuthology.provision.fog.smithi073:Waiting for deploy to finish 2023-11-09T02:49:59.741 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-11-09T02:50:14.835 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None 2023-11-09T02:50:14.838 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-11-09T02:50:29.934 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-11-09T02:50:29.936 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None 2023-11-09T02:50:45.026 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-11-09T02:50:45.028 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None 2023-11-09T02:51:00.122 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-11-09T02:51:00.124 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None 2023-11-09T02:51:15.218 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-11-09T02:51:15.221 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None 2023-11-09T02:51:30.310 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None 2023-11-09T02:51:30.312 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-11-09T02:51:45.412 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None 2023-11-09T02:51:45.414 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-11-09T02:52:00.506 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None 2023-11-09T02:52:00.508 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-11-09T02:52:15.603 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-11-09T02:52:15.605 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None 2023-11-09T02:52:30.694 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-11-09T02:52:30.696 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None 2023-11-09T02:52:45.802 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-11-09T02:52:45.804 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None 2023-11-09T02:52:45.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T02:52:45.881 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T02:52:48.954 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2023-11-09T02:52:48.955 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-11-09T02:52:54.959 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T02:52:54.961 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T02:52:58.010 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2023-11-09T02:52:58.011 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-11-09T02:53:04.018 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T02:53:04.021 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T02:53:07.098 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2023-11-09T02:53:07.099 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-11-09T02:53:13.105 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T02:53:13.107 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T02:53:16.190 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2023-11-09T02:53:16.191 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-11-09T02:53:22.195 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T02:53:22.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T02:53:25.274 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2023-11-09T02:53:25.275 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-11-09T02:53:31.279 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T02:53:31.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T02:53:34.330 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2023-11-09T02:53:34.362 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-11-09T02:53:40.335 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T02:53:40.363 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T02:53:43.418 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-11-09T02:53:49.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T02:54:21.019 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-09T02:54:21.020 DEBUG:teuthology.orchestra.run.smithi073:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-09T02:54:40.338 WARNING:teuthology.provision.fog.smithi046:timed out 2023-11-09T02:54:46.341 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T02:54:46.556 INFO:teuthology.provision.fog.smithi073:Node is ready 2023-11-09T02:54:46.557 DEBUG:teuthology.orchestra.run.smithi073:> hostname 2023-11-09T02:54:46.575 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-09T02:54:46.575 DEBUG:teuthology.orchestra.run.smithi046:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-09T02:54:46.582 INFO:teuthology.orchestra.run.smithi073.stdout:smithi073.front.sepia.ceph.com 2023-11-09T02:54:46.582 DEBUG:teuthology.orchestra.run.smithi073:> grep smithi073.front.sepia.ceph.com /etc/hosts 2023-11-09T02:54:46.643 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73 smithi073.front.sepia.ceph.com smithi073 2023-11-09T02:54:46.644 DEBUG:teuthology.orchestra.run.smithi073:> sudo hostname smithi073 2023-11-09T02:54:46.767 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i -e 's/smithi073.front.sepia.ceph.com/smithi073/g' /etc/hosts 2023-11-09T02:54:46.800 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i -e 's/172.21.15.73/172.21.15.73/g' /etc/hosts 2023-11-09T02:54:46.812 INFO:teuthology.provision.fog.smithi046:Node is ready 2023-11-09T02:54:46.812 DEBUG:teuthology.orchestra.run.smithi046:> hostname 2023-11-09T02:54:46.832 INFO:teuthology.orchestra.run.smithi046.stdout:smithi046.front.sepia.ceph.com 2023-11-09T02:54:46.833 DEBUG:teuthology.orchestra.run.smithi046:> grep smithi046.front.sepia.ceph.com /etc/hosts 2023-11-09T02:54:46.873 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i -e 's/smithi073.front.sepia.ceph.com/smithi073/g' /etc/hostname 2023-11-09T02:54:46.893 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2023-11-09T02:54:46.894 DEBUG:teuthology.orchestra.run.smithi046:> sudo hostname smithi046 2023-11-09T02:54:46.945 DEBUG:teuthology.orchestra.run.smithi073:> sudo hostname smithi073 2023-11-09T02:54:46.999 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i -e 's/smithi046.front.sepia.ceph.com/smithi046/g' /etc/hosts 2023-11-09T02:54:47.015 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release 2023-11-09T02:54:47.030 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i -e 's/172.21.15.46/172.21.15.46/g' /etc/hosts 2023-11-09T02:54:47.074 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="CentOS Stream" 2023-11-09T02:54:47.075 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="8" 2023-11-09T02:54:47.075 INFO:teuthology.orchestra.run.smithi073.stdout:ID="centos" 2023-11-09T02:54:47.075 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="rhel fedora" 2023-11-09T02:54:47.075 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="8" 2023-11-09T02:54:47.075 INFO:teuthology.orchestra.run.smithi073.stdout:PLATFORM_ID="platform:el8" 2023-11-09T02:54:47.076 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-09T02:54:47.076 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31" 2023-11-09T02:54:47.076 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-09T02:54:47.076 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://centos.org/" 2023-11-09T02:54:47.076 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-09T02:54:47.077 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-09T02:54:47.077 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-09T02:54:47.078 INFO:teuthology.provision.fog.smithi073:Deploy complete! 2023-11-09T02:54:47.079 DEBUG:teuthology.parallel:result is None 2023-11-09T02:54:47.099 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i -e 's/smithi046.front.sepia.ceph.com/smithi046/g' /etc/hostname 2023-11-09T02:54:47.170 DEBUG:teuthology.orchestra.run.smithi046:> sudo hostname smithi046 2023-11-09T02:54:47.240 DEBUG:teuthology.orchestra.run.smithi046:> cat /etc/os-release 2023-11-09T02:54:47.299 INFO:teuthology.orchestra.run.smithi046.stdout:NAME="CentOS Stream" 2023-11-09T02:54:47.299 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION="8" 2023-11-09T02:54:47.300 INFO:teuthology.orchestra.run.smithi046.stdout:ID="centos" 2023-11-09T02:54:47.300 INFO:teuthology.orchestra.run.smithi046.stdout:ID_LIKE="rhel fedora" 2023-11-09T02:54:47.300 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_ID="8" 2023-11-09T02:54:47.300 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM_ID="platform:el8" 2023-11-09T02:54:47.300 INFO:teuthology.orchestra.run.smithi046.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-09T02:54:47.301 INFO:teuthology.orchestra.run.smithi046.stdout:ANSI_COLOR="0;31" 2023-11-09T02:54:47.301 INFO:teuthology.orchestra.run.smithi046.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-09T02:54:47.301 INFO:teuthology.orchestra.run.smithi046.stdout:HOME_URL="https://centos.org/" 2023-11-09T02:54:47.301 INFO:teuthology.orchestra.run.smithi046.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-09T02:54:47.301 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-09T02:54:47.302 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-09T02:54:47.302 INFO:teuthology.provision.fog.smithi046:Deploy complete! 2023-11-09T02:54:47.303 DEBUG:teuthology.parallel:result is None 2023-11-09T02:54:47.469 INFO:teuthology.lock.ops:Checking smithi046.front.sepia.ceph.com 2023-11-09T02:54:47.470 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-09T02:54:47.515 INFO:teuthology.lock.ops:Checking smithi073.front.sepia.ceph.com 2023-11-09T02:54:47.515 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-09T02:54:47.544 INFO:teuthology.lock.ops:Updating [smithi046.front.sepia.ceph.com]: set os type and version on server 2023-11-09T02:54:47.545 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2023-11-09T02:54:47.546 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T02:54:47.614 DEBUG:teuthology.orchestra.run.smithi046:> true 2023-11-09T02:54:47.681 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi046.front.sepia.ceph.com' 2023-11-09T02:54:47.681 DEBUG:teuthology.orchestra.run.smithi046:> uname -m 2023-11-09T02:54:47.739 INFO:teuthology.orchestra.run.smithi046.stdout:x86_64 2023-11-09T02:54:47.740 DEBUG:teuthology.orchestra.run.smithi046:> cat /etc/os-release 2023-11-09T02:54:47.798 INFO:teuthology.orchestra.run.smithi046.stdout:NAME="CentOS Stream" 2023-11-09T02:54:47.798 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION="8" 2023-11-09T02:54:47.799 INFO:teuthology.orchestra.run.smithi046.stdout:ID="centos" 2023-11-09T02:54:47.799 INFO:teuthology.orchestra.run.smithi046.stdout:ID_LIKE="rhel fedora" 2023-11-09T02:54:47.799 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_ID="8" 2023-11-09T02:54:47.799 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM_ID="platform:el8" 2023-11-09T02:54:47.799 INFO:teuthology.orchestra.run.smithi046.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-09T02:54:47.800 INFO:teuthology.orchestra.run.smithi046.stdout:ANSI_COLOR="0;31" 2023-11-09T02:54:47.800 INFO:teuthology.orchestra.run.smithi046.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-09T02:54:47.800 INFO:teuthology.orchestra.run.smithi046.stdout:HOME_URL="https://centos.org/" 2023-11-09T02:54:47.800 INFO:teuthology.orchestra.run.smithi046.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-09T02:54:47.800 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-09T02:54:47.800 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-09T02:54:47.801 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server 2023-11-09T02:54:47.830 INFO:teuthology.lock.ops:Updating [smithi073.front.sepia.ceph.com]: set os type and version on server 2023-11-09T02:54:47.831 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-11-09T02:54:47.831 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T02:54:47.900 DEBUG:teuthology.orchestra.run.smithi073:> true 2023-11-09T02:54:47.977 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-11-09T02:54:47.978 DEBUG:teuthology.orchestra.run.smithi073:> uname -m 2023-11-09T02:54:48.038 INFO:teuthology.orchestra.run.smithi073.stdout:x86_64 2023-11-09T02:54:48.039 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release 2023-11-09T02:54:48.098 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="CentOS Stream" 2023-11-09T02:54:48.099 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="8" 2023-11-09T02:54:48.099 INFO:teuthology.orchestra.run.smithi073.stdout:ID="centos" 2023-11-09T02:54:48.099 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="rhel fedora" 2023-11-09T02:54:48.099 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="8" 2023-11-09T02:54:48.100 INFO:teuthology.orchestra.run.smithi073.stdout:PLATFORM_ID="platform:el8" 2023-11-09T02:54:48.100 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-09T02:54:48.100 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31" 2023-11-09T02:54:48.100 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-09T02:54:48.100 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://centos.org/" 2023-11-09T02:54:48.101 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-09T02:54:48.101 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-09T02:54:48.101 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-09T02:54:48.101 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2023-11-09T02:54:48.127 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T02:54:48.224 INFO:teuthology.dispatcher.supervisor:Running job 7452369 2023-11-09T02:54:48.224 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2023-11-09_02:25:01-upgrade:reef-x-main-distro-default-smithi/7452369 --name teuthology-2023-11-09_02:25:01-upgrade:reef-x-main-distro-default-smithi --description upgrade:reef-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} -- /home/teuthworker/archive/teuthology-2023-11-09_02:25:01-upgrade:reef-x-main-distro-default-smithi/7452369/orig.config.yaml 2023-11-09T02:54:48.231 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2023-11-09_02:25:01-upgrade:reef-x-main-distro-default-smithi/7452369 2023-11-09T02:54:48.232 INFO:teuthology.dispatcher.supervisor:Job PID: 158749 2023-11-09T02:54:48.232 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-09T02:56:48.333 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T02:58:48.513 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T03:00:48.683 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T03:02:48.859 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T03:04:49.035 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T03:06:49.211 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T03:08:49.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T03:10:49.556 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T03:12:49.715 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T03:14:49.891 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T03:14:49.959 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-11-09T03:14:50.090 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-09T03:14:50.091 INFO:teuthology.nuke:Checking targets against current locks 2023-11-09T03:14:50.141 DEBUG:teuthology.nuke:shortname: smithi046 2023-11-09T03:14:50.143 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-09T03:14:50.170 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi046.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-11-09_02:25:01-upgrade:reef-x-main-distro-default-smithi/7452369', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-09 02:49:41.253495', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ5LNLtvliBDxxB3O3TF9Jw7PyztsqOfBIyhWl7mi9zCyNgxwjFi2tsGR2wC8IOI5vbKvFXnZbV763HkQTWNQjs='} 2023-11-09T03:14:50.173 DEBUG:teuthology.nuke:shortname: smithi073 2023-11-09T03:14:50.174 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-09T03:14:50.195 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi073.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-11-09_02:25:01-upgrade:reef-x-main-distro-default-smithi/7452369', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-09 02:49:41.255368', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOcXn0jdxR2l4K5aYAOex82LbsREPGJUFP3l5fxqbi7k2YGN2gWqkJ3elMISxlW18TwZVgjmKwHty8x4IMWWTvc='} 2023-11-09T03:14:50.226 INFO:teuthology.orchestra.console.smithi046:Power off 2023-11-09T03:14:50.226 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-09T03:14:50.249 DEBUG:teuthology.orchestra.console.smithi046:power off output: Chassis Power Control: Down/Off 2023-11-09T03:14:50.249 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T03:14:50.267 INFO:teuthology.orchestra.console.smithi073:Power off 2023-11-09T03:14:50.267 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-09T03:14:50.278 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is off 2023-11-09T03:14:50.291 DEBUG:teuthology.orchestra.console.smithi073:power off output: Chassis Power Control: Down/Off 2023-11-09T03:14:50.292 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T03:14:50.334 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is off 2023-11-09T03:14:50.379 INFO:teuthology.orchestra.console.smithi046:Power off completed 2023-11-09T03:14:50.436 INFO:teuthology.orchestra.console.smithi073:Power off completed 2023-11-09T03:14:50.531 INFO:teuthology.lock.ops:unlocked: smithi046.front.sepia.ceph.com 2023-11-09T03:14:50.590 INFO:teuthology.lock.ops:unlocked: smithi073.front.sepia.ceph.com