2023-10-10T05:51:55.213 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-10T05:51:55.214 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T05:51:55.347 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7feeffde4b80>, signals=[15]) 2023-10-10T05:51:55.348 INFO:teuthology.lock.ops:Start node 'smithi157.front.sepia.ceph.com' reimaging 2023-10-10T05:51:55.349 INFO:teuthology.lock.ops:Updating [smithi157.front.sepia.ceph.com]: reset os type and version on server 2023-10-10T05:51:55.349 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2023-10-10T05:51:55.378 INFO:teuthology.lock.ops:Start node 'smithi181.front.sepia.ceph.com' reimaging 2023-10-10T05:51:55.379 INFO:teuthology.lock.ops:Updating [smithi181.front.sepia.ceph.com]: reset os type and version on server 2023-10-10T05:51:55.379 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server 2023-10-10T05:51:55.381 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /host {"name": "smithi157"} 2023-10-10T05:51:55.403 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /host {"name": "smithi181"} 2023-10-10T05:51:55.451 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-10-10T05:51:55.466 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-10-10T05:51:55.491 DEBUG:teuthology.provision.fog.smithi157:Requesting image smithi_centos_8.stream (ID 3) 2023-10-10T05:51:55.491 DEBUG:teuthology.provision.fog.smithi157:FOG request: PUT /host/262 {"imageID": 3} 2023-10-10T05:51:55.503 DEBUG:teuthology.provision.fog.smithi181:Requesting image smithi_centos_8.stream (ID 3) 2023-10-10T05:51:55.503 DEBUG:teuthology.provision.fog.smithi181:FOG request: PUT /host/286 {"imageID": 3} 2023-10-10T05:51:55.546 INFO:teuthology.provision.fog.smithi157:Scheduling deploy of centos 8.stream 2023-10-10T05:51:55.547 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-10-10T05:51:55.548 INFO:teuthology.provision.fog.smithi181:Scheduling deploy of centos 8.stream 2023-10-10T05:51:55.548 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-10-10T05:51:55.611 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /tasktype {"name": "deploy"} 2023-10-10T05:51:55.615 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /tasktype {"name": "deploy"} 2023-10-10T05:51:55.649 DEBUG:teuthology.provision.fog.smithi181:FOG request: POST /host/286/task {"taskTypeID": 1} 2023-10-10T05:51:55.652 DEBUG:teuthology.provision.fog.smithi157:FOG request: POST /host/262/task {"taskTypeID": 1} 2023-10-10T05:51:55.702 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-10-10T05:51:55.705 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-10-10T05:51:55.803 INFO:teuthology.orchestra.console.smithi181:Power off 2023-10-10T05:51:55.804 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-10T05:51:55.817 INFO:teuthology.orchestra.console.smithi157:Power off 2023-10-10T05:51:55.817 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-10T05:51:55.828 DEBUG:teuthology.orchestra.console.smithi181:power off output: Chassis Power Control: Down/Off 2023-10-10T05:51:55.829 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T05:51:55.841 DEBUG:teuthology.orchestra.console.smithi157:power off output: Chassis Power Control: Down/Off 2023-10-10T05:51:55.841 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T05:51:55.849 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on 2023-10-10T05:51:55.861 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on 2023-10-10T05:51:59.854 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T05:51:59.862 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T05:51:59.963 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on 2023-10-10T05:51:59.971 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on 2023-10-10T05:52:03.966 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T05:52:03.974 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T05:52:04.076 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on 2023-10-10T05:52:04.082 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off 2023-10-10T05:52:04.183 INFO:teuthology.orchestra.console.smithi157:Power off completed 2023-10-10T05:52:04.284 INFO:teuthology.orchestra.console.smithi157:Power on 2023-10-10T05:52:04.285 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-10T05:52:04.305 DEBUG:teuthology.orchestra.console.smithi157:power on output: Chassis Power Control: Up/On 2023-10-10T05:52:04.305 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T05:52:04.327 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off 2023-10-10T05:52:08.078 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T05:52:08.187 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off 2023-10-10T05:52:08.288 INFO:teuthology.orchestra.console.smithi181:Power off completed 2023-10-10T05:52:08.328 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T05:52:08.389 INFO:teuthology.orchestra.console.smithi181:Power on 2023-10-10T05:52:08.390 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-10T05:52:08.411 DEBUG:teuthology.orchestra.console.smithi181:power on output: Chassis Power Control: Up/On 2023-10-10T05:52:08.412 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T05:52:08.432 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off 2023-10-10T05:52:08.437 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on 2023-10-10T05:52:08.538 INFO:teuthology.orchestra.console.smithi157:Power on completed 2023-10-10T05:52:08.639 INFO:teuthology.provision.fog.smithi157:Waiting for deploy to finish 2023-10-10T05:52:08.639 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-10-10T05:52:12.434 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T05:52:12.542 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on 2023-10-10T05:52:12.643 INFO:teuthology.orchestra.console.smithi181:Power on completed 2023-10-10T05:52:12.744 INFO:teuthology.provision.fog.smithi181:Waiting for deploy to finish 2023-10-10T05:52:12.745 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-10-10T05:52:23.730 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-10-10T05:52:27.826 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-10-10T05:52:38.822 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-10-10T05:52:42.910 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-10-10T05:52:53.926 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-10-10T05:52:57.994 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-10-10T05:53:09.003 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-10-10T05:53:13.084 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-10-10T05:53:24.096 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-10-10T05:53:28.166 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-10-10T05:53:39.183 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-10-10T05:53:43.235 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-10-10T05:53:54.264 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-10-10T05:53:58.307 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-10-10T05:54:09.334 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-10-10T05:54:13.386 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-10-10T05:54:24.422 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-10-10T05:54:28.462 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-10-10T05:54:39.494 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-10-10T05:54:43.538 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-10-10T05:54:54.578 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-10-10T05:54:58.602 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-10-10T05:54:58.662 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T05:55:09.644 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-10-10T05:55:16.986 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2023-10-10T05:55:22.994 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T05:55:24.707 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-10-10T05:55:24.762 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T05:55:26.078 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2023-10-10T05:55:32.085 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T05:55:35.166 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2023-10-10T05:55:41.172 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T05:55:43.102 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-10-10T05:55:44.250 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2023-10-10T05:55:49.106 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T05:55:50.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T05:55:52.190 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-10-10T05:55:58.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T05:56:01.274 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-10-10T05:56:07.279 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T05:56:10.330 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-10-10T05:56:16.336 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T05:56:19.422 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-10-10T05:56:25.426 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T05:56:28.506 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-10-10T05:56:34.510 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T05:56:50.265 WARNING:teuthology.provision.fog.smithi181:timed out 2023-10-10T05:56:56.270 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T05:56:56.535 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-10T05:56:56.536 DEBUG:teuthology.orchestra.run.smithi181:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-10T05:56:56.779 INFO:teuthology.provision.fog.smithi181:Node is ready 2023-10-10T05:56:56.780 DEBUG:teuthology.orchestra.run.smithi181:> hostname 2023-10-10T05:56:56.799 INFO:teuthology.orchestra.run.smithi181.stdout:smithi181.front.sepia.ceph.com 2023-10-10T05:56:56.800 DEBUG:teuthology.orchestra.run.smithi181:> grep smithi181.front.sepia.ceph.com /etc/hosts 2023-10-10T05:56:56.860 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.15.181 smithi181.front.sepia.ceph.com smithi181 2023-10-10T05:56:56.860 DEBUG:teuthology.orchestra.run.smithi181:> sudo hostname smithi181 2023-10-10T05:56:56.972 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i -e 's/smithi181.front.sepia.ceph.com/smithi181/g' /etc/hosts 2023-10-10T05:56:57.003 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i -e 's/172.21.15.181/172.21.15.181/g' /etc/hosts 2023-10-10T05:56:57.073 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i -e 's/smithi181.front.sepia.ceph.com/smithi181/g' /etc/hostname 2023-10-10T05:56:57.142 DEBUG:teuthology.orchestra.run.smithi181:> sudo hostname smithi181 2023-10-10T05:56:57.209 DEBUG:teuthology.orchestra.run.smithi181:> cat /etc/os-release 2023-10-10T05:56:57.267 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="CentOS Stream" 2023-10-10T05:56:57.267 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="8" 2023-10-10T05:56:57.267 INFO:teuthology.orchestra.run.smithi181.stdout:ID="centos" 2023-10-10T05:56:57.268 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE="rhel fedora" 2023-10-10T05:56:57.268 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="8" 2023-10-10T05:56:57.268 INFO:teuthology.orchestra.run.smithi181.stdout:PLATFORM_ID="platform:el8" 2023-10-10T05:56:57.268 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-10T05:56:57.268 INFO:teuthology.orchestra.run.smithi181.stdout:ANSI_COLOR="0;31" 2023-10-10T05:56:57.268 INFO:teuthology.orchestra.run.smithi181.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-10T05:56:57.269 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://centos.org/" 2023-10-10T05:56:57.269 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-10T05:56:57.269 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-10T05:56:57.269 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-10T05:56:57.270 INFO:teuthology.provision.fog.smithi181:Deploy complete! 2023-10-10T05:56:57.271 DEBUG:teuthology.parallel:result is None 2023-10-10T05:57:34.542 WARNING:teuthology.provision.fog.smithi157:timed out 2023-10-10T05:57:40.547 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T05:57:40.819 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-10T05:57:40.820 DEBUG:teuthology.orchestra.run.smithi157:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-10T05:57:41.094 INFO:teuthology.provision.fog.smithi157:Node is ready 2023-10-10T05:57:41.095 DEBUG:teuthology.orchestra.run.smithi157:> hostname 2023-10-10T05:57:41.113 INFO:teuthology.orchestra.run.smithi157.stdout:smithi157.front.sepia.ceph.com 2023-10-10T05:57:41.114 DEBUG:teuthology.orchestra.run.smithi157:> grep smithi157.front.sepia.ceph.com /etc/hosts 2023-10-10T05:57:41.172 INFO:teuthology.orchestra.run.smithi157.stdout:172.21.15.157 smithi157.front.sepia.ceph.com smithi157 2023-10-10T05:57:41.173 DEBUG:teuthology.orchestra.run.smithi157:> sudo hostname smithi157 2023-10-10T05:57:41.272 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/smithi157.front.sepia.ceph.com/smithi157/g' /etc/hosts 2023-10-10T05:57:41.301 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/172.21.15.157/172.21.15.157/g' /etc/hosts 2023-10-10T05:57:41.369 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/smithi157.front.sepia.ceph.com/smithi157/g' /etc/hostname 2023-10-10T05:57:41.437 DEBUG:teuthology.orchestra.run.smithi157:> sudo hostname smithi157 2023-10-10T05:57:41.503 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release 2023-10-10T05:57:41.562 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="CentOS Stream" 2023-10-10T05:57:41.562 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="8" 2023-10-10T05:57:41.563 INFO:teuthology.orchestra.run.smithi157.stdout:ID="centos" 2023-10-10T05:57:41.563 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="rhel fedora" 2023-10-10T05:57:41.563 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="8" 2023-10-10T05:57:41.563 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el8" 2023-10-10T05:57:41.564 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-10T05:57:41.564 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31" 2023-10-10T05:57:41.565 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-10T05:57:41.565 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://centos.org/" 2023-10-10T05:57:41.565 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-10T05:57:41.566 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-10T05:57:41.566 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-10T05:57:41.567 INFO:teuthology.provision.fog.smithi157:Deploy complete! 2023-10-10T05:57:41.567 DEBUG:teuthology.parallel:result is None 2023-10-10T05:57:41.713 INFO:teuthology.lock.ops:Checking smithi157.front.sepia.ceph.com 2023-10-10T05:57:41.713 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-10T05:57:41.735 INFO:teuthology.lock.ops:Checking smithi181.front.sepia.ceph.com 2023-10-10T05:57:41.736 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-10T05:57:41.762 INFO:teuthology.lock.ops:Updating [smithi157.front.sepia.ceph.com]: set os type and version on server 2023-10-10T05:57:41.763 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2023-10-10T05:57:41.764 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T05:57:41.832 DEBUG:teuthology.orchestra.run.smithi157:> true 2023-10-10T05:57:41.904 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi157.front.sepia.ceph.com' 2023-10-10T05:57:41.905 DEBUG:teuthology.orchestra.run.smithi157:> uname -m 2023-10-10T05:57:41.962 INFO:teuthology.orchestra.run.smithi157.stdout:x86_64 2023-10-10T05:57:41.962 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release 2023-10-10T05:57:42.020 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="CentOS Stream" 2023-10-10T05:57:42.021 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="8" 2023-10-10T05:57:42.021 INFO:teuthology.orchestra.run.smithi157.stdout:ID="centos" 2023-10-10T05:57:42.021 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="rhel fedora" 2023-10-10T05:57:42.021 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="8" 2023-10-10T05:57:42.022 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el8" 2023-10-10T05:57:42.022 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-10T05:57:42.022 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31" 2023-10-10T05:57:42.022 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-10T05:57:42.022 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://centos.org/" 2023-10-10T05:57:42.023 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-10T05:57:42.023 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-10T05:57:42.023 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-10T05:57:42.024 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2023-10-10T05:57:42.043 INFO:teuthology.lock.ops:Updating [smithi181.front.sepia.ceph.com]: set os type and version on server 2023-10-10T05:57:42.043 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2023-10-10T05:57:42.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T05:57:42.113 DEBUG:teuthology.orchestra.run.smithi181:> true 2023-10-10T05:57:42.250 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi181.front.sepia.ceph.com' 2023-10-10T05:57:42.250 DEBUG:teuthology.orchestra.run.smithi181:> uname -m 2023-10-10T05:57:42.308 INFO:teuthology.orchestra.run.smithi181.stdout:x86_64 2023-10-10T05:57:42.309 DEBUG:teuthology.orchestra.run.smithi181:> cat /etc/os-release 2023-10-10T05:57:42.367 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="CentOS Stream" 2023-10-10T05:57:42.367 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="8" 2023-10-10T05:57:42.368 INFO:teuthology.orchestra.run.smithi181.stdout:ID="centos" 2023-10-10T05:57:42.368 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE="rhel fedora" 2023-10-10T05:57:42.368 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="8" 2023-10-10T05:57:42.368 INFO:teuthology.orchestra.run.smithi181.stdout:PLATFORM_ID="platform:el8" 2023-10-10T05:57:42.368 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-10T05:57:42.369 INFO:teuthology.orchestra.run.smithi181.stdout:ANSI_COLOR="0;31" 2023-10-10T05:57:42.369 INFO:teuthology.orchestra.run.smithi181.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-10T05:57:42.369 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://centos.org/" 2023-10-10T05:57:42.369 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-10T05:57:42.369 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-10T05:57:42.369 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-10T05:57:42.370 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server 2023-10-10T05:57:42.402 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T05:57:42.490 INFO:teuthology.dispatcher.supervisor:Running job 7419361 2023-10-10T05:57:42.490 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_gsalomon@teuthology --archive /home/teuthworker/archive/gsalomon-2023-10-09_23:17:31-rgw-QE_defect_fixes-distro-default-smithi/7419361 --name gsalomon-2023-10-09_23:17:31-rgw-QE_defect_fixes-distro-default-smithi --description rgw/upgrade/{1-install/pacific/{distro$/{centos_8.stream} install overrides} 2-setup 3-upgrade-sequence/osds-then-rgws cluster frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides} -- /home/teuthworker/archive/gsalomon-2023-10-09_23:17:31-rgw-QE_defect_fixes-distro-default-smithi/7419361/orig.config.yaml 2023-10-10T05:57:42.493 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/gsalomon-2023-10-09_23:17:31-rgw-QE_defect_fixes-distro-default-smithi/7419361 2023-10-10T05:57:42.494 INFO:teuthology.dispatcher.supervisor:Job PID: 2355505 2023-10-10T05:57:42.494 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-10T05:59:42.574 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T06:01:42.747 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T06:03:42.920 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T06:05:43.055 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T06:07:43.144 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T06:09:43.307 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T06:11:43.437 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T06:13:43.587 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T06:15:43.755 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T06:17:43.919 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T06:19:44.091 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T06:21:44.255 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T06:23:44.419 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T06:23:44.481 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-10T06:23:44.585 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-10T06:23:44.586 INFO:teuthology.nuke:Checking targets against current locks 2023-10-10T06:23:44.637 DEBUG:teuthology.nuke:shortname: smithi157 2023-10-10T06:23:44.638 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-10T06:23:44.658 DEBUG:teuthology.nuke:shortname: smithi181 2023-10-10T06:23:44.659 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-10T06:23:44.662 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi157.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gsalomon-2023-10-09_23:17:31-rgw-QE_defect_fixes-distro-default-smithi/7419361', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-10 05:51:54.410247', 'locked_by': 'scheduled_gsalomon@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIIzF0x9b9Hiezuv5qW6qdzI/IyUZhT3RTjB92KO2lmvLBm1swqh0iOP0riXRJpCXANfJyVWc+ce/e7rvlyu/IU='} 2023-10-10T06:23:44.684 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi181.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gsalomon-2023-10-09_23:17:31-rgw-QE_defect_fixes-distro-default-smithi/7419361', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-10 05:51:54.408364', 'locked_by': 'scheduled_gsalomon@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAYqbozMTl6jVRkMDjZemqZGNj5I9R4xxHahMugEMd3Te2YhUyLnK8fWXu1NN6YdGguWRuYHIsX+BwHkO+AVB5E='} 2023-10-10T06:23:44.714 INFO:teuthology.orchestra.console.smithi157:Power off 2023-10-10T06:23:44.714 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-10T06:23:44.736 DEBUG:teuthology.orchestra.console.smithi157:power off output: Chassis Power Control: Down/Off 2023-10-10T06:23:44.737 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T06:23:44.756 INFO:teuthology.orchestra.console.smithi181:Power off 2023-10-10T06:23:44.757 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-10T06:23:44.765 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off 2023-10-10T06:23:44.779 DEBUG:teuthology.orchestra.console.smithi181:power off output: Chassis Power Control: Down/Off 2023-10-10T06:23:44.779 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T06:23:44.801 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off 2023-10-10T06:23:44.867 INFO:teuthology.orchestra.console.smithi157:Power off completed 2023-10-10T06:23:44.903 INFO:teuthology.orchestra.console.smithi181:Power off completed 2023-10-10T06:23:45.022 INFO:teuthology.lock.ops:unlocked: smithi157.front.sepia.ceph.com 2023-10-10T06:23:45.047 INFO:teuthology.lock.ops:unlocked: smithi181.front.sepia.ceph.com