2023-10-09T09:51:46.299 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-09T09:51:46.300 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T09:51:46.444 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4ff8a91f70>, signals=[15]) 2023-10-09T09:51:46.445 INFO:teuthology.lock.ops:Start node 'smithi187.front.sepia.ceph.com' reimaging 2023-10-09T09:51:46.445 INFO:teuthology.lock.ops:Updating [smithi187.front.sepia.ceph.com]: reset os type and version on server 2023-10-09T09:51:46.445 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2023-10-09T09:51:46.463 INFO:teuthology.lock.ops:Start node 'smithi190.front.sepia.ceph.com' reimaging 2023-10-09T09:51:46.464 INFO:teuthology.lock.ops:Updating [smithi190.front.sepia.ceph.com]: reset os type and version on server 2023-10-09T09:51:46.464 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2023-10-09T09:51:46.465 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /host {"name": "smithi187"} 2023-10-09T09:51:46.488 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /host {"name": "smithi190"} 2023-10-09T09:51:46.539 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-10-09T09:51:46.556 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-10-09T09:51:46.594 DEBUG:teuthology.provision.fog.smithi187:Requesting image smithi_centos_8.stream (ID 3) 2023-10-09T09:51:46.595 DEBUG:teuthology.provision.fog.smithi187:FOG request: PUT /host/292 {"imageID": 3} 2023-10-09T09:51:46.611 DEBUG:teuthology.provision.fog.smithi190:Requesting image smithi_centos_8.stream (ID 3) 2023-10-09T09:51:46.612 DEBUG:teuthology.provision.fog.smithi190:FOG request: PUT /host/295 {"imageID": 3} 2023-10-09T09:51:46.639 INFO:teuthology.provision.fog.smithi187:Scheduling deploy of centos 8.stream 2023-10-09T09:51:46.639 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-09T09:51:46.658 INFO:teuthology.provision.fog.smithi190:Scheduling deploy of centos 8.stream 2023-10-09T09:51:46.658 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-10-09T09:51:46.678 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /tasktype {"name": "deploy"} 2023-10-09T09:51:46.695 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /tasktype {"name": "deploy"} 2023-10-09T09:51:46.718 DEBUG:teuthology.provision.fog.smithi187:FOG request: POST /host/292/task {"taskTypeID": 1} 2023-10-09T09:51:46.725 DEBUG:teuthology.provision.fog.smithi190:FOG request: POST /host/295/task {"taskTypeID": 1} 2023-10-09T09:51:46.881 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-10-09T09:51:46.884 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-09T09:51:46.984 INFO:teuthology.orchestra.console.smithi187:Power off 2023-10-09T09:51:46.984 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-09T09:51:46.998 INFO:teuthology.orchestra.console.smithi190:Power off 2023-10-09T09:51:46.998 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-09T09:51:47.007 DEBUG:teuthology.orchestra.console.smithi187:power off output: Chassis Power Control: Down/Off 2023-10-09T09:51:47.007 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T09:51:47.019 DEBUG:teuthology.orchestra.console.smithi190:power off output: Chassis Power Control: Down/Off 2023-10-09T09:51:47.019 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T09:51:47.030 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off 2023-10-09T09:51:47.042 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off 2023-10-09T09:51:47.133 INFO:teuthology.orchestra.console.smithi187:Power off completed 2023-10-09T09:51:47.143 INFO:teuthology.orchestra.console.smithi190:Power off completed 2023-10-09T09:51:47.234 INFO:teuthology.orchestra.console.smithi187:Power on 2023-10-09T09:51:47.234 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-09T09:51:47.244 INFO:teuthology.orchestra.console.smithi190:Power on 2023-10-09T09:51:47.245 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-09T09:51:47.256 DEBUG:teuthology.orchestra.console.smithi187:power on output: Chassis Power Control: Up/On 2023-10-09T09:51:47.257 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T09:51:47.264 DEBUG:teuthology.orchestra.console.smithi190:power on output: Chassis Power Control: Up/On 2023-10-09T09:51:47.265 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T09:51:47.277 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off 2023-10-09T09:51:47.286 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off 2023-10-09T09:51:51.278 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T09:51:51.287 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T09:51:51.388 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off 2023-10-09T09:51:51.395 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off 2023-10-09T09:51:55.390 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T09:51:55.397 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T09:51:55.502 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on 2023-10-09T09:51:55.505 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on 2023-10-09T09:51:55.603 INFO:teuthology.orchestra.console.smithi187:Power on completed 2023-10-09T09:51:55.606 INFO:teuthology.orchestra.console.smithi190:Power on completed 2023-10-09T09:51:55.704 INFO:teuthology.provision.fog.smithi187:Waiting for deploy to finish 2023-10-09T09:51:55.705 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-09T09:51:55.708 INFO:teuthology.provision.fog.smithi190:Waiting for deploy to finish 2023-10-09T09:51:55.708 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-10-09T09:52:10.777 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-09T09:52:10.778 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-10-09T09:52:25.854 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-09T09:52:25.855 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-10-09T09:52:40.922 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-09T09:52:40.923 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-10-09T09:52:55.992 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-10-09T09:52:55.994 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-09T09:53:11.067 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-09T09:53:11.068 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-10-09T09:53:26.137 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-09T09:53:26.138 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-10-09T09:53:41.210 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-10-09T09:53:41.212 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-09T09:53:56.285 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-09T09:53:56.286 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-10-09T09:54:11.355 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-09T09:54:11.357 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-10-09T09:54:26.426 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-10-09T09:54:26.428 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-09T09:54:41.503 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-10-09T09:54:41.504 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-09T09:54:41.578 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T09:54:41.580 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T09:55:00.090 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-10-09T09:55:00.091 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-10-09T09:55:06.095 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T09:55:06.097 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T09:55:09.146 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-10-09T09:55:09.147 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-10-09T09:55:15.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T09:55:15.152 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T09:55:18.206 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-10-09T09:55:18.207 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-10-09T09:55:24.212 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T09:55:24.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T09:55:27.290 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-10-09T09:55:27.291 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-10-09T09:55:33.294 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T09:55:33.296 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T09:56:33.338 WARNING:teuthology.provision.fog.smithi190:timed out 2023-10-09T09:56:33.339 WARNING:teuthology.provision.fog.smithi187:timed out 2023-10-09T09:56:39.346 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T09:56:39.531 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T09:56:39.735 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-09T09:56:39.736 DEBUG:teuthology.orchestra.run.smithi190:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-09T09:56:39.749 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-09T09:56:39.750 DEBUG:teuthology.orchestra.run.smithi187:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-09T09:56:40.002 INFO:teuthology.provision.fog.smithi187:Node is ready 2023-10-09T09:56:40.506 DEBUG:teuthology.orchestra.run.smithi187:> hostname 2023-10-09T09:56:40.508 INFO:teuthology.provision.fog.smithi190:Node is ready 2023-10-09T09:56:40.508 DEBUG:teuthology.orchestra.run.smithi190:> hostname 2023-10-09T09:56:40.528 INFO:teuthology.orchestra.run.smithi187.stdout:smithi187.front.sepia.ceph.com 2023-10-09T09:56:40.542 DEBUG:teuthology.orchestra.run.smithi187:> grep smithi187.front.sepia.ceph.com /etc/hosts 2023-10-09T09:56:40.569 INFO:teuthology.orchestra.run.smithi190.stdout:smithi190.front.sepia.ceph.com 2023-10-09T09:56:40.569 DEBUG:teuthology.orchestra.run.smithi190:> grep smithi190.front.sepia.ceph.com /etc/hosts 2023-10-09T09:56:40.591 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.15.187 smithi187.front.sepia.ceph.com smithi187 2023-10-09T09:56:40.591 DEBUG:teuthology.orchestra.run.smithi187:> sudo hostname smithi187 2023-10-09T09:56:40.630 INFO:teuthology.orchestra.run.smithi190.stdout:172.21.15.190 smithi190.front.sepia.ceph.com smithi190 2023-10-09T09:56:40.630 DEBUG:teuthology.orchestra.run.smithi190:> sudo hostname smithi190 2023-10-09T09:56:40.699 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/smithi187.front.sepia.ceph.com/smithi187/g' /etc/hosts 2023-10-09T09:56:40.731 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/172.21.15.187/172.21.15.187/g' /etc/hosts 2023-10-09T09:56:40.750 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/smithi190.front.sepia.ceph.com/smithi190/g' /etc/hosts 2023-10-09T09:56:40.780 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/172.21.15.190/172.21.15.190/g' /etc/hosts 2023-10-09T09:56:40.801 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/smithi187.front.sepia.ceph.com/smithi187/g' /etc/hostname 2023-10-09T09:56:40.850 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/smithi190.front.sepia.ceph.com/smithi190/g' /etc/hostname 2023-10-09T09:56:40.870 DEBUG:teuthology.orchestra.run.smithi187:> sudo hostname smithi187 2023-10-09T09:56:40.919 DEBUG:teuthology.orchestra.run.smithi190:> sudo hostname smithi190 2023-10-09T09:56:40.938 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release 2023-10-09T09:56:40.987 DEBUG:teuthology.orchestra.run.smithi190:> cat /etc/os-release 2023-10-09T09:56:40.997 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="CentOS Stream" 2023-10-09T09:56:40.997 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="8" 2023-10-09T09:56:40.997 INFO:teuthology.orchestra.run.smithi187.stdout:ID="centos" 2023-10-09T09:56:40.997 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE="rhel fedora" 2023-10-09T09:56:40.997 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="8" 2023-10-09T09:56:40.997 INFO:teuthology.orchestra.run.smithi187.stdout:PLATFORM_ID="platform:el8" 2023-10-09T09:56:40.997 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-09T09:56:40.997 INFO:teuthology.orchestra.run.smithi187.stdout:ANSI_COLOR="0;31" 2023-10-09T09:56:40.997 INFO:teuthology.orchestra.run.smithi187.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-09T09:56:40.997 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://centos.org/" 2023-10-09T09:56:40.998 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-09T09:56:40.998 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-09T09:56:40.998 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-09T09:56:40.998 INFO:teuthology.provision.fog.smithi187:Deploy complete! 2023-10-09T09:56:40.999 DEBUG:teuthology.parallel:result is None 2023-10-09T09:56:41.046 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="CentOS Stream" 2023-10-09T09:56:41.046 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="8" 2023-10-09T09:56:41.046 INFO:teuthology.orchestra.run.smithi190.stdout:ID="centos" 2023-10-09T09:56:41.046 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE="rhel fedora" 2023-10-09T09:56:41.046 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="8" 2023-10-09T09:56:41.046 INFO:teuthology.orchestra.run.smithi190.stdout:PLATFORM_ID="platform:el8" 2023-10-09T09:56:41.046 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-09T09:56:41.046 INFO:teuthology.orchestra.run.smithi190.stdout:ANSI_COLOR="0;31" 2023-10-09T09:56:41.046 INFO:teuthology.orchestra.run.smithi190.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-09T09:56:41.047 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://centos.org/" 2023-10-09T09:56:41.047 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-09T09:56:41.047 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-09T09:56:41.047 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-09T09:56:41.047 INFO:teuthology.provision.fog.smithi190:Deploy complete! 2023-10-09T09:56:41.047 DEBUG:teuthology.parallel:result is None 2023-10-09T09:56:41.208 INFO:teuthology.lock.ops:Checking smithi187.front.sepia.ceph.com 2023-10-09T09:56:41.209 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-09T09:56:41.229 INFO:teuthology.lock.ops:Checking smithi190.front.sepia.ceph.com 2023-10-09T09:56:41.229 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-09T09:56:41.246 INFO:teuthology.lock.ops:Updating [smithi187.front.sepia.ceph.com]: set os type and version on server 2023-10-09T09:56:41.247 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2023-10-09T09:56:41.247 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T09:56:41.312 DEBUG:teuthology.orchestra.run.smithi187:> true 2023-10-09T09:56:41.380 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi187.front.sepia.ceph.com' 2023-10-09T09:56:41.380 DEBUG:teuthology.orchestra.run.smithi187:> uname -m 2023-10-09T09:56:41.437 INFO:teuthology.orchestra.run.smithi187.stdout:x86_64 2023-10-09T09:56:41.438 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release 2023-10-09T09:56:41.495 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="CentOS Stream" 2023-10-09T09:56:41.495 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="8" 2023-10-09T09:56:41.495 INFO:teuthology.orchestra.run.smithi187.stdout:ID="centos" 2023-10-09T09:56:41.495 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE="rhel fedora" 2023-10-09T09:56:41.496 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="8" 2023-10-09T09:56:41.496 INFO:teuthology.orchestra.run.smithi187.stdout:PLATFORM_ID="platform:el8" 2023-10-09T09:56:41.496 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-09T09:56:41.496 INFO:teuthology.orchestra.run.smithi187.stdout:ANSI_COLOR="0;31" 2023-10-09T09:56:41.496 INFO:teuthology.orchestra.run.smithi187.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-09T09:56:41.496 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://centos.org/" 2023-10-09T09:56:41.496 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-09T09:56:41.496 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-09T09:56:41.496 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-09T09:56:41.497 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2023-10-09T09:56:41.521 INFO:teuthology.lock.ops:Updating [smithi190.front.sepia.ceph.com]: set os type and version on server 2023-10-09T09:56:41.521 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-10-09T09:56:41.521 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T09:56:41.586 DEBUG:teuthology.orchestra.run.smithi190:> true 2023-10-09T09:56:41.611 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-10-09T09:56:41.611 DEBUG:teuthology.orchestra.run.smithi190:> uname -m 2023-10-09T09:56:41.669 INFO:teuthology.orchestra.run.smithi190.stdout:x86_64 2023-10-09T09:56:41.669 DEBUG:teuthology.orchestra.run.smithi190:> cat /etc/os-release 2023-10-09T09:56:41.727 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="CentOS Stream" 2023-10-09T09:56:41.727 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="8" 2023-10-09T09:56:41.727 INFO:teuthology.orchestra.run.smithi190.stdout:ID="centos" 2023-10-09T09:56:41.727 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE="rhel fedora" 2023-10-09T09:56:41.727 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="8" 2023-10-09T09:56:41.727 INFO:teuthology.orchestra.run.smithi190.stdout:PLATFORM_ID="platform:el8" 2023-10-09T09:56:41.728 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-09T09:56:41.728 INFO:teuthology.orchestra.run.smithi190.stdout:ANSI_COLOR="0;31" 2023-10-09T09:56:41.728 INFO:teuthology.orchestra.run.smithi190.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-09T09:56:41.728 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://centos.org/" 2023-10-09T09:56:41.728 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-09T09:56:41.728 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-09T09:56:41.728 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-09T09:56:41.728 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2023-10-09T09:56:41.754 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T09:56:41.859 INFO:teuthology.dispatcher.supervisor:Running job 7417649 2023-10-09T09:56:41.859 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2023-10-07_14:23:11-upgrade:pacific-x-reef-distro-default-smithi/7417649 --name teuthology-2023-10-07_14:23:11-upgrade:pacific-x-reef-distro-default-smithi --description upgrade:pacific-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} -- /home/teuthworker/archive/teuthology-2023-10-07_14:23:11-upgrade:pacific-x-reef-distro-default-smithi/7417649/orig.config.yaml 2023-10-09T09:56:41.862 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2023-10-07_14:23:11-upgrade:pacific-x-reef-distro-default-smithi/7417649 2023-10-09T09:56:41.862 INFO:teuthology.dispatcher.supervisor:Job PID: 2801500 2023-10-09T09:56:41.862 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-09T09:58:41.962 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T10:00:42.125 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T10:02:42.291 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T10:04:42.455 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T10:06:42.627 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T10:08:42.810 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T10:10:42.975 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T10:12:43.138 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T10:14:43.300 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T10:16:43.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T10:18:43.626 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T10:20:43.807 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T10:22:43.971 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T10:24:44.135 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T10:26:44.311 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T10:28:44.471 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T10:30:44.603 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T10:32:44.759 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T10:34:44.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T10:36:45.069 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T10:38:45.235 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T10:40:45.371 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T10:42:45.470 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T10:44:45.618 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T10:46:45.783 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T10:48:45.955 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T10:50:46.102 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T10:52:46.237 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T10:54:46.397 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T10:56:46.564 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T10:58:46.731 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T11:00:46.905 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T11:02:47.048 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T11:04:47.211 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T11:06:47.375 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T11:08:47.477 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T11:10:47.578 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T11:12:47.710 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T11:12:47.777 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-10-09T11:12:47.967 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-09T11:12:47.967 INFO:teuthology.nuke:Checking targets against current locks 2023-10-09T11:12:48.008 DEBUG:teuthology.nuke:shortname: smithi187 2023-10-09T11:12:48.008 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-09T11:12:48.031 DEBUG:teuthology.nuke:shortname: smithi190 2023-10-09T11:12:48.031 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-09T11:12:48.034 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi187.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-10-07_14:23:11-upgrade:pacific-x-reef-distro-default-smithi/7417649', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-09 09:51:45.213509', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJx6vqIDhybCTlomxN5GLV5tXuiPjlzFodYQe0YrPj0Pu7aZv8YkCN0bDxQ1mx5XRLDkeml8Fe+/qEVEXheE6jY='} 2023-10-09T11:12:48.057 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi190.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-10-07_14:23:11-upgrade:pacific-x-reef-distro-default-smithi/7417649', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-09 09:51:45.211576', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF7td2LtYVdpK4KtW9p8jic4CsnBuniGqirbZDQEEPaRAy0azh9/GYVcDka2ueVp6ChLXNQy4Uyxvwsti8x+vrI='} 2023-10-09T11:12:48.083 INFO:teuthology.orchestra.console.smithi187:Power off 2023-10-09T11:12:48.083 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-09T11:12:48.108 DEBUG:teuthology.orchestra.console.smithi187:power off output: Chassis Power Control: Down/Off 2023-10-09T11:12:48.108 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T11:12:48.126 INFO:teuthology.orchestra.console.smithi190:Power off 2023-10-09T11:12:48.126 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-09T11:12:48.134 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off 2023-10-09T11:12:48.146 DEBUG:teuthology.orchestra.console.smithi190:power off output: Chassis Power Control: Down/Off 2023-10-09T11:12:48.146 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T11:12:48.168 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off 2023-10-09T11:12:48.235 INFO:teuthology.orchestra.console.smithi187:Power off completed 2023-10-09T11:12:48.269 INFO:teuthology.orchestra.console.smithi190:Power off completed 2023-10-09T11:12:48.384 INFO:teuthology.lock.ops:unlocked: smithi187.front.sepia.ceph.com 2023-10-09T11:12:48.417 INFO:teuthology.lock.ops:unlocked: smithi190.front.sepia.ceph.com