2023-09-23T18:39:27.776 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-23T18:39:27.776 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T18:39:27.909 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7ae0fdcf70>, signals=[15]) 2023-09-23T18:39:27.910 INFO:teuthology.lock.ops:Start node 'smithi140.front.sepia.ceph.com' reimaging 2023-09-23T18:39:27.910 INFO:teuthology.lock.ops:Updating [smithi140.front.sepia.ceph.com]: reset os type and version on server 2023-09-23T18:39:27.910 INFO:teuthology.lock.ops:Updating smithi140.front.sepia.ceph.com on lock server 2023-09-23T18:39:27.939 INFO:teuthology.lock.ops:Start node 'smithi186.front.sepia.ceph.com' reimaging 2023-09-23T18:39:27.939 INFO:teuthology.lock.ops:Updating [smithi186.front.sepia.ceph.com]: reset os type and version on server 2023-09-23T18:39:27.939 INFO:teuthology.lock.ops:Updating smithi186.front.sepia.ceph.com on lock server 2023-09-23T18:39:27.940 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /host {"name": "smithi140"} 2023-09-23T18:39:27.964 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /host {"name": "smithi186"} 2023-09-23T18:39:28.008 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-09-23T18:39:28.034 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-09-23T18:39:28.046 DEBUG:teuthology.provision.fog.smithi140:Requesting image smithi_centos_8.stream (ID 3) 2023-09-23T18:39:28.046 DEBUG:teuthology.provision.fog.smithi140:FOG request: PUT /host/245 {"imageID": 3} 2023-09-23T18:39:28.073 DEBUG:teuthology.provision.fog.smithi186:Requesting image smithi_centos_8.stream (ID 3) 2023-09-23T18:39:28.073 DEBUG:teuthology.provision.fog.smithi186:FOG request: PUT /host/291 {"imageID": 3} 2023-09-23T18:39:28.087 INFO:teuthology.provision.fog.smithi140:Scheduling deploy of centos 8.stream 2023-09-23T18:39:28.087 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-23T18:39:28.119 INFO:teuthology.provision.fog.smithi186:Scheduling deploy of centos 8.stream 2023-09-23T18:39:28.119 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-09-23T18:39:28.130 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /tasktype {"name": "deploy"} 2023-09-23T18:39:28.166 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /tasktype {"name": "deploy"} 2023-09-23T18:39:28.170 DEBUG:teuthology.provision.fog.smithi140:FOG request: POST /host/245/task {"taskTypeID": 1} 2023-09-23T18:39:28.201 DEBUG:teuthology.provision.fog.smithi186:FOG request: POST /host/291/task {"taskTypeID": 1} 2023-09-23T18:39:28.259 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-23T18:39:28.265 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-09-23T18:39:28.350 INFO:teuthology.orchestra.console.smithi140:Power off 2023-09-23T18:39:28.350 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-23T18:39:28.361 INFO:teuthology.orchestra.console.smithi186:Power off 2023-09-23T18:39:28.361 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-23T18:39:28.382 DEBUG:teuthology.orchestra.console.smithi186:power off output: Chassis Power Control: Down/Off 2023-09-23T18:39:28.382 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-23T18:39:28.391 DEBUG:teuthology.orchestra.console.smithi140:power off output: Chassis Power Control: Down/Off 2023-09-23T18:39:28.391 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-23T18:39:28.402 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off 2023-09-23T18:39:28.411 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off 2023-09-23T18:39:28.503 INFO:teuthology.orchestra.console.smithi186:Power off completed 2023-09-23T18:39:28.512 INFO:teuthology.orchestra.console.smithi140:Power off completed 2023-09-23T18:39:28.604 INFO:teuthology.orchestra.console.smithi186:Power on 2023-09-23T18:39:28.605 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-23T18:39:28.613 INFO:teuthology.orchestra.console.smithi140:Power on 2023-09-23T18:39:28.613 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-23T18:39:28.626 DEBUG:teuthology.orchestra.console.smithi186:power on output: Chassis Power Control: Up/On 2023-09-23T18:39:28.626 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-23T18:39:28.633 DEBUG:teuthology.orchestra.console.smithi140:power on output: Chassis Power Control: Up/On 2023-09-23T18:39:28.633 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-23T18:39:28.646 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off 2023-09-23T18:39:28.653 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off 2023-09-23T18:39:32.651 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-23T18:39:32.657 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-23T18:39:32.759 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off 2023-09-23T18:39:32.765 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off 2023-09-23T18:39:36.764 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-23T18:39:36.770 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-23T18:39:36.872 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on 2023-09-23T18:39:36.878 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on 2023-09-23T18:39:36.974 INFO:teuthology.orchestra.console.smithi186:Power on completed 2023-09-23T18:39:36.979 INFO:teuthology.orchestra.console.smithi140:Power on completed 2023-09-23T18:39:37.075 INFO:teuthology.provision.fog.smithi186:Waiting for deploy to finish 2023-09-23T18:39:37.075 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-09-23T18:39:37.080 INFO:teuthology.provision.fog.smithi140:Waiting for deploy to finish 2023-09-23T18:39:37.081 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-23T18:39:52.151 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-23T18:39:52.152 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-09-23T18:40:07.222 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-09-23T18:40:07.224 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-23T18:40:22.294 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-23T18:40:22.295 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-09-23T18:40:37.374 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-23T18:40:37.375 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-09-23T18:40:52.452 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-23T18:40:52.454 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-09-23T18:41:07.526 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-09-23T18:41:07.528 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-23T18:41:22.602 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-23T18:41:22.603 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-09-23T18:41:37.678 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-23T18:41:37.679 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-09-23T18:41:52.766 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-09-23T18:41:52.768 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-23T18:42:07.838 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-09-23T18:42:07.839 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-23T18:42:22.915 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-09-23T18:42:22.917 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-23T18:42:22.974 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-23T18:42:22.976 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-23T18:42:23.096 ERROR:teuthology.orchestra.connection:Error authenticating with smithi140.front.sepia.ceph.com: Authentication failed. 2023-09-23T18:42:23.096 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-23T18:42:23.096 DEBUG:teuthology.orchestra.run.smithi140:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-23T18:42:23.097 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-23T18:42:24.102 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-23T18:42:41.406 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-09-23T18:42:47.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-23T18:42:50.490 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-09-23T18:42:56.492 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-23T18:42:59.546 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-09-23T18:43:05.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-23T18:43:08.606 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-09-23T18:43:14.607 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-23T18:43:17.658 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-09-23T18:43:23.660 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-23T18:44:23.662 WARNING:teuthology.provision.fog.smithi186:timed out 2023-09-23T18:44:29.678 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-23T18:44:29.891 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-23T18:44:29.892 DEBUG:teuthology.orchestra.run.smithi186:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-23T18:44:30.178 INFO:teuthology.provision.fog.smithi186:Node is ready 2023-09-23T18:44:30.178 DEBUG:teuthology.orchestra.run.smithi186:> hostname 2023-09-23T18:44:30.198 INFO:teuthology.orchestra.run.smithi186.stdout:smithi186.front.sepia.ceph.com 2023-09-23T18:44:30.199 DEBUG:teuthology.orchestra.run.smithi186:> grep smithi186.front.sepia.ceph.com /etc/hosts 2023-09-23T18:44:30.260 INFO:teuthology.orchestra.run.smithi186.stdout:172.21.15.186 smithi186.front.sepia.ceph.com smithi186 2023-09-23T18:44:30.261 DEBUG:teuthology.orchestra.run.smithi186:> sudo hostname smithi186 2023-09-23T18:44:30.366 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/smithi186.front.sepia.ceph.com/smithi186/g' /etc/hosts 2023-09-23T18:44:30.397 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/172.21.15.186/172.21.15.186/g' /etc/hosts 2023-09-23T18:44:30.467 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/smithi186.front.sepia.ceph.com/smithi186/g' /etc/hostname 2023-09-23T18:44:30.536 DEBUG:teuthology.orchestra.run.smithi186:> sudo hostname smithi186 2023-09-23T18:44:30.604 DEBUG:teuthology.orchestra.run.smithi186:> cat /etc/os-release 2023-09-23T18:44:30.662 INFO:teuthology.orchestra.run.smithi186.stdout:NAME="CentOS Stream" 2023-09-23T18:44:30.662 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION="8" 2023-09-23T18:44:30.662 INFO:teuthology.orchestra.run.smithi186.stdout:ID="centos" 2023-09-23T18:44:30.663 INFO:teuthology.orchestra.run.smithi186.stdout:ID_LIKE="rhel fedora" 2023-09-23T18:44:30.663 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_ID="8" 2023-09-23T18:44:30.663 INFO:teuthology.orchestra.run.smithi186.stdout:PLATFORM_ID="platform:el8" 2023-09-23T18:44:30.663 INFO:teuthology.orchestra.run.smithi186.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-23T18:44:30.663 INFO:teuthology.orchestra.run.smithi186.stdout:ANSI_COLOR="0;31" 2023-09-23T18:44:30.663 INFO:teuthology.orchestra.run.smithi186.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-23T18:44:30.663 INFO:teuthology.orchestra.run.smithi186.stdout:HOME_URL="https://centos.org/" 2023-09-23T18:44:30.663 INFO:teuthology.orchestra.run.smithi186.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-23T18:44:30.663 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-23T18:44:30.663 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-23T18:44:30.664 INFO:teuthology.provision.fog.smithi186:Deploy complete! 2023-09-23T18:44:30.665 DEBUG:teuthology.parallel:result is None 2023-09-23T18:44:42.746 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-09-23T18:44:42.747 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi140 2023-09-23T18:44:51.748 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi140.front.sepia.ceph.com' 2023-09-23T18:44:51.748 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-23T18:44:51.969 DEBUG:teuthology.orchestra.run.smithi140:> true 2023-09-23T18:44:52.223 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi140.front.sepia.ceph.com' 2023-09-23T18:44:52.223 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-23T18:44:52.223 DEBUG:teuthology.orchestra.run.smithi140:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-23T18:44:52.241 INFO:teuthology.provision.fog.smithi140:Node is ready 2023-09-23T18:44:52.241 DEBUG:teuthology.orchestra.run.smithi140:> hostname 2023-09-23T18:44:52.299 INFO:teuthology.orchestra.run.smithi140.stdout:smithi140.front.sepia.ceph.com 2023-09-23T18:44:52.299 DEBUG:teuthology.orchestra.run.smithi140:> grep smithi140.front.sepia.ceph.com /etc/hosts 2023-09-23T18:44:52.357 INFO:teuthology.orchestra.run.smithi140.stdout:172.21.15.140 smithi140.front.sepia.ceph.com smithi140 2023-09-23T18:44:52.358 DEBUG:teuthology.orchestra.run.smithi140:> sudo hostname smithi140 2023-09-23T18:44:52.461 DEBUG:teuthology.orchestra.run.smithi140:> sudo sed -i -e 's/smithi140.front.sepia.ceph.com/smithi140/g' /etc/hosts 2023-09-23T18:44:52.490 DEBUG:teuthology.orchestra.run.smithi140:> sudo sed -i -e 's/172.21.15.140/172.21.15.140/g' /etc/hosts 2023-09-23T18:44:52.557 DEBUG:teuthology.orchestra.run.smithi140:> sudo sed -i -e 's/smithi140.front.sepia.ceph.com/smithi140/g' /etc/hostname 2023-09-23T18:44:52.625 DEBUG:teuthology.orchestra.run.smithi140:> sudo hostname smithi140 2023-09-23T18:44:52.691 DEBUG:teuthology.orchestra.run.smithi140:> cat /etc/os-release 2023-09-23T18:44:52.749 INFO:teuthology.orchestra.run.smithi140.stdout:NAME="CentOS Stream" 2023-09-23T18:44:52.749 INFO:teuthology.orchestra.run.smithi140.stdout:VERSION="8" 2023-09-23T18:44:52.750 INFO:teuthology.orchestra.run.smithi140.stdout:ID="centos" 2023-09-23T18:44:52.750 INFO:teuthology.orchestra.run.smithi140.stdout:ID_LIKE="rhel fedora" 2023-09-23T18:44:52.750 INFO:teuthology.orchestra.run.smithi140.stdout:VERSION_ID="8" 2023-09-23T18:44:52.750 INFO:teuthology.orchestra.run.smithi140.stdout:PLATFORM_ID="platform:el8" 2023-09-23T18:44:52.750 INFO:teuthology.orchestra.run.smithi140.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-23T18:44:52.750 INFO:teuthology.orchestra.run.smithi140.stdout:ANSI_COLOR="0;31" 2023-09-23T18:44:52.750 INFO:teuthology.orchestra.run.smithi140.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-23T18:44:52.750 INFO:teuthology.orchestra.run.smithi140.stdout:HOME_URL="https://centos.org/" 2023-09-23T18:44:52.750 INFO:teuthology.orchestra.run.smithi140.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-23T18:44:52.750 INFO:teuthology.orchestra.run.smithi140.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-23T18:44:52.750 INFO:teuthology.orchestra.run.smithi140.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-23T18:44:52.751 INFO:teuthology.provision.fog.smithi140:Deploy complete! 2023-09-23T18:44:52.751 DEBUG:teuthology.parallel:result is None 2023-09-23T18:44:52.896 INFO:teuthology.lock.ops:Checking smithi140.front.sepia.ceph.com 2023-09-23T18:44:52.896 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-23T18:44:52.921 INFO:teuthology.lock.ops:Checking smithi186.front.sepia.ceph.com 2023-09-23T18:44:52.921 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-23T18:44:52.938 INFO:teuthology.lock.ops:Updating [smithi140.front.sepia.ceph.com]: set os type and version on server 2023-09-23T18:44:52.939 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi140.front.sepia.ceph.com' 2023-09-23T18:44:52.939 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-23T18:44:53.005 DEBUG:teuthology.orchestra.run.smithi140:> true 2023-09-23T18:44:53.072 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi140.front.sepia.ceph.com' 2023-09-23T18:44:53.072 DEBUG:teuthology.orchestra.run.smithi140:> uname -m 2023-09-23T18:44:53.129 INFO:teuthology.orchestra.run.smithi140.stdout:x86_64 2023-09-23T18:44:53.130 DEBUG:teuthology.orchestra.run.smithi140:> cat /etc/os-release 2023-09-23T18:44:53.187 INFO:teuthology.orchestra.run.smithi140.stdout:NAME="CentOS Stream" 2023-09-23T18:44:53.187 INFO:teuthology.orchestra.run.smithi140.stdout:VERSION="8" 2023-09-23T18:44:53.187 INFO:teuthology.orchestra.run.smithi140.stdout:ID="centos" 2023-09-23T18:44:53.187 INFO:teuthology.orchestra.run.smithi140.stdout:ID_LIKE="rhel fedora" 2023-09-23T18:44:53.187 INFO:teuthology.orchestra.run.smithi140.stdout:VERSION_ID="8" 2023-09-23T18:44:53.187 INFO:teuthology.orchestra.run.smithi140.stdout:PLATFORM_ID="platform:el8" 2023-09-23T18:44:53.187 INFO:teuthology.orchestra.run.smithi140.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-23T18:44:53.187 INFO:teuthology.orchestra.run.smithi140.stdout:ANSI_COLOR="0;31" 2023-09-23T18:44:53.187 INFO:teuthology.orchestra.run.smithi140.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-23T18:44:53.187 INFO:teuthology.orchestra.run.smithi140.stdout:HOME_URL="https://centos.org/" 2023-09-23T18:44:53.188 INFO:teuthology.orchestra.run.smithi140.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-23T18:44:53.188 INFO:teuthology.orchestra.run.smithi140.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-23T18:44:53.188 INFO:teuthology.orchestra.run.smithi140.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-23T18:44:53.189 INFO:teuthology.lock.ops:Updating smithi140.front.sepia.ceph.com on lock server 2023-09-23T18:44:53.213 INFO:teuthology.lock.ops:Updating [smithi186.front.sepia.ceph.com]: set os type and version on server 2023-09-23T18:44:53.213 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi186.front.sepia.ceph.com' 2023-09-23T18:44:53.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-23T18:44:53.280 DEBUG:teuthology.orchestra.run.smithi186:> true 2023-09-23T18:44:53.352 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi186.front.sepia.ceph.com' 2023-09-23T18:44:53.352 DEBUG:teuthology.orchestra.run.smithi186:> uname -m 2023-09-23T18:44:53.413 INFO:teuthology.orchestra.run.smithi186.stdout:x86_64 2023-09-23T18:44:53.413 DEBUG:teuthology.orchestra.run.smithi186:> cat /etc/os-release 2023-09-23T18:44:53.472 INFO:teuthology.orchestra.run.smithi186.stdout:NAME="CentOS Stream" 2023-09-23T18:44:53.472 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION="8" 2023-09-23T18:44:53.473 INFO:teuthology.orchestra.run.smithi186.stdout:ID="centos" 2023-09-23T18:44:53.473 INFO:teuthology.orchestra.run.smithi186.stdout:ID_LIKE="rhel fedora" 2023-09-23T18:44:53.473 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_ID="8" 2023-09-23T18:44:53.473 INFO:teuthology.orchestra.run.smithi186.stdout:PLATFORM_ID="platform:el8" 2023-09-23T18:44:53.473 INFO:teuthology.orchestra.run.smithi186.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-23T18:44:53.473 INFO:teuthology.orchestra.run.smithi186.stdout:ANSI_COLOR="0;31" 2023-09-23T18:44:53.473 INFO:teuthology.orchestra.run.smithi186.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-23T18:44:53.473 INFO:teuthology.orchestra.run.smithi186.stdout:HOME_URL="https://centos.org/" 2023-09-23T18:44:53.473 INFO:teuthology.orchestra.run.smithi186.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-23T18:44:53.473 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-23T18:44:53.473 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-23T18:44:53.474 INFO:teuthology.lock.ops:Updating smithi186.front.sepia.ceph.com on lock server 2023-09-23T18:44:53.496 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T18:44:53.611 INFO:teuthology.dispatcher.supervisor:Running job 7401796 2023-09-23T18:44:53.611 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2023-09-23_14:23:10-upgrade:pacific-x-reef-distro-default-smithi/7401796 --name teuthology-2023-09-23_14:23:10-upgrade:pacific-x-reef-distro-default-smithi --description upgrade:pacific-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} -- /home/teuthworker/archive/teuthology-2023-09-23_14:23:10-upgrade:pacific-x-reef-distro-default-smithi/7401796/orig.config.yaml 2023-09-23T18:44:53.613 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2023-09-23_14:23:10-upgrade:pacific-x-reef-distro-default-smithi/7401796 2023-09-23T18:44:53.614 INFO:teuthology.dispatcher.supervisor:Job PID: 4041227 2023-09-23T18:44:53.614 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-09-23T18:46:53.714 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T18:48:53.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T18:50:54.071 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T18:52:54.233 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T18:54:54.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T18:56:54.539 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T18:58:54.699 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T19:00:54.859 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T19:02:55.027 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T19:04:55.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T19:06:55.322 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T19:08:55.567 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T19:10:55.647 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T19:12:55.736 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T19:14:55.897 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T19:16:56.060 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T19:18:56.185 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T19:20:56.263 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T19:22:56.424 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T19:24:56.583 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T19:26:56.750 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T19:28:56.916 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T19:30:57.074 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T19:32:57.244 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T19:34:57.364 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T19:36:57.524 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T19:38:57.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T19:40:57.863 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T19:42:58.008 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T19:44:58.154 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T19:46:58.319 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T19:48:58.487 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T19:50:58.632 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T19:52:58.760 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T19:54:58.839 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T19:56:59.002 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T19:58:59.175 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T20:00:59.338 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T20:02:59.502 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T20:02:59.558 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-09-23T20:02:59.743 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-09-23T20:02:59.744 INFO:teuthology.nuke:Checking targets against current locks 2023-09-23T20:02:59.790 DEBUG:teuthology.nuke:shortname: smithi140 2023-09-23T20:02:59.790 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-23T20:02:59.807 DEBUG:teuthology.nuke:shortname: smithi186 2023-09-23T20:02:59.807 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-23T20:02:59.809 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi140.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-09-23_14:23:10-upgrade:pacific-x-reef-distro-default-smithi/7401796', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-23 18:39:26.939697', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKEtJlPFf0b/GVDJ4wu42gusGVelXuRaRw+58bZxoYJwg3YkCEYcweTrfURVw/n3O27BFuJsGu2h2JyIBJESMcA='} 2023-09-23T20:02:59.829 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi186.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-09-23_14:23:10-upgrade:pacific-x-reef-distro-default-smithi/7401796', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-23 18:39:26.941191', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLXehugqmysw7Q1cB957S5/79ARNGIItcG7P80ljSNwQvN+2czdiJe06D5zf4LKp9Ubd0/urRAC6Ck6ughlsHUc='} 2023-09-23T20:02:59.855 INFO:teuthology.orchestra.console.smithi140:Power off 2023-09-23T20:02:59.855 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-23T20:02:59.878 DEBUG:teuthology.orchestra.console.smithi140:power off output: Chassis Power Control: Down/Off 2023-09-23T20:02:59.878 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-23T20:02:59.891 INFO:teuthology.orchestra.console.smithi186:Power off 2023-09-23T20:02:59.891 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-23T20:02:59.898 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off 2023-09-23T20:02:59.912 DEBUG:teuthology.orchestra.console.smithi186:power off output: Chassis Power Control: Down/Off 2023-09-23T20:02:59.912 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-23T20:02:59.932 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off 2023-09-23T20:02:59.999 INFO:teuthology.orchestra.console.smithi140:Power off completed 2023-09-23T20:03:00.033 INFO:teuthology.orchestra.console.smithi186:Power off completed 2023-09-23T20:03:00.150 INFO:teuthology.lock.ops:unlocked: smithi140.front.sepia.ceph.com 2023-09-23T20:03:00.174 INFO:teuthology.lock.ops:unlocked: smithi186.front.sepia.ceph.com