2023-09-30T23:13:36.154 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-30T23:13:36.155 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T23:13:36.284 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5d67bb3ca0>, signals=[15]) 2023-09-30T23:13:36.284 INFO:teuthology.lock.ops:Start node 'smithi115.front.sepia.ceph.com' reimaging 2023-09-30T23:13:36.285 INFO:teuthology.lock.ops:Updating [smithi115.front.sepia.ceph.com]: reset os type and version on server 2023-09-30T23:13:36.285 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server 2023-09-30T23:13:36.308 INFO:teuthology.lock.ops:Start node 'smithi132.front.sepia.ceph.com' reimaging 2023-09-30T23:13:36.308 INFO:teuthology.lock.ops:Updating [smithi132.front.sepia.ceph.com]: reset os type and version on server 2023-09-30T23:13:36.308 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server 2023-09-30T23:13:36.309 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /host {"name": "smithi115"} 2023-09-30T23:13:36.332 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /host {"name": "smithi132"} 2023-09-30T23:13:36.387 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-09-30T23:13:36.407 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-09-30T23:13:36.430 DEBUG:teuthology.provision.fog.smithi115:Requesting image smithi_centos_9.stream (ID 10) 2023-09-30T23:13:36.431 DEBUG:teuthology.provision.fog.smithi115:FOG request: PUT /host/220 {"imageID": 10} 2023-09-30T23:13:36.450 DEBUG:teuthology.provision.fog.smithi132:Requesting image smithi_centos_9.stream (ID 10) 2023-09-30T23:13:36.450 DEBUG:teuthology.provision.fog.smithi132:FOG request: PUT /host/237 {"imageID": 10} 2023-09-30T23:13:36.495 INFO:teuthology.provision.fog.smithi115:Scheduling deploy of centos 9.stream 2023-09-30T23:13:36.495 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None 2023-09-30T23:13:36.501 INFO:teuthology.provision.fog.smithi132:Scheduling deploy of centos 9.stream 2023-09-30T23:13:36.501 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-09-30T23:13:36.544 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /tasktype {"name": "deploy"} 2023-09-30T23:13:36.555 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /tasktype {"name": "deploy"} 2023-09-30T23:13:36.583 DEBUG:teuthology.provision.fog.smithi115:FOG request: POST /host/220/task {"taskTypeID": 1} 2023-09-30T23:13:36.586 DEBUG:teuthology.provision.fog.smithi132:FOG request: POST /host/237/task {"taskTypeID": 1} 2023-09-30T23:13:36.636 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-09-30T23:13:36.642 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None 2023-09-30T23:13:36.723 INFO:teuthology.orchestra.console.smithi115:Power off 2023-09-30T23:13:36.724 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-30T23:13:36.735 INFO:teuthology.orchestra.console.smithi132:Power off 2023-09-30T23:13:36.736 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-30T23:13:36.745 DEBUG:teuthology.orchestra.console.smithi115:power off output: Chassis Power Control: Down/Off 2023-09-30T23:13:36.745 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T23:13:36.756 DEBUG:teuthology.orchestra.console.smithi132:power off output: Chassis Power Control: Down/Off 2023-09-30T23:13:36.756 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T23:13:36.767 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on 2023-09-30T23:13:36.777 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on 2023-09-30T23:13:40.770 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T23:13:40.778 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T23:13:40.879 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on 2023-09-30T23:13:40.888 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on 2023-09-30T23:13:44.880 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T23:13:44.889 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T23:13:44.989 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off 2023-09-30T23:13:44.997 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off 2023-09-30T23:13:45.090 INFO:teuthology.orchestra.console.smithi115:Power off completed 2023-09-30T23:13:45.098 INFO:teuthology.orchestra.console.smithi132:Power off completed 2023-09-30T23:13:45.191 INFO:teuthology.orchestra.console.smithi115:Power on 2023-09-30T23:13:45.192 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-30T23:13:45.200 INFO:teuthology.orchestra.console.smithi132:Power on 2023-09-30T23:13:45.200 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-30T23:13:45.215 DEBUG:teuthology.orchestra.console.smithi115:power on output: Chassis Power Control: Up/On 2023-09-30T23:13:45.215 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T23:13:45.223 DEBUG:teuthology.orchestra.console.smithi132:power on output: Chassis Power Control: Up/On 2023-09-30T23:13:45.223 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T23:13:45.236 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off 2023-09-30T23:13:45.243 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off 2023-09-30T23:13:49.238 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T23:13:49.245 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T23:13:49.347 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off 2023-09-30T23:13:49.354 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off 2023-09-30T23:13:53.350 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T23:13:53.357 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T23:13:53.459 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on 2023-09-30T23:13:53.465 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on 2023-09-30T23:13:53.560 INFO:teuthology.orchestra.console.smithi115:Power on completed 2023-09-30T23:13:53.567 INFO:teuthology.orchestra.console.smithi132:Power on completed 2023-09-30T23:13:53.661 INFO:teuthology.provision.fog.smithi115:Waiting for deploy to finish 2023-09-30T23:13:53.661 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None 2023-09-30T23:13:53.667 INFO:teuthology.provision.fog.smithi132:Waiting for deploy to finish 2023-09-30T23:13:53.668 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-09-30T23:14:08.734 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None 2023-09-30T23:14:08.735 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-09-30T23:14:23.802 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-09-30T23:14:23.803 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None 2023-09-30T23:14:38.886 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-09-30T23:14:38.887 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None 2023-09-30T23:14:53.962 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None 2023-09-30T23:14:53.963 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-09-30T23:15:09.039 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-09-30T23:15:09.041 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None 2023-09-30T23:15:24.114 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None 2023-09-30T23:15:24.115 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-09-30T23:15:39.209 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-09-30T23:15:39.210 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None 2023-09-30T23:15:54.286 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None 2023-09-30T23:15:54.287 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-09-30T23:16:09.366 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None 2023-09-30T23:16:09.367 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-09-30T23:16:24.446 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None 2023-09-30T23:16:24.448 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-09-30T23:16:24.510 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T23:16:24.513 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T23:16:24.591 ERROR:teuthology.orchestra.connection:Error authenticating with smithi115.front.sepia.ceph.com: Authentication failed. 2023-09-30T23:16:24.591 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-30T23:16:24.591 DEBUG:teuthology.orchestra.run.smithi115:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-30T23:16:24.593 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-30T23:16:27.578 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-09-30T23:16:33.580 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T23:16:36.634 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-09-30T23:16:42.636 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T23:16:45.690 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-09-30T23:16:51.691 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T23:16:54.746 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-09-30T23:17:00.747 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T23:17:03.802 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-09-30T23:17:09.804 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T23:17:12.858 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-09-30T23:17:18.860 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T23:17:37.274 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-09-30T23:17:43.275 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T23:17:46.334 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-09-30T23:17:52.335 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T23:17:55.386 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-09-30T23:18:01.387 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T23:18:01.635 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-30T23:18:01.635 DEBUG:teuthology.orchestra.run.smithi132:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-30T23:18:21.982 INFO:teuthology.provision.fog.smithi132:Node is ready 2023-09-30T23:18:21.982 DEBUG:teuthology.orchestra.run.smithi132:> hostname 2023-09-30T23:18:22.000 INFO:teuthology.orchestra.run.smithi132.stdout:smithi132.front.sepia.ceph.com 2023-09-30T23:18:22.001 DEBUG:teuthology.orchestra.run.smithi132:> grep smithi132.front.sepia.ceph.com /etc/hosts 2023-09-30T23:18:22.058 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.15.132 smithi132.front.sepia.ceph.com smithi132 2023-09-30T23:18:22.059 DEBUG:teuthology.orchestra.run.smithi132:> sudo hostname smithi132 2023-09-30T23:18:22.176 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/smithi132.front.sepia.ceph.com/smithi132/g' /etc/hosts 2023-09-30T23:18:22.207 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/172.21.15.132/172.21.15.132/g' /etc/hosts 2023-09-30T23:18:22.278 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/smithi132.front.sepia.ceph.com/smithi132/g' /etc/hostname 2023-09-30T23:18:22.347 DEBUG:teuthology.orchestra.run.smithi132:> sudo hostname smithi132 2023-09-30T23:18:22.450 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release 2023-09-30T23:18:22.505 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="CentOS Stream" 2023-09-30T23:18:22.505 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="9" 2023-09-30T23:18:22.505 INFO:teuthology.orchestra.run.smithi132.stdout:ID="centos" 2023-09-30T23:18:22.505 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="rhel fedora" 2023-09-30T23:18:22.505 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="9" 2023-09-30T23:18:22.505 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el9" 2023-09-30T23:18:22.506 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="CentOS Stream 9" 2023-09-30T23:18:22.506 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31" 2023-09-30T23:18:22.506 INFO:teuthology.orchestra.run.smithi132.stdout:LOGO="fedora-logo-icon" 2023-09-30T23:18:22.506 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-09-30T23:18:22.506 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://centos.org/" 2023-09-30T23:18:22.506 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-30T23:18:22.506 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-09-30T23:18:22.506 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-30T23:18:22.507 INFO:teuthology.provision.fog.smithi132:Deploy complete! 2023-09-30T23:18:22.508 DEBUG:teuthology.parallel:result is None 2023-09-30T23:19:58.842 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-09-30T23:19:58.843 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi115 2023-09-30T23:20:07.850 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2023-09-30T23:20:07.851 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T23:20:08.077 DEBUG:teuthology.orchestra.run.smithi115:> true 2023-09-30T23:20:08.411 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2023-09-30T23:20:08.411 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-30T23:20:08.411 DEBUG:teuthology.orchestra.run.smithi115:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-30T23:20:08.426 INFO:teuthology.provision.fog.smithi115:Node is ready 2023-09-30T23:20:08.427 DEBUG:teuthology.orchestra.run.smithi115:> hostname 2023-09-30T23:20:08.481 INFO:teuthology.orchestra.run.smithi115.stdout:smithi115.front.sepia.ceph.com 2023-09-30T23:20:08.481 DEBUG:teuthology.orchestra.run.smithi115:> grep smithi115.front.sepia.ceph.com /etc/hosts 2023-09-30T23:20:08.537 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115 smithi115.front.sepia.ceph.com smithi115 2023-09-30T23:20:08.537 DEBUG:teuthology.orchestra.run.smithi115:> sudo hostname smithi115 2023-09-30T23:20:08.654 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/smithi115.front.sepia.ceph.com/smithi115/g' /etc/hosts 2023-09-30T23:20:08.683 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/172.21.15.115/172.21.15.115/g' /etc/hosts 2023-09-30T23:20:08.751 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/smithi115.front.sepia.ceph.com/smithi115/g' /etc/hostname 2023-09-30T23:20:08.819 DEBUG:teuthology.orchestra.run.smithi115:> sudo hostname smithi115 2023-09-30T23:20:08.885 DEBUG:teuthology.orchestra.run.smithi115:> cat /etc/os-release 2023-09-30T23:20:08.939 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="CentOS Stream" 2023-09-30T23:20:08.939 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="9" 2023-09-30T23:20:08.939 INFO:teuthology.orchestra.run.smithi115.stdout:ID="centos" 2023-09-30T23:20:08.940 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="rhel fedora" 2023-09-30T23:20:08.940 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="9" 2023-09-30T23:20:08.940 INFO:teuthology.orchestra.run.smithi115.stdout:PLATFORM_ID="platform:el9" 2023-09-30T23:20:08.940 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="CentOS Stream 9" 2023-09-30T23:20:08.940 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31" 2023-09-30T23:20:08.940 INFO:teuthology.orchestra.run.smithi115.stdout:LOGO="fedora-logo-icon" 2023-09-30T23:20:08.940 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-09-30T23:20:08.940 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://centos.org/" 2023-09-30T23:20:08.940 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-30T23:20:08.940 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-09-30T23:20:08.940 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-30T23:20:08.941 INFO:teuthology.provision.fog.smithi115:Deploy complete! 2023-09-30T23:20:08.941 DEBUG:teuthology.parallel:result is None 2023-09-30T23:20:09.110 INFO:teuthology.lock.ops:Checking smithi115.front.sepia.ceph.com 2023-09-30T23:20:09.110 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-30T23:20:09.135 INFO:teuthology.lock.ops:Checking smithi132.front.sepia.ceph.com 2023-09-30T23:20:09.135 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-30T23:20:09.153 INFO:teuthology.lock.ops:Updating [smithi115.front.sepia.ceph.com]: set os type and version on server 2023-09-30T23:20:09.153 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2023-09-30T23:20:09.154 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T23:20:09.234 DEBUG:teuthology.orchestra.run.smithi115:> true 2023-09-30T23:20:09.300 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2023-09-30T23:20:09.300 DEBUG:teuthology.orchestra.run.smithi115:> uname -m 2023-09-30T23:20:09.354 INFO:teuthology.orchestra.run.smithi115.stdout:x86_64 2023-09-30T23:20:09.354 DEBUG:teuthology.orchestra.run.smithi115:> cat /etc/os-release 2023-09-30T23:20:09.408 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="CentOS Stream" 2023-09-30T23:20:09.408 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="9" 2023-09-30T23:20:09.408 INFO:teuthology.orchestra.run.smithi115.stdout:ID="centos" 2023-09-30T23:20:09.409 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="rhel fedora" 2023-09-30T23:20:09.409 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="9" 2023-09-30T23:20:09.409 INFO:teuthology.orchestra.run.smithi115.stdout:PLATFORM_ID="platform:el9" 2023-09-30T23:20:09.409 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="CentOS Stream 9" 2023-09-30T23:20:09.409 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31" 2023-09-30T23:20:09.409 INFO:teuthology.orchestra.run.smithi115.stdout:LOGO="fedora-logo-icon" 2023-09-30T23:20:09.409 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-09-30T23:20:09.409 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://centos.org/" 2023-09-30T23:20:09.409 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-30T23:20:09.409 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-09-30T23:20:09.409 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-30T23:20:09.410 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server 2023-09-30T23:20:09.435 INFO:teuthology.lock.ops:Updating [smithi132.front.sepia.ceph.com]: set os type and version on server 2023-09-30T23:20:09.435 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2023-09-30T23:20:09.435 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T23:20:09.519 DEBUG:teuthology.orchestra.run.smithi132:> true 2023-09-30T23:20:09.692 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi132.front.sepia.ceph.com' 2023-09-30T23:20:09.693 DEBUG:teuthology.orchestra.run.smithi132:> uname -m 2023-09-30T23:20:09.747 INFO:teuthology.orchestra.run.smithi132.stdout:x86_64 2023-09-30T23:20:09.747 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release 2023-09-30T23:20:09.801 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="CentOS Stream" 2023-09-30T23:20:09.802 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="9" 2023-09-30T23:20:09.802 INFO:teuthology.orchestra.run.smithi132.stdout:ID="centos" 2023-09-30T23:20:09.802 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="rhel fedora" 2023-09-30T23:20:09.802 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="9" 2023-09-30T23:20:09.802 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el9" 2023-09-30T23:20:09.802 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="CentOS Stream 9" 2023-09-30T23:20:09.802 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31" 2023-09-30T23:20:09.802 INFO:teuthology.orchestra.run.smithi132.stdout:LOGO="fedora-logo-icon" 2023-09-30T23:20:09.802 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-09-30T23:20:09.803 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://centos.org/" 2023-09-30T23:20:09.803 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-30T23:20:09.803 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-09-30T23:20:09.803 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-30T23:20:09.803 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server 2023-09-30T23:20:09.826 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T23:20:09.921 INFO:teuthology.dispatcher.supervisor:Running job 7406417 2023-09-30T23:20:09.921 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_cbodley@teuthology --archive /home/teuthworker/archive/cbodley-2023-09-29_14:54:02-rgw-wip-cbodley-testing-distro-default-smithi/7406417 --name cbodley-2023-09-29_14:54:02-rgw-wip-cbodley-testing-distro-default-smithi --description rgw/upgrade/{1-install/quincy/{distro$/{centos_latest} install overrides} 2-setup 3-upgrade-sequence/osds-then-rgws cluster frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides} -- /home/teuthworker/archive/cbodley-2023-09-29_14:54:02-rgw-wip-cbodley-testing-distro-default-smithi/7406417/orig.config.yaml 2023-09-30T23:20:09.924 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/cbodley-2023-09-29_14:54:02-rgw-wip-cbodley-testing-distro-default-smithi/7406417 2023-09-30T23:20:09.924 INFO:teuthology.dispatcher.supervisor:Job PID: 1439011 2023-09-30T23:20:09.925 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-09-30T23:22:10.024 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T23:24:10.188 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T23:26:10.352 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T23:28:10.525 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T23:30:10.695 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T23:32:10.860 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T23:34:11.035 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T23:36:11.251 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T23:38:11.423 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T23:40:11.599 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T23:42:11.755 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T23:44:11.927 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T23:44:11.993 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-09-30T23:44:12.096 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-09-30T23:44:12.096 INFO:teuthology.nuke:Checking targets against current locks 2023-09-30T23:44:12.143 DEBUG:teuthology.nuke:shortname: smithi115 2023-09-30T23:44:12.143 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-30T23:44:12.165 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi115.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2023-09-29_14:54:02-rgw-wip-cbodley-testing-distro-default-smithi/7406417', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-30 23:13:35.308814', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGzL0pstg6J+YmEPGu1tRFyviJwEhg3THaiSpMvRtWIKwgtSU2rRKTnauboLIAI8FfTSRoKk+fsobL3etaaZnac='} 2023-09-30T23:44:12.169 DEBUG:teuthology.nuke:shortname: smithi132 2023-09-30T23:44:12.169 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-30T23:44:12.191 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi132.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2023-09-29_14:54:02-rgw-wip-cbodley-testing-distro-default-smithi/7406417', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-30 23:13:35.306868', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLAQXfMWQylcO7t8D6rqsb/bEVDjNDUyHEGyAetV6VFIEH765Ht4Ut3AWkzeiBDXBfA9lRNBD5jNuK4jVcB/wMw='} 2023-09-30T23:44:12.208 INFO:teuthology.orchestra.console.smithi115:Power off 2023-09-30T23:44:12.209 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-30T23:44:12.230 DEBUG:teuthology.orchestra.console.smithi115:power off output: Chassis Power Control: Down/Off 2023-09-30T23:44:12.231 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T23:44:12.245 INFO:teuthology.orchestra.console.smithi132:Power off 2023-09-30T23:44:12.245 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-30T23:44:12.252 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off 2023-09-30T23:44:12.265 DEBUG:teuthology.orchestra.console.smithi132:power off output: Chassis Power Control: Down/Off 2023-09-30T23:44:12.265 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T23:44:12.287 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off 2023-09-30T23:44:12.354 INFO:teuthology.orchestra.console.smithi115:Power off completed 2023-09-30T23:44:12.389 INFO:teuthology.orchestra.console.smithi132:Power off completed 2023-09-30T23:44:12.512 INFO:teuthology.lock.ops:unlocked: smithi115.front.sepia.ceph.com 2023-09-30T23:44:12.534 INFO:teuthology.lock.ops:unlocked: smithi132.front.sepia.ceph.com