2023-10-21T19:04:39.077 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-21T19:04:39.078 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T19:04:39.207 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc4abf61f70>, signals=[15]) 2023-10-21T19:04:39.208 INFO:teuthology.lock.ops:Start node 'smithi131.front.sepia.ceph.com' reimaging 2023-10-21T19:04:39.209 INFO:teuthology.lock.ops:Updating [smithi131.front.sepia.ceph.com]: reset os type and version on server 2023-10-21T19:04:39.209 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server 2023-10-21T19:04:39.232 INFO:teuthology.lock.ops:Start node 'smithi135.front.sepia.ceph.com' reimaging 2023-10-21T19:04:39.232 INFO:teuthology.lock.ops:Updating [smithi135.front.sepia.ceph.com]: reset os type and version on server 2023-10-21T19:04:39.233 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server 2023-10-21T19:04:39.235 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /host {"name": "smithi131"} 2023-10-21T19:04:39.257 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /host {"name": "smithi135"} 2023-10-21T19:04:39.306 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-10-21T19:04:39.340 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-10-21T19:04:39.348 DEBUG:teuthology.provision.fog.smithi131:Requesting image smithi_centos_8.stream (ID 3) 2023-10-21T19:04:39.348 DEBUG:teuthology.provision.fog.smithi131:FOG request: PUT /host/236 {"imageID": 3} 2023-10-21T19:04:39.384 DEBUG:teuthology.provision.fog.smithi135:Requesting image smithi_centos_8.stream (ID 3) 2023-10-21T19:04:39.384 DEBUG:teuthology.provision.fog.smithi135:FOG request: PUT /host/240 {"imageID": 3} 2023-10-21T19:04:39.393 INFO:teuthology.provision.fog.smithi131:Scheduling deploy of centos 8.stream 2023-10-21T19:04:39.393 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None 2023-10-21T19:04:39.427 INFO:teuthology.provision.fog.smithi135:Scheduling deploy of centos 8.stream 2023-10-21T19:04:39.428 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-10-21T19:04:39.437 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /tasktype {"name": "deploy"} 2023-10-21T19:04:39.468 DEBUG:teuthology.provision.fog.smithi131:FOG request: POST /host/236/task {"taskTypeID": 1} 2023-10-21T19:04:39.475 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /tasktype {"name": "deploy"} 2023-10-21T19:04:39.511 DEBUG:teuthology.provision.fog.smithi135:FOG request: POST /host/240/task {"taskTypeID": 1} 2023-10-21T19:04:39.519 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None 2023-10-21T19:04:39.560 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-10-21T19:04:39.600 INFO:teuthology.orchestra.console.smithi131:Power off 2023-10-21T19:04:39.601 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-21T19:04:39.622 DEBUG:teuthology.orchestra.console.smithi131:power off output: Chassis Power Control: Down/Off 2023-10-21T19:04:39.622 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T19:04:39.639 INFO:teuthology.orchestra.console.smithi135:Power off 2023-10-21T19:04:39.640 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-21T19:04:39.648 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is off 2023-10-21T19:04:39.661 DEBUG:teuthology.orchestra.console.smithi135:power off output: Chassis Power Control: Down/Off 2023-10-21T19:04:39.661 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T19:04:39.683 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is off 2023-10-21T19:04:39.749 INFO:teuthology.orchestra.console.smithi131:Power off completed 2023-10-21T19:04:39.784 INFO:teuthology.orchestra.console.smithi135:Power off completed 2023-10-21T19:04:39.850 INFO:teuthology.orchestra.console.smithi131:Power on 2023-10-21T19:04:39.850 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-21T19:04:39.872 DEBUG:teuthology.orchestra.console.smithi131:power on output: Chassis Power Control: Up/On 2023-10-21T19:04:39.873 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T19:04:39.885 INFO:teuthology.orchestra.console.smithi135:Power on 2023-10-21T19:04:39.886 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-21T19:04:39.896 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is off 2023-10-21T19:04:39.906 DEBUG:teuthology.orchestra.console.smithi135:power on output: Chassis Power Control: Up/On 2023-10-21T19:04:39.906 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T19:04:39.927 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is off 2023-10-21T19:04:43.901 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T19:04:43.928 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T19:04:44.010 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is off 2023-10-21T19:04:44.036 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is off 2023-10-21T19:04:48.013 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T19:04:48.038 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T19:04:48.147 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on 2023-10-21T19:04:48.160 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is on 2023-10-21T19:04:48.248 INFO:teuthology.orchestra.console.smithi135:Power on completed 2023-10-21T19:04:48.261 INFO:teuthology.orchestra.console.smithi131:Power on completed 2023-10-21T19:04:48.349 INFO:teuthology.provision.fog.smithi135:Waiting for deploy to finish 2023-10-21T19:04:48.350 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-10-21T19:04:48.362 INFO:teuthology.provision.fog.smithi131:Waiting for deploy to finish 2023-10-21T19:04:48.362 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None 2023-10-21T19:05:03.405 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-10-21T19:05:03.412 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None 2023-10-21T19:05:18.492 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-10-21T19:05:18.494 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None 2023-10-21T19:05:33.561 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None 2023-10-21T19:05:33.564 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-10-21T19:05:48.638 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None 2023-10-21T19:05:48.640 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-10-21T19:06:03.714 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None 2023-10-21T19:06:03.716 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-10-21T19:06:18.786 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None 2023-10-21T19:06:18.788 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-10-21T19:06:33.856 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-10-21T19:06:33.858 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None 2023-10-21T19:06:48.934 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-10-21T19:06:48.936 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None 2023-10-21T19:07:04.002 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-10-21T19:07:04.004 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None 2023-10-21T19:07:19.070 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-10-21T19:07:19.071 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None 2023-10-21T19:07:19.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T19:07:34.142 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-10-21T19:07:34.192 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T19:07:37.466 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131 2023-10-21T19:07:43.471 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T19:07:46.522 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131 2023-10-21T19:07:52.527 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T19:07:52.570 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2023-10-21T19:07:55.578 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131 2023-10-21T19:07:58.574 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T19:08:01.583 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T19:08:01.626 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2023-10-21T19:08:04.638 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131 2023-10-21T19:08:07.629 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T19:08:10.643 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T19:08:10.682 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2023-10-21T19:08:13.722 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131 2023-10-21T19:08:16.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T19:08:19.726 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T19:08:19.742 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2023-10-21T19:08:25.747 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T19:09:19.783 WARNING:teuthology.provision.fog.smithi131:timed out 2023-10-21T19:09:25.754 WARNING:teuthology.provision.fog.smithi135:timed out 2023-10-21T19:09:25.786 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T19:09:26.070 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-21T19:09:26.071 DEBUG:teuthology.orchestra.run.smithi131:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-21T19:09:26.337 INFO:teuthology.provision.fog.smithi131:Node is ready 2023-10-21T19:09:26.337 DEBUG:teuthology.orchestra.run.smithi131:> hostname 2023-10-21T19:09:26.357 INFO:teuthology.orchestra.run.smithi131.stdout:smithi131.front.sepia.ceph.com 2023-10-21T19:09:26.357 DEBUG:teuthology.orchestra.run.smithi131:> grep smithi131.front.sepia.ceph.com /etc/hosts 2023-10-21T19:09:26.417 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.15.131 smithi131.front.sepia.ceph.com smithi131 2023-10-21T19:09:26.417 DEBUG:teuthology.orchestra.run.smithi131:> sudo hostname smithi131 2023-10-21T19:09:26.531 DEBUG:teuthology.orchestra.run.smithi131:> sudo sed -i -e 's/smithi131.front.sepia.ceph.com/smithi131/g' /etc/hosts 2023-10-21T19:09:26.562 DEBUG:teuthology.orchestra.run.smithi131:> sudo sed -i -e 's/172.21.15.131/172.21.15.131/g' /etc/hosts 2023-10-21T19:09:26.631 DEBUG:teuthology.orchestra.run.smithi131:> sudo sed -i -e 's/smithi131.front.sepia.ceph.com/smithi131/g' /etc/hostname 2023-10-21T19:09:26.699 DEBUG:teuthology.orchestra.run.smithi131:> sudo hostname smithi131 2023-10-21T19:09:26.767 DEBUG:teuthology.orchestra.run.smithi131:> cat /etc/os-release 2023-10-21T19:09:26.826 INFO:teuthology.orchestra.run.smithi131.stdout:NAME="CentOS Stream" 2023-10-21T19:09:26.826 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION="8" 2023-10-21T19:09:26.826 INFO:teuthology.orchestra.run.smithi131.stdout:ID="centos" 2023-10-21T19:09:26.827 INFO:teuthology.orchestra.run.smithi131.stdout:ID_LIKE="rhel fedora" 2023-10-21T19:09:26.827 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_ID="8" 2023-10-21T19:09:26.827 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM_ID="platform:el8" 2023-10-21T19:09:26.827 INFO:teuthology.orchestra.run.smithi131.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-21T19:09:26.827 INFO:teuthology.orchestra.run.smithi131.stdout:ANSI_COLOR="0;31" 2023-10-21T19:09:26.828 INFO:teuthology.orchestra.run.smithi131.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-21T19:09:26.828 INFO:teuthology.orchestra.run.smithi131.stdout:HOME_URL="https://centos.org/" 2023-10-21T19:09:26.828 INFO:teuthology.orchestra.run.smithi131.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-21T19:09:26.828 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-21T19:09:26.828 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-21T19:09:26.829 INFO:teuthology.provision.fog.smithi131:Deploy complete! 2023-10-21T19:09:26.831 DEBUG:teuthology.parallel:result is None 2023-10-21T19:09:31.758 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T19:09:32.012 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-21T19:09:32.012 DEBUG:teuthology.orchestra.run.smithi135:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-21T19:09:32.266 INFO:teuthology.provision.fog.smithi135:Node is ready 2023-10-21T19:09:32.266 DEBUG:teuthology.orchestra.run.smithi135:> hostname 2023-10-21T19:09:32.285 INFO:teuthology.orchestra.run.smithi135.stdout:smithi135.front.sepia.ceph.com 2023-10-21T19:09:32.286 DEBUG:teuthology.orchestra.run.smithi135:> grep smithi135.front.sepia.ceph.com /etc/hosts 2023-10-21T19:09:32.344 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135 smithi135.front.sepia.ceph.com smithi135 2023-10-21T19:09:32.345 DEBUG:teuthology.orchestra.run.smithi135:> sudo hostname smithi135 2023-10-21T19:09:32.448 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i -e 's/smithi135.front.sepia.ceph.com/smithi135/g' /etc/hosts 2023-10-21T19:09:32.477 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i -e 's/172.21.15.135/172.21.15.135/g' /etc/hosts 2023-10-21T19:09:32.545 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i -e 's/smithi135.front.sepia.ceph.com/smithi135/g' /etc/hostname 2023-10-21T19:09:32.613 DEBUG:teuthology.orchestra.run.smithi135:> sudo hostname smithi135 2023-10-21T19:09:32.680 DEBUG:teuthology.orchestra.run.smithi135:> cat /etc/os-release 2023-10-21T19:09:32.738 INFO:teuthology.orchestra.run.smithi135.stdout:NAME="CentOS Stream" 2023-10-21T19:09:32.738 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION="8" 2023-10-21T19:09:32.738 INFO:teuthology.orchestra.run.smithi135.stdout:ID="centos" 2023-10-21T19:09:32.739 INFO:teuthology.orchestra.run.smithi135.stdout:ID_LIKE="rhel fedora" 2023-10-21T19:09:32.739 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_ID="8" 2023-10-21T19:09:32.739 INFO:teuthology.orchestra.run.smithi135.stdout:PLATFORM_ID="platform:el8" 2023-10-21T19:09:32.739 INFO:teuthology.orchestra.run.smithi135.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-21T19:09:32.739 INFO:teuthology.orchestra.run.smithi135.stdout:ANSI_COLOR="0;31" 2023-10-21T19:09:32.739 INFO:teuthology.orchestra.run.smithi135.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-21T19:09:32.740 INFO:teuthology.orchestra.run.smithi135.stdout:HOME_URL="https://centos.org/" 2023-10-21T19:09:32.740 INFO:teuthology.orchestra.run.smithi135.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-21T19:09:32.740 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-21T19:09:32.740 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-21T19:09:32.740 INFO:teuthology.provision.fog.smithi135:Deploy complete! 2023-10-21T19:09:32.741 DEBUG:teuthology.parallel:result is None 2023-10-21T19:09:32.888 INFO:teuthology.lock.ops:Checking smithi131.front.sepia.ceph.com 2023-10-21T19:09:32.889 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-21T19:09:32.911 INFO:teuthology.lock.ops:Checking smithi135.front.sepia.ceph.com 2023-10-21T19:09:32.911 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-21T19:09:32.937 INFO:teuthology.lock.ops:Updating [smithi131.front.sepia.ceph.com]: set os type and version on server 2023-10-21T19:09:32.937 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2023-10-21T19:09:32.938 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T19:09:33.003 DEBUG:teuthology.orchestra.run.smithi131:> true 2023-10-21T19:09:33.076 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi131.front.sepia.ceph.com' 2023-10-21T19:09:33.077 DEBUG:teuthology.orchestra.run.smithi131:> uname -m 2023-10-21T19:09:33.139 INFO:teuthology.orchestra.run.smithi131.stdout:x86_64 2023-10-21T19:09:33.139 DEBUG:teuthology.orchestra.run.smithi131:> cat /etc/os-release 2023-10-21T19:09:33.200 INFO:teuthology.orchestra.run.smithi131.stdout:NAME="CentOS Stream" 2023-10-21T19:09:33.200 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION="8" 2023-10-21T19:09:33.201 INFO:teuthology.orchestra.run.smithi131.stdout:ID="centos" 2023-10-21T19:09:33.201 INFO:teuthology.orchestra.run.smithi131.stdout:ID_LIKE="rhel fedora" 2023-10-21T19:09:33.201 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_ID="8" 2023-10-21T19:09:33.201 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM_ID="platform:el8" 2023-10-21T19:09:33.201 INFO:teuthology.orchestra.run.smithi131.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-21T19:09:33.202 INFO:teuthology.orchestra.run.smithi131.stdout:ANSI_COLOR="0;31" 2023-10-21T19:09:33.202 INFO:teuthology.orchestra.run.smithi131.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-21T19:09:33.202 INFO:teuthology.orchestra.run.smithi131.stdout:HOME_URL="https://centos.org/" 2023-10-21T19:09:33.202 INFO:teuthology.orchestra.run.smithi131.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-21T19:09:33.202 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-21T19:09:33.203 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-21T19:09:33.203 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server 2023-10-21T19:09:33.227 INFO:teuthology.lock.ops:Updating [smithi135.front.sepia.ceph.com]: set os type and version on server 2023-10-21T19:09:33.228 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2023-10-21T19:09:33.228 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T19:09:33.296 DEBUG:teuthology.orchestra.run.smithi135:> true 2023-10-21T19:09:33.368 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi135.front.sepia.ceph.com' 2023-10-21T19:09:33.369 DEBUG:teuthology.orchestra.run.smithi135:> uname -m 2023-10-21T19:09:33.426 INFO:teuthology.orchestra.run.smithi135.stdout:x86_64 2023-10-21T19:09:33.427 DEBUG:teuthology.orchestra.run.smithi135:> cat /etc/os-release 2023-10-21T19:09:33.484 INFO:teuthology.orchestra.run.smithi135.stdout:NAME="CentOS Stream" 2023-10-21T19:09:33.484 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION="8" 2023-10-21T19:09:33.485 INFO:teuthology.orchestra.run.smithi135.stdout:ID="centos" 2023-10-21T19:09:33.485 INFO:teuthology.orchestra.run.smithi135.stdout:ID_LIKE="rhel fedora" 2023-10-21T19:09:33.485 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_ID="8" 2023-10-21T19:09:33.485 INFO:teuthology.orchestra.run.smithi135.stdout:PLATFORM_ID="platform:el8" 2023-10-21T19:09:33.485 INFO:teuthology.orchestra.run.smithi135.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-21T19:09:33.486 INFO:teuthology.orchestra.run.smithi135.stdout:ANSI_COLOR="0;31" 2023-10-21T19:09:33.486 INFO:teuthology.orchestra.run.smithi135.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-21T19:09:33.486 INFO:teuthology.orchestra.run.smithi135.stdout:HOME_URL="https://centos.org/" 2023-10-21T19:09:33.486 INFO:teuthology.orchestra.run.smithi135.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-21T19:09:33.486 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-21T19:09:33.487 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-21T19:09:33.487 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server 2023-10-21T19:09:33.511 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T19:09:33.623 INFO:teuthology.dispatcher.supervisor:Running job 7427761 2023-10-21T19:09:33.624 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2023-10-14_14:23:11-upgrade:pacific-x-reef-distro-default-smithi/7427761 --name teuthology-2023-10-14_14:23:11-upgrade:pacific-x-reef-distro-default-smithi --description upgrade:pacific-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} -- /home/teuthworker/archive/teuthology-2023-10-14_14:23:11-upgrade:pacific-x-reef-distro-default-smithi/7427761/orig.config.yaml 2023-10-21T19:09:33.627 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2023-10-14_14:23:11-upgrade:pacific-x-reef-distro-default-smithi/7427761 2023-10-21T19:09:33.628 INFO:teuthology.dispatcher.supervisor:Job PID: 517847 2023-10-21T19:09:33.629 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-21T19:11:33.727 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T19:13:33.895 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T19:15:34.071 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T19:17:34.227 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T19:19:34.391 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T19:21:34.558 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T19:23:34.731 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T19:25:34.903 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T19:27:35.068 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T19:29:35.240 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T19:31:35.407 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T19:33:35.583 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T19:35:35.735 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T19:37:35.907 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T19:39:36.066 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T19:41:36.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T19:43:36.396 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T19:45:36.563 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T19:47:36.728 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T19:49:36.896 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T19:51:37.056 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T19:53:37.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T19:55:37.398 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T19:57:37.563 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T19:59:37.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T20:01:37.892 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T20:03:38.068 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T20:05:38.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T20:07:38.304 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T20:09:38.478 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T20:11:38.655 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T20:13:38.823 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T20:15:38.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T20:17:39.153 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T20:19:39.311 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T20:21:39.483 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T20:23:39.648 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T20:25:39.823 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T20:27:40.000 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T20:29:40.155 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T20:31:40.335 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T20:31:40.404 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-21T20:31:40.609 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-21T20:31:40.610 INFO:teuthology.nuke:Checking targets against current locks 2023-10-21T20:31:40.666 DEBUG:teuthology.nuke:shortname: smithi131 2023-10-21T20:31:40.667 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-21T20:31:40.688 DEBUG:teuthology.nuke:shortname: smithi135 2023-10-21T20:31:40.688 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-21T20:31:40.692 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi131.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-10-14_14:23:11-upgrade:pacific-x-reef-distro-default-smithi/7427761', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-21 19:04:38.211439', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNtssckwqgMfsMfSBCYRSb2XkvxGxUCabRDDSSzadRRD8a8VMROJeWAx8GcZMZmM1PfsFvbExA2HyGMEVAOeuIY='} 2023-10-21T20:31:40.707 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi135.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-10-14_14:23:11-upgrade:pacific-x-reef-distro-default-smithi/7427761', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-21 19:04:38.209955', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPkzcNtKIPbR16wvlHiv1qwK57GHGYcmXLHfsV0MVXwIpSq8+MaHe2jWO9ZOFd2CQEEMlHCyRbiy6PXDru8CA4Y='} 2023-10-21T20:31:40.740 INFO:teuthology.orchestra.console.smithi131:Power off 2023-10-21T20:31:40.741 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-21T20:31:40.754 INFO:teuthology.orchestra.console.smithi135:Power off 2023-10-21T20:31:40.755 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-21T20:31:40.763 DEBUG:teuthology.orchestra.console.smithi131:power off output: Chassis Power Control: Down/Off 2023-10-21T20:31:40.764 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T20:31:40.776 DEBUG:teuthology.orchestra.console.smithi135:power off output: Chassis Power Control: Down/Off 2023-10-21T20:31:40.776 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T20:31:40.786 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is off 2023-10-21T20:31:40.797 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is off 2023-10-21T20:31:40.888 INFO:teuthology.orchestra.console.smithi131:Power off completed 2023-10-21T20:31:40.898 INFO:teuthology.orchestra.console.smithi135:Power off completed 2023-10-21T20:31:41.037 INFO:teuthology.lock.ops:unlocked: smithi131.front.sepia.ceph.com 2023-10-21T20:31:41.046 INFO:teuthology.lock.ops:unlocked: smithi135.front.sepia.ceph.com