2023-09-15T15:49:17.864 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-15T15:49:17.866 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-15T15:49:18.004 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5f0a8b3c10>, signals=[15]) 2023-09-15T15:49:18.005 INFO:teuthology.lock.ops:Start node 'smithi156.front.sepia.ceph.com' reimaging 2023-09-15T15:49:18.005 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: reset os type and version on server 2023-09-15T15:49:18.005 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2023-09-15T15:49:18.028 INFO:teuthology.lock.ops:Start node 'smithi186.front.sepia.ceph.com' reimaging 2023-09-15T15:49:18.029 INFO:teuthology.lock.ops:Updating [smithi186.front.sepia.ceph.com]: reset os type and version on server 2023-09-15T15:49:18.029 INFO:teuthology.lock.ops:Updating smithi186.front.sepia.ceph.com on lock server 2023-09-15T15:49:18.031 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /host {"name": "smithi156"} 2023-09-15T15:49:18.052 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /host {"name": "smithi186"} 2023-09-15T15:49:18.107 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-09-15T15:49:18.120 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-09-15T15:49:18.159 DEBUG:teuthology.provision.fog.smithi156:Requesting image smithi_centos_8.stream (ID 3) 2023-09-15T15:49:18.159 DEBUG:teuthology.provision.fog.smithi156:FOG request: PUT /host/261 {"imageID": 3} 2023-09-15T15:49:18.163 DEBUG:teuthology.provision.fog.smithi186:Requesting image smithi_centos_8.stream (ID 3) 2023-09-15T15:49:18.163 DEBUG:teuthology.provision.fog.smithi186:FOG request: PUT /host/291 {"imageID": 3} 2023-09-15T15:49:18.205 INFO:teuthology.provision.fog.smithi156:Scheduling deploy of centos 8.stream 2023-09-15T15:49:18.205 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-09-15T15:49:18.208 INFO:teuthology.provision.fog.smithi186:Scheduling deploy of centos 8.stream 2023-09-15T15:49:18.208 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-09-15T15:49:18.277 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /tasktype {"name": "deploy"} 2023-09-15T15:49:18.285 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /tasktype {"name": "deploy"} 2023-09-15T15:49:18.312 DEBUG:teuthology.provision.fog.smithi186:FOG request: POST /host/291/task {"taskTypeID": 1} 2023-09-15T15:49:18.320 DEBUG:teuthology.provision.fog.smithi156:FOG request: POST /host/261/task {"taskTypeID": 1} 2023-09-15T15:49:18.371 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-09-15T15:49:18.375 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-09-15T15:49:18.464 INFO:teuthology.orchestra.console.smithi186:Power off 2023-09-15T15:49:18.465 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-15T15:49:18.478 INFO:teuthology.orchestra.console.smithi156:Power off 2023-09-15T15:49:18.478 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-15T15:49:18.491 DEBUG:teuthology.orchestra.console.smithi186:power off output: Chassis Power Control: Down/Off 2023-09-15T15:49:18.492 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-15T15:49:18.500 DEBUG:teuthology.orchestra.console.smithi156:power off output: Chassis Power Control: Down/Off 2023-09-15T15:49:18.500 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-15T15:49:18.512 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on 2023-09-15T15:49:18.520 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2023-09-15T15:49:22.517 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-15T15:49:22.524 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-15T15:49:22.626 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on 2023-09-15T15:49:22.633 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2023-09-15T15:49:26.632 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-15T15:49:26.640 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-15T15:49:26.742 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off 2023-09-15T15:49:26.751 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2023-09-15T15:49:26.844 INFO:teuthology.orchestra.console.smithi186:Power off completed 2023-09-15T15:49:26.852 INFO:teuthology.orchestra.console.smithi156:Power off completed 2023-09-15T15:49:26.946 INFO:teuthology.orchestra.console.smithi186:Power on 2023-09-15T15:49:26.946 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-15T15:49:26.954 INFO:teuthology.orchestra.console.smithi156:Power on 2023-09-15T15:49:26.955 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-15T15:49:26.968 DEBUG:teuthology.orchestra.console.smithi186:power on output: Chassis Power Control: Up/On 2023-09-15T15:49:26.968 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-15T15:49:26.977 DEBUG:teuthology.orchestra.console.smithi156:power on output: Chassis Power Control: Up/On 2023-09-15T15:49:26.978 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-15T15:49:26.988 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off 2023-09-15T15:49:26.998 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2023-09-15T15:49:30.993 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-15T15:49:31.001 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-15T15:49:31.103 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off 2023-09-15T15:49:31.110 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2023-09-15T15:49:35.106 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-15T15:49:35.112 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-15T15:49:35.214 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on 2023-09-15T15:49:35.220 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2023-09-15T15:49:35.316 INFO:teuthology.orchestra.console.smithi186:Power on completed 2023-09-15T15:49:35.322 INFO:teuthology.orchestra.console.smithi156:Power on completed 2023-09-15T15:49:35.417 INFO:teuthology.provision.fog.smithi186:Waiting for deploy to finish 2023-09-15T15:49:35.418 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-09-15T15:49:35.423 INFO:teuthology.provision.fog.smithi156:Waiting for deploy to finish 2023-09-15T15:49:35.423 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-09-15T15:49:50.498 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-09-15T15:49:50.499 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-09-15T15:50:05.586 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-09-15T15:50:05.587 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-09-15T15:50:20.674 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-09-15T15:50:20.675 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-09-15T15:50:35.762 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-09-15T15:50:35.764 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-09-15T15:50:50.838 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-09-15T15:50:50.839 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-09-15T15:51:05.916 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-09-15T15:51:05.918 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-09-15T15:51:21.010 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-09-15T15:51:21.011 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-09-15T15:51:36.102 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-09-15T15:51:36.104 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-09-15T15:51:51.186 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-09-15T15:51:51.187 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-09-15T15:52:06.270 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-09-15T15:52:06.271 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-09-15T15:52:21.350 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-09-15T15:52:21.353 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-09-15T15:52:21.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-15T15:52:21.437 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-15T15:52:39.834 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-09-15T15:52:39.835 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-09-15T15:52:45.842 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-15T15:52:45.844 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-15T15:52:48.922 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-09-15T15:52:48.922 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-09-15T15:52:54.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-15T15:52:54.928 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-15T15:52:57.978 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-09-15T15:52:57.978 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-09-15T15:53:03.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-15T15:53:03.984 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-15T15:53:07.038 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-09-15T15:53:07.038 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-09-15T15:53:13.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-15T15:53:13.046 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-15T15:53:16.126 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-09-15T15:53:22.128 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-15T15:54:13.098 WARNING:teuthology.provision.fog.smithi156:timed out 2023-09-15T15:54:19.106 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-15T15:54:19.354 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-15T15:54:19.355 DEBUG:teuthology.orchestra.run.smithi156:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-15T15:54:19.617 INFO:teuthology.provision.fog.smithi156:Node is ready 2023-09-15T15:54:19.618 DEBUG:teuthology.orchestra.run.smithi156:> hostname 2023-09-15T15:54:19.638 INFO:teuthology.orchestra.run.smithi156.stdout:smithi156.front.sepia.ceph.com 2023-09-15T15:54:19.638 DEBUG:teuthology.orchestra.run.smithi156:> grep smithi156.front.sepia.ceph.com /etc/hosts 2023-09-15T15:54:19.698 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.15.156 smithi156.front.sepia.ceph.com smithi156 2023-09-15T15:54:19.698 DEBUG:teuthology.orchestra.run.smithi156:> sudo hostname smithi156 2023-09-15T15:54:19.814 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/smithi156.front.sepia.ceph.com/smithi156/g' /etc/hosts 2023-09-15T15:54:19.845 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/172.21.15.156/172.21.15.156/g' /etc/hosts 2023-09-15T15:54:19.913 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/smithi156.front.sepia.ceph.com/smithi156/g' /etc/hostname 2023-09-15T15:54:19.982 DEBUG:teuthology.orchestra.run.smithi156:> sudo hostname smithi156 2023-09-15T15:54:20.049 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release 2023-09-15T15:54:20.107 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="CentOS Stream" 2023-09-15T15:54:20.108 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="8" 2023-09-15T15:54:20.108 INFO:teuthology.orchestra.run.smithi156.stdout:ID="centos" 2023-09-15T15:54:20.108 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="rhel fedora" 2023-09-15T15:54:20.108 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="8" 2023-09-15T15:54:20.109 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el8" 2023-09-15T15:54:20.109 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-15T15:54:20.109 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31" 2023-09-15T15:54:20.109 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-15T15:54:20.109 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://centos.org/" 2023-09-15T15:54:20.110 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-15T15:54:20.110 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-15T15:54:20.110 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-15T15:54:20.111 INFO:teuthology.provision.fog.smithi156:Deploy complete! 2023-09-15T15:54:20.112 DEBUG:teuthology.parallel:result is None 2023-09-15T15:54:22.133 WARNING:teuthology.provision.fog.smithi186:timed out 2023-09-15T15:54:28.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-15T15:54:28.353 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-15T15:54:28.353 DEBUG:teuthology.orchestra.run.smithi186:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-15T15:54:28.598 INFO:teuthology.provision.fog.smithi186:Node is ready 2023-09-15T15:54:28.598 DEBUG:teuthology.orchestra.run.smithi186:> hostname 2023-09-15T15:54:28.617 INFO:teuthology.orchestra.run.smithi186.stdout:smithi186.front.sepia.ceph.com 2023-09-15T15:54:28.617 DEBUG:teuthology.orchestra.run.smithi186:> grep smithi186.front.sepia.ceph.com /etc/hosts 2023-09-15T15:54:28.676 INFO:teuthology.orchestra.run.smithi186.stdout:172.21.15.186 smithi186.front.sepia.ceph.com smithi186 2023-09-15T15:54:28.677 DEBUG:teuthology.orchestra.run.smithi186:> sudo hostname smithi186 2023-09-15T15:54:28.777 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/smithi186.front.sepia.ceph.com/smithi186/g' /etc/hosts 2023-09-15T15:54:28.806 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/172.21.15.186/172.21.15.186/g' /etc/hosts 2023-09-15T15:54:28.874 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/smithi186.front.sepia.ceph.com/smithi186/g' /etc/hostname 2023-09-15T15:54:28.943 DEBUG:teuthology.orchestra.run.smithi186:> sudo hostname smithi186 2023-09-15T15:54:29.009 DEBUG:teuthology.orchestra.run.smithi186:> cat /etc/os-release 2023-09-15T15:54:29.067 INFO:teuthology.orchestra.run.smithi186.stdout:NAME="CentOS Stream" 2023-09-15T15:54:29.067 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION="8" 2023-09-15T15:54:29.068 INFO:teuthology.orchestra.run.smithi186.stdout:ID="centos" 2023-09-15T15:54:29.068 INFO:teuthology.orchestra.run.smithi186.stdout:ID_LIKE="rhel fedora" 2023-09-15T15:54:29.068 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_ID="8" 2023-09-15T15:54:29.068 INFO:teuthology.orchestra.run.smithi186.stdout:PLATFORM_ID="platform:el8" 2023-09-15T15:54:29.068 INFO:teuthology.orchestra.run.smithi186.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-15T15:54:29.068 INFO:teuthology.orchestra.run.smithi186.stdout:ANSI_COLOR="0;31" 2023-09-15T15:54:29.069 INFO:teuthology.orchestra.run.smithi186.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-15T15:54:29.069 INFO:teuthology.orchestra.run.smithi186.stdout:HOME_URL="https://centos.org/" 2023-09-15T15:54:29.069 INFO:teuthology.orchestra.run.smithi186.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-15T15:54:29.069 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-15T15:54:29.069 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-15T15:54:29.070 INFO:teuthology.provision.fog.smithi186:Deploy complete! 2023-09-15T15:54:29.070 DEBUG:teuthology.parallel:result is None 2023-09-15T15:54:29.244 INFO:teuthology.lock.ops:Checking smithi156.front.sepia.ceph.com 2023-09-15T15:54:29.245 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-15T15:54:29.270 INFO:teuthology.lock.ops:Checking smithi186.front.sepia.ceph.com 2023-09-15T15:54:29.271 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-15T15:54:29.288 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: set os type and version on server 2023-09-15T15:54:29.288 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-09-15T15:54:29.289 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-15T15:54:29.358 DEBUG:teuthology.orchestra.run.smithi156:> true 2023-09-15T15:54:29.434 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-09-15T15:54:29.435 DEBUG:teuthology.orchestra.run.smithi156:> uname -m 2023-09-15T15:54:29.495 INFO:teuthology.orchestra.run.smithi156.stdout:x86_64 2023-09-15T15:54:29.495 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release 2023-09-15T15:54:29.555 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="CentOS Stream" 2023-09-15T15:54:29.555 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="8" 2023-09-15T15:54:29.555 INFO:teuthology.orchestra.run.smithi156.stdout:ID="centos" 2023-09-15T15:54:29.556 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="rhel fedora" 2023-09-15T15:54:29.556 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="8" 2023-09-15T15:54:29.556 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el8" 2023-09-15T15:54:29.556 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-15T15:54:29.556 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31" 2023-09-15T15:54:29.557 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-15T15:54:29.557 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://centos.org/" 2023-09-15T15:54:29.557 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-15T15:54:29.557 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-15T15:54:29.557 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-15T15:54:29.558 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2023-09-15T15:54:29.579 INFO:teuthology.lock.ops:Updating [smithi186.front.sepia.ceph.com]: set os type and version on server 2023-09-15T15:54:29.579 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi186.front.sepia.ceph.com' 2023-09-15T15:54:29.580 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-15T15:54:29.645 DEBUG:teuthology.orchestra.run.smithi186:> true 2023-09-15T15:54:29.712 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi186.front.sepia.ceph.com' 2023-09-15T15:54:29.712 DEBUG:teuthology.orchestra.run.smithi186:> uname -m 2023-09-15T15:54:29.770 INFO:teuthology.orchestra.run.smithi186.stdout:x86_64 2023-09-15T15:54:29.770 DEBUG:teuthology.orchestra.run.smithi186:> cat /etc/os-release 2023-09-15T15:54:29.828 INFO:teuthology.orchestra.run.smithi186.stdout:NAME="CentOS Stream" 2023-09-15T15:54:29.828 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION="8" 2023-09-15T15:54:29.828 INFO:teuthology.orchestra.run.smithi186.stdout:ID="centos" 2023-09-15T15:54:29.828 INFO:teuthology.orchestra.run.smithi186.stdout:ID_LIKE="rhel fedora" 2023-09-15T15:54:29.829 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_ID="8" 2023-09-15T15:54:29.829 INFO:teuthology.orchestra.run.smithi186.stdout:PLATFORM_ID="platform:el8" 2023-09-15T15:54:29.829 INFO:teuthology.orchestra.run.smithi186.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-15T15:54:29.829 INFO:teuthology.orchestra.run.smithi186.stdout:ANSI_COLOR="0;31" 2023-09-15T15:54:29.829 INFO:teuthology.orchestra.run.smithi186.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-15T15:54:29.830 INFO:teuthology.orchestra.run.smithi186.stdout:HOME_URL="https://centos.org/" 2023-09-15T15:54:29.830 INFO:teuthology.orchestra.run.smithi186.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-15T15:54:29.830 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-15T15:54:29.830 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-15T15:54:29.831 INFO:teuthology.lock.ops:Updating smithi186.front.sepia.ceph.com on lock server 2023-09-15T15:54:29.854 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-15T15:54:29.944 INFO:teuthology.dispatcher.supervisor:Running job 7397146 2023-09-15T15:54:29.944 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_cbodley@teuthology --archive /home/teuthworker/archive/cbodley-2023-09-15_15:32:39-rgw-wip-62507-quincy-distro-default-smithi/7397146 --name cbodley-2023-09-15_15:32:39-rgw-wip-62507-quincy-distro-default-smithi --description rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests versioning} validater/valgrind} -- /home/teuthworker/archive/cbodley-2023-09-15_15:32:39-rgw-wip-62507-quincy-distro-default-smithi/7397146/orig.config.yaml 2023-09-15T15:54:29.948 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/cbodley-2023-09-15_15:32:39-rgw-wip-62507-quincy-distro-default-smithi/7397146 2023-09-15T15:54:29.948 INFO:teuthology.dispatcher.supervisor:Job PID: 2943444 2023-09-15T15:54:29.949 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-09-15T15:56:30.046 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-15T15:58:30.207 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-15T16:00:30.371 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-15T16:02:30.539 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-15T16:04:30.703 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-15T16:06:30.868 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-15T16:08:31.041 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-15T16:10:31.215 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-15T16:12:31.383 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-15T16:14:31.555 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-15T16:16:31.729 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-15T16:18:31.903 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-15T16:20:32.063 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-15T16:22:32.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-15T16:24:32.386 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-15T16:26:32.551 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-15T16:26:32.611 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-09-15T16:26:32.734 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-09-15T16:26:32.734 INFO:teuthology.nuke:Checking targets against current locks 2023-09-15T16:26:32.782 DEBUG:teuthology.nuke:shortname: smithi156 2023-09-15T16:26:32.783 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-15T16:26:32.802 DEBUG:teuthology.nuke:shortname: smithi186 2023-09-15T16:26:32.803 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-15T16:26:32.806 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi156.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2023-09-15_15:32:39-rgw-wip-62507-quincy-distro-default-smithi/7397146', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-15 15:49:17.060370', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKmTxxv0tp8cCPN7kJJlQuDjOZTWt6Do5AxjECfqW+FPFR0m8jlQSIjYBCOqjSXEmuJ1bt1dP8x92H129NARjeE='} 2023-09-15T16:26:32.824 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi186.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2023-09-15_15:32:39-rgw-wip-62507-quincy-distro-default-smithi/7397146', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-15 15:49:17.061445', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHAeAvpJKuh85fKYyLbI1Z2nYK01SYyFaut6aAgiy6DpCs7XZ2MT0MnAJNEctunr//e0LB8F9JgtOxbABPOK6w4='} 2023-09-15T16:26:32.853 INFO:teuthology.orchestra.console.smithi156:Power off 2023-09-15T16:26:32.854 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-15T16:26:32.878 DEBUG:teuthology.orchestra.console.smithi156:power off output: Chassis Power Control: Down/Off 2023-09-15T16:26:32.879 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-15T16:26:32.891 INFO:teuthology.orchestra.console.smithi186:Power off 2023-09-15T16:26:32.891 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-15T16:26:32.899 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2023-09-15T16:26:32.911 DEBUG:teuthology.orchestra.console.smithi186:power off output: Chassis Power Control: Down/Off 2023-09-15T16:26:32.911 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-15T16:26:32.931 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off 2023-09-15T16:26:33.000 INFO:teuthology.orchestra.console.smithi156:Power off completed 2023-09-15T16:26:33.033 INFO:teuthology.orchestra.console.smithi186:Power off completed 2023-09-15T16:26:33.151 INFO:teuthology.lock.ops:unlocked: smithi156.front.sepia.ceph.com 2023-09-15T16:26:33.175 INFO:teuthology.lock.ops:unlocked: smithi186.front.sepia.ceph.com