2023-10-04T13:10:44.696 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-04T13:10:44.697 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-04T13:10:45.013 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1269545670>, signals=[15]) 2023-10-04T13:10:45.014 INFO:teuthology.lock.ops:Start node 'smithi133.front.sepia.ceph.com' reimaging 2023-10-04T13:10:45.014 INFO:teuthology.lock.ops:Updating [smithi133.front.sepia.ceph.com]: reset os type and version on server 2023-10-04T13:10:45.014 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2023-10-04T13:10:45.039 INFO:teuthology.lock.ops:Start node 'smithi142.front.sepia.ceph.com' reimaging 2023-10-04T13:10:45.040 INFO:teuthology.lock.ops:Updating [smithi142.front.sepia.ceph.com]: reset os type and version on server 2023-10-04T13:10:45.040 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2023-10-04T13:10:45.041 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /host {"name": "smithi133"} 2023-10-04T13:10:45.064 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /host {"name": "smithi142"} 2023-10-04T13:10:45.137 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-10-04T13:10:45.157 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-10-04T13:10:45.190 DEBUG:teuthology.provision.fog.smithi133:Requesting image smithi_centos_8.stream (ID 3) 2023-10-04T13:10:45.190 DEBUG:teuthology.provision.fog.smithi133:FOG request: PUT /host/238 {"imageID": 3} 2023-10-04T13:10:45.210 DEBUG:teuthology.provision.fog.smithi142:Requesting image smithi_centos_8.stream (ID 3) 2023-10-04T13:10:45.210 DEBUG:teuthology.provision.fog.smithi142:FOG request: PUT /host/247 {"imageID": 3} 2023-10-04T13:10:45.240 INFO:teuthology.provision.fog.smithi133:Scheduling deploy of centos 8.stream 2023-10-04T13:10:45.240 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-10-04T13:10:45.273 INFO:teuthology.provision.fog.smithi142:Scheduling deploy of centos 8.stream 2023-10-04T13:10:45.273 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-10-04T13:10:45.346 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /tasktype {"name": "deploy"} 2023-10-04T13:10:45.355 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /tasktype {"name": "deploy"} 2023-10-04T13:10:45.393 DEBUG:teuthology.provision.fog.smithi133:FOG request: POST /host/238/task {"taskTypeID": 1} 2023-10-04T13:10:45.399 DEBUG:teuthology.provision.fog.smithi142:FOG request: POST /host/247/task {"taskTypeID": 1} 2023-10-04T13:10:45.463 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-10-04T13:10:45.468 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-10-04T13:10:45.680 INFO:teuthology.orchestra.console.smithi142:Power off 2023-10-04T13:10:45.680 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-04T13:10:45.751 INFO:teuthology.orchestra.console.smithi133:Power off 2023-10-04T13:10:45.752 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-04T13:10:45.790 DEBUG:teuthology.orchestra.console.smithi142:power off output: Chassis Power Control: Down/Off 2023-10-04T13:10:45.790 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-04T13:10:45.833 DEBUG:teuthology.orchestra.console.smithi133:power off output: Chassis Power Control: Down/Off 2023-10-04T13:10:45.834 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-04T13:10:45.869 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2023-10-04T13:10:45.901 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2023-10-04T13:10:49.870 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-04T13:10:49.902 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-04T13:10:49.994 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2023-10-04T13:10:50.046 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2023-10-04T13:10:53.998 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-04T13:10:54.111 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-04T13:10:54.213 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off 2023-10-04T13:10:54.254 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2023-10-04T13:10:54.314 INFO:teuthology.orchestra.console.smithi142:Power off completed 2023-10-04T13:10:54.355 INFO:teuthology.orchestra.console.smithi133:Power off completed 2023-10-04T13:10:54.415 INFO:teuthology.orchestra.console.smithi142:Power on 2023-10-04T13:10:54.416 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-04T13:10:54.456 INFO:teuthology.orchestra.console.smithi133:Power on 2023-10-04T13:10:54.456 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-04T13:10:54.528 DEBUG:teuthology.orchestra.console.smithi142:power on output: Chassis Power Control: Up/On 2023-10-04T13:10:54.537 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-04T13:10:54.622 DEBUG:teuthology.orchestra.console.smithi133:power on output: Chassis Power Control: Up/On 2023-10-04T13:10:54.625 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-04T13:10:54.699 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off 2023-10-04T13:10:54.808 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2023-10-04T13:10:58.702 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-04T13:10:58.809 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-04T13:10:58.853 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2023-10-04T13:10:58.953 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2023-10-04T13:10:58.955 INFO:teuthology.orchestra.console.smithi142:Power on completed 2023-10-04T13:10:59.055 INFO:teuthology.provision.fog.smithi142:Waiting for deploy to finish 2023-10-04T13:10:59.056 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-10-04T13:11:02.958 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-04T13:11:03.095 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2023-10-04T13:11:03.195 INFO:teuthology.orchestra.console.smithi133:Power on completed 2023-10-04T13:11:03.296 INFO:teuthology.provision.fog.smithi133:Waiting for deploy to finish 2023-10-04T13:11:03.296 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-10-04T13:11:14.170 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-10-04T13:11:18.382 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-10-04T13:11:29.279 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-10-04T13:11:33.490 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-10-04T13:11:44.398 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-10-04T13:11:48.670 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-10-04T13:11:59.498 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-10-04T13:12:03.770 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-10-04T13:12:14.634 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-10-04T13:12:18.862 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-10-04T13:12:29.730 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-10-04T13:12:33.958 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-10-04T13:12:44.815 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-10-04T13:12:49.075 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-10-04T13:12:59.930 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-10-04T13:13:04.186 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-10-04T13:13:15.011 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-10-04T13:13:19.262 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-10-04T13:13:30.103 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-10-04T13:13:30.192 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-04T13:13:30.333 ERROR:teuthology.orchestra.connection:Error authenticating with smithi142.front.sepia.ceph.com: Authentication failed. 2023-10-04T13:13:30.333 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-04T13:13:30.335 DEBUG:teuthology.orchestra.run.smithi142:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-04T13:13:30.336 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-10-04T13:13:34.336 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-10-04T13:13:34.408 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-04T13:13:37.466 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2023-10-04T13:13:43.468 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-04T13:13:46.522 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2023-10-04T13:13:52.523 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-04T13:13:55.578 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2023-10-04T13:14:01.579 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-04T13:14:04.634 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2023-10-04T13:14:10.635 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-04T13:14:13.690 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2023-10-04T13:14:19.691 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-04T13:14:22.778 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2023-10-04T13:14:28.780 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-04T13:14:31.834 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2023-10-04T13:14:37.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-04T13:15:09.554 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-04T13:15:09.555 DEBUG:teuthology.orchestra.run.smithi133:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-04T13:15:34.958 INFO:teuthology.provision.fog.smithi133:Node is ready 2023-10-04T13:15:34.958 DEBUG:teuthology.orchestra.run.smithi133:> hostname 2023-10-04T13:15:34.988 INFO:teuthology.orchestra.run.smithi133.stdout:smithi133.front.sepia.ceph.com 2023-10-04T13:15:34.988 DEBUG:teuthology.orchestra.run.smithi133:> grep smithi133.front.sepia.ceph.com /etc/hosts 2023-10-04T13:15:35.050 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.15.133 smithi133.front.sepia.ceph.com smithi133 2023-10-04T13:15:35.051 DEBUG:teuthology.orchestra.run.smithi133:> sudo hostname smithi133 2023-10-04T13:15:35.183 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/smithi133.front.sepia.ceph.com/smithi133/g' /etc/hosts 2023-10-04T13:15:35.219 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/172.21.15.133/172.21.15.133/g' /etc/hosts 2023-10-04T13:15:35.289 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/smithi133.front.sepia.ceph.com/smithi133/g' /etc/hostname 2023-10-04T13:15:35.407 DEBUG:teuthology.orchestra.run.smithi133:> sudo hostname smithi133 2023-10-04T13:15:35.490 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release 2023-10-04T13:15:35.558 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="CentOS Stream" 2023-10-04T13:15:35.559 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="8" 2023-10-04T13:15:35.559 INFO:teuthology.orchestra.run.smithi133.stdout:ID="centos" 2023-10-04T13:15:35.559 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE="rhel fedora" 2023-10-04T13:15:35.559 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="8" 2023-10-04T13:15:35.559 INFO:teuthology.orchestra.run.smithi133.stdout:PLATFORM_ID="platform:el8" 2023-10-04T13:15:35.559 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-04T13:15:35.559 INFO:teuthology.orchestra.run.smithi133.stdout:ANSI_COLOR="0;31" 2023-10-04T13:15:35.559 INFO:teuthology.orchestra.run.smithi133.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-04T13:15:35.559 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://centos.org/" 2023-10-04T13:15:35.559 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-04T13:15:35.559 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-04T13:15:35.559 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-04T13:15:35.560 INFO:teuthology.provision.fog.smithi133:Deploy complete! 2023-10-04T13:15:35.561 DEBUG:teuthology.parallel:result is None 2023-10-04T13:15:51.298 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-10-04T13:15:51.299 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi142 2023-10-04T13:16:00.306 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2023-10-04T13:16:00.307 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-04T13:16:00.570 DEBUG:teuthology.orchestra.run.smithi142:> true 2023-10-04T13:16:01.089 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com' 2023-10-04T13:16:01.089 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-04T13:16:01.089 DEBUG:teuthology.orchestra.run.smithi142:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-04T13:16:01.112 INFO:teuthology.provision.fog.smithi142:Node is ready 2023-10-04T13:16:01.113 DEBUG:teuthology.orchestra.run.smithi142:> hostname 2023-10-04T13:16:01.183 INFO:teuthology.orchestra.run.smithi142.stdout:smithi142.front.sepia.ceph.com 2023-10-04T13:16:01.183 DEBUG:teuthology.orchestra.run.smithi142:> grep smithi142.front.sepia.ceph.com /etc/hosts 2023-10-04T13:16:01.258 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142 smithi142.front.sepia.ceph.com smithi142 2023-10-04T13:16:01.259 DEBUG:teuthology.orchestra.run.smithi142:> sudo hostname smithi142 2023-10-04T13:16:01.374 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/smithi142.front.sepia.ceph.com/smithi142/g' /etc/hosts 2023-10-04T13:16:01.416 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/172.21.15.142/172.21.15.142/g' /etc/hosts 2023-10-04T13:16:01.498 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/smithi142.front.sepia.ceph.com/smithi142/g' /etc/hostname 2023-10-04T13:16:01.586 DEBUG:teuthology.orchestra.run.smithi142:> sudo hostname smithi142 2023-10-04T13:16:01.667 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release 2023-10-04T13:16:01.734 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="CentOS Stream" 2023-10-04T13:16:01.734 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="8" 2023-10-04T13:16:01.735 INFO:teuthology.orchestra.run.smithi142.stdout:ID="centos" 2023-10-04T13:16:01.735 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="rhel fedora" 2023-10-04T13:16:01.735 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="8" 2023-10-04T13:16:01.735 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el8" 2023-10-04T13:16:01.735 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-04T13:16:01.735 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31" 2023-10-04T13:16:01.735 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-04T13:16:01.735 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://centos.org/" 2023-10-04T13:16:01.735 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-04T13:16:01.735 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-04T13:16:01.735 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-04T13:16:01.736 INFO:teuthology.provision.fog.smithi142:Deploy complete! 2023-10-04T13:16:01.738 DEBUG:teuthology.parallel:result is None 2023-10-04T13:16:02.186 INFO:teuthology.lock.ops:Checking smithi133.front.sepia.ceph.com 2023-10-04T13:16:02.187 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-04T13:16:02.230 INFO:teuthology.lock.ops:Checking smithi142.front.sepia.ceph.com 2023-10-04T13:16:02.230 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-04T13:16:02.269 INFO:teuthology.lock.ops:Updating [smithi133.front.sepia.ceph.com]: set os type and version on server 2023-10-04T13:16:02.270 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2023-10-04T13:16:02.281 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-04T13:16:02.376 DEBUG:teuthology.orchestra.run.smithi133:> true 2023-10-04T13:16:02.508 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi133.front.sepia.ceph.com' 2023-10-04T13:16:02.508 DEBUG:teuthology.orchestra.run.smithi133:> uname -m 2023-10-04T13:16:02.579 INFO:teuthology.orchestra.run.smithi133.stdout:x86_64 2023-10-04T13:16:02.579 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release 2023-10-04T13:16:02.646 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="CentOS Stream" 2023-10-04T13:16:02.647 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="8" 2023-10-04T13:16:02.647 INFO:teuthology.orchestra.run.smithi133.stdout:ID="centos" 2023-10-04T13:16:02.647 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE="rhel fedora" 2023-10-04T13:16:02.647 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="8" 2023-10-04T13:16:02.647 INFO:teuthology.orchestra.run.smithi133.stdout:PLATFORM_ID="platform:el8" 2023-10-04T13:16:02.648 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-04T13:16:02.648 INFO:teuthology.orchestra.run.smithi133.stdout:ANSI_COLOR="0;31" 2023-10-04T13:16:02.648 INFO:teuthology.orchestra.run.smithi133.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-04T13:16:02.648 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://centos.org/" 2023-10-04T13:16:02.649 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-04T13:16:02.649 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-04T13:16:02.649 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-04T13:16:02.650 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2023-10-04T13:16:02.688 INFO:teuthology.lock.ops:Updating [smithi142.front.sepia.ceph.com]: set os type and version on server 2023-10-04T13:16:02.689 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2023-10-04T13:16:02.689 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-04T13:16:02.784 DEBUG:teuthology.orchestra.run.smithi142:> true 2023-10-04T13:16:02.875 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com' 2023-10-04T13:16:02.876 DEBUG:teuthology.orchestra.run.smithi142:> uname -m 2023-10-04T13:16:02.943 INFO:teuthology.orchestra.run.smithi142.stdout:x86_64 2023-10-04T13:16:02.943 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release 2023-10-04T13:16:03.010 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="CentOS Stream" 2023-10-04T13:16:03.011 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="8" 2023-10-04T13:16:03.011 INFO:teuthology.orchestra.run.smithi142.stdout:ID="centos" 2023-10-04T13:16:03.011 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="rhel fedora" 2023-10-04T13:16:03.012 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="8" 2023-10-04T13:16:03.013 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el8" 2023-10-04T13:16:03.013 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-04T13:16:03.013 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31" 2023-10-04T13:16:03.013 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-04T13:16:03.013 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://centos.org/" 2023-10-04T13:16:03.013 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-04T13:16:03.015 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-04T13:16:03.015 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-04T13:16:03.018 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2023-10-04T13:16:03.058 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-04T13:16:03.250 INFO:teuthology.dispatcher.supervisor:Running job 7410203 2023-10-04T13:16:03.251 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_amaredia@teuthology --archive /home/teuthworker/archive/amaredia-2023-10-04_12:54:15-rgw:verify-wip-rgw-perf-counters-cache-distro-default-smithi/7410203 --name amaredia-2023-10-04_12:54:15-rgw:verify-wip-rgw-perf-counters-cache-distro-default-smithi --description rgw:verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_8} tasks/{cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} -- /home/teuthworker/archive/amaredia-2023-10-04_12:54:15-rgw:verify-wip-rgw-perf-counters-cache-distro-default-smithi/7410203/orig.config.yaml 2023-10-04T13:16:03.272 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/amaredia-2023-10-04_12:54:15-rgw:verify-wip-rgw-perf-counters-cache-distro-default-smithi/7410203 2023-10-04T13:16:03.273 INFO:teuthology.dispatcher.supervisor:Job PID: 1707161 2023-10-04T13:16:03.273 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-04T13:18:03.370 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-04T13:20:03.555 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-04T13:22:03.739 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-04T13:24:03.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-04T13:26:04.083 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-04T13:28:04.255 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-04T13:30:04.429 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-04T13:32:04.510 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-04T13:34:04.617 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-04T13:36:04.795 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-04T13:38:04.950 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-04T13:40:05.113 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-04T13:42:05.256 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-04T13:42:05.325 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-10-04T13:42:05.631 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-04T13:42:05.631 INFO:teuthology.nuke:Checking targets against current locks 2023-10-04T13:42:05.678 DEBUG:teuthology.nuke:shortname: smithi133 2023-10-04T13:42:05.678 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-04T13:42:05.699 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi133.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/amaredia-2023-10-04_12:54:15-rgw:verify-wip-rgw-perf-counters-cache-distro-default-smithi/7410203', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-04 13:10:43.197480', 'locked_by': 'scheduled_amaredia@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDwVgRpHObCps49SUyHgktcjLhxcgyYb8vxUK0l2i4dr7vfwN1eOZBwDDG+G6pGRhGTX8Jk4n77ir/C85PCe4FE='} 2023-10-04T13:42:05.702 DEBUG:teuthology.nuke:shortname: smithi142 2023-10-04T13:42:05.702 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-04T13:42:05.724 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi142.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/amaredia-2023-10-04_12:54:15-rgw:verify-wip-rgw-perf-counters-cache-distro-default-smithi/7410203', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-04 13:10:43.199351', 'locked_by': 'scheduled_amaredia@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK4FHZCswep9mBzCMSRTZq1Lwx7OS8E2dvUGs60hDqpY4/hcZO20WedYvHYAi15eUqkpXlPwiyyKe0C33aXN6Vg='} 2023-10-04T13:42:05.754 INFO:teuthology.orchestra.console.smithi133:Power off 2023-10-04T13:42:05.754 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-04T13:42:05.765 INFO:teuthology.orchestra.console.smithi142:Power off 2023-10-04T13:42:05.766 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-04T13:42:05.776 DEBUG:teuthology.orchestra.console.smithi133:power off output: Chassis Power Control: Down/Off 2023-10-04T13:42:05.776 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-04T13:42:05.785 DEBUG:teuthology.orchestra.console.smithi142:power off output: Chassis Power Control: Down/Off 2023-10-04T13:42:05.786 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-04T13:42:05.796 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2023-10-04T13:42:05.804 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off 2023-10-04T13:42:05.897 INFO:teuthology.orchestra.console.smithi133:Power off completed 2023-10-04T13:42:05.905 INFO:teuthology.orchestra.console.smithi142:Power off completed 2023-10-04T13:42:06.048 INFO:teuthology.lock.ops:unlocked: smithi142.front.sepia.ceph.com 2023-10-04T13:42:06.064 INFO:teuthology.lock.ops:unlocked: smithi133.front.sepia.ceph.com