2023-11-16T03:16:33.806 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-16T03:16:33.807 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T03:16:33.949 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f9589edeee0>, signals=[15]) 2023-11-16T03:16:33.950 INFO:teuthology.lock.ops:Start node 'smithi012.front.sepia.ceph.com' reimaging 2023-11-16T03:16:33.950 INFO:teuthology.lock.ops:Updating [smithi012.front.sepia.ceph.com]: reset os type and version on server 2023-11-16T03:16:33.950 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server 2023-11-16T03:16:33.976 INFO:teuthology.lock.ops:Start node 'smithi148.front.sepia.ceph.com' reimaging 2023-11-16T03:16:33.977 INFO:teuthology.lock.ops:Updating [smithi148.front.sepia.ceph.com]: reset os type and version on server 2023-11-16T03:16:33.977 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server 2023-11-16T03:16:33.978 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /host {"name": "smithi012"} 2023-11-16T03:16:34.001 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /host {"name": "smithi148"} 2023-11-16T03:16:34.058 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-11-16T03:16:34.075 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-11-16T03:16:34.103 DEBUG:teuthology.provision.fog.smithi012:Requesting image smithi_centos_8.stream (ID 3) 2023-11-16T03:16:34.104 DEBUG:teuthology.provision.fog.smithi012:FOG request: PUT /host/118 {"imageID": 3} 2023-11-16T03:16:34.123 DEBUG:teuthology.provision.fog.smithi148:Requesting image smithi_centos_8.stream (ID 3) 2023-11-16T03:16:34.123 DEBUG:teuthology.provision.fog.smithi148:FOG request: PUT /host/253 {"imageID": 3} 2023-11-16T03:16:34.150 INFO:teuthology.provision.fog.smithi012:Scheduling deploy of centos 8.stream 2023-11-16T03:16:34.150 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-11-16T03:16:34.179 INFO:teuthology.provision.fog.smithi148:Scheduling deploy of centos 8.stream 2023-11-16T03:16:34.179 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-11-16T03:16:34.224 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /tasktype {"name": "deploy"} 2023-11-16T03:16:34.237 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /tasktype {"name": "deploy"} 2023-11-16T03:16:34.256 DEBUG:teuthology.provision.fog.smithi012:FOG request: POST /host/118/task {"taskTypeID": 1} 2023-11-16T03:16:34.274 DEBUG:teuthology.provision.fog.smithi148:FOG request: POST /host/253/task {"taskTypeID": 1} 2023-11-16T03:16:34.338 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-11-16T03:16:34.342 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-11-16T03:16:34.461 INFO:teuthology.orchestra.console.smithi012:Power off 2023-11-16T03:16:34.461 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-16T03:16:34.480 INFO:teuthology.orchestra.console.smithi148:Power off 2023-11-16T03:16:34.480 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-16T03:16:34.490 DEBUG:teuthology.orchestra.console.smithi012:power off output: Chassis Power Control: Down/Off 2023-11-16T03:16:34.490 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T03:16:34.505 DEBUG:teuthology.orchestra.console.smithi148:power off output: Chassis Power Control: Down/Off 2023-11-16T03:16:34.505 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T03:16:34.515 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is off 2023-11-16T03:16:34.527 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2023-11-16T03:16:34.616 INFO:teuthology.orchestra.console.smithi012:Power off completed 2023-11-16T03:16:34.628 INFO:teuthology.orchestra.console.smithi148:Power off completed 2023-11-16T03:16:34.717 INFO:teuthology.orchestra.console.smithi012:Power on 2023-11-16T03:16:34.717 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-16T03:16:34.729 INFO:teuthology.orchestra.console.smithi148:Power on 2023-11-16T03:16:34.729 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-16T03:16:34.739 DEBUG:teuthology.orchestra.console.smithi012:power on output: Chassis Power Control: Up/On 2023-11-16T03:16:34.739 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T03:16:34.753 DEBUG:teuthology.orchestra.console.smithi148:power on output: Chassis Power Control: Up/On 2023-11-16T03:16:34.754 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T03:16:34.764 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is off 2023-11-16T03:16:34.776 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2023-11-16T03:16:38.769 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T03:16:38.777 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T03:16:38.878 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is on 2023-11-16T03:16:38.889 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2023-11-16T03:16:38.980 INFO:teuthology.orchestra.console.smithi012:Power on completed 2023-11-16T03:16:39.080 INFO:teuthology.provision.fog.smithi012:Waiting for deploy to finish 2023-11-16T03:16:39.081 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-11-16T03:16:42.893 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T03:16:43.002 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on 2023-11-16T03:16:43.103 INFO:teuthology.orchestra.console.smithi148:Power on completed 2023-11-16T03:16:43.204 INFO:teuthology.provision.fog.smithi148:Waiting for deploy to finish 2023-11-16T03:16:43.204 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-11-16T03:16:54.160 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-11-16T03:16:58.298 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-11-16T03:17:09.238 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-11-16T03:17:13.386 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-11-16T03:17:24.317 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-11-16T03:17:28.479 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-11-16T03:17:39.394 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-11-16T03:17:43.583 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-11-16T03:17:54.470 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-11-16T03:17:58.657 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-11-16T03:18:09.550 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-11-16T03:18:13.741 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-11-16T03:18:24.637 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-11-16T03:18:28.814 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-11-16T03:18:39.714 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-11-16T03:18:43.910 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-11-16T03:18:54.826 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-11-16T03:18:59.017 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-11-16T03:19:09.915 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-11-16T03:19:10.015 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T03:19:13.086 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-11-16T03:19:14.104 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-11-16T03:19:19.091 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T03:19:22.174 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-11-16T03:19:29.197 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-11-16T03:19:29.285 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T03:19:32.350 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-11-16T03:19:33.165 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T03:19:36.222 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-11-16T03:19:38.354 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T03:19:41.438 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-11-16T03:19:42.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T03:19:45.278 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-11-16T03:19:47.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T03:19:50.490 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-11-16T03:19:51.280 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T03:19:54.333 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-11-16T03:19:56.492 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T03:19:59.550 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-11-16T03:20:00.334 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T03:20:05.554 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T03:20:08.634 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-11-16T03:20:10.618 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-11-16T03:20:14.639 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T03:20:16.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T03:20:17.694 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-11-16T03:20:19.674 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-11-16T03:20:23.698 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T03:20:25.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T03:20:26.778 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-11-16T03:20:32.116 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-16T03:20:32.116 DEBUG:teuthology.orchestra.run.smithi012:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-16T03:20:32.780 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T03:20:51.322 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-11-16T03:20:52.658 INFO:teuthology.provision.fog.smithi012:Node is ready 2023-11-16T03:20:52.658 DEBUG:teuthology.orchestra.run.smithi012:> hostname 2023-11-16T03:20:52.683 INFO:teuthology.orchestra.run.smithi012.stdout:smithi012.front.sepia.ceph.com 2023-11-16T03:20:52.683 DEBUG:teuthology.orchestra.run.smithi012:> grep smithi012.front.sepia.ceph.com /etc/hosts 2023-11-16T03:20:52.746 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12 smithi012.front.sepia.ceph.com smithi012 2023-11-16T03:20:52.747 DEBUG:teuthology.orchestra.run.smithi012:> sudo hostname smithi012 2023-11-16T03:20:52.885 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i -e 's/smithi012.front.sepia.ceph.com/smithi012/g' /etc/hosts 2023-11-16T03:20:52.919 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i -e 's/172.21.15.12/172.21.15.12/g' /etc/hosts 2023-11-16T03:20:52.995 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i -e 's/smithi012.front.sepia.ceph.com/smithi012/g' /etc/hostname 2023-11-16T03:20:53.068 DEBUG:teuthology.orchestra.run.smithi012:> sudo hostname smithi012 2023-11-16T03:20:53.140 DEBUG:teuthology.orchestra.run.smithi012:> cat /etc/os-release 2023-11-16T03:20:53.202 INFO:teuthology.orchestra.run.smithi012.stdout:NAME="CentOS Stream" 2023-11-16T03:20:53.203 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION="8" 2023-11-16T03:20:53.203 INFO:teuthology.orchestra.run.smithi012.stdout:ID="centos" 2023-11-16T03:20:53.203 INFO:teuthology.orchestra.run.smithi012.stdout:ID_LIKE="rhel fedora" 2023-11-16T03:20:53.203 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_ID="8" 2023-11-16T03:20:53.203 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM_ID="platform:el8" 2023-11-16T03:20:53.203 INFO:teuthology.orchestra.run.smithi012.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-16T03:20:53.203 INFO:teuthology.orchestra.run.smithi012.stdout:ANSI_COLOR="0;31" 2023-11-16T03:20:53.203 INFO:teuthology.orchestra.run.smithi012.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-16T03:20:53.203 INFO:teuthology.orchestra.run.smithi012.stdout:HOME_URL="https://centos.org/" 2023-11-16T03:20:53.203 INFO:teuthology.orchestra.run.smithi012.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-16T03:20:53.203 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-16T03:20:53.203 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-16T03:20:53.204 INFO:teuthology.provision.fog.smithi012:Deploy complete! 2023-11-16T03:20:53.205 DEBUG:teuthology.parallel:result is None 2023-11-16T03:20:57.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T03:21:00.378 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-11-16T03:21:06.383 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T03:21:08.063 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-16T03:21:08.063 DEBUG:teuthology.orchestra.run.smithi148:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-16T03:21:33.142 INFO:teuthology.provision.fog.smithi148:Node is ready 2023-11-16T03:21:33.142 DEBUG:teuthology.orchestra.run.smithi148:> hostname 2023-11-16T03:21:33.167 INFO:teuthology.orchestra.run.smithi148.stdout:smithi148.front.sepia.ceph.com 2023-11-16T03:21:33.167 DEBUG:teuthology.orchestra.run.smithi148:> grep smithi148.front.sepia.ceph.com /etc/hosts 2023-11-16T03:21:33.228 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148 smithi148.front.sepia.ceph.com smithi148 2023-11-16T03:21:33.229 DEBUG:teuthology.orchestra.run.smithi148:> sudo hostname smithi148 2023-11-16T03:21:33.345 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/smithi148.front.sepia.ceph.com/smithi148/g' /etc/hosts 2023-11-16T03:21:33.376 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/172.21.15.148/172.21.15.148/g' /etc/hosts 2023-11-16T03:21:33.445 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/smithi148.front.sepia.ceph.com/smithi148/g' /etc/hostname 2023-11-16T03:21:33.514 DEBUG:teuthology.orchestra.run.smithi148:> sudo hostname smithi148 2023-11-16T03:21:33.582 DEBUG:teuthology.orchestra.run.smithi148:> cat /etc/os-release 2023-11-16T03:21:33.639 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="CentOS Stream" 2023-11-16T03:21:33.640 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="8" 2023-11-16T03:21:33.640 INFO:teuthology.orchestra.run.smithi148.stdout:ID="centos" 2023-11-16T03:21:33.640 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE="rhel fedora" 2023-11-16T03:21:33.640 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="8" 2023-11-16T03:21:33.640 INFO:teuthology.orchestra.run.smithi148.stdout:PLATFORM_ID="platform:el8" 2023-11-16T03:21:33.640 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-16T03:21:33.640 INFO:teuthology.orchestra.run.smithi148.stdout:ANSI_COLOR="0;31" 2023-11-16T03:21:33.640 INFO:teuthology.orchestra.run.smithi148.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-16T03:21:33.640 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://centos.org/" 2023-11-16T03:21:33.640 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-16T03:21:33.640 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-16T03:21:33.641 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-16T03:21:33.641 INFO:teuthology.provision.fog.smithi148:Deploy complete! 2023-11-16T03:21:33.641 DEBUG:teuthology.parallel:result is None 2023-11-16T03:21:33.798 INFO:teuthology.lock.ops:Checking smithi012.front.sepia.ceph.com 2023-11-16T03:21:33.799 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-16T03:21:33.824 INFO:teuthology.lock.ops:Checking smithi148.front.sepia.ceph.com 2023-11-16T03:21:33.825 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-16T03:21:33.842 INFO:teuthology.lock.ops:Updating [smithi012.front.sepia.ceph.com]: set os type and version on server 2023-11-16T03:21:33.842 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2023-11-16T03:21:33.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T03:21:33.957 DEBUG:teuthology.orchestra.run.smithi012:> true 2023-11-16T03:21:34.056 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi012.front.sepia.ceph.com' 2023-11-16T03:21:34.056 DEBUG:teuthology.orchestra.run.smithi012:> uname -m 2023-11-16T03:21:34.116 INFO:teuthology.orchestra.run.smithi012.stdout:x86_64 2023-11-16T03:21:34.116 DEBUG:teuthology.orchestra.run.smithi012:> cat /etc/os-release 2023-11-16T03:21:34.175 INFO:teuthology.orchestra.run.smithi012.stdout:NAME="CentOS Stream" 2023-11-16T03:21:34.176 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION="8" 2023-11-16T03:21:34.176 INFO:teuthology.orchestra.run.smithi012.stdout:ID="centos" 2023-11-16T03:21:34.176 INFO:teuthology.orchestra.run.smithi012.stdout:ID_LIKE="rhel fedora" 2023-11-16T03:21:34.176 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_ID="8" 2023-11-16T03:21:34.176 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM_ID="platform:el8" 2023-11-16T03:21:34.176 INFO:teuthology.orchestra.run.smithi012.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-16T03:21:34.176 INFO:teuthology.orchestra.run.smithi012.stdout:ANSI_COLOR="0;31" 2023-11-16T03:21:34.176 INFO:teuthology.orchestra.run.smithi012.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-16T03:21:34.176 INFO:teuthology.orchestra.run.smithi012.stdout:HOME_URL="https://centos.org/" 2023-11-16T03:21:34.176 INFO:teuthology.orchestra.run.smithi012.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-16T03:21:34.176 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-16T03:21:34.176 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-16T03:21:34.177 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server 2023-11-16T03:21:34.199 INFO:teuthology.lock.ops:Updating [smithi148.front.sepia.ceph.com]: set os type and version on server 2023-11-16T03:21:34.199 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2023-11-16T03:21:34.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T03:21:34.271 DEBUG:teuthology.orchestra.run.smithi148:> true 2023-11-16T03:21:34.341 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi148.front.sepia.ceph.com' 2023-11-16T03:21:34.341 DEBUG:teuthology.orchestra.run.smithi148:> uname -m 2023-11-16T03:21:34.399 INFO:teuthology.orchestra.run.smithi148.stdout:x86_64 2023-11-16T03:21:34.400 DEBUG:teuthology.orchestra.run.smithi148:> cat /etc/os-release 2023-11-16T03:21:34.458 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="CentOS Stream" 2023-11-16T03:21:34.458 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="8" 2023-11-16T03:21:34.458 INFO:teuthology.orchestra.run.smithi148.stdout:ID="centos" 2023-11-16T03:21:34.458 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE="rhel fedora" 2023-11-16T03:21:34.458 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="8" 2023-11-16T03:21:34.458 INFO:teuthology.orchestra.run.smithi148.stdout:PLATFORM_ID="platform:el8" 2023-11-16T03:21:34.458 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-16T03:21:34.458 INFO:teuthology.orchestra.run.smithi148.stdout:ANSI_COLOR="0;31" 2023-11-16T03:21:34.458 INFO:teuthology.orchestra.run.smithi148.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-16T03:21:34.458 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://centos.org/" 2023-11-16T03:21:34.458 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-16T03:21:34.459 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-16T03:21:34.459 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-16T03:21:34.459 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server 2023-11-16T03:21:34.482 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T03:21:34.581 INFO:teuthology.dispatcher.supervisor:Running job 7460277 2023-11-16T03:21:34.581 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2023-11-16_02:25:09-upgrade:reef-x-main-distro-default-smithi/7460277 --name teuthology-2023-11-16_02:25:09-upgrade:reef-x-main-distro-default-smithi --description upgrade:reef-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} -- /home/teuthworker/archive/teuthology-2023-11-16_02:25:09-upgrade:reef-x-main-distro-default-smithi/7460277/orig.config.yaml 2023-11-16T03:21:34.585 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2023-11-16_02:25:09-upgrade:reef-x-main-distro-default-smithi/7460277 2023-11-16T03:21:34.585 INFO:teuthology.dispatcher.supervisor:Job PID: 648875 2023-11-16T03:21:34.585 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-16T03:23:34.685 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T03:25:34.859 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T03:27:35.033 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T03:29:35.211 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T03:31:35.391 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T03:33:35.559 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T03:35:35.751 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T03:37:35.926 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T03:39:36.087 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T03:39:36.159 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-11-16T03:39:36.292 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-16T03:39:36.292 INFO:teuthology.nuke:Checking targets against current locks 2023-11-16T03:39:36.344 DEBUG:teuthology.nuke:shortname: smithi012 2023-11-16T03:39:36.345 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-16T03:39:36.369 DEBUG:teuthology.nuke:shortname: smithi148 2023-11-16T03:39:36.370 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-16T03:39:36.373 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi012.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-11-16_02:25:09-upgrade:reef-x-main-distro-default-smithi/7460277', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-16 03:16:32.894113', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIWjY3v+vzIFUBdxKZdxdCfuN9AuJ4rAi3SUbHqVdDMhLFpyK+ZU2W9jpF9grDwD0ngIHbU1fCwqETLGjdxcA3c='} 2023-11-16T03:39:36.394 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi148.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-11-16_02:25:09-upgrade:reef-x-main-distro-default-smithi/7460277', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-16 03:16:32.896028', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHtDzH2Hw/2ot61f6o8tJ3Vc8/guDxg5LUOdILOtq6mHnUhkk5RhGHvB0sMmBO6ZL4DuHN/An/TFyzQKRfMtr5c='} 2023-11-16T03:39:36.429 INFO:teuthology.orchestra.console.smithi012:Power off 2023-11-16T03:39:36.429 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-16T03:39:36.452 DEBUG:teuthology.orchestra.console.smithi012:power off output: Chassis Power Control: Down/Off 2023-11-16T03:39:36.452 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T03:39:36.467 INFO:teuthology.orchestra.console.smithi148:Power off 2023-11-16T03:39:36.467 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-16T03:39:36.480 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is off 2023-11-16T03:39:36.490 DEBUG:teuthology.orchestra.console.smithi148:power off output: Chassis Power Control: Down/Off 2023-11-16T03:39:36.491 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T03:39:36.514 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2023-11-16T03:39:36.581 INFO:teuthology.orchestra.console.smithi012:Power off completed 2023-11-16T03:39:36.616 INFO:teuthology.orchestra.console.smithi148:Power off completed 2023-11-16T03:39:36.742 INFO:teuthology.lock.ops:unlocked: smithi012.front.sepia.ceph.com 2023-11-16T03:39:36.765 INFO:teuthology.lock.ops:unlocked: smithi148.front.sepia.ceph.com