2023-07-26T20:09:26.516 INFO:root:teuthology version: 0.0.1.dev160+g407880c
2023-07-26T20:09:26.517 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-26T20:09:26.518 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-26T20:09:26.672 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f8bdae16df0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f8bdc3151f0>, signals=[15])
2023-07-26T20:09:26.674 INFO:teuthology.lock.ops:Start node 'smithi102.front.sepia.ceph.com' reimaging
2023-07-26T20:09:26.674 INFO:teuthology.lock.ops:Updating [smithi102.front.sepia.ceph.com]: reset os type and version on server
2023-07-26T20:09:26.675 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server
2023-07-26T20:09:26.701 INFO:teuthology.lock.ops:Start node 'smithi150.front.sepia.ceph.com' reimaging
2023-07-26T20:09:26.701 INFO:teuthology.lock.ops:Updating [smithi150.front.sepia.ceph.com]: reset os type and version on server
2023-07-26T20:09:26.701 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server
2023-07-26T20:09:26.703 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /host {"name": "smithi102"}
2023-07-26T20:09:26.725 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /host {"name": "smithi150"}
2023-07-26T20:09:26.785 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-07-26T20:09:26.802 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-07-26T20:09:26.828 DEBUG:teuthology.provision.fog.smithi102:Requesting image smithi_centos_8.stream (ID 3)
2023-07-26T20:09:26.828 DEBUG:teuthology.provision.fog.smithi102:FOG request: PUT /host/207 {"imageID": 3}
2023-07-26T20:09:26.844 DEBUG:teuthology.provision.fog.smithi150:Requesting image smithi_centos_8.stream (ID 3)
2023-07-26T20:09:26.844 DEBUG:teuthology.provision.fog.smithi150:FOG request: PUT /host/255 {"imageID": 3}
2023-07-26T20:09:26.878 INFO:teuthology.provision.fog.smithi102:Scheduling deploy of centos 8.stream
2023-07-26T20:09:26.878 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None
2023-07-26T20:09:26.891 INFO:teuthology.provision.fog.smithi150:Scheduling deploy of centos 8.stream
2023-07-26T20:09:26.892 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None
2023-07-26T20:09:26.932 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /tasktype {"name": "deploy"}
2023-07-26T20:09:26.950 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /tasktype {"name": "deploy"}
2023-07-26T20:09:26.972 DEBUG:teuthology.provision.fog.smithi102:FOG request: POST /host/207/task {"taskTypeID": 1}
2023-07-26T20:09:26.985 DEBUG:teuthology.provision.fog.smithi150:FOG request: POST /host/255/task {"taskTypeID": 1}
2023-07-26T20:09:27.020 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None
2023-07-26T20:09:27.030 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None
2023-07-26T20:09:27.126 INFO:teuthology.orchestra.console:Power off smithi102
2023-07-26T20:09:27.127 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-26T20:09:27.143 INFO:teuthology.orchestra.console:Power off smithi150
2023-07-26T20:09:27.144 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-26T20:09:27.155 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off
2023-07-26T20:09:27.156 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T20:09:27.168 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off
2023-07-26T20:09:27.169 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T20:09:27.180 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on
2023-07-26T20:09:27.189 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on
2023-07-26T20:09:31.186 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T20:09:31.194 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T20:09:31.297 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on
2023-07-26T20:09:31.304 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on
2023-07-26T20:09:35.300 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T20:09:35.308 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T20:09:35.411 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on
2023-07-26T20:09:35.418 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off
2023-07-26T20:09:35.519 INFO:teuthology.orchestra.console:Power off for smithi150 completed
2023-07-26T20:09:35.620 INFO:teuthology.orchestra.console:Power on smithi150
2023-07-26T20:09:35.620 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-26T20:09:35.642 DEBUG:teuthology.orchestra.console:power on output: Chassis Power Control: Up/On
2023-07-26T20:09:35.643 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T20:09:35.667 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off
2023-07-26T20:09:39.416 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T20:09:39.527 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off
2023-07-26T20:09:39.629 INFO:teuthology.orchestra.console:Power off for smithi102 completed
2023-07-26T20:09:39.669 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T20:09:39.730 INFO:teuthology.orchestra.console:Power on smithi102
2023-07-26T20:09:39.731 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-26T20:09:39.753 DEBUG:teuthology.orchestra.console:power on output: Chassis Power Control: Up/On
2023-07-26T20:09:39.753 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T20:09:39.776 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off
2023-07-26T20:09:39.783 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off
2023-07-26T20:09:43.782 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T20:09:43.790 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T20:09:43.892 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off
2023-07-26T20:09:43.898 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on
2023-07-26T20:09:43.999 INFO:teuthology.orchestra.console:Power on for smithi150 completed
2023-07-26T20:09:44.100 INFO:teuthology.provision.fog.smithi150:Waiting for deploy to finish
2023-07-26T20:09:44.100 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None
2023-07-26T20:09:47.896 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T20:09:48.006 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on
2023-07-26T20:09:48.107 INFO:teuthology.orchestra.console:Power on for smithi102 completed
2023-07-26T20:09:48.208 INFO:teuthology.provision.fog.smithi102:Waiting for deploy to finish
2023-07-26T20:09:48.208 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None
2023-07-26T20:09:59.177 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None
2023-07-26T20:10:03.284 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None
2023-07-26T20:10:14.265 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None
2023-07-26T20:10:18.372 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None
2023-07-26T20:10:29.340 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None
2023-07-26T20:10:33.452 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None
2023-07-26T20:10:44.428 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None
2023-07-26T20:10:48.524 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None
2023-07-26T20:10:59.520 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None
2023-07-26T20:11:03.592 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None
2023-07-26T20:11:14.608 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None
2023-07-26T20:11:18.679 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None
2023-07-26T20:11:29.696 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None
2023-07-26T20:11:33.756 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None
2023-07-26T20:11:44.764 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None
2023-07-26T20:11:48.824 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None
2023-07-26T20:11:59.848 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None
2023-07-26T20:12:03.884 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None
2023-07-26T20:12:14.912 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None
2023-07-26T20:12:18.936 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None
2023-07-26T20:12:19.000 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-26T20:12:22.064 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2023-07-26T20:12:28.072 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-26T20:12:29.967 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None
2023-07-26T20:12:30.022 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-26T20:12:31.152 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2023-07-26T20:12:33.076 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2023-07-26T20:12:37.156 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-26T20:12:39.080 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-26T20:12:40.208 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2023-07-26T20:12:42.160 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2023-07-26T20:12:46.212 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-26T20:12:48.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-26T20:12:49.264 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2023-07-26T20:12:51.216 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2023-07-26T20:12:55.268 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-26T20:12:57.220 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-26T20:12:58.324 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2023-07-26T20:13:00.276 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2023-07-26T20:13:04.328 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-26T20:13:06.279 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-26T20:13:07.408 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2023-07-26T20:13:09.332 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2023-07-26T20:13:13.414 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-26T20:13:15.335 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-26T20:13:16.464 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2023-07-26T20:13:18.416 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2023-07-26T20:13:22.468 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-26T20:13:24.420 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-26T20:13:40.848 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2023-07-26T20:13:46.852 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-26T20:13:49.908 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2023-07-26T20:13:55.912 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-26T20:13:56.133 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-26T20:13:56.134 DEBUG:teuthology.orchestra.run.smithi102:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-26T20:14:21.514 INFO:teuthology.provision.fog.smithi102:Node is ready
2023-07-26T20:14:21.515 DEBUG:teuthology.orchestra.run.smithi102:> hostname
2023-07-26T20:14:21.539 INFO:teuthology.orchestra.run.smithi102.stdout:smithi102.front.sepia.ceph.com
2023-07-26T20:14:21.539 DEBUG:teuthology.orchestra.run.smithi102:> grep smithi102.front.sepia.ceph.com /etc/hosts
2023-07-26T20:14:21.601 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.15.102 smithi102.front.sepia.ceph.com smithi102
2023-07-26T20:14:21.602 DEBUG:teuthology.orchestra.run.smithi102:> sudo hostname smithi102
2023-07-26T20:14:21.733 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/smithi102.front.sepia.ceph.com/smithi102/g' /etc/hosts
2023-07-26T20:14:21.767 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/172.21.15.102/172.21.15.102/g' /etc/hosts
2023-07-26T20:14:21.841 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/smithi102.front.sepia.ceph.com/smithi102/g' /etc/hostname
2023-07-26T20:14:21.915 DEBUG:teuthology.orchestra.run.smithi102:> sudo hostname smithi102
2023-07-26T20:14:21.988 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release
2023-07-26T20:14:22.050 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="CentOS Stream"
2023-07-26T20:14:22.050 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="8"
2023-07-26T20:14:22.050 INFO:teuthology.orchestra.run.smithi102.stdout:ID="centos"
2023-07-26T20:14:22.051 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE="rhel fedora"
2023-07-26T20:14:22.051 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="8"
2023-07-26T20:14:22.051 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM_ID="platform:el8"
2023-07-26T20:14:22.051 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="CentOS Stream 8"
2023-07-26T20:14:22.051 INFO:teuthology.orchestra.run.smithi102.stdout:ANSI_COLOR="0;31"
2023-07-26T20:14:22.051 INFO:teuthology.orchestra.run.smithi102.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-07-26T20:14:22.051 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://centos.org/"
2023-07-26T20:14:22.052 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-26T20:14:22.052 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-26T20:14:22.052 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-26T20:14:22.053 INFO:teuthology.provision.fog.smithi102:Deploy complete!
2023-07-26T20:14:22.054 DEBUG:teuthology.parallel:result is None
2023-07-26T20:14:24.423 WARNING:teuthology.provision.fog.smithi150:timed out
2023-07-26T20:14:30.430 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-26T20:14:30.636 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-26T20:14:30.636 DEBUG:teuthology.orchestra.run.smithi150:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-26T20:14:30.885 INFO:teuthology.provision.fog.smithi150:Node is ready
2023-07-26T20:14:30.885 DEBUG:teuthology.orchestra.run.smithi150:> hostname
2023-07-26T20:14:30.945 INFO:teuthology.orchestra.run.smithi150.stdout:smithi150.front.sepia.ceph.com
2023-07-26T20:14:30.945 DEBUG:teuthology.orchestra.run.smithi150:> grep smithi150.front.sepia.ceph.com /etc/hosts
2023-07-26T20:14:31.003 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.15.150 smithi150.front.sepia.ceph.com smithi150
2023-07-26T20:14:31.004 DEBUG:teuthology.orchestra.run.smithi150:> sudo hostname smithi150
2023-07-26T20:14:31.092 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/smithi150.front.sepia.ceph.com/smithi150/g' /etc/hosts
2023-07-26T20:14:31.121 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/172.21.15.150/172.21.15.150/g' /etc/hosts
2023-07-26T20:14:31.188 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/smithi150.front.sepia.ceph.com/smithi150/g' /etc/hostname
2023-07-26T20:14:31.256 DEBUG:teuthology.orchestra.run.smithi150:> sudo hostname smithi150
2023-07-26T20:14:31.324 DEBUG:teuthology.orchestra.run.smithi150:> cat /etc/os-release
2023-07-26T20:14:31.382 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="CentOS Stream"
2023-07-26T20:14:31.383 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="8"
2023-07-26T20:14:31.383 INFO:teuthology.orchestra.run.smithi150.stdout:ID="centos"
2023-07-26T20:14:31.383 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE="rhel fedora"
2023-07-26T20:14:31.384 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="8"
2023-07-26T20:14:31.384 INFO:teuthology.orchestra.run.smithi150.stdout:PLATFORM_ID="platform:el8"
2023-07-26T20:14:31.384 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="CentOS Stream 8"
2023-07-26T20:14:31.385 INFO:teuthology.orchestra.run.smithi150.stdout:ANSI_COLOR="0;31"
2023-07-26T20:14:31.385 INFO:teuthology.orchestra.run.smithi150.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-07-26T20:14:31.385 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://centos.org/"
2023-07-26T20:14:31.385 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-26T20:14:31.386 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-26T20:14:31.386 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-26T20:14:31.387 INFO:teuthology.provision.fog.smithi150:Deploy complete!
2023-07-26T20:14:31.387 DEBUG:teuthology.parallel:result is None
2023-07-26T20:14:31.548 INFO:teuthology.lock.ops:Checking smithi102.front.sepia.ceph.com
2023-07-26T20:14:31.549 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-26T20:14:31.573 INFO:teuthology.lock.ops:Checking smithi150.front.sepia.ceph.com
2023-07-26T20:14:31.573 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-26T20:14:31.599 INFO:teuthology.lock.ops:Updating [smithi102.front.sepia.ceph.com]: set os type and version on server
2023-07-26T20:14:31.600 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com'
2023-07-26T20:14:31.600 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-26T20:14:31.667 DEBUG:teuthology.orchestra.run.smithi102:> true
2023-07-26T20:14:31.736 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com'
2023-07-26T20:14:31.736 DEBUG:teuthology.orchestra.run.smithi102:> uname -m
2023-07-26T20:14:31.796 INFO:teuthology.orchestra.run.smithi102.stdout:x86_64
2023-07-26T20:14:31.797 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release
2023-07-26T20:14:31.855 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="CentOS Stream"
2023-07-26T20:14:31.855 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="8"
2023-07-26T20:14:31.856 INFO:teuthology.orchestra.run.smithi102.stdout:ID="centos"
2023-07-26T20:14:31.856 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE="rhel fedora"
2023-07-26T20:14:31.856 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="8"
2023-07-26T20:14:31.856 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM_ID="platform:el8"
2023-07-26T20:14:31.856 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="CentOS Stream 8"
2023-07-26T20:14:31.856 INFO:teuthology.orchestra.run.smithi102.stdout:ANSI_COLOR="0;31"
2023-07-26T20:14:31.857 INFO:teuthology.orchestra.run.smithi102.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-07-26T20:14:31.857 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://centos.org/"
2023-07-26T20:14:31.857 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-26T20:14:31.857 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-26T20:14:31.857 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-26T20:14:31.858 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server
2023-07-26T20:14:31.881 INFO:teuthology.lock.ops:Updating [smithi150.front.sepia.ceph.com]: set os type and version on server
2023-07-26T20:14:31.882 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com'
2023-07-26T20:14:31.882 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-26T20:14:31.947 DEBUG:teuthology.orchestra.run.smithi150:> true
2023-07-26T20:14:32.015 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi150.front.sepia.ceph.com'
2023-07-26T20:14:32.015 DEBUG:teuthology.orchestra.run.smithi150:> uname -m
2023-07-26T20:14:32.073 INFO:teuthology.orchestra.run.smithi150.stdout:x86_64
2023-07-26T20:14:32.073 DEBUG:teuthology.orchestra.run.smithi150:> cat /etc/os-release
2023-07-26T20:14:32.131 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="CentOS Stream"
2023-07-26T20:14:32.131 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="8"
2023-07-26T20:14:32.131 INFO:teuthology.orchestra.run.smithi150.stdout:ID="centos"
2023-07-26T20:14:32.131 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE="rhel fedora"
2023-07-26T20:14:32.132 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="8"
2023-07-26T20:14:32.132 INFO:teuthology.orchestra.run.smithi150.stdout:PLATFORM_ID="platform:el8"
2023-07-26T20:14:32.132 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="CentOS Stream 8"
2023-07-26T20:14:32.132 INFO:teuthology.orchestra.run.smithi150.stdout:ANSI_COLOR="0;31"
2023-07-26T20:14:32.132 INFO:teuthology.orchestra.run.smithi150.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-07-26T20:14:32.132 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://centos.org/"
2023-07-26T20:14:32.132 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-26T20:14:32.133 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-26T20:14:32.133 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-26T20:14:32.133 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server
2023-07-26T20:14:32.156 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-26T20:14:32.157 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-26T20:14:32.250 INFO:teuthology.dispatcher.supervisor:Running job 7353044
2023-07-26T20:14:32.251 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-07-26_14:31:06-orch-reef-release-distro-default-smithi/7353044 --name yuriw-2023-07-26_14:31:06-orch-reef-release-distro-default-smithi --description orch/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/classic} -- /home/teuthworker/archive/yuriw-2023-07-26_14:31:06-orch-reef-release-distro-default-smithi/7353044/orig.config.yaml
2023-07-26T20:14:32.255 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-07-26_14:31:06-orch-reef-release-distro-default-smithi/7353044
2023-07-26T20:14:32.256 INFO:teuthology.dispatcher.supervisor:Job PID: 1384
2023-07-26T20:14:32.256 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-07-26T20:16:32.356 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-26T20:16:32.357 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-26T20:18:32.524 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-26T20:18:32.525 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-26T20:20:37.745 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-26T20:20:37.746 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-26T20:22:44.225 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-26T20:22:44.226 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-26T20:24:49.397 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-26T20:24:49.397 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-26T20:26:54.573 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-26T20:26:54.574 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-26T20:28:59.745 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-26T20:28:59.745 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-26T20:31:04.917 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-26T20:31:04.917 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-26T20:33:10.093 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-26T20:33:10.094 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-26T20:35:16.878 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-26T20:35:16.878 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-26T20:37:22.070 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-26T20:37:22.071 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-26T20:39:27.259 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-26T20:39:27.260 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-26T20:41:32.425 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-26T20:41:32.425 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-26T20:43:37.609 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-26T20:43:37.609 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-26T20:45:42.801 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-26T20:45:42.802 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-26T20:47:48.001 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-26T20:47:48.002 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-26T20:49:52.671 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-26T20:49:52.672 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-26T20:51:57.865 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-26T20:51:57.866 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-26T20:54:03.041 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-26T20:54:03.042 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-26T20:54:08.133 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-07-26T20:54:18.300 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-07-26T20:54:18.300 INFO:teuthology.nuke:Checking targets against current locks
2023-07-26T20:54:38.370 DEBUG:teuthology.nuke:shortname: smithi102
2023-07-26T20:54:38.370 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-26T20:54:40.524 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi102.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-26_14:31:06-orch-reef-release-distro-default-smithi/7353044', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-26 20:09:25.744202', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDIWP8eaiqv/c7Yo9QioVJ7Y4mLM5TyVALVMahvk5oS3MZdV0my9wSLwZhai459X5ZMHabuvrqtp94uqihgHa7WFJKBD/iyi7TT8WPqaRHOCdAaQIzSXZ1D1ndSUMba5925pOV+IY6qK/+jnBx1WSc5sjQyAFqw4K1MTbS8QR2ozUIIdvGbm13UERErZqX8d+VGP+DHPEW2zKoNr4C6bHbjrJdZWmYMrugrIFra6RDYe3nlA4au5rDWEyz+cVaOIAkCaUPltEhc7hwwYM1ZX8PiaVndKYxi8TK5BsXSj14ggO8lOqW2JvbMDP3CylMYoAnuVLDDOFYr5f0kaB0C0m9yZRFjo2Exh82YHyJj6FrZ60mg63pyhx2TaYDFPvDq7ZbyfqXi6msemMCRzi/SA8WlfwxO2Sa6zpa2bMEl3plOdcyILBnwLr8r55Qub59HdPYpn/Igg0G5Bipzo4F90o+yK8jg24UtvUglQozu3Dzvq/e0Aw7ms0Z1e3XXp4UGun0='}
2023-07-26T20:54:40.528 DEBUG:teuthology.nuke:shortname: smithi150
2023-07-26T20:54:40.529 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-26T20:54:40.554 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi150.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-26_14:31:06-orch-reef-release-distro-default-smithi/7353044', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-26 20:09:25.745818', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH9EJ6350zsMLxD9DCV9DjaWpu5s+q5yiKInBacYifXrTvaDnKvKiwNpZRUwxOm1L7oDh4WDv/n8E2JfXQQ4re0='}
2023-07-26T20:54:40.582 INFO:teuthology.orchestra.console:Power off smithi102
2023-07-26T20:54:40.583 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-26T20:54:40.605 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off
2023-07-26T20:54:40.606 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T20:54:40.624 INFO:teuthology.orchestra.console:Power off smithi150
2023-07-26T20:54:40.624 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-26T20:54:40.633 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off
2023-07-26T20:54:40.645 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off
2023-07-26T20:54:40.646 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T20:54:40.668 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off
2023-07-26T20:54:40.735 INFO:teuthology.orchestra.console:Power off for smithi102 completed
2023-07-26T20:54:40.770 INFO:teuthology.orchestra.console:Power off for smithi150 completed
2023-07-26T20:54:40.891 INFO:teuthology.lock.ops:unlocked: smithi102.front.sepia.ceph.com
2023-07-26T20:54:40.926 INFO:teuthology.lock.ops:unlocked: smithi150.front.sepia.ceph.com