2023-11-27T14:35:33.445 INFO:root:teuthology version: 0.0.1.dev205+g2442239
2023-11-27T14:35:33.445 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-27T14:35:33.578 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fb624d12820>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fb624a0ff70>, signals=[15])
2023-11-27T14:35:33.578 INFO:teuthology.lock.ops:Start node 'smithi039.front.sepia.ceph.com' reimaging
2023-11-27T14:35:33.578 INFO:teuthology.lock.ops:Updating [smithi039.front.sepia.ceph.com]: reset os type and version on server
2023-11-27T14:35:33.578 INFO:teuthology.lock.ops:Updating smithi039.front.sepia.ceph.com on lock server
2023-11-27T14:35:33.613 INFO:teuthology.lock.ops:Start node 'smithi196.front.sepia.ceph.com' reimaging
2023-11-27T14:35:33.613 INFO:teuthology.lock.ops:Updating [smithi196.front.sepia.ceph.com]: reset os type and version on server
2023-11-27T14:35:33.613 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server
2023-11-27T14:35:33.733 DEBUG:teuthology.provision.fog.smithi039:Requesting image smithi_centos_8.stream (ID 3)
2023-11-27T14:35:33.748 DEBUG:teuthology.provision.fog.smithi196:Requesting image smithi_centos_8.stream (ID 3)
2023-11-27T14:35:33.778 INFO:teuthology.provision.fog.smithi039:Scheduling deploy of centos 8.stream
2023-11-27T14:35:33.791 INFO:teuthology.provision.fog.smithi196:Scheduling deploy of centos 8.stream
2023-11-27T14:35:34.029 INFO:teuthology.orchestra.console.smithi196:Power off
2023-11-27T14:35:34.030 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-27T14:35:34.043 INFO:teuthology.orchestra.console.smithi039:Power off
2023-11-27T14:35:34.043 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-27T14:35:34.052 DEBUG:teuthology.orchestra.console.smithi196:power off output: Chassis Power Control: Down/Off
2023-11-27T14:35:34.053 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-27T14:35:34.065 DEBUG:teuthology.orchestra.console.smithi039:power off output: Chassis Power Control: Down/Off
2023-11-27T14:35:34.066 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-27T14:35:34.074 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off
2023-11-27T14:35:34.086 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is off
2023-11-27T14:35:34.175 INFO:teuthology.orchestra.console.smithi196:Power off completed
2023-11-27T14:35:34.187 INFO:teuthology.orchestra.console.smithi039:Power off completed
2023-11-27T14:35:34.276 INFO:teuthology.orchestra.console.smithi196:Power on
2023-11-27T14:35:34.276 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-27T14:35:34.288 INFO:teuthology.orchestra.console.smithi039:Power on
2023-11-27T14:35:34.289 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-27T14:35:34.296 DEBUG:teuthology.orchestra.console.smithi196:power on output: Chassis Power Control: Up/On
2023-11-27T14:35:34.297 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-27T14:35:34.310 DEBUG:teuthology.orchestra.console.smithi039:power on output: Chassis Power Control: Up/On
2023-11-27T14:35:34.310 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-27T14:35:34.317 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off
2023-11-27T14:35:34.334 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is off
2023-11-27T14:35:38.322 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-27T14:35:38.335 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-27T14:35:38.431 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on
2023-11-27T14:35:38.446 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is off
2023-11-27T14:35:38.532 INFO:teuthology.orchestra.console.smithi196:Power on completed
2023-11-27T14:35:38.633 INFO:teuthology.provision.fog.smithi196:Waiting for deploy to finish
2023-11-27T14:35:42.450 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-27T14:35:42.559 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is on
2023-11-27T14:35:42.662 INFO:teuthology.orchestra.console.smithi039:Power on completed
2023-11-27T14:35:42.763 INFO:teuthology.provision.fog.smithi039:Waiting for deploy to finish
2023-11-27T14:38:24.660 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-27T14:38:43.042 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2023-11-27T14:38:49.046 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-27T14:38:52.098 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2023-11-27T14:38:58.105 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-27T14:38:58.847 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-27T14:39:01.190 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2023-11-27T14:39:01.922 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39
2023-11-27T14:39:07.194 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-27T14:39:07.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-27T14:39:10.274 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2023-11-27T14:39:10.982 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39
2023-11-27T14:39:16.278 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-27T14:39:16.984 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-27T14:39:20.066 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39
2023-11-27T14:39:22.370 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2023-11-27T14:39:26.070 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-27T14:39:28.374 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-27T14:39:29.122 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39
2023-11-27T14:39:31.426 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2023-11-27T14:39:35.129 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-27T14:39:37.430 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-27T14:39:38.214 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39
2023-11-27T14:39:40.486 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2023-11-27T14:39:44.218 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-27T14:39:46.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-27T14:39:47.302 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39
2023-11-27T14:39:49.574 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2023-11-27T14:39:53.308 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-27T14:39:55.577 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-27T14:39:55.830 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-27T14:39:55.830 DEBUG:teuthology.orchestra.run.smithi196:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-27T14:39:56.390 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39
2023-11-27T14:40:02.392 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-27T14:40:05.442 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39
2023-11-27T14:40:11.443 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-27T14:40:14.502 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39
2023-11-27T14:40:16.454 INFO:teuthology.provision.fog.smithi196:Node is ready
2023-11-27T14:40:16.454 DEBUG:teuthology.orchestra.run.smithi196:> hostname
2023-11-27T14:40:16.479 INFO:teuthology.orchestra.run.smithi196.stdout:smithi196.front.sepia.ceph.com
2023-11-27T14:40:16.479 DEBUG:teuthology.orchestra.run.smithi196:> grep smithi196.front.sepia.ceph.com /etc/hosts
2023-11-27T14:40:16.541 INFO:teuthology.orchestra.run.smithi196.stdout:172.21.15.196 smithi196.front.sepia.ceph.com smithi196
2023-11-27T14:40:16.542 DEBUG:teuthology.orchestra.run.smithi196:> sudo hostname smithi196
2023-11-27T14:40:16.668 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/smithi196.front.sepia.ceph.com/smithi196/g' /etc/hosts
2023-11-27T14:40:16.701 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/172.21.15.196/172.21.15.196/g' /etc/hosts
2023-11-27T14:40:16.771 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/smithi196.front.sepia.ceph.com/smithi196/g' /etc/hostname
2023-11-27T14:40:16.843 DEBUG:teuthology.orchestra.run.smithi196:> sudo hostname smithi196
2023-11-27T14:40:16.912 DEBUG:teuthology.orchestra.run.smithi196:> cat /etc/os-release
2023-11-27T14:40:16.972 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="CentOS Stream"
2023-11-27T14:40:16.972 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="8"
2023-11-27T14:40:16.972 INFO:teuthology.orchestra.run.smithi196.stdout:ID="centos"
2023-11-27T14:40:16.973 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE="rhel fedora"
2023-11-27T14:40:16.973 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="8"
2023-11-27T14:40:16.973 INFO:teuthology.orchestra.run.smithi196.stdout:PLATFORM_ID="platform:el8"
2023-11-27T14:40:16.973 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="CentOS Stream 8"
2023-11-27T14:40:16.973 INFO:teuthology.orchestra.run.smithi196.stdout:ANSI_COLOR="0;31"
2023-11-27T14:40:16.973 INFO:teuthology.orchestra.run.smithi196.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-11-27T14:40:16.974 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://centos.org/"
2023-11-27T14:40:16.974 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-27T14:40:16.974 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-27T14:40:16.974 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-27T14:40:16.975 INFO:teuthology.provision.fog.smithi196:Deploy complete!
2023-11-27T14:40:16.976 DEBUG:teuthology.parallel:result is None
2023-11-27T14:40:20.506 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-27T14:41:20.568 WARNING:teuthology.provision.fog.smithi039:timed out
2023-11-27T14:41:26.575 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-27T14:41:26.835 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-27T14:41:26.835 DEBUG:teuthology.orchestra.run.smithi039:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-27T14:41:27.090 INFO:teuthology.provision.fog.smithi039:Node is ready
2023-11-27T14:41:27.090 DEBUG:teuthology.orchestra.run.smithi039:> hostname
2023-11-27T14:41:27.111 INFO:teuthology.orchestra.run.smithi039.stdout:smithi039.front.sepia.ceph.com
2023-11-27T14:41:27.111 DEBUG:teuthology.orchestra.run.smithi039:> grep smithi039.front.sepia.ceph.com /etc/hosts
2023-11-27T14:41:27.174 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39 smithi039.front.sepia.ceph.com smithi039
2023-11-27T14:41:27.174 DEBUG:teuthology.orchestra.run.smithi039:> sudo hostname smithi039
2023-11-27T14:41:27.263 DEBUG:teuthology.orchestra.run.smithi039:> sudo sed -i -e 's/smithi039.front.sepia.ceph.com/smithi039/g' /etc/hosts
2023-11-27T14:41:27.296 DEBUG:teuthology.orchestra.run.smithi039:> sudo sed -i -e 's/172.21.15.39/172.21.15.39/g' /etc/hosts
2023-11-27T14:41:27.367 DEBUG:teuthology.orchestra.run.smithi039:> sudo sed -i -e 's/smithi039.front.sepia.ceph.com/smithi039/g' /etc/hostname
2023-11-27T14:41:27.437 DEBUG:teuthology.orchestra.run.smithi039:> sudo hostname smithi039
2023-11-27T14:41:27.506 DEBUG:teuthology.orchestra.run.smithi039:> cat /etc/os-release
2023-11-27T14:41:27.565 INFO:teuthology.orchestra.run.smithi039.stdout:NAME="CentOS Stream"
2023-11-27T14:41:27.565 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION="8"
2023-11-27T14:41:27.565 INFO:teuthology.orchestra.run.smithi039.stdout:ID="centos"
2023-11-27T14:41:27.566 INFO:teuthology.orchestra.run.smithi039.stdout:ID_LIKE="rhel fedora"
2023-11-27T14:41:27.566 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION_ID="8"
2023-11-27T14:41:27.566 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM_ID="platform:el8"
2023-11-27T14:41:27.566 INFO:teuthology.orchestra.run.smithi039.stdout:PRETTY_NAME="CentOS Stream 8"
2023-11-27T14:41:27.566 INFO:teuthology.orchestra.run.smithi039.stdout:ANSI_COLOR="0;31"
2023-11-27T14:41:27.566 INFO:teuthology.orchestra.run.smithi039.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-11-27T14:41:27.566 INFO:teuthology.orchestra.run.smithi039.stdout:HOME_URL="https://centos.org/"
2023-11-27T14:41:27.566 INFO:teuthology.orchestra.run.smithi039.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-27T14:41:27.566 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-27T14:41:27.566 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-27T14:41:27.567 INFO:teuthology.provision.fog.smithi039:Deploy complete!
2023-11-27T14:41:27.567 DEBUG:teuthology.parallel:result is None
2023-11-27T14:41:27.719 INFO:teuthology.lock.ops:Checking smithi039.front.sepia.ceph.com
2023-11-27T14:41:27.719 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-27T14:41:27.749 INFO:teuthology.lock.ops:Checking smithi196.front.sepia.ceph.com
2023-11-27T14:41:27.749 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-27T14:41:27.767 INFO:teuthology.lock.ops:Updating [smithi039.front.sepia.ceph.com]: set os type and version on server
2023-11-27T14:41:27.767 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com'
2023-11-27T14:41:27.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-27T14:41:27.836 DEBUG:teuthology.orchestra.run.smithi039:> true
2023-11-27T14:41:27.906 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi039.front.sepia.ceph.com'
2023-11-27T14:41:27.906 DEBUG:teuthology.orchestra.run.smithi039:> uname -m
2023-11-27T14:41:27.964 INFO:teuthology.orchestra.run.smithi039.stdout:x86_64
2023-11-27T14:41:27.965 DEBUG:teuthology.orchestra.run.smithi039:> cat /etc/os-release
2023-11-27T14:41:28.023 INFO:teuthology.orchestra.run.smithi039.stdout:NAME="CentOS Stream"
2023-11-27T14:41:28.024 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION="8"
2023-11-27T14:41:28.024 INFO:teuthology.orchestra.run.smithi039.stdout:ID="centos"
2023-11-27T14:41:28.024 INFO:teuthology.orchestra.run.smithi039.stdout:ID_LIKE="rhel fedora"
2023-11-27T14:41:28.024 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION_ID="8"
2023-11-27T14:41:28.024 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM_ID="platform:el8"
2023-11-27T14:41:28.024 INFO:teuthology.orchestra.run.smithi039.stdout:PRETTY_NAME="CentOS Stream 8"
2023-11-27T14:41:28.024 INFO:teuthology.orchestra.run.smithi039.stdout:ANSI_COLOR="0;31"
2023-11-27T14:41:28.024 INFO:teuthology.orchestra.run.smithi039.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-11-27T14:41:28.024 INFO:teuthology.orchestra.run.smithi039.stdout:HOME_URL="https://centos.org/"
2023-11-27T14:41:28.024 INFO:teuthology.orchestra.run.smithi039.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-27T14:41:28.024 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-27T14:41:28.025 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-27T14:41:28.025 INFO:teuthology.lock.ops:Updating smithi039.front.sepia.ceph.com on lock server
2023-11-27T14:41:28.057 INFO:teuthology.lock.ops:Updating [smithi196.front.sepia.ceph.com]: set os type and version on server
2023-11-27T14:41:28.058 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com'
2023-11-27T14:41:28.058 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-27T14:41:28.126 DEBUG:teuthology.orchestra.run.smithi196:> true
2023-11-27T14:41:28.266 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi196.front.sepia.ceph.com'
2023-11-27T14:41:28.266 DEBUG:teuthology.orchestra.run.smithi196:> uname -m
2023-11-27T14:41:28.326 INFO:teuthology.orchestra.run.smithi196.stdout:x86_64
2023-11-27T14:41:28.326 DEBUG:teuthology.orchestra.run.smithi196:> cat /etc/os-release
2023-11-27T14:41:28.385 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="CentOS Stream"
2023-11-27T14:41:28.385 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="8"
2023-11-27T14:41:28.385 INFO:teuthology.orchestra.run.smithi196.stdout:ID="centos"
2023-11-27T14:41:28.386 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE="rhel fedora"
2023-11-27T14:41:28.386 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="8"
2023-11-27T14:41:28.386 INFO:teuthology.orchestra.run.smithi196.stdout:PLATFORM_ID="platform:el8"
2023-11-27T14:41:28.386 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="CentOS Stream 8"
2023-11-27T14:41:28.386 INFO:teuthology.orchestra.run.smithi196.stdout:ANSI_COLOR="0;31"
2023-11-27T14:41:28.386 INFO:teuthology.orchestra.run.smithi196.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-11-27T14:41:28.386 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://centos.org/"
2023-11-27T14:41:28.386 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-27T14:41:28.386 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-27T14:41:28.386 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-27T14:41:28.387 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server
2023-11-27T14:41:28.407 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-27T14:41:28.495 INFO:teuthology.dispatcher.supervisor:Running job 7467779
2023-11-27T14:41:28.495 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/virtualenv/bin/teuthology -v --owner scheduled_adking@teuthology --archive /home/teuthworker/archive/adking-2023-11-27_13:10:55-orch:cephadm-wip-adk3-testing-2023-11-26-1627-distro-default-smithi/7467779 --name adking-2023-11-27_13:10:55-orch:cephadm-wip-adk3-testing-2023-11-26-1627-distro-default-smithi --description orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/classic overrides/ignorelist} -- /home/teuthworker/archive/adking-2023-11-27_13:10:55-orch:cephadm-wip-adk3-testing-2023-11-26-1627-distro-default-smithi/7467779/orig.config.yaml
2023-11-27T14:41:28.498 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/adking-2023-11-27_13:10:55-orch:cephadm-wip-adk3-testing-2023-11-26-1627-distro-default-smithi/7467779
2023-11-27T14:41:28.499 INFO:teuthology.dispatcher.supervisor:Job PID: 3118300
2023-11-27T14:41:28.499 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-11-27T14:43:28.598 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-27T14:45:28.762 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-27T14:47:28.936 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-27T14:49:29.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-27T14:51:29.281 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-27T14:53:29.452 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-27T14:55:29.619 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-27T14:57:29.803 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-27T14:59:29.971 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-27T15:01:30.137 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-27T15:03:30.311 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-27T15:05:30.450 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-27T15:07:30.616 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-27T15:09:30.779 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-27T15:11:30.943 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-27T15:13:31.039 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-27T15:15:31.207 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-27T15:17:31.377 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-27T15:19:31.546 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-27T15:21:31.700 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-27T15:23:31.854 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-27T15:25:32.023 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-27T15:27:32.184 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-27T15:29:32.339 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-27T15:31:32.470 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-27T15:33:32.632 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-27T15:35:32.791 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-27T15:37:32.934 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-27T15:39:33.099 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-27T15:41:33.268 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-27T15:43:33.365 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-27T15:45:33.531 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-27T15:45:33.599 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-11-27T15:45:33.800 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-11-27T15:45:33.800 INFO:teuthology.nuke:Checking targets against current locks
2023-11-27T15:45:33.849 DEBUG:teuthology.nuke:shortname: smithi039
2023-11-27T15:45:33.850 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-27T15:45:33.875 DEBUG:teuthology.nuke:shortname: smithi196
2023-11-27T15:45:33.876 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-27T15:45:33.879 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi039.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-11-27_13:10:55-orch:cephadm-wip-adk3-testing-2023-11-26-1627-distro-default-smithi/7467779', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-27 14:35:32.619764', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGHTZEQhoRx0DesjZUYkLBgf60y2AYykjj7OYbFa9V0KxOSMLUWt/btsgbWx4TqUC12eDzok2G3lhX+wDBhv2YY='}
2023-11-27T15:45:33.904 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi196.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-11-27_13:10:55-orch:cephadm-wip-adk3-testing-2023-11-26-1627-distro-default-smithi/7467779', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-27 14:35:32.621757', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNEYe4Puzlyqnmxl3CARKSh5OHldzrcJrPH/USLabZxjU+k6glycdlzkbSi5i7OYnOneEOp0d9WL7PaAn2QJh5c='}
2023-11-27T15:45:33.935 INFO:teuthology.orchestra.console.smithi039:Power off
2023-11-27T15:45:33.935 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-27T15:45:33.959 DEBUG:teuthology.orchestra.console.smithi039:power off output: Chassis Power Control: Down/Off
2023-11-27T15:45:33.960 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-27T15:45:33.975 INFO:teuthology.orchestra.console.smithi196:Power off
2023-11-27T15:45:33.975 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-27T15:45:33.985 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is off
2023-11-27T15:45:33.999 DEBUG:teuthology.orchestra.console.smithi196:power off output: Chassis Power Control: Down/Off
2023-11-27T15:45:33.999 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-27T15:45:34.020 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off
2023-11-27T15:45:34.085 INFO:teuthology.orchestra.console.smithi039:Power off completed
2023-11-27T15:45:34.121 INFO:teuthology.orchestra.console.smithi196:Power off completed
2023-11-27T15:45:34.239 INFO:teuthology.lock.ops:unlocked: smithi039.front.sepia.ceph.com
2023-11-27T15:45:34.265 INFO:teuthology.lock.ops:unlocked: smithi196.front.sepia.ceph.com