2023-12-20T15:25:21.262 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e
2023-12-20T15:25:21.262 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-20T15:25:21.836 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f591d25b280>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f591e1a1940>, signals=[15])
2023-12-20T15:25:21.837 INFO:teuthology.lock.ops:Start node 'smithi049.front.sepia.ceph.com' reimaging
2023-12-20T15:25:21.837 INFO:teuthology.lock.ops:Updating [smithi049.front.sepia.ceph.com]: reset os type and version on server
2023-12-20T15:25:21.837 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server
2023-12-20T15:25:21.992 INFO:teuthology.lock.ops:Start node 'smithi115.front.sepia.ceph.com' reimaging
2023-12-20T15:25:21.992 INFO:teuthology.lock.ops:Updating [smithi115.front.sepia.ceph.com]: reset os type and version on server
2023-12-20T15:25:21.992 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server
2023-12-20T15:25:22.059 INFO:teuthology.lock.ops:Start node 'smithi195.front.sepia.ceph.com' reimaging
2023-12-20T15:25:22.059 INFO:teuthology.lock.ops:Updating [smithi195.front.sepia.ceph.com]: reset os type and version on server
2023-12-20T15:25:22.059 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server
2023-12-20T15:25:22.107 DEBUG:teuthology.provision.fog.smithi049:Requesting image smithi_centos_9.stream (ID 10)
2023-12-20T15:25:22.162 INFO:teuthology.provision.fog.smithi049:Scheduling deploy of centos 9.stream
2023-12-20T15:25:22.178 DEBUG:teuthology.provision.fog.smithi115:Requesting image smithi_centos_9.stream (ID 10)
2023-12-20T15:25:22.252 INFO:teuthology.provision.fog.smithi115:Scheduling deploy of centos 9.stream
2023-12-20T15:25:22.272 DEBUG:teuthology.provision.fog.smithi195:Requesting image smithi_centos_9.stream (ID 10)
2023-12-20T15:25:22.332 INFO:teuthology.provision.fog.smithi195:Scheduling deploy of centos 9.stream
2023-12-20T15:25:23.064 INFO:teuthology.orchestra.console.smithi115:Power off
2023-12-20T15:25:23.064 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-20T15:25:23.076 INFO:teuthology.orchestra.console.smithi049:Power off
2023-12-20T15:25:23.076 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-20T15:25:23.084 DEBUG:teuthology.orchestra.console.smithi115:power off output: Chassis Power Control: Down/Off
2023-12-20T15:25:23.084 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T15:25:23.103 DEBUG:teuthology.orchestra.console.smithi049:power off output: Chassis Power Control: Down/Off
2023-12-20T15:25:23.104 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T15:25:23.110 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on
2023-12-20T15:25:23.128 INFO:teuthology.orchestra.console.smithi195:Power off
2023-12-20T15:25:23.129 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-20T15:25:23.138 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off
2023-12-20T15:25:23.152 DEBUG:teuthology.orchestra.console.smithi195:power off output: Chassis Power Control: Down/Off
2023-12-20T15:25:23.152 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T15:25:23.174 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on
2023-12-20T15:25:23.240 INFO:teuthology.orchestra.console.smithi049:Power off completed
2023-12-20T15:25:23.341 INFO:teuthology.orchestra.console.smithi049:Power on
2023-12-20T15:25:23.341 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-20T15:25:23.361 DEBUG:teuthology.orchestra.console.smithi049:power on output: Chassis Power Control: Up/On
2023-12-20T15:25:23.361 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T15:25:23.381 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off
2023-12-20T15:25:27.114 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T15:25:27.175 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T15:25:27.223 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on
2023-12-20T15:25:27.283 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on
2023-12-20T15:25:27.382 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T15:25:27.490 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off
2023-12-20T15:25:31.225 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T15:25:31.284 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T15:25:31.334 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on
2023-12-20T15:25:31.392 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on
2023-12-20T15:25:31.491 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T15:25:31.667 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is on
2023-12-20T15:25:31.768 INFO:teuthology.orchestra.console.smithi049:Power on completed
2023-12-20T15:25:31.868 INFO:teuthology.provision.fog.smithi049:Waiting for deploy to finish
2023-12-20T15:25:35.339 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T15:25:35.393 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T15:25:35.449 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off
2023-12-20T15:25:35.500 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off
2023-12-20T15:25:35.551 INFO:teuthology.orchestra.console.smithi115:Power off completed
2023-12-20T15:25:35.601 INFO:teuthology.orchestra.console.smithi195:Power off completed
2023-12-20T15:25:35.651 INFO:teuthology.orchestra.console.smithi115:Power on
2023-12-20T15:25:35.652 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-20T15:25:35.671 DEBUG:teuthology.orchestra.console.smithi115:power on output: Chassis Power Control: Up/On
2023-12-20T15:25:35.671 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T15:25:35.692 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off
2023-12-20T15:25:35.702 INFO:teuthology.orchestra.console.smithi195:Power on
2023-12-20T15:25:35.702 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-20T15:25:35.722 DEBUG:teuthology.orchestra.console.smithi195:power on output: Chassis Power Control: Up/On
2023-12-20T15:25:35.722 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T15:25:35.742 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off
2023-12-20T15:25:39.698 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T15:25:39.743 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T15:25:39.807 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on
2023-12-20T15:25:39.850 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on
2023-12-20T15:25:39.908 INFO:teuthology.orchestra.console.smithi115:Power on completed
2023-12-20T15:25:39.951 INFO:teuthology.orchestra.console.smithi195:Power on completed
2023-12-20T15:25:40.008 INFO:teuthology.provision.fog.smithi115:Waiting for deploy to finish
2023-12-20T15:25:40.052 INFO:teuthology.provision.fog.smithi195:Waiting for deploy to finish
2023-12-20T15:25:40.285 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T15:25:58.677 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195
2023-12-20T15:26:04.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T15:26:07.761 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195
2023-12-20T15:26:13.765 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T15:26:16.818 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195
2023-12-20T15:26:22.824 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T15:26:25.905 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195
2023-12-20T15:26:31.912 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T15:26:34.993 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195
2023-12-20T15:26:40.998 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T15:26:44.049 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195
2023-12-20T15:26:50.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T15:27:08.561 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195
2023-12-20T15:27:14.566 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T15:27:16.429 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195
2023-12-20T15:27:22.434 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T15:27:22.516 ERROR:teuthology.orchestra.connection:Error authenticating with smithi195.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-20T15:27:26.639 ERROR:teuthology.orchestra.connection:Error authenticating with smithi195.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-20T15:27:33.760 ERROR:teuthology.orchestra.connection:Error authenticating with smithi195.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-20T15:27:43.881 ERROR:teuthology.orchestra.connection:Error authenticating with smithi195.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-20T15:27:57.003 ERROR:teuthology.orchestra.connection:Error authenticating with smithi195.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-20T15:28:13.125 ERROR:teuthology.orchestra.connection:Error authenticating with smithi195.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-20T15:28:32.245 ERROR:teuthology.orchestra.connection:Error authenticating with smithi195.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-20T15:28:54.327 ERROR:teuthology.orchestra.connection:Error authenticating with smithi195.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-20T15:29:19.410 ERROR:teuthology.orchestra.connection:Error authenticating with smithi195.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-20T15:29:28.939 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T15:29:32.017 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115
2023-12-20T15:29:38.019 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T15:29:41.073 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115
2023-12-20T15:29:47.075 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T15:29:47.532 ERROR:teuthology.orchestra.connection:Error authenticating with smithi195.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-20T15:29:47.532 WARNING:teuthology.provision.fog.smithi195:'connect to smithi195.front.sepia.ceph.com' reached maximum tries (11) after waiting for 145 seconds
2023-12-20T15:29:50.129 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115
2023-12-20T15:29:53.534 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T15:29:53.657 ERROR:teuthology.orchestra.connection:Error authenticating with smithi195.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-20T15:29:56.130 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T15:29:59.217 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115
2023-12-20T15:30:05.219 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T15:30:08.273 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115
2023-12-20T15:30:14.275 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T15:30:17.330 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115
2023-12-20T15:30:23.331 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T15:30:26.385 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115
2023-12-20T15:30:32.386 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T15:30:42.578 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115
2023-12-20T15:30:48.579 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T15:30:51.633 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115
2023-12-20T15:30:57.635 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T15:30:57.660 WARNING:teuthology.provision.fog.smithi195:timed out
2023-12-20T15:31:00.689 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115
2023-12-20T15:31:03.662 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T15:31:06.690 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T15:31:08.582 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-20T15:31:08.582 DEBUG:teuthology.orchestra.run.smithi115:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-20T15:31:18.929 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195
2023-12-20T15:31:24.931 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T15:31:27.986 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195
2023-12-20T15:31:28.970 INFO:teuthology.provision.fog.smithi115:Node is ready
2023-12-20T15:31:28.971 DEBUG:teuthology.orchestra.run.smithi115:> hostname
2023-12-20T15:31:28.990 INFO:teuthology.orchestra.run.smithi115.stdout:smithi115.front.sepia.ceph.com
2023-12-20T15:31:28.991 DEBUG:teuthology.orchestra.run.smithi115:> grep smithi115.front.sepia.ceph.com /etc/hosts
2023-12-20T15:31:29.048 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115 smithi115.front.sepia.ceph.com smithi115
2023-12-20T15:31:29.048 DEBUG:teuthology.orchestra.run.smithi115:> sudo hostname smithi115
2023-12-20T15:31:29.180 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/smithi115.front.sepia.ceph.com/smithi115/g' /etc/hosts
2023-12-20T15:31:29.210 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/172.21.15.115/172.21.15.115/g' /etc/hosts
2023-12-20T15:31:29.279 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/smithi115.front.sepia.ceph.com/smithi115/g' /etc/hostname
2023-12-20T15:31:29.348 DEBUG:teuthology.orchestra.run.smithi115:> sudo hostname smithi115
2023-12-20T15:31:29.416 DEBUG:teuthology.orchestra.run.smithi115:> cat /etc/os-release
2023-12-20T15:31:29.471 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="CentOS Stream"
2023-12-20T15:31:29.471 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="9"
2023-12-20T15:31:29.471 INFO:teuthology.orchestra.run.smithi115.stdout:ID="centos"
2023-12-20T15:31:29.471 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="rhel fedora"
2023-12-20T15:31:29.471 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="9"
2023-12-20T15:31:29.471 INFO:teuthology.orchestra.run.smithi115.stdout:PLATFORM_ID="platform:el9"
2023-12-20T15:31:29.471 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="CentOS Stream 9"
2023-12-20T15:31:29.471 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31"
2023-12-20T15:31:29.472 INFO:teuthology.orchestra.run.smithi115.stdout:LOGO="fedora-logo-icon"
2023-12-20T15:31:29.472 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-12-20T15:31:29.472 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://centos.org/"
2023-12-20T15:31:29.472 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-20T15:31:29.472 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-12-20T15:31:29.472 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-20T15:31:29.473 INFO:teuthology.provision.fog.smithi115:Deploy complete!
2023-12-20T15:31:29.475 DEBUG:teuthology.parallel:result is None
2023-12-20T15:31:33.987 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T15:31:34.994 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195
2023-12-20T15:31:40.996 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T15:31:40.998 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195
2023-12-20T15:31:46.999 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T15:31:47.001 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195
2023-12-20T15:31:53.002 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T15:31:53.004 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195
2023-12-20T15:31:59.005 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T15:31:59.006 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195
2023-12-20T15:32:05.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T15:32:05.216 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-20T15:32:05.216 DEBUG:teuthology.orchestra.run.smithi195:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-20T15:32:05.715 INFO:teuthology.provision.fog.smithi195:Node is ready
2023-12-20T15:32:05.715 DEBUG:teuthology.orchestra.run.smithi195:> hostname
2023-12-20T15:32:05.720 INFO:teuthology.orchestra.run.smithi195.stdout:smithi195.front.sepia.ceph.com
2023-12-20T15:32:05.720 DEBUG:teuthology.orchestra.run.smithi195:> grep smithi195.front.sepia.ceph.com /etc/hosts
2023-12-20T15:32:05.768 INFO:teuthology.orchestra.run.smithi195.stdout:172.21.15.195 smithi195.front.sepia.ceph.com smithi195
2023-12-20T15:32:05.768 DEBUG:teuthology.orchestra.run.smithi195:> sudo hostname smithi195
2023-12-20T15:32:05.894 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/smithi195.front.sepia.ceph.com/smithi195/g' /etc/hosts
2023-12-20T15:32:05.907 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/172.21.15.195/172.21.15.195/g' /etc/hosts
2023-12-20T15:32:05.960 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/smithi195.front.sepia.ceph.com/smithi195/g' /etc/hostname
2023-12-20T15:32:06.015 DEBUG:teuthology.orchestra.run.smithi195:> sudo hostname smithi195
2023-12-20T15:32:06.071 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release
2023-12-20T15:32:06.116 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-12-20T15:32:06.116 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="Ubuntu"
2023-12-20T15:32:06.117 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="22.04"
2023-12-20T15:32:06.117 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-12-20T15:32:06.117 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_CODENAME=jammy
2023-12-20T15:32:06.117 INFO:teuthology.orchestra.run.smithi195.stdout:ID=ubuntu
2023-12-20T15:32:06.117 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE=debian
2023-12-20T15:32:06.117 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://www.ubuntu.com/"
2023-12-20T15:32:06.117 INFO:teuthology.orchestra.run.smithi195.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-12-20T15:32:06.117 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-12-20T15:32:06.117 INFO:teuthology.orchestra.run.smithi195.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-12-20T15:32:06.117 INFO:teuthology.orchestra.run.smithi195.stdout:UBUNTU_CODENAME=jammy
2023-12-20T15:32:06.119 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/dispatcher/supervisor.py", line 232, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/provision/fog.py", line 347, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi195's OS to be centos 9 but found ubuntu 22.04
2023-12-20T15:32:06.119 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-20T15:32:06.255 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=429553c520e14ed7a37f574fefe97137
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/dispatcher/supervisor.py", line 232, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/provision/fog.py", line 347, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi195's OS to be centos 9 but found ubuntu 22.04
2023-12-20T15:32:06.256 INFO:teuthology.nuke:Checking targets against current locks
2023-12-20T15:32:06.305 DEBUG:teuthology.nuke:shortname: smithi049
2023-12-20T15:32:06.306 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-20T15:32:06.330 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi049.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-20_15:22:54-rados-wip-yuri-testing-2023-12-19-1112-distro-default-smithi/7497909', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-20 15:25:20.408717', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}
2023-12-20T15:32:06.333 DEBUG:teuthology.nuke:shortname: smithi115
2023-12-20T15:32:06.333 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-20T15:32:06.353 DEBUG:teuthology.nuke:shortname: smithi195
2023-12-20T15:32:06.353 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-20T15:32:06.356 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi115.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-20_15:22:54-rados-wip-yuri-testing-2023-12-19-1112-distro-default-smithi/7497909', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-20 15:25:20.407464', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMOzBZHcwM1FlvE9nCLHxNTgZ+jW1Smq8yEWH1M6fEWqcev+Uk9zBQ8Mt+RajST1XmK3xfgQ2a9I9rLMyGsiMvI='}
2023-12-20T15:32:06.374 INFO:teuthology.orchestra.console.smithi049:Power off
2023-12-20T15:32:06.375 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-20T15:32:06.386 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi195.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-20_15:22:54-rados-wip-yuri-testing-2023-12-19-1112-distro-default-smithi/7497909', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-20 15:25:20.405981', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCu0RVq490q7+S8wdStaawJTdinEouTyy4dFL/y+3ygiMQvMH8nB3oiSUW55RM/7rLlfIsWrc7cH59Gr3Bskq/U='}
2023-12-20T15:32:06.396 DEBUG:teuthology.orchestra.console.smithi049:power off output: Chassis Power Control: Down/Off
2023-12-20T15:32:06.396 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T15:32:06.415 INFO:teuthology.orchestra.console.smithi115:Power off
2023-12-20T15:32:06.416 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-20T15:32:06.423 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is on
2023-12-20T15:32:06.436 DEBUG:teuthology.orchestra.console.smithi115:power off output: Chassis Power Control: Down/Off
2023-12-20T15:32:06.436 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T15:32:06.450 INFO:teuthology.orchestra.console.smithi195:Power off
2023-12-20T15:32:06.450 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-20T15:32:06.458 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on
2023-12-20T15:32:06.471 DEBUG:teuthology.orchestra.console.smithi195:power off output: Chassis Power Control: Down/Off
2023-12-20T15:32:06.471 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T15:32:06.492 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on
2023-12-20T15:32:10.424 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T15:32:10.458 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T15:32:10.492 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T15:32:10.533 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is on
2023-12-20T15:32:10.567 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on
2023-12-20T15:32:10.602 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on
2023-12-20T15:32:14.534 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T15:32:14.568 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T15:32:14.603 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T15:32:14.644 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off
2023-12-20T15:32:14.676 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on
2023-12-20T15:32:14.712 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on
2023-12-20T15:32:14.745 INFO:teuthology.orchestra.console.smithi049:Power off completed
2023-12-20T15:32:14.882 INFO:teuthology.lock.ops:unlocked: smithi049.front.sepia.ceph.com
2023-12-20T15:32:18.678 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T15:32:18.713 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T15:32:18.788 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off
2023-12-20T15:32:18.822 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off
2023-12-20T15:32:18.888 INFO:teuthology.orchestra.console.smithi115:Power off completed
2023-12-20T15:32:18.923 INFO:teuthology.orchestra.console.smithi195:Power off completed
2023-12-20T15:32:19.418 INFO:teuthology.lock.ops:unlocked: smithi115.front.sepia.ceph.com
2023-12-20T15:32:19.442 INFO:teuthology.lock.ops:unlocked: smithi195.front.sepia.ceph.com
2023-12-20T15:32:19.738 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology-dispatcher", line 8, in <module>
    sys.exit(main())
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/scripts/dispatcher.py", line 35, in main
    sys.exit(teuthology.dispatcher.main(args))
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/dispatcher/__init__.py", line 69, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/dispatcher/supervisor.py", line 58, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/dispatcher/supervisor.py", line 232, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/provision/fog.py", line 347, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi195's OS to be centos 9 but found ubuntu 22.04