2024-01-27T05:20:24.407 INFO:root:teuthology version: 0.0.1.dev251+gc856e0f
2024-01-27T05:20:24.408 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T05:20:24.550 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fdd7419bf70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fdd75201c10>, signals=[15])
2024-01-27T05:20:24.551 INFO:teuthology.lock.ops:Start node 'smithi161.front.sepia.ceph.com' reimaging
2024-01-27T05:20:24.551 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: reset os type and version on server
2024-01-27T05:20:24.551 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server
2024-01-27T05:20:24.567 INFO:teuthology.lock.ops:Start node 'smithi196.front.sepia.ceph.com' reimaging
2024-01-27T05:20:24.567 INFO:teuthology.lock.ops:Updating [smithi196.front.sepia.ceph.com]: reset os type and version on server
2024-01-27T05:20:24.567 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server
2024-01-27T05:20:24.681 DEBUG:teuthology.provision.fog.smithi161:Requesting image smithi_centos_9.stream (ID 10)
2024-01-27T05:20:24.688 DEBUG:teuthology.provision.fog.smithi196:Requesting image smithi_centos_9.stream (ID 10)
2024-01-27T05:20:24.725 INFO:teuthology.provision.fog.smithi161:Scheduling deploy of centos 9.stream
2024-01-27T05:20:24.729 INFO:teuthology.provision.fog.smithi196:Scheduling deploy of centos 9.stream
2024-01-27T05:20:25.014 INFO:teuthology.orchestra.console.smithi161:Power off
2024-01-27T05:20:25.015 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-27T05:20:25.026 INFO:teuthology.orchestra.console.smithi196:Power off
2024-01-27T05:20:25.027 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-27T05:20:25.038 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off
2024-01-27T05:20:25.038 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-27T05:20:25.049 DEBUG:teuthology.orchestra.console.smithi196:power off output: Chassis Power Control: Down/Off
2024-01-27T05:20:25.049 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-27T05:20:25.058 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off
2024-01-27T05:20:25.070 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off
2024-01-27T05:20:25.159 INFO:teuthology.orchestra.console.smithi161:Power off completed
2024-01-27T05:20:25.170 INFO:teuthology.orchestra.console.smithi196:Power off completed
2024-01-27T05:20:25.261 INFO:teuthology.orchestra.console.smithi161:Power on
2024-01-27T05:20:25.261 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-27T05:20:25.271 INFO:teuthology.orchestra.console.smithi196:Power on
2024-01-27T05:20:25.272 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-27T05:20:25.282 DEBUG:teuthology.orchestra.console.smithi161:power on output: Chassis Power Control: Up/On
2024-01-27T05:20:25.283 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-27T05:20:25.297 DEBUG:teuthology.orchestra.console.smithi196:power on output: Chassis Power Control: Up/On
2024-01-27T05:20:25.297 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-27T05:20:25.306 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off
2024-01-27T05:20:25.319 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off
2024-01-27T05:20:29.308 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-27T05:20:29.319 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-27T05:20:29.417 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off
2024-01-27T05:20:29.428 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off
2024-01-27T05:20:33.420 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-27T05:20:33.428 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-27T05:20:33.530 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on
2024-01-27T05:20:33.593 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on
2024-01-27T05:20:33.631 INFO:teuthology.orchestra.console.smithi161:Power on completed
2024-01-27T05:20:33.694 INFO:teuthology.orchestra.console.smithi196:Power on completed
2024-01-27T05:20:33.732 INFO:teuthology.provision.fog.smithi161:Waiting for deploy to finish
2024-01-27T05:20:33.795 INFO:teuthology.provision.fog.smithi196:Waiting for deploy to finish
2024-01-27T05:23:04.925 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T05:23:07.996 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2024-01-27T05:23:14.003 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T05:23:17.084 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2024-01-27T05:23:20.002 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T05:23:23.068 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2024-01-27T05:23:23.085 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T05:23:26.140 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2024-01-27T05:23:29.072 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T05:23:32.124 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2024-01-27T05:23:32.141 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T05:23:35.197 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2024-01-27T05:23:38.128 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T05:23:41.180 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2024-01-27T05:23:41.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T05:23:44.252 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2024-01-27T05:23:47.184 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T05:23:50.236 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2024-01-27T05:23:50.254 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T05:23:53.308 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2024-01-27T05:23:56.240 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T05:23:59.292 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2024-01-27T05:23:59.310 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T05:24:02.364 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2024-01-27T05:24:05.296 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T05:24:08.352 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2024-01-27T05:24:08.365 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T05:24:14.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T05:24:17.436 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2024-01-27T05:24:23.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T05:25:08.412 WARNING:teuthology.provision.fog.smithi196:timed out
2024-01-27T05:25:14.417 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T05:25:14.648 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-27T05:25:14.648 DEBUG:teuthology.orchestra.run.smithi196:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-27T05:25:14.970 INFO:teuthology.provision.fog.smithi196:Node is ready
2024-01-27T05:25:14.971 DEBUG:teuthology.orchestra.run.smithi196:> hostname
2024-01-27T05:25:14.985 INFO:teuthology.orchestra.run.smithi196.stdout:smithi196.front.sepia.ceph.com
2024-01-27T05:25:14.986 DEBUG:teuthology.orchestra.run.smithi196:> grep smithi196.front.sepia.ceph.com /etc/hosts
2024-01-27T05:25:15.041 INFO:teuthology.orchestra.run.smithi196.stdout:172.21.15.196 smithi196.front.sepia.ceph.com smithi196
2024-01-27T05:25:15.042 DEBUG:teuthology.orchestra.run.smithi196:> sudo hostname smithi196
2024-01-27T05:25:15.153 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/smithi196.front.sepia.ceph.com/smithi196/g' /etc/hosts
2024-01-27T05:25:15.181 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/172.21.15.196/172.21.15.196/g' /etc/hosts
2024-01-27T05:25:15.249 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/smithi196.front.sepia.ceph.com/smithi196/g' /etc/hostname
2024-01-27T05:25:15.316 DEBUG:teuthology.orchestra.run.smithi196:> sudo hostname smithi196
2024-01-27T05:25:15.382 DEBUG:teuthology.orchestra.run.smithi196:> cat /etc/os-release
2024-01-27T05:25:15.436 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="CentOS Stream"
2024-01-27T05:25:15.436 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="9"
2024-01-27T05:25:15.436 INFO:teuthology.orchestra.run.smithi196.stdout:ID="centos"
2024-01-27T05:25:15.436 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE="rhel fedora"
2024-01-27T05:25:15.436 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="9"
2024-01-27T05:25:15.436 INFO:teuthology.orchestra.run.smithi196.stdout:PLATFORM_ID="platform:el9"
2024-01-27T05:25:15.437 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="CentOS Stream 9"
2024-01-27T05:25:15.437 INFO:teuthology.orchestra.run.smithi196.stdout:ANSI_COLOR="0;31"
2024-01-27T05:25:15.437 INFO:teuthology.orchestra.run.smithi196.stdout:LOGO="fedora-logo-icon"
2024-01-27T05:25:15.437 INFO:teuthology.orchestra.run.smithi196.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-01-27T05:25:15.437 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://centos.org/"
2024-01-27T05:25:15.437 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-27T05:25:15.437 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-01-27T05:25:15.437 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-27T05:25:15.438 INFO:teuthology.provision.fog.smithi196:Deploy complete!
2024-01-27T05:25:15.439 DEBUG:teuthology.parallel:result is None
2024-01-27T05:25:23.448 WARNING:teuthology.provision.fog.smithi161:timed out
2024-01-27T05:25:29.453 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T05:25:29.826 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-27T05:25:29.826 DEBUG:teuthology.orchestra.run.smithi161:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-27T05:25:30.132 INFO:teuthology.provision.fog.smithi161:Node is ready
2024-01-27T05:25:30.132 DEBUG:teuthology.orchestra.run.smithi161:> hostname
2024-01-27T05:25:30.147 INFO:teuthology.orchestra.run.smithi161.stdout:smithi161.front.sepia.ceph.com
2024-01-27T05:25:30.147 DEBUG:teuthology.orchestra.run.smithi161:> grep smithi161.front.sepia.ceph.com /etc/hosts
2024-01-27T05:25:30.202 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.15.161 smithi161.front.sepia.ceph.com smithi161
2024-01-27T05:25:30.202 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161
2024-01-27T05:25:30.304 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hosts
2024-01-27T05:25:30.331 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/172.21.15.161/172.21.15.161/g' /etc/hosts
2024-01-27T05:25:30.398 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hostname
2024-01-27T05:25:30.466 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161
2024-01-27T05:25:30.532 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release
2024-01-27T05:25:30.586 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream"
2024-01-27T05:25:30.586 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="9"
2024-01-27T05:25:30.586 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos"
2024-01-27T05:25:30.586 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora"
2024-01-27T05:25:30.586 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="9"
2024-01-27T05:25:30.587 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el9"
2024-01-27T05:25:30.587 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 9"
2024-01-27T05:25:30.587 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31"
2024-01-27T05:25:30.587 INFO:teuthology.orchestra.run.smithi161.stdout:LOGO="fedora-logo-icon"
2024-01-27T05:25:30.587 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-01-27T05:25:30.587 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/"
2024-01-27T05:25:30.587 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-27T05:25:30.587 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-01-27T05:25:30.587 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-27T05:25:30.587 INFO:teuthology.provision.fog.smithi161:Deploy complete!
2024-01-27T05:25:30.588 DEBUG:teuthology.parallel:result is None
2024-01-27T05:25:30.756 INFO:teuthology.lock.ops:Checking smithi161.front.sepia.ceph.com
2024-01-27T05:25:30.757 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-27T05:25:30.776 INFO:teuthology.lock.ops:Checking smithi196.front.sepia.ceph.com
2024-01-27T05:25:30.776 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-27T05:25:30.794 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: set os type and version on server
2024-01-27T05:25:30.794 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com'
2024-01-27T05:25:30.795 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T05:25:30.889 DEBUG:teuthology.orchestra.run.smithi161:> true
2024-01-27T05:25:30.954 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com'
2024-01-27T05:25:30.954 DEBUG:teuthology.orchestra.run.smithi161:> uname -m
2024-01-27T05:25:31.008 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64
2024-01-27T05:25:31.008 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release
2024-01-27T05:25:31.062 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream"
2024-01-27T05:25:31.062 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="9"
2024-01-27T05:25:31.062 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos"
2024-01-27T05:25:31.062 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora"
2024-01-27T05:25:31.062 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="9"
2024-01-27T05:25:31.062 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el9"
2024-01-27T05:25:31.062 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 9"
2024-01-27T05:25:31.063 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31"
2024-01-27T05:25:31.063 INFO:teuthology.orchestra.run.smithi161.stdout:LOGO="fedora-logo-icon"
2024-01-27T05:25:31.063 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-01-27T05:25:31.063 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/"
2024-01-27T05:25:31.063 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-27T05:25:31.063 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-01-27T05:25:31.063 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-27T05:25:31.064 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server
2024-01-27T05:25:31.085 INFO:teuthology.lock.ops:Updating [smithi196.front.sepia.ceph.com]: set os type and version on server
2024-01-27T05:25:31.085 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com'
2024-01-27T05:25:31.085 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T05:25:31.174 DEBUG:teuthology.orchestra.run.smithi196:> true
2024-01-27T05:25:31.342 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi196.front.sepia.ceph.com'
2024-01-27T05:25:31.342 DEBUG:teuthology.orchestra.run.smithi196:> uname -m
2024-01-27T05:25:31.397 INFO:teuthology.orchestra.run.smithi196.stdout:x86_64
2024-01-27T05:25:31.397 DEBUG:teuthology.orchestra.run.smithi196:> cat /etc/os-release
2024-01-27T05:25:31.452 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="CentOS Stream"
2024-01-27T05:25:31.452 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="9"
2024-01-27T05:25:31.452 INFO:teuthology.orchestra.run.smithi196.stdout:ID="centos"
2024-01-27T05:25:31.452 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE="rhel fedora"
2024-01-27T05:25:31.453 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="9"
2024-01-27T05:25:31.453 INFO:teuthology.orchestra.run.smithi196.stdout:PLATFORM_ID="platform:el9"
2024-01-27T05:25:31.453 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="CentOS Stream 9"
2024-01-27T05:25:31.453 INFO:teuthology.orchestra.run.smithi196.stdout:ANSI_COLOR="0;31"
2024-01-27T05:25:31.453 INFO:teuthology.orchestra.run.smithi196.stdout:LOGO="fedora-logo-icon"
2024-01-27T05:25:31.453 INFO:teuthology.orchestra.run.smithi196.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-01-27T05:25:31.453 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://centos.org/"
2024-01-27T05:25:31.453 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-27T05:25:31.453 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-01-27T05:25:31.453 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-27T05:25:31.454 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server
2024-01-27T05:25:31.477 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T05:25:31.592 INFO:teuthology.dispatcher.supervisor:Running job 7533809
2024-01-27T05:25:31.593 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-01-26_01:08:12-rados-wip-yuri2-testing-2024-01-25-1327-reef-distro-default-smithi/7533809 --name yuriw-2024-01-26_01:08:12-rados-wip-yuri2-testing-2024-01-25-1327-reef-distro-default-smithi --description rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados tasks/rados_api_tests validater/valgrind} -- /home/teuthworker/archive/yuriw-2024-01-26_01:08:12-rados-wip-yuri2-testing-2024-01-25-1327-reef-distro-default-smithi/7533809/orig.config.yaml
2024-01-27T05:25:31.596 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-01-26_01:08:12-rados-wip-yuri2-testing-2024-01-25-1327-reef-distro-default-smithi/7533809
2024-01-27T05:25:31.596 INFO:teuthology.dispatcher.supervisor:Job PID: 2004296
2024-01-27T05:25:31.596 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-01-27T05:27:31.696 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T05:29:31.865 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T05:31:32.035 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T05:33:32.209 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T05:35:32.378 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T05:37:32.524 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T05:39:32.688 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T05:41:32.852 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T05:43:33.016 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T05:45:33.190 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T05:47:33.370 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T05:49:33.600 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T05:51:33.764 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T05:53:33.945 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T05:55:34.079 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T05:57:34.238 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T05:59:34.404 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T06:01:34.581 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T06:03:34.756 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T06:05:34.932 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T06:07:35.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T06:09:35.277 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T06:11:35.452 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T06:13:35.628 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T06:15:35.800 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T06:17:35.968 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T06:19:36.136 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T06:21:36.304 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T06:23:36.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T06:25:36.685 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T06:27:36.854 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T06:29:37.038 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T06:31:37.201 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T06:33:37.358 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T06:35:37.491 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T06:37:37.659 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T06:39:37.832 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T06:39:37.895 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2024-01-27T06:39:38.074 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2024-01-27T06:39:38.074 INFO:teuthology.nuke:Checking targets against current locks
2024-01-27T06:39:38.117 DEBUG:teuthology.nuke:shortname: smithi161
2024-01-27T06:39:38.117 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-27T06:39:38.139 DEBUG:teuthology.nuke:shortname: smithi196
2024-01-27T06:39:38.139 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-27T06:39:38.142 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi161.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-26_01:08:12-rados-wip-yuri2-testing-2024-01-25-1327-reef-distro-default-smithi/7533809', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-27 05:20:23.254537', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKs+ia1tPRscqUzcxPKuwoaFK0eluh679GbwuUekHk5hy9s6xqWFHt107iN0yMq5YBg1/Qf0AKZcAcLeqY6QUZs='}
2024-01-27T06:39:38.162 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi196.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-26_01:08:12-rados-wip-yuri2-testing-2024-01-25-1327-reef-distro-default-smithi/7533809', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-27 05:20:23.252979', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAO+BYIBaqJNGfluxVTAcs9PW4skTwXXW0Jfepj38MtuapVXOrUI/9kapLRQGBsTHIYDe3xt949ySn0D3Uywnjk='}
2024-01-27T06:39:38.192 INFO:teuthology.orchestra.console.smithi161:Power off
2024-01-27T06:39:38.192 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-27T06:39:38.214 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off
2024-01-27T06:39:38.214 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-27T06:39:38.227 INFO:teuthology.orchestra.console.smithi196:Power off
2024-01-27T06:39:38.228 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-27T06:39:38.235 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off
2024-01-27T06:39:38.248 DEBUG:teuthology.orchestra.console.smithi196:power off output: Chassis Power Control: Down/Off
2024-01-27T06:39:38.248 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-27T06:39:38.269 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off
2024-01-27T06:39:38.336 INFO:teuthology.orchestra.console.smithi161:Power off completed
2024-01-27T06:39:38.370 INFO:teuthology.orchestra.console.smithi196:Power off completed
2024-01-27T06:39:38.485 INFO:teuthology.lock.ops:unlocked: smithi161.front.sepia.ceph.com
2024-01-27T06:39:38.519 INFO:teuthology.lock.ops:unlocked: smithi196.front.sepia.ceph.com