2023-10-30T01:06:56.892 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2
2023-10-30T01:06:56.894 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T01:06:57.032 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f9ddf55ab50>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f9de004b670>, signals=[15])
2023-10-30T01:06:57.033 INFO:teuthology.lock.ops:Start node 'smithi089.front.sepia.ceph.com' reimaging
2023-10-30T01:06:57.034 INFO:teuthology.lock.ops:Updating [smithi089.front.sepia.ceph.com]: reset os type and version on server
2023-10-30T01:06:57.034 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server
2023-10-30T01:06:57.059 INFO:teuthology.lock.ops:Start node 'smithi154.front.sepia.ceph.com' reimaging
2023-10-30T01:06:57.060 INFO:teuthology.lock.ops:Updating [smithi154.front.sepia.ceph.com]: reset os type and version on server
2023-10-30T01:06:57.060 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server
2023-10-30T01:06:57.061 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /host {"name": "smithi089"}
2023-10-30T01:06:57.084 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /host {"name": "smithi154"}
2023-10-30T01:06:57.149 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-10-30T01:06:57.152 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-10-30T01:06:57.187 DEBUG:teuthology.provision.fog.smithi089:Requesting image smithi_centos_9.stream (ID 10)
2023-10-30T01:06:57.187 DEBUG:teuthology.provision.fog.smithi089:FOG request: PUT /host/194 {"imageID": 10}
2023-10-30T01:06:57.194 DEBUG:teuthology.provision.fog.smithi154:Requesting image smithi_centos_9.stream (ID 10)
2023-10-30T01:06:57.194 DEBUG:teuthology.provision.fog.smithi154:FOG request: PUT /host/259 {"imageID": 10}
2023-10-30T01:06:57.236 INFO:teuthology.provision.fog.smithi154:Scheduling deploy of centos 9.stream
2023-10-30T01:06:57.237 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None
2023-10-30T01:06:57.240 INFO:teuthology.provision.fog.smithi089:Scheduling deploy of centos 9.stream
2023-10-30T01:06:57.240 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None
2023-10-30T01:06:57.288 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /tasktype {"name": "deploy"}
2023-10-30T01:06:57.292 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /tasktype {"name": "deploy"}
2023-10-30T01:06:57.331 DEBUG:teuthology.provision.fog.smithi089:FOG request: POST /host/194/task {"taskTypeID": 1}
2023-10-30T01:06:57.339 DEBUG:teuthology.provision.fog.smithi154:FOG request: POST /host/259/task {"taskTypeID": 1}
2023-10-30T01:06:57.395 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None
2023-10-30T01:06:57.398 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None
2023-10-30T01:06:57.487 INFO:teuthology.orchestra.console.smithi089:Power off
2023-10-30T01:06:57.487 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-30T01:06:57.498 INFO:teuthology.orchestra.console.smithi154:Power off
2023-10-30T01:06:57.499 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-30T01:06:57.509 DEBUG:teuthology.orchestra.console.smithi089:power off output: Chassis Power Control: Down/Off
2023-10-30T01:06:57.510 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-30T01:06:57.519 DEBUG:teuthology.orchestra.console.smithi154:power off output: Chassis Power Control: Down/Off
2023-10-30T01:06:57.519 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-30T01:06:57.530 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is on
2023-10-30T01:06:57.540 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on
2023-10-30T01:07:01.535 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-30T01:07:01.542 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-30T01:07:01.644 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is on
2023-10-30T01:07:01.651 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on
2023-10-30T01:07:05.649 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-30T01:07:05.657 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-30T01:07:05.759 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is on
2023-10-30T01:07:05.766 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off
2023-10-30T01:07:05.867 INFO:teuthology.orchestra.console.smithi154:Power off completed
2023-10-30T01:07:05.968 INFO:teuthology.orchestra.console.smithi154:Power on
2023-10-30T01:07:05.968 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-10-30T01:07:05.992 DEBUG:teuthology.orchestra.console.smithi154:power on output: Chassis Power Control: Up/On
2023-10-30T01:07:05.992 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-30T01:07:06.013 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off
2023-10-30T01:07:09.762 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-30T01:07:09.871 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is off
2023-10-30T01:07:09.972 INFO:teuthology.orchestra.console.smithi089:Power off completed
2023-10-30T01:07:10.014 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-30T01:07:10.074 INFO:teuthology.orchestra.console.smithi089:Power on
2023-10-30T01:07:10.075 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-10-30T01:07:10.097 DEBUG:teuthology.orchestra.console.smithi089:power on output: Chassis Power Control: Up/On
2023-10-30T01:07:10.097 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-30T01:07:10.118 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is off
2023-10-30T01:07:10.123 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on
2023-10-30T01:07:10.223 INFO:teuthology.orchestra.console.smithi154:Power on completed
2023-10-30T01:07:10.324 INFO:teuthology.provision.fog.smithi154:Waiting for deploy to finish
2023-10-30T01:07:10.325 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None
2023-10-30T01:07:14.122 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-30T01:07:14.231 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is off
2023-10-30T01:07:18.234 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-30T01:07:18.397 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is on
2023-10-30T01:07:18.498 INFO:teuthology.orchestra.console.smithi089:Power on completed
2023-10-30T01:07:18.599 INFO:teuthology.provision.fog.smithi089:Waiting for deploy to finish
2023-10-30T01:07:18.600 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None
2023-10-30T01:07:25.398 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None
2023-10-30T01:07:33.662 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None
2023-10-30T01:07:40.466 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None
2023-10-30T01:07:48.742 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None
2023-10-30T01:07:55.546 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None
2023-10-30T01:08:03.834 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None
2023-10-30T01:08:10.626 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None
2023-10-30T01:08:18.906 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None
2023-10-30T01:08:25.710 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None
2023-10-30T01:08:33.983 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None
2023-10-30T01:08:40.796 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None
2023-10-30T01:08:49.054 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None
2023-10-30T01:08:55.882 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None
2023-10-30T01:09:04.120 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None
2023-10-30T01:09:10.962 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None
2023-10-30T01:09:19.197 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None
2023-10-30T01:09:26.050 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None
2023-10-30T01:09:34.272 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None
2023-10-30T01:09:41.118 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None
2023-10-30T01:09:49.358 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None
2023-10-30T01:09:49.423 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-30T01:09:49.673 ERROR:teuthology.orchestra.connection:Error authenticating with smithi089.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-10-30T01:09:56.196 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None
2023-10-30T01:09:56.270 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-30T01:10:14.650 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154
2023-10-30T01:10:20.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-30T01:10:23.710 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154
2023-10-30T01:10:29.711 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-30T01:10:32.766 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154
2023-10-30T01:10:38.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-30T01:10:41.822 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154
2023-10-30T01:10:47.824 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-30T01:10:50.874 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154
2023-10-30T01:10:53.677 WARNING:teuthology.provision.fog.smithi089:timed out
2023-10-30T01:10:56.876 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-30T01:10:59.679 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-30T01:11:18.138 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89
2023-10-30T01:11:24.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-30T01:11:27.194 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89
2023-10-30T01:11:33.196 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-30T01:11:33.529 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-10-30T01:11:33.531 DEBUG:teuthology.orchestra.run.smithi089:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-10-30T01:11:53.850 INFO:teuthology.provision.fog.smithi089:Node is ready
2023-10-30T01:11:53.851 DEBUG:teuthology.orchestra.run.smithi089:> hostname
2023-10-30T01:11:53.869 INFO:teuthology.orchestra.run.smithi089.stdout:smithi089.front.sepia.ceph.com
2023-10-30T01:11:53.870 DEBUG:teuthology.orchestra.run.smithi089:> grep smithi089.front.sepia.ceph.com /etc/hosts
2023-10-30T01:11:53.926 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89 smithi089.front.sepia.ceph.com smithi089
2023-10-30T01:11:53.927 DEBUG:teuthology.orchestra.run.smithi089:> sudo hostname smithi089
2023-10-30T01:11:54.058 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i -e 's/smithi089.front.sepia.ceph.com/smithi089/g' /etc/hosts
2023-10-30T01:11:54.087 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i -e 's/172.21.15.89/172.21.15.89/g' /etc/hosts
2023-10-30T01:11:54.156 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i -e 's/smithi089.front.sepia.ceph.com/smithi089/g' /etc/hostname
2023-10-30T01:11:54.225 DEBUG:teuthology.orchestra.run.smithi089:> sudo hostname smithi089
2023-10-30T01:11:54.293 DEBUG:teuthology.orchestra.run.smithi089:> cat /etc/os-release
2023-10-30T01:11:54.348 INFO:teuthology.orchestra.run.smithi089.stdout:NAME="CentOS Stream"
2023-10-30T01:11:54.349 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION="9"
2023-10-30T01:11:54.349 INFO:teuthology.orchestra.run.smithi089.stdout:ID="centos"
2023-10-30T01:11:54.349 INFO:teuthology.orchestra.run.smithi089.stdout:ID_LIKE="rhel fedora"
2023-10-30T01:11:54.349 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_ID="9"
2023-10-30T01:11:54.349 INFO:teuthology.orchestra.run.smithi089.stdout:PLATFORM_ID="platform:el9"
2023-10-30T01:11:54.350 INFO:teuthology.orchestra.run.smithi089.stdout:PRETTY_NAME="CentOS Stream 9"
2023-10-30T01:11:54.350 INFO:teuthology.orchestra.run.smithi089.stdout:ANSI_COLOR="0;31"
2023-10-30T01:11:54.350 INFO:teuthology.orchestra.run.smithi089.stdout:LOGO="fedora-logo-icon"
2023-10-30T01:11:54.350 INFO:teuthology.orchestra.run.smithi089.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-10-30T01:11:54.350 INFO:teuthology.orchestra.run.smithi089.stdout:HOME_URL="https://centos.org/"
2023-10-30T01:11:54.350 INFO:teuthology.orchestra.run.smithi089.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-30T01:11:54.351 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-10-30T01:11:54.351 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-10-30T01:11:54.351 INFO:teuthology.provision.fog.smithi089:Deploy complete!
2023-10-30T01:11:54.353 DEBUG:teuthology.parallel:result is None
2023-10-30T01:11:56.878 WARNING:teuthology.provision.fog.smithi154:timed out
2023-10-30T01:12:02.880 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-30T01:12:03.150 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-10-30T01:12:03.151 DEBUG:teuthology.orchestra.run.smithi154:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-10-30T01:12:03.470 INFO:teuthology.provision.fog.smithi154:Node is ready
2023-10-30T01:12:03.470 DEBUG:teuthology.orchestra.run.smithi154:> hostname
2023-10-30T01:12:03.485 INFO:teuthology.orchestra.run.smithi154.stdout:smithi154.front.sepia.ceph.com
2023-10-30T01:12:03.485 DEBUG:teuthology.orchestra.run.smithi154:> grep smithi154.front.sepia.ceph.com /etc/hosts
2023-10-30T01:12:03.540 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.15.154 smithi154.front.sepia.ceph.com smithi154
2023-10-30T01:12:03.540 DEBUG:teuthology.orchestra.run.smithi154:> sudo hostname smithi154
2023-10-30T01:12:03.644 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i -e 's/smithi154.front.sepia.ceph.com/smithi154/g' /etc/hosts
2023-10-30T01:12:03.673 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i -e 's/172.21.15.154/172.21.15.154/g' /etc/hosts
2023-10-30T01:12:03.742 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i -e 's/smithi154.front.sepia.ceph.com/smithi154/g' /etc/hostname
2023-10-30T01:12:03.809 DEBUG:teuthology.orchestra.run.smithi154:> sudo hostname smithi154
2023-10-30T01:12:03.876 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release
2023-10-30T01:12:03.930 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="CentOS Stream"
2023-10-30T01:12:03.930 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="9"
2023-10-30T01:12:03.930 INFO:teuthology.orchestra.run.smithi154.stdout:ID="centos"
2023-10-30T01:12:03.931 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE="rhel fedora"
2023-10-30T01:12:03.931 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="9"
2023-10-30T01:12:03.931 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM_ID="platform:el9"
2023-10-30T01:12:03.931 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="CentOS Stream 9"
2023-10-30T01:12:03.931 INFO:teuthology.orchestra.run.smithi154.stdout:ANSI_COLOR="0;31"
2023-10-30T01:12:03.932 INFO:teuthology.orchestra.run.smithi154.stdout:LOGO="fedora-logo-icon"
2023-10-30T01:12:03.932 INFO:teuthology.orchestra.run.smithi154.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-10-30T01:12:03.932 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://centos.org/"
2023-10-30T01:12:03.932 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-30T01:12:03.932 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-10-30T01:12:03.933 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-10-30T01:12:03.933 INFO:teuthology.provision.fog.smithi154:Deploy complete!
2023-10-30T01:12:03.934 DEBUG:teuthology.parallel:result is None
2023-10-30T01:12:04.110 INFO:teuthology.lock.ops:Checking smithi089.front.sepia.ceph.com
2023-10-30T01:12:04.110 INFO:teuthology.lock.ops:New key found. Updating...
2023-10-30T01:12:04.138 INFO:teuthology.lock.ops:Checking smithi154.front.sepia.ceph.com
2023-10-30T01:12:04.139 INFO:teuthology.lock.ops:New key found. Updating...
2023-10-30T01:12:04.156 INFO:teuthology.lock.ops:Updating [smithi089.front.sepia.ceph.com]: set os type and version on server
2023-10-30T01:12:04.156 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com'
2023-10-30T01:12:04.157 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-30T01:12:04.240 DEBUG:teuthology.orchestra.run.smithi089:> true
2023-10-30T01:12:04.310 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi089.front.sepia.ceph.com'
2023-10-30T01:12:04.310 DEBUG:teuthology.orchestra.run.smithi089:> uname -m
2023-10-30T01:12:04.366 INFO:teuthology.orchestra.run.smithi089.stdout:x86_64
2023-10-30T01:12:04.367 DEBUG:teuthology.orchestra.run.smithi089:> cat /etc/os-release
2023-10-30T01:12:04.421 INFO:teuthology.orchestra.run.smithi089.stdout:NAME="CentOS Stream"
2023-10-30T01:12:04.422 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION="9"
2023-10-30T01:12:04.422 INFO:teuthology.orchestra.run.smithi089.stdout:ID="centos"
2023-10-30T01:12:04.422 INFO:teuthology.orchestra.run.smithi089.stdout:ID_LIKE="rhel fedora"
2023-10-30T01:12:04.423 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_ID="9"
2023-10-30T01:12:04.423 INFO:teuthology.orchestra.run.smithi089.stdout:PLATFORM_ID="platform:el9"
2023-10-30T01:12:04.423 INFO:teuthology.orchestra.run.smithi089.stdout:PRETTY_NAME="CentOS Stream 9"
2023-10-30T01:12:04.423 INFO:teuthology.orchestra.run.smithi089.stdout:ANSI_COLOR="0;31"
2023-10-30T01:12:04.423 INFO:teuthology.orchestra.run.smithi089.stdout:LOGO="fedora-logo-icon"
2023-10-30T01:12:04.424 INFO:teuthology.orchestra.run.smithi089.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-10-30T01:12:04.424 INFO:teuthology.orchestra.run.smithi089.stdout:HOME_URL="https://centos.org/"
2023-10-30T01:12:04.424 INFO:teuthology.orchestra.run.smithi089.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-30T01:12:04.424 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-10-30T01:12:04.424 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-10-30T01:12:04.425 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server
2023-10-30T01:12:04.447 INFO:teuthology.lock.ops:Updating [smithi154.front.sepia.ceph.com]: set os type and version on server
2023-10-30T01:12:04.447 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com'
2023-10-30T01:12:04.448 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-30T01:12:04.531 DEBUG:teuthology.orchestra.run.smithi154:> true
2023-10-30T01:12:04.596 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi154.front.sepia.ceph.com'
2023-10-30T01:12:04.596 DEBUG:teuthology.orchestra.run.smithi154:> uname -m
2023-10-30T01:12:04.650 INFO:teuthology.orchestra.run.smithi154.stdout:x86_64
2023-10-30T01:12:04.650 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release
2023-10-30T01:12:04.703 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="CentOS Stream"
2023-10-30T01:12:04.704 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="9"
2023-10-30T01:12:04.704 INFO:teuthology.orchestra.run.smithi154.stdout:ID="centos"
2023-10-30T01:12:04.704 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE="rhel fedora"
2023-10-30T01:12:04.704 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="9"
2023-10-30T01:12:04.704 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM_ID="platform:el9"
2023-10-30T01:12:04.705 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="CentOS Stream 9"
2023-10-30T01:12:04.705 INFO:teuthology.orchestra.run.smithi154.stdout:ANSI_COLOR="0;31"
2023-10-30T01:12:04.705 INFO:teuthology.orchestra.run.smithi154.stdout:LOGO="fedora-logo-icon"
2023-10-30T01:12:04.705 INFO:teuthology.orchestra.run.smithi154.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-10-30T01:12:04.705 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://centos.org/"
2023-10-30T01:12:04.706 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-30T01:12:04.706 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-10-30T01:12:04.706 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-10-30T01:12:04.707 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server
2023-10-30T01:12:04.730 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T01:12:04.826 INFO:teuthology.dispatcher.supervisor:Running job 7440393
2023-10-30T01:12:04.827 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-10-29_15:56:10-rados-main-distro-default-smithi/7440393 --name yuriw-2023-10-29_15:56:10-rados-main-distro-default-smithi --description rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-radosbench} -- /home/teuthworker/archive/yuriw-2023-10-29_15:56:10-rados-main-distro-default-smithi/7440393/orig.config.yaml
2023-10-30T01:12:04.830 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-10-29_15:56:10-rados-main-distro-default-smithi/7440393
2023-10-30T01:12:04.831 INFO:teuthology.dispatcher.supervisor:Job PID: 2108958
2023-10-30T01:12:04.831 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-10-30T01:14:04.832 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T01:16:04.919 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T01:18:04.984 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T01:20:05.058 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T01:22:05.133 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T01:24:05.206 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T01:26:05.277 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T01:28:05.350 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T01:30:05.414 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T01:32:05.488 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T01:34:05.563 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T01:36:05.636 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T01:38:05.710 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T01:40:05.784 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T01:42:05.857 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T01:44:05.930 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T01:46:06.000 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T01:48:06.073 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T01:50:06.141 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T01:52:06.212 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T01:54:06.295 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T01:56:06.358 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T01:58:06.432 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T02:00:06.510 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T02:02:06.584 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T02:04:06.658 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T02:06:06.726 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T02:08:06.799 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T02:10:06.885 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T02:12:06.956 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T02:14:07.030 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T02:16:07.105 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T02:18:07.185 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T02:20:07.249 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T02:22:07.315 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T02:24:07.386 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T02:26:07.450 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T02:28:07.514 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T02:30:07.581 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T02:32:07.689 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T02:34:07.760 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T02:36:07.826 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T02:38:07.891 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T02:40:07.948 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T02:42:08.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T02:44:08.087 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T02:46:08.170 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T02:48:08.243 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T02:50:08.316 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T02:52:08.380 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T02:54:08.443 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T02:56:08.510 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T02:58:08.581 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T03:00:08.647 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T03:02:08.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T03:04:08.792 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T03:06:08.859 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T03:08:08.931 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T03:10:09.007 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T03:12:09.078 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T03:14:09.150 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T03:16:09.216 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T03:18:09.288 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T03:20:09.364 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T03:22:09.436 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T03:24:09.507 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T03:26:09.573 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T03:28:09.645 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T03:30:09.711 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T03:32:09.778 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T03:34:09.843 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-30T03:34:09.914 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-10-30T03:34:10.096 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-10-30T03:34:10.097 INFO:teuthology.nuke:Checking targets against current locks
2023-10-30T03:34:10.148 DEBUG:teuthology.nuke:shortname: smithi089
2023-10-30T03:34:10.148 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-10-30T03:34:10.173 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi089.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-29_15:56:10-rados-main-distro-default-smithi/7440393', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-30 01:06:56.012256', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIkVzFEoRZwJSni7ihUeO22e+hDeCdo60RonK3hsTkD+64wtXKJH/VL9Ns9qbV7/5/IBDe5SYLmxc0Ptmg9iyek='}
2023-10-30T03:34:10.176 DEBUG:teuthology.nuke:shortname: smithi154
2023-10-30T03:34:10.177 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-10-30T03:34:10.202 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi154.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-29_15:56:10-rados-main-distro-default-smithi/7440393', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-30 01:06:56.013864', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN5RxaIrOpAust8zT5FhAP3vLCN6GmGTWtiSH0lObESREKWj8VhWrbAtcLc2BLydEBZDk97L+rLr5CkX0gpcQPY='}
2023-10-30T03:34:10.228 INFO:teuthology.orchestra.console.smithi089:Power off
2023-10-30T03:34:10.229 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-30T03:34:10.249 DEBUG:teuthology.orchestra.console.smithi089:power off output: Chassis Power Control: Down/Off
2023-10-30T03:34:10.250 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-30T03:34:10.266 INFO:teuthology.orchestra.console.smithi154:Power off
2023-10-30T03:34:10.266 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-30T03:34:10.274 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is off
2023-10-30T03:34:10.286 DEBUG:teuthology.orchestra.console.smithi154:power off output: Chassis Power Control: Down/Off
2023-10-30T03:34:10.286 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-30T03:34:10.308 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off
2023-10-30T03:34:10.375 INFO:teuthology.orchestra.console.smithi089:Power off completed
2023-10-30T03:34:10.410 INFO:teuthology.orchestra.console.smithi154:Power off completed
2023-10-30T03:34:10.522 INFO:teuthology.lock.ops:unlocked: smithi089.front.sepia.ceph.com
2023-10-30T03:34:10.556 INFO:teuthology.lock.ops:unlocked: smithi154.front.sepia.ceph.com