2023-11-09T02:48:00.264 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2
2023-11-09T02:48:00.265 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T02:48:00.413 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f765141baf0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f7650cd9ee0>, signals=[15])
2023-11-09T02:48:00.415 INFO:teuthology.lock.ops:Start node 'smithi038.front.sepia.ceph.com' reimaging
2023-11-09T02:48:00.415 INFO:teuthology.lock.ops:Updating [smithi038.front.sepia.ceph.com]: reset os type and version on server
2023-11-09T02:48:00.416 INFO:teuthology.lock.ops:Updating smithi038.front.sepia.ceph.com on lock server
2023-11-09T02:48:00.437 INFO:teuthology.lock.ops:Start node 'smithi080.front.sepia.ceph.com' reimaging
2023-11-09T02:48:00.438 INFO:teuthology.lock.ops:Updating [smithi080.front.sepia.ceph.com]: reset os type and version on server
2023-11-09T02:48:00.438 INFO:teuthology.lock.ops:Updating smithi080.front.sepia.ceph.com on lock server
2023-11-09T02:48:00.440 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /host {"name": "smithi038"}
2023-11-09T02:48:00.463 DEBUG:teuthology.provision.fog.smithi080:FOG request: GET /host {"name": "smithi080"}
2023-11-09T02:48:00.525 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-11-09T02:48:00.532 DEBUG:teuthology.provision.fog.smithi080:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-11-09T02:48:00.568 DEBUG:teuthology.provision.fog.smithi038:Requesting image smithi_centos_8.stream (ID 3)
2023-11-09T02:48:00.569 DEBUG:teuthology.provision.fog.smithi038:FOG request: PUT /host/143 {"imageID": 3}
2023-11-09T02:48:00.574 DEBUG:teuthology.provision.fog.smithi080:Requesting image smithi_centos_8.stream (ID 3)
2023-11-09T02:48:00.574 DEBUG:teuthology.provision.fog.smithi080:FOG request: PUT /host/185 {"imageID": 3}
2023-11-09T02:48:00.631 INFO:teuthology.provision.fog.smithi080:Scheduling deploy of centos 8.stream
2023-11-09T02:48:00.632 DEBUG:teuthology.provision.fog.smithi080:FOG request: GET /task/active None
2023-11-09T02:48:00.633 INFO:teuthology.provision.fog.smithi038:Scheduling deploy of centos 8.stream
2023-11-09T02:48:00.633 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None
2023-11-09T02:48:00.715 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /tasktype {"name": "deploy"}
2023-11-09T02:48:00.719 DEBUG:teuthology.provision.fog.smithi080:FOG request: GET /tasktype {"name": "deploy"}
2023-11-09T02:48:00.760 DEBUG:teuthology.provision.fog.smithi080:FOG request: POST /host/185/task {"taskTypeID": 1}
2023-11-09T02:48:00.765 DEBUG:teuthology.provision.fog.smithi038:FOG request: POST /host/143/task {"taskTypeID": 1}
2023-11-09T02:48:00.815 DEBUG:teuthology.provision.fog.smithi080:FOG request: GET /task/active None
2023-11-09T02:48:00.822 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None
2023-11-09T02:48:00.936 INFO:teuthology.orchestra.console.smithi038:Power off
2023-11-09T02:48:00.937 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-09T02:48:00.951 INFO:teuthology.orchestra.console.smithi080:Power off
2023-11-09T02:48:00.952 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-09T02:48:00.963 DEBUG:teuthology.orchestra.console.smithi038:power off output: Chassis Power Control: Down/Off
2023-11-09T02:48:00.964 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T02:48:00.977 DEBUG:teuthology.orchestra.console.smithi080:power off output: Chassis Power Control: Down/Off
2023-11-09T02:48:00.977 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T02:48:00.993 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is off
2023-11-09T02:48:01.007 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is off
2023-11-09T02:48:01.095 INFO:teuthology.orchestra.console.smithi038:Power off completed
2023-11-09T02:48:01.108 INFO:teuthology.orchestra.console.smithi080:Power off completed
2023-11-09T02:48:01.196 INFO:teuthology.orchestra.console.smithi038:Power on
2023-11-09T02:48:01.197 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-09T02:48:01.210 INFO:teuthology.orchestra.console.smithi080:Power on
2023-11-09T02:48:01.211 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-09T02:48:01.224 DEBUG:teuthology.orchestra.console.smithi038:power on output: Chassis Power Control: Up/On
2023-11-09T02:48:01.224 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T02:48:01.239 DEBUG:teuthology.orchestra.console.smithi080:power on output: Chassis Power Control: Up/On
2023-11-09T02:48:01.239 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T02:48:01.248 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is off
2023-11-09T02:48:01.267 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is off
2023-11-09T02:48:05.250 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T02:48:05.268 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T02:48:05.359 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is on
2023-11-09T02:48:05.377 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is on
2023-11-09T02:48:05.461 INFO:teuthology.orchestra.console.smithi038:Power on completed
2023-11-09T02:48:05.479 INFO:teuthology.orchestra.console.smithi080:Power on completed
2023-11-09T02:48:05.562 INFO:teuthology.provision.fog.smithi038:Waiting for deploy to finish
2023-11-09T02:48:05.563 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None
2023-11-09T02:48:05.580 INFO:teuthology.provision.fog.smithi080:Waiting for deploy to finish
2023-11-09T02:48:05.581 DEBUG:teuthology.provision.fog.smithi080:FOG request: GET /task/active None
2023-11-09T02:48:20.682 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None
2023-11-09T02:48:20.685 DEBUG:teuthology.provision.fog.smithi080:FOG request: GET /task/active None
2023-11-09T02:48:35.790 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None
2023-11-09T02:48:35.791 DEBUG:teuthology.provision.fog.smithi080:FOG request: GET /task/active None
2023-11-09T02:48:50.898 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None
2023-11-09T02:48:50.900 DEBUG:teuthology.provision.fog.smithi080:FOG request: GET /task/active None
2023-11-09T02:49:05.994 DEBUG:teuthology.provision.fog.smithi080:FOG request: GET /task/active None
2023-11-09T02:49:05.996 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None
2023-11-09T02:49:21.093 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None
2023-11-09T02:49:21.095 DEBUG:teuthology.provision.fog.smithi080:FOG request: GET /task/active None
2023-11-09T02:49:36.190 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None
2023-11-09T02:49:36.192 DEBUG:teuthology.provision.fog.smithi080:FOG request: GET /task/active None
2023-11-09T02:49:51.291 DEBUG:teuthology.provision.fog.smithi080:FOG request: GET /task/active None
2023-11-09T02:49:51.293 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None
2023-11-09T02:50:06.398 DEBUG:teuthology.provision.fog.smithi080:FOG request: GET /task/active None
2023-11-09T02:50:06.400 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None
2023-11-09T02:50:21.496 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None
2023-11-09T02:50:21.498 DEBUG:teuthology.provision.fog.smithi080:FOG request: GET /task/active None
2023-11-09T02:50:36.586 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None
2023-11-09T02:50:36.588 DEBUG:teuthology.provision.fog.smithi080:FOG request: GET /task/active None
2023-11-09T02:50:36.669 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T02:50:36.796 ERROR:teuthology.orchestra.connection:Error authenticating with smithi038.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-11-09T02:50:51.130 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38
2023-11-09T02:50:51.674 DEBUG:teuthology.provision.fog.smithi080:FOG request: GET /task/active None
2023-11-09T02:50:51.757 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T02:50:54.815 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80
2023-11-09T02:50:57.132 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T02:51:00.186 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38
2023-11-09T02:51:00.817 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T02:51:03.902 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80
2023-11-09T02:51:06.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T02:51:09.242 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38
2023-11-09T02:51:09.904 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T02:51:12.986 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80
2023-11-09T02:51:15.244 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T02:51:18.298 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38
2023-11-09T02:51:18.987 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T02:51:22.042 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80
2023-11-09T02:51:24.300 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T02:51:27.358 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38
2023-11-09T02:51:28.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T02:51:31.098 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80
2023-11-09T02:51:33.360 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T02:51:37.101 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T02:51:40.158 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80
2023-11-09T02:51:46.160 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T02:52:33.362 WARNING:teuthology.provision.fog.smithi038:timed out
2023-11-09T02:52:39.366 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T02:52:39.664 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-09T02:52:39.665 DEBUG:teuthology.orchestra.run.smithi038:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-09T02:52:39.909 INFO:teuthology.provision.fog.smithi038:Node is ready
2023-11-09T02:52:39.909 DEBUG:teuthology.orchestra.run.smithi038:> hostname
2023-11-09T02:52:39.931 INFO:teuthology.orchestra.run.smithi038.stdout:smithi038.front.sepia.ceph.com
2023-11-09T02:52:39.931 DEBUG:teuthology.orchestra.run.smithi038:> grep smithi038.front.sepia.ceph.com /etc/hosts
2023-11-09T02:52:39.997 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38 smithi038.front.sepia.ceph.com smithi038
2023-11-09T02:52:39.997 DEBUG:teuthology.orchestra.run.smithi038:> sudo hostname smithi038
2023-11-09T02:52:40.096 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i -e 's/smithi038.front.sepia.ceph.com/smithi038/g' /etc/hosts
2023-11-09T02:52:40.128 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i -e 's/172.21.15.38/172.21.15.38/g' /etc/hosts
2023-11-09T02:52:40.199 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i -e 's/smithi038.front.sepia.ceph.com/smithi038/g' /etc/hostname
2023-11-09T02:52:40.269 DEBUG:teuthology.orchestra.run.smithi038:> sudo hostname smithi038
2023-11-09T02:52:40.338 DEBUG:teuthology.orchestra.run.smithi038:> cat /etc/os-release
2023-11-09T02:52:40.397 INFO:teuthology.orchestra.run.smithi038.stdout:NAME="CentOS Stream"
2023-11-09T02:52:40.397 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION="8"
2023-11-09T02:52:40.398 INFO:teuthology.orchestra.run.smithi038.stdout:ID="centos"
2023-11-09T02:52:40.398 INFO:teuthology.orchestra.run.smithi038.stdout:ID_LIKE="rhel fedora"
2023-11-09T02:52:40.398 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_ID="8"
2023-11-09T02:52:40.398 INFO:teuthology.orchestra.run.smithi038.stdout:PLATFORM_ID="platform:el8"
2023-11-09T02:52:40.398 INFO:teuthology.orchestra.run.smithi038.stdout:PRETTY_NAME="CentOS Stream 8"
2023-11-09T02:52:40.399 INFO:teuthology.orchestra.run.smithi038.stdout:ANSI_COLOR="0;31"
2023-11-09T02:52:40.399 INFO:teuthology.orchestra.run.smithi038.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-11-09T02:52:40.399 INFO:teuthology.orchestra.run.smithi038.stdout:HOME_URL="https://centos.org/"
2023-11-09T02:52:40.399 INFO:teuthology.orchestra.run.smithi038.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-09T02:52:40.399 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-09T02:52:40.400 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-09T02:52:40.400 INFO:teuthology.provision.fog.smithi038:Deploy complete!
2023-11-09T02:52:40.402 DEBUG:teuthology.parallel:result is None
2023-11-09T02:52:46.163 WARNING:teuthology.provision.fog.smithi080:timed out
2023-11-09T02:52:52.165 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T02:52:52.384 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-09T02:52:52.384 DEBUG:teuthology.orchestra.run.smithi080:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-09T02:52:52.633 INFO:teuthology.provision.fog.smithi080:Node is ready
2023-11-09T02:52:52.633 DEBUG:teuthology.orchestra.run.smithi080:> hostname
2023-11-09T02:52:52.655 INFO:teuthology.orchestra.run.smithi080.stdout:smithi080.front.sepia.ceph.com
2023-11-09T02:52:52.655 DEBUG:teuthology.orchestra.run.smithi080:> grep smithi080.front.sepia.ceph.com /etc/hosts
2023-11-09T02:52:52.717 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80 smithi080.front.sepia.ceph.com smithi080
2023-11-09T02:52:52.717 DEBUG:teuthology.orchestra.run.smithi080:> sudo hostname smithi080
2023-11-09T02:52:52.829 DEBUG:teuthology.orchestra.run.smithi080:> sudo sed -i -e 's/smithi080.front.sepia.ceph.com/smithi080/g' /etc/hosts
2023-11-09T02:52:52.863 DEBUG:teuthology.orchestra.run.smithi080:> sudo sed -i -e 's/172.21.15.80/172.21.15.80/g' /etc/hosts
2023-11-09T02:52:52.936 DEBUG:teuthology.orchestra.run.smithi080:> sudo sed -i -e 's/smithi080.front.sepia.ceph.com/smithi080/g' /etc/hostname
2023-11-09T02:52:53.009 DEBUG:teuthology.orchestra.run.smithi080:> sudo hostname smithi080
2023-11-09T02:52:53.081 DEBUG:teuthology.orchestra.run.smithi080:> cat /etc/os-release
2023-11-09T02:52:53.142 INFO:teuthology.orchestra.run.smithi080.stdout:NAME="CentOS Stream"
2023-11-09T02:52:53.142 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION="8"
2023-11-09T02:52:53.142 INFO:teuthology.orchestra.run.smithi080.stdout:ID="centos"
2023-11-09T02:52:53.142 INFO:teuthology.orchestra.run.smithi080.stdout:ID_LIKE="rhel fedora"
2023-11-09T02:52:53.143 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION_ID="8"
2023-11-09T02:52:53.143 INFO:teuthology.orchestra.run.smithi080.stdout:PLATFORM_ID="platform:el8"
2023-11-09T02:52:53.143 INFO:teuthology.orchestra.run.smithi080.stdout:PRETTY_NAME="CentOS Stream 8"
2023-11-09T02:52:53.143 INFO:teuthology.orchestra.run.smithi080.stdout:ANSI_COLOR="0;31"
2023-11-09T02:52:53.143 INFO:teuthology.orchestra.run.smithi080.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-11-09T02:52:53.144 INFO:teuthology.orchestra.run.smithi080.stdout:HOME_URL="https://centos.org/"
2023-11-09T02:52:53.144 INFO:teuthology.orchestra.run.smithi080.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-09T02:52:53.144 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-09T02:52:53.144 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-09T02:52:53.145 INFO:teuthology.provision.fog.smithi080:Deploy complete!
2023-11-09T02:52:53.145 DEBUG:teuthology.parallel:result is None
2023-11-09T02:52:53.299 INFO:teuthology.lock.ops:Checking smithi038.front.sepia.ceph.com
2023-11-09T02:52:53.299 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-09T02:52:53.324 INFO:teuthology.lock.ops:Checking smithi080.front.sepia.ceph.com
2023-11-09T02:52:53.325 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-09T02:52:53.350 INFO:teuthology.lock.ops:Updating [smithi038.front.sepia.ceph.com]: set os type and version on server
2023-11-09T02:52:53.350 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com'
2023-11-09T02:52:53.351 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T02:52:53.424 DEBUG:teuthology.orchestra.run.smithi038:> true
2023-11-09T02:52:53.517 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi038.front.sepia.ceph.com'
2023-11-09T02:52:53.518 DEBUG:teuthology.orchestra.run.smithi038:> uname -m
2023-11-09T02:52:53.577 INFO:teuthology.orchestra.run.smithi038.stdout:x86_64
2023-11-09T02:52:53.578 DEBUG:teuthology.orchestra.run.smithi038:> cat /etc/os-release
2023-11-09T02:52:53.636 INFO:teuthology.orchestra.run.smithi038.stdout:NAME="CentOS Stream"
2023-11-09T02:52:53.637 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION="8"
2023-11-09T02:52:53.637 INFO:teuthology.orchestra.run.smithi038.stdout:ID="centos"
2023-11-09T02:52:53.637 INFO:teuthology.orchestra.run.smithi038.stdout:ID_LIKE="rhel fedora"
2023-11-09T02:52:53.637 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_ID="8"
2023-11-09T02:52:53.638 INFO:teuthology.orchestra.run.smithi038.stdout:PLATFORM_ID="platform:el8"
2023-11-09T02:52:53.638 INFO:teuthology.orchestra.run.smithi038.stdout:PRETTY_NAME="CentOS Stream 8"
2023-11-09T02:52:53.638 INFO:teuthology.orchestra.run.smithi038.stdout:ANSI_COLOR="0;31"
2023-11-09T02:52:53.638 INFO:teuthology.orchestra.run.smithi038.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-11-09T02:52:53.639 INFO:teuthology.orchestra.run.smithi038.stdout:HOME_URL="https://centos.org/"
2023-11-09T02:52:53.639 INFO:teuthology.orchestra.run.smithi038.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-09T02:52:53.639 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-09T02:52:53.639 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-09T02:52:53.640 INFO:teuthology.lock.ops:Updating smithi038.front.sepia.ceph.com on lock server
2023-11-09T02:52:53.657 INFO:teuthology.lock.ops:Updating [smithi080.front.sepia.ceph.com]: set os type and version on server
2023-11-09T02:52:53.658 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com'
2023-11-09T02:52:53.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T02:52:53.725 DEBUG:teuthology.orchestra.run.smithi080:> true
2023-11-09T02:52:53.794 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi080.front.sepia.ceph.com'
2023-11-09T02:52:53.794 DEBUG:teuthology.orchestra.run.smithi080:> uname -m
2023-11-09T02:52:53.853 INFO:teuthology.orchestra.run.smithi080.stdout:x86_64
2023-11-09T02:52:53.854 DEBUG:teuthology.orchestra.run.smithi080:> cat /etc/os-release
2023-11-09T02:52:53.913 INFO:teuthology.orchestra.run.smithi080.stdout:NAME="CentOS Stream"
2023-11-09T02:52:53.913 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION="8"
2023-11-09T02:52:53.913 INFO:teuthology.orchestra.run.smithi080.stdout:ID="centos"
2023-11-09T02:52:53.914 INFO:teuthology.orchestra.run.smithi080.stdout:ID_LIKE="rhel fedora"
2023-11-09T02:52:53.914 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION_ID="8"
2023-11-09T02:52:53.914 INFO:teuthology.orchestra.run.smithi080.stdout:PLATFORM_ID="platform:el8"
2023-11-09T02:52:53.914 INFO:teuthology.orchestra.run.smithi080.stdout:PRETTY_NAME="CentOS Stream 8"
2023-11-09T02:52:53.914 INFO:teuthology.orchestra.run.smithi080.stdout:ANSI_COLOR="0;31"
2023-11-09T02:52:53.915 INFO:teuthology.orchestra.run.smithi080.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-11-09T02:52:53.915 INFO:teuthology.orchestra.run.smithi080.stdout:HOME_URL="https://centos.org/"
2023-11-09T02:52:53.915 INFO:teuthology.orchestra.run.smithi080.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-09T02:52:53.915 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-09T02:52:53.915 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-09T02:52:53.916 INFO:teuthology.lock.ops:Updating smithi080.front.sepia.ceph.com on lock server
2023-11-09T02:52:53.940 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T02:52:54.031 INFO:teuthology.dispatcher.supervisor:Running job 7452365
2023-11-09T02:52:54.031 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2023-11-09_02:25:01-upgrade:reef-x-main-distro-default-smithi/7452365 --name teuthology-2023-11-09_02:25:01-upgrade:reef-x-main-distro-default-smithi --description upgrade:reef-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} -- /home/teuthworker/archive/teuthology-2023-11-09_02:25:01-upgrade:reef-x-main-distro-default-smithi/7452365/orig.config.yaml
2023-11-09T02:52:54.035 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2023-11-09_02:25:01-upgrade:reef-x-main-distro-default-smithi/7452365
2023-11-09T02:52:54.035 INFO:teuthology.dispatcher.supervisor:Job PID: 122077
2023-11-09T02:52:54.035 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-11-09T02:54:54.037 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T02:56:54.114 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T02:58:54.188 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T03:00:54.257 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T03:02:54.324 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T03:04:54.395 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T03:06:54.461 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T03:08:54.555 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T03:10:54.631 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T03:10:54.697 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-11-09T03:10:54.836 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-11-09T03:10:54.837 INFO:teuthology.nuke:Checking targets against current locks
2023-11-09T03:10:54.889 DEBUG:teuthology.nuke:shortname: smithi038
2023-11-09T03:10:54.889 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-09T03:10:54.908 DEBUG:teuthology.nuke:shortname: smithi080
2023-11-09T03:10:54.909 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-09T03:10:54.912 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi038.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-11-09_02:25:01-upgrade:reef-x-main-distro-default-smithi/7452365', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-09 02:47:59.307965', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPp9InCv1KNJ0l+vynExkYmCRy8IacxOMHJLvv7GOXehk5oIb7swONd9I+axdBcaeQnavqQHY93clTkBiPhv9u8='}
2023-11-09T03:10:54.936 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi080.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-11-09_02:25:01-upgrade:reef-x-main-distro-default-smithi/7452365', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-09 02:47:59.309801', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEj/8INqK3dpfxk9w21zjNC5jg/+H5rZLWZxXAj2IyegnHBJqWtdkMwT2Rt8aPWN2lQ6gUfjf5ujQDwQmHomxTc='}
2023-11-09T03:10:54.969 INFO:teuthology.orchestra.console.smithi038:Power off
2023-11-09T03:10:54.971 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-09T03:10:54.997 DEBUG:teuthology.orchestra.console.smithi038:power off output: Chassis Power Control: Down/Off
2023-11-09T03:10:54.998 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T03:10:55.017 INFO:teuthology.orchestra.console.smithi080:Power off
2023-11-09T03:10:55.017 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-09T03:10:55.028 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is off
2023-11-09T03:10:55.043 DEBUG:teuthology.orchestra.console.smithi080:power off output: Chassis Power Control: Down/Off
2023-11-09T03:10:55.043 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T03:10:55.071 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is off
2023-11-09T03:10:55.129 INFO:teuthology.orchestra.console.smithi038:Power off completed
2023-11-09T03:10:55.172 INFO:teuthology.orchestra.console.smithi080:Power off completed
2023-11-09T03:10:55.292 INFO:teuthology.lock.ops:unlocked: smithi038.front.sepia.ceph.com
2023-11-09T03:10:55.321 INFO:teuthology.lock.ops:unlocked: smithi080.front.sepia.ceph.com