2023-09-23T16:42:13.223 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc
2023-09-23T16:42:13.224 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T16:42:13.367 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f505261eb50>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f505235cf70>, signals=[15])
2023-09-23T16:42:13.368 INFO:teuthology.lock.ops:Start node 'smithi137.front.sepia.ceph.com' reimaging
2023-09-23T16:42:13.368 INFO:teuthology.lock.ops:Updating [smithi137.front.sepia.ceph.com]: reset os type and version on server
2023-09-23T16:42:13.368 INFO:teuthology.lock.ops:Updating smithi137.front.sepia.ceph.com on lock server
2023-09-23T16:42:13.392 INFO:teuthology.lock.ops:Start node 'smithi203.front.sepia.ceph.com' reimaging
2023-09-23T16:42:13.393 INFO:teuthology.lock.ops:Updating [smithi203.front.sepia.ceph.com]: reset os type and version on server
2023-09-23T16:42:13.393 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server
2023-09-23T16:42:13.394 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /host {"name": "smithi137"}
2023-09-23T16:42:13.418 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /host {"name": "smithi203"}
2023-09-23T16:42:13.466 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-09-23T16:42:13.503 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-09-23T16:42:13.513 DEBUG:teuthology.provision.fog.smithi137:Requesting image smithi_centos_8.stream (ID 3)
2023-09-23T16:42:13.513 DEBUG:teuthology.provision.fog.smithi137:FOG request: PUT /host/242 {"imageID": 3}
2023-09-23T16:42:13.541 DEBUG:teuthology.provision.fog.smithi203:Requesting image smithi_centos_8.stream (ID 3)
2023-09-23T16:42:13.541 DEBUG:teuthology.provision.fog.smithi203:FOG request: PUT /host/307 {"imageID": 3}
2023-09-23T16:42:13.570 INFO:teuthology.provision.fog.smithi137:Scheduling deploy of centos 8.stream
2023-09-23T16:42:13.570 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None
2023-09-23T16:42:13.588 INFO:teuthology.provision.fog.smithi203:Scheduling deploy of centos 8.stream
2023-09-23T16:42:13.589 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-09-23T16:42:13.621 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /tasktype {"name": "deploy"}
2023-09-23T16:42:13.632 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /tasktype {"name": "deploy"}
2023-09-23T16:42:13.662 DEBUG:teuthology.provision.fog.smithi203:FOG request: POST /host/307/task {"taskTypeID": 1}
2023-09-23T16:42:13.667 DEBUG:teuthology.provision.fog.smithi137:FOG request: POST /host/242/task {"taskTypeID": 1}
2023-09-23T16:42:13.737 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-09-23T16:42:13.739 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None
2023-09-23T16:42:13.829 INFO:teuthology.orchestra.console.smithi203:Power off
2023-09-23T16:42:13.829 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-23T16:42:13.842 INFO:teuthology.orchestra.console.smithi137:Power off
2023-09-23T16:42:13.842 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-23T16:42:13.851 DEBUG:teuthology.orchestra.console.smithi203:power off output: Chassis Power Control: Down/Off
2023-09-23T16:42:13.851 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-23T16:42:13.863 DEBUG:teuthology.orchestra.console.smithi137:power off output: Chassis Power Control: Down/Off
2023-09-23T16:42:13.863 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-23T16:42:13.873 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off
2023-09-23T16:42:13.885 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is off
2023-09-23T16:42:13.974 INFO:teuthology.orchestra.console.smithi203:Power off completed
2023-09-23T16:42:13.986 INFO:teuthology.orchestra.console.smithi137:Power off completed
2023-09-23T16:42:14.075 INFO:teuthology.orchestra.console.smithi203:Power on
2023-09-23T16:42:14.075 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-23T16:42:14.087 INFO:teuthology.orchestra.console.smithi137:Power on
2023-09-23T16:42:14.087 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-23T16:42:14.097 DEBUG:teuthology.orchestra.console.smithi203:power on output: Chassis Power Control: Up/On
2023-09-23T16:42:14.097 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-23T16:42:14.108 DEBUG:teuthology.orchestra.console.smithi137:power on output: Chassis Power Control: Up/On
2023-09-23T16:42:14.108 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-23T16:42:14.117 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off
2023-09-23T16:42:14.129 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is off
2023-09-23T16:42:18.122 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-23T16:42:18.130 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-23T16:42:18.231 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on
2023-09-23T16:42:18.238 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is off
2023-09-23T16:42:18.332 INFO:teuthology.orchestra.console.smithi203:Power on completed
2023-09-23T16:42:18.433 INFO:teuthology.provision.fog.smithi203:Waiting for deploy to finish
2023-09-23T16:42:18.433 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-09-23T16:42:22.240 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-23T16:42:22.348 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is on
2023-09-23T16:42:22.448 INFO:teuthology.orchestra.console.smithi137:Power on completed
2023-09-23T16:42:22.549 INFO:teuthology.provision.fog.smithi137:Waiting for deploy to finish
2023-09-23T16:42:22.549 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None
2023-09-23T16:42:33.502 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-09-23T16:42:37.621 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None
2023-09-23T16:42:48.570 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-09-23T16:42:52.690 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None
2023-09-23T16:43:03.644 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-09-23T16:43:07.754 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None
2023-09-23T16:43:18.710 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-09-23T16:43:22.822 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None
2023-09-23T16:43:33.778 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-09-23T16:43:37.884 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None
2023-09-23T16:43:48.854 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-09-23T16:43:52.950 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None
2023-09-23T16:44:03.922 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-09-23T16:44:08.010 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None
2023-09-23T16:44:18.994 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-09-23T16:44:23.070 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None
2023-09-23T16:44:34.065 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-09-23T16:44:38.138 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None
2023-09-23T16:44:49.138 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-09-23T16:44:53.198 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None
2023-09-23T16:45:04.206 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-09-23T16:45:04.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-23T16:45:08.255 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None
2023-09-23T16:45:08.311 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-23T16:45:22.682 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203
2023-09-23T16:45:26.778 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137
2023-09-23T16:45:28.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-23T16:45:31.738 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203
2023-09-23T16:45:32.781 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-23T16:45:35.834 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137
2023-09-23T16:45:37.741 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-23T16:45:40.794 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203
2023-09-23T16:45:41.837 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-23T16:45:44.890 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137
2023-09-23T16:45:46.797 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-23T16:45:49.850 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203
2023-09-23T16:45:50.893 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-23T16:45:53.946 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137
2023-09-23T16:45:55.853 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-23T16:45:58.906 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203
2023-09-23T16:45:59.949 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-23T16:46:04.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-23T16:46:07.962 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203
2023-09-23T16:46:13.967 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-23T16:46:45.641 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-09-23T16:46:45.641 DEBUG:teuthology.orchestra.run.smithi203:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-09-23T16:46:59.952 WARNING:teuthology.provision.fog.smithi137:timed out
2023-09-23T16:47:05.952 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-23T16:47:06.148 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-09-23T16:47:06.148 DEBUG:teuthology.orchestra.run.smithi137:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-09-23T16:47:06.399 INFO:teuthology.provision.fog.smithi137:Node is ready
2023-09-23T16:47:06.400 DEBUG:teuthology.orchestra.run.smithi137:> hostname
2023-09-23T16:47:06.458 INFO:teuthology.orchestra.run.smithi137.stdout:smithi137.front.sepia.ceph.com
2023-09-23T16:47:06.459 DEBUG:teuthology.orchestra.run.smithi137:> grep smithi137.front.sepia.ceph.com /etc/hosts
2023-09-23T16:47:06.517 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.15.137 smithi137.front.sepia.ceph.com smithi137
2023-09-23T16:47:06.518 DEBUG:teuthology.orchestra.run.smithi137:> sudo hostname smithi137
2023-09-23T16:47:06.620 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i -e 's/smithi137.front.sepia.ceph.com/smithi137/g' /etc/hosts
2023-09-23T16:47:06.649 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i -e 's/172.21.15.137/172.21.15.137/g' /etc/hosts
2023-09-23T16:47:06.717 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i -e 's/smithi137.front.sepia.ceph.com/smithi137/g' /etc/hostname
2023-09-23T16:47:06.784 DEBUG:teuthology.orchestra.run.smithi137:> sudo hostname smithi137
2023-09-23T16:47:06.851 DEBUG:teuthology.orchestra.run.smithi137:> cat /etc/os-release
2023-09-23T16:47:06.908 INFO:teuthology.orchestra.run.smithi137.stdout:NAME="CentOS Stream"
2023-09-23T16:47:06.908 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION="8"
2023-09-23T16:47:06.908 INFO:teuthology.orchestra.run.smithi137.stdout:ID="centos"
2023-09-23T16:47:06.908 INFO:teuthology.orchestra.run.smithi137.stdout:ID_LIKE="rhel fedora"
2023-09-23T16:47:06.908 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_ID="8"
2023-09-23T16:47:06.909 INFO:teuthology.orchestra.run.smithi137.stdout:PLATFORM_ID="platform:el8"
2023-09-23T16:47:06.909 INFO:teuthology.orchestra.run.smithi137.stdout:PRETTY_NAME="CentOS Stream 8"
2023-09-23T16:47:06.909 INFO:teuthology.orchestra.run.smithi137.stdout:ANSI_COLOR="0;31"
2023-09-23T16:47:06.909 INFO:teuthology.orchestra.run.smithi137.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-09-23T16:47:06.909 INFO:teuthology.orchestra.run.smithi137.stdout:HOME_URL="https://centos.org/"
2023-09-23T16:47:06.909 INFO:teuthology.orchestra.run.smithi137.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-23T16:47:06.909 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-09-23T16:47:06.909 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-09-23T16:47:06.910 INFO:teuthology.provision.fog.smithi137:Deploy complete!
2023-09-23T16:47:06.914 DEBUG:teuthology.parallel:result is None
2023-09-23T16:47:11.425 INFO:teuthology.provision.fog.smithi203:Node is ready
2023-09-23T16:47:11.425 DEBUG:teuthology.orchestra.run.smithi203:> hostname
2023-09-23T16:47:11.450 INFO:teuthology.orchestra.run.smithi203.stdout:smithi203.front.sepia.ceph.com
2023-09-23T16:47:11.450 DEBUG:teuthology.orchestra.run.smithi203:> grep smithi203.front.sepia.ceph.com /etc/hosts
2023-09-23T16:47:11.511 INFO:teuthology.orchestra.run.smithi203.stdout:172.21.15.203 smithi203.front.sepia.ceph.com smithi203
2023-09-23T16:47:11.511 DEBUG:teuthology.orchestra.run.smithi203:> sudo hostname smithi203
2023-09-23T16:47:11.642 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/smithi203.front.sepia.ceph.com/smithi203/g' /etc/hosts
2023-09-23T16:47:11.673 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/172.21.15.203/172.21.15.203/g' /etc/hosts
2023-09-23T16:47:11.742 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/smithi203.front.sepia.ceph.com/smithi203/g' /etc/hostname
2023-09-23T16:47:11.811 DEBUG:teuthology.orchestra.run.smithi203:> sudo hostname smithi203
2023-09-23T16:47:11.878 DEBUG:teuthology.orchestra.run.smithi203:> cat /etc/os-release
2023-09-23T16:47:11.936 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="CentOS Stream"
2023-09-23T16:47:11.936 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="8"
2023-09-23T16:47:11.936 INFO:teuthology.orchestra.run.smithi203.stdout:ID="centos"
2023-09-23T16:47:11.936 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE="rhel fedora"
2023-09-23T16:47:11.936 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="8"
2023-09-23T16:47:11.936 INFO:teuthology.orchestra.run.smithi203.stdout:PLATFORM_ID="platform:el8"
2023-09-23T16:47:11.936 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="CentOS Stream 8"
2023-09-23T16:47:11.936 INFO:teuthology.orchestra.run.smithi203.stdout:ANSI_COLOR="0;31"
2023-09-23T16:47:11.936 INFO:teuthology.orchestra.run.smithi203.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-09-23T16:47:11.937 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://centos.org/"
2023-09-23T16:47:11.937 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-23T16:47:11.937 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-09-23T16:47:11.937 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-09-23T16:47:11.937 INFO:teuthology.provision.fog.smithi203:Deploy complete!
2023-09-23T16:47:11.938 DEBUG:teuthology.parallel:result is None
2023-09-23T16:47:12.085 INFO:teuthology.lock.ops:Checking smithi137.front.sepia.ceph.com
2023-09-23T16:47:12.085 INFO:teuthology.lock.ops:New key found. Updating...
2023-09-23T16:47:12.111 INFO:teuthology.lock.ops:Checking smithi203.front.sepia.ceph.com
2023-09-23T16:47:12.111 INFO:teuthology.lock.ops:New key found. Updating...
2023-09-23T16:47:12.128 INFO:teuthology.lock.ops:Updating [smithi137.front.sepia.ceph.com]: set os type and version on server
2023-09-23T16:47:12.129 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com'
2023-09-23T16:47:12.129 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-23T16:47:12.195 DEBUG:teuthology.orchestra.run.smithi137:> true
2023-09-23T16:47:12.267 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi137.front.sepia.ceph.com'
2023-09-23T16:47:12.267 DEBUG:teuthology.orchestra.run.smithi137:> uname -m
2023-09-23T16:47:12.326 INFO:teuthology.orchestra.run.smithi137.stdout:x86_64
2023-09-23T16:47:12.326 DEBUG:teuthology.orchestra.run.smithi137:> cat /etc/os-release
2023-09-23T16:47:12.386 INFO:teuthology.orchestra.run.smithi137.stdout:NAME="CentOS Stream"
2023-09-23T16:47:12.387 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION="8"
2023-09-23T16:47:12.387 INFO:teuthology.orchestra.run.smithi137.stdout:ID="centos"
2023-09-23T16:47:12.387 INFO:teuthology.orchestra.run.smithi137.stdout:ID_LIKE="rhel fedora"
2023-09-23T16:47:12.387 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_ID="8"
2023-09-23T16:47:12.387 INFO:teuthology.orchestra.run.smithi137.stdout:PLATFORM_ID="platform:el8"
2023-09-23T16:47:12.387 INFO:teuthology.orchestra.run.smithi137.stdout:PRETTY_NAME="CentOS Stream 8"
2023-09-23T16:47:12.387 INFO:teuthology.orchestra.run.smithi137.stdout:ANSI_COLOR="0;31"
2023-09-23T16:47:12.387 INFO:teuthology.orchestra.run.smithi137.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-09-23T16:47:12.387 INFO:teuthology.orchestra.run.smithi137.stdout:HOME_URL="https://centos.org/"
2023-09-23T16:47:12.387 INFO:teuthology.orchestra.run.smithi137.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-23T16:47:12.387 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-09-23T16:47:12.388 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-09-23T16:47:12.388 INFO:teuthology.lock.ops:Updating smithi137.front.sepia.ceph.com on lock server
2023-09-23T16:47:12.411 INFO:teuthology.lock.ops:Updating [smithi203.front.sepia.ceph.com]: set os type and version on server
2023-09-23T16:47:12.412 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com'
2023-09-23T16:47:12.412 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-23T16:47:12.478 DEBUG:teuthology.orchestra.run.smithi203:> true
2023-09-23T16:47:12.548 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi203.front.sepia.ceph.com'
2023-09-23T16:47:12.548 DEBUG:teuthology.orchestra.run.smithi203:> uname -m
2023-09-23T16:47:12.606 INFO:teuthology.orchestra.run.smithi203.stdout:x86_64
2023-09-23T16:47:12.606 DEBUG:teuthology.orchestra.run.smithi203:> cat /etc/os-release
2023-09-23T16:47:12.663 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="CentOS Stream"
2023-09-23T16:47:12.663 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="8"
2023-09-23T16:47:12.664 INFO:teuthology.orchestra.run.smithi203.stdout:ID="centos"
2023-09-23T16:47:12.664 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE="rhel fedora"
2023-09-23T16:47:12.664 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="8"
2023-09-23T16:47:12.664 INFO:teuthology.orchestra.run.smithi203.stdout:PLATFORM_ID="platform:el8"
2023-09-23T16:47:12.664 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="CentOS Stream 8"
2023-09-23T16:47:12.664 INFO:teuthology.orchestra.run.smithi203.stdout:ANSI_COLOR="0;31"
2023-09-23T16:47:12.664 INFO:teuthology.orchestra.run.smithi203.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-09-23T16:47:12.664 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://centos.org/"
2023-09-23T16:47:12.664 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-23T16:47:12.665 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-09-23T16:47:12.665 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-09-23T16:47:12.665 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server
2023-09-23T16:47:12.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T16:47:12.781 INFO:teuthology.dispatcher.supervisor:Running job 7401747
2023-09-23T16:47:12.781 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2023-09-23_14:23:10-upgrade:quincy-x-reef-distro-default-smithi/7401747 --name teuthology-2023-09-23_14:23:10-upgrade:quincy-x-reef-distro-default-smithi --description upgrade:quincy-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} -- /home/teuthworker/archive/teuthology-2023-09-23_14:23:10-upgrade:quincy-x-reef-distro-default-smithi/7401747/orig.config.yaml
2023-09-23T16:47:12.785 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2023-09-23_14:23:10-upgrade:quincy-x-reef-distro-default-smithi/7401747
2023-09-23T16:47:12.785 INFO:teuthology.dispatcher.supervisor:Job PID: 3580328
2023-09-23T16:47:12.785 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-09-23T16:49:12.883 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T16:51:12.964 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T16:53:13.043 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T16:55:13.219 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T16:57:13.383 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T16:59:13.562 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T17:01:13.727 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T17:03:13.895 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T17:05:14.007 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T17:07:14.150 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T17:09:14.323 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T17:11:14.447 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T17:13:14.610 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T17:15:14.773 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T17:17:14.935 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T17:19:15.101 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T17:21:15.282 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T17:23:15.443 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T17:25:15.604 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T17:27:15.745 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T17:29:15.939 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T17:31:16.103 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T17:33:16.274 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T17:35:16.438 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T17:37:16.603 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T17:39:16.772 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T17:41:16.963 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T17:43:17.104 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T17:45:17.267 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T17:47:17.429 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T17:49:17.596 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T17:51:17.763 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T17:53:17.889 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T17:55:18.138 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T17:57:18.303 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T17:59:18.452 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T18:01:18.620 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T18:03:18.791 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T18:05:21.556 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T18:07:22.044 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T18:09:22.211 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T18:11:22.375 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T18:13:22.511 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T18:15:22.679 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T18:15:22.751 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-09-23T18:15:22.924 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-09-23T18:15:22.925 INFO:teuthology.nuke:Checking targets against current locks
2023-09-23T18:15:22.973 DEBUG:teuthology.nuke:shortname: smithi137
2023-09-23T18:15:22.974 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-09-23T18:15:22.989 DEBUG:teuthology.nuke:shortname: smithi203
2023-09-23T18:15:22.989 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-09-23T18:15:22.996 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi137.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-09-23_14:23:10-upgrade:quincy-x-reef-distro-default-smithi/7401747', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-23 16:42:12.373967', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMRp9OyYYyKlRSrh43Cl5ZUhWznpWEJyQoGTfbTj3PtzBL2t7oIslHpdpwJs6xsSuXSD/9KNC9UFqSyGwOjZTW8='}
2023-09-23T18:15:23.011 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi203.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-09-23_14:23:10-upgrade:quincy-x-reef-distro-default-smithi/7401747', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-23 16:42:12.375858', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKVj1GHTM8VlRE0Ekx/SzZbNiXPGB7M+2GWamtGN7rr/elpKAEFxgBA8woT9+cSRLJv9L5ejtl6b94OLHsEn/A0='}
2023-09-23T18:15:23.039 INFO:teuthology.orchestra.console.smithi137:Power off
2023-09-23T18:15:23.039 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-23T18:15:23.062 DEBUG:teuthology.orchestra.console.smithi137:power off output: Chassis Power Control: Down/Off
2023-09-23T18:15:23.062 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-23T18:15:23.075 INFO:teuthology.orchestra.console.smithi203:Power off
2023-09-23T18:15:23.076 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-23T18:15:23.085 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is off
2023-09-23T18:15:23.097 DEBUG:teuthology.orchestra.console.smithi203:power off output: Chassis Power Control: Down/Off
2023-09-23T18:15:23.097 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-23T18:15:23.120 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off
2023-09-23T18:15:23.186 INFO:teuthology.orchestra.console.smithi137:Power off completed
2023-09-23T18:15:23.221 INFO:teuthology.orchestra.console.smithi203:Power off completed
2023-09-23T18:15:23.342 INFO:teuthology.lock.ops:unlocked: smithi137.front.sepia.ceph.com
2023-09-23T18:15:23.366 INFO:teuthology.lock.ops:unlocked: smithi203.front.sepia.ceph.com