2023-11-09T03:24:30.513 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2
2023-11-09T03:24:30.515 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T03:24:30.668 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fe859b47b20>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fe859404e50>, signals=[15])
2023-11-09T03:24:30.670 INFO:teuthology.lock.ops:Start node 'smithi079.front.sepia.ceph.com' reimaging
2023-11-09T03:24:30.670 INFO:teuthology.lock.ops:Updating [smithi079.front.sepia.ceph.com]: reset os type and version on server
2023-11-09T03:24:30.671 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server
2023-11-09T03:24:30.692 INFO:teuthology.lock.ops:Start node 'smithi119.front.sepia.ceph.com' reimaging
2023-11-09T03:24:30.692 INFO:teuthology.lock.ops:Updating [smithi119.front.sepia.ceph.com]: reset os type and version on server
2023-11-09T03:24:30.692 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server
2023-11-09T03:24:30.694 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /host {"name": "smithi079"}
2023-11-09T03:24:30.716 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /host {"name": "smithi119"}
2023-11-09T03:24:30.757 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-11-09T03:24:30.781 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-11-09T03:24:30.815 DEBUG:teuthology.provision.fog.smithi079:Requesting image smithi_rhel_8.6 (ID 5)
2023-11-09T03:24:30.816 DEBUG:teuthology.provision.fog.smithi079:FOG request: PUT /host/184 {"imageID": 5}
2023-11-09T03:24:30.832 DEBUG:teuthology.provision.fog.smithi119:Requesting image smithi_rhel_8.6 (ID 5)
2023-11-09T03:24:30.833 DEBUG:teuthology.provision.fog.smithi119:FOG request: PUT /host/224 {"imageID": 5}
2023-11-09T03:24:30.861 INFO:teuthology.provision.fog.smithi079:Scheduling deploy of rhel 8.6
2023-11-09T03:24:30.861 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-11-09T03:24:30.881 INFO:teuthology.provision.fog.smithi119:Scheduling deploy of rhel 8.6
2023-11-09T03:24:30.881 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None
2023-11-09T03:24:30.931 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /tasktype {"name": "deploy"}
2023-11-09T03:24:30.958 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /tasktype {"name": "deploy"}
2023-11-09T03:24:30.973 DEBUG:teuthology.provision.fog.smithi079:FOG request: POST /host/184/task {"taskTypeID": 1}
2023-11-09T03:24:30.999 DEBUG:teuthology.provision.fog.smithi119:FOG request: POST /host/224/task {"taskTypeID": 1}
2023-11-09T03:24:31.029 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-11-09T03:24:31.053 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None
2023-11-09T03:24:31.142 INFO:teuthology.orchestra.console.smithi079:Power off
2023-11-09T03:24:31.143 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-09T03:24:31.161 INFO:teuthology.orchestra.console.smithi119:Power off
2023-11-09T03:24:31.161 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-09T03:24:31.181 DEBUG:teuthology.orchestra.console.smithi079:power off output: Chassis Power Control: Down/Off
2023-11-09T03:24:31.182 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T03:24:31.203 DEBUG:teuthology.orchestra.console.smithi119:power off output: Chassis Power Control: Down/Off
2023-11-09T03:24:31.204 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T03:24:31.214 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off
2023-11-09T03:24:31.232 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off
2023-11-09T03:24:31.315 INFO:teuthology.orchestra.console.smithi079:Power off completed
2023-11-09T03:24:31.333 INFO:teuthology.orchestra.console.smithi119:Power off completed
2023-11-09T03:24:31.417 INFO:teuthology.orchestra.console.smithi079:Power on
2023-11-09T03:24:31.417 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-09T03:24:31.435 INFO:teuthology.orchestra.console.smithi119:Power on
2023-11-09T03:24:31.435 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-09T03:24:31.447 DEBUG:teuthology.orchestra.console.smithi079:power on output: Chassis Power Control: Up/On
2023-11-09T03:24:31.448 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T03:24:31.463 DEBUG:teuthology.orchestra.console.smithi119:power on output: Chassis Power Control: Up/On
2023-11-09T03:24:31.464 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T03:24:31.477 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off
2023-11-09T03:24:31.491 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off
2023-11-09T03:24:35.482 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T03:24:35.492 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T03:24:35.594 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off
2023-11-09T03:24:35.601 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off
2023-11-09T03:24:39.598 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T03:24:39.606 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T03:24:39.708 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is on
2023-11-09T03:24:39.716 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on
2023-11-09T03:24:39.810 INFO:teuthology.orchestra.console.smithi079:Power on completed
2023-11-09T03:24:39.817 INFO:teuthology.orchestra.console.smithi119:Power on completed
2023-11-09T03:24:39.911 INFO:teuthology.provision.fog.smithi079:Waiting for deploy to finish
2023-11-09T03:24:39.912 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-11-09T03:24:39.919 INFO:teuthology.provision.fog.smithi119:Waiting for deploy to finish
2023-11-09T03:24:39.919 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None
2023-11-09T03:24:55.018 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-11-09T03:24:55.021 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None
2023-11-09T03:25:10.126 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None
2023-11-09T03:25:10.128 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-11-09T03:25:25.234 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-11-09T03:25:25.236 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None
2023-11-09T03:25:40.374 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-11-09T03:25:40.376 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None
2023-11-09T03:25:55.476 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-11-09T03:25:55.478 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None
2023-11-09T03:26:10.586 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-11-09T03:26:10.588 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None
2023-11-09T03:26:25.678 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None
2023-11-09T03:26:25.680 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-11-09T03:26:40.774 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-11-09T03:26:40.776 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None
2023-11-09T03:26:55.878 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None
2023-11-09T03:26:55.880 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-11-09T03:27:10.994 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None
2023-11-09T03:27:10.996 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-11-09T03:27:11.092 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T03:27:14.174 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2023-11-09T03:27:20.179 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T03:27:23.258 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2023-11-09T03:27:26.098 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-11-09T03:27:26.192 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T03:27:29.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T03:27:29.274 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79
2023-11-09T03:27:32.318 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2023-11-09T03:27:35.278 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T03:27:38.323 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T03:27:38.334 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79
2023-11-09T03:27:41.403 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2023-11-09T03:27:44.336 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T03:27:47.390 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79
2023-11-09T03:27:47.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T03:27:50.458 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2023-11-09T03:27:53.394 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T03:27:56.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T03:27:56.478 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79
2023-11-09T03:27:59.518 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2023-11-09T03:28:02.482 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T03:28:05.522 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T03:28:05.562 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79
2023-11-09T03:28:08.606 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2023-11-09T03:28:11.566 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T03:28:14.610 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T03:28:14.618 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79
2023-11-09T03:28:20.623 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T03:28:24.954 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2023-11-09T03:28:30.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T03:28:34.010 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2023-11-09T03:28:40.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T03:28:43.070 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2023-11-09T03:28:49.075 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T03:28:49.305 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-09T03:28:49.306 DEBUG:teuthology.orchestra.run.smithi119:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-09T03:28:49.645 INFO:teuthology.provision.fog.smithi119:Node is ready
2023-11-09T03:28:49.646 DEBUG:teuthology.orchestra.run.smithi119:> hostname
2023-11-09T03:28:49.662 INFO:teuthology.orchestra.run.smithi119.stdout:smithi119.front.sepia.ceph.com
2023-11-09T03:28:49.662 DEBUG:teuthology.orchestra.run.smithi119:> grep smithi119.front.sepia.ceph.com /etc/hosts
2023-11-09T03:28:49.719 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119 smithi119.front.sepia.ceph.com smithi119
2023-11-09T03:28:49.720 DEBUG:teuthology.orchestra.run.smithi119:> sudo hostname smithi119
2023-11-09T03:28:49.930 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/smithi119.front.sepia.ceph.com/smithi119/g' /etc/hosts
2023-11-09T03:28:49.957 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/172.21.15.119/172.21.15.119/g' /etc/hosts
2023-11-09T03:28:50.023 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/smithi119.front.sepia.ceph.com/smithi119/g' /etc/hostname
2023-11-09T03:28:50.091 DEBUG:teuthology.orchestra.run.smithi119:> sudo hostname smithi119
2023-11-09T03:28:50.156 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release
2023-11-09T03:28:50.212 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="Red Hat Enterprise Linux"
2023-11-09T03:28:50.213 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="8.6 (Ootpa)"
2023-11-09T03:28:50.213 INFO:teuthology.orchestra.run.smithi119.stdout:ID="rhel"
2023-11-09T03:28:50.213 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="fedora"
2023-11-09T03:28:50.214 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="8.6"
2023-11-09T03:28:50.214 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el8"
2023-11-09T03:28:50.214 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-11-09T03:28:50.214 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31"
2023-11-09T03:28:50.215 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-11-09T03:28:50.215 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://www.redhat.com/"
2023-11-09T03:28:50.215 INFO:teuthology.orchestra.run.smithi119.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-09T03:28:50.215 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-09T03:28:50.216 INFO:teuthology.orchestra.run.smithi119.stdout:
2023-11-09T03:28:50.216 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-09T03:28:50.216 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-11-09T03:28:50.216 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-09T03:28:50.217 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-11-09T03:28:50.217 INFO:teuthology.provision.fog.smithi119:Deploy complete!
2023-11-09T03:28:50.219 DEBUG:teuthology.parallel:result is None
2023-11-09T03:29:20.654 WARNING:teuthology.provision.fog.smithi079:timed out
2023-11-09T03:29:26.662 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T03:29:27.007 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-09T03:29:27.008 DEBUG:teuthology.orchestra.run.smithi079:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-09T03:29:27.267 INFO:teuthology.provision.fog.smithi079:Node is ready
2023-11-09T03:29:27.267 DEBUG:teuthology.orchestra.run.smithi079:> hostname
2023-11-09T03:29:27.285 INFO:teuthology.orchestra.run.smithi079.stdout:smithi079.front.sepia.ceph.com
2023-11-09T03:29:27.285 DEBUG:teuthology.orchestra.run.smithi079:> grep smithi079.front.sepia.ceph.com /etc/hosts
2023-11-09T03:29:27.343 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79 smithi079.front.sepia.ceph.com smithi079
2023-11-09T03:29:27.344 DEBUG:teuthology.orchestra.run.smithi079:> sudo hostname smithi079
2023-11-09T03:29:27.465 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/smithi079.front.sepia.ceph.com/smithi079/g' /etc/hosts
2023-11-09T03:29:27.493 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/172.21.15.79/172.21.15.79/g' /etc/hosts
2023-11-09T03:29:27.561 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/smithi079.front.sepia.ceph.com/smithi079/g' /etc/hostname
2023-11-09T03:29:27.630 DEBUG:teuthology.orchestra.run.smithi079:> sudo hostname smithi079
2023-11-09T03:29:27.696 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release
2023-11-09T03:29:27.753 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="Red Hat Enterprise Linux"
2023-11-09T03:29:27.753 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="8.6 (Ootpa)"
2023-11-09T03:29:27.753 INFO:teuthology.orchestra.run.smithi079.stdout:ID="rhel"
2023-11-09T03:29:27.753 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="fedora"
2023-11-09T03:29:27.754 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="8.6"
2023-11-09T03:29:27.754 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el8"
2023-11-09T03:29:27.754 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-11-09T03:29:27.754 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31"
2023-11-09T03:29:27.754 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-11-09T03:29:27.755 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://www.redhat.com/"
2023-11-09T03:29:27.755 INFO:teuthology.orchestra.run.smithi079.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-09T03:29:27.755 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-09T03:29:27.755 INFO:teuthology.orchestra.run.smithi079.stdout:
2023-11-09T03:29:27.755 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-09T03:29:27.756 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-11-09T03:29:27.756 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-09T03:29:27.756 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-11-09T03:29:27.757 INFO:teuthology.provision.fog.smithi079:Deploy complete!
2023-11-09T03:29:27.758 DEBUG:teuthology.parallel:result is None
2023-11-09T03:29:27.915 INFO:teuthology.lock.ops:Checking smithi079.front.sepia.ceph.com
2023-11-09T03:29:27.915 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-09T03:29:27.936 INFO:teuthology.lock.ops:Checking smithi119.front.sepia.ceph.com
2023-11-09T03:29:27.937 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-09T03:29:27.961 INFO:teuthology.lock.ops:Updating [smithi079.front.sepia.ceph.com]: set os type and version on server
2023-11-09T03:29:27.962 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com'
2023-11-09T03:29:27.963 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T03:29:28.029 DEBUG:teuthology.orchestra.run.smithi079:> true
2023-11-09T03:29:28.094 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi079.front.sepia.ceph.com'
2023-11-09T03:29:28.095 DEBUG:teuthology.orchestra.run.smithi079:> uname -m
2023-11-09T03:29:28.151 INFO:teuthology.orchestra.run.smithi079.stdout:x86_64
2023-11-09T03:29:28.152 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release
2023-11-09T03:29:28.208 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="Red Hat Enterprise Linux"
2023-11-09T03:29:28.208 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="8.6 (Ootpa)"
2023-11-09T03:29:28.208 INFO:teuthology.orchestra.run.smithi079.stdout:ID="rhel"
2023-11-09T03:29:28.209 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="fedora"
2023-11-09T03:29:28.209 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="8.6"
2023-11-09T03:29:28.209 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el8"
2023-11-09T03:29:28.209 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-11-09T03:29:28.209 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31"
2023-11-09T03:29:28.210 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-11-09T03:29:28.210 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://www.redhat.com/"
2023-11-09T03:29:28.210 INFO:teuthology.orchestra.run.smithi079.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-09T03:29:28.210 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-09T03:29:28.210 INFO:teuthology.orchestra.run.smithi079.stdout:
2023-11-09T03:29:28.211 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-09T03:29:28.211 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-11-09T03:29:28.211 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-09T03:29:28.211 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-11-09T03:29:28.212 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server
2023-11-09T03:29:28.236 INFO:teuthology.lock.ops:Updating [smithi119.front.sepia.ceph.com]: set os type and version on server
2023-11-09T03:29:28.236 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com'
2023-11-09T03:29:28.237 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T03:29:28.304 DEBUG:teuthology.orchestra.run.smithi119:> true
2023-11-09T03:29:28.436 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi119.front.sepia.ceph.com'
2023-11-09T03:29:28.436 DEBUG:teuthology.orchestra.run.smithi119:> uname -m
2023-11-09T03:29:28.493 INFO:teuthology.orchestra.run.smithi119.stdout:x86_64
2023-11-09T03:29:28.494 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release
2023-11-09T03:29:28.550 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="Red Hat Enterprise Linux"
2023-11-09T03:29:28.550 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="8.6 (Ootpa)"
2023-11-09T03:29:28.551 INFO:teuthology.orchestra.run.smithi119.stdout:ID="rhel"
2023-11-09T03:29:28.551 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="fedora"
2023-11-09T03:29:28.551 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="8.6"
2023-11-09T03:29:28.551 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el8"
2023-11-09T03:29:28.551 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-11-09T03:29:28.552 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31"
2023-11-09T03:29:28.552 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-11-09T03:29:28.552 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://www.redhat.com/"
2023-11-09T03:29:28.552 INFO:teuthology.orchestra.run.smithi119.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-09T03:29:28.552 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-09T03:29:28.553 INFO:teuthology.orchestra.run.smithi119.stdout:
2023-11-09T03:29:28.553 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-09T03:29:28.553 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-11-09T03:29:28.553 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-09T03:29:28.553 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-11-09T03:29:28.554 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server
2023-11-09T03:29:28.578 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T03:29:28.687 INFO:teuthology.dispatcher.supervisor:Running job 7452452
2023-11-09T03:29:28.688 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2023-11-09_02:25:01-upgrade:reef-x-main-distro-default-smithi/7452452 --name teuthology-2023-11-09_02:25:01-upgrade:reef-x-main-distro-default-smithi --description upgrade:reef-x/stress-split/{0-distro/rhel_8.6_container_tools_3.0 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} -- /home/teuthworker/archive/teuthology-2023-11-09_02:25:01-upgrade:reef-x-main-distro-default-smithi/7452452/orig.config.yaml
2023-11-09T03:29:28.695 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2023-11-09_02:25:01-upgrade:reef-x-main-distro-default-smithi/7452452
2023-11-09T03:29:28.696 INFO:teuthology.dispatcher.supervisor:Job PID: 1011076
2023-11-09T03:29:28.696 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-11-09T03:31:28.794 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T03:33:28.971 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T03:35:29.148 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T03:37:29.325 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T03:39:29.487 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T03:41:29.651 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T03:43:29.815 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T03:45:29.976 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T03:47:30.139 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T03:49:30.285 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T03:49:30.353 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-11-09T03:49:30.477 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-11-09T03:49:30.477 INFO:teuthology.nuke:Checking targets against current locks
2023-11-09T03:49:30.526 DEBUG:teuthology.nuke:shortname: smithi079
2023-11-09T03:49:30.527 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-09T03:49:30.545 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi079.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-11-09_02:25:01-upgrade:reef-x-main-distro-default-smithi/7452452', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-09 03:24:29.661573', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}
2023-11-09T03:49:30.551 DEBUG:teuthology.nuke:shortname: smithi119
2023-11-09T03:49:30.551 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-09T03:49:30.572 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi119.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-11-09_02:25:01-upgrade:reef-x-main-distro-default-smithi/7452452', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-09 03:24:29.659779', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}
2023-11-09T03:49:30.597 INFO:teuthology.orchestra.console.smithi079:Power off
2023-11-09T03:49:30.598 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-09T03:49:30.619 DEBUG:teuthology.orchestra.console.smithi079:power off output: Chassis Power Control: Down/Off
2023-11-09T03:49:30.620 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T03:49:30.633 INFO:teuthology.orchestra.console.smithi119:Power off
2023-11-09T03:49:30.634 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-09T03:49:30.641 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off
2023-11-09T03:49:30.653 DEBUG:teuthology.orchestra.console.smithi119:power off output: Chassis Power Control: Down/Off
2023-11-09T03:49:30.654 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T03:49:30.673 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off
2023-11-09T03:49:30.743 INFO:teuthology.orchestra.console.smithi079:Power off completed
2023-11-09T03:49:30.774 INFO:teuthology.orchestra.console.smithi119:Power off completed
2023-11-09T03:49:30.885 INFO:teuthology.lock.ops:unlocked: smithi079.front.sepia.ceph.com
2023-11-09T03:49:30.921 INFO:teuthology.lock.ops:unlocked: smithi119.front.sepia.ceph.com