2023-10-09T03:49:49.420 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc
2023-10-09T03:49:49.420 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T03:49:49.562 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f1296c74a30>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f129775f670>, signals=[15])
2023-10-09T03:49:49.562 INFO:teuthology.lock.ops:Start node 'smithi148.front.sepia.ceph.com' reimaging
2023-10-09T03:49:49.562 INFO:teuthology.lock.ops:Updating [smithi148.front.sepia.ceph.com]: reset os type and version on server
2023-10-09T03:49:49.563 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server
2023-10-09T03:49:49.593 INFO:teuthology.lock.ops:Start node 'smithi187.front.sepia.ceph.com' reimaging
2023-10-09T03:49:49.594 INFO:teuthology.lock.ops:Updating [smithi187.front.sepia.ceph.com]: reset os type and version on server
2023-10-09T03:49:49.594 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server
2023-10-09T03:49:49.595 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /host {"name": "smithi148"}
2023-10-09T03:49:49.618 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /host {"name": "smithi187"}
2023-10-09T03:49:49.662 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-10-09T03:49:49.687 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-10-09T03:49:49.699 DEBUG:teuthology.provision.fog.smithi148:Requesting image smithi_centos_8.stream (ID 3)
2023-10-09T03:49:49.699 DEBUG:teuthology.provision.fog.smithi148:FOG request: PUT /host/253 {"imageID": 3}
2023-10-09T03:49:49.726 DEBUG:teuthology.provision.fog.smithi187:Requesting image smithi_centos_8.stream (ID 3)
2023-10-09T03:49:49.726 DEBUG:teuthology.provision.fog.smithi187:FOG request: PUT /host/292 {"imageID": 3}
2023-10-09T03:49:49.749 INFO:teuthology.provision.fog.smithi148:Scheduling deploy of centos 8.stream
2023-10-09T03:49:49.750 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None
2023-10-09T03:49:49.769 INFO:teuthology.provision.fog.smithi187:Scheduling deploy of centos 8.stream
2023-10-09T03:49:49.769 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None
2023-10-09T03:49:49.806 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /tasktype {"name": "deploy"}
2023-10-09T03:49:49.827 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /tasktype {"name": "deploy"}
2023-10-09T03:49:49.841 DEBUG:teuthology.provision.fog.smithi148:FOG request: POST /host/253/task {"taskTypeID": 1}
2023-10-09T03:49:49.862 DEBUG:teuthology.provision.fog.smithi187:FOG request: POST /host/292/task {"taskTypeID": 1}
2023-10-09T03:49:49.895 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None
2023-10-09T03:49:49.915 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None
2023-10-09T03:49:49.993 INFO:teuthology.orchestra.console.smithi148:Power off
2023-10-09T03:49:49.993 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-09T03:49:50.005 INFO:teuthology.orchestra.console.smithi187:Power off
2023-10-09T03:49:50.006 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-09T03:49:50.017 DEBUG:teuthology.orchestra.console.smithi148:power off output: Chassis Power Control: Down/Off
2023-10-09T03:49:50.017 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-09T03:49:50.027 DEBUG:teuthology.orchestra.console.smithi187:power off output: Chassis Power Control: Down/Off
2023-10-09T03:49:50.027 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-09T03:49:50.040 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on
2023-10-09T03:49:50.049 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on
2023-10-09T03:49:54.042 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-09T03:49:54.050 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-09T03:49:54.151 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on
2023-10-09T03:49:54.158 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on
2023-10-09T03:49:58.155 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-09T03:49:58.161 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-09T03:49:58.264 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on
2023-10-09T03:49:58.270 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on
2023-10-09T03:50:02.266 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-09T03:50:02.273 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-09T03:50:02.375 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off
2023-10-09T03:50:02.380 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off
2023-10-09T03:50:02.476 INFO:teuthology.orchestra.console.smithi148:Power off completed
2023-10-09T03:50:02.481 INFO:teuthology.orchestra.console.smithi187:Power off completed
2023-10-09T03:50:02.577 INFO:teuthology.orchestra.console.smithi148:Power on
2023-10-09T03:50:02.577 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-10-09T03:50:02.584 INFO:teuthology.orchestra.console.smithi187:Power on
2023-10-09T03:50:02.584 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-10-09T03:50:02.599 DEBUG:teuthology.orchestra.console.smithi148:power on output: Chassis Power Control: Up/On
2023-10-09T03:50:02.599 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-09T03:50:02.606 DEBUG:teuthology.orchestra.console.smithi187:power on output: Chassis Power Control: Up/On
2023-10-09T03:50:02.607 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-09T03:50:02.618 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off
2023-10-09T03:50:02.625 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off
2023-10-09T03:50:06.622 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-09T03:50:06.629 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-09T03:50:06.731 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on
2023-10-09T03:50:06.737 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on
2023-10-09T03:50:06.832 INFO:teuthology.orchestra.console.smithi148:Power on completed
2023-10-09T03:50:06.838 INFO:teuthology.orchestra.console.smithi187:Power on completed
2023-10-09T03:50:06.933 INFO:teuthology.provision.fog.smithi148:Waiting for deploy to finish
2023-10-09T03:50:06.933 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None
2023-10-09T03:50:06.939 INFO:teuthology.provision.fog.smithi187:Waiting for deploy to finish
2023-10-09T03:50:06.939 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None
2023-10-09T03:50:22.016 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None
2023-10-09T03:50:22.018 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None
2023-10-09T03:50:37.092 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None
2023-10-09T03:50:37.093 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None
2023-10-09T03:50:52.184 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None
2023-10-09T03:50:52.185 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None
2023-10-09T03:51:07.262 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None
2023-10-09T03:51:07.263 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None
2023-10-09T03:51:22.341 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None
2023-10-09T03:51:22.342 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None
2023-10-09T03:51:37.414 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None
2023-10-09T03:51:37.416 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None
2023-10-09T03:51:52.490 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None
2023-10-09T03:51:52.491 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None
2023-10-09T03:52:07.566 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None
2023-10-09T03:52:07.568 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None
2023-10-09T03:52:22.650 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None
2023-10-09T03:52:22.651 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None
2023-10-09T03:52:37.714 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None
2023-10-09T03:52:37.715 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None
2023-10-09T03:52:52.782 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None
2023-10-09T03:52:52.783 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None
2023-10-09T03:52:52.835 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-09T03:52:52.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-09T03:53:11.290 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187
2023-10-09T03:53:11.291 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148
2023-10-09T03:53:17.294 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-09T03:53:17.296 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-09T03:53:20.346 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187
2023-10-09T03:53:20.347 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148
2023-10-09T03:53:26.350 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-09T03:53:26.353 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-09T03:53:29.402 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187
2023-10-09T03:53:29.434 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148
2023-10-09T03:53:35.407 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-09T03:53:35.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-09T03:53:38.458 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187
2023-10-09T03:53:38.494 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148
2023-10-09T03:53:44.464 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-09T03:53:44.495 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-09T03:53:47.546 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148
2023-10-09T03:53:53.551 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-09T03:54:44.515 WARNING:teuthology.provision.fog.smithi187:timed out
2023-10-09T03:54:50.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-09T03:54:50.748 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-10-09T03:54:50.748 DEBUG:teuthology.orchestra.run.smithi187:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-10-09T03:54:51.017 INFO:teuthology.provision.fog.smithi187:Node is ready
2023-10-09T03:54:51.018 DEBUG:teuthology.orchestra.run.smithi187:> hostname
2023-10-09T03:54:51.038 INFO:teuthology.orchestra.run.smithi187.stdout:smithi187.front.sepia.ceph.com
2023-10-09T03:54:51.038 DEBUG:teuthology.orchestra.run.smithi187:> grep smithi187.front.sepia.ceph.com /etc/hosts
2023-10-09T03:54:51.098 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.15.187 smithi187.front.sepia.ceph.com smithi187
2023-10-09T03:54:51.098 DEBUG:teuthology.orchestra.run.smithi187:> sudo hostname smithi187
2023-10-09T03:54:51.206 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/smithi187.front.sepia.ceph.com/smithi187/g' /etc/hosts
2023-10-09T03:54:51.236 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/172.21.15.187/172.21.15.187/g' /etc/hosts
2023-10-09T03:54:51.305 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/smithi187.front.sepia.ceph.com/smithi187/g' /etc/hostname
2023-10-09T03:54:51.376 DEBUG:teuthology.orchestra.run.smithi187:> sudo hostname smithi187
2023-10-09T03:54:51.444 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release
2023-10-09T03:54:51.502 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="CentOS Stream"
2023-10-09T03:54:51.502 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="8"
2023-10-09T03:54:51.502 INFO:teuthology.orchestra.run.smithi187.stdout:ID="centos"
2023-10-09T03:54:51.502 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE="rhel fedora"
2023-10-09T03:54:51.502 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="8"
2023-10-09T03:54:51.502 INFO:teuthology.orchestra.run.smithi187.stdout:PLATFORM_ID="platform:el8"
2023-10-09T03:54:51.502 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="CentOS Stream 8"
2023-10-09T03:54:51.502 INFO:teuthology.orchestra.run.smithi187.stdout:ANSI_COLOR="0;31"
2023-10-09T03:54:51.503 INFO:teuthology.orchestra.run.smithi187.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-10-09T03:54:51.503 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://centos.org/"
2023-10-09T03:54:51.503 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-09T03:54:51.503 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-10-09T03:54:51.503 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-10-09T03:54:51.504 INFO:teuthology.provision.fog.smithi187:Deploy complete!
2023-10-09T03:54:51.505 DEBUG:teuthology.parallel:result is None
2023-10-09T03:54:53.554 WARNING:teuthology.provision.fog.smithi148:timed out
2023-10-09T03:54:59.558 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-09T03:54:59.771 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-10-09T03:54:59.771 DEBUG:teuthology.orchestra.run.smithi148:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-10-09T03:55:00.049 INFO:teuthology.provision.fog.smithi148:Node is ready
2023-10-09T03:55:00.050 DEBUG:teuthology.orchestra.run.smithi148:> hostname
2023-10-09T03:55:00.069 INFO:teuthology.orchestra.run.smithi148.stdout:smithi148.front.sepia.ceph.com
2023-10-09T03:55:00.069 DEBUG:teuthology.orchestra.run.smithi148:> grep smithi148.front.sepia.ceph.com /etc/hosts
2023-10-09T03:55:00.129 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148 smithi148.front.sepia.ceph.com smithi148
2023-10-09T03:55:00.129 DEBUG:teuthology.orchestra.run.smithi148:> sudo hostname smithi148
2023-10-09T03:55:00.232 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/smithi148.front.sepia.ceph.com/smithi148/g' /etc/hosts
2023-10-09T03:55:00.262 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/172.21.15.148/172.21.15.148/g' /etc/hosts
2023-10-09T03:55:00.331 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/smithi148.front.sepia.ceph.com/smithi148/g' /etc/hostname
2023-10-09T03:55:00.400 DEBUG:teuthology.orchestra.run.smithi148:> sudo hostname smithi148
2023-10-09T03:55:00.467 DEBUG:teuthology.orchestra.run.smithi148:> cat /etc/os-release
2023-10-09T03:55:00.524 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="CentOS Stream"
2023-10-09T03:55:00.525 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="8"
2023-10-09T03:55:00.525 INFO:teuthology.orchestra.run.smithi148.stdout:ID="centos"
2023-10-09T03:55:00.525 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE="rhel fedora"
2023-10-09T03:55:00.525 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="8"
2023-10-09T03:55:00.525 INFO:teuthology.orchestra.run.smithi148.stdout:PLATFORM_ID="platform:el8"
2023-10-09T03:55:00.525 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="CentOS Stream 8"
2023-10-09T03:55:00.525 INFO:teuthology.orchestra.run.smithi148.stdout:ANSI_COLOR="0;31"
2023-10-09T03:55:00.525 INFO:teuthology.orchestra.run.smithi148.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-10-09T03:55:00.525 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://centos.org/"
2023-10-09T03:55:00.525 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-09T03:55:00.526 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-10-09T03:55:00.526 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-10-09T03:55:00.526 INFO:teuthology.provision.fog.smithi148:Deploy complete!
2023-10-09T03:55:00.526 DEBUG:teuthology.parallel:result is None
2023-10-09T03:55:00.700 INFO:teuthology.lock.ops:Checking smithi148.front.sepia.ceph.com
2023-10-09T03:55:00.701 INFO:teuthology.lock.ops:New key found. Updating...
2023-10-09T03:55:00.730 INFO:teuthology.lock.ops:Checking smithi187.front.sepia.ceph.com
2023-10-09T03:55:00.730 INFO:teuthology.lock.ops:New key found. Updating...
2023-10-09T03:55:00.755 INFO:teuthology.lock.ops:Updating [smithi148.front.sepia.ceph.com]: set os type and version on server
2023-10-09T03:55:00.755 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com'
2023-10-09T03:55:00.756 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-09T03:55:00.821 DEBUG:teuthology.orchestra.run.smithi148:> true
2023-10-09T03:55:00.888 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi148.front.sepia.ceph.com'
2023-10-09T03:55:00.888 DEBUG:teuthology.orchestra.run.smithi148:> uname -m
2023-10-09T03:55:00.945 INFO:teuthology.orchestra.run.smithi148.stdout:x86_64
2023-10-09T03:55:00.946 DEBUG:teuthology.orchestra.run.smithi148:> cat /etc/os-release
2023-10-09T03:55:01.003 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="CentOS Stream"
2023-10-09T03:55:01.004 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="8"
2023-10-09T03:55:01.004 INFO:teuthology.orchestra.run.smithi148.stdout:ID="centos"
2023-10-09T03:55:01.004 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE="rhel fedora"
2023-10-09T03:55:01.004 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="8"
2023-10-09T03:55:01.004 INFO:teuthology.orchestra.run.smithi148.stdout:PLATFORM_ID="platform:el8"
2023-10-09T03:55:01.004 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="CentOS Stream 8"
2023-10-09T03:55:01.004 INFO:teuthology.orchestra.run.smithi148.stdout:ANSI_COLOR="0;31"
2023-10-09T03:55:01.004 INFO:teuthology.orchestra.run.smithi148.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-10-09T03:55:01.004 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://centos.org/"
2023-10-09T03:55:01.004 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-09T03:55:01.004 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-10-09T03:55:01.005 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-10-09T03:55:01.005 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server
2023-10-09T03:55:01.029 INFO:teuthology.lock.ops:Updating [smithi187.front.sepia.ceph.com]: set os type and version on server
2023-10-09T03:55:01.029 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com'
2023-10-09T03:55:01.029 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-09T03:55:01.095 DEBUG:teuthology.orchestra.run.smithi187:> true
2023-10-09T03:55:01.167 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi187.front.sepia.ceph.com'
2023-10-09T03:55:01.167 DEBUG:teuthology.orchestra.run.smithi187:> uname -m
2023-10-09T03:55:01.229 INFO:teuthology.orchestra.run.smithi187.stdout:x86_64
2023-10-09T03:55:01.229 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release
2023-10-09T03:55:01.290 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="CentOS Stream"
2023-10-09T03:55:01.291 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="8"
2023-10-09T03:55:01.291 INFO:teuthology.orchestra.run.smithi187.stdout:ID="centos"
2023-10-09T03:55:01.291 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE="rhel fedora"
2023-10-09T03:55:01.291 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="8"
2023-10-09T03:55:01.291 INFO:teuthology.orchestra.run.smithi187.stdout:PLATFORM_ID="platform:el8"
2023-10-09T03:55:01.291 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="CentOS Stream 8"
2023-10-09T03:55:01.291 INFO:teuthology.orchestra.run.smithi187.stdout:ANSI_COLOR="0;31"
2023-10-09T03:55:01.291 INFO:teuthology.orchestra.run.smithi187.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-10-09T03:55:01.291 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://centos.org/"
2023-10-09T03:55:01.291 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-09T03:55:01.291 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-10-09T03:55:01.292 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-10-09T03:55:01.292 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server
2023-10-09T03:55:01.312 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T03:55:01.409 INFO:teuthology.dispatcher.supervisor:Running job 7417460
2023-10-09T03:55:01.409 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2023-10-07_14:23:11-upgrade:pacific-x-reef-distro-default-smithi/7417460 --name teuthology-2023-10-07_14:23:11-upgrade:pacific-x-reef-distro-default-smithi --description upgrade:pacific-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} -- /home/teuthworker/archive/teuthology-2023-10-07_14:23:11-upgrade:pacific-x-reef-distro-default-smithi/7417460/orig.config.yaml
2023-10-09T03:55:01.412 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2023-10-07_14:23:11-upgrade:pacific-x-reef-distro-default-smithi/7417460
2023-10-09T03:55:01.413 INFO:teuthology.dispatcher.supervisor:Job PID: 526570
2023-10-09T03:55:01.413 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-10-09T03:57:01.512 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T03:59:01.699 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T04:01:01.963 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T04:03:02.126 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T04:05:02.287 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T04:07:02.443 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T04:09:02.643 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T04:11:02.799 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T04:13:02.956 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T04:15:03.121 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T04:17:03.283 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T04:19:03.451 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T04:21:03.609 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T04:23:03.768 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T04:25:03.935 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T04:27:04.095 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T04:29:04.335 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T04:31:04.506 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T04:33:04.675 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T04:35:04.839 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T04:37:05.004 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T04:39:05.195 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T04:41:05.367 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T04:43:05.438 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T04:45:05.599 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T04:47:05.771 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T04:49:05.943 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T04:51:06.109 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T04:53:06.275 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T04:55:06.439 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T04:57:06.606 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T04:59:06.811 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T05:01:06.979 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T05:03:07.139 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T05:05:07.309 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T05:07:07.483 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T05:09:07.647 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T05:11:07.811 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T05:13:07.967 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T05:13:08.034 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-10-09T05:13:08.245 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-10-09T05:13:08.245 INFO:teuthology.nuke:Checking targets against current locks
2023-10-09T05:13:08.295 DEBUG:teuthology.nuke:shortname: smithi148
2023-10-09T05:13:08.295 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-10-09T05:13:08.315 DEBUG:teuthology.nuke:shortname: smithi187
2023-10-09T05:13:08.315 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-10-09T05:13:08.318 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi148.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-10-07_14:23:11-upgrade:pacific-x-reef-distro-default-smithi/7417460', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-09 03:49:48.446029', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBIw3DoO0ETodQB8zkhjt3tQyaZeLNnOhhJrobOdxdizG5O0pmxZXN6ehBBZRLGgQ9SvBk/uRNYiivhVu6ST+Bw='}
2023-10-09T05:13:08.342 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi187.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-10-07_14:23:11-upgrade:pacific-x-reef-distro-default-smithi/7417460', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-09 03:49:48.444280', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG9n+GQ3ut4a2kutcR5W8cbhqcl4FbQgp304qq4itE/jonVBPdKUA/RtRe1SxGs2IycAOq6Omlr0ZbHRXEBGph4='}
2023-10-09T05:13:08.374 INFO:teuthology.orchestra.console.smithi148:Power off
2023-10-09T05:13:08.375 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-09T05:13:08.388 INFO:teuthology.orchestra.console.smithi187:Power off
2023-10-09T05:13:08.388 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-09T05:13:08.396 DEBUG:teuthology.orchestra.console.smithi148:power off output: Chassis Power Control: Down/Off
2023-10-09T05:13:08.396 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-09T05:13:08.408 DEBUG:teuthology.orchestra.console.smithi187:power off output: Chassis Power Control: Down/Off
2023-10-09T05:13:08.408 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-09T05:13:08.418 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off
2023-10-09T05:13:08.429 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off
2023-10-09T05:13:08.519 INFO:teuthology.orchestra.console.smithi148:Power off completed
2023-10-09T05:13:08.530 INFO:teuthology.orchestra.console.smithi187:Power off completed
2023-10-09T05:13:08.676 INFO:teuthology.lock.ops:unlocked: smithi187.front.sepia.ceph.com
2023-10-09T05:13:08.684 INFO:teuthology.lock.ops:unlocked: smithi148.front.sepia.ceph.com