2023-10-09T07:53:51.305 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc
2023-10-09T07:53:51.306 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T07:53:51.453 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f3011dc5b80>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f3011b02f70>, signals=[15])
2023-10-09T07:53:51.453 INFO:teuthology.lock.ops:Start node 'smithi099.front.sepia.ceph.com' reimaging
2023-10-09T07:53:51.453 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: reset os type and version on server
2023-10-09T07:53:51.453 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server
2023-10-09T07:53:51.471 INFO:teuthology.lock.ops:Start node 'smithi152.front.sepia.ceph.com' reimaging
2023-10-09T07:53:51.471 INFO:teuthology.lock.ops:Updating [smithi152.front.sepia.ceph.com]: reset os type and version on server
2023-10-09T07:53:51.471 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server
2023-10-09T07:53:51.473 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /host {"name": "smithi099"}
2023-10-09T07:53:51.496 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /host {"name": "smithi152"}
2023-10-09T07:53:51.550 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-10-09T07:53:51.573 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-10-09T07:53:51.590 DEBUG:teuthology.provision.fog.smithi099:Requesting image smithi_centos_8.stream (ID 3)
2023-10-09T07:53:51.590 DEBUG:teuthology.provision.fog.smithi099:FOG request: PUT /host/204 {"imageID": 3}
2023-10-09T07:53:51.615 DEBUG:teuthology.provision.fog.smithi152:Requesting image smithi_centos_8.stream (ID 3)
2023-10-09T07:53:51.615 DEBUG:teuthology.provision.fog.smithi152:FOG request: PUT /host/257 {"imageID": 3}
2023-10-09T07:53:51.637 INFO:teuthology.provision.fog.smithi099:Scheduling deploy of centos 8.stream
2023-10-09T07:53:51.638 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-10-09T07:53:51.654 INFO:teuthology.provision.fog.smithi152:Scheduling deploy of centos 8.stream
2023-10-09T07:53:51.654 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None
2023-10-09T07:53:51.688 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /tasktype {"name": "deploy"}
2023-10-09T07:53:51.701 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /tasktype {"name": "deploy"}
2023-10-09T07:53:51.727 DEBUG:teuthology.provision.fog.smithi099:FOG request: POST /host/204/task {"taskTypeID": 1}
2023-10-09T07:53:51.735 DEBUG:teuthology.provision.fog.smithi152:FOG request: POST /host/257/task {"taskTypeID": 1}
2023-10-09T07:53:51.784 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-10-09T07:53:51.874 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None
2023-10-09T07:53:51.928 INFO:teuthology.orchestra.console.smithi099:Power off
2023-10-09T07:53:51.928 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-09T07:53:51.948 DEBUG:teuthology.orchestra.console.smithi099:power off output: Chassis Power Control: Down/Off
2023-10-09T07:53:51.948 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-09T07:53:51.965 INFO:teuthology.orchestra.console.smithi152:Power off
2023-10-09T07:53:51.965 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-09T07:53:51.973 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off
2023-10-09T07:53:51.986 DEBUG:teuthology.orchestra.console.smithi152:power off output: Chassis Power Control: Down/Off
2023-10-09T07:53:51.986 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-09T07:53:52.008 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off
2023-10-09T07:53:52.075 INFO:teuthology.orchestra.console.smithi099:Power off completed
2023-10-09T07:53:52.109 INFO:teuthology.orchestra.console.smithi152:Power off completed
2023-10-09T07:53:52.176 INFO:teuthology.orchestra.console.smithi099:Power on
2023-10-09T07:53:52.176 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-10-09T07:53:52.198 DEBUG:teuthology.orchestra.console.smithi099:power on output: Chassis Power Control: Up/On
2023-10-09T07:53:52.198 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-09T07:53:52.210 INFO:teuthology.orchestra.console.smithi152:Power on
2023-10-09T07:53:52.210 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-10-09T07:53:52.220 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off
2023-10-09T07:53:52.232 DEBUG:teuthology.orchestra.console.smithi152:power on output: Chassis Power Control: Up/On
2023-10-09T07:53:52.232 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-09T07:53:52.253 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off
2023-10-09T07:53:56.225 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-09T07:53:56.254 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-09T07:53:56.334 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off
2023-10-09T07:53:56.360 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off
2023-10-09T07:54:00.338 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-09T07:54:00.361 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-09T07:54:00.447 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on
2023-10-09T07:54:00.468 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on
2023-10-09T07:54:00.548 INFO:teuthology.orchestra.console.smithi099:Power on completed
2023-10-09T07:54:00.569 INFO:teuthology.orchestra.console.smithi152:Power on completed
2023-10-09T07:54:00.649 INFO:teuthology.provision.fog.smithi099:Waiting for deploy to finish
2023-10-09T07:54:00.649 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-10-09T07:54:00.670 INFO:teuthology.provision.fog.smithi152:Waiting for deploy to finish
2023-10-09T07:54:00.670 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None
2023-10-09T07:54:15.718 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-10-09T07:54:15.725 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None
2023-10-09T07:54:30.787 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-10-09T07:54:30.788 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None
2023-10-09T07:54:45.862 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None
2023-10-09T07:54:45.864 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-10-09T07:55:00.930 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-10-09T07:55:00.931 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None
2023-10-09T07:55:15.998 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-10-09T07:55:15.999 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None
2023-10-09T07:55:31.070 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-10-09T07:55:31.072 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None
2023-10-09T07:55:46.138 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-10-09T07:55:46.141 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None
2023-10-09T07:56:01.212 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None
2023-10-09T07:56:01.595 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-10-09T07:56:16.678 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-10-09T07:56:16.680 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None
2023-10-09T07:56:31.755 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-10-09T07:56:31.816 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-09T07:56:31.924 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None
2023-10-09T07:56:32.313 ERROR:teuthology.orchestra.connection:Error authenticating with smithi099.front.sepia.ceph.com: Authentication failed.
2023-10-09T07:56:32.314 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-10-09T07:56:32.314 DEBUG:teuthology.orchestra.run.smithi099:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-10-09T07:56:32.315 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-10-09T07:56:46.981 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None
2023-10-09T07:56:47.033 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-09T07:57:05.530 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152
2023-10-09T07:57:11.531 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-09T07:57:14.586 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152
2023-10-09T07:57:20.587 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-09T07:57:23.642 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152
2023-10-09T07:57:29.645 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-09T07:57:32.701 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152
2023-10-09T07:57:38.703 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-09T07:57:41.754 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152
2023-10-09T07:57:47.755 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-09T07:58:47.758 WARNING:teuthology.provision.fog.smithi152:timed out
2023-10-09T07:58:53.759 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-09T07:58:54.050 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-10-09T07:58:54.050 DEBUG:teuthology.orchestra.run.smithi152:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-10-09T07:58:54.299 INFO:teuthology.provision.fog.smithi152:Node is ready
2023-10-09T07:58:54.299 DEBUG:teuthology.orchestra.run.smithi152:> hostname
2023-10-09T07:58:54.317 INFO:teuthology.orchestra.run.smithi152.stdout:smithi152.front.sepia.ceph.com
2023-10-09T07:58:54.317 DEBUG:teuthology.orchestra.run.smithi152:> grep smithi152.front.sepia.ceph.com /etc/hosts
2023-10-09T07:58:54.376 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152 smithi152.front.sepia.ceph.com smithi152
2023-10-09T07:58:54.376 DEBUG:teuthology.orchestra.run.smithi152:> sudo hostname smithi152
2023-10-09T07:58:54.479 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/smithi152.front.sepia.ceph.com/smithi152/g' /etc/hosts
2023-10-09T07:58:54.507 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/172.21.15.152/172.21.15.152/g' /etc/hosts
2023-10-09T07:58:54.574 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/smithi152.front.sepia.ceph.com/smithi152/g' /etc/hostname
2023-10-09T07:58:54.642 DEBUG:teuthology.orchestra.run.smithi152:> sudo hostname smithi152
2023-10-09T07:58:54.709 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release
2023-10-09T07:58:54.767 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="CentOS Stream"
2023-10-09T07:58:54.767 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="8"
2023-10-09T07:58:54.767 INFO:teuthology.orchestra.run.smithi152.stdout:ID="centos"
2023-10-09T07:58:54.767 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="rhel fedora"
2023-10-09T07:58:54.767 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="8"
2023-10-09T07:58:54.767 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM_ID="platform:el8"
2023-10-09T07:58:54.767 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="CentOS Stream 8"
2023-10-09T07:58:54.767 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31"
2023-10-09T07:58:54.768 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-10-09T07:58:54.768 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://centos.org/"
2023-10-09T07:58:54.768 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-09T07:58:54.768 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-10-09T07:58:54.768 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-10-09T07:58:54.768 INFO:teuthology.provision.fog.smithi152:Deploy complete!
2023-10-09T07:58:54.769 DEBUG:teuthology.parallel:result is None
2023-10-09T07:59:00.730 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2023-10-09T07:59:00.731 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi099
2023-10-09T07:59:09.732 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com'
2023-10-09T07:59:09.733 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-09T07:59:10.030 DEBUG:teuthology.orchestra.run.smithi099:> true
2023-10-09T07:59:10.297 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com'
2023-10-09T07:59:10.298 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-10-09T07:59:10.298 DEBUG:teuthology.orchestra.run.smithi099:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-10-09T07:59:10.316 INFO:teuthology.provision.fog.smithi099:Node is ready
2023-10-09T07:59:10.317 DEBUG:teuthology.orchestra.run.smithi099:> hostname
2023-10-09T07:59:10.375 INFO:teuthology.orchestra.run.smithi099.stdout:smithi099.front.sepia.ceph.com
2023-10-09T07:59:10.376 DEBUG:teuthology.orchestra.run.smithi099:> grep smithi099.front.sepia.ceph.com /etc/hosts
2023-10-09T07:59:10.434 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99 smithi099.front.sepia.ceph.com smithi099
2023-10-09T07:59:10.435 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099
2023-10-09T07:59:10.524 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hosts
2023-10-09T07:59:10.552 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/172.21.15.99/172.21.15.99/g' /etc/hosts
2023-10-09T07:59:10.620 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hostname
2023-10-09T07:59:10.687 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099
2023-10-09T07:59:10.754 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release
2023-10-09T07:59:10.811 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="CentOS Stream"
2023-10-09T07:59:10.811 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="8"
2023-10-09T07:59:10.811 INFO:teuthology.orchestra.run.smithi099.stdout:ID="centos"
2023-10-09T07:59:10.811 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="rhel fedora"
2023-10-09T07:59:10.811 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="8"
2023-10-09T07:59:10.811 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el8"
2023-10-09T07:59:10.812 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="CentOS Stream 8"
2023-10-09T07:59:10.812 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31"
2023-10-09T07:59:10.812 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-10-09T07:59:10.812 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://centos.org/"
2023-10-09T07:59:10.812 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-09T07:59:10.812 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-10-09T07:59:10.812 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-10-09T07:59:10.812 INFO:teuthology.provision.fog.smithi099:Deploy complete!
2023-10-09T07:59:10.813 DEBUG:teuthology.parallel:result is None
2023-10-09T07:59:10.958 INFO:teuthology.lock.ops:Checking smithi099.front.sepia.ceph.com
2023-10-09T07:59:10.959 INFO:teuthology.lock.ops:New key found. Updating...
2023-10-09T07:59:10.983 INFO:teuthology.lock.ops:Checking smithi152.front.sepia.ceph.com
2023-10-09T07:59:10.983 INFO:teuthology.lock.ops:New key found. Updating...
2023-10-09T07:59:11.000 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: set os type and version on server
2023-10-09T07:59:11.000 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com'
2023-10-09T07:59:11.000 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-09T07:59:11.066 DEBUG:teuthology.orchestra.run.smithi099:> true
2023-10-09T07:59:11.135 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com'
2023-10-09T07:59:11.135 DEBUG:teuthology.orchestra.run.smithi099:> uname -m
2023-10-09T07:59:11.193 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64
2023-10-09T07:59:11.194 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release
2023-10-09T07:59:11.251 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="CentOS Stream"
2023-10-09T07:59:11.251 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="8"
2023-10-09T07:59:11.251 INFO:teuthology.orchestra.run.smithi099.stdout:ID="centos"
2023-10-09T07:59:11.251 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="rhel fedora"
2023-10-09T07:59:11.251 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="8"
2023-10-09T07:59:11.251 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el8"
2023-10-09T07:59:11.251 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="CentOS Stream 8"
2023-10-09T07:59:11.252 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31"
2023-10-09T07:59:11.252 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-10-09T07:59:11.252 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://centos.org/"
2023-10-09T07:59:11.252 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-09T07:59:11.252 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-10-09T07:59:11.252 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-10-09T07:59:11.252 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server
2023-10-09T07:59:11.274 INFO:teuthology.lock.ops:Updating [smithi152.front.sepia.ceph.com]: set os type and version on server
2023-10-09T07:59:11.274 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com'
2023-10-09T07:59:11.274 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-09T07:59:11.342 DEBUG:teuthology.orchestra.run.smithi152:> true
2023-10-09T07:59:11.416 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi152.front.sepia.ceph.com'
2023-10-09T07:59:11.416 DEBUG:teuthology.orchestra.run.smithi152:> uname -m
2023-10-09T07:59:11.476 INFO:teuthology.orchestra.run.smithi152.stdout:x86_64
2023-10-09T07:59:11.477 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release
2023-10-09T07:59:11.536 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="CentOS Stream"
2023-10-09T07:59:11.536 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="8"
2023-10-09T07:59:11.536 INFO:teuthology.orchestra.run.smithi152.stdout:ID="centos"
2023-10-09T07:59:11.536 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="rhel fedora"
2023-10-09T07:59:11.536 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="8"
2023-10-09T07:59:11.536 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM_ID="platform:el8"
2023-10-09T07:59:11.536 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="CentOS Stream 8"
2023-10-09T07:59:11.536 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31"
2023-10-09T07:59:11.537 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-10-09T07:59:11.537 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://centos.org/"
2023-10-09T07:59:11.537 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-09T07:59:11.537 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-10-09T07:59:11.537 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-10-09T07:59:11.537 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server
2023-10-09T07:59:11.557 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T07:59:11.673 INFO:teuthology.dispatcher.supervisor:Running job 7417581
2023-10-09T07:59:11.673 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2023-10-07_14:23:11-upgrade:pacific-x-reef-distro-default-smithi/7417581 --name teuthology-2023-10-07_14:23:11-upgrade:pacific-x-reef-distro-default-smithi --description upgrade:pacific-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} -- /home/teuthworker/archive/teuthology-2023-10-07_14:23:11-upgrade:pacific-x-reef-distro-default-smithi/7417581/orig.config.yaml
2023-10-09T07:59:11.676 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2023-10-07_14:23:11-upgrade:pacific-x-reef-distro-default-smithi/7417581
2023-10-09T07:59:11.677 INFO:teuthology.dispatcher.supervisor:Job PID: 2064005
2023-10-09T07:59:11.677 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-10-09T08:01:11.751 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T08:03:11.919 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T08:05:12.083 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T08:07:12.247 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T08:09:12.432 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T08:11:12.597 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T08:13:12.781 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T08:15:12.951 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T08:17:13.119 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T08:19:13.283 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T08:21:13.455 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T08:23:13.614 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T08:25:13.776 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T08:27:13.943 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T08:29:14.127 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T08:31:14.290 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T08:33:14.455 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T08:35:14.659 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T08:37:14.823 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T08:39:14.986 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T08:41:15.175 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T08:43:15.375 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T08:45:15.543 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T08:47:15.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T08:49:15.906 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T08:51:16.071 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T08:53:16.235 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T08:55:16.379 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T08:57:16.543 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T08:59:16.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T09:01:16.883 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T09:03:17.047 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T09:05:17.214 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T09:07:17.379 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T09:09:17.546 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T09:11:17.692 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T09:13:17.855 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T09:15:18.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T09:17:18.267 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T09:19:18.422 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T09:21:18.591 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T09:23:18.763 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T09:23:18.830 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-10-09T09:23:19.027 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-10-09T09:23:19.028 INFO:teuthology.nuke:Checking targets against current locks
2023-10-09T09:23:19.075 DEBUG:teuthology.nuke:shortname: smithi099
2023-10-09T09:23:19.075 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-10-09T09:23:19.099 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi099.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-10-07_14:23:11-upgrade:pacific-x-reef-distro-default-smithi/7417581', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-09 07:53:50.399112', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE1A5Dol5zQd9xqboFTajARBh8M0gpeX/Y/WvlXuo8pb2KQ4BsDw4cpqtSoGX7bPYCll1M2/tdrqkHfDEqbXIIg='}
2023-10-09T09:23:19.102 DEBUG:teuthology.nuke:shortname: smithi152
2023-10-09T09:23:19.102 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-10-09T09:23:19.126 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi152.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-10-07_14:23:11-upgrade:pacific-x-reef-distro-default-smithi/7417581', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-09 07:53:50.397655', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLg66ANdyXO+PKsioWi/zYDGL4jdxzXwxPHFjx5AD6FKcX9cybIRHrrezBMoJ7HEy17gO2RytNQKw0Lf1rq75Sg='}
2023-10-09T09:23:19.154 INFO:teuthology.orchestra.console.smithi099:Power off
2023-10-09T09:23:19.154 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-09T09:23:19.175 DEBUG:teuthology.orchestra.console.smithi099:power off output: Chassis Power Control: Down/Off
2023-10-09T09:23:19.176 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-09T09:23:19.191 INFO:teuthology.orchestra.console.smithi152:Power off
2023-10-09T09:23:19.192 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-09T09:23:19.200 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off
2023-10-09T09:23:19.212 DEBUG:teuthology.orchestra.console.smithi152:power off output: Chassis Power Control: Down/Off
2023-10-09T09:23:19.212 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-09T09:23:19.235 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off
2023-10-09T09:23:19.301 INFO:teuthology.orchestra.console.smithi099:Power off completed
2023-10-09T09:23:19.336 INFO:teuthology.orchestra.console.smithi152:Power off completed
2023-10-09T09:23:19.456 INFO:teuthology.lock.ops:unlocked: smithi099.front.sepia.ceph.com
2023-10-09T09:23:19.479 INFO:teuthology.lock.ops:unlocked: smithi152.front.sepia.ceph.com