2023-09-16T15:53:54.676 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc
2023-09-16T15:53:54.678 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T15:53:54.812 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f2a81e22cd0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f2a816def70>, signals=[15])
2023-09-16T15:53:54.813 INFO:teuthology.lock.ops:Start node 'smithi050.front.sepia.ceph.com' reimaging
2023-09-16T15:53:54.813 INFO:teuthology.lock.ops:Updating [smithi050.front.sepia.ceph.com]: reset os type and version on server
2023-09-16T15:53:54.814 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server
2023-09-16T15:53:54.837 INFO:teuthology.lock.ops:Start node 'smithi155.front.sepia.ceph.com' reimaging
2023-09-16T15:53:54.838 INFO:teuthology.lock.ops:Updating [smithi155.front.sepia.ceph.com]: reset os type and version on server
2023-09-16T15:53:54.838 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server
2023-09-16T15:53:54.839 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /host {"name": "smithi050"}
2023-09-16T15:53:54.862 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /host {"name": "smithi155"}
2023-09-16T15:53:54.909 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-09-16T15:53:54.926 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-09-16T15:53:54.945 DEBUG:teuthology.provision.fog.smithi050:Requesting image smithi_centos_8.stream (ID 3)
2023-09-16T15:53:54.946 DEBUG:teuthology.provision.fog.smithi050:FOG request: PUT /host/155 {"imageID": 3}
2023-09-16T15:53:54.986 DEBUG:teuthology.provision.fog.smithi155:Requesting image smithi_centos_8.stream (ID 3)
2023-09-16T15:53:54.986 DEBUG:teuthology.provision.fog.smithi155:FOG request: PUT /host/260 {"imageID": 3}
2023-09-16T15:53:55.009 INFO:teuthology.provision.fog.smithi050:Scheduling deploy of centos 8.stream
2023-09-16T15:53:55.009 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None
2023-09-16T15:53:55.034 INFO:teuthology.provision.fog.smithi155:Scheduling deploy of centos 8.stream
2023-09-16T15:53:55.035 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None
2023-09-16T15:53:55.058 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /tasktype {"name": "deploy"}
2023-09-16T15:53:55.081 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /tasktype {"name": "deploy"}
2023-09-16T15:53:55.098 DEBUG:teuthology.provision.fog.smithi050:FOG request: POST /host/155/task {"taskTypeID": 1}
2023-09-16T15:53:55.118 DEBUG:teuthology.provision.fog.smithi155:FOG request: POST /host/260/task {"taskTypeID": 1}
2023-09-16T15:53:55.150 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None
2023-09-16T15:53:55.166 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None
2023-09-16T15:53:55.222 INFO:teuthology.orchestra.console.smithi050:Power off
2023-09-16T15:53:55.223 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-16T15:53:55.235 INFO:teuthology.orchestra.console.smithi155:Power off
2023-09-16T15:53:55.236 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-16T15:53:55.244 DEBUG:teuthology.orchestra.console.smithi050:power off output: Chassis Power Control: Down/Off
2023-09-16T15:53:55.244 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-16T15:53:55.255 DEBUG:teuthology.orchestra.console.smithi155:power off output: Chassis Power Control: Down/Off
2023-09-16T15:53:55.256 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-16T15:53:55.265 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is off
2023-09-16T15:53:55.276 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is off
2023-09-16T15:53:55.366 INFO:teuthology.orchestra.console.smithi050:Power off completed
2023-09-16T15:53:55.378 INFO:teuthology.orchestra.console.smithi155:Power off completed
2023-09-16T15:53:55.468 INFO:teuthology.orchestra.console.smithi050:Power on
2023-09-16T15:53:55.468 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-16T15:53:55.479 INFO:teuthology.orchestra.console.smithi155:Power on
2023-09-16T15:53:55.480 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-16T15:53:55.490 DEBUG:teuthology.orchestra.console.smithi050:power on output: Chassis Power Control: Up/On
2023-09-16T15:53:55.491 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-16T15:53:55.499 DEBUG:teuthology.orchestra.console.smithi155:power on output: Chassis Power Control: Up/On
2023-09-16T15:53:55.500 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-16T15:53:55.513 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is off
2023-09-16T15:53:55.519 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is off
2023-09-16T15:53:59.518 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-16T15:53:59.525 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-16T15:53:59.628 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is off
2023-09-16T15:53:59.634 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is off
2023-09-16T15:54:03.634 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-16T15:54:03.641 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-16T15:54:03.744 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is on
2023-09-16T15:54:03.828 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is on
2023-09-16T15:54:03.845 INFO:teuthology.orchestra.console.smithi050:Power on completed
2023-09-16T15:54:03.930 INFO:teuthology.orchestra.console.smithi155:Power on completed
2023-09-16T15:54:03.947 INFO:teuthology.provision.fog.smithi050:Waiting for deploy to finish
2023-09-16T15:54:03.947 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None
2023-09-16T15:54:04.033 INFO:teuthology.provision.fog.smithi155:Waiting for deploy to finish
2023-09-16T15:54:04.033 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None
2023-09-16T15:54:19.018 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None
2023-09-16T15:54:19.098 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None
2023-09-16T15:54:34.087 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None
2023-09-16T15:54:34.149 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None
2023-09-16T15:54:49.149 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None
2023-09-16T15:54:49.197 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None
2023-09-16T15:55:04.237 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None
2023-09-16T15:55:04.257 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None
2023-09-16T15:55:19.326 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None
2023-09-16T15:55:19.327 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None
2023-09-16T15:55:34.390 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None
2023-09-16T15:55:34.392 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None
2023-09-16T15:55:49.467 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None
2023-09-16T15:55:49.469 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None
2023-09-16T15:56:04.546 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None
2023-09-16T15:56:04.548 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None
2023-09-16T15:56:19.617 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None
2023-09-16T15:56:19.619 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None
2023-09-16T15:56:34.695 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None
2023-09-16T15:56:34.696 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None
2023-09-16T15:56:34.779 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-16T15:56:49.797 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None
2023-09-16T15:56:49.866 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-16T15:56:53.274 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50
2023-09-16T15:56:59.278 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-16T15:57:02.330 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50
2023-09-16T15:57:08.338 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-16T15:57:08.378 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155
2023-09-16T15:57:11.418 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50
2023-09-16T15:57:14.386 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-16T15:57:17.423 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-16T15:57:17.466 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155
2023-09-16T15:57:23.473 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-16T15:57:26.746 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155
2023-09-16T15:57:33.211 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-16T15:57:36.282 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155
2023-09-16T15:57:42.284 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-16T15:57:45.342 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155
2023-09-16T15:57:51.349 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-16T15:57:54.426 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155
2023-09-16T15:58:00.430 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-16T15:58:17.441 WARNING:teuthology.provision.fog.smithi050:timed out
2023-09-16T15:58:23.449 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-16T15:58:23.714 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-09-16T15:58:23.715 DEBUG:teuthology.orchestra.run.smithi050:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-09-16T15:58:24.000 INFO:teuthology.provision.fog.smithi050:Node is ready
2023-09-16T15:58:24.001 DEBUG:teuthology.orchestra.run.smithi050:> hostname
2023-09-16T15:58:24.021 INFO:teuthology.orchestra.run.smithi050.stdout:smithi050.front.sepia.ceph.com
2023-09-16T15:58:24.021 DEBUG:teuthology.orchestra.run.smithi050:> grep smithi050.front.sepia.ceph.com /etc/hosts
2023-09-16T15:58:24.085 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50 smithi050.front.sepia.ceph.com smithi050
2023-09-16T15:58:24.085 DEBUG:teuthology.orchestra.run.smithi050:> sudo hostname smithi050
2023-09-16T15:58:24.188 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i -e 's/smithi050.front.sepia.ceph.com/smithi050/g' /etc/hosts
2023-09-16T15:58:24.219 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i -e 's/172.21.15.50/172.21.15.50/g' /etc/hosts
2023-09-16T15:58:24.295 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i -e 's/smithi050.front.sepia.ceph.com/smithi050/g' /etc/hostname
2023-09-16T15:58:24.367 DEBUG:teuthology.orchestra.run.smithi050:> sudo hostname smithi050
2023-09-16T15:58:24.441 DEBUG:teuthology.orchestra.run.smithi050:> cat /etc/os-release
2023-09-16T15:58:24.503 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="CentOS Stream"
2023-09-16T15:58:24.503 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="8"
2023-09-16T15:58:24.503 INFO:teuthology.orchestra.run.smithi050.stdout:ID="centos"
2023-09-16T15:58:24.504 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE="rhel fedora"
2023-09-16T15:58:24.504 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="8"
2023-09-16T15:58:24.504 INFO:teuthology.orchestra.run.smithi050.stdout:PLATFORM_ID="platform:el8"
2023-09-16T15:58:24.504 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="CentOS Stream 8"
2023-09-16T15:58:24.505 INFO:teuthology.orchestra.run.smithi050.stdout:ANSI_COLOR="0;31"
2023-09-16T15:58:24.505 INFO:teuthology.orchestra.run.smithi050.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-09-16T15:58:24.505 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://centos.org/"
2023-09-16T15:58:24.505 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-16T15:58:24.505 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-09-16T15:58:24.506 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-09-16T15:58:24.506 INFO:teuthology.provision.fog.smithi050:Deploy complete!
2023-09-16T15:58:24.508 DEBUG:teuthology.parallel:result is None
2023-09-16T15:59:00.464 WARNING:teuthology.provision.fog.smithi155:timed out
2023-09-16T15:59:06.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-16T15:59:06.671 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-09-16T15:59:06.671 DEBUG:teuthology.orchestra.run.smithi155:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-09-16T15:59:06.950 INFO:teuthology.provision.fog.smithi155:Node is ready
2023-09-16T15:59:06.951 DEBUG:teuthology.orchestra.run.smithi155:> hostname
2023-09-16T15:59:06.969 INFO:teuthology.orchestra.run.smithi155.stdout:smithi155.front.sepia.ceph.com
2023-09-16T15:59:06.970 DEBUG:teuthology.orchestra.run.smithi155:> grep smithi155.front.sepia.ceph.com /etc/hosts
2023-09-16T15:59:07.029 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155 smithi155.front.sepia.ceph.com smithi155
2023-09-16T15:59:07.029 DEBUG:teuthology.orchestra.run.smithi155:> sudo hostname smithi155
2023-09-16T15:59:07.120 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i -e 's/smithi155.front.sepia.ceph.com/smithi155/g' /etc/hosts
2023-09-16T15:59:07.149 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i -e 's/172.21.15.155/172.21.15.155/g' /etc/hosts
2023-09-16T15:59:07.217 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i -e 's/smithi155.front.sepia.ceph.com/smithi155/g' /etc/hostname
2023-09-16T15:59:07.285 DEBUG:teuthology.orchestra.run.smithi155:> sudo hostname smithi155
2023-09-16T15:59:07.351 DEBUG:teuthology.orchestra.run.smithi155:> cat /etc/os-release
2023-09-16T15:59:07.409 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="CentOS Stream"
2023-09-16T15:59:07.410 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="8"
2023-09-16T15:59:07.410 INFO:teuthology.orchestra.run.smithi155.stdout:ID="centos"
2023-09-16T15:59:07.410 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE="rhel fedora"
2023-09-16T15:59:07.410 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="8"
2023-09-16T15:59:07.411 INFO:teuthology.orchestra.run.smithi155.stdout:PLATFORM_ID="platform:el8"
2023-09-16T15:59:07.411 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="CentOS Stream 8"
2023-09-16T15:59:07.411 INFO:teuthology.orchestra.run.smithi155.stdout:ANSI_COLOR="0;31"
2023-09-16T15:59:07.411 INFO:teuthology.orchestra.run.smithi155.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-09-16T15:59:07.411 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://centos.org/"
2023-09-16T15:59:07.412 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-16T15:59:07.412 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-09-16T15:59:07.412 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-09-16T15:59:07.412 INFO:teuthology.provision.fog.smithi155:Deploy complete!
2023-09-16T15:59:07.413 DEBUG:teuthology.parallel:result is None
2023-09-16T15:59:07.561 INFO:teuthology.lock.ops:Checking smithi050.front.sepia.ceph.com
2023-09-16T15:59:07.562 INFO:teuthology.lock.ops:New key found. Updating...
2023-09-16T15:59:07.584 INFO:teuthology.lock.ops:Checking smithi155.front.sepia.ceph.com
2023-09-16T15:59:07.584 INFO:teuthology.lock.ops:New key found. Updating...
2023-09-16T15:59:07.610 INFO:teuthology.lock.ops:Updating [smithi050.front.sepia.ceph.com]: set os type and version on server
2023-09-16T15:59:07.610 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com'
2023-09-16T15:59:07.611 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-16T15:59:07.680 DEBUG:teuthology.orchestra.run.smithi050:> true
2023-09-16T15:59:07.817 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi050.front.sepia.ceph.com'
2023-09-16T15:59:07.817 DEBUG:teuthology.orchestra.run.smithi050:> uname -m
2023-09-16T15:59:07.876 INFO:teuthology.orchestra.run.smithi050.stdout:x86_64
2023-09-16T15:59:07.877 DEBUG:teuthology.orchestra.run.smithi050:> cat /etc/os-release
2023-09-16T15:59:07.936 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="CentOS Stream"
2023-09-16T15:59:07.936 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="8"
2023-09-16T15:59:07.936 INFO:teuthology.orchestra.run.smithi050.stdout:ID="centos"
2023-09-16T15:59:07.936 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE="rhel fedora"
2023-09-16T15:59:07.937 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="8"
2023-09-16T15:59:07.937 INFO:teuthology.orchestra.run.smithi050.stdout:PLATFORM_ID="platform:el8"
2023-09-16T15:59:07.937 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="CentOS Stream 8"
2023-09-16T15:59:07.937 INFO:teuthology.orchestra.run.smithi050.stdout:ANSI_COLOR="0;31"
2023-09-16T15:59:07.937 INFO:teuthology.orchestra.run.smithi050.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-09-16T15:59:07.937 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://centos.org/"
2023-09-16T15:59:07.938 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-16T15:59:07.938 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-09-16T15:59:07.938 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-09-16T15:59:07.938 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server
2023-09-16T15:59:07.959 INFO:teuthology.lock.ops:Updating [smithi155.front.sepia.ceph.com]: set os type and version on server
2023-09-16T15:59:07.959 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com'
2023-09-16T15:59:07.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-16T15:59:08.024 DEBUG:teuthology.orchestra.run.smithi155:> true
2023-09-16T15:59:08.092 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi155.front.sepia.ceph.com'
2023-09-16T15:59:08.093 DEBUG:teuthology.orchestra.run.smithi155:> uname -m
2023-09-16T15:59:08.150 INFO:teuthology.orchestra.run.smithi155.stdout:x86_64
2023-09-16T15:59:08.151 DEBUG:teuthology.orchestra.run.smithi155:> cat /etc/os-release
2023-09-16T15:59:08.208 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="CentOS Stream"
2023-09-16T15:59:08.209 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="8"
2023-09-16T15:59:08.209 INFO:teuthology.orchestra.run.smithi155.stdout:ID="centos"
2023-09-16T15:59:08.209 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE="rhel fedora"
2023-09-16T15:59:08.209 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="8"
2023-09-16T15:59:08.209 INFO:teuthology.orchestra.run.smithi155.stdout:PLATFORM_ID="platform:el8"
2023-09-16T15:59:08.209 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="CentOS Stream 8"
2023-09-16T15:59:08.210 INFO:teuthology.orchestra.run.smithi155.stdout:ANSI_COLOR="0;31"
2023-09-16T15:59:08.210 INFO:teuthology.orchestra.run.smithi155.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-09-16T15:59:08.210 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://centos.org/"
2023-09-16T15:59:08.210 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-16T15:59:08.210 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-09-16T15:59:08.211 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-09-16T15:59:08.211 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server
2023-09-16T15:59:08.234 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T15:59:08.330 INFO:teuthology.dispatcher.supervisor:Running job 7397267
2023-09-16T15:59:08.330 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2023-09-16_14:23:09-upgrade:pacific-x-reef-distro-default-smithi/7397267 --name teuthology-2023-09-16_14:23:09-upgrade:pacific-x-reef-distro-default-smithi --description upgrade:pacific-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} -- /home/teuthworker/archive/teuthology-2023-09-16_14:23:09-upgrade:pacific-x-reef-distro-default-smithi/7397267/orig.config.yaml
2023-09-16T15:59:08.333 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2023-09-16_14:23:09-upgrade:pacific-x-reef-distro-default-smithi/7397267
2023-09-16T15:59:08.334 INFO:teuthology.dispatcher.supervisor:Job PID: 4081208
2023-09-16T15:59:08.334 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-09-16T16:01:08.434 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T16:03:08.603 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T16:05:08.771 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T16:07:08.934 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T16:09:09.127 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T16:11:09.294 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T16:13:09.480 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T16:15:09.642 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T16:17:09.827 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T16:19:09.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T16:21:10.178 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T16:23:10.346 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T16:25:10.511 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T16:27:10.686 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T16:29:10.879 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T16:31:11.045 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T16:33:11.210 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T16:35:11.374 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T16:37:11.535 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T16:39:11.695 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T16:41:11.858 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T16:43:12.008 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T16:45:12.145 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T16:47:12.332 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T16:49:12.490 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T16:51:12.649 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T16:53:12.815 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T16:55:13.004 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T16:57:13.171 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T16:59:13.335 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T17:01:13.496 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T17:03:13.663 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T17:05:13.838 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T17:07:14.007 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T17:09:14.166 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T17:11:14.331 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T17:13:14.497 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T17:15:14.667 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T17:17:14.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T17:19:15.000 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T17:21:15.171 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T17:23:15.339 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T17:25:15.515 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T17:25:15.580 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-09-16T17:25:15.786 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-09-16T17:25:15.786 INFO:teuthology.nuke:Checking targets against current locks
2023-09-16T17:25:15.835 DEBUG:teuthology.nuke:shortname: smithi050
2023-09-16T17:25:15.835 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-09-16T17:25:15.859 DEBUG:teuthology.nuke:shortname: smithi155
2023-09-16T17:25:15.860 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-09-16T17:25:15.863 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi050.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-09-16_14:23:09-upgrade:pacific-x-reef-distro-default-smithi/7397267', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-16 15:53:53.826807', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM8YtrYgWks0mNeFkw3M74n5l3rojSXgX8UhejXaIVa7W0gjHQDC51wmVHaCoeCWjxKkgdgae4GDApy6Q4rmyUs='}
2023-09-16T17:25:15.881 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi155.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-09-16_14:23:09-upgrade:pacific-x-reef-distro-default-smithi/7397267', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-16 15:53:53.828616', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBInAzvO7klr0HMUdu1fYHGf3YhUfcUugbVqb6BNKXDQtMs6IdihldwBiNJ9QX504ykOJC19K5D5Ua0TOIytfyLE='}
2023-09-16T17:25:15.909 INFO:teuthology.orchestra.console.smithi050:Power off
2023-09-16T17:25:15.910 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-16T17:25:15.930 DEBUG:teuthology.orchestra.console.smithi050:power off output: Chassis Power Control: Down/Off
2023-09-16T17:25:15.931 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-16T17:25:15.945 INFO:teuthology.orchestra.console.smithi155:Power off
2023-09-16T17:25:15.945 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-16T17:25:15.953 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is off
2023-09-16T17:25:15.965 DEBUG:teuthology.orchestra.console.smithi155:power off output: Chassis Power Control: Down/Off
2023-09-16T17:25:15.966 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-16T17:25:15.986 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is off
2023-09-16T17:25:16.054 INFO:teuthology.orchestra.console.smithi050:Power off completed
2023-09-16T17:25:16.088 INFO:teuthology.orchestra.console.smithi155:Power off completed
2023-09-16T17:25:16.204 INFO:teuthology.lock.ops:unlocked: smithi050.front.sepia.ceph.com
2023-09-16T17:25:16.229 INFO:teuthology.lock.ops:unlocked: smithi155.front.sepia.ceph.com