2023-09-26T21:18:45.543 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc
2023-09-26T21:18:45.584 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-26T21:18:45.714 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f05359b7c10>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f05356f5d30>, signals=[15])
2023-09-26T21:18:45.714 INFO:teuthology.lock.ops:Start node 'smithi092.front.sepia.ceph.com' reimaging
2023-09-26T21:18:45.715 INFO:teuthology.lock.ops:Updating [smithi092.front.sepia.ceph.com]: reset os type and version on server
2023-09-26T21:18:45.715 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server
2023-09-26T21:18:45.736 INFO:teuthology.lock.ops:Start node 'smithi118.front.sepia.ceph.com' reimaging
2023-09-26T21:18:45.736 INFO:teuthology.lock.ops:Updating [smithi118.front.sepia.ceph.com]: reset os type and version on server
2023-09-26T21:18:45.736 INFO:teuthology.lock.ops:Updating smithi118.front.sepia.ceph.com on lock server
2023-09-26T21:18:45.738 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /host {"name": "smithi092"}
2023-09-26T21:18:45.752 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /host {"name": "smithi118"}
2023-09-26T21:18:45.806 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-09-26T21:18:45.815 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-09-26T21:18:45.866 DEBUG:teuthology.provision.fog.smithi092:Requesting image smithi_centos_8.stream (ID 3)
2023-09-26T21:18:45.866 DEBUG:teuthology.provision.fog.smithi092:FOG request: PUT /host/197 {"imageID": 3}
2023-09-26T21:18:45.874 DEBUG:teuthology.provision.fog.smithi118:Requesting image smithi_centos_8.stream (ID 3)
2023-09-26T21:18:45.875 DEBUG:teuthology.provision.fog.smithi118:FOG request: PUT /host/223 {"imageID": 3}
2023-09-26T21:18:45.916 INFO:teuthology.provision.fog.smithi092:Scheduling deploy of centos 8.stream
2023-09-26T21:18:45.916 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None
2023-09-26T21:18:45.927 INFO:teuthology.provision.fog.smithi118:Scheduling deploy of centos 8.stream
2023-09-26T21:18:45.927 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None
2023-09-26T21:18:45.959 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /tasktype {"name": "deploy"}
2023-09-26T21:18:45.978 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /tasktype {"name": "deploy"}
2023-09-26T21:18:46.000 DEBUG:teuthology.provision.fog.smithi092:FOG request: POST /host/197/task {"taskTypeID": 1}
2023-09-26T21:18:46.014 DEBUG:teuthology.provision.fog.smithi118:FOG request: POST /host/223/task {"taskTypeID": 1}
2023-09-26T21:18:46.058 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None
2023-09-26T21:18:46.066 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None
2023-09-26T21:18:46.138 INFO:teuthology.orchestra.console.smithi092:Power off
2023-09-26T21:18:46.139 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-26T21:18:46.152 INFO:teuthology.orchestra.console.smithi118:Power off
2023-09-26T21:18:46.152 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-26T21:18:46.159 DEBUG:teuthology.orchestra.console.smithi092:power off output: Chassis Power Control: Down/Off
2023-09-26T21:18:46.160 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-26T21:18:46.171 DEBUG:teuthology.orchestra.console.smithi118:power off output: Chassis Power Control: Down/Off
2023-09-26T21:18:46.171 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-26T21:18:46.181 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is off
2023-09-26T21:18:46.190 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is off
2023-09-26T21:18:46.282 INFO:teuthology.orchestra.console.smithi092:Power off completed
2023-09-26T21:18:46.291 INFO:teuthology.orchestra.console.smithi118:Power off completed
2023-09-26T21:18:46.383 INFO:teuthology.orchestra.console.smithi092:Power on
2023-09-26T21:18:46.383 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-26T21:18:46.392 INFO:teuthology.orchestra.console.smithi118:Power on
2023-09-26T21:18:46.393 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-26T21:18:46.403 DEBUG:teuthology.orchestra.console.smithi092:power on output: Chassis Power Control: Up/On
2023-09-26T21:18:46.403 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-26T21:18:46.411 DEBUG:teuthology.orchestra.console.smithi118:power on output: Chassis Power Control: Up/On
2023-09-26T21:18:46.412 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-26T21:18:46.423 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is off
2023-09-26T21:18:46.432 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is off
2023-09-26T21:18:50.427 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-26T21:18:50.433 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-26T21:18:50.535 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is off
2023-09-26T21:18:50.541 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is on
2023-09-26T21:18:50.642 INFO:teuthology.orchestra.console.smithi118:Power on completed
2023-09-26T21:18:50.743 INFO:teuthology.provision.fog.smithi118:Waiting for deploy to finish
2023-09-26T21:18:50.743 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None
2023-09-26T21:18:54.540 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-26T21:18:54.648 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is on
2023-09-26T21:18:54.749 INFO:teuthology.orchestra.console.smithi092:Power on completed
2023-09-26T21:18:54.849 INFO:teuthology.provision.fog.smithi092:Waiting for deploy to finish
2023-09-26T21:18:54.849 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None
2023-09-26T21:19:05.810 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None
2023-09-26T21:19:09.910 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None
2023-09-26T21:19:20.874 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None
2023-09-26T21:19:24.986 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None
2023-09-26T21:19:35.938 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None
2023-09-26T21:19:40.047 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None
2023-09-26T21:19:51.002 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None
2023-09-26T21:19:55.120 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None
2023-09-26T21:20:06.070 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None
2023-09-26T21:20:10.184 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None
2023-09-26T21:20:21.134 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None
2023-09-26T21:20:25.246 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None
2023-09-26T21:20:36.193 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None
2023-09-26T21:20:40.308 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None
2023-09-26T21:20:51.352 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None
2023-09-26T21:20:55.369 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None
2023-09-26T21:21:06.426 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None
2023-09-26T21:21:10.433 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None
2023-09-26T21:21:21.494 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None
2023-09-26T21:21:25.493 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None
2023-09-26T21:21:36.566 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None
2023-09-26T21:21:40.561 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None
2023-09-26T21:21:40.623 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-26T21:21:51.635 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None
2023-09-26T21:21:59.162 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92
2023-09-26T21:22:05.168 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-26T21:22:06.693 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None
2023-09-26T21:22:06.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-26T21:22:08.250 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92
2023-09-26T21:22:14.266 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-26T21:22:17.338 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92
2023-09-26T21:22:23.343 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-26T21:22:25.278 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118
2023-09-26T21:22:26.394 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92
2023-09-26T21:22:31.285 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-26T21:22:32.397 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-26T21:22:34.366 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118
2023-09-26T21:22:40.373 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-26T21:22:43.450 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118
2023-09-26T21:22:49.457 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-26T21:22:52.538 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118
2023-09-26T21:22:58.545 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-26T21:23:01.626 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118
2023-09-26T21:23:04.150 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-09-26T21:23:04.150 DEBUG:teuthology.orchestra.run.smithi092:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-09-26T21:23:07.628 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-26T21:23:29.108 INFO:teuthology.provision.fog.smithi092:Node is ready
2023-09-26T21:23:29.108 DEBUG:teuthology.orchestra.run.smithi092:> hostname
2023-09-26T21:23:29.132 INFO:teuthology.orchestra.run.smithi092.stdout:smithi092.front.sepia.ceph.com
2023-09-26T21:23:29.132 DEBUG:teuthology.orchestra.run.smithi092:> grep smithi092.front.sepia.ceph.com /etc/hosts
2023-09-26T21:23:29.193 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92 smithi092.front.sepia.ceph.com smithi092
2023-09-26T21:23:29.194 DEBUG:teuthology.orchestra.run.smithi092:> sudo hostname smithi092
2023-09-26T21:23:29.321 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i -e 's/smithi092.front.sepia.ceph.com/smithi092/g' /etc/hosts
2023-09-26T21:23:29.355 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i -e 's/172.21.15.92/172.21.15.92/g' /etc/hosts
2023-09-26T21:23:29.428 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i -e 's/smithi092.front.sepia.ceph.com/smithi092/g' /etc/hostname
2023-09-26T21:23:29.502 DEBUG:teuthology.orchestra.run.smithi092:> sudo hostname smithi092
2023-09-26T21:23:29.575 DEBUG:teuthology.orchestra.run.smithi092:> cat /etc/os-release
2023-09-26T21:23:29.637 INFO:teuthology.orchestra.run.smithi092.stdout:NAME="CentOS Stream"
2023-09-26T21:23:29.637 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION="8"
2023-09-26T21:23:29.637 INFO:teuthology.orchestra.run.smithi092.stdout:ID="centos"
2023-09-26T21:23:29.637 INFO:teuthology.orchestra.run.smithi092.stdout:ID_LIKE="rhel fedora"
2023-09-26T21:23:29.637 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_ID="8"
2023-09-26T21:23:29.637 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM_ID="platform:el8"
2023-09-26T21:23:29.638 INFO:teuthology.orchestra.run.smithi092.stdout:PRETTY_NAME="CentOS Stream 8"
2023-09-26T21:23:29.638 INFO:teuthology.orchestra.run.smithi092.stdout:ANSI_COLOR="0;31"
2023-09-26T21:23:29.638 INFO:teuthology.orchestra.run.smithi092.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-09-26T21:23:29.638 INFO:teuthology.orchestra.run.smithi092.stdout:HOME_URL="https://centos.org/"
2023-09-26T21:23:29.638 INFO:teuthology.orchestra.run.smithi092.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-26T21:23:29.638 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-09-26T21:23:29.638 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-09-26T21:23:29.639 INFO:teuthology.provision.fog.smithi092:Deploy complete!
2023-09-26T21:23:29.640 DEBUG:teuthology.parallel:result is None
2023-09-26T21:24:07.663 WARNING:teuthology.provision.fog.smithi118:timed out
2023-09-26T21:24:13.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-26T21:24:13.882 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-09-26T21:24:13.883 DEBUG:teuthology.orchestra.run.smithi118:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-09-26T21:24:14.128 INFO:teuthology.provision.fog.smithi118:Node is ready
2023-09-26T21:24:14.128 DEBUG:teuthology.orchestra.run.smithi118:> hostname
2023-09-26T21:24:14.149 INFO:teuthology.orchestra.run.smithi118.stdout:smithi118.front.sepia.ceph.com
2023-09-26T21:24:14.149 DEBUG:teuthology.orchestra.run.smithi118:> grep smithi118.front.sepia.ceph.com /etc/hosts
2023-09-26T21:24:14.211 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118 smithi118.front.sepia.ceph.com smithi118
2023-09-26T21:24:14.212 DEBUG:teuthology.orchestra.run.smithi118:> sudo hostname smithi118
2023-09-26T21:24:14.323 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i -e 's/smithi118.front.sepia.ceph.com/smithi118/g' /etc/hosts
2023-09-26T21:24:14.358 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i -e 's/172.21.15.118/172.21.15.118/g' /etc/hosts
2023-09-26T21:24:14.432 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i -e 's/smithi118.front.sepia.ceph.com/smithi118/g' /etc/hostname
2023-09-26T21:24:14.506 DEBUG:teuthology.orchestra.run.smithi118:> sudo hostname smithi118
2023-09-26T21:24:14.579 DEBUG:teuthology.orchestra.run.smithi118:> cat /etc/os-release
2023-09-26T21:24:14.641 INFO:teuthology.orchestra.run.smithi118.stdout:NAME="CentOS Stream"
2023-09-26T21:24:14.641 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION="8"
2023-09-26T21:24:14.641 INFO:teuthology.orchestra.run.smithi118.stdout:ID="centos"
2023-09-26T21:24:14.641 INFO:teuthology.orchestra.run.smithi118.stdout:ID_LIKE="rhel fedora"
2023-09-26T21:24:14.641 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_ID="8"
2023-09-26T21:24:14.642 INFO:teuthology.orchestra.run.smithi118.stdout:PLATFORM_ID="platform:el8"
2023-09-26T21:24:14.642 INFO:teuthology.orchestra.run.smithi118.stdout:PRETTY_NAME="CentOS Stream 8"
2023-09-26T21:24:14.642 INFO:teuthology.orchestra.run.smithi118.stdout:ANSI_COLOR="0;31"
2023-09-26T21:24:14.642 INFO:teuthology.orchestra.run.smithi118.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-09-26T21:24:14.642 INFO:teuthology.orchestra.run.smithi118.stdout:HOME_URL="https://centos.org/"
2023-09-26T21:24:14.642 INFO:teuthology.orchestra.run.smithi118.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-26T21:24:14.642 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-09-26T21:24:14.642 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-09-26T21:24:14.642 INFO:teuthology.provision.fog.smithi118:Deploy complete!
2023-09-26T21:24:14.643 DEBUG:teuthology.parallel:result is None
2023-09-26T21:24:14.820 INFO:teuthology.lock.ops:Checking smithi092.front.sepia.ceph.com
2023-09-26T21:24:14.821 INFO:teuthology.lock.ops:New key found. Updating...
2023-09-26T21:24:14.842 INFO:teuthology.lock.ops:Checking smithi118.front.sepia.ceph.com
2023-09-26T21:24:14.842 INFO:teuthology.lock.ops:New key found. Updating...
2023-09-26T21:24:14.860 INFO:teuthology.lock.ops:Updating [smithi092.front.sepia.ceph.com]: set os type and version on server
2023-09-26T21:24:14.860 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com'
2023-09-26T21:24:14.860 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-26T21:24:14.927 DEBUG:teuthology.orchestra.run.smithi092:> true
2023-09-26T21:24:15.024 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi092.front.sepia.ceph.com'
2023-09-26T21:24:15.024 DEBUG:teuthology.orchestra.run.smithi092:> uname -m
2023-09-26T21:24:15.083 INFO:teuthology.orchestra.run.smithi092.stdout:x86_64
2023-09-26T21:24:15.083 DEBUG:teuthology.orchestra.run.smithi092:> cat /etc/os-release
2023-09-26T21:24:15.143 INFO:teuthology.orchestra.run.smithi092.stdout:NAME="CentOS Stream"
2023-09-26T21:24:15.143 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION="8"
2023-09-26T21:24:15.143 INFO:teuthology.orchestra.run.smithi092.stdout:ID="centos"
2023-09-26T21:24:15.144 INFO:teuthology.orchestra.run.smithi092.stdout:ID_LIKE="rhel fedora"
2023-09-26T21:24:15.144 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_ID="8"
2023-09-26T21:24:15.144 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM_ID="platform:el8"
2023-09-26T21:24:15.144 INFO:teuthology.orchestra.run.smithi092.stdout:PRETTY_NAME="CentOS Stream 8"
2023-09-26T21:24:15.144 INFO:teuthology.orchestra.run.smithi092.stdout:ANSI_COLOR="0;31"
2023-09-26T21:24:15.144 INFO:teuthology.orchestra.run.smithi092.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-09-26T21:24:15.144 INFO:teuthology.orchestra.run.smithi092.stdout:HOME_URL="https://centos.org/"
2023-09-26T21:24:15.144 INFO:teuthology.orchestra.run.smithi092.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-26T21:24:15.144 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-09-26T21:24:15.144 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-09-26T21:24:15.146 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server
2023-09-26T21:24:15.185 INFO:teuthology.lock.ops:Updating [smithi118.front.sepia.ceph.com]: set os type and version on server
2023-09-26T21:24:15.185 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com'
2023-09-26T21:24:15.186 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-26T21:24:15.251 DEBUG:teuthology.orchestra.run.smithi118:> true
2023-09-26T21:24:15.326 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi118.front.sepia.ceph.com'
2023-09-26T21:24:15.327 DEBUG:teuthology.orchestra.run.smithi118:> uname -m
2023-09-26T21:24:15.386 INFO:teuthology.orchestra.run.smithi118.stdout:x86_64
2023-09-26T21:24:15.387 DEBUG:teuthology.orchestra.run.smithi118:> cat /etc/os-release
2023-09-26T21:24:15.445 INFO:teuthology.orchestra.run.smithi118.stdout:NAME="CentOS Stream"
2023-09-26T21:24:15.445 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION="8"
2023-09-26T21:24:15.446 INFO:teuthology.orchestra.run.smithi118.stdout:ID="centos"
2023-09-26T21:24:15.446 INFO:teuthology.orchestra.run.smithi118.stdout:ID_LIKE="rhel fedora"
2023-09-26T21:24:15.446 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_ID="8"
2023-09-26T21:24:15.446 INFO:teuthology.orchestra.run.smithi118.stdout:PLATFORM_ID="platform:el8"
2023-09-26T21:24:15.446 INFO:teuthology.orchestra.run.smithi118.stdout:PRETTY_NAME="CentOS Stream 8"
2023-09-26T21:24:15.446 INFO:teuthology.orchestra.run.smithi118.stdout:ANSI_COLOR="0;31"
2023-09-26T21:24:15.446 INFO:teuthology.orchestra.run.smithi118.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-09-26T21:24:15.446 INFO:teuthology.orchestra.run.smithi118.stdout:HOME_URL="https://centos.org/"
2023-09-26T21:24:15.446 INFO:teuthology.orchestra.run.smithi118.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-26T21:24:15.446 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-09-26T21:24:15.446 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-09-26T21:24:15.447 INFO:teuthology.lock.ops:Updating smithi118.front.sepia.ceph.com on lock server
2023-09-26T21:24:15.467 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-26T21:24:15.547 INFO:teuthology.dispatcher.supervisor:Running job 7402588
2023-09-26T21:24:15.547 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_ksirivad@teuthology --archive /home/teuthworker/archive/ksirivad-2023-09-26_19:24:31-rados:thrash-erasure-code-main-distro-default-smithi/7402588 --name ksirivad-2023-09-26_19:24:31-rados:thrash-erasure-code-main-distro-default-smithi --description rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} -- /home/teuthworker/archive/ksirivad-2023-09-26_19:24:31-rados:thrash-erasure-code-main-distro-default-smithi/7402588/orig.config.yaml
2023-09-26T21:24:15.550 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/ksirivad-2023-09-26_19:24:31-rados:thrash-erasure-code-main-distro-default-smithi/7402588
2023-09-26T21:24:15.550 INFO:teuthology.dispatcher.supervisor:Job PID: 1786918
2023-09-26T21:24:15.554 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-09-26T21:26:15.643 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-26T21:28:15.819 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-26T21:30:15.991 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-26T21:32:16.164 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-26T21:34:16.327 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-26T21:36:16.483 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-26T21:38:16.655 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-26T21:40:16.819 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-26T21:42:16.940 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-26T21:44:17.167 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-26T21:46:17.332 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-26T21:48:17.495 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-26T21:50:17.671 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-26T21:52:17.811 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-26T21:54:18.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-26T21:56:18.564 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-26T21:58:18.767 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-26T22:00:18.885 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-26T22:02:18.979 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-26T22:04:19.211 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-26T22:06:19.376 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-26T22:08:19.552 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-26T22:08:19.615 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-09-26T22:08:19.786 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-09-26T22:08:19.787 INFO:teuthology.nuke:Checking targets against current locks
2023-09-26T22:08:19.836 DEBUG:teuthology.nuke:shortname: smithi092
2023-09-26T22:08:19.836 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-09-26T22:08:19.855 DEBUG:teuthology.nuke:shortname: smithi118
2023-09-26T22:08:19.856 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-09-26T22:08:19.858 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi092.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/ksirivad-2023-09-26_19:24:31-rados:thrash-erasure-code-main-distro-default-smithi/7402588', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-26 21:18:44.519562', 'locked_by': 'scheduled_ksirivad@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFqnhDk4TcdXTlIX2mu2735cBglixnY3ixlcGXQsQxwttbxBgALnCz8kl/iCcxfDxVQV5bGHCMPxU03jdM9j21A='}
2023-09-26T22:08:19.880 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi118.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/ksirivad-2023-09-26_19:24:31-rados:thrash-erasure-code-main-distro-default-smithi/7402588', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-26 21:18:44.521462', 'locked_by': 'scheduled_ksirivad@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMJxJGLOmHWqe7WkdF0XbSWGGWbiDRiT1H2joNniKbypVYOP+RWLdQ3ak1sNzi87fwnk2wt89ZXma4+XqJ4reNI='}
2023-09-26T22:08:19.912 INFO:teuthology.orchestra.console.smithi092:Power off
2023-09-26T22:08:19.912 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-26T22:08:19.933 DEBUG:teuthology.orchestra.console.smithi092:power off output: Chassis Power Control: Down/Off
2023-09-26T22:08:19.934 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-26T22:08:19.948 INFO:teuthology.orchestra.console.smithi118:Power off
2023-09-26T22:08:19.948 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-26T22:08:19.956 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is off
2023-09-26T22:08:19.967 DEBUG:teuthology.orchestra.console.smithi118:power off output: Chassis Power Control: Down/Off
2023-09-26T22:08:19.968 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-26T22:08:19.989 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is off
2023-09-26T22:08:20.057 INFO:teuthology.orchestra.console.smithi092:Power off completed
2023-09-26T22:08:20.091 INFO:teuthology.orchestra.console.smithi118:Power off completed
2023-09-26T22:08:20.219 INFO:teuthology.lock.ops:unlocked: smithi092.front.sepia.ceph.com
2023-09-26T22:08:20.240 INFO:teuthology.lock.ops:unlocked: smithi118.front.sepia.ceph.com