2023-10-26T02:30:30.504 INFO:root:teuthology version: 0.0.1.dev201+g202b180 2023-10-26T02:30:30.505 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-26T02:30:30.641 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa2e45cce50>, signals=[15]) 2023-10-26T02:30:30.643 INFO:teuthology.lock.ops:Start node 'smithi094.front.sepia.ceph.com' reimaging 2023-10-26T02:30:30.643 INFO:teuthology.lock.ops:Updating [smithi094.front.sepia.ceph.com]: reset os type and version on server 2023-10-26T02:30:30.644 INFO:teuthology.lock.ops:Updating smithi094.front.sepia.ceph.com on lock server 2023-10-26T02:30:30.665 INFO:teuthology.lock.ops:Start node 'smithi179.front.sepia.ceph.com' reimaging 2023-10-26T02:30:30.665 INFO:teuthology.lock.ops:Updating [smithi179.front.sepia.ceph.com]: reset os type and version on server 2023-10-26T02:30:30.665 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server 2023-10-26T02:30:30.667 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /host {"name": "smithi094"} 2023-10-26T02:30:30.689 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /host {"name": "smithi179"} 2023-10-26T02:30:30.747 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-10-26T02:30:30.779 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-10-26T02:30:30.786 DEBUG:teuthology.provision.fog.smithi094:Requesting image smithi_centos_8.stream (ID 3) 2023-10-26T02:30:30.786 DEBUG:teuthology.provision.fog.smithi094:FOG request: PUT /host/199 {"imageID": 3} 2023-10-26T02:30:30.831 INFO:teuthology.provision.fog.smithi094:Scheduling deploy of centos 8.stream 2023-10-26T02:30:30.831 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-10-26T02:30:30.835 DEBUG:teuthology.provision.fog.smithi179:Requesting image smithi_centos_8.stream (ID 3) 2023-10-26T02:30:30.835 DEBUG:teuthology.provision.fog.smithi179:FOG request: PUT /host/284 {"imageID": 3} 2023-10-26T02:30:30.879 INFO:teuthology.provision.fog.smithi179:Scheduling deploy of centos 8.stream 2023-10-26T02:30:30.879 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-10-26T02:30:30.882 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /tasktype {"name": "deploy"} 2023-10-26T02:30:30.920 DEBUG:teuthology.provision.fog.smithi094:FOG request: POST /host/199/task {"taskTypeID": 1} 2023-10-26T02:30:30.928 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /tasktype {"name": "deploy"} 2023-10-26T02:30:30.962 DEBUG:teuthology.provision.fog.smithi179:FOG request: POST /host/284/task {"taskTypeID": 1} 2023-10-26T02:30:30.979 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-10-26T02:30:31.011 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-10-26T02:30:31.059 INFO:teuthology.orchestra.console.smithi094:Power off 2023-10-26T02:30:31.060 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-26T02:30:31.083 DEBUG:teuthology.orchestra.console.smithi094:power off output: Chassis Power Control: Down/Off 2023-10-26T02:30:31.084 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-26T02:30:31.097 INFO:teuthology.orchestra.console.smithi179:Power off 2023-10-26T02:30:31.097 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-26T02:30:31.105 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is on 2023-10-26T02:30:31.118 DEBUG:teuthology.orchestra.console.smithi179:power off output: Chassis Power Control: Down/Off 2023-10-26T02:30:31.119 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-26T02:30:31.140 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2023-10-26T02:30:35.106 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-26T02:30:35.141 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-26T02:30:35.217 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is on 2023-10-26T02:30:35.250 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2023-10-26T02:30:39.221 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-26T02:30:39.251 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-26T02:30:39.330 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is off 2023-10-26T02:30:39.360 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2023-10-26T02:30:39.432 INFO:teuthology.orchestra.console.smithi094:Power off completed 2023-10-26T02:30:39.462 INFO:teuthology.orchestra.console.smithi179:Power off completed 2023-10-26T02:30:39.533 INFO:teuthology.orchestra.console.smithi094:Power on 2023-10-26T02:30:39.534 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-26T02:30:39.554 DEBUG:teuthology.orchestra.console.smithi094:power on output: Chassis Power Control: Up/On 2023-10-26T02:30:39.555 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-26T02:30:39.563 INFO:teuthology.orchestra.console.smithi179:Power on 2023-10-26T02:30:39.564 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-26T02:30:39.574 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is off 2023-10-26T02:30:39.584 DEBUG:teuthology.orchestra.console.smithi179:power on output: Chassis Power Control: Up/On 2023-10-26T02:30:39.585 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-26T02:30:39.605 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2023-10-26T02:30:43.579 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-26T02:30:43.606 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-26T02:30:43.687 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is off 2023-10-26T02:30:43.715 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2023-10-26T02:30:47.690 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-26T02:30:47.716 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-26T02:30:47.798 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is on 2023-10-26T02:30:47.825 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2023-10-26T02:30:47.900 INFO:teuthology.orchestra.console.smithi094:Power on completed 2023-10-26T02:30:47.926 INFO:teuthology.orchestra.console.smithi179:Power on completed 2023-10-26T02:30:48.002 INFO:teuthology.provision.fog.smithi094:Waiting for deploy to finish 2023-10-26T02:30:48.002 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-10-26T02:30:48.027 INFO:teuthology.provision.fog.smithi179:Waiting for deploy to finish 2023-10-26T02:30:48.028 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-10-26T02:31:03.076 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-10-26T02:31:03.080 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-10-26T02:31:18.146 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-10-26T02:31:18.148 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-10-26T02:31:33.218 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-10-26T02:31:33.220 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-10-26T02:31:48.294 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-10-26T02:31:48.295 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-10-26T02:32:03.369 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-10-26T02:32:03.371 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-10-26T02:32:18.442 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-10-26T02:32:18.444 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-10-26T02:32:33.514 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-10-26T02:32:33.516 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-10-26T02:32:48.592 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-10-26T02:32:48.594 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-10-26T02:33:03.674 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-10-26T02:33:03.676 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-10-26T02:33:18.744 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-10-26T02:33:18.746 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-10-26T02:33:33.818 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-10-26T02:33:33.820 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-10-26T02:33:33.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-26T02:33:33.874 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-26T02:33:52.250 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94 2023-10-26T02:33:52.270 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-10-26T02:33:58.274 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-26T02:33:58.277 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-26T02:34:01.338 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94 2023-10-26T02:34:01.339 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-10-26T02:34:07.344 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-26T02:34:07.346 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-26T02:34:10.426 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94 2023-10-26T02:34:10.427 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-10-26T02:34:16.434 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-26T02:34:16.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-26T02:34:19.521 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94 2023-10-26T02:34:19.522 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-10-26T02:34:25.527 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-26T02:34:25.529 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-26T02:34:57.427 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-26T02:34:57.428 DEBUG:teuthology.orchestra.run.smithi179:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-26T02:35:22.803 INFO:teuthology.provision.fog.smithi179:Node is ready 2023-10-26T02:35:22.803 DEBUG:teuthology.orchestra.run.smithi179:> hostname 2023-10-26T02:35:22.828 INFO:teuthology.orchestra.run.smithi179.stdout:smithi179.front.sepia.ceph.com 2023-10-26T02:35:22.829 DEBUG:teuthology.orchestra.run.smithi179:> grep smithi179.front.sepia.ceph.com /etc/hosts 2023-10-26T02:35:22.889 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.15.179 smithi179.front.sepia.ceph.com smithi179 2023-10-26T02:35:22.890 DEBUG:teuthology.orchestra.run.smithi179:> sudo hostname smithi179 2023-10-26T02:35:23.020 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/smithi179.front.sepia.ceph.com/smithi179/g' /etc/hosts 2023-10-26T02:35:23.051 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/172.21.15.179/172.21.15.179/g' /etc/hosts 2023-10-26T02:35:23.123 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/smithi179.front.sepia.ceph.com/smithi179/g' /etc/hostname 2023-10-26T02:35:23.193 DEBUG:teuthology.orchestra.run.smithi179:> sudo hostname smithi179 2023-10-26T02:35:23.261 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release 2023-10-26T02:35:23.320 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="CentOS Stream" 2023-10-26T02:35:23.320 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="8" 2023-10-26T02:35:23.320 INFO:teuthology.orchestra.run.smithi179.stdout:ID="centos" 2023-10-26T02:35:23.321 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE="rhel fedora" 2023-10-26T02:35:23.321 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="8" 2023-10-26T02:35:23.321 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM_ID="platform:el8" 2023-10-26T02:35:23.321 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-26T02:35:23.321 INFO:teuthology.orchestra.run.smithi179.stdout:ANSI_COLOR="0;31" 2023-10-26T02:35:23.322 INFO:teuthology.orchestra.run.smithi179.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-26T02:35:23.322 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://centos.org/" 2023-10-26T02:35:23.322 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-26T02:35:23.322 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-26T02:35:23.323 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-26T02:35:23.324 INFO:teuthology.provision.fog.smithi179:Deploy complete! 2023-10-26T02:35:23.326 DEBUG:teuthology.parallel:result is None 2023-10-26T02:35:25.530 WARNING:teuthology.provision.fog.smithi094:timed out 2023-10-26T02:35:31.538 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-26T02:35:31.776 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-26T02:35:31.776 DEBUG:teuthology.orchestra.run.smithi094:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-26T02:35:32.032 INFO:teuthology.provision.fog.smithi094:Node is ready 2023-10-26T02:35:32.033 DEBUG:teuthology.orchestra.run.smithi094:> hostname 2023-10-26T02:35:32.052 INFO:teuthology.orchestra.run.smithi094.stdout:smithi094.front.sepia.ceph.com 2023-10-26T02:35:32.053 DEBUG:teuthology.orchestra.run.smithi094:> grep smithi094.front.sepia.ceph.com /etc/hosts 2023-10-26T02:35:32.112 INFO:teuthology.orchestra.run.smithi094.stdout:172.21.15.94 smithi094.front.sepia.ceph.com smithi094 2023-10-26T02:35:32.112 DEBUG:teuthology.orchestra.run.smithi094:> sudo hostname smithi094 2023-10-26T02:35:32.207 DEBUG:teuthology.orchestra.run.smithi094:> sudo sed -i -e 's/smithi094.front.sepia.ceph.com/smithi094/g' /etc/hosts 2023-10-26T02:35:32.237 DEBUG:teuthology.orchestra.run.smithi094:> sudo sed -i -e 's/172.21.15.94/172.21.15.94/g' /etc/hosts 2023-10-26T02:35:32.306 DEBUG:teuthology.orchestra.run.smithi094:> sudo sed -i -e 's/smithi094.front.sepia.ceph.com/smithi094/g' /etc/hostname 2023-10-26T02:35:32.375 DEBUG:teuthology.orchestra.run.smithi094:> sudo hostname smithi094 2023-10-26T02:35:32.442 DEBUG:teuthology.orchestra.run.smithi094:> cat /etc/os-release 2023-10-26T02:35:32.500 INFO:teuthology.orchestra.run.smithi094.stdout:NAME="CentOS Stream" 2023-10-26T02:35:32.501 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION="8" 2023-10-26T02:35:32.501 INFO:teuthology.orchestra.run.smithi094.stdout:ID="centos" 2023-10-26T02:35:32.501 INFO:teuthology.orchestra.run.smithi094.stdout:ID_LIKE="rhel fedora" 2023-10-26T02:35:32.501 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION_ID="8" 2023-10-26T02:35:32.501 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM_ID="platform:el8" 2023-10-26T02:35:32.502 INFO:teuthology.orchestra.run.smithi094.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-26T02:35:32.502 INFO:teuthology.orchestra.run.smithi094.stdout:ANSI_COLOR="0;31" 2023-10-26T02:35:32.502 INFO:teuthology.orchestra.run.smithi094.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-26T02:35:32.502 INFO:teuthology.orchestra.run.smithi094.stdout:HOME_URL="https://centos.org/" 2023-10-26T02:35:32.502 INFO:teuthology.orchestra.run.smithi094.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-26T02:35:32.503 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-26T02:35:32.503 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-26T02:35:32.503 INFO:teuthology.provision.fog.smithi094:Deploy complete! 2023-10-26T02:35:32.504 DEBUG:teuthology.parallel:result is None 2023-10-26T02:35:32.661 INFO:teuthology.lock.ops:Checking smithi094.front.sepia.ceph.com 2023-10-26T02:35:32.662 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-26T02:35:32.685 INFO:teuthology.lock.ops:Checking smithi179.front.sepia.ceph.com 2023-10-26T02:35:32.685 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-26T02:35:32.702 INFO:teuthology.lock.ops:Updating [smithi094.front.sepia.ceph.com]: set os type and version on server 2023-10-26T02:35:32.703 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com' 2023-10-26T02:35:32.703 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-26T02:35:32.770 DEBUG:teuthology.orchestra.run.smithi094:> true 2023-10-26T02:35:32.836 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi094.front.sepia.ceph.com' 2023-10-26T02:35:32.837 DEBUG:teuthology.orchestra.run.smithi094:> uname -m 2023-10-26T02:35:32.894 INFO:teuthology.orchestra.run.smithi094.stdout:x86_64 2023-10-26T02:35:32.895 DEBUG:teuthology.orchestra.run.smithi094:> cat /etc/os-release 2023-10-26T02:35:32.952 INFO:teuthology.orchestra.run.smithi094.stdout:NAME="CentOS Stream" 2023-10-26T02:35:32.952 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION="8" 2023-10-26T02:35:32.952 INFO:teuthology.orchestra.run.smithi094.stdout:ID="centos" 2023-10-26T02:35:32.953 INFO:teuthology.orchestra.run.smithi094.stdout:ID_LIKE="rhel fedora" 2023-10-26T02:35:32.953 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION_ID="8" 2023-10-26T02:35:32.953 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM_ID="platform:el8" 2023-10-26T02:35:32.953 INFO:teuthology.orchestra.run.smithi094.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-26T02:35:32.953 INFO:teuthology.orchestra.run.smithi094.stdout:ANSI_COLOR="0;31" 2023-10-26T02:35:32.954 INFO:teuthology.orchestra.run.smithi094.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-26T02:35:32.954 INFO:teuthology.orchestra.run.smithi094.stdout:HOME_URL="https://centos.org/" 2023-10-26T02:35:32.954 INFO:teuthology.orchestra.run.smithi094.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-26T02:35:32.954 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-26T02:35:32.955 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-26T02:35:32.955 INFO:teuthology.lock.ops:Updating smithi094.front.sepia.ceph.com on lock server 2023-10-26T02:35:32.976 INFO:teuthology.lock.ops:Updating [smithi179.front.sepia.ceph.com]: set os type and version on server 2023-10-26T02:35:32.977 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2023-10-26T02:35:32.977 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-26T02:35:33.047 DEBUG:teuthology.orchestra.run.smithi179:> true 2023-10-26T02:35:33.124 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi179.front.sepia.ceph.com' 2023-10-26T02:35:33.124 DEBUG:teuthology.orchestra.run.smithi179:> uname -m 2023-10-26T02:35:33.185 INFO:teuthology.orchestra.run.smithi179.stdout:x86_64 2023-10-26T02:35:33.186 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release 2023-10-26T02:35:33.247 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="CentOS Stream" 2023-10-26T02:35:33.247 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="8" 2023-10-26T02:35:33.247 INFO:teuthology.orchestra.run.smithi179.stdout:ID="centos" 2023-10-26T02:35:33.247 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE="rhel fedora" 2023-10-26T02:35:33.248 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="8" 2023-10-26T02:35:33.248 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM_ID="platform:el8" 2023-10-26T02:35:33.248 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-26T02:35:33.248 INFO:teuthology.orchestra.run.smithi179.stdout:ANSI_COLOR="0;31" 2023-10-26T02:35:33.248 INFO:teuthology.orchestra.run.smithi179.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-26T02:35:33.249 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://centos.org/" 2023-10-26T02:35:33.249 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-26T02:35:33.249 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-26T02:35:33.249 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-26T02:35:33.250 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server 2023-10-26T02:35:33.268 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-26T02:35:33.361 INFO:teuthology.dispatcher.supervisor:Running job 7438267 2023-10-26T02:35:33.362 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2023-10-26_02:25:12-upgrade:reef-x-main-distro-default-smithi/7438267 --name teuthology-2023-10-26_02:25:12-upgrade:reef-x-main-distro-default-smithi --description upgrade:reef-x/parallel/{0-random-distro$/{centos_8.stream_container_tools_crun} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} -- /home/teuthworker/archive/teuthology-2023-10-26_02:25:12-upgrade:reef-x-main-distro-default-smithi/7438267/orig.config.yaml 2023-10-26T02:35:33.365 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2023-10-26_02:25:12-upgrade:reef-x-main-distro-default-smithi/7438267 2023-10-26T02:35:33.365 INFO:teuthology.dispatcher.supervisor:Job PID: 2989976 2023-10-26T02:35:33.365 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-26T02:37:33.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-26T02:39:33.635 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-26T02:41:33.801 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-26T02:43:33.969 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-26T02:45:34.135 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-26T02:47:34.300 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-26T02:49:34.443 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-26T02:49:34.515 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-26T02:49:34.631 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-26T02:49:34.632 INFO:teuthology.nuke:Checking targets against current locks 2023-10-26T02:49:34.679 DEBUG:teuthology.nuke:shortname: smithi094 2023-10-26T02:49:34.680 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-26T02:49:34.704 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi094.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-10-26_02:25:12-upgrade:reef-x-main-distro-default-smithi/7438267', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-26 02:30:29.723079', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJTVeo+gx0WP9suZ4gxJga5D4mxoOjlhtAkY3W7baBB+N3gnaqrSWd1vxF0Jn64K3yBwI5MVZtfe3PSLE9XEVas='} 2023-10-26T02:49:34.707 DEBUG:teuthology.nuke:shortname: smithi179 2023-10-26T02:49:34.707 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-26T02:49:34.729 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi179.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-10-26_02:25:12-upgrade:reef-x-main-distro-default-smithi/7438267', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-26 02:30:29.724590', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN6IK3dXq+Ni7iM/J/aaEVLQFsJ7GfSY/UWqHhNHSmM69fAO9jiVHqEgFbsLldz/Kot2UxQymH4UOBlit5JQxk0='} 2023-10-26T02:49:34.757 INFO:teuthology.orchestra.console.smithi094:Power off 2023-10-26T02:49:34.758 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-26T02:49:34.773 INFO:teuthology.orchestra.console.smithi179:Power off 2023-10-26T02:49:34.774 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-26T02:49:34.782 DEBUG:teuthology.orchestra.console.smithi094:power off output: Chassis Power Control: Down/Off 2023-10-26T02:49:34.782 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-26T02:49:34.794 DEBUG:teuthology.orchestra.console.smithi179:power off output: Chassis Power Control: Down/Off 2023-10-26T02:49:34.795 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-26T02:49:34.803 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is off 2023-10-26T02:49:34.815 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2023-10-26T02:49:34.904 INFO:teuthology.orchestra.console.smithi094:Power off completed 2023-10-26T02:49:34.916 INFO:teuthology.orchestra.console.smithi179:Power off completed 2023-10-26T02:49:35.055 INFO:teuthology.lock.ops:unlocked: smithi094.front.sepia.ceph.com 2023-10-26T02:49:35.063 INFO:teuthology.lock.ops:unlocked: smithi179.front.sepia.ceph.com