2023-10-19T17:20:45.446 INFO:root:teuthology version: 0.0.1.dev201+g202b180 2023-10-19T17:20:45.448 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T17:20:45.576 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f363c491670>, signals=[15]) 2023-10-19T17:20:45.577 INFO:teuthology.lock.ops:Start node 'smithi132.front.sepia.ceph.com' reimaging 2023-10-19T17:20:45.578 INFO:teuthology.lock.ops:Updating [smithi132.front.sepia.ceph.com]: reset os type and version on server 2023-10-19T17:20:45.578 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server 2023-10-19T17:20:45.599 INFO:teuthology.lock.ops:Start node 'smithi161.front.sepia.ceph.com' reimaging 2023-10-19T17:20:45.600 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: reset os type and version on server 2023-10-19T17:20:45.600 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2023-10-19T17:20:45.602 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /host {"name": "smithi132"} 2023-10-19T17:20:45.625 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /host {"name": "smithi161"} 2023-10-19T17:20:45.670 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-10-19T17:20:45.689 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-10-19T17:20:45.721 DEBUG:teuthology.provision.fog.smithi132:Requesting image smithi_centos_9.stream (ID 10) 2023-10-19T17:20:45.721 DEBUG:teuthology.provision.fog.smithi132:FOG request: PUT /host/237 {"imageID": 10} 2023-10-19T17:20:45.742 DEBUG:teuthology.provision.fog.smithi161:Requesting image smithi_centos_9.stream (ID 10) 2023-10-19T17:20:45.742 DEBUG:teuthology.provision.fog.smithi161:FOG request: PUT /host/266 {"imageID": 10} 2023-10-19T17:20:45.769 INFO:teuthology.provision.fog.smithi132:Scheduling deploy of centos 9.stream 2023-10-19T17:20:45.769 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-10-19T17:20:45.791 INFO:teuthology.provision.fog.smithi161:Scheduling deploy of centos 9.stream 2023-10-19T17:20:45.791 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-19T17:20:45.828 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /tasktype {"name": "deploy"} 2023-10-19T17:20:45.845 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /tasktype {"name": "deploy"} 2023-10-19T17:20:45.863 DEBUG:teuthology.provision.fog.smithi132:FOG request: POST /host/237/task {"taskTypeID": 1} 2023-10-19T17:20:45.879 DEBUG:teuthology.provision.fog.smithi161:FOG request: POST /host/266/task {"taskTypeID": 1} 2023-10-19T17:20:45.932 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-10-19T17:20:45.948 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-19T17:20:46.021 INFO:teuthology.orchestra.console.smithi132:Power off 2023-10-19T17:20:46.022 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-19T17:20:46.034 INFO:teuthology.orchestra.console.smithi161:Power off 2023-10-19T17:20:46.034 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-19T17:20:46.044 DEBUG:teuthology.orchestra.console.smithi132:power off output: Chassis Power Control: Down/Off 2023-10-19T17:20:46.044 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T17:20:46.055 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off 2023-10-19T17:20:46.056 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T17:20:46.065 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on 2023-10-19T17:20:46.077 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2023-10-19T17:20:50.066 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T17:20:50.078 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T17:20:50.176 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on 2023-10-19T17:20:50.187 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2023-10-19T17:20:54.178 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T17:20:54.188 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T17:20:54.288 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off 2023-10-19T17:20:54.296 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2023-10-19T17:20:54.390 INFO:teuthology.orchestra.console.smithi132:Power off completed 2023-10-19T17:20:54.491 INFO:teuthology.orchestra.console.smithi132:Power on 2023-10-19T17:20:54.491 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-19T17:20:54.511 DEBUG:teuthology.orchestra.console.smithi132:power on output: Chassis Power Control: Up/On 2023-10-19T17:20:54.512 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T17:20:54.532 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off 2023-10-19T17:20:58.298 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T17:20:58.407 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2023-10-19T17:20:58.508 INFO:teuthology.orchestra.console.smithi161:Power off completed 2023-10-19T17:20:58.533 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T17:20:58.609 INFO:teuthology.orchestra.console.smithi161:Power on 2023-10-19T17:20:58.610 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-19T17:20:58.630 DEBUG:teuthology.orchestra.console.smithi161:power on output: Chassis Power Control: Up/On 2023-10-19T17:20:58.631 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T17:20:58.642 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off 2023-10-19T17:20:58.651 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2023-10-19T17:21:02.646 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T17:21:02.653 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T17:21:02.761 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2023-10-19T17:21:02.873 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on 2023-10-19T17:21:02.974 INFO:teuthology.orchestra.console.smithi132:Power on completed 2023-10-19T17:21:03.074 INFO:teuthology.provision.fog.smithi132:Waiting for deploy to finish 2023-10-19T17:21:03.075 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-10-19T17:21:06.762 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T17:21:06.870 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2023-10-19T17:21:06.971 INFO:teuthology.orchestra.console.smithi161:Power on completed 2023-10-19T17:21:07.072 INFO:teuthology.provision.fog.smithi161:Waiting for deploy to finish 2023-10-19T17:21:07.073 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-19T17:21:18.159 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-10-19T17:21:22.142 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-19T17:21:33.250 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-10-19T17:21:37.228 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-19T17:21:48.327 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-10-19T17:21:52.314 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-19T17:22:03.435 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-10-19T17:22:07.404 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-19T17:22:18.522 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-10-19T17:22:22.474 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-19T17:22:33.609 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-10-19T17:22:37.552 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-19T17:22:48.690 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-10-19T17:22:52.626 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-19T17:23:03.766 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-10-19T17:23:07.698 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-19T17:23:18.850 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-10-19T17:23:22.774 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-19T17:23:33.933 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-10-19T17:23:33.999 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T17:23:37.850 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-19T17:23:52.314 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-10-19T17:23:52.929 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-19T17:23:52.987 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T17:23:58.318 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T17:24:01.374 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-10-19T17:24:07.379 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T17:24:10.458 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-10-19T17:24:11.517 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-10-19T17:24:16.463 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T17:24:17.520 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T17:24:19.514 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-10-19T17:24:20.574 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-10-19T17:24:25.520 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T17:24:26.577 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T17:24:29.662 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-10-19T17:24:35.667 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T17:24:38.746 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-10-19T17:24:44.750 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T17:25:25.558 WARNING:teuthology.provision.fog.smithi132:timed out 2023-10-19T17:25:31.565 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T17:25:31.780 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-19T17:25:31.781 DEBUG:teuthology.orchestra.run.smithi132:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-19T17:25:32.099 INFO:teuthology.provision.fog.smithi132:Node is ready 2023-10-19T17:25:32.100 DEBUG:teuthology.orchestra.run.smithi132:> hostname 2023-10-19T17:25:32.115 INFO:teuthology.orchestra.run.smithi132.stdout:smithi132.front.sepia.ceph.com 2023-10-19T17:25:32.116 DEBUG:teuthology.orchestra.run.smithi132:> grep smithi132.front.sepia.ceph.com /etc/hosts 2023-10-19T17:25:32.171 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.15.132 smithi132.front.sepia.ceph.com smithi132 2023-10-19T17:25:32.171 DEBUG:teuthology.orchestra.run.smithi132:> sudo hostname smithi132 2023-10-19T17:25:32.275 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/smithi132.front.sepia.ceph.com/smithi132/g' /etc/hosts 2023-10-19T17:25:32.303 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/172.21.15.132/172.21.15.132/g' /etc/hosts 2023-10-19T17:25:32.370 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/smithi132.front.sepia.ceph.com/smithi132/g' /etc/hostname 2023-10-19T17:25:32.437 DEBUG:teuthology.orchestra.run.smithi132:> sudo hostname smithi132 2023-10-19T17:25:32.503 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release 2023-10-19T17:25:32.558 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="CentOS Stream" 2023-10-19T17:25:32.558 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="9" 2023-10-19T17:25:32.558 INFO:teuthology.orchestra.run.smithi132.stdout:ID="centos" 2023-10-19T17:25:32.558 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="rhel fedora" 2023-10-19T17:25:32.559 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="9" 2023-10-19T17:25:32.559 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el9" 2023-10-19T17:25:32.559 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-19T17:25:32.559 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31" 2023-10-19T17:25:32.559 INFO:teuthology.orchestra.run.smithi132.stdout:LOGO="fedora-logo-icon" 2023-10-19T17:25:32.559 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-19T17:25:32.560 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://centos.org/" 2023-10-19T17:25:32.560 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-19T17:25:32.560 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-19T17:25:32.560 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-19T17:25:32.561 INFO:teuthology.provision.fog.smithi132:Deploy complete! 2023-10-19T17:25:32.563 DEBUG:teuthology.parallel:result is None 2023-10-19T17:25:44.763 WARNING:teuthology.provision.fog.smithi161:timed out 2023-10-19T17:25:50.767 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T17:25:51.035 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-19T17:25:51.036 DEBUG:teuthology.orchestra.run.smithi161:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-19T17:25:51.341 INFO:teuthology.provision.fog.smithi161:Node is ready 2023-10-19T17:25:51.341 DEBUG:teuthology.orchestra.run.smithi161:> hostname 2023-10-19T17:25:51.356 INFO:teuthology.orchestra.run.smithi161.stdout:smithi161.front.sepia.ceph.com 2023-10-19T17:25:51.357 DEBUG:teuthology.orchestra.run.smithi161:> grep smithi161.front.sepia.ceph.com /etc/hosts 2023-10-19T17:25:51.412 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.15.161 smithi161.front.sepia.ceph.com smithi161 2023-10-19T17:25:51.412 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161 2023-10-19T17:25:51.521 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hosts 2023-10-19T17:25:51.550 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/172.21.15.161/172.21.15.161/g' /etc/hosts 2023-10-19T17:25:51.617 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hostname 2023-10-19T17:25:51.684 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161 2023-10-19T17:25:51.750 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2023-10-19T17:25:51.805 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream" 2023-10-19T17:25:51.805 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="9" 2023-10-19T17:25:51.805 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos" 2023-10-19T17:25:51.805 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora" 2023-10-19T17:25:51.806 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="9" 2023-10-19T17:25:51.806 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el9" 2023-10-19T17:25:51.806 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-19T17:25:51.806 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31" 2023-10-19T17:25:51.807 INFO:teuthology.orchestra.run.smithi161.stdout:LOGO="fedora-logo-icon" 2023-10-19T17:25:51.807 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-19T17:25:51.807 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/" 2023-10-19T17:25:51.807 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-19T17:25:51.807 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-19T17:25:51.808 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-19T17:25:51.808 INFO:teuthology.provision.fog.smithi161:Deploy complete! 2023-10-19T17:25:51.809 DEBUG:teuthology.parallel:result is None 2023-10-19T17:25:51.970 INFO:teuthology.lock.ops:Checking smithi132.front.sepia.ceph.com 2023-10-19T17:25:51.971 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-19T17:25:51.998 INFO:teuthology.lock.ops:Checking smithi161.front.sepia.ceph.com 2023-10-19T17:25:51.998 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-19T17:25:52.024 INFO:teuthology.lock.ops:Updating [smithi132.front.sepia.ceph.com]: set os type and version on server 2023-10-19T17:25:52.025 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2023-10-19T17:25:52.025 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T17:25:52.106 DEBUG:teuthology.orchestra.run.smithi132:> true 2023-10-19T17:25:52.276 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi132.front.sepia.ceph.com' 2023-10-19T17:25:52.277 DEBUG:teuthology.orchestra.run.smithi132:> uname -m 2023-10-19T17:25:52.331 INFO:teuthology.orchestra.run.smithi132.stdout:x86_64 2023-10-19T17:25:52.331 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release 2023-10-19T17:25:52.385 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="CentOS Stream" 2023-10-19T17:25:52.385 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="9" 2023-10-19T17:25:52.386 INFO:teuthology.orchestra.run.smithi132.stdout:ID="centos" 2023-10-19T17:25:52.386 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="rhel fedora" 2023-10-19T17:25:52.386 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="9" 2023-10-19T17:25:52.386 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el9" 2023-10-19T17:25:52.386 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-19T17:25:52.387 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31" 2023-10-19T17:25:52.387 INFO:teuthology.orchestra.run.smithi132.stdout:LOGO="fedora-logo-icon" 2023-10-19T17:25:52.387 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-19T17:25:52.387 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://centos.org/" 2023-10-19T17:25:52.387 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-19T17:25:52.388 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-19T17:25:52.388 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-19T17:25:52.388 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server 2023-10-19T17:25:52.406 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: set os type and version on server 2023-10-19T17:25:52.407 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-10-19T17:25:52.408 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T17:25:52.491 DEBUG:teuthology.orchestra.run.smithi161:> true 2023-10-19T17:25:52.560 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-10-19T17:25:52.560 DEBUG:teuthology.orchestra.run.smithi161:> uname -m 2023-10-19T17:25:52.614 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64 2023-10-19T17:25:52.615 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2023-10-19T17:25:52.669 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream" 2023-10-19T17:25:52.669 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="9" 2023-10-19T17:25:52.669 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos" 2023-10-19T17:25:52.669 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora" 2023-10-19T17:25:52.670 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="9" 2023-10-19T17:25:52.670 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el9" 2023-10-19T17:25:52.670 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-19T17:25:52.670 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31" 2023-10-19T17:25:52.671 INFO:teuthology.orchestra.run.smithi161.stdout:LOGO="fedora-logo-icon" 2023-10-19T17:25:52.671 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-19T17:25:52.671 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/" 2023-10-19T17:25:52.671 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-19T17:25:52.671 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-19T17:25:52.672 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-19T17:25:52.672 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2023-10-19T17:25:52.707 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T17:25:52.792 INFO:teuthology.dispatcher.supervisor:Running job 7432436 2023-10-19T17:25:52.792 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-10-19_16:23:25-rados-wip-yuri10-testing-2023-10-11-0812-distro-default-smithi/7432436 --name yuriw-2023-10-19_16:23:25-rados-wip-yuri10-testing-2023-10-11-0812-distro-default-smithi --description rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/cache-snaps-balanced} -- /home/teuthworker/archive/yuriw-2023-10-19_16:23:25-rados-wip-yuri10-testing-2023-10-11-0812-distro-default-smithi/7432436/orig.config.yaml 2023-10-19T17:25:52.795 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-10-19_16:23:25-rados-wip-yuri10-testing-2023-10-11-0812-distro-default-smithi/7432436 2023-10-19T17:25:52.796 INFO:teuthology.dispatcher.supervisor:Job PID: 412734 2023-10-19T17:25:52.797 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-19T17:27:52.879 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T17:29:53.043 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T17:31:53.203 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T17:33:53.377 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T17:35:53.555 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T17:37:53.732 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T17:39:53.896 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T17:41:54.060 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T17:43:54.224 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T17:45:54.409 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T17:47:54.583 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T17:49:54.748 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T17:51:54.920 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T17:53:55.099 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T17:55:55.262 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T17:57:55.423 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T17:59:55.580 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T17:59:55.641 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-19T17:59:55.828 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-19T17:59:55.829 INFO:teuthology.nuke:Checking targets against current locks 2023-10-19T17:59:55.877 DEBUG:teuthology.nuke:shortname: smithi132 2023-10-19T17:59:55.877 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-19T17:59:55.895 DEBUG:teuthology.nuke:shortname: smithi161 2023-10-19T17:59:55.895 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-19T17:59:55.899 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi132.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-19_16:23:25-rados-wip-yuri10-testing-2023-10-11-0812-distro-default-smithi/7432436', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-19 17:20:44.679630', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCFLXsgczAKzg08lAW0gHP+3HIhmfNEWVd6sXAheHyxvKHlzxFde3edonPEzd2+7hDgENGrD3SLy3ejAvFbLDYo='} 2023-10-19T17:59:55.916 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi161.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-19_16:23:25-rados-wip-yuri10-testing-2023-10-11-0812-distro-default-smithi/7432436', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-19 17:20:44.678633', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIrXLBDGhrFs8gPBrj1VcinzBzhKDiWRj9Z3Jz/BZk6a7pUDtx0oiWob26AeQXJtEiRB8u5C1qGL7jYxYSq7o8w='} 2023-10-19T17:59:55.947 INFO:teuthology.orchestra.console.smithi132:Power off 2023-10-19T17:59:55.948 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-19T17:59:55.967 INFO:teuthology.orchestra.console.smithi161:Power off 2023-10-19T17:59:55.967 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-19T17:59:55.975 DEBUG:teuthology.orchestra.console.smithi132:power off output: Chassis Power Control: Down/Off 2023-10-19T17:59:55.975 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T17:59:55.989 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off 2023-10-19T17:59:55.989 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T17:59:55.998 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off 2023-10-19T17:59:56.013 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2023-10-19T17:59:56.099 INFO:teuthology.orchestra.console.smithi132:Power off completed 2023-10-19T17:59:56.114 INFO:teuthology.orchestra.console.smithi161:Power off completed 2023-10-19T17:59:56.247 INFO:teuthology.lock.ops:unlocked: smithi132.front.sepia.ceph.com 2023-10-19T17:59:56.262 INFO:teuthology.lock.ops:unlocked: smithi161.front.sepia.ceph.com