2023-11-05T01:50:55.678 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-05T01:50:55.679 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T01:50:55.814 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5764bda670>, signals=[15]) 2023-11-05T01:50:55.815 INFO:teuthology.lock.ops:Start node 'smithi129.front.sepia.ceph.com' reimaging 2023-11-05T01:50:55.816 INFO:teuthology.lock.ops:Updating [smithi129.front.sepia.ceph.com]: reset os type and version on server 2023-11-05T01:50:55.816 INFO:teuthology.lock.ops:Updating smithi129.front.sepia.ceph.com on lock server 2023-11-05T01:50:55.840 INFO:teuthology.lock.ops:Start node 'smithi132.front.sepia.ceph.com' reimaging 2023-11-05T01:50:55.840 INFO:teuthology.lock.ops:Updating [smithi132.front.sepia.ceph.com]: reset os type and version on server 2023-11-05T01:50:55.841 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server 2023-11-05T01:50:55.842 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /host {"name": "smithi129"} 2023-11-05T01:50:55.865 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /host {"name": "smithi132"} 2023-11-05T01:50:55.943 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-11-05T01:50:55.944 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-11-05T01:50:55.980 DEBUG:teuthology.provision.fog.smithi129:Requesting image smithi_centos_9.stream (ID 10) 2023-11-05T01:50:55.981 DEBUG:teuthology.provision.fog.smithi129:FOG request: PUT /host/234 {"imageID": 10} 2023-11-05T01:50:55.993 DEBUG:teuthology.provision.fog.smithi132:Requesting image smithi_centos_9.stream (ID 10) 2023-11-05T01:50:55.994 DEBUG:teuthology.provision.fog.smithi132:FOG request: PUT /host/237 {"imageID": 10} 2023-11-05T01:50:56.032 INFO:teuthology.provision.fog.smithi129:Scheduling deploy of centos 9.stream 2023-11-05T01:50:56.032 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-11-05T01:50:56.035 INFO:teuthology.provision.fog.smithi132:Scheduling deploy of centos 9.stream 2023-11-05T01:50:56.035 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-11-05T01:50:56.088 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /tasktype {"name": "deploy"} 2023-11-05T01:50:56.092 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /tasktype {"name": "deploy"} 2023-11-05T01:50:56.128 DEBUG:teuthology.provision.fog.smithi129:FOG request: POST /host/234/task {"taskTypeID": 1} 2023-11-05T01:50:56.132 DEBUG:teuthology.provision.fog.smithi132:FOG request: POST /host/237/task {"taskTypeID": 1} 2023-11-05T01:50:56.184 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-11-05T01:50:56.188 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-11-05T01:50:56.282 INFO:teuthology.orchestra.console.smithi129:Power off 2023-11-05T01:50:56.283 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-05T01:50:56.298 INFO:teuthology.orchestra.console.smithi132:Power off 2023-11-05T01:50:56.298 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-05T01:50:56.306 DEBUG:teuthology.orchestra.console.smithi129:power off output: Chassis Power Control: Down/Off 2023-11-05T01:50:56.307 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T01:50:56.322 DEBUG:teuthology.orchestra.console.smithi132:power off output: Chassis Power Control: Down/Off 2023-11-05T01:50:56.323 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T01:50:56.331 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is on 2023-11-05T01:50:56.344 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off 2023-11-05T01:50:56.445 INFO:teuthology.orchestra.console.smithi132:Power off completed 2023-11-05T01:50:56.545 INFO:teuthology.orchestra.console.smithi132:Power on 2023-11-05T01:50:56.546 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-05T01:50:56.567 DEBUG:teuthology.orchestra.console.smithi132:power on output: Chassis Power Control: Up/On 2023-11-05T01:50:56.568 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T01:50:56.591 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off 2023-11-05T01:51:00.334 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T01:51:00.447 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is on 2023-11-05T01:51:00.593 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T01:51:00.703 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on 2023-11-05T01:51:00.804 INFO:teuthology.orchestra.console.smithi132:Power on completed 2023-11-05T01:51:00.905 INFO:teuthology.provision.fog.smithi132:Waiting for deploy to finish 2023-11-05T01:51:00.906 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-11-05T01:51:04.450 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T01:51:04.559 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is on 2023-11-05T01:51:08.561 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T01:51:08.670 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off 2023-11-05T01:51:08.771 INFO:teuthology.orchestra.console.smithi129:Power off completed 2023-11-05T01:51:08.872 INFO:teuthology.orchestra.console.smithi129:Power on 2023-11-05T01:51:08.872 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-05T01:51:08.894 DEBUG:teuthology.orchestra.console.smithi129:power on output: Chassis Power Control: Up/On 2023-11-05T01:51:08.894 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T01:51:08.914 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off 2023-11-05T01:51:12.919 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T01:51:13.029 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off 2023-11-05T01:51:15.978 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-11-05T01:51:17.030 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T01:51:17.139 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is on 2023-11-05T01:51:17.240 INFO:teuthology.orchestra.console.smithi129:Power on completed 2023-11-05T01:51:17.341 INFO:teuthology.provision.fog.smithi129:Waiting for deploy to finish 2023-11-05T01:51:17.341 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-11-05T01:51:31.062 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-11-05T01:51:32.408 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-11-05T01:51:46.146 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-11-05T01:51:47.466 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-11-05T01:52:01.222 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-11-05T01:52:02.529 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-11-05T01:52:16.294 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-11-05T01:52:17.598 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-11-05T01:52:31.378 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-11-05T01:52:32.662 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-11-05T01:52:46.456 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-11-05T01:52:47.737 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-11-05T01:53:01.542 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-11-05T01:53:02.806 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-11-05T01:53:16.618 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-11-05T01:53:17.874 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-11-05T01:53:31.694 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-11-05T01:53:31.756 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T01:53:32.942 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-11-05T01:53:34.810 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-11-05T01:53:40.815 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T01:53:43.866 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-11-05T01:53:48.010 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-11-05T01:53:48.064 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T01:53:48.143 ERROR:teuthology.orchestra.connection:Error authenticating with smithi129.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-11-05T01:53:49.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T01:53:52.926 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-11-05T01:53:58.928 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T01:54:02.010 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-11-05T01:54:08.012 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T01:54:11.067 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-11-05T01:54:17.068 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T01:54:20.122 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-11-05T01:54:26.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T01:54:44.474 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-11-05T01:54:50.476 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T01:54:52.149 WARNING:teuthology.provision.fog.smithi129:timed out 2023-11-05T01:54:53.530 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-11-05T01:54:58.151 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T01:54:59.532 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T01:55:02.586 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-11-05T01:55:08.588 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T01:55:08.904 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-05T01:55:08.905 DEBUG:teuthology.orchestra.run.smithi132:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-05T01:55:16.474 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2023-11-05T01:55:22.476 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T01:55:24.345 INFO:teuthology.provision.fog.smithi132:Node is ready 2023-11-05T01:55:24.345 DEBUG:teuthology.orchestra.run.smithi132:> hostname 2023-11-05T01:55:24.363 INFO:teuthology.orchestra.run.smithi132.stdout:smithi132.front.sepia.ceph.com 2023-11-05T01:55:24.363 DEBUG:teuthology.orchestra.run.smithi132:> grep smithi132.front.sepia.ceph.com /etc/hosts 2023-11-05T01:55:24.420 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.15.132 smithi132.front.sepia.ceph.com smithi132 2023-11-05T01:55:24.420 DEBUG:teuthology.orchestra.run.smithi132:> sudo hostname smithi132 2023-11-05T01:55:24.513 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/smithi132.front.sepia.ceph.com/smithi132/g' /etc/hosts 2023-11-05T01:55:24.544 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/172.21.15.132/172.21.15.132/g' /etc/hosts 2023-11-05T01:55:24.613 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/smithi132.front.sepia.ceph.com/smithi132/g' /etc/hostname 2023-11-05T01:55:24.683 DEBUG:teuthology.orchestra.run.smithi132:> sudo hostname smithi132 2023-11-05T01:55:24.752 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release 2023-11-05T01:55:24.807 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="CentOS Stream" 2023-11-05T01:55:24.807 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="9" 2023-11-05T01:55:24.807 INFO:teuthology.orchestra.run.smithi132.stdout:ID="centos" 2023-11-05T01:55:24.807 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="rhel fedora" 2023-11-05T01:55:24.808 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="9" 2023-11-05T01:55:24.808 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el9" 2023-11-05T01:55:24.808 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-05T01:55:24.808 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31" 2023-11-05T01:55:24.809 INFO:teuthology.orchestra.run.smithi132.stdout:LOGO="fedora-logo-icon" 2023-11-05T01:55:24.809 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-05T01:55:24.809 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://centos.org/" 2023-11-05T01:55:24.809 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-05T01:55:24.810 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-05T01:55:24.810 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-05T01:55:24.811 INFO:teuthology.provision.fog.smithi132:Deploy complete! 2023-11-05T01:55:24.812 DEBUG:teuthology.parallel:result is None 2023-11-05T01:55:25.534 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2023-11-05T01:55:31.536 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T01:55:32.262 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-05T01:55:32.263 DEBUG:teuthology.orchestra.run.smithi129:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-05T01:55:52.593 INFO:teuthology.provision.fog.smithi129:Node is ready 2023-11-05T01:55:52.594 DEBUG:teuthology.orchestra.run.smithi129:> hostname 2023-11-05T01:55:52.612 INFO:teuthology.orchestra.run.smithi129.stdout:smithi129.front.sepia.ceph.com 2023-11-05T01:55:52.613 DEBUG:teuthology.orchestra.run.smithi129:> grep smithi129.front.sepia.ceph.com /etc/hosts 2023-11-05T01:55:52.671 INFO:teuthology.orchestra.run.smithi129.stdout:172.21.15.129 smithi129.front.sepia.ceph.com smithi129 2023-11-05T01:55:52.671 DEBUG:teuthology.orchestra.run.smithi129:> sudo hostname smithi129 2023-11-05T01:55:52.792 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i -e 's/smithi129.front.sepia.ceph.com/smithi129/g' /etc/hosts 2023-11-05T01:55:52.822 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i -e 's/172.21.15.129/172.21.15.129/g' /etc/hosts 2023-11-05T01:55:52.892 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i -e 's/smithi129.front.sepia.ceph.com/smithi129/g' /etc/hostname 2023-11-05T01:55:52.962 DEBUG:teuthology.orchestra.run.smithi129:> sudo hostname smithi129 2023-11-05T01:55:53.031 DEBUG:teuthology.orchestra.run.smithi129:> cat /etc/os-release 2023-11-05T01:55:53.087 INFO:teuthology.orchestra.run.smithi129.stdout:NAME="CentOS Stream" 2023-11-05T01:55:53.088 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION="9" 2023-11-05T01:55:53.088 INFO:teuthology.orchestra.run.smithi129.stdout:ID="centos" 2023-11-05T01:55:53.088 INFO:teuthology.orchestra.run.smithi129.stdout:ID_LIKE="rhel fedora" 2023-11-05T01:55:53.088 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION_ID="9" 2023-11-05T01:55:53.089 INFO:teuthology.orchestra.run.smithi129.stdout:PLATFORM_ID="platform:el9" 2023-11-05T01:55:53.089 INFO:teuthology.orchestra.run.smithi129.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-05T01:55:53.089 INFO:teuthology.orchestra.run.smithi129.stdout:ANSI_COLOR="0;31" 2023-11-05T01:55:53.089 INFO:teuthology.orchestra.run.smithi129.stdout:LOGO="fedora-logo-icon" 2023-11-05T01:55:53.089 INFO:teuthology.orchestra.run.smithi129.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-05T01:55:53.090 INFO:teuthology.orchestra.run.smithi129.stdout:HOME_URL="https://centos.org/" 2023-11-05T01:55:53.090 INFO:teuthology.orchestra.run.smithi129.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-05T01:55:53.090 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-05T01:55:53.090 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-05T01:55:53.091 INFO:teuthology.provision.fog.smithi129:Deploy complete! 2023-11-05T01:55:53.091 DEBUG:teuthology.parallel:result is None 2023-11-05T01:55:53.256 INFO:teuthology.lock.ops:Checking smithi129.front.sepia.ceph.com 2023-11-05T01:55:53.257 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-05T01:55:53.281 INFO:teuthology.lock.ops:Checking smithi132.front.sepia.ceph.com 2023-11-05T01:55:53.282 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-05T01:55:53.300 INFO:teuthology.lock.ops:Updating [smithi129.front.sepia.ceph.com]: set os type and version on server 2023-11-05T01:55:53.300 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com' 2023-11-05T01:55:53.301 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T01:55:53.384 DEBUG:teuthology.orchestra.run.smithi129:> true 2023-11-05T01:55:53.454 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi129.front.sepia.ceph.com' 2023-11-05T01:55:53.454 DEBUG:teuthology.orchestra.run.smithi129:> uname -m 2023-11-05T01:55:53.509 INFO:teuthology.orchestra.run.smithi129.stdout:x86_64 2023-11-05T01:55:53.509 DEBUG:teuthology.orchestra.run.smithi129:> cat /etc/os-release 2023-11-05T01:55:53.564 INFO:teuthology.orchestra.run.smithi129.stdout:NAME="CentOS Stream" 2023-11-05T01:55:53.565 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION="9" 2023-11-05T01:55:53.565 INFO:teuthology.orchestra.run.smithi129.stdout:ID="centos" 2023-11-05T01:55:53.565 INFO:teuthology.orchestra.run.smithi129.stdout:ID_LIKE="rhel fedora" 2023-11-05T01:55:53.565 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION_ID="9" 2023-11-05T01:55:53.566 INFO:teuthology.orchestra.run.smithi129.stdout:PLATFORM_ID="platform:el9" 2023-11-05T01:55:53.566 INFO:teuthology.orchestra.run.smithi129.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-05T01:55:53.566 INFO:teuthology.orchestra.run.smithi129.stdout:ANSI_COLOR="0;31" 2023-11-05T01:55:53.566 INFO:teuthology.orchestra.run.smithi129.stdout:LOGO="fedora-logo-icon" 2023-11-05T01:55:53.566 INFO:teuthology.orchestra.run.smithi129.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-05T01:55:53.567 INFO:teuthology.orchestra.run.smithi129.stdout:HOME_URL="https://centos.org/" 2023-11-05T01:55:53.567 INFO:teuthology.orchestra.run.smithi129.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-05T01:55:53.567 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-05T01:55:53.567 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-05T01:55:53.568 INFO:teuthology.lock.ops:Updating smithi129.front.sepia.ceph.com on lock server 2023-11-05T01:55:53.590 INFO:teuthology.lock.ops:Updating [smithi132.front.sepia.ceph.com]: set os type and version on server 2023-11-05T01:55:53.590 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2023-11-05T01:55:53.591 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T01:55:53.677 DEBUG:teuthology.orchestra.run.smithi132:> true 2023-11-05T01:55:53.848 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi132.front.sepia.ceph.com' 2023-11-05T01:55:53.849 DEBUG:teuthology.orchestra.run.smithi132:> uname -m 2023-11-05T01:55:53.902 INFO:teuthology.orchestra.run.smithi132.stdout:x86_64 2023-11-05T01:55:53.903 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release 2023-11-05T01:55:53.957 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="CentOS Stream" 2023-11-05T01:55:53.958 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="9" 2023-11-05T01:55:53.958 INFO:teuthology.orchestra.run.smithi132.stdout:ID="centos" 2023-11-05T01:55:53.958 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="rhel fedora" 2023-11-05T01:55:53.959 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="9" 2023-11-05T01:55:53.959 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el9" 2023-11-05T01:55:53.959 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-05T01:55:53.959 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31" 2023-11-05T01:55:53.959 INFO:teuthology.orchestra.run.smithi132.stdout:LOGO="fedora-logo-icon" 2023-11-05T01:55:53.960 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-05T01:55:53.960 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://centos.org/" 2023-11-05T01:55:53.960 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-05T01:55:53.960 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-05T01:55:53.961 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-05T01:55:53.961 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server 2023-11-05T01:55:53.981 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T01:55:54.072 INFO:teuthology.dispatcher.supervisor:Running job 7447487 2023-11-05T01:55:54.072 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-11-04_11:32:36-fs-wip-yuri-testing-2023-11-01-1538-reef-distro-default-smithi/7447487 --name yuriw-2023-11-04_11:32:36-fs-wip-yuri-testing-2023-11-01-1538-reef-distro-default-smithi --description fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/clone}} -- /home/teuthworker/archive/yuriw-2023-11-04_11:32:36-fs-wip-yuri-testing-2023-11-01-1538-reef-distro-default-smithi/7447487/orig.config.yaml 2023-11-05T01:55:54.075 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-11-04_11:32:36-fs-wip-yuri-testing-2023-11-01-1538-reef-distro-default-smithi/7447487 2023-11-05T01:55:54.076 INFO:teuthology.dispatcher.supervisor:Job PID: 3377276 2023-11-05T01:55:54.076 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-05T01:57:54.078 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T01:59:54.144 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T02:01:54.212 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T02:03:54.277 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T02:05:54.346 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T02:07:54.409 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T02:09:54.476 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T02:11:54.547 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T02:13:54.615 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T02:15:54.680 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T02:17:54.757 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T02:19:54.824 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T02:21:54.900 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T02:23:54.986 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T02:25:55.060 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T02:27:55.129 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T02:29:55.194 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T02:31:55.264 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T02:33:55.330 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T02:35:55.395 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T02:37:55.465 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T02:39:55.524 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T02:41:55.592 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T02:43:55.659 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T02:45:55.724 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T02:47:55.795 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T02:49:55.866 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T02:51:55.934 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T02:53:55.997 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T02:55:56.063 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T02:57:56.138 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T02:59:56.203 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T03:01:56.261 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T03:03:56.338 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T03:05:56.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T03:07:56.465 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T03:07:56.529 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-11-05T03:07:56.707 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-05T03:07:56.708 INFO:teuthology.nuke:Checking targets against current locks 2023-11-05T03:07:56.759 DEBUG:teuthology.nuke:shortname: smithi129 2023-11-05T03:07:56.759 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-05T03:07:56.773 DEBUG:teuthology.nuke:shortname: smithi132 2023-11-05T03:07:56.774 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-05T03:07:56.778 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi129.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-04_11:32:36-fs-wip-yuri-testing-2023-11-01-1538-reef-distro-default-smithi/7447487', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-05 01:50:54.861446', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFNGIhq6mgziooiUL6RGt9D0WqVv/iz2fqG730fBnTA3zYg2djrFKPB7RBlcGzPH28+8pkq7kGAhOVvxiUjtxd4='} 2023-11-05T03:07:56.795 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi132.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-04_11:32:36-fs-wip-yuri-testing-2023-11-01-1538-reef-distro-default-smithi/7447487', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-05 01:50:54.859801', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ0cbSu1inLt7dCu1NPVPF75mWQpETNNIxuYMzLUfvsTumwGofTdBsdrCrQFcUOrIzaDeM2uMDKWlFwzwrTW21w='} 2023-11-05T03:07:56.824 INFO:teuthology.orchestra.console.smithi129:Power off 2023-11-05T03:07:56.824 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-05T03:07:56.847 DEBUG:teuthology.orchestra.console.smithi129:power off output: Chassis Power Control: Down/Off 2023-11-05T03:07:56.847 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T03:07:56.860 INFO:teuthology.orchestra.console.smithi132:Power off 2023-11-05T03:07:56.860 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-05T03:07:56.868 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off 2023-11-05T03:07:56.881 DEBUG:teuthology.orchestra.console.smithi132:power off output: Chassis Power Control: Down/Off 2023-11-05T03:07:56.882 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T03:07:56.902 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off 2023-11-05T03:07:56.969 INFO:teuthology.orchestra.console.smithi129:Power off completed 2023-11-05T03:07:57.004 INFO:teuthology.orchestra.console.smithi132:Power off completed 2023-11-05T03:07:57.120 INFO:teuthology.lock.ops:unlocked: smithi129.front.sepia.ceph.com 2023-11-05T03:07:57.152 INFO:teuthology.lock.ops:unlocked: smithi132.front.sepia.ceph.com