2023-10-26T22:06:57.820 INFO:root:teuthology version: 0.0.1.dev201+g202b180 2023-10-26T22:06:57.821 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-26T22:06:57.988 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc841fd9670>, signals=[15]) 2023-10-26T22:06:57.989 INFO:teuthology.lock.ops:Start node 'smithi158.front.sepia.ceph.com' reimaging 2023-10-26T22:06:57.990 INFO:teuthology.lock.ops:Updating [smithi158.front.sepia.ceph.com]: reset os type and version on server 2023-10-26T22:06:57.990 INFO:teuthology.lock.ops:Updating smithi158.front.sepia.ceph.com on lock server 2023-10-26T22:06:58.016 INFO:teuthology.lock.ops:Start node 'smithi186.front.sepia.ceph.com' reimaging 2023-10-26T22:06:58.016 INFO:teuthology.lock.ops:Updating [smithi186.front.sepia.ceph.com]: reset os type and version on server 2023-10-26T22:06:58.017 INFO:teuthology.lock.ops:Updating smithi186.front.sepia.ceph.com on lock server 2023-10-26T22:06:58.018 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /host {"name": "smithi158"} 2023-10-26T22:06:58.042 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /host {"name": "smithi186"} 2023-10-26T22:06:58.108 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-10-26T22:06:58.126 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-10-26T22:06:58.181 DEBUG:teuthology.provision.fog.smithi158:Requesting image smithi_centos_8.stream (ID 3) 2023-10-26T22:06:58.181 DEBUG:teuthology.provision.fog.smithi158:FOG request: PUT /host/263 {"imageID": 3} 2023-10-26T22:06:58.194 DEBUG:teuthology.provision.fog.smithi186:Requesting image smithi_centos_8.stream (ID 3) 2023-10-26T22:06:58.194 DEBUG:teuthology.provision.fog.smithi186:FOG request: PUT /host/291 {"imageID": 3} 2023-10-26T22:06:58.231 INFO:teuthology.provision.fog.smithi158:Scheduling deploy of centos 8.stream 2023-10-26T22:06:58.231 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-10-26T22:06:58.245 INFO:teuthology.provision.fog.smithi186:Scheduling deploy of centos 8.stream 2023-10-26T22:06:58.245 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-10-26T22:06:58.287 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /tasktype {"name": "deploy"} 2023-10-26T22:06:58.302 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /tasktype {"name": "deploy"} 2023-10-26T22:06:58.340 DEBUG:teuthology.provision.fog.smithi186:FOG request: POST /host/291/task {"taskTypeID": 1} 2023-10-26T22:06:58.345 DEBUG:teuthology.provision.fog.smithi158:FOG request: POST /host/263/task {"taskTypeID": 1} 2023-10-26T22:06:58.405 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-10-26T22:06:58.485 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-10-26T22:06:58.525 INFO:teuthology.orchestra.console.smithi186:Power off 2023-10-26T22:06:58.526 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-26T22:06:58.552 DEBUG:teuthology.orchestra.console.smithi186:power off output: Chassis Power Control: Down/Off 2023-10-26T22:06:58.552 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-26T22:06:58.567 INFO:teuthology.orchestra.console.smithi158:Power off 2023-10-26T22:06:58.568 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-26T22:06:58.577 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on 2023-10-26T22:06:58.596 DEBUG:teuthology.orchestra.console.smithi158:power off output: Chassis Power Control: Down/Off 2023-10-26T22:06:58.596 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-26T22:06:58.622 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is off 2023-10-26T22:06:58.723 INFO:teuthology.orchestra.console.smithi158:Power off completed 2023-10-26T22:06:58.824 INFO:teuthology.orchestra.console.smithi158:Power on 2023-10-26T22:06:58.824 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-26T22:06:58.848 DEBUG:teuthology.orchestra.console.smithi158:power on output: Chassis Power Control: Up/On 2023-10-26T22:06:58.848 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-26T22:06:58.869 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is off 2023-10-26T22:07:02.578 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-26T22:07:02.687 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on 2023-10-26T22:07:02.870 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-26T22:07:02.979 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is off 2023-10-26T22:07:06.694 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-26T22:07:06.802 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off 2023-10-26T22:07:06.903 INFO:teuthology.orchestra.console.smithi186:Power off completed 2023-10-26T22:07:06.980 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-26T22:07:07.004 INFO:teuthology.orchestra.console.smithi186:Power on 2023-10-26T22:07:07.005 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-26T22:07:07.026 DEBUG:teuthology.orchestra.console.smithi186:power on output: Chassis Power Control: Up/On 2023-10-26T22:07:07.026 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-26T22:07:07.047 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off 2023-10-26T22:07:07.089 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is on 2023-10-26T22:07:07.190 INFO:teuthology.orchestra.console.smithi158:Power on completed 2023-10-26T22:07:07.290 INFO:teuthology.provision.fog.smithi158:Waiting for deploy to finish 2023-10-26T22:07:07.291 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-10-26T22:07:11.050 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-26T22:07:11.159 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off 2023-10-26T22:07:15.164 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-26T22:07:15.273 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on 2023-10-26T22:07:15.374 INFO:teuthology.orchestra.console.smithi186:Power on completed 2023-10-26T22:07:15.474 INFO:teuthology.provision.fog.smithi186:Waiting for deploy to finish 2023-10-26T22:07:15.475 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-10-26T22:07:22.357 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-10-26T22:07:30.542 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-10-26T22:07:37.418 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-10-26T22:07:45.612 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-10-26T22:07:52.486 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-10-26T22:08:00.678 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-10-26T22:08:07.554 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-10-26T22:08:15.746 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-10-26T22:08:22.622 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-10-26T22:08:30.814 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-10-26T22:08:37.690 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-10-26T22:08:45.878 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-10-26T22:08:52.766 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-10-26T22:09:00.950 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-10-26T22:09:07.834 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-10-26T22:09:16.024 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-10-26T22:09:22.910 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-10-26T22:09:31.118 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-10-26T22:09:37.987 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-10-26T22:09:46.190 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-10-26T22:09:53.054 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-10-26T22:10:01.274 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-10-26T22:10:01.334 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-26T22:10:08.126 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-10-26T22:10:08.180 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-26T22:10:19.898 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-10-26T22:10:25.906 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-26T22:10:26.554 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-10-26T22:10:28.990 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-10-26T22:10:32.559 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-26T22:10:34.994 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-26T22:10:35.642 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-10-26T22:10:38.074 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-10-26T22:10:41.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-26T22:10:44.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-26T22:10:44.702 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-10-26T22:10:47.134 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-10-26T22:10:50.706 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-26T22:10:53.138 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-26T22:10:53.786 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-10-26T22:10:56.218 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-10-26T22:10:59.790 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-26T22:11:02.222 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-26T22:11:02.842 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-10-26T22:11:05.274 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-10-26T22:11:08.847 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-26T22:11:11.278 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-26T22:11:11.898 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-10-26T22:11:17.904 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-26T22:11:20.990 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-10-26T22:11:26.995 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-26T22:11:29.790 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-10-26T22:11:30.078 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-10-26T22:11:35.794 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-26T22:11:36.080 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-26T22:11:38.878 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-10-26T22:11:44.886 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-26T22:11:46.364 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-26T22:11:46.365 DEBUG:teuthology.orchestra.run.smithi186:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-26T22:12:12.034 INFO:teuthology.provision.fog.smithi186:Node is ready 2023-10-26T22:12:12.035 DEBUG:teuthology.orchestra.run.smithi186:> hostname 2023-10-26T22:12:12.059 INFO:teuthology.orchestra.run.smithi186.stdout:smithi186.front.sepia.ceph.com 2023-10-26T22:12:12.060 DEBUG:teuthology.orchestra.run.smithi186:> grep smithi186.front.sepia.ceph.com /etc/hosts 2023-10-26T22:12:12.120 INFO:teuthology.orchestra.run.smithi186.stdout:172.21.15.186 smithi186.front.sepia.ceph.com smithi186 2023-10-26T22:12:12.121 DEBUG:teuthology.orchestra.run.smithi186:> sudo hostname smithi186 2023-10-26T22:12:12.243 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/smithi186.front.sepia.ceph.com/smithi186/g' /etc/hosts 2023-10-26T22:12:12.275 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/172.21.15.186/172.21.15.186/g' /etc/hosts 2023-10-26T22:12:12.344 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/smithi186.front.sepia.ceph.com/smithi186/g' /etc/hostname 2023-10-26T22:12:12.413 DEBUG:teuthology.orchestra.run.smithi186:> sudo hostname smithi186 2023-10-26T22:12:12.482 DEBUG:teuthology.orchestra.run.smithi186:> cat /etc/os-release 2023-10-26T22:12:12.540 INFO:teuthology.orchestra.run.smithi186.stdout:NAME="CentOS Stream" 2023-10-26T22:12:12.540 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION="8" 2023-10-26T22:12:12.541 INFO:teuthology.orchestra.run.smithi186.stdout:ID="centos" 2023-10-26T22:12:12.541 INFO:teuthology.orchestra.run.smithi186.stdout:ID_LIKE="rhel fedora" 2023-10-26T22:12:12.541 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_ID="8" 2023-10-26T22:12:12.541 INFO:teuthology.orchestra.run.smithi186.stdout:PLATFORM_ID="platform:el8" 2023-10-26T22:12:12.541 INFO:teuthology.orchestra.run.smithi186.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-26T22:12:12.542 INFO:teuthology.orchestra.run.smithi186.stdout:ANSI_COLOR="0;31" 2023-10-26T22:12:12.542 INFO:teuthology.orchestra.run.smithi186.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-26T22:12:12.542 INFO:teuthology.orchestra.run.smithi186.stdout:HOME_URL="https://centos.org/" 2023-10-26T22:12:12.542 INFO:teuthology.orchestra.run.smithi186.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-26T22:12:12.542 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-26T22:12:12.543 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-26T22:12:12.543 INFO:teuthology.provision.fog.smithi186:Deploy complete! 2023-10-26T22:12:12.545 DEBUG:teuthology.parallel:result is None 2023-10-26T22:12:36.086 WARNING:teuthology.provision.fog.smithi158:timed out 2023-10-26T22:12:42.089 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-26T22:12:42.356 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-26T22:12:42.356 DEBUG:teuthology.orchestra.run.smithi158:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-26T22:12:42.615 INFO:teuthology.provision.fog.smithi158:Node is ready 2023-10-26T22:12:42.616 DEBUG:teuthology.orchestra.run.smithi158:> hostname 2023-10-26T22:12:42.639 INFO:teuthology.orchestra.run.smithi158.stdout:smithi158.front.sepia.ceph.com 2023-10-26T22:12:42.639 DEBUG:teuthology.orchestra.run.smithi158:> grep smithi158.front.sepia.ceph.com /etc/hosts 2023-10-26T22:12:42.702 INFO:teuthology.orchestra.run.smithi158.stdout:172.21.15.158 smithi158.front.sepia.ceph.com smithi158 2023-10-26T22:12:42.703 DEBUG:teuthology.orchestra.run.smithi158:> sudo hostname smithi158 2023-10-26T22:12:42.805 DEBUG:teuthology.orchestra.run.smithi158:> sudo sed -i -e 's/smithi158.front.sepia.ceph.com/smithi158/g' /etc/hosts 2023-10-26T22:12:42.836 DEBUG:teuthology.orchestra.run.smithi158:> sudo sed -i -e 's/172.21.15.158/172.21.15.158/g' /etc/hosts 2023-10-26T22:12:42.908 DEBUG:teuthology.orchestra.run.smithi158:> sudo sed -i -e 's/smithi158.front.sepia.ceph.com/smithi158/g' /etc/hostname 2023-10-26T22:12:42.983 DEBUG:teuthology.orchestra.run.smithi158:> sudo hostname smithi158 2023-10-26T22:12:43.053 DEBUG:teuthology.orchestra.run.smithi158:> cat /etc/os-release 2023-10-26T22:12:43.115 INFO:teuthology.orchestra.run.smithi158.stdout:NAME="CentOS Stream" 2023-10-26T22:12:43.116 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION="8" 2023-10-26T22:12:43.116 INFO:teuthology.orchestra.run.smithi158.stdout:ID="centos" 2023-10-26T22:12:43.116 INFO:teuthology.orchestra.run.smithi158.stdout:ID_LIKE="rhel fedora" 2023-10-26T22:12:43.116 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION_ID="8" 2023-10-26T22:12:43.117 INFO:teuthology.orchestra.run.smithi158.stdout:PLATFORM_ID="platform:el8" 2023-10-26T22:12:43.117 INFO:teuthology.orchestra.run.smithi158.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-26T22:12:43.117 INFO:teuthology.orchestra.run.smithi158.stdout:ANSI_COLOR="0;31" 2023-10-26T22:12:43.117 INFO:teuthology.orchestra.run.smithi158.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-26T22:12:43.117 INFO:teuthology.orchestra.run.smithi158.stdout:HOME_URL="https://centos.org/" 2023-10-26T22:12:43.117 INFO:teuthology.orchestra.run.smithi158.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-26T22:12:43.118 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-26T22:12:43.118 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-26T22:12:43.121 INFO:teuthology.provision.fog.smithi158:Deploy complete! 2023-10-26T22:12:43.123 DEBUG:teuthology.parallel:result is None 2023-10-26T22:12:43.444 INFO:teuthology.lock.ops:Checking smithi158.front.sepia.ceph.com 2023-10-26T22:12:43.445 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-26T22:12:43.467 INFO:teuthology.lock.ops:Checking smithi186.front.sepia.ceph.com 2023-10-26T22:12:43.468 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-26T22:12:43.495 INFO:teuthology.lock.ops:Updating [smithi158.front.sepia.ceph.com]: set os type and version on server 2023-10-26T22:12:43.495 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-10-26T22:12:43.497 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-26T22:12:43.575 DEBUG:teuthology.orchestra.run.smithi158:> true 2023-10-26T22:12:43.647 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-10-26T22:12:43.649 DEBUG:teuthology.orchestra.run.smithi158:> uname -m 2023-10-26T22:12:43.708 INFO:teuthology.orchestra.run.smithi158.stdout:x86_64 2023-10-26T22:12:43.708 DEBUG:teuthology.orchestra.run.smithi158:> cat /etc/os-release 2023-10-26T22:12:43.769 INFO:teuthology.orchestra.run.smithi158.stdout:NAME="CentOS Stream" 2023-10-26T22:12:43.769 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION="8" 2023-10-26T22:12:43.769 INFO:teuthology.orchestra.run.smithi158.stdout:ID="centos" 2023-10-26T22:12:43.770 INFO:teuthology.orchestra.run.smithi158.stdout:ID_LIKE="rhel fedora" 2023-10-26T22:12:43.770 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION_ID="8" 2023-10-26T22:12:43.770 INFO:teuthology.orchestra.run.smithi158.stdout:PLATFORM_ID="platform:el8" 2023-10-26T22:12:43.770 INFO:teuthology.orchestra.run.smithi158.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-26T22:12:43.770 INFO:teuthology.orchestra.run.smithi158.stdout:ANSI_COLOR="0;31" 2023-10-26T22:12:43.771 INFO:teuthology.orchestra.run.smithi158.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-26T22:12:43.771 INFO:teuthology.orchestra.run.smithi158.stdout:HOME_URL="https://centos.org/" 2023-10-26T22:12:43.771 INFO:teuthology.orchestra.run.smithi158.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-26T22:12:43.771 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-26T22:12:43.771 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-26T22:12:43.772 INFO:teuthology.lock.ops:Updating smithi158.front.sepia.ceph.com on lock server 2023-10-26T22:12:43.794 INFO:teuthology.lock.ops:Updating [smithi186.front.sepia.ceph.com]: set os type and version on server 2023-10-26T22:12:43.795 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi186.front.sepia.ceph.com' 2023-10-26T22:12:43.800 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-26T22:12:43.922 DEBUG:teuthology.orchestra.run.smithi186:> true 2023-10-26T22:12:44.001 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi186.front.sepia.ceph.com' 2023-10-26T22:12:44.001 DEBUG:teuthology.orchestra.run.smithi186:> uname -m 2023-10-26T22:12:44.065 INFO:teuthology.orchestra.run.smithi186.stdout:x86_64 2023-10-26T22:12:44.066 DEBUG:teuthology.orchestra.run.smithi186:> cat /etc/os-release 2023-10-26T22:12:44.135 INFO:teuthology.orchestra.run.smithi186.stdout:NAME="CentOS Stream" 2023-10-26T22:12:44.136 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION="8" 2023-10-26T22:12:44.136 INFO:teuthology.orchestra.run.smithi186.stdout:ID="centos" 2023-10-26T22:12:44.136 INFO:teuthology.orchestra.run.smithi186.stdout:ID_LIKE="rhel fedora" 2023-10-26T22:12:44.136 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_ID="8" 2023-10-26T22:12:44.137 INFO:teuthology.orchestra.run.smithi186.stdout:PLATFORM_ID="platform:el8" 2023-10-26T22:12:44.137 INFO:teuthology.orchestra.run.smithi186.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-26T22:12:44.138 INFO:teuthology.orchestra.run.smithi186.stdout:ANSI_COLOR="0;31" 2023-10-26T22:12:44.138 INFO:teuthology.orchestra.run.smithi186.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-26T22:12:44.138 INFO:teuthology.orchestra.run.smithi186.stdout:HOME_URL="https://centos.org/" 2023-10-26T22:12:44.138 INFO:teuthology.orchestra.run.smithi186.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-26T22:12:44.139 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-26T22:12:44.139 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-26T22:12:44.140 INFO:teuthology.lock.ops:Updating smithi186.front.sepia.ceph.com on lock server 2023-10-26T22:12:44.168 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-26T22:12:44.311 INFO:teuthology.dispatcher.supervisor:Running job 7437820 2023-10-26T22:12:44.312 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-10-25_20:20:53-rados-wip-yuri3-testing-2023-10-25-0858-pacific-distro-default-smithi/7437820 --name yuriw-2023-10-25_20:20:53-rados-wip-yuri3-testing-2023-10-25-0858-pacific-distro-default-smithi --description rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} -- /home/teuthworker/archive/yuriw-2023-10-25_20:20:53-rados-wip-yuri3-testing-2023-10-25-0858-pacific-distro-default-smithi/7437820/orig.config.yaml 2023-10-26T22:12:44.316 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-10-25_20:20:53-rados-wip-yuri3-testing-2023-10-25-0858-pacific-distro-default-smithi/7437820 2023-10-26T22:12:44.317 INFO:teuthology.dispatcher.supervisor:Job PID: 730636 2023-10-26T22:12:44.317 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-26T22:14:44.363 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-26T22:16:44.508 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-26T22:18:44.671 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-26T22:20:44.847 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-26T22:22:45.008 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-26T22:24:45.175 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-26T22:26:45.339 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-26T22:28:45.515 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-26T22:30:45.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-26T22:32:45.855 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-26T22:34:46.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-26T22:36:46.187 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-26T22:36:46.251 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-26T22:36:46.411 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-26T22:36:46.412 INFO:teuthology.nuke:Checking targets against current locks 2023-10-26T22:36:46.462 DEBUG:teuthology.nuke:shortname: smithi158 2023-10-26T22:36:46.462 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-26T22:36:46.480 DEBUG:teuthology.nuke:shortname: smithi186 2023-10-26T22:36:46.481 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-26T22:36:46.484 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi158.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-25_20:20:53-rados-wip-yuri3-testing-2023-10-25-0858-pacific-distro-default-smithi/7437820', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-26 22:06:57.044918', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI9EoV24du47wwDPre062Uz+WctBFcHfcPkqErliMRGxAFH9HQ4AJNz+W93qiePX/HyPiqG/F57aMWIVJEIPXKc='} 2023-10-26T22:36:46.505 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi186.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-25_20:20:53-rados-wip-yuri3-testing-2023-10-25-0858-pacific-distro-default-smithi/7437820', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-26 22:06:57.046977', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJYy9mPKOCY0hu3yTNlKUQKvh6CMXI6jVjd9yW4sdz13CvnzvYa/2Y1S6C8tkSXckkf5leZtkQBNk7AI46J44pY='} 2023-10-26T22:36:46.537 INFO:teuthology.orchestra.console.smithi158:Power off 2023-10-26T22:36:46.538 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-26T22:36:46.559 DEBUG:teuthology.orchestra.console.smithi158:power off output: Chassis Power Control: Down/Off 2023-10-26T22:36:46.560 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-26T22:36:46.573 INFO:teuthology.orchestra.console.smithi186:Power off 2023-10-26T22:36:46.573 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-26T22:36:46.580 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is off 2023-10-26T22:36:46.593 DEBUG:teuthology.orchestra.console.smithi186:power off output: Chassis Power Control: Down/Off 2023-10-26T22:36:46.594 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-26T22:36:46.614 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off 2023-10-26T22:36:46.682 INFO:teuthology.orchestra.console.smithi158:Power off completed 2023-10-26T22:36:46.715 INFO:teuthology.orchestra.console.smithi186:Power off completed 2023-10-26T22:36:46.834 INFO:teuthology.lock.ops:unlocked: smithi158.front.sepia.ceph.com 2023-10-26T22:36:46.859 INFO:teuthology.lock.ops:unlocked: smithi186.front.sepia.ceph.com