2023-10-16T07:11:13.445 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-16T07:11:13.446 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T07:11:13.612 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fea28874c10>, signals=[15]) 2023-10-16T07:11:13.614 INFO:teuthology.lock.ops:Start node 'smithi079.front.sepia.ceph.com' reimaging 2023-10-16T07:11:13.614 INFO:teuthology.lock.ops:Updating [smithi079.front.sepia.ceph.com]: reset os type and version on server 2023-10-16T07:11:13.614 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2023-10-16T07:11:13.650 INFO:teuthology.lock.ops:Start node 'smithi194.front.sepia.ceph.com' reimaging 2023-10-16T07:11:13.650 INFO:teuthology.lock.ops:Updating [smithi194.front.sepia.ceph.com]: reset os type and version on server 2023-10-16T07:11:13.650 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server 2023-10-16T07:11:13.652 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /host {"name": "smithi079"} 2023-10-16T07:11:13.717 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /host {"name": "smithi194"} 2023-10-16T07:11:13.769 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-10-16T07:11:13.813 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-10-16T07:11:13.829 DEBUG:teuthology.provision.fog.smithi079:Requesting image smithi_centos_9.stream (ID 10) 2023-10-16T07:11:13.830 DEBUG:teuthology.provision.fog.smithi079:FOG request: PUT /host/184 {"imageID": 10} 2023-10-16T07:11:13.861 DEBUG:teuthology.provision.fog.smithi194:Requesting image smithi_centos_9.stream (ID 10) 2023-10-16T07:11:13.861 DEBUG:teuthology.provision.fog.smithi194:FOG request: PUT /host/299 {"imageID": 10} 2023-10-16T07:11:13.887 INFO:teuthology.provision.fog.smithi079:Scheduling deploy of centos 9.stream 2023-10-16T07:11:13.887 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-10-16T07:11:13.917 INFO:teuthology.provision.fog.smithi194:Scheduling deploy of centos 9.stream 2023-10-16T07:11:13.917 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-10-16T07:11:13.953 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /tasktype {"name": "deploy"} 2023-10-16T07:11:13.975 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /tasktype {"name": "deploy"} 2023-10-16T07:11:14.001 DEBUG:teuthology.provision.fog.smithi079:FOG request: POST /host/184/task {"taskTypeID": 1} 2023-10-16T07:11:14.021 DEBUG:teuthology.provision.fog.smithi194:FOG request: POST /host/299/task {"taskTypeID": 1} 2023-10-16T07:11:14.061 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-10-16T07:11:14.083 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-10-16T07:11:14.165 INFO:teuthology.orchestra.console.smithi079:Power off 2023-10-16T07:11:14.166 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-16T07:11:14.178 INFO:teuthology.orchestra.console.smithi194:Power off 2023-10-16T07:11:14.179 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-16T07:11:14.211 DEBUG:teuthology.orchestra.console.smithi079:power off output: Chassis Power Control: Down/Off 2023-10-16T07:11:14.211 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T07:11:14.223 DEBUG:teuthology.orchestra.console.smithi194:power off output: Chassis Power Control: Down/Off 2023-10-16T07:11:14.224 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T07:11:14.240 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is on 2023-10-16T07:11:14.269 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on 2023-10-16T07:11:18.244 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T07:11:18.270 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T07:11:18.353 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is on 2023-10-16T07:11:18.379 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on 2023-10-16T07:11:22.357 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T07:11:22.380 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T07:11:22.466 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off 2023-10-16T07:11:22.487 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off 2023-10-16T07:11:22.567 INFO:teuthology.orchestra.console.smithi079:Power off completed 2023-10-16T07:11:22.588 INFO:teuthology.orchestra.console.smithi194:Power off completed 2023-10-16T07:11:22.668 INFO:teuthology.orchestra.console.smithi079:Power on 2023-10-16T07:11:22.669 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-16T07:11:22.689 INFO:teuthology.orchestra.console.smithi194:Power on 2023-10-16T07:11:22.689 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-16T07:11:22.702 DEBUG:teuthology.orchestra.console.smithi079:power on output: Chassis Power Control: Up/On 2023-10-16T07:11:22.703 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T07:11:22.732 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off 2023-10-16T07:11:22.734 DEBUG:teuthology.orchestra.console.smithi194:power on output: Chassis Power Control: Up/On 2023-10-16T07:11:22.734 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T07:11:22.778 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off 2023-10-16T07:11:26.734 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T07:11:26.779 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T07:11:26.843 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off 2023-10-16T07:11:26.887 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off 2023-10-16T07:11:30.849 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T07:11:30.889 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T07:11:30.987 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is on 2023-10-16T07:11:30.997 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on 2023-10-16T07:11:31.089 INFO:teuthology.orchestra.console.smithi079:Power on completed 2023-10-16T07:11:31.098 INFO:teuthology.orchestra.console.smithi194:Power on completed 2023-10-16T07:11:31.190 INFO:teuthology.provision.fog.smithi079:Waiting for deploy to finish 2023-10-16T07:11:31.190 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-10-16T07:11:31.202 INFO:teuthology.provision.fog.smithi194:Waiting for deploy to finish 2023-10-16T07:11:31.203 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-10-16T07:11:46.288 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-10-16T07:11:46.289 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-10-16T07:12:01.386 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-10-16T07:12:01.388 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-10-16T07:12:16.530 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-10-16T07:12:16.532 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-10-16T07:12:31.622 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-10-16T07:12:31.640 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-10-16T07:12:46.746 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-10-16T07:12:46.748 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-10-16T07:13:01.834 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-10-16T07:13:01.836 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-10-16T07:13:16.926 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-10-16T07:13:16.928 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-10-16T07:13:32.078 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-10-16T07:13:32.080 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-10-16T07:13:47.174 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-10-16T07:13:47.176 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-10-16T07:14:02.274 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-10-16T07:14:02.276 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-10-16T07:14:02.365 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T07:14:02.394 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T07:14:20.922 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-10-16T07:14:20.923 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-10-16T07:14:26.927 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T07:14:26.954 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T07:14:30.010 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-10-16T07:14:30.078 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-10-16T07:14:36.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T07:14:36.080 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T07:14:39.098 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-10-16T07:14:39.166 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-10-16T07:14:45.106 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T07:14:45.168 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T07:14:48.190 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-10-16T07:14:48.250 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-10-16T07:14:54.196 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T07:14:54.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T07:14:57.278 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-10-16T07:15:03.285 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T07:15:54.311 WARNING:teuthology.provision.fog.smithi079:timed out 2023-10-16T07:16:00.319 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T07:16:00.763 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-16T07:16:00.764 DEBUG:teuthology.orchestra.run.smithi079:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-16T07:16:01.064 INFO:teuthology.provision.fog.smithi079:Node is ready 2023-10-16T07:16:01.065 DEBUG:teuthology.orchestra.run.smithi079:> hostname 2023-10-16T07:16:01.079 INFO:teuthology.orchestra.run.smithi079.stdout:smithi079.front.sepia.ceph.com 2023-10-16T07:16:01.080 DEBUG:teuthology.orchestra.run.smithi079:> grep smithi079.front.sepia.ceph.com /etc/hosts 2023-10-16T07:16:01.134 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79 smithi079.front.sepia.ceph.com smithi079 2023-10-16T07:16:01.135 DEBUG:teuthology.orchestra.run.smithi079:> sudo hostname smithi079 2023-10-16T07:16:01.226 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/smithi079.front.sepia.ceph.com/smithi079/g' /etc/hosts 2023-10-16T07:16:01.254 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/172.21.15.79/172.21.15.79/g' /etc/hosts 2023-10-16T07:16:01.322 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/smithi079.front.sepia.ceph.com/smithi079/g' /etc/hostname 2023-10-16T07:16:01.391 DEBUG:teuthology.orchestra.run.smithi079:> sudo hostname smithi079 2023-10-16T07:16:01.457 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release 2023-10-16T07:16:01.511 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="CentOS Stream" 2023-10-16T07:16:01.511 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="9" 2023-10-16T07:16:01.512 INFO:teuthology.orchestra.run.smithi079.stdout:ID="centos" 2023-10-16T07:16:01.512 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="rhel fedora" 2023-10-16T07:16:01.512 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="9" 2023-10-16T07:16:01.512 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el9" 2023-10-16T07:16:01.512 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-16T07:16:01.513 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31" 2023-10-16T07:16:01.513 INFO:teuthology.orchestra.run.smithi079.stdout:LOGO="fedora-logo-icon" 2023-10-16T07:16:01.513 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-16T07:16:01.513 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://centos.org/" 2023-10-16T07:16:01.513 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-16T07:16:01.514 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-16T07:16:01.514 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-16T07:16:01.515 INFO:teuthology.provision.fog.smithi079:Deploy complete! 2023-10-16T07:16:01.516 DEBUG:teuthology.parallel:result is None 2023-10-16T07:16:03.298 WARNING:teuthology.provision.fog.smithi194:timed out 2023-10-16T07:16:09.302 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T07:16:09.520 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-16T07:16:09.520 DEBUG:teuthology.orchestra.run.smithi194:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-16T07:16:09.846 INFO:teuthology.provision.fog.smithi194:Node is ready 2023-10-16T07:16:09.847 DEBUG:teuthology.orchestra.run.smithi194:> hostname 2023-10-16T07:16:09.863 INFO:teuthology.orchestra.run.smithi194.stdout:smithi194.front.sepia.ceph.com 2023-10-16T07:16:09.863 DEBUG:teuthology.orchestra.run.smithi194:> grep smithi194.front.sepia.ceph.com /etc/hosts 2023-10-16T07:16:09.919 INFO:teuthology.orchestra.run.smithi194.stdout:172.21.15.194 smithi194.front.sepia.ceph.com smithi194 2023-10-16T07:16:09.920 DEBUG:teuthology.orchestra.run.smithi194:> sudo hostname smithi194 2023-10-16T07:16:10.041 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/smithi194.front.sepia.ceph.com/smithi194/g' /etc/hosts 2023-10-16T07:16:10.071 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/172.21.15.194/172.21.15.194/g' /etc/hosts 2023-10-16T07:16:10.140 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/smithi194.front.sepia.ceph.com/smithi194/g' /etc/hostname 2023-10-16T07:16:10.208 DEBUG:teuthology.orchestra.run.smithi194:> sudo hostname smithi194 2023-10-16T07:16:10.275 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release 2023-10-16T07:16:10.330 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="CentOS Stream" 2023-10-16T07:16:10.330 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="9" 2023-10-16T07:16:10.330 INFO:teuthology.orchestra.run.smithi194.stdout:ID="centos" 2023-10-16T07:16:10.331 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE="rhel fedora" 2023-10-16T07:16:10.331 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="9" 2023-10-16T07:16:10.331 INFO:teuthology.orchestra.run.smithi194.stdout:PLATFORM_ID="platform:el9" 2023-10-16T07:16:10.332 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-16T07:16:10.332 INFO:teuthology.orchestra.run.smithi194.stdout:ANSI_COLOR="0;31" 2023-10-16T07:16:10.332 INFO:teuthology.orchestra.run.smithi194.stdout:LOGO="fedora-logo-icon" 2023-10-16T07:16:10.332 INFO:teuthology.orchestra.run.smithi194.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-16T07:16:10.332 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://centos.org/" 2023-10-16T07:16:10.333 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-16T07:16:10.333 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-16T07:16:10.333 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-16T07:16:10.333 INFO:teuthology.provision.fog.smithi194:Deploy complete! 2023-10-16T07:16:10.334 DEBUG:teuthology.parallel:result is None 2023-10-16T07:16:10.667 INFO:teuthology.lock.ops:Checking smithi079.front.sepia.ceph.com 2023-10-16T07:16:10.668 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-16T07:16:10.705 INFO:teuthology.lock.ops:Checking smithi194.front.sepia.ceph.com 2023-10-16T07:16:10.706 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-16T07:16:10.740 INFO:teuthology.lock.ops:Updating [smithi079.front.sepia.ceph.com]: set os type and version on server 2023-10-16T07:16:10.741 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-10-16T07:16:10.742 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T07:16:10.839 DEBUG:teuthology.orchestra.run.smithi079:> true 2023-10-16T07:16:10.910 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-10-16T07:16:10.910 DEBUG:teuthology.orchestra.run.smithi079:> uname -m 2023-10-16T07:16:10.969 INFO:teuthology.orchestra.run.smithi079.stdout:x86_64 2023-10-16T07:16:10.970 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release 2023-10-16T07:16:11.029 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="CentOS Stream" 2023-10-16T07:16:11.030 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="9" 2023-10-16T07:16:11.030 INFO:teuthology.orchestra.run.smithi079.stdout:ID="centos" 2023-10-16T07:16:11.030 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="rhel fedora" 2023-10-16T07:16:11.030 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="9" 2023-10-16T07:16:11.031 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el9" 2023-10-16T07:16:11.031 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-16T07:16:11.031 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31" 2023-10-16T07:16:11.031 INFO:teuthology.orchestra.run.smithi079.stdout:LOGO="fedora-logo-icon" 2023-10-16T07:16:11.031 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-16T07:16:11.032 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://centos.org/" 2023-10-16T07:16:11.032 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-16T07:16:11.032 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-16T07:16:11.032 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-16T07:16:11.033 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2023-10-16T07:16:11.073 INFO:teuthology.lock.ops:Updating [smithi194.front.sepia.ceph.com]: set os type and version on server 2023-10-16T07:16:11.073 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2023-10-16T07:16:11.074 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T07:16:11.186 DEBUG:teuthology.orchestra.run.smithi194:> true 2023-10-16T07:16:11.254 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi194.front.sepia.ceph.com' 2023-10-16T07:16:11.254 DEBUG:teuthology.orchestra.run.smithi194:> uname -m 2023-10-16T07:16:11.310 INFO:teuthology.orchestra.run.smithi194.stdout:x86_64 2023-10-16T07:16:11.310 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release 2023-10-16T07:16:11.366 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="CentOS Stream" 2023-10-16T07:16:11.366 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="9" 2023-10-16T07:16:11.367 INFO:teuthology.orchestra.run.smithi194.stdout:ID="centos" 2023-10-16T07:16:11.367 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE="rhel fedora" 2023-10-16T07:16:11.367 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="9" 2023-10-16T07:16:11.367 INFO:teuthology.orchestra.run.smithi194.stdout:PLATFORM_ID="platform:el9" 2023-10-16T07:16:11.368 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-16T07:16:11.368 INFO:teuthology.orchestra.run.smithi194.stdout:ANSI_COLOR="0;31" 2023-10-16T07:16:11.368 INFO:teuthology.orchestra.run.smithi194.stdout:LOGO="fedora-logo-icon" 2023-10-16T07:16:11.368 INFO:teuthology.orchestra.run.smithi194.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-16T07:16:11.368 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://centos.org/" 2023-10-16T07:16:11.369 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-16T07:16:11.369 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-16T07:16:11.369 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-16T07:16:11.370 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server 2023-10-16T07:16:11.414 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T07:16:11.516 INFO:teuthology.dispatcher.supervisor:Running job 7428883 2023-10-16T07:16:11.517 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-10-16_06:54:33-fs-rishabh-2023oct13-testing-default-smithi/7428883 --name rishabh-2023-10-16_06:54:33-fs-rishabh-2023oct13-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/acls} -- /home/teuthworker/archive/rishabh-2023-10-16_06:54:33-fs-rishabh-2023oct13-testing-default-smithi/7428883/orig.config.yaml 2023-10-16T07:16:11.520 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-10-16_06:54:33-fs-rishabh-2023oct13-testing-default-smithi/7428883 2023-10-16T07:16:11.521 INFO:teuthology.dispatcher.supervisor:Job PID: 4091231 2023-10-16T07:16:11.521 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-16T07:18:11.619 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T07:20:11.799 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T07:22:11.965 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T07:24:12.136 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T07:26:12.313 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T07:28:12.487 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T07:30:12.659 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T07:32:12.836 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T07:34:13.010 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T07:36:13.192 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T07:38:13.367 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T07:40:13.539 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T07:40:13.615 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-16T07:40:13.742 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-16T07:40:13.743 INFO:teuthology.nuke:Checking targets against current locks 2023-10-16T07:40:13.832 DEBUG:teuthology.nuke:shortname: smithi079 2023-10-16T07:40:13.833 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-16T07:40:13.871 DEBUG:teuthology.nuke:shortname: smithi194 2023-10-16T07:40:13.871 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-16T07:40:13.882 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi079.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-16_06:54:33-fs-rishabh-2023oct13-testing-default-smithi/7428883', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-16 07:11:12.639299', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLo84IbiyJsbZllH9Qnlbr5/X2wRI88ZWVY/OkscuvuXN/A02WDMntEB/NHDwuV1i//SkrQcK22zZHugnKcbeq8='} 2023-10-16T07:40:13.913 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi194.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-16_06:54:33-fs-rishabh-2023oct13-testing-default-smithi/7428883', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-16 07:11:12.637245', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJLeRxfH3YRYUqZHOSHWvADGwpDxBcXFgzFJIf1S3FLg7PRcqPV5VQf4bndgt3Se29VVNGDEq/dPvP5c65S3gKE='} 2023-10-16T07:40:13.975 INFO:teuthology.orchestra.console.smithi079:Power off 2023-10-16T07:40:13.975 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-16T07:40:14.009 INFO:teuthology.orchestra.console.smithi194:Power off 2023-10-16T07:40:14.010 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-16T07:40:14.017 DEBUG:teuthology.orchestra.console.smithi079:power off output: Chassis Power Control: Down/Off 2023-10-16T07:40:14.018 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T07:40:14.038 DEBUG:teuthology.orchestra.console.smithi194:power off output: Chassis Power Control: Down/Off 2023-10-16T07:40:14.039 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T07:40:14.046 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off 2023-10-16T07:40:14.087 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off 2023-10-16T07:40:14.147 INFO:teuthology.orchestra.console.smithi079:Power off completed 2023-10-16T07:40:14.189 INFO:teuthology.orchestra.console.smithi194:Power off completed 2023-10-16T07:40:14.335 INFO:teuthology.lock.ops:unlocked: smithi079.front.sepia.ceph.com 2023-10-16T07:40:14.356 INFO:teuthology.lock.ops:unlocked: smithi194.front.sepia.ceph.com