2023-08-18T20:58:58.227 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-18T20:58:58.228 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-18T20:58:58.377 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fbd050ba310>, signals=[15]) 2023-08-18T20:58:58.381 INFO:teuthology.lock.ops:Start node 'smithi003.front.sepia.ceph.com' reimaging 2023-08-18T20:58:58.381 INFO:teuthology.lock.ops:Updating [smithi003.front.sepia.ceph.com]: reset os type and version on server 2023-08-18T20:58:58.382 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server 2023-08-18T20:58:58.406 INFO:teuthology.lock.ops:Start node 'smithi163.front.sepia.ceph.com' reimaging 2023-08-18T20:58:58.407 INFO:teuthology.lock.ops:Updating [smithi163.front.sepia.ceph.com]: reset os type and version on server 2023-08-18T20:58:58.407 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server 2023-08-18T20:58:58.408 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /host {"name": "smithi003"} 2023-08-18T20:58:58.430 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /host {"name": "smithi163"} 2023-08-18T20:58:58.481 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-08-18T20:58:58.499 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-08-18T20:58:58.522 DEBUG:teuthology.provision.fog.smithi003:Requesting image smithi_centos_9.stream (ID 10) 2023-08-18T20:58:58.522 DEBUG:teuthology.provision.fog.smithi003:FOG request: PUT /host/109 {"imageID": 10} 2023-08-18T20:58:58.545 DEBUG:teuthology.provision.fog.smithi163:Requesting image smithi_centos_9.stream (ID 10) 2023-08-18T20:58:58.545 DEBUG:teuthology.provision.fog.smithi163:FOG request: PUT /host/268 {"imageID": 10} 2023-08-18T20:58:58.580 INFO:teuthology.provision.fog.smithi003:Scheduling deploy of centos 9.stream 2023-08-18T20:58:58.580 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-18T20:58:58.594 INFO:teuthology.provision.fog.smithi163:Scheduling deploy of centos 9.stream 2023-08-18T20:58:58.594 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-08-18T20:58:58.646 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /tasktype {"name": "deploy"} 2023-08-18T20:58:58.650 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /tasktype {"name": "deploy"} 2023-08-18T20:58:58.683 DEBUG:teuthology.provision.fog.smithi163:FOG request: POST /host/268/task {"taskTypeID": 1} 2023-08-18T20:58:58.686 DEBUG:teuthology.provision.fog.smithi003:FOG request: POST /host/109/task {"taskTypeID": 1} 2023-08-18T20:58:58.744 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-18T20:58:58.751 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-08-18T20:58:58.841 INFO:teuthology.orchestra.console.smithi163:Power off 2023-08-18T20:58:58.842 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-18T20:58:58.856 INFO:teuthology.orchestra.console.smithi003:Power off 2023-08-18T20:58:58.857 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-18T20:58:58.867 DEBUG:teuthology.orchestra.console.smithi163:power off output: Chassis Power Control: Down/Off 2023-08-18T20:58:58.868 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-18T20:58:58.882 DEBUG:teuthology.orchestra.console.smithi003:power off output: Chassis Power Control: Down/Off 2023-08-18T20:58:58.883 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-18T20:58:58.894 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on 2023-08-18T20:58:58.904 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is on 2023-08-18T20:59:02.896 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-18T20:59:02.906 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-18T20:59:03.008 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on 2023-08-18T20:59:03.017 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is on 2023-08-18T20:59:07.012 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-18T20:59:07.020 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-18T20:59:07.123 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off 2023-08-18T20:59:07.129 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is on 2023-08-18T20:59:07.225 INFO:teuthology.orchestra.console.smithi163:Power off completed 2023-08-18T20:59:07.326 INFO:teuthology.orchestra.console.smithi163:Power on 2023-08-18T20:59:07.326 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-18T20:59:07.347 DEBUG:teuthology.orchestra.console.smithi163:power on output: Chassis Power Control: Up/On 2023-08-18T20:59:07.347 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-18T20:59:07.369 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off 2023-08-18T20:59:11.132 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-18T20:59:11.241 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is off 2023-08-18T20:59:11.342 INFO:teuthology.orchestra.console.smithi003:Power off completed 2023-08-18T20:59:11.370 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-18T20:59:11.444 INFO:teuthology.orchestra.console.smithi003:Power on 2023-08-18T20:59:11.444 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-18T20:59:11.470 DEBUG:teuthology.orchestra.console.smithi003:power on output: Chassis Power Control: Up/On 2023-08-18T20:59:11.471 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-18T20:59:11.482 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off 2023-08-18T20:59:11.492 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is off 2023-08-18T20:59:15.485 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-18T20:59:15.493 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-18T20:59:15.596 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on 2023-08-18T20:59:15.603 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is on 2023-08-18T20:59:15.697 INFO:teuthology.orchestra.console.smithi163:Power on completed 2023-08-18T20:59:15.704 INFO:teuthology.orchestra.console.smithi003:Power on completed 2023-08-18T20:59:15.798 INFO:teuthology.provision.fog.smithi163:Waiting for deploy to finish 2023-08-18T20:59:15.798 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-08-18T20:59:15.805 INFO:teuthology.provision.fog.smithi003:Waiting for deploy to finish 2023-08-18T20:59:15.806 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-18T20:59:30.888 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-08-18T20:59:30.889 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-18T20:59:45.960 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-08-18T20:59:45.961 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-18T21:00:01.026 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-08-18T21:00:01.027 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-18T21:00:16.100 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-18T21:00:16.101 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-08-18T21:00:31.164 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-08-18T21:00:31.166 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-18T21:00:46.236 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-18T21:00:46.238 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-08-18T21:01:01.308 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-08-18T21:01:01.310 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-18T21:01:16.388 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-08-18T21:01:16.390 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-18T21:01:31.464 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-08-18T21:01:31.465 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-18T21:01:46.548 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-18T21:01:46.549 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-08-18T21:01:46.616 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-18T21:01:49.684 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-08-18T21:01:55.688 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-18T21:01:58.768 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-08-18T21:02:01.614 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-08-18T21:02:04.772 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-18T21:02:07.828 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-08-18T21:02:13.832 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-18T21:02:16.704 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-08-18T21:02:16.791 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-18T21:02:16.912 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-08-18T21:02:19.856 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-08-18T21:02:22.916 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-18T21:02:25.861 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-18T21:02:25.972 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-08-18T21:02:28.912 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-08-18T21:02:31.976 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-18T21:02:34.917 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-18T21:02:37.972 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-08-18T21:02:43.979 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-18T21:02:47.056 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-08-18T21:02:53.061 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-18T21:02:56.112 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-08-18T21:03:02.121 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-18T21:03:05.200 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-08-18T21:03:11.205 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-18T21:03:14.256 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-08-18T21:03:20.261 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-18T21:03:23.312 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-08-18T21:03:29.316 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-18T21:03:31.980 WARNING:teuthology.provision.fog.smithi003:timed out 2023-08-18T21:03:37.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-18T21:03:38.183 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-18T21:03:38.184 DEBUG:teuthology.orchestra.run.smithi003:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-18T21:03:38.495 INFO:teuthology.provision.fog.smithi003:Node is ready 2023-08-18T21:03:38.496 DEBUG:teuthology.orchestra.run.smithi003:> hostname 2023-08-18T21:03:38.558 INFO:teuthology.orchestra.run.smithi003.stdout:smithi003.front.sepia.ceph.com 2023-08-18T21:03:38.559 DEBUG:teuthology.orchestra.run.smithi003:> grep smithi003.front.sepia.ceph.com /etc/hosts 2023-08-18T21:03:38.621 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3 smithi003.front.sepia.ceph.com smithi003 2023-08-18T21:03:38.622 DEBUG:teuthology.orchestra.run.smithi003:> sudo hostname smithi003 2023-08-18T21:03:38.745 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/smithi003.front.sepia.ceph.com/smithi003/g' /etc/hosts 2023-08-18T21:03:38.785 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/172.21.15.3/172.21.15.3/g' /etc/hosts 2023-08-18T21:03:38.861 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/smithi003.front.sepia.ceph.com/smithi003/g' /etc/hostname 2023-08-18T21:03:38.937 DEBUG:teuthology.orchestra.run.smithi003:> sudo hostname smithi003 2023-08-18T21:03:39.011 DEBUG:teuthology.orchestra.run.smithi003:> cat /etc/os-release 2023-08-18T21:03:39.068 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="CentOS Stream" 2023-08-18T21:03:39.069 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="9" 2023-08-18T21:03:39.069 INFO:teuthology.orchestra.run.smithi003.stdout:ID="centos" 2023-08-18T21:03:39.069 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE="rhel fedora" 2023-08-18T21:03:39.070 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="9" 2023-08-18T21:03:39.070 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM_ID="platform:el9" 2023-08-18T21:03:39.070 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-18T21:03:39.070 INFO:teuthology.orchestra.run.smithi003.stdout:ANSI_COLOR="0;31" 2023-08-18T21:03:39.070 INFO:teuthology.orchestra.run.smithi003.stdout:LOGO="fedora-logo-icon" 2023-08-18T21:03:39.070 INFO:teuthology.orchestra.run.smithi003.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-18T21:03:39.070 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://centos.org/" 2023-08-18T21:03:39.071 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-18T21:03:39.071 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-18T21:03:39.071 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-18T21:03:39.072 INFO:teuthology.provision.fog.smithi003:Deploy complete! 2023-08-18T21:03:39.073 DEBUG:teuthology.parallel:result is None 2023-08-18T21:04:29.368 WARNING:teuthology.provision.fog.smithi163:timed out 2023-08-18T21:04:35.373 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-18T21:04:35.747 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-18T21:04:35.747 DEBUG:teuthology.orchestra.run.smithi163:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-18T21:04:36.065 INFO:teuthology.provision.fog.smithi163:Node is ready 2023-08-18T21:04:36.066 DEBUG:teuthology.orchestra.run.smithi163:> hostname 2023-08-18T21:04:36.081 INFO:teuthology.orchestra.run.smithi163.stdout:smithi163.front.sepia.ceph.com 2023-08-18T21:04:36.082 DEBUG:teuthology.orchestra.run.smithi163:> grep smithi163.front.sepia.ceph.com /etc/hosts 2023-08-18T21:04:36.137 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163 smithi163.front.sepia.ceph.com smithi163 2023-08-18T21:04:36.137 DEBUG:teuthology.orchestra.run.smithi163:> sudo hostname smithi163 2023-08-18T21:04:36.256 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/smithi163.front.sepia.ceph.com/smithi163/g' /etc/hosts 2023-08-18T21:04:36.284 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/172.21.15.163/172.21.15.163/g' /etc/hosts 2023-08-18T21:04:36.352 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/smithi163.front.sepia.ceph.com/smithi163/g' /etc/hostname 2023-08-18T21:04:36.420 DEBUG:teuthology.orchestra.run.smithi163:> sudo hostname smithi163 2023-08-18T21:04:36.486 DEBUG:teuthology.orchestra.run.smithi163:> cat /etc/os-release 2023-08-18T21:04:36.542 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="CentOS Stream" 2023-08-18T21:04:36.542 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="9" 2023-08-18T21:04:36.543 INFO:teuthology.orchestra.run.smithi163.stdout:ID="centos" 2023-08-18T21:04:36.543 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE="rhel fedora" 2023-08-18T21:04:36.543 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="9" 2023-08-18T21:04:36.543 INFO:teuthology.orchestra.run.smithi163.stdout:PLATFORM_ID="platform:el9" 2023-08-18T21:04:36.543 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-18T21:04:36.543 INFO:teuthology.orchestra.run.smithi163.stdout:ANSI_COLOR="0;31" 2023-08-18T21:04:36.544 INFO:teuthology.orchestra.run.smithi163.stdout:LOGO="fedora-logo-icon" 2023-08-18T21:04:36.544 INFO:teuthology.orchestra.run.smithi163.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-18T21:04:36.544 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://centos.org/" 2023-08-18T21:04:36.544 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-18T21:04:36.544 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-18T21:04:36.544 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-18T21:04:36.545 INFO:teuthology.provision.fog.smithi163:Deploy complete! 2023-08-18T21:04:36.545 DEBUG:teuthology.parallel:result is None 2023-08-18T21:04:36.698 INFO:teuthology.lock.ops:Checking smithi003.front.sepia.ceph.com 2023-08-18T21:04:36.699 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-18T21:04:36.724 INFO:teuthology.lock.ops:Checking smithi163.front.sepia.ceph.com 2023-08-18T21:04:36.725 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-18T21:04:36.742 INFO:teuthology.lock.ops:Updating [smithi003.front.sepia.ceph.com]: set os type and version on server 2023-08-18T21:04:36.743 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com' 2023-08-18T21:04:36.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-18T21:04:36.886 DEBUG:teuthology.orchestra.run.smithi003:> true 2023-08-18T21:04:37.071 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi003.front.sepia.ceph.com' 2023-08-18T21:04:37.072 DEBUG:teuthology.orchestra.run.smithi003:> uname -m 2023-08-18T21:04:37.126 INFO:teuthology.orchestra.run.smithi003.stdout:x86_64 2023-08-18T21:04:37.127 DEBUG:teuthology.orchestra.run.smithi003:> cat /etc/os-release 2023-08-18T21:04:37.182 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="CentOS Stream" 2023-08-18T21:04:37.183 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="9" 2023-08-18T21:04:37.184 INFO:teuthology.orchestra.run.smithi003.stdout:ID="centos" 2023-08-18T21:04:37.184 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE="rhel fedora" 2023-08-18T21:04:37.184 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="9" 2023-08-18T21:04:37.184 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM_ID="platform:el9" 2023-08-18T21:04:37.184 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-18T21:04:37.184 INFO:teuthology.orchestra.run.smithi003.stdout:ANSI_COLOR="0;31" 2023-08-18T21:04:37.184 INFO:teuthology.orchestra.run.smithi003.stdout:LOGO="fedora-logo-icon" 2023-08-18T21:04:37.185 INFO:teuthology.orchestra.run.smithi003.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-18T21:04:37.185 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://centos.org/" 2023-08-18T21:04:37.185 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-18T21:04:37.186 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-18T21:04:37.186 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-18T21:04:37.187 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server 2023-08-18T21:04:37.209 INFO:teuthology.lock.ops:Updating [smithi163.front.sepia.ceph.com]: set os type and version on server 2023-08-18T21:04:37.210 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2023-08-18T21:04:37.211 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-18T21:04:37.296 DEBUG:teuthology.orchestra.run.smithi163:> true 2023-08-18T21:04:37.366 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi163.front.sepia.ceph.com' 2023-08-18T21:04:37.367 DEBUG:teuthology.orchestra.run.smithi163:> uname -m 2023-08-18T21:04:37.420 INFO:teuthology.orchestra.run.smithi163.stdout:x86_64 2023-08-18T21:04:37.421 DEBUG:teuthology.orchestra.run.smithi163:> cat /etc/os-release 2023-08-18T21:04:37.475 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="CentOS Stream" 2023-08-18T21:04:37.475 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="9" 2023-08-18T21:04:37.476 INFO:teuthology.orchestra.run.smithi163.stdout:ID="centos" 2023-08-18T21:04:37.476 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE="rhel fedora" 2023-08-18T21:04:37.478 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="9" 2023-08-18T21:04:37.478 INFO:teuthology.orchestra.run.smithi163.stdout:PLATFORM_ID="platform:el9" 2023-08-18T21:04:37.478 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-18T21:04:37.479 INFO:teuthology.orchestra.run.smithi163.stdout:ANSI_COLOR="0;31" 2023-08-18T21:04:37.479 INFO:teuthology.orchestra.run.smithi163.stdout:LOGO="fedora-logo-icon" 2023-08-18T21:04:37.479 INFO:teuthology.orchestra.run.smithi163.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-18T21:04:37.479 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://centos.org/" 2023-08-18T21:04:37.479 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-18T21:04:37.479 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-18T21:04:37.480 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-18T21:04:37.480 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server 2023-08-18T21:04:37.499 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-18T21:04:37.590 INFO:teuthology.dispatcher.supervisor:Running job 7372501 2023-08-18T21:04:37.590 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-08-18_20:13:47-fs-main-distro-default-smithi/7372501 --name yuriw-2023-08-18_20:13:47-fs-main-distro-default-smithi --description fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/iozone}} -- /home/teuthworker/archive/yuriw-2023-08-18_20:13:47-fs-main-distro-default-smithi/7372501/orig.config.yaml 2023-08-18T21:04:37.594 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-08-18_20:13:47-fs-main-distro-default-smithi/7372501 2023-08-18T21:04:37.595 INFO:teuthology.dispatcher.supervisor:Job PID: 22612 2023-08-18T21:04:37.595 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-18T21:06:37.695 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-18T21:08:37.863 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-18T21:10:38.025 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-18T21:12:38.189 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-18T21:14:38.349 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-18T21:16:38.506 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-18T21:18:38.665 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-18T21:20:38.821 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-18T21:22:38.989 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-18T21:24:39.158 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-18T21:26:39.325 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-18T21:28:39.493 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-18T21:30:39.677 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-18T21:30:39.772 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-18T21:30:39.927 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-18T21:30:39.928 INFO:teuthology.nuke:Checking targets against current locks 2023-08-18T21:30:39.978 DEBUG:teuthology.nuke:shortname: smithi003 2023-08-18T21:30:39.978 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-18T21:30:40.002 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi003.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-18_20:13:47-fs-main-distro-default-smithi/7372501', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-18 20:58:57.410439', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN25hXV6NUbJKahEi/wnWcHjLMbjgvZIImdV4Bg9XMdBvgRIfPa2mjaqVujzg4Aela1x4aJVb1GMV1P1TfzJ91U='} 2023-08-18T21:30:40.007 DEBUG:teuthology.nuke:shortname: smithi163 2023-08-18T21:30:40.008 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-18T21:30:40.036 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi163.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-18_20:13:47-fs-main-distro-default-smithi/7372501', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-18 20:58:57.408977', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJVbDujD2oMowE4NQitAD4Chofsyxb+dO2Er0JDlNFWaj8mUzjekdUX4iRvpMpAlSTdwYhacTXkcRq+IiZQ3C/c='} 2023-08-18T21:30:40.079 INFO:teuthology.orchestra.console.smithi003:Power off 2023-08-18T21:30:40.080 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-18T21:30:40.106 DEBUG:teuthology.orchestra.console.smithi003:power off output: Chassis Power Control: Down/Off 2023-08-18T21:30:40.106 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-18T21:30:40.125 INFO:teuthology.orchestra.console.smithi163:Power off 2023-08-18T21:30:40.126 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-18T21:30:40.139 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is off 2023-08-18T21:30:40.149 DEBUG:teuthology.orchestra.console.smithi163:power off output: Chassis Power Control: Down/Off 2023-08-18T21:30:40.149 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-18T21:30:40.171 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off 2023-08-18T21:30:40.241 INFO:teuthology.orchestra.console.smithi003:Power off completed 2023-08-18T21:30:40.273 INFO:teuthology.orchestra.console.smithi163:Power off completed 2023-08-18T21:30:40.398 INFO:teuthology.lock.ops:unlocked: smithi003.front.sepia.ceph.com 2023-08-18T21:30:40.414 INFO:teuthology.lock.ops:unlocked: smithi163.front.sepia.ceph.com