2023-09-08T07:04:22.124 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-08T07:04:22.125 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-08T07:04:22.235 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f10ab3c1670>, signals=[15]) 2023-09-08T07:04:22.236 INFO:teuthology.lock.ops:Start node 'smithi017.front.sepia.ceph.com' reimaging 2023-09-08T07:04:22.237 INFO:teuthology.lock.ops:Updating [smithi017.front.sepia.ceph.com]: reset os type and version on server 2023-09-08T07:04:22.237 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server 2023-09-08T07:04:22.259 INFO:teuthology.lock.ops:Start node 'smithi124.front.sepia.ceph.com' reimaging 2023-09-08T07:04:22.260 INFO:teuthology.lock.ops:Updating [smithi124.front.sepia.ceph.com]: reset os type and version on server 2023-09-08T07:04:22.260 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server 2023-09-08T07:04:22.261 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /host {"name": "smithi017"} 2023-09-08T07:04:22.284 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /host {"name": "smithi124"} 2023-09-08T07:04:22.337 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-09-08T07:04:22.343 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-09-08T07:04:22.385 DEBUG:teuthology.provision.fog.smithi124:Requesting image smithi_centos_8.stream (ID 3) 2023-09-08T07:04:22.385 DEBUG:teuthology.provision.fog.smithi124:FOG request: PUT /host/229 {"imageID": 3} 2023-09-08T07:04:22.391 DEBUG:teuthology.provision.fog.smithi017:Requesting image smithi_centos_8.stream (ID 3) 2023-09-08T07:04:22.391 DEBUG:teuthology.provision.fog.smithi017:FOG request: PUT /host/123 {"imageID": 3} 2023-09-08T07:04:22.433 INFO:teuthology.provision.fog.smithi124:Scheduling deploy of centos 8.stream 2023-09-08T07:04:22.433 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-09-08T07:04:22.436 INFO:teuthology.provision.fog.smithi017:Scheduling deploy of centos 8.stream 2023-09-08T07:04:22.437 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-08T07:04:22.578 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /tasktype {"name": "deploy"} 2023-09-08T07:04:22.583 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /tasktype {"name": "deploy"} 2023-09-08T07:04:22.616 DEBUG:teuthology.provision.fog.smithi017:FOG request: POST /host/123/task {"taskTypeID": 1} 2023-09-08T07:04:22.619 DEBUG:teuthology.provision.fog.smithi124:FOG request: POST /host/229/task {"taskTypeID": 1} 2023-09-08T07:04:22.675 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-08T07:04:22.685 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-09-08T07:04:22.848 INFO:teuthology.orchestra.console.smithi124:Power off 2023-09-08T07:04:22.848 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-08T07:04:22.861 INFO:teuthology.orchestra.console.smithi017:Power off 2023-09-08T07:04:22.862 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-08T07:04:22.869 DEBUG:teuthology.orchestra.console.smithi124:power off output: Chassis Power Control: Down/Off 2023-09-08T07:04:22.870 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-08T07:04:22.882 DEBUG:teuthology.orchestra.console.smithi017:power off output: Chassis Power Control: Down/Off 2023-09-08T07:04:22.882 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-08T07:04:22.889 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off 2023-09-08T07:04:22.901 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off 2023-09-08T07:04:22.990 INFO:teuthology.orchestra.console.smithi124:Power off completed 2023-09-08T07:04:23.003 INFO:teuthology.orchestra.console.smithi017:Power off completed 2023-09-08T07:04:23.091 INFO:teuthology.orchestra.console.smithi124:Power on 2023-09-08T07:04:23.092 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-08T07:04:23.103 INFO:teuthology.orchestra.console.smithi017:Power on 2023-09-08T07:04:23.104 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-08T07:04:23.112 DEBUG:teuthology.orchestra.console.smithi124:power on output: Chassis Power Control: Up/On 2023-09-08T07:04:23.112 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-08T07:04:23.122 DEBUG:teuthology.orchestra.console.smithi017:power on output: Chassis Power Control: Up/On 2023-09-08T07:04:23.123 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-08T07:04:23.136 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off 2023-09-08T07:04:23.143 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off 2023-09-08T07:04:27.138 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-08T07:04:27.144 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-08T07:04:27.246 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off 2023-09-08T07:04:27.252 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off 2023-09-08T07:04:31.250 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-08T07:04:31.256 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-08T07:04:31.358 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on 2023-09-08T07:04:31.364 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is on 2023-09-08T07:04:31.459 INFO:teuthology.orchestra.console.smithi124:Power on completed 2023-09-08T07:04:31.465 INFO:teuthology.orchestra.console.smithi017:Power on completed 2023-09-08T07:04:31.560 INFO:teuthology.provision.fog.smithi124:Waiting for deploy to finish 2023-09-08T07:04:31.561 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-09-08T07:04:31.566 INFO:teuthology.provision.fog.smithi017:Waiting for deploy to finish 2023-09-08T07:04:31.566 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-08T07:04:46.771 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-08T07:04:46.772 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-09-08T07:05:02.014 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-09-08T07:05:02.015 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-08T07:05:17.211 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-08T07:05:17.212 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-09-08T07:05:32.442 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-09-08T07:05:32.446 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-08T07:05:47.648 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-09-08T07:05:47.650 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-08T07:06:02.894 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-09-08T07:06:02.896 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-08T07:06:18.147 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-08T07:06:18.149 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-09-08T07:06:33.393 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-09-08T07:06:33.395 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-08T07:06:48.673 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-08T07:06:48.677 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-09-08T07:07:34.982 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-08T07:07:35.031 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-09-08T07:07:53.248 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-09-08T07:07:53.752 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-08T07:08:08.615 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-09-08T07:08:11.541 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-08T07:08:12.132 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T07:08:23.937 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-09-08T07:08:24.171 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T07:08:30.490 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17 2023-09-08T07:08:36.498 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T07:08:39.578 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17 2023-09-08T07:08:42.522 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-09-08T07:08:45.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T07:08:48.526 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T07:08:48.634 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17 2023-09-08T07:08:51.582 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-09-08T07:08:54.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T07:08:57.587 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T07:08:57.690 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17 2023-09-08T07:09:00.666 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-09-08T07:09:03.694 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T07:09:06.671 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T07:09:09.722 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-09-08T07:09:15.726 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T07:09:18.778 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-09-08T07:09:24.785 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T07:10:03.735 WARNING:teuthology.provision.fog.smithi017:timed out 2023-09-08T07:10:09.781 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T07:10:10.011 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-08T07:10:10.012 DEBUG:teuthology.orchestra.run.smithi017:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-08T07:10:10.419 INFO:teuthology.provision.fog.smithi017:Node is ready 2023-09-08T07:10:10.419 DEBUG:teuthology.orchestra.run.smithi017:> hostname 2023-09-08T07:10:10.440 INFO:teuthology.orchestra.run.smithi017.stdout:smithi017.front.sepia.ceph.com 2023-09-08T07:10:10.441 DEBUG:teuthology.orchestra.run.smithi017:> grep smithi017.front.sepia.ceph.com /etc/hosts 2023-09-08T07:10:10.502 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17 smithi017.front.sepia.ceph.com smithi017 2023-09-08T07:10:10.503 DEBUG:teuthology.orchestra.run.smithi017:> sudo hostname smithi017 2023-09-08T07:10:10.616 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i -e 's/smithi017.front.sepia.ceph.com/smithi017/g' /etc/hosts 2023-09-08T07:10:10.649 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i -e 's/172.21.15.17/172.21.15.17/g' /etc/hosts 2023-09-08T07:10:10.721 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i -e 's/smithi017.front.sepia.ceph.com/smithi017/g' /etc/hostname 2023-09-08T07:10:10.792 DEBUG:teuthology.orchestra.run.smithi017:> sudo hostname smithi017 2023-09-08T07:10:10.861 DEBUG:teuthology.orchestra.run.smithi017:> cat /etc/os-release 2023-09-08T07:10:10.921 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="CentOS Stream" 2023-09-08T07:10:10.921 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="8" 2023-09-08T07:10:10.921 INFO:teuthology.orchestra.run.smithi017.stdout:ID="centos" 2023-09-08T07:10:10.922 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE="rhel fedora" 2023-09-08T07:10:10.922 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="8" 2023-09-08T07:10:10.922 INFO:teuthology.orchestra.run.smithi017.stdout:PLATFORM_ID="platform:el8" 2023-09-08T07:10:10.923 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-08T07:10:10.923 INFO:teuthology.orchestra.run.smithi017.stdout:ANSI_COLOR="0;31" 2023-09-08T07:10:10.923 INFO:teuthology.orchestra.run.smithi017.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-08T07:10:10.923 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://centos.org/" 2023-09-08T07:10:10.924 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-08T07:10:10.924 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-08T07:10:10.924 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-08T07:10:10.925 INFO:teuthology.provision.fog.smithi017:Deploy complete! 2023-09-08T07:10:10.927 DEBUG:teuthology.parallel:result is None 2023-09-08T07:10:24.798 WARNING:teuthology.provision.fog.smithi124:timed out 2023-09-08T07:10:30.805 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T07:10:31.006 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-08T07:10:31.006 DEBUG:teuthology.orchestra.run.smithi124:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-08T07:10:31.263 INFO:teuthology.provision.fog.smithi124:Node is ready 2023-09-08T07:10:31.264 DEBUG:teuthology.orchestra.run.smithi124:> hostname 2023-09-08T07:10:31.285 INFO:teuthology.orchestra.run.smithi124.stdout:smithi124.front.sepia.ceph.com 2023-09-08T07:10:31.285 DEBUG:teuthology.orchestra.run.smithi124:> grep smithi124.front.sepia.ceph.com /etc/hosts 2023-09-08T07:10:31.347 INFO:teuthology.orchestra.run.smithi124.stdout:172.21.15.124 smithi124.front.sepia.ceph.com smithi124 2023-09-08T07:10:31.348 DEBUG:teuthology.orchestra.run.smithi124:> sudo hostname smithi124 2023-09-08T07:10:31.446 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/smithi124.front.sepia.ceph.com/smithi124/g' /etc/hosts 2023-09-08T07:10:31.480 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/172.21.15.124/172.21.15.124/g' /etc/hosts 2023-09-08T07:10:31.553 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/smithi124.front.sepia.ceph.com/smithi124/g' /etc/hostname 2023-09-08T07:10:31.626 DEBUG:teuthology.orchestra.run.smithi124:> sudo hostname smithi124 2023-09-08T07:10:31.698 DEBUG:teuthology.orchestra.run.smithi124:> cat /etc/os-release 2023-09-08T07:10:31.760 INFO:teuthology.orchestra.run.smithi124.stdout:NAME="CentOS Stream" 2023-09-08T07:10:31.760 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION="8" 2023-09-08T07:10:31.760 INFO:teuthology.orchestra.run.smithi124.stdout:ID="centos" 2023-09-08T07:10:31.761 INFO:teuthology.orchestra.run.smithi124.stdout:ID_LIKE="rhel fedora" 2023-09-08T07:10:31.761 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_ID="8" 2023-09-08T07:10:31.761 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM_ID="platform:el8" 2023-09-08T07:10:31.761 INFO:teuthology.orchestra.run.smithi124.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-08T07:10:31.761 INFO:teuthology.orchestra.run.smithi124.stdout:ANSI_COLOR="0;31" 2023-09-08T07:10:31.762 INFO:teuthology.orchestra.run.smithi124.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-08T07:10:31.762 INFO:teuthology.orchestra.run.smithi124.stdout:HOME_URL="https://centos.org/" 2023-09-08T07:10:31.762 INFO:teuthology.orchestra.run.smithi124.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-08T07:10:31.762 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-08T07:10:31.762 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-08T07:10:31.763 INFO:teuthology.provision.fog.smithi124:Deploy complete! 2023-09-08T07:10:31.763 DEBUG:teuthology.parallel:result is None 2023-09-08T07:10:31.911 INFO:teuthology.lock.ops:Checking smithi017.front.sepia.ceph.com 2023-09-08T07:10:31.912 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-08T07:10:31.946 INFO:teuthology.lock.ops:Checking smithi124.front.sepia.ceph.com 2023-09-08T07:10:31.947 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-08T07:10:31.964 INFO:teuthology.lock.ops:Updating [smithi017.front.sepia.ceph.com]: set os type and version on server 2023-09-08T07:10:31.964 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2023-09-08T07:10:31.965 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T07:10:32.033 DEBUG:teuthology.orchestra.run.smithi017:> true 2023-09-08T07:10:32.172 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi017.front.sepia.ceph.com' 2023-09-08T07:10:32.173 DEBUG:teuthology.orchestra.run.smithi017:> uname -m 2023-09-08T07:10:32.232 INFO:teuthology.orchestra.run.smithi017.stdout:x86_64 2023-09-08T07:10:32.232 DEBUG:teuthology.orchestra.run.smithi017:> cat /etc/os-release 2023-09-08T07:10:32.292 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="CentOS Stream" 2023-09-08T07:10:32.292 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="8" 2023-09-08T07:10:32.292 INFO:teuthology.orchestra.run.smithi017.stdout:ID="centos" 2023-09-08T07:10:32.292 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE="rhel fedora" 2023-09-08T07:10:32.292 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="8" 2023-09-08T07:10:32.293 INFO:teuthology.orchestra.run.smithi017.stdout:PLATFORM_ID="platform:el8" 2023-09-08T07:10:32.293 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-08T07:10:32.293 INFO:teuthology.orchestra.run.smithi017.stdout:ANSI_COLOR="0;31" 2023-09-08T07:10:32.293 INFO:teuthology.orchestra.run.smithi017.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-08T07:10:32.293 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://centos.org/" 2023-09-08T07:10:32.293 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-08T07:10:32.294 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-08T07:10:32.294 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-08T07:10:32.294 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server 2023-09-08T07:10:32.313 INFO:teuthology.lock.ops:Updating [smithi124.front.sepia.ceph.com]: set os type and version on server 2023-09-08T07:10:32.314 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-09-08T07:10:32.314 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T07:10:32.379 DEBUG:teuthology.orchestra.run.smithi124:> true 2023-09-08T07:10:32.451 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-09-08T07:10:32.451 DEBUG:teuthology.orchestra.run.smithi124:> uname -m 2023-09-08T07:10:32.512 INFO:teuthology.orchestra.run.smithi124.stdout:x86_64 2023-09-08T07:10:32.512 DEBUG:teuthology.orchestra.run.smithi124:> cat /etc/os-release 2023-09-08T07:10:32.573 INFO:teuthology.orchestra.run.smithi124.stdout:NAME="CentOS Stream" 2023-09-08T07:10:32.574 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION="8" 2023-09-08T07:10:32.574 INFO:teuthology.orchestra.run.smithi124.stdout:ID="centos" 2023-09-08T07:10:32.574 INFO:teuthology.orchestra.run.smithi124.stdout:ID_LIKE="rhel fedora" 2023-09-08T07:10:32.574 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_ID="8" 2023-09-08T07:10:32.574 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM_ID="platform:el8" 2023-09-08T07:10:32.575 INFO:teuthology.orchestra.run.smithi124.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-08T07:10:32.575 INFO:teuthology.orchestra.run.smithi124.stdout:ANSI_COLOR="0;31" 2023-09-08T07:10:32.575 INFO:teuthology.orchestra.run.smithi124.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-08T07:10:32.575 INFO:teuthology.orchestra.run.smithi124.stdout:HOME_URL="https://centos.org/" 2023-09-08T07:10:32.575 INFO:teuthology.orchestra.run.smithi124.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-08T07:10:32.576 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-08T07:10:32.576 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-08T07:10:32.576 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server 2023-09-08T07:10:32.597 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-08T07:10:32.677 INFO:teuthology.dispatcher.supervisor:Running job 7391034 2023-09-08T07:10:32.678 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-09-08_07:03:01-fs-wip-vshankar-testing-20230830.153114-testing-default-smithi/7391034 --name vshankar-2023-09-08_07:03:01-fs-wip-vshankar-testing-20230830.153114-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/quota} -- /home/teuthworker/archive/vshankar-2023-09-08_07:03:01-fs-wip-vshankar-testing-20230830.153114-testing-default-smithi/7391034/orig.config.yaml 2023-09-08T07:10:32.680 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-09-08_07:03:01-fs-wip-vshankar-testing-20230830.153114-testing-default-smithi/7391034 2023-09-08T07:10:32.681 INFO:teuthology.dispatcher.supervisor:Job PID: 1729733 2023-09-08T07:10:32.681 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-09-08T07:12:32.778 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-08T07:14:32.956 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-08T07:16:33.123 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-08T07:18:33.296 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-08T07:20:33.452 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-08T07:22:33.623 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-08T07:24:33.787 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-08T07:26:33.951 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-08T07:28:34.115 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-08T07:30:34.515 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-08T07:32:34.675 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-08T07:34:34.858 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-08T07:34:34.917 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-09-08T07:34:35.032 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-09-08T07:34:35.033 INFO:teuthology.nuke:Checking targets against current locks 2023-09-08T07:34:35.078 DEBUG:teuthology.nuke:shortname: smithi017 2023-09-08T07:34:35.079 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-08T07:34:35.098 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi017.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-09-08_07:03:01-fs-wip-vshankar-testing-20230830.153114-testing-default-smithi/7391034', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-08 07:04:21.364577', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDfSjrExPc2gxPp3B7SzpKUCbT22oZ4tVBUIHh0B63YnchGs+Szn8Wb6oUZatUlz2avFEOHpTrRWqBlU2cd3Hgg='} 2023-09-08T07:34:35.102 DEBUG:teuthology.nuke:shortname: smithi124 2023-09-08T07:34:35.102 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-08T07:34:35.122 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi124.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-09-08_07:03:01-fs-wip-vshankar-testing-20230830.153114-testing-default-smithi/7391034', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-08 07:04:21.365656', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG9bXpbyzLAD4c/uU2BjKV7nrg15eNwySBWJXVcqgGxzr2xrt680fj2uHNrhVIZlc2KRjkKAPnjZbZn+4OiuRo8='} 2023-09-08T07:34:35.155 INFO:teuthology.orchestra.console.smithi017:Power off 2023-09-08T07:34:35.156 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-08T07:34:35.168 INFO:teuthology.orchestra.console.smithi124:Power off 2023-09-08T07:34:35.169 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-08T07:34:35.177 DEBUG:teuthology.orchestra.console.smithi017:power off output: Chassis Power Control: Down/Off 2023-09-08T07:34:35.177 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-08T07:34:35.188 DEBUG:teuthology.orchestra.console.smithi124:power off output: Chassis Power Control: Down/Off 2023-09-08T07:34:35.189 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-08T07:34:35.197 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off 2023-09-08T07:34:35.210 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off 2023-09-08T07:34:35.298 INFO:teuthology.orchestra.console.smithi017:Power off completed 2023-09-08T07:34:35.311 INFO:teuthology.orchestra.console.smithi124:Power off completed 2023-09-08T07:34:35.451 INFO:teuthology.lock.ops:unlocked: smithi017.front.sepia.ceph.com 2023-09-08T07:34:35.459 INFO:teuthology.lock.ops:unlocked: smithi124.front.sepia.ceph.com