2023-10-16T08:31:38.005 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-16T08:31:38.007 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T08:31:38.142 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe489f7ec10>, signals=[15]) 2023-10-16T08:31:38.144 INFO:teuthology.lock.ops:Start node 'smithi064.front.sepia.ceph.com' reimaging 2023-10-16T08:31:38.144 INFO:teuthology.lock.ops:Updating [smithi064.front.sepia.ceph.com]: reset os type and version on server 2023-10-16T08:31:38.144 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server 2023-10-16T08:31:38.166 INFO:teuthology.lock.ops:Start node 'smithi081.front.sepia.ceph.com' reimaging 2023-10-16T08:31:38.166 INFO:teuthology.lock.ops:Updating [smithi081.front.sepia.ceph.com]: reset os type and version on server 2023-10-16T08:31:38.167 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2023-10-16T08:31:38.168 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /host {"name": "smithi064"} 2023-10-16T08:31:38.191 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /host {"name": "smithi081"} 2023-10-16T08:31:38.239 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-10-16T08:31:38.264 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-10-16T08:31:38.281 DEBUG:teuthology.provision.fog.smithi064:Requesting image smithi_centos_9.stream (ID 10) 2023-10-16T08:31:38.281 DEBUG:teuthology.provision.fog.smithi064:FOG request: PUT /host/169 {"imageID": 10} 2023-10-16T08:31:38.320 DEBUG:teuthology.provision.fog.smithi081:Requesting image smithi_centos_9.stream (ID 10) 2023-10-16T08:31:38.320 DEBUG:teuthology.provision.fog.smithi081:FOG request: PUT /host/186 {"imageID": 10} 2023-10-16T08:31:38.335 INFO:teuthology.provision.fog.smithi064:Scheduling deploy of centos 9.stream 2023-10-16T08:31:38.335 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-10-16T08:31:38.378 INFO:teuthology.provision.fog.smithi081:Scheduling deploy of centos 9.stream 2023-10-16T08:31:38.378 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-10-16T08:31:38.399 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /tasktype {"name": "deploy"} 2023-10-16T08:31:38.431 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /tasktype {"name": "deploy"} 2023-10-16T08:31:38.439 DEBUG:teuthology.provision.fog.smithi064:FOG request: POST /host/169/task {"taskTypeID": 1} 2023-10-16T08:31:38.470 DEBUG:teuthology.provision.fog.smithi081:FOG request: POST /host/186/task {"taskTypeID": 1} 2023-10-16T08:31:38.492 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-10-16T08:31:38.524 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-10-16T08:31:38.584 INFO:teuthology.orchestra.console.smithi064:Power off 2023-10-16T08:31:38.585 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-16T08:31:38.604 DEBUG:teuthology.orchestra.console.smithi064:power off output: Chassis Power Control: Down/Off 2023-10-16T08:31:38.605 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T08:31:38.619 INFO:teuthology.orchestra.console.smithi081:Power off 2023-10-16T08:31:38.619 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-16T08:31:38.628 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off 2023-10-16T08:31:38.641 DEBUG:teuthology.orchestra.console.smithi081:power off output: Chassis Power Control: Down/Off 2023-10-16T08:31:38.641 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T08:31:38.663 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off 2023-10-16T08:31:38.730 INFO:teuthology.orchestra.console.smithi064:Power off completed 2023-10-16T08:31:38.764 INFO:teuthology.orchestra.console.smithi081:Power off completed 2023-10-16T08:31:38.831 INFO:teuthology.orchestra.console.smithi064:Power on 2023-10-16T08:31:38.832 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-16T08:31:38.856 DEBUG:teuthology.orchestra.console.smithi064:power on output: Chassis Power Control: Up/On 2023-10-16T08:31:38.857 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T08:31:38.866 INFO:teuthology.orchestra.console.smithi081:Power on 2023-10-16T08:31:38.867 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-16T08:31:38.879 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off 2023-10-16T08:31:38.891 DEBUG:teuthology.orchestra.console.smithi081:power on output: Chassis Power Control: Up/On 2023-10-16T08:31:38.891 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T08:31:38.912 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off 2023-10-16T08:31:42.882 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T08:31:42.914 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T08:31:42.992 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off 2023-10-16T08:31:43.022 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off 2023-10-16T08:31:46.994 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T08:31:47.024 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T08:31:47.103 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on 2023-10-16T08:31:47.134 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on 2023-10-16T08:31:47.204 INFO:teuthology.orchestra.console.smithi064:Power on completed 2023-10-16T08:31:47.235 INFO:teuthology.orchestra.console.smithi081:Power on completed 2023-10-16T08:31:47.305 INFO:teuthology.provision.fog.smithi064:Waiting for deploy to finish 2023-10-16T08:31:47.306 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-10-16T08:31:47.337 INFO:teuthology.provision.fog.smithi081:Waiting for deploy to finish 2023-10-16T08:31:47.337 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-10-16T08:32:02.390 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-10-16T08:32:02.397 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-10-16T08:32:17.474 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-10-16T08:32:17.476 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-10-16T08:32:32.546 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-10-16T08:32:32.548 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-10-16T08:32:47.618 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-10-16T08:32:47.620 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-10-16T08:33:02.686 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-10-16T08:33:02.688 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-10-16T08:33:17.754 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-10-16T08:33:17.756 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-10-16T08:33:32.823 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-10-16T08:33:32.825 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-10-16T08:33:47.893 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-10-16T08:33:47.897 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-10-16T08:34:02.974 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-10-16T08:34:02.979 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-10-16T08:34:18.062 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-10-16T08:34:18.064 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-10-16T08:34:18.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T08:34:18.129 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T08:34:18.431 ERROR:teuthology.orchestra.connection:Error authenticating with smithi081.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-10-16T08:34:36.539 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-10-16T08:34:42.585 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T08:34:45.662 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-10-16T08:34:51.664 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T08:34:54.749 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-10-16T08:35:00.751 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T08:35:03.802 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-10-16T08:35:09.804 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T08:35:12.858 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-10-16T08:35:18.860 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T08:35:22.435 WARNING:teuthology.provision.fog.smithi081:timed out 2023-10-16T08:35:28.437 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T08:35:46.938 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-10-16T08:35:52.940 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T08:35:55.994 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-10-16T08:36:01.996 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T08:36:03.593 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-16T08:36:03.594 DEBUG:teuthology.orchestra.run.smithi081:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-16T08:36:18.864 WARNING:teuthology.provision.fog.smithi064:timed out 2023-10-16T08:36:23.909 INFO:teuthology.provision.fog.smithi081:Node is ready 2023-10-16T08:36:23.909 DEBUG:teuthology.orchestra.run.smithi081:> hostname 2023-10-16T08:36:23.928 INFO:teuthology.orchestra.run.smithi081.stdout:smithi081.front.sepia.ceph.com 2023-10-16T08:36:23.928 DEBUG:teuthology.orchestra.run.smithi081:> grep smithi081.front.sepia.ceph.com /etc/hosts 2023-10-16T08:36:23.985 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81 smithi081.front.sepia.ceph.com smithi081 2023-10-16T08:36:23.985 DEBUG:teuthology.orchestra.run.smithi081:> sudo hostname smithi081 2023-10-16T08:36:24.124 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/smithi081.front.sepia.ceph.com/smithi081/g' /etc/hosts 2023-10-16T08:36:24.155 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/172.21.15.81/172.21.15.81/g' /etc/hosts 2023-10-16T08:36:24.224 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/smithi081.front.sepia.ceph.com/smithi081/g' /etc/hostname 2023-10-16T08:36:24.294 DEBUG:teuthology.orchestra.run.smithi081:> sudo hostname smithi081 2023-10-16T08:36:24.362 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release 2023-10-16T08:36:24.417 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="CentOS Stream" 2023-10-16T08:36:24.417 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="9" 2023-10-16T08:36:24.417 INFO:teuthology.orchestra.run.smithi081.stdout:ID="centos" 2023-10-16T08:36:24.418 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="rhel fedora" 2023-10-16T08:36:24.418 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="9" 2023-10-16T08:36:24.418 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el9" 2023-10-16T08:36:24.418 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-16T08:36:24.418 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31" 2023-10-16T08:36:24.419 INFO:teuthology.orchestra.run.smithi081.stdout:LOGO="fedora-logo-icon" 2023-10-16T08:36:24.419 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-16T08:36:24.419 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://centos.org/" 2023-10-16T08:36:24.419 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-16T08:36:24.419 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-16T08:36:24.420 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-16T08:36:24.420 INFO:teuthology.provision.fog.smithi081:Deploy complete! 2023-10-16T08:36:24.421 DEBUG:teuthology.parallel:result is None 2023-10-16T08:36:24.866 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T08:36:25.137 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-16T08:36:25.138 DEBUG:teuthology.orchestra.run.smithi064:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-16T08:36:25.482 INFO:teuthology.provision.fog.smithi064:Node is ready 2023-10-16T08:36:25.482 DEBUG:teuthology.orchestra.run.smithi064:> hostname 2023-10-16T08:36:25.497 INFO:teuthology.orchestra.run.smithi064.stdout:smithi064.front.sepia.ceph.com 2023-10-16T08:36:25.498 DEBUG:teuthology.orchestra.run.smithi064:> grep smithi064.front.sepia.ceph.com /etc/hosts 2023-10-16T08:36:25.554 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64 smithi064.front.sepia.ceph.com smithi064 2023-10-16T08:36:25.554 DEBUG:teuthology.orchestra.run.smithi064:> sudo hostname smithi064 2023-10-16T08:36:25.670 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/smithi064.front.sepia.ceph.com/smithi064/g' /etc/hosts 2023-10-16T08:36:25.702 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/172.21.15.64/172.21.15.64/g' /etc/hosts 2023-10-16T08:36:25.773 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/smithi064.front.sepia.ceph.com/smithi064/g' /etc/hostname 2023-10-16T08:36:25.844 DEBUG:teuthology.orchestra.run.smithi064:> sudo hostname smithi064 2023-10-16T08:36:25.913 DEBUG:teuthology.orchestra.run.smithi064:> cat /etc/os-release 2023-10-16T08:36:25.969 INFO:teuthology.orchestra.run.smithi064.stdout:NAME="CentOS Stream" 2023-10-16T08:36:25.969 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION="9" 2023-10-16T08:36:25.969 INFO:teuthology.orchestra.run.smithi064.stdout:ID="centos" 2023-10-16T08:36:25.970 INFO:teuthology.orchestra.run.smithi064.stdout:ID_LIKE="rhel fedora" 2023-10-16T08:36:25.970 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_ID="9" 2023-10-16T08:36:25.970 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM_ID="platform:el9" 2023-10-16T08:36:25.970 INFO:teuthology.orchestra.run.smithi064.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-16T08:36:25.970 INFO:teuthology.orchestra.run.smithi064.stdout:ANSI_COLOR="0;31" 2023-10-16T08:36:25.971 INFO:teuthology.orchestra.run.smithi064.stdout:LOGO="fedora-logo-icon" 2023-10-16T08:36:25.971 INFO:teuthology.orchestra.run.smithi064.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-16T08:36:25.971 INFO:teuthology.orchestra.run.smithi064.stdout:HOME_URL="https://centos.org/" 2023-10-16T08:36:25.971 INFO:teuthology.orchestra.run.smithi064.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-16T08:36:25.971 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-16T08:36:25.972 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-16T08:36:25.972 INFO:teuthology.provision.fog.smithi064:Deploy complete! 2023-10-16T08:36:25.973 DEBUG:teuthology.parallel:result is None 2023-10-16T08:36:26.172 INFO:teuthology.lock.ops:Checking smithi064.front.sepia.ceph.com 2023-10-16T08:36:26.172 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-16T08:36:26.199 INFO:teuthology.lock.ops:Checking smithi081.front.sepia.ceph.com 2023-10-16T08:36:26.199 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-16T08:36:26.225 INFO:teuthology.lock.ops:Updating [smithi064.front.sepia.ceph.com]: set os type and version on server 2023-10-16T08:36:26.225 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi064.front.sepia.ceph.com' 2023-10-16T08:36:26.226 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T08:36:26.321 DEBUG:teuthology.orchestra.run.smithi064:> true 2023-10-16T08:36:26.392 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi064.front.sepia.ceph.com' 2023-10-16T08:36:26.393 DEBUG:teuthology.orchestra.run.smithi064:> uname -m 2023-10-16T08:36:26.448 INFO:teuthology.orchestra.run.smithi064.stdout:x86_64 2023-10-16T08:36:26.448 DEBUG:teuthology.orchestra.run.smithi064:> cat /etc/os-release 2023-10-16T08:36:26.502 INFO:teuthology.orchestra.run.smithi064.stdout:NAME="CentOS Stream" 2023-10-16T08:36:26.503 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION="9" 2023-10-16T08:36:26.503 INFO:teuthology.orchestra.run.smithi064.stdout:ID="centos" 2023-10-16T08:36:26.503 INFO:teuthology.orchestra.run.smithi064.stdout:ID_LIKE="rhel fedora" 2023-10-16T08:36:26.503 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_ID="9" 2023-10-16T08:36:26.504 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM_ID="platform:el9" 2023-10-16T08:36:26.504 INFO:teuthology.orchestra.run.smithi064.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-16T08:36:26.504 INFO:teuthology.orchestra.run.smithi064.stdout:ANSI_COLOR="0;31" 2023-10-16T08:36:26.504 INFO:teuthology.orchestra.run.smithi064.stdout:LOGO="fedora-logo-icon" 2023-10-16T08:36:26.504 INFO:teuthology.orchestra.run.smithi064.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-16T08:36:26.505 INFO:teuthology.orchestra.run.smithi064.stdout:HOME_URL="https://centos.org/" 2023-10-16T08:36:26.505 INFO:teuthology.orchestra.run.smithi064.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-16T08:36:26.505 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-16T08:36:26.505 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-16T08:36:26.506 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server 2023-10-16T08:36:26.524 INFO:teuthology.lock.ops:Updating [smithi081.front.sepia.ceph.com]: set os type and version on server 2023-10-16T08:36:26.525 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-10-16T08:36:26.525 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T08:36:26.609 DEBUG:teuthology.orchestra.run.smithi081:> true 2023-10-16T08:36:26.682 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-10-16T08:36:26.683 DEBUG:teuthology.orchestra.run.smithi081:> uname -m 2023-10-16T08:36:26.741 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64 2023-10-16T08:36:26.742 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release 2023-10-16T08:36:26.799 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="CentOS Stream" 2023-10-16T08:36:26.799 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="9" 2023-10-16T08:36:26.799 INFO:teuthology.orchestra.run.smithi081.stdout:ID="centos" 2023-10-16T08:36:26.800 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="rhel fedora" 2023-10-16T08:36:26.800 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="9" 2023-10-16T08:36:26.800 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el9" 2023-10-16T08:36:26.800 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-16T08:36:26.800 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31" 2023-10-16T08:36:26.801 INFO:teuthology.orchestra.run.smithi081.stdout:LOGO="fedora-logo-icon" 2023-10-16T08:36:26.801 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-16T08:36:26.801 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://centos.org/" 2023-10-16T08:36:26.801 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-16T08:36:26.801 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-16T08:36:26.801 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-16T08:36:26.802 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2023-10-16T08:36:26.824 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T08:36:26.913 INFO:teuthology.dispatcher.supervisor:Running job 7428936 2023-10-16T08:36:26.913 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-10-16_06:54:33-fs-rishabh-2023oct13-testing-default-smithi/7428936 --name rishabh-2023-10-16_06:54:33-fs-rishabh-2023oct13-testing-default-smithi --description fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/1 tasks/dbench validater/valgrind} -- /home/teuthworker/archive/rishabh-2023-10-16_06:54:33-fs-rishabh-2023oct13-testing-default-smithi/7428936/orig.config.yaml 2023-10-16T08:36:26.917 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-10-16_06:54:33-fs-rishabh-2023oct13-testing-default-smithi/7428936 2023-10-16T08:36:26.917 INFO:teuthology.dispatcher.supervisor:Job PID: 563417 2023-10-16T08:36:26.918 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-16T08:38:26.919 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T08:40:26.984 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T08:42:27.051 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T08:44:27.126 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T08:46:27.202 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T08:48:27.262 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T08:50:27.335 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T08:52:27.402 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T08:54:27.473 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T08:56:27.541 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T08:58:27.620 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T09:00:27.694 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T09:02:27.743 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T09:04:27.818 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T09:06:27.885 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T09:08:27.958 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T09:10:28.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T09:12:28.090 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T09:14:28.157 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T09:16:28.220 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T09:18:28.286 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T09:20:28.351 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T09:22:28.420 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T09:24:28.494 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T09:26:28.559 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T09:28:28.628 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T09:30:28.700 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T09:32:28.766 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T09:34:28.833 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T09:36:28.897 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T09:36:28.960 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-16T09:36:29.127 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-16T09:36:29.128 INFO:teuthology.nuke:Checking targets against current locks 2023-10-16T09:36:29.176 DEBUG:teuthology.nuke:shortname: smithi064 2023-10-16T09:36:29.176 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-16T09:36:29.201 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi064.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-16_06:54:33-fs-rishabh-2023oct13-testing-default-smithi/7428936', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-16 08:31:37.179357', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNgluMuoHckL/PuE/PShw/IcqRYz0V9J9Hn3fNYr8xklnd7S1/hcrCDud4Pd1+UGjBF8o64y1BdBzMQfdnHPIeE='} 2023-10-16T09:36:29.204 DEBUG:teuthology.nuke:shortname: smithi081 2023-10-16T09:36:29.205 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-16T09:36:29.226 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi081.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-16_06:54:33-fs-rishabh-2023oct13-testing-default-smithi/7428936', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-16 08:31:37.181145', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMvaMSAVMPYM7GXz+Ddyod0SZ7EZzoatxFsJjq4c+ROg9QFAkh02ThAfSs3NxXbNMifLeuXdAuuX/4EgQTKY+8k='} 2023-10-16T09:36:29.257 INFO:teuthology.orchestra.console.smithi064:Power off 2023-10-16T09:36:29.258 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-16T09:36:29.275 INFO:teuthology.orchestra.console.smithi081:Power off 2023-10-16T09:36:29.275 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-16T09:36:29.284 DEBUG:teuthology.orchestra.console.smithi064:power off output: Chassis Power Control: Down/Off 2023-10-16T09:36:29.284 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T09:36:29.297 DEBUG:teuthology.orchestra.console.smithi081:power off output: Chassis Power Control: Down/Off 2023-10-16T09:36:29.298 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T09:36:29.306 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off 2023-10-16T09:36:29.320 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off 2023-10-16T09:36:29.408 INFO:teuthology.orchestra.console.smithi064:Power off completed 2023-10-16T09:36:29.421 INFO:teuthology.orchestra.console.smithi081:Power off completed 2023-10-16T09:36:29.568 INFO:teuthology.lock.ops:unlocked: smithi064.front.sepia.ceph.com 2023-10-16T09:36:29.577 INFO:teuthology.lock.ops:unlocked: smithi081.front.sepia.ceph.com