2023-11-08T07:45:30.942 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-08T07:45:30.943 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T07:45:31.090 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff0361ca670>, signals=[15]) 2023-11-08T07:45:31.092 INFO:teuthology.lock.ops:Start node 'smithi067.front.sepia.ceph.com' reimaging 2023-11-08T07:45:31.092 INFO:teuthology.lock.ops:Updating [smithi067.front.sepia.ceph.com]: reset os type and version on server 2023-11-08T07:45:31.092 INFO:teuthology.lock.ops:Updating smithi067.front.sepia.ceph.com on lock server 2023-11-08T07:45:31.110 INFO:teuthology.lock.ops:Start node 'smithi119.front.sepia.ceph.com' reimaging 2023-11-08T07:45:31.111 INFO:teuthology.lock.ops:Updating [smithi119.front.sepia.ceph.com]: reset os type and version on server 2023-11-08T07:45:31.111 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server 2023-11-08T07:45:31.112 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /host {"name": "smithi067"} 2023-11-08T07:45:31.136 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /host {"name": "smithi119"} 2023-11-08T07:45:31.189 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-11-08T07:45:31.215 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-11-08T07:45:31.237 DEBUG:teuthology.provision.fog.smithi067:Requesting image smithi_centos_9.stream (ID 10) 2023-11-08T07:45:31.237 DEBUG:teuthology.provision.fog.smithi067:FOG request: PUT /host/172 {"imageID": 10} 2023-11-08T07:45:31.256 DEBUG:teuthology.provision.fog.smithi119:Requesting image smithi_centos_9.stream (ID 10) 2023-11-08T07:45:31.256 DEBUG:teuthology.provision.fog.smithi119:FOG request: PUT /host/224 {"imageID": 10} 2023-11-08T07:45:31.282 INFO:teuthology.provision.fog.smithi067:Scheduling deploy of centos 9.stream 2023-11-08T07:45:31.282 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None 2023-11-08T07:45:31.305 INFO:teuthology.provision.fog.smithi119:Scheduling deploy of centos 9.stream 2023-11-08T07:45:31.305 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-11-08T07:45:31.326 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /tasktype {"name": "deploy"} 2023-11-08T07:45:31.353 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /tasktype {"name": "deploy"} 2023-11-08T07:45:31.363 DEBUG:teuthology.provision.fog.smithi067:FOG request: POST /host/172/task {"taskTypeID": 1} 2023-11-08T07:45:31.402 DEBUG:teuthology.provision.fog.smithi119:FOG request: POST /host/224/task {"taskTypeID": 1} 2023-11-08T07:45:31.439 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None 2023-11-08T07:45:31.454 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-11-08T07:45:31.524 INFO:teuthology.orchestra.console.smithi067:Power off 2023-11-08T07:45:31.525 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-08T07:45:31.538 INFO:teuthology.orchestra.console.smithi119:Power off 2023-11-08T07:45:31.539 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-08T07:45:31.548 DEBUG:teuthology.orchestra.console.smithi067:power off output: Chassis Power Control: Down/Off 2023-11-08T07:45:31.548 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T07:45:31.561 DEBUG:teuthology.orchestra.console.smithi119:power off output: Chassis Power Control: Down/Off 2023-11-08T07:45:31.562 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T07:45:31.569 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is on 2023-11-08T07:45:31.583 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on 2023-11-08T07:45:35.574 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T07:45:35.585 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T07:45:35.687 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is on 2023-11-08T07:45:35.694 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on 2023-11-08T07:45:39.691 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T07:45:39.698 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T07:45:39.800 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is off 2023-11-08T07:45:39.807 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off 2023-11-08T07:45:39.902 INFO:teuthology.orchestra.console.smithi067:Power off completed 2023-11-08T07:45:39.908 INFO:teuthology.orchestra.console.smithi119:Power off completed 2023-11-08T07:45:40.003 INFO:teuthology.orchestra.console.smithi067:Power on 2023-11-08T07:45:40.003 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-08T07:45:40.010 INFO:teuthology.orchestra.console.smithi119:Power on 2023-11-08T07:45:40.011 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-08T07:45:40.024 DEBUG:teuthology.orchestra.console.smithi067:power on output: Chassis Power Control: Up/On 2023-11-08T07:45:40.024 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T07:45:40.032 DEBUG:teuthology.orchestra.console.smithi119:power on output: Chassis Power Control: Up/On 2023-11-08T07:45:40.033 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T07:45:40.045 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is off 2023-11-08T07:45:40.053 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off 2023-11-08T07:45:44.046 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T07:45:44.053 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T07:45:44.156 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is off 2023-11-08T07:45:44.162 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off 2023-11-08T07:45:48.158 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T07:45:48.165 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T07:45:48.267 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is on 2023-11-08T07:45:48.273 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on 2023-11-08T07:45:48.369 INFO:teuthology.orchestra.console.smithi067:Power on completed 2023-11-08T07:45:48.375 INFO:teuthology.orchestra.console.smithi119:Power on completed 2023-11-08T07:45:48.470 INFO:teuthology.provision.fog.smithi067:Waiting for deploy to finish 2023-11-08T07:45:48.471 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None 2023-11-08T07:45:48.475 INFO:teuthology.provision.fog.smithi119:Waiting for deploy to finish 2023-11-08T07:45:48.476 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-11-08T07:46:03.530 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None 2023-11-08T07:46:03.532 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-11-08T07:46:18.613 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None 2023-11-08T07:46:18.615 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-11-08T07:46:33.694 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-11-08T07:46:33.697 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None 2023-11-08T07:46:48.779 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None 2023-11-08T07:46:48.781 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-11-08T07:47:03.873 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None 2023-11-08T07:47:03.876 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-11-08T07:47:18.982 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-11-08T07:47:18.984 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None 2023-11-08T07:47:34.070 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-11-08T07:47:34.072 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None 2023-11-08T07:47:49.158 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-11-08T07:47:49.160 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None 2023-11-08T07:48:04.254 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-11-08T07:48:04.256 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None 2023-11-08T07:48:19.342 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-11-08T07:48:19.344 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None 2023-11-08T07:48:19.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T07:48:19.407 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T07:48:37.882 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67 2023-11-08T07:48:37.884 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2023-11-08T07:48:43.891 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T07:48:43.893 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T07:48:46.970 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67 2023-11-08T07:48:46.971 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2023-11-08T07:48:52.975 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T07:48:52.977 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T07:48:56.026 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67 2023-11-08T07:48:56.027 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2023-11-08T07:49:02.032 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T07:49:02.034 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T07:49:05.114 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67 2023-11-08T07:49:05.115 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2023-11-08T07:49:11.120 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T07:49:11.122 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T07:49:14.170 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67 2023-11-08T07:49:20.175 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T07:50:11.175 WARNING:teuthology.provision.fog.smithi119:timed out 2023-11-08T07:50:17.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T07:50:17.421 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-08T07:50:17.422 DEBUG:teuthology.orchestra.run.smithi119:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-08T07:50:17.738 INFO:teuthology.provision.fog.smithi119:Node is ready 2023-11-08T07:50:17.738 DEBUG:teuthology.orchestra.run.smithi119:> hostname 2023-11-08T07:50:17.753 INFO:teuthology.orchestra.run.smithi119.stdout:smithi119.front.sepia.ceph.com 2023-11-08T07:50:17.753 DEBUG:teuthology.orchestra.run.smithi119:> grep smithi119.front.sepia.ceph.com /etc/hosts 2023-11-08T07:50:17.808 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119 smithi119.front.sepia.ceph.com smithi119 2023-11-08T07:50:17.809 DEBUG:teuthology.orchestra.run.smithi119:> sudo hostname smithi119 2023-11-08T07:50:17.931 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/smithi119.front.sepia.ceph.com/smithi119/g' /etc/hosts 2023-11-08T07:50:17.960 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/172.21.15.119/172.21.15.119/g' /etc/hosts 2023-11-08T07:50:18.027 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/smithi119.front.sepia.ceph.com/smithi119/g' /etc/hostname 2023-11-08T07:50:18.093 DEBUG:teuthology.orchestra.run.smithi119:> sudo hostname smithi119 2023-11-08T07:50:18.160 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release 2023-11-08T07:50:18.214 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="CentOS Stream" 2023-11-08T07:50:18.215 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="9" 2023-11-08T07:50:18.215 INFO:teuthology.orchestra.run.smithi119.stdout:ID="centos" 2023-11-08T07:50:18.215 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="rhel fedora" 2023-11-08T07:50:18.215 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="9" 2023-11-08T07:50:18.216 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el9" 2023-11-08T07:50:18.216 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-08T07:50:18.216 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31" 2023-11-08T07:50:18.216 INFO:teuthology.orchestra.run.smithi119.stdout:LOGO="fedora-logo-icon" 2023-11-08T07:50:18.217 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-08T07:50:18.217 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://centos.org/" 2023-11-08T07:50:18.217 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-08T07:50:18.217 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-08T07:50:18.217 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-08T07:50:18.218 INFO:teuthology.provision.fog.smithi119:Deploy complete! 2023-11-08T07:50:18.220 DEBUG:teuthology.parallel:result is None 2023-11-08T07:50:20.178 WARNING:teuthology.provision.fog.smithi067:timed out 2023-11-08T07:50:26.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T07:50:26.470 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-08T07:50:26.471 DEBUG:teuthology.orchestra.run.smithi067:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-08T07:50:26.820 INFO:teuthology.provision.fog.smithi067:Node is ready 2023-11-08T07:50:26.820 DEBUG:teuthology.orchestra.run.smithi067:> hostname 2023-11-08T07:50:26.836 INFO:teuthology.orchestra.run.smithi067.stdout:smithi067.front.sepia.ceph.com 2023-11-08T07:50:26.836 DEBUG:teuthology.orchestra.run.smithi067:> grep smithi067.front.sepia.ceph.com /etc/hosts 2023-11-08T07:50:26.892 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67 smithi067.front.sepia.ceph.com smithi067 2023-11-08T07:50:26.892 DEBUG:teuthology.orchestra.run.smithi067:> sudo hostname smithi067 2023-11-08T07:50:27.016 DEBUG:teuthology.orchestra.run.smithi067:> sudo sed -i -e 's/smithi067.front.sepia.ceph.com/smithi067/g' /etc/hosts 2023-11-08T07:50:27.049 DEBUG:teuthology.orchestra.run.smithi067:> sudo sed -i -e 's/172.21.15.67/172.21.15.67/g' /etc/hosts 2023-11-08T07:50:27.120 DEBUG:teuthology.orchestra.run.smithi067:> sudo sed -i -e 's/smithi067.front.sepia.ceph.com/smithi067/g' /etc/hostname 2023-11-08T07:50:27.190 DEBUG:teuthology.orchestra.run.smithi067:> sudo hostname smithi067 2023-11-08T07:50:27.261 DEBUG:teuthology.orchestra.run.smithi067:> cat /etc/os-release 2023-11-08T07:50:27.316 INFO:teuthology.orchestra.run.smithi067.stdout:NAME="CentOS Stream" 2023-11-08T07:50:27.316 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION="9" 2023-11-08T07:50:27.317 INFO:teuthology.orchestra.run.smithi067.stdout:ID="centos" 2023-11-08T07:50:27.317 INFO:teuthology.orchestra.run.smithi067.stdout:ID_LIKE="rhel fedora" 2023-11-08T07:50:27.317 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION_ID="9" 2023-11-08T07:50:27.317 INFO:teuthology.orchestra.run.smithi067.stdout:PLATFORM_ID="platform:el9" 2023-11-08T07:50:27.317 INFO:teuthology.orchestra.run.smithi067.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-08T07:50:27.318 INFO:teuthology.orchestra.run.smithi067.stdout:ANSI_COLOR="0;31" 2023-11-08T07:50:27.318 INFO:teuthology.orchestra.run.smithi067.stdout:LOGO="fedora-logo-icon" 2023-11-08T07:50:27.318 INFO:teuthology.orchestra.run.smithi067.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-08T07:50:27.318 INFO:teuthology.orchestra.run.smithi067.stdout:HOME_URL="https://centos.org/" 2023-11-08T07:50:27.319 INFO:teuthology.orchestra.run.smithi067.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-08T07:50:27.319 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-08T07:50:27.319 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-08T07:50:27.319 INFO:teuthology.provision.fog.smithi067:Deploy complete! 2023-11-08T07:50:27.320 DEBUG:teuthology.parallel:result is None 2023-11-08T07:50:27.486 INFO:teuthology.lock.ops:Checking smithi067.front.sepia.ceph.com 2023-11-08T07:50:27.487 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-08T07:50:27.511 INFO:teuthology.lock.ops:Checking smithi119.front.sepia.ceph.com 2023-11-08T07:50:27.512 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-08T07:50:27.537 INFO:teuthology.lock.ops:Updating [smithi067.front.sepia.ceph.com]: set os type and version on server 2023-11-08T07:50:27.538 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2023-11-08T07:50:27.539 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T07:50:27.635 DEBUG:teuthology.orchestra.run.smithi067:> true 2023-11-08T07:50:27.660 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi067.front.sepia.ceph.com' 2023-11-08T07:50:27.660 DEBUG:teuthology.orchestra.run.smithi067:> uname -m 2023-11-08T07:50:27.714 INFO:teuthology.orchestra.run.smithi067.stdout:x86_64 2023-11-08T07:50:27.715 DEBUG:teuthology.orchestra.run.smithi067:> cat /etc/os-release 2023-11-08T07:50:27.770 INFO:teuthology.orchestra.run.smithi067.stdout:NAME="CentOS Stream" 2023-11-08T07:50:27.770 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION="9" 2023-11-08T07:50:27.770 INFO:teuthology.orchestra.run.smithi067.stdout:ID="centos" 2023-11-08T07:50:27.770 INFO:teuthology.orchestra.run.smithi067.stdout:ID_LIKE="rhel fedora" 2023-11-08T07:50:27.771 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION_ID="9" 2023-11-08T07:50:27.771 INFO:teuthology.orchestra.run.smithi067.stdout:PLATFORM_ID="platform:el9" 2023-11-08T07:50:27.771 INFO:teuthology.orchestra.run.smithi067.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-08T07:50:27.771 INFO:teuthology.orchestra.run.smithi067.stdout:ANSI_COLOR="0;31" 2023-11-08T07:50:27.771 INFO:teuthology.orchestra.run.smithi067.stdout:LOGO="fedora-logo-icon" 2023-11-08T07:50:27.772 INFO:teuthology.orchestra.run.smithi067.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-08T07:50:27.772 INFO:teuthology.orchestra.run.smithi067.stdout:HOME_URL="https://centos.org/" 2023-11-08T07:50:27.772 INFO:teuthology.orchestra.run.smithi067.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-08T07:50:27.772 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-08T07:50:27.772 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-08T07:50:27.773 INFO:teuthology.lock.ops:Updating smithi067.front.sepia.ceph.com on lock server 2023-11-08T07:50:27.795 INFO:teuthology.lock.ops:Updating [smithi119.front.sepia.ceph.com]: set os type and version on server 2023-11-08T07:50:27.795 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2023-11-08T07:50:27.796 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T07:50:27.878 DEBUG:teuthology.orchestra.run.smithi119:> true 2023-11-08T07:50:27.946 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi119.front.sepia.ceph.com' 2023-11-08T07:50:27.946 DEBUG:teuthology.orchestra.run.smithi119:> uname -m 2023-11-08T07:50:28.002 INFO:teuthology.orchestra.run.smithi119.stdout:x86_64 2023-11-08T07:50:28.002 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release 2023-11-08T07:50:28.057 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="CentOS Stream" 2023-11-08T07:50:28.058 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="9" 2023-11-08T07:50:28.058 INFO:teuthology.orchestra.run.smithi119.stdout:ID="centos" 2023-11-08T07:50:28.058 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="rhel fedora" 2023-11-08T07:50:28.058 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="9" 2023-11-08T07:50:28.059 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el9" 2023-11-08T07:50:28.059 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-08T07:50:28.059 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31" 2023-11-08T07:50:28.059 INFO:teuthology.orchestra.run.smithi119.stdout:LOGO="fedora-logo-icon" 2023-11-08T07:50:28.060 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-08T07:50:28.060 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://centos.org/" 2023-11-08T07:50:28.060 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-08T07:50:28.060 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-08T07:50:28.061 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-08T07:50:28.061 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server 2023-11-08T07:50:28.086 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T07:50:28.175 INFO:teuthology.dispatcher.supervisor:Running job 7451613 2023-11-08T07:50:28.176 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-11-07_20:51:43-fs-reef-release-distro-default-smithi/7451613 --name yuriw-2023-11-07_20:51:43-fs-reef-release-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/pool-perm} -- /home/teuthworker/archive/yuriw-2023-11-07_20:51:43-fs-reef-release-distro-default-smithi/7451613/orig.config.yaml 2023-11-08T07:50:28.179 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-11-07_20:51:43-fs-reef-release-distro-default-smithi/7451613 2023-11-08T07:50:28.180 INFO:teuthology.dispatcher.supervisor:Job PID: 4159365 2023-11-08T07:50:28.180 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-08T07:52:28.279 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T07:54:28.451 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T07:56:28.640 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T07:58:28.816 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T08:00:28.976 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T08:02:29.161 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T08:04:29.332 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T08:06:29.500 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T08:08:29.664 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T08:08:29.728 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-11-08T08:08:29.887 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-08T08:08:29.887 INFO:teuthology.nuke:Checking targets against current locks 2023-11-08T08:08:29.939 DEBUG:teuthology.nuke:shortname: smithi067 2023-11-08T08:08:29.939 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-08T08:08:29.966 DEBUG:teuthology.nuke:shortname: smithi119 2023-11-08T08:08:29.966 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-08T08:08:29.970 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi067.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-07_20:51:43-fs-reef-release-distro-default-smithi/7451613', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-08 07:45:30.084494', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNgkNbbmEeMy4V1qLsFryQC8G2gbTXME0aapd4mDUW7HoC9fXpGB5ft9/QVisGBfOhIgBBAlvMlHWWf2sA1QodA='} 2023-11-08T08:08:29.989 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi119.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-07_20:51:43-fs-reef-release-distro-default-smithi/7451613', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-08 07:45:30.082687', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFFpWTa6NPmPcAJ/k/yTyqPF6XcMBMRDAFxR2W2lqGEpQa15DZBO+N4SGSAr6We0v0EJhBKvZomFlunDeZYSQnM='} 2023-11-08T08:08:30.020 INFO:teuthology.orchestra.console.smithi067:Power off 2023-11-08T08:08:30.021 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-08T08:08:30.033 INFO:teuthology.orchestra.console.smithi119:Power off 2023-11-08T08:08:30.034 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-08T08:08:30.042 DEBUG:teuthology.orchestra.console.smithi067:power off output: Chassis Power Control: Down/Off 2023-11-08T08:08:30.044 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T08:08:30.055 DEBUG:teuthology.orchestra.console.smithi119:power off output: Chassis Power Control: Down/Off 2023-11-08T08:08:30.056 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T08:08:30.066 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is off 2023-11-08T08:08:30.077 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off 2023-11-08T08:08:30.167 INFO:teuthology.orchestra.console.smithi067:Power off completed 2023-11-08T08:08:30.178 INFO:teuthology.orchestra.console.smithi119:Power off completed 2023-11-08T08:08:30.319 INFO:teuthology.lock.ops:unlocked: smithi067.front.sepia.ceph.com 2023-11-08T08:08:30.327 INFO:teuthology.lock.ops:unlocked: smithi119.front.sepia.ceph.com