2023-11-14T02:53:12.670 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-14T02:53:12.672 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-14T02:53:12.804 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd4326f3ca0>, signals=[15]) 2023-11-14T02:53:12.805 INFO:teuthology.lock.ops:Start node 'smithi070.front.sepia.ceph.com' reimaging 2023-11-14T02:53:12.805 INFO:teuthology.lock.ops:Updating [smithi070.front.sepia.ceph.com]: reset os type and version on server 2023-11-14T02:53:12.805 INFO:teuthology.lock.ops:Updating smithi070.front.sepia.ceph.com on lock server 2023-11-14T02:53:12.821 INFO:teuthology.lock.ops:Start node 'smithi160.front.sepia.ceph.com' reimaging 2023-11-14T02:53:12.821 INFO:teuthology.lock.ops:Updating [smithi160.front.sepia.ceph.com]: reset os type and version on server 2023-11-14T02:53:12.822 INFO:teuthology.lock.ops:Updating smithi160.front.sepia.ceph.com on lock server 2023-11-14T02:53:12.823 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /host {"name": "smithi070"} 2023-11-14T02:53:12.846 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /host {"name": "smithi160"} 2023-11-14T02:53:12.894 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-11-14T02:53:12.922 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-11-14T02:53:12.939 DEBUG:teuthology.provision.fog.smithi070:Requesting image smithi_centos_8.stream (ID 3) 2023-11-14T02:53:12.939 DEBUG:teuthology.provision.fog.smithi070:FOG request: PUT /host/175 {"imageID": 3} 2023-11-14T02:53:12.962 DEBUG:teuthology.provision.fog.smithi160:Requesting image smithi_centos_8.stream (ID 3) 2023-11-14T02:53:12.962 DEBUG:teuthology.provision.fog.smithi160:FOG request: PUT /host/265 {"imageID": 3} 2023-11-14T02:53:12.982 INFO:teuthology.provision.fog.smithi070:Scheduling deploy of centos 8.stream 2023-11-14T02:53:12.983 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None 2023-11-14T02:53:13.028 INFO:teuthology.provision.fog.smithi160:Scheduling deploy of centos 8.stream 2023-11-14T02:53:13.029 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-11-14T02:53:13.032 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /tasktype {"name": "deploy"} 2023-11-14T02:53:13.078 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /tasktype {"name": "deploy"} 2023-11-14T02:53:13.082 DEBUG:teuthology.provision.fog.smithi070:FOG request: POST /host/175/task {"taskTypeID": 1} 2023-11-14T02:53:13.119 DEBUG:teuthology.provision.fog.smithi160:FOG request: POST /host/265/task {"taskTypeID": 1} 2023-11-14T02:53:13.125 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None 2023-11-14T02:53:13.173 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-11-14T02:53:13.216 INFO:teuthology.orchestra.console.smithi070:Power off 2023-11-14T02:53:13.217 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-14T02:53:13.237 DEBUG:teuthology.orchestra.console.smithi070:power off output: Chassis Power Control: Down/Off 2023-11-14T02:53:13.237 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-14T02:53:13.254 INFO:teuthology.orchestra.console.smithi160:Power off 2023-11-14T02:53:13.255 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-14T02:53:13.262 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is on 2023-11-14T02:53:13.277 DEBUG:teuthology.orchestra.console.smithi160:power off output: Chassis Power Control: Down/Off 2023-11-14T02:53:13.278 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-14T02:53:13.304 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is on 2023-11-14T02:53:17.266 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-14T02:53:17.305 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-14T02:53:17.375 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is on 2023-11-14T02:53:17.413 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is on 2023-11-14T02:53:21.380 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-14T02:53:21.414 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-14T02:53:21.489 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is off 2023-11-14T02:53:21.522 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is off 2023-11-14T02:53:21.590 INFO:teuthology.orchestra.console.smithi070:Power off completed 2023-11-14T02:53:21.623 INFO:teuthology.orchestra.console.smithi160:Power off completed 2023-11-14T02:53:21.691 INFO:teuthology.orchestra.console.smithi070:Power on 2023-11-14T02:53:21.692 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-14T02:53:21.711 DEBUG:teuthology.orchestra.console.smithi070:power on output: Chassis Power Control: Up/On 2023-11-14T02:53:21.711 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-14T02:53:21.724 INFO:teuthology.orchestra.console.smithi160:Power on 2023-11-14T02:53:21.724 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-14T02:53:21.731 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is off 2023-11-14T02:53:21.742 DEBUG:teuthology.orchestra.console.smithi160:power on output: Chassis Power Control: Up/On 2023-11-14T02:53:21.742 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-14T02:53:21.761 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is off 2023-11-14T02:53:25.736 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-14T02:53:25.763 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-14T02:53:25.844 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is off 2023-11-14T02:53:25.870 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is off 2023-11-14T02:53:29.849 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-14T02:53:29.871 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-14T02:53:29.958 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is on 2023-11-14T02:53:30.004 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is on 2023-11-14T02:53:30.060 INFO:teuthology.orchestra.console.smithi070:Power on completed 2023-11-14T02:53:30.106 INFO:teuthology.orchestra.console.smithi160:Power on completed 2023-11-14T02:53:30.162 INFO:teuthology.provision.fog.smithi070:Waiting for deploy to finish 2023-11-14T02:53:30.162 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None 2023-11-14T02:53:30.208 INFO:teuthology.provision.fog.smithi160:Waiting for deploy to finish 2023-11-14T02:53:30.208 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-11-14T02:53:45.228 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None 2023-11-14T02:53:45.250 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-11-14T02:54:00.325 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None 2023-11-14T02:54:00.327 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-11-14T02:54:15.416 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-11-14T02:54:15.419 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None 2023-11-14T02:54:30.508 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None 2023-11-14T02:54:30.510 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-11-14T02:54:45.599 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None 2023-11-14T02:54:45.600 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-11-14T02:55:00.699 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None 2023-11-14T02:55:00.701 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-11-14T02:55:15.806 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None 2023-11-14T02:55:15.808 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-11-14T02:55:30.912 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-11-14T02:55:30.914 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None 2023-11-14T02:55:46.043 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None 2023-11-14T02:55:46.045 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-11-14T02:56:01.192 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-11-14T02:56:01.194 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None 2023-11-14T02:56:16.355 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-11-14T02:56:16.356 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None 2023-11-14T02:56:16.464 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T02:56:16.484 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T02:56:19.547 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-11-14T02:56:19.548 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70 2023-11-14T02:56:25.555 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T02:56:25.557 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T02:56:28.634 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-11-14T02:56:28.635 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70 2023-11-14T02:56:34.642 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T02:56:34.645 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T02:56:37.722 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-11-14T02:56:37.723 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70 2023-11-14T02:56:43.730 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T02:56:43.732 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T02:56:46.810 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-11-14T02:56:46.811 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70 2023-11-14T02:56:52.818 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T02:56:52.821 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T02:56:55.898 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-11-14T02:56:55.899 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70 2023-11-14T02:57:01.906 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T02:57:01.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T02:57:04.986 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-11-14T02:57:10.993 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T02:57:14.074 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-11-14T02:57:20.082 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T02:57:20.250 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70 2023-11-14T02:57:26.257 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T02:57:29.338 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70 2023-11-14T02:57:35.346 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T02:57:38.630 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-14T02:57:38.631 DEBUG:teuthology.orchestra.run.smithi070:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-14T02:58:03.722 INFO:teuthology.provision.fog.smithi070:Node is ready 2023-11-14T02:58:03.723 DEBUG:teuthology.orchestra.run.smithi070:> hostname 2023-11-14T02:58:03.747 INFO:teuthology.orchestra.run.smithi070.stdout:smithi070.front.sepia.ceph.com 2023-11-14T02:58:03.748 DEBUG:teuthology.orchestra.run.smithi070:> grep smithi070.front.sepia.ceph.com /etc/hosts 2023-11-14T02:58:03.809 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70 smithi070.front.sepia.ceph.com smithi070 2023-11-14T02:58:03.809 DEBUG:teuthology.orchestra.run.smithi070:> sudo hostname smithi070 2023-11-14T02:58:03.937 DEBUG:teuthology.orchestra.run.smithi070:> sudo sed -i -e 's/smithi070.front.sepia.ceph.com/smithi070/g' /etc/hosts 2023-11-14T02:58:03.968 DEBUG:teuthology.orchestra.run.smithi070:> sudo sed -i -e 's/172.21.15.70/172.21.15.70/g' /etc/hosts 2023-11-14T02:58:04.038 DEBUG:teuthology.orchestra.run.smithi070:> sudo sed -i -e 's/smithi070.front.sepia.ceph.com/smithi070/g' /etc/hostname 2023-11-14T02:58:04.107 DEBUG:teuthology.orchestra.run.smithi070:> sudo hostname smithi070 2023-11-14T02:58:04.175 DEBUG:teuthology.orchestra.run.smithi070:> cat /etc/os-release 2023-11-14T02:58:04.233 INFO:teuthology.orchestra.run.smithi070.stdout:NAME="CentOS Stream" 2023-11-14T02:58:04.234 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION="8" 2023-11-14T02:58:04.234 INFO:teuthology.orchestra.run.smithi070.stdout:ID="centos" 2023-11-14T02:58:04.234 INFO:teuthology.orchestra.run.smithi070.stdout:ID_LIKE="rhel fedora" 2023-11-14T02:58:04.234 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION_ID="8" 2023-11-14T02:58:04.235 INFO:teuthology.orchestra.run.smithi070.stdout:PLATFORM_ID="platform:el8" 2023-11-14T02:58:04.235 INFO:teuthology.orchestra.run.smithi070.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-14T02:58:04.235 INFO:teuthology.orchestra.run.smithi070.stdout:ANSI_COLOR="0;31" 2023-11-14T02:58:04.235 INFO:teuthology.orchestra.run.smithi070.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-14T02:58:04.235 INFO:teuthology.orchestra.run.smithi070.stdout:HOME_URL="https://centos.org/" 2023-11-14T02:58:04.235 INFO:teuthology.orchestra.run.smithi070.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-14T02:58:04.236 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-14T02:58:04.236 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-14T02:58:04.237 INFO:teuthology.provision.fog.smithi070:Deploy complete! 2023-11-14T02:58:04.238 DEBUG:teuthology.parallel:result is None 2023-11-14T02:58:20.089 WARNING:teuthology.provision.fog.smithi160:timed out 2023-11-14T02:58:26.098 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T02:58:26.366 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-14T02:58:26.366 DEBUG:teuthology.orchestra.run.smithi160:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-14T02:58:26.627 INFO:teuthology.provision.fog.smithi160:Node is ready 2023-11-14T02:58:26.628 DEBUG:teuthology.orchestra.run.smithi160:> hostname 2023-11-14T02:58:26.648 INFO:teuthology.orchestra.run.smithi160.stdout:smithi160.front.sepia.ceph.com 2023-11-14T02:58:26.648 DEBUG:teuthology.orchestra.run.smithi160:> grep smithi160.front.sepia.ceph.com /etc/hosts 2023-11-14T02:58:26.709 INFO:teuthology.orchestra.run.smithi160.stdout:172.21.15.160 smithi160.front.sepia.ceph.com smithi160 2023-11-14T02:58:26.710 DEBUG:teuthology.orchestra.run.smithi160:> sudo hostname smithi160 2023-11-14T02:58:26.808 DEBUG:teuthology.orchestra.run.smithi160:> sudo sed -i -e 's/smithi160.front.sepia.ceph.com/smithi160/g' /etc/hosts 2023-11-14T02:58:26.838 DEBUG:teuthology.orchestra.run.smithi160:> sudo sed -i -e 's/172.21.15.160/172.21.15.160/g' /etc/hosts 2023-11-14T02:58:26.908 DEBUG:teuthology.orchestra.run.smithi160:> sudo sed -i -e 's/smithi160.front.sepia.ceph.com/smithi160/g' /etc/hostname 2023-11-14T02:58:26.977 DEBUG:teuthology.orchestra.run.smithi160:> sudo hostname smithi160 2023-11-14T02:58:27.046 DEBUG:teuthology.orchestra.run.smithi160:> cat /etc/os-release 2023-11-14T02:58:27.104 INFO:teuthology.orchestra.run.smithi160.stdout:NAME="CentOS Stream" 2023-11-14T02:58:27.104 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION="8" 2023-11-14T02:58:27.104 INFO:teuthology.orchestra.run.smithi160.stdout:ID="centos" 2023-11-14T02:58:27.105 INFO:teuthology.orchestra.run.smithi160.stdout:ID_LIKE="rhel fedora" 2023-11-14T02:58:27.105 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION_ID="8" 2023-11-14T02:58:27.105 INFO:teuthology.orchestra.run.smithi160.stdout:PLATFORM_ID="platform:el8" 2023-11-14T02:58:27.106 INFO:teuthology.orchestra.run.smithi160.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-14T02:58:27.106 INFO:teuthology.orchestra.run.smithi160.stdout:ANSI_COLOR="0;31" 2023-11-14T02:58:27.106 INFO:teuthology.orchestra.run.smithi160.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-14T02:58:27.106 INFO:teuthology.orchestra.run.smithi160.stdout:HOME_URL="https://centos.org/" 2023-11-14T02:58:27.107 INFO:teuthology.orchestra.run.smithi160.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-14T02:58:27.107 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-14T02:58:27.107 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-14T02:58:27.108 INFO:teuthology.provision.fog.smithi160:Deploy complete! 2023-11-14T02:58:27.108 DEBUG:teuthology.parallel:result is None 2023-11-14T02:58:27.261 INFO:teuthology.lock.ops:Checking smithi070.front.sepia.ceph.com 2023-11-14T02:58:27.262 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-14T02:58:27.291 INFO:teuthology.lock.ops:Checking smithi160.front.sepia.ceph.com 2023-11-14T02:58:27.292 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-14T02:58:27.317 INFO:teuthology.lock.ops:Updating [smithi070.front.sepia.ceph.com]: set os type and version on server 2023-11-14T02:58:27.318 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2023-11-14T02:58:27.319 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T02:58:27.387 DEBUG:teuthology.orchestra.run.smithi070:> true 2023-11-14T02:58:27.522 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi070.front.sepia.ceph.com' 2023-11-14T02:58:27.522 DEBUG:teuthology.orchestra.run.smithi070:> uname -m 2023-11-14T02:58:27.580 INFO:teuthology.orchestra.run.smithi070.stdout:x86_64 2023-11-14T02:58:27.581 DEBUG:teuthology.orchestra.run.smithi070:> cat /etc/os-release 2023-11-14T02:58:27.639 INFO:teuthology.orchestra.run.smithi070.stdout:NAME="CentOS Stream" 2023-11-14T02:58:27.639 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION="8" 2023-11-14T02:58:27.640 INFO:teuthology.orchestra.run.smithi070.stdout:ID="centos" 2023-11-14T02:58:27.640 INFO:teuthology.orchestra.run.smithi070.stdout:ID_LIKE="rhel fedora" 2023-11-14T02:58:27.640 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION_ID="8" 2023-11-14T02:58:27.641 INFO:teuthology.orchestra.run.smithi070.stdout:PLATFORM_ID="platform:el8" 2023-11-14T02:58:27.641 INFO:teuthology.orchestra.run.smithi070.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-14T02:58:27.641 INFO:teuthology.orchestra.run.smithi070.stdout:ANSI_COLOR="0;31" 2023-11-14T02:58:27.641 INFO:teuthology.orchestra.run.smithi070.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-14T02:58:27.642 INFO:teuthology.orchestra.run.smithi070.stdout:HOME_URL="https://centos.org/" 2023-11-14T02:58:27.642 INFO:teuthology.orchestra.run.smithi070.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-14T02:58:27.642 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-14T02:58:27.642 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-14T02:58:27.643 INFO:teuthology.lock.ops:Updating smithi070.front.sepia.ceph.com on lock server 2023-11-14T02:58:27.667 INFO:teuthology.lock.ops:Updating [smithi160.front.sepia.ceph.com]: set os type and version on server 2023-11-14T02:58:27.667 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com' 2023-11-14T02:58:27.668 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T02:58:27.737 DEBUG:teuthology.orchestra.run.smithi160:> true 2023-11-14T02:58:27.805 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi160.front.sepia.ceph.com' 2023-11-14T02:58:27.805 DEBUG:teuthology.orchestra.run.smithi160:> uname -m 2023-11-14T02:58:27.863 INFO:teuthology.orchestra.run.smithi160.stdout:x86_64 2023-11-14T02:58:27.863 DEBUG:teuthology.orchestra.run.smithi160:> cat /etc/os-release 2023-11-14T02:58:27.921 INFO:teuthology.orchestra.run.smithi160.stdout:NAME="CentOS Stream" 2023-11-14T02:58:27.921 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION="8" 2023-11-14T02:58:27.922 INFO:teuthology.orchestra.run.smithi160.stdout:ID="centos" 2023-11-14T02:58:27.922 INFO:teuthology.orchestra.run.smithi160.stdout:ID_LIKE="rhel fedora" 2023-11-14T02:58:27.922 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION_ID="8" 2023-11-14T02:58:27.922 INFO:teuthology.orchestra.run.smithi160.stdout:PLATFORM_ID="platform:el8" 2023-11-14T02:58:27.923 INFO:teuthology.orchestra.run.smithi160.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-14T02:58:27.923 INFO:teuthology.orchestra.run.smithi160.stdout:ANSI_COLOR="0;31" 2023-11-14T02:58:27.923 INFO:teuthology.orchestra.run.smithi160.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-14T02:58:27.924 INFO:teuthology.orchestra.run.smithi160.stdout:HOME_URL="https://centos.org/" 2023-11-14T02:58:27.924 INFO:teuthology.orchestra.run.smithi160.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-14T02:58:27.924 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-14T02:58:27.924 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-14T02:58:27.925 INFO:teuthology.lock.ops:Updating smithi160.front.sepia.ceph.com on lock server 2023-11-14T02:58:27.950 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-14T02:58:28.045 INFO:teuthology.dispatcher.supervisor:Running job 7456679 2023-11-14T02:58:28.045 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-11-14_02:53:06-rados:dashboard-reef-release-distro-default-smithi/7456679 --name yuriw-2023-11-14_02:53:06-rados:dashboard-reef-release-distro-default-smithi --description rados:dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-bitmap} tasks/e2e} -- /home/teuthworker/archive/yuriw-2023-11-14_02:53:06-rados:dashboard-reef-release-distro-default-smithi/7456679/orig.config.yaml 2023-11-14T02:58:28.049 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-11-14_02:53:06-rados:dashboard-reef-release-distro-default-smithi/7456679 2023-11-14T02:58:28.050 INFO:teuthology.dispatcher.supervisor:Job PID: 460762 2023-11-14T02:58:28.050 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-14T03:00:28.139 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-14T03:02:28.299 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-14T03:04:28.527 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-14T03:06:28.699 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-14T03:08:28.875 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-14T03:10:29.000 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-14T03:12:29.163 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-14T03:14:29.314 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-14T03:16:29.499 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-14T03:18:29.631 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-14T03:20:29.829 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-14T03:22:30.004 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-14T03:24:30.179 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-14T03:26:30.337 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-14T03:28:30.500 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-14T03:30:30.667 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-14T03:32:30.844 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-14T03:34:31.007 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-14T03:34:31.081 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-11-14T03:34:31.177 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-14T03:34:31.177 INFO:teuthology.nuke:Checking targets against current locks 2023-11-14T03:34:31.232 DEBUG:teuthology.nuke:shortname: smithi070 2023-11-14T03:34:31.233 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-14T03:34:31.251 DEBUG:teuthology.nuke:shortname: smithi160 2023-11-14T03:34:31.252 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-14T03:34:31.257 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi070.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-14_02:53:06-rados:dashboard-reef-release-distro-default-smithi/7456679', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-14 02:53:11.903630', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFlkrq5ux1c3n3in6VWACP0G57YR0+S9Nk/2OBtgCxq1TdzPKIdmHc/F3UGJVSiJQN2UOZHcTeJ32Q0mfhNWP0M='} 2023-11-14T03:34:31.281 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi160.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-14_02:53:06-rados:dashboard-reef-release-distro-default-smithi/7456679', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-14 02:53:11.905721', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB7GmUkGpnCp3z9iZqOCufLooal+0z5N2Ch/10mjwN8a02YXzPWI7sXhJZF88/OoNc4aV8vYjnEFwOQCSY0eNuE='} 2023-11-14T03:34:31.311 INFO:teuthology.orchestra.console.smithi070:Power off 2023-11-14T03:34:31.312 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-14T03:34:31.333 DEBUG:teuthology.orchestra.console.smithi070:power off output: Chassis Power Control: Down/Off 2023-11-14T03:34:31.334 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-14T03:34:31.350 INFO:teuthology.orchestra.console.smithi160:Power off 2023-11-14T03:34:31.350 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-14T03:34:31.359 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is off 2023-11-14T03:34:31.373 DEBUG:teuthology.orchestra.console.smithi160:power off output: Chassis Power Control: Down/Off 2023-11-14T03:34:31.373 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-14T03:34:31.398 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is off 2023-11-14T03:34:31.461 INFO:teuthology.orchestra.console.smithi070:Power off completed 2023-11-14T03:34:31.500 INFO:teuthology.orchestra.console.smithi160:Power off completed 2023-11-14T03:34:31.613 INFO:teuthology.lock.ops:unlocked: smithi070.front.sepia.ceph.com 2023-11-14T03:34:31.647 INFO:teuthology.lock.ops:unlocked: smithi160.front.sepia.ceph.com