2023-08-09T00:47:20.407 INFO:root:teuthology version: 0.0.1.dev179+gce5f6d5 2023-08-09T00:47:20.409 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-09T00:47:20.561 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff222a50280>, signals=[15]) 2023-08-09T00:47:20.562 INFO:teuthology.lock.ops:Start node 'smithi154.front.sepia.ceph.com' reimaging 2023-08-09T00:47:20.562 INFO:teuthology.lock.ops:Updating [smithi154.front.sepia.ceph.com]: reset os type and version on server 2023-08-09T00:47:20.563 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2023-08-09T00:47:20.584 INFO:teuthology.lock.ops:Start node 'smithi159.front.sepia.ceph.com' reimaging 2023-08-09T00:47:20.584 INFO:teuthology.lock.ops:Updating [smithi159.front.sepia.ceph.com]: reset os type and version on server 2023-08-09T00:47:20.585 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server 2023-08-09T00:47:20.586 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /host {"name": "smithi154"} 2023-08-09T00:47:20.608 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /host {"name": "smithi159"} 2023-08-09T00:47:20.648 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-08-09T00:47:20.670 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-08-09T00:47:20.689 DEBUG:teuthology.provision.fog.smithi154:Requesting image smithi_centos_8.stream (ID 3) 2023-08-09T00:47:20.689 DEBUG:teuthology.provision.fog.smithi154:FOG request: PUT /host/259 {"imageID": 3} 2023-08-09T00:47:20.708 DEBUG:teuthology.provision.fog.smithi159:Requesting image smithi_centos_8.stream (ID 3) 2023-08-09T00:47:20.708 DEBUG:teuthology.provision.fog.smithi159:FOG request: PUT /host/264 {"imageID": 3} 2023-08-09T00:47:20.736 INFO:teuthology.provision.fog.smithi154:Scheduling deploy of centos 8.stream 2023-08-09T00:47:20.737 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-08-09T00:47:20.755 INFO:teuthology.provision.fog.smithi159:Scheduling deploy of centos 8.stream 2023-08-09T00:47:20.755 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-08-09T00:47:20.820 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /tasktype {"name": "deploy"} 2023-08-09T00:47:20.823 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /tasktype {"name": "deploy"} 2023-08-09T00:47:20.862 DEBUG:teuthology.provision.fog.smithi159:FOG request: POST /host/264/task {"taskTypeID": 1} 2023-08-09T00:47:20.868 DEBUG:teuthology.provision.fog.smithi154:FOG request: POST /host/259/task {"taskTypeID": 1} 2023-08-09T00:47:20.922 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-08-09T00:47:20.927 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-08-09T00:47:21.040 INFO:teuthology.orchestra.console.smithi159:Power off 2023-08-09T00:47:21.041 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-09T00:47:21.060 INFO:teuthology.orchestra.console.smithi154:Power off 2023-08-09T00:47:21.060 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-09T00:47:21.071 DEBUG:teuthology.orchestra.console.smithi159:power off output: Chassis Power Control: Down/Off 2023-08-09T00:47:21.072 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-09T00:47:21.084 DEBUG:teuthology.orchestra.console.smithi154:power off output: Chassis Power Control: Down/Off 2023-08-09T00:47:21.086 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-09T00:47:21.098 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is off 2023-08-09T00:47:21.111 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on 2023-08-09T00:47:21.199 INFO:teuthology.orchestra.console.smithi159:Power off completed 2023-08-09T00:47:21.300 INFO:teuthology.orchestra.console.smithi159:Power on 2023-08-09T00:47:21.300 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-09T00:47:21.323 DEBUG:teuthology.orchestra.console.smithi159:power on output: Chassis Power Control: Up/On 2023-08-09T00:47:21.324 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-09T00:47:21.347 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is off 2023-08-09T00:47:25.116 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-09T00:47:25.226 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on 2023-08-09T00:47:25.349 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-09T00:47:25.459 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is on 2023-08-09T00:47:25.560 INFO:teuthology.orchestra.console.smithi159:Power on completed 2023-08-09T00:47:25.661 INFO:teuthology.provision.fog.smithi159:Waiting for deploy to finish 2023-08-09T00:47:25.661 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-08-09T00:47:29.232 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-09T00:47:29.341 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on 2023-08-09T00:47:33.344 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-09T00:47:33.455 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off 2023-08-09T00:47:33.556 INFO:teuthology.orchestra.console.smithi154:Power off completed 2023-08-09T00:47:33.657 INFO:teuthology.orchestra.console.smithi154:Power on 2023-08-09T00:47:33.657 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-09T00:47:33.681 DEBUG:teuthology.orchestra.console.smithi154:power on output: Chassis Power Control: Up/On 2023-08-09T00:47:33.682 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-09T00:47:33.707 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off 2023-08-09T00:47:37.708 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-09T00:47:37.819 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off 2023-08-09T00:47:40.748 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-08-09T00:47:41.822 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-09T00:47:41.933 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on 2023-08-09T00:47:42.034 INFO:teuthology.orchestra.console.smithi154:Power on completed 2023-08-09T00:47:42.135 INFO:teuthology.provision.fog.smithi154:Waiting for deploy to finish 2023-08-09T00:47:42.136 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-08-09T00:47:55.852 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-08-09T00:47:57.226 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-08-09T00:48:10.953 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-08-09T00:48:12.318 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-08-09T00:48:26.052 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-08-09T00:48:27.408 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-08-09T00:48:41.136 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-08-09T00:48:42.492 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-08-09T00:48:56.224 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-08-09T00:48:57.575 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-08-09T00:49:11.312 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-08-09T00:49:12.661 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-08-09T00:49:26.400 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-08-09T00:49:27.740 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-08-09T00:49:41.482 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-08-09T00:49:42.798 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-08-09T00:49:56.556 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-08-09T00:49:57.867 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-08-09T00:50:11.652 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-08-09T00:50:11.722 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-09T00:50:12.940 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-08-09T00:50:14.800 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-08-09T00:50:20.806 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-09T00:50:23.856 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-08-09T00:50:28.040 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-08-09T00:50:28.109 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-09T00:50:29.859 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-09T00:50:31.184 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-08-09T00:50:32.912 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-08-09T00:50:37.189 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-09T00:50:38.915 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-09T00:50:40.240 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-08-09T00:50:41.968 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-08-09T00:50:46.244 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-09T00:50:47.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-09T00:50:49.300 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-08-09T00:50:51.024 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-08-09T00:50:55.304 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-09T00:50:57.028 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-09T00:50:58.384 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-08-09T00:51:00.080 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-08-09T00:51:04.389 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-09T00:51:06.084 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-09T00:51:07.440 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-08-09T00:51:09.136 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-08-09T00:51:13.444 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-09T00:51:15.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-09T00:51:16.500 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-08-09T00:51:18.192 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-08-09T00:51:22.505 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-09T00:51:24.195 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-09T00:51:25.584 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-08-09T00:51:31.588 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-09T00:51:34.640 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-08-09T00:51:40.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-09T00:52:12.200 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-09T00:52:12.201 DEBUG:teuthology.orchestra.run.smithi154:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-09T00:52:24.197 WARNING:teuthology.provision.fog.smithi159:timed out 2023-08-09T00:52:30.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-09T00:52:30.395 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-09T00:52:30.396 DEBUG:teuthology.orchestra.run.smithi159:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-09T00:52:30.647 INFO:teuthology.provision.fog.smithi159:Node is ready 2023-08-09T00:52:30.648 DEBUG:teuthology.orchestra.run.smithi159:> hostname 2023-08-09T00:52:30.667 INFO:teuthology.orchestra.run.smithi159.stdout:smithi159.front.sepia.ceph.com 2023-08-09T00:52:30.667 DEBUG:teuthology.orchestra.run.smithi159:> grep smithi159.front.sepia.ceph.com /etc/hosts 2023-08-09T00:52:30.726 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159 smithi159.front.sepia.ceph.com smithi159 2023-08-09T00:52:30.727 DEBUG:teuthology.orchestra.run.smithi159:> sudo hostname smithi159 2023-08-09T00:52:30.825 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/smithi159.front.sepia.ceph.com/smithi159/g' /etc/hosts 2023-08-09T00:52:30.855 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/172.21.15.159/172.21.15.159/g' /etc/hosts 2023-08-09T00:52:30.924 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/smithi159.front.sepia.ceph.com/smithi159/g' /etc/hostname 2023-08-09T00:52:30.992 DEBUG:teuthology.orchestra.run.smithi159:> sudo hostname smithi159 2023-08-09T00:52:31.059 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release 2023-08-09T00:52:31.117 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="CentOS Stream" 2023-08-09T00:52:31.118 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="8" 2023-08-09T00:52:31.118 INFO:teuthology.orchestra.run.smithi159.stdout:ID="centos" 2023-08-09T00:52:31.118 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE="rhel fedora" 2023-08-09T00:52:31.119 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="8" 2023-08-09T00:52:31.119 INFO:teuthology.orchestra.run.smithi159.stdout:PLATFORM_ID="platform:el8" 2023-08-09T00:52:31.119 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-09T00:52:31.119 INFO:teuthology.orchestra.run.smithi159.stdout:ANSI_COLOR="0;31" 2023-08-09T00:52:31.120 INFO:teuthology.orchestra.run.smithi159.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-09T00:52:31.120 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://centos.org/" 2023-08-09T00:52:31.120 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-09T00:52:31.120 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-09T00:52:31.121 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-09T00:52:31.122 INFO:teuthology.provision.fog.smithi159:Deploy complete! 2023-08-09T00:52:31.123 DEBUG:teuthology.parallel:result is None 2023-08-09T00:52:37.418 INFO:teuthology.provision.fog.smithi154:Node is ready 2023-08-09T00:52:37.419 DEBUG:teuthology.orchestra.run.smithi154:> hostname 2023-08-09T00:52:37.442 INFO:teuthology.orchestra.run.smithi154.stdout:smithi154.front.sepia.ceph.com 2023-08-09T00:52:37.443 DEBUG:teuthology.orchestra.run.smithi154:> grep smithi154.front.sepia.ceph.com /etc/hosts 2023-08-09T00:52:37.502 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.15.154 smithi154.front.sepia.ceph.com smithi154 2023-08-09T00:52:37.503 DEBUG:teuthology.orchestra.run.smithi154:> sudo hostname smithi154 2023-08-09T00:52:37.635 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i -e 's/smithi154.front.sepia.ceph.com/smithi154/g' /etc/hosts 2023-08-09T00:52:37.666 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i -e 's/172.21.15.154/172.21.15.154/g' /etc/hosts 2023-08-09T00:52:37.735 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i -e 's/smithi154.front.sepia.ceph.com/smithi154/g' /etc/hostname 2023-08-09T00:52:37.803 DEBUG:teuthology.orchestra.run.smithi154:> sudo hostname smithi154 2023-08-09T00:52:37.871 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release 2023-08-09T00:52:37.928 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="CentOS Stream" 2023-08-09T00:52:37.929 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="8" 2023-08-09T00:52:37.929 INFO:teuthology.orchestra.run.smithi154.stdout:ID="centos" 2023-08-09T00:52:37.930 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE="rhel fedora" 2023-08-09T00:52:37.930 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="8" 2023-08-09T00:52:37.930 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM_ID="platform:el8" 2023-08-09T00:52:37.930 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-09T00:52:37.931 INFO:teuthology.orchestra.run.smithi154.stdout:ANSI_COLOR="0;31" 2023-08-09T00:52:37.931 INFO:teuthology.orchestra.run.smithi154.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-09T00:52:37.931 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://centos.org/" 2023-08-09T00:52:37.932 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-09T00:52:37.932 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-09T00:52:37.932 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-09T00:52:37.933 INFO:teuthology.provision.fog.smithi154:Deploy complete! 2023-08-09T00:52:37.934 DEBUG:teuthology.parallel:result is None 2023-08-09T00:52:38.097 INFO:teuthology.lock.ops:Checking smithi154.front.sepia.ceph.com 2023-08-09T00:52:38.098 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-09T00:52:38.120 INFO:teuthology.lock.ops:Checking smithi159.front.sepia.ceph.com 2023-08-09T00:52:38.121 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-09T00:52:38.139 INFO:teuthology.lock.ops:Updating [smithi154.front.sepia.ceph.com]: set os type and version on server 2023-08-09T00:52:38.140 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2023-08-09T00:52:38.141 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-09T00:52:38.208 DEBUG:teuthology.orchestra.run.smithi154:> true 2023-08-09T00:52:38.278 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi154.front.sepia.ceph.com' 2023-08-09T00:52:38.279 DEBUG:teuthology.orchestra.run.smithi154:> uname -m 2023-08-09T00:52:38.336 INFO:teuthology.orchestra.run.smithi154.stdout:x86_64 2023-08-09T00:52:38.336 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release 2023-08-09T00:52:38.393 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="CentOS Stream" 2023-08-09T00:52:38.394 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="8" 2023-08-09T00:52:38.394 INFO:teuthology.orchestra.run.smithi154.stdout:ID="centos" 2023-08-09T00:52:38.394 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE="rhel fedora" 2023-08-09T00:52:38.395 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="8" 2023-08-09T00:52:38.395 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM_ID="platform:el8" 2023-08-09T00:52:38.395 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-09T00:52:38.395 INFO:teuthology.orchestra.run.smithi154.stdout:ANSI_COLOR="0;31" 2023-08-09T00:52:38.395 INFO:teuthology.orchestra.run.smithi154.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-09T00:52:38.395 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://centos.org/" 2023-08-09T00:52:38.395 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-09T00:52:38.396 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-09T00:52:38.396 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-09T00:52:38.396 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2023-08-09T00:52:38.421 INFO:teuthology.lock.ops:Updating [smithi159.front.sepia.ceph.com]: set os type and version on server 2023-08-09T00:52:38.421 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2023-08-09T00:52:38.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-09T00:52:38.492 DEBUG:teuthology.orchestra.run.smithi159:> true 2023-08-09T00:52:38.570 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi159.front.sepia.ceph.com' 2023-08-09T00:52:38.571 DEBUG:teuthology.orchestra.run.smithi159:> uname -m 2023-08-09T00:52:38.631 INFO:teuthology.orchestra.run.smithi159.stdout:x86_64 2023-08-09T00:52:38.631 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release 2023-08-09T00:52:38.692 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="CentOS Stream" 2023-08-09T00:52:38.692 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="8" 2023-08-09T00:52:38.692 INFO:teuthology.orchestra.run.smithi159.stdout:ID="centos" 2023-08-09T00:52:38.692 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE="rhel fedora" 2023-08-09T00:52:38.692 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="8" 2023-08-09T00:52:38.692 INFO:teuthology.orchestra.run.smithi159.stdout:PLATFORM_ID="platform:el8" 2023-08-09T00:52:38.693 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-09T00:52:38.693 INFO:teuthology.orchestra.run.smithi159.stdout:ANSI_COLOR="0;31" 2023-08-09T00:52:38.693 INFO:teuthology.orchestra.run.smithi159.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-09T00:52:38.693 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://centos.org/" 2023-08-09T00:52:38.693 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-09T00:52:38.693 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-09T00:52:38.693 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-09T00:52:38.694 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server 2023-08-09T00:52:38.713 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-09T00:52:38.794 INFO:teuthology.dispatcher.supervisor:Running job 7360342 2023-08-09T00:52:38.794 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_ce5f6d589a888dfc88977261bfa1ed63441de8fb/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2023-08-04_14:22:11-upgrade:octopus-x-quincy-distro-default-smithi/7360342 --name teuthology-2023-08-04_14:22:11-upgrade:octopus-x-quincy-distro-default-smithi --description upgrade:octopus-x/parallel/{0-distro/centos_8.stream_container_tools 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} -- /home/teuthworker/archive/teuthology-2023-08-04_14:22:11-upgrade:octopus-x-quincy-distro-default-smithi/7360342/orig.config.yaml 2023-08-09T00:52:38.798 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2023-08-04_14:22:11-upgrade:octopus-x-quincy-distro-default-smithi/7360342 2023-08-09T00:52:38.799 INFO:teuthology.dispatcher.supervisor:Job PID: 16597 2023-08-09T00:52:38.799 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-09T00:54:38.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-09T00:56:39.089 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-09T00:58:39.253 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-09T01:00:39.402 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-09T01:02:39.569 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-09T01:04:39.725 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-09T01:06:39.893 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-09T01:08:40.057 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-09T01:10:40.225 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-09T01:12:40.397 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-09T01:14:40.566 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-09T01:16:40.745 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-09T01:18:40.906 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-09T01:20:41.065 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-09T01:22:41.196 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-09T01:24:41.353 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-09T01:26:41.521 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-09T01:28:41.680 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-09T01:30:41.849 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-09T01:32:41.967 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-09T01:34:42.129 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-09T01:36:42.293 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-09T01:36:42.360 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-09T01:36:42.472 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-09T01:36:42.472 INFO:teuthology.nuke:Checking targets against current locks 2023-08-09T01:36:42.518 DEBUG:teuthology.nuke:shortname: smithi154 2023-08-09T01:36:42.518 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-09T01:36:42.539 DEBUG:teuthology.nuke:shortname: smithi159 2023-08-09T01:36:42.539 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-09T01:36:42.541 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi154.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-08-04_14:22:11-upgrade:octopus-x-quincy-distro-default-smithi/7360342', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-09 00:47:19.556243', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4JJsqMyf6ChVBq8U8k0tTVpS0nzoebJnt/+qVSUvfwLIZ6GVTi/UK0+CrYeqiO4FH7BGY5OUtCwbyoxo64W7vY3lQw+C0OONp1AcXDf0lxOHpc2mrEypMzWzb0f6bL0qILVFIkCvvgZ92lpg62humZeCSE0QrJ5fRF1gJaAHae/pD7NUn3k0tg6PRSzrM/ud+M7/rxyL3PfRFeYB128j+0gmKRtH4/vnimRuelZ1OL+kzSxpKshZ8q/YyPzOtPSraSCfvTIWkU2lZiRCvOB8SnqY7flOsPjOoxcrRtUfhp6n2NJ1i3C9GMjtBVLYGmAyI1QN1htJSA+ayOytidpamod/KjJ8x2BOkvum/OMcejwRESUPcTMJ91q1qT0Rv+85p0TaI6Zmy70M5O7R+ft4G+HqDQnOsIpoeosyoJ3NUGNLHbUxBSrN6W+bBZMd95AvIYSirNAQvEDzTbZMnUwDHqMG5JSOTi2IL/s0Q7z03G7ikwMyjhAzwbT5aqkypHsc='} 2023-08-09T01:36:42.562 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi159.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-08-04_14:22:11-upgrade:octopus-x-quincy-distro-default-smithi/7360342', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-09 00:47:19.558303', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCyIFpmu9YkInaTto1N/wztziTtR9AFOlYOCGW58wMQ0OPRgF9ZAzhzwFDNsFFYSWDsTu6A2lAVa/APpC+EZy0QbIuIjVqRr/Pdlo4jAnGZOS1E50BhltBjtnqhJWjwotxRzNFDR2/5VnENjxBV2yCw6LDStZWLz2uXOVSyxzfoTsPH3ZUA/jOIU6hRpfdM/WX+/52GGO0ejbqXA5v27QmyW0pQ4RUh5ZEdVAxzv23nMAvva6kWbdsj/SReRM+ZD0xGTSkeVBKcrFVE8h6xfkT4YyKkAo9yhWsFPygXpZVxXg6VoaSsWAkPL+DnsCG0/i8YB+UUDu4QM9AR0T5olO20URl8zqRTwXwZzryDQOTs8/ymVJuSe8tCaSzV6Njyo2M3Pm1KAfjQ19F5XX2gz5Sdm/y1xXryntTU23TES4Lokf3ndOajHUU3OGz0MVhxv39VSA4df22AZBLtHQPAIMfnE0UwrhfK5o/cPOp31gRS7vuP302FbKEb26fh7g+pDYE='} 2023-08-09T01:36:42.589 INFO:teuthology.orchestra.console.smithi154:Power off 2023-08-09T01:36:42.589 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-09T01:36:42.609 DEBUG:teuthology.orchestra.console.smithi154:power off output: Chassis Power Control: Down/Off 2023-08-09T01:36:42.610 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-09T01:36:42.629 INFO:teuthology.orchestra.console.smithi159:Power off 2023-08-09T01:36:42.630 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-09T01:36:42.638 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off 2023-08-09T01:36:42.648 DEBUG:teuthology.orchestra.console.smithi159:power off output: Chassis Power Control: Down/Off 2023-08-09T01:36:42.649 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-09T01:36:42.668 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is off 2023-08-09T01:36:42.740 INFO:teuthology.orchestra.console.smithi154:Power off completed 2023-08-09T01:36:42.770 INFO:teuthology.orchestra.console.smithi159:Power off completed 2023-08-09T01:36:42.892 INFO:teuthology.lock.ops:unlocked: smithi154.front.sepia.ceph.com 2023-08-09T01:36:42.909 INFO:teuthology.lock.ops:unlocked: smithi159.front.sepia.ceph.com