2023-10-26T02:48:07.526 INFO:root:teuthology version: 0.0.1.dev201+g202b180 2023-10-26T02:48:07.528 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-26T02:48:07.668 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc39c01aee0>, signals=[15]) 2023-10-26T02:48:07.670 INFO:teuthology.lock.ops:Start node 'smithi033.front.sepia.ceph.com' reimaging 2023-10-26T02:48:07.670 INFO:teuthology.lock.ops:Updating [smithi033.front.sepia.ceph.com]: reset os type and version on server 2023-10-26T02:48:07.671 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server 2023-10-26T02:48:07.700 INFO:teuthology.lock.ops:Start node 'smithi169.front.sepia.ceph.com' reimaging 2023-10-26T02:48:07.701 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: reset os type and version on server 2023-10-26T02:48:07.701 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2023-10-26T02:48:07.703 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /host {"name": "smithi033"} 2023-10-26T02:48:07.725 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /host {"name": "smithi169"} 2023-10-26T02:48:07.788 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-10-26T02:48:07.808 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-10-26T02:48:07.825 DEBUG:teuthology.provision.fog.smithi033:Requesting image smithi_centos_8.stream (ID 3) 2023-10-26T02:48:07.825 DEBUG:teuthology.provision.fog.smithi033:FOG request: PUT /host/138 {"imageID": 3} 2023-10-26T02:48:07.851 DEBUG:teuthology.provision.fog.smithi169:Requesting image smithi_centos_8.stream (ID 3) 2023-10-26T02:48:07.851 DEBUG:teuthology.provision.fog.smithi169:FOG request: PUT /host/274 {"imageID": 3} 2023-10-26T02:48:07.875 INFO:teuthology.provision.fog.smithi033:Scheduling deploy of centos 8.stream 2023-10-26T02:48:07.876 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-10-26T02:48:07.904 INFO:teuthology.provision.fog.smithi169:Scheduling deploy of centos 8.stream 2023-10-26T02:48:07.904 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-26T02:48:07.925 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /tasktype {"name": "deploy"} 2023-10-26T02:48:07.956 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /tasktype {"name": "deploy"} 2023-10-26T02:48:07.970 DEBUG:teuthology.provision.fog.smithi033:FOG request: POST /host/138/task {"taskTypeID": 1} 2023-10-26T02:48:07.997 DEBUG:teuthology.provision.fog.smithi169:FOG request: POST /host/274/task {"taskTypeID": 1} 2023-10-26T02:48:08.014 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-10-26T02:48:08.042 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-26T02:48:08.097 INFO:teuthology.orchestra.console.smithi033:Power off 2023-10-26T02:48:08.098 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-26T02:48:08.122 DEBUG:teuthology.orchestra.console.smithi033:power off output: Chassis Power Control: Down/Off 2023-10-26T02:48:08.123 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-26T02:48:08.137 INFO:teuthology.orchestra.console.smithi169:Power off 2023-10-26T02:48:08.137 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-26T02:48:08.145 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on 2023-10-26T02:48:08.158 DEBUG:teuthology.orchestra.console.smithi169:power off output: Chassis Power Control: Down/Off 2023-10-26T02:48:08.159 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-26T02:48:08.186 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on 2023-10-26T02:48:12.150 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-26T02:48:12.187 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-26T02:48:12.260 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on 2023-10-26T02:48:12.297 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on 2023-10-26T02:48:16.263 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-26T02:48:16.298 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-26T02:48:16.372 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on 2023-10-26T02:48:16.407 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on 2023-10-26T02:48:20.378 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-26T02:48:20.407 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-26T02:48:20.486 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off 2023-10-26T02:48:20.516 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2023-10-26T02:48:20.587 INFO:teuthology.orchestra.console.smithi033:Power off completed 2023-10-26T02:48:20.618 INFO:teuthology.orchestra.console.smithi169:Power off completed 2023-10-26T02:48:20.689 INFO:teuthology.orchestra.console.smithi033:Power on 2023-10-26T02:48:20.689 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-26T02:48:20.710 DEBUG:teuthology.orchestra.console.smithi033:power on output: Chassis Power Control: Up/On 2023-10-26T02:48:20.711 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-26T02:48:20.722 INFO:teuthology.orchestra.console.smithi169:Power on 2023-10-26T02:48:20.723 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-26T02:48:20.739 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off 2023-10-26T02:48:20.742 DEBUG:teuthology.orchestra.console.smithi169:power on output: Chassis Power Control: Up/On 2023-10-26T02:48:20.742 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-26T02:48:20.768 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2023-10-26T02:48:24.744 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-26T02:48:24.770 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-26T02:48:24.855 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off 2023-10-26T02:48:24.879 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2023-10-26T02:48:28.858 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-26T02:48:28.880 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-26T02:48:28.967 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on 2023-10-26T02:48:28.989 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on 2023-10-26T02:48:29.068 INFO:teuthology.orchestra.console.smithi033:Power on completed 2023-10-26T02:48:29.091 INFO:teuthology.orchestra.console.smithi169:Power on completed 2023-10-26T02:48:29.169 INFO:teuthology.provision.fog.smithi033:Waiting for deploy to finish 2023-10-26T02:48:29.170 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-10-26T02:48:29.192 INFO:teuthology.provision.fog.smithi169:Waiting for deploy to finish 2023-10-26T02:48:29.193 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-26T02:48:44.242 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-10-26T02:48:44.246 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-26T02:48:59.330 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-26T02:48:59.332 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-10-26T02:49:14.393 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-26T02:49:14.397 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-10-26T02:49:29.463 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-26T02:49:29.465 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-10-26T02:49:44.538 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-26T02:49:44.540 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-10-26T02:49:59.622 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-26T02:49:59.624 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-10-26T02:50:14.704 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-26T02:50:14.705 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-10-26T02:50:29.784 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-26T02:50:29.786 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-10-26T02:50:44.870 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-10-26T02:50:44.873 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-26T02:50:59.946 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-10-26T02:50:59.948 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-26T02:51:00.021 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-26T02:51:15.028 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-26T02:51:15.108 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-26T02:51:18.522 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-10-26T02:51:24.530 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-26T02:51:27.610 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-10-26T02:51:33.617 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-26T02:51:33.628 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-10-26T02:51:36.702 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-10-26T02:51:39.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-26T02:51:42.706 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-26T02:51:42.714 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-10-26T02:51:48.718 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-26T02:51:51.770 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-10-26T02:51:57.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-26T02:52:00.826 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-10-26T02:52:01.274 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-10-26T02:52:06.834 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-26T02:52:07.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-26T02:52:09.914 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-10-26T02:52:10.330 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-10-26T02:52:15.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-26T02:52:16.332 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-26T02:52:19.386 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-10-26T02:52:25.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-26T02:52:26.019 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-26T02:52:26.020 DEBUG:teuthology.orchestra.run.smithi033:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-26T02:52:37.204 INFO:teuthology.provision.fog.smithi033:Node is ready 2023-10-26T02:52:37.204 DEBUG:teuthology.orchestra.run.smithi033:> hostname 2023-10-26T02:52:37.229 INFO:teuthology.orchestra.run.smithi033.stdout:smithi033.front.sepia.ceph.com 2023-10-26T02:52:37.230 DEBUG:teuthology.orchestra.run.smithi033:> grep smithi033.front.sepia.ceph.com /etc/hosts 2023-10-26T02:52:37.292 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33 smithi033.front.sepia.ceph.com smithi033 2023-10-26T02:52:37.292 DEBUG:teuthology.orchestra.run.smithi033:> sudo hostname smithi033 2023-10-26T02:52:37.425 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/smithi033.front.sepia.ceph.com/smithi033/g' /etc/hosts 2023-10-26T02:52:37.457 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/172.21.15.33/172.21.15.33/g' /etc/hosts 2023-10-26T02:52:37.529 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/smithi033.front.sepia.ceph.com/smithi033/g' /etc/hostname 2023-10-26T02:52:37.600 DEBUG:teuthology.orchestra.run.smithi033:> sudo hostname smithi033 2023-10-26T02:52:37.669 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release 2023-10-26T02:52:37.728 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="CentOS Stream" 2023-10-26T02:52:37.728 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="8" 2023-10-26T02:52:37.728 INFO:teuthology.orchestra.run.smithi033.stdout:ID="centos" 2023-10-26T02:52:37.728 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE="rhel fedora" 2023-10-26T02:52:37.728 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="8" 2023-10-26T02:52:37.729 INFO:teuthology.orchestra.run.smithi033.stdout:PLATFORM_ID="platform:el8" 2023-10-26T02:52:37.729 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-26T02:52:37.729 INFO:teuthology.orchestra.run.smithi033.stdout:ANSI_COLOR="0;31" 2023-10-26T02:52:37.729 INFO:teuthology.orchestra.run.smithi033.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-26T02:52:37.729 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://centos.org/" 2023-10-26T02:52:37.730 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-26T02:52:37.730 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-26T02:52:37.730 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-26T02:52:37.731 INFO:teuthology.provision.fog.smithi033:Deploy complete! 2023-10-26T02:52:37.732 DEBUG:teuthology.parallel:result is None 2023-10-26T02:53:15.958 WARNING:teuthology.provision.fog.smithi169:timed out 2023-10-26T02:53:21.964 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-26T02:53:22.191 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-26T02:53:22.192 DEBUG:teuthology.orchestra.run.smithi169:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-26T02:53:22.467 INFO:teuthology.provision.fog.smithi169:Node is ready 2023-10-26T02:53:22.468 DEBUG:teuthology.orchestra.run.smithi169:> hostname 2023-10-26T02:53:22.488 INFO:teuthology.orchestra.run.smithi169.stdout:smithi169.front.sepia.ceph.com 2023-10-26T02:53:22.488 DEBUG:teuthology.orchestra.run.smithi169:> grep smithi169.front.sepia.ceph.com /etc/hosts 2023-10-26T02:53:22.548 INFO:teuthology.orchestra.run.smithi169.stdout:172.21.15.169 smithi169.front.sepia.ceph.com smithi169 2023-10-26T02:53:22.549 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169 2023-10-26T02:53:22.647 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi169.front.sepia.ceph.com/smithi169/g' /etc/hosts 2023-10-26T02:53:22.677 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/172.21.15.169/172.21.15.169/g' /etc/hosts 2023-10-26T02:53:22.746 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi169.front.sepia.ceph.com/smithi169/g' /etc/hostname 2023-10-26T02:53:22.814 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169 2023-10-26T02:53:22.880 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2023-10-26T02:53:22.939 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="CentOS Stream" 2023-10-26T02:53:22.940 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="8" 2023-10-26T02:53:22.940 INFO:teuthology.orchestra.run.smithi169.stdout:ID="centos" 2023-10-26T02:53:22.940 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="rhel fedora" 2023-10-26T02:53:22.940 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="8" 2023-10-26T02:53:22.940 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el8" 2023-10-26T02:53:22.941 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-26T02:53:22.941 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31" 2023-10-26T02:53:22.941 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-26T02:53:22.941 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://centos.org/" 2023-10-26T02:53:22.941 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-26T02:53:22.942 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-26T02:53:22.942 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-26T02:53:22.942 INFO:teuthology.provision.fog.smithi169:Deploy complete! 2023-10-26T02:53:22.943 DEBUG:teuthology.parallel:result is None 2023-10-26T02:53:23.097 INFO:teuthology.lock.ops:Checking smithi033.front.sepia.ceph.com 2023-10-26T02:53:23.098 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-26T02:53:23.119 INFO:teuthology.lock.ops:Checking smithi169.front.sepia.ceph.com 2023-10-26T02:53:23.119 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-26T02:53:23.136 INFO:teuthology.lock.ops:Updating [smithi033.front.sepia.ceph.com]: set os type and version on server 2023-10-26T02:53:23.137 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2023-10-26T02:53:23.137 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-26T02:53:23.205 DEBUG:teuthology.orchestra.run.smithi033:> true 2023-10-26T02:53:23.351 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi033.front.sepia.ceph.com' 2023-10-26T02:53:23.351 DEBUG:teuthology.orchestra.run.smithi033:> uname -m 2023-10-26T02:53:23.412 INFO:teuthology.orchestra.run.smithi033.stdout:x86_64 2023-10-26T02:53:23.412 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release 2023-10-26T02:53:23.472 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="CentOS Stream" 2023-10-26T02:53:23.472 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="8" 2023-10-26T02:53:23.472 INFO:teuthology.orchestra.run.smithi033.stdout:ID="centos" 2023-10-26T02:53:23.473 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE="rhel fedora" 2023-10-26T02:53:23.473 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="8" 2023-10-26T02:53:23.473 INFO:teuthology.orchestra.run.smithi033.stdout:PLATFORM_ID="platform:el8" 2023-10-26T02:53:23.473 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-26T02:53:23.473 INFO:teuthology.orchestra.run.smithi033.stdout:ANSI_COLOR="0;31" 2023-10-26T02:53:23.474 INFO:teuthology.orchestra.run.smithi033.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-26T02:53:23.474 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://centos.org/" 2023-10-26T02:53:23.474 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-26T02:53:23.474 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-26T02:53:23.474 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-26T02:53:23.475 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server 2023-10-26T02:53:23.494 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: set os type and version on server 2023-10-26T02:53:23.494 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2023-10-26T02:53:23.495 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-26T02:53:23.563 DEBUG:teuthology.orchestra.run.smithi169:> true 2023-10-26T02:53:23.633 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi169.front.sepia.ceph.com' 2023-10-26T02:53:23.634 DEBUG:teuthology.orchestra.run.smithi169:> uname -m 2023-10-26T02:53:23.693 INFO:teuthology.orchestra.run.smithi169.stdout:x86_64 2023-10-26T02:53:23.693 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2023-10-26T02:53:23.752 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="CentOS Stream" 2023-10-26T02:53:23.752 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="8" 2023-10-26T02:53:23.753 INFO:teuthology.orchestra.run.smithi169.stdout:ID="centos" 2023-10-26T02:53:23.753 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="rhel fedora" 2023-10-26T02:53:23.753 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="8" 2023-10-26T02:53:23.753 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el8" 2023-10-26T02:53:23.753 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-26T02:53:23.754 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31" 2023-10-26T02:53:23.754 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-26T02:53:23.754 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://centos.org/" 2023-10-26T02:53:23.754 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-26T02:53:23.754 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-26T02:53:23.755 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-26T02:53:23.755 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2023-10-26T02:53:23.777 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-26T02:53:23.874 INFO:teuthology.dispatcher.supervisor:Running job 7438279 2023-10-26T02:53:23.875 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2023-10-26_02:25:12-upgrade:reef-x-main-distro-default-smithi/7438279 --name teuthology-2023-10-26_02:25:12-upgrade:reef-x-main-distro-default-smithi --description upgrade:reef-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} -- /home/teuthworker/archive/teuthology-2023-10-26_02:25:12-upgrade:reef-x-main-distro-default-smithi/7438279/orig.config.yaml 2023-10-26T02:53:23.879 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2023-10-26_02:25:12-upgrade:reef-x-main-distro-default-smithi/7438279 2023-10-26T02:53:23.880 INFO:teuthology.dispatcher.supervisor:Job PID: 3112892 2023-10-26T02:53:23.880 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-26T02:55:23.979 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-26T02:57:24.147 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-26T02:59:24.317 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-26T03:01:24.487 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-26T03:03:24.656 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-26T03:05:24.817 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-26T03:07:24.979 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-26T03:09:25.155 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-26T03:11:25.339 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-26T03:13:25.511 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-26T03:13:25.580 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-26T03:13:25.776 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-26T03:13:25.777 INFO:teuthology.nuke:Checking targets against current locks 2023-10-26T03:13:25.826 DEBUG:teuthology.nuke:shortname: smithi033 2023-10-26T03:13:25.827 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-26T03:13:25.852 DEBUG:teuthology.nuke:shortname: smithi169 2023-10-26T03:13:25.852 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-26T03:13:25.856 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi033.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-10-26_02:25:12-upgrade:reef-x-main-distro-default-smithi/7438279', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-26 02:48:06.618505', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHknlw/C0smjx0GUz2mVKkIPiVNhPiJbbItaA0dmIWr2E1j8p+FWC9rpK8gOVvdW5Py/hmbqa2Oo00GhpU1H/Sg='} 2023-10-26T03:13:25.877 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi169.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-10-26_02:25:12-upgrade:reef-x-main-distro-default-smithi/7438279', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-26 02:48:06.620117', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI+tKZ9cOdMHyh9pn7EY8zgHaLpJ4b5h+QyrwxdJDd97kbvqbF6P1pM2FDvqBbMmvVeuISy0sIj1jkd0rVSPNZ4='} 2023-10-26T03:13:25.910 INFO:teuthology.orchestra.console.smithi033:Power off 2023-10-26T03:13:25.911 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-26T03:13:25.932 DEBUG:teuthology.orchestra.console.smithi033:power off output: Chassis Power Control: Down/Off 2023-10-26T03:13:25.933 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-26T03:13:25.946 INFO:teuthology.orchestra.console.smithi169:Power off 2023-10-26T03:13:25.946 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-26T03:13:25.954 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off 2023-10-26T03:13:25.968 DEBUG:teuthology.orchestra.console.smithi169:power off output: Chassis Power Control: Down/Off 2023-10-26T03:13:25.969 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-26T03:13:25.995 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2023-10-26T03:13:26.056 INFO:teuthology.orchestra.console.smithi033:Power off completed 2023-10-26T03:13:26.097 INFO:teuthology.orchestra.console.smithi169:Power off completed 2023-10-26T03:13:26.211 INFO:teuthology.lock.ops:unlocked: smithi033.front.sepia.ceph.com 2023-10-26T03:13:26.244 INFO:teuthology.lock.ops:unlocked: smithi169.front.sepia.ceph.com