2023-10-20T12:12:14.740 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-20T12:12:14.741 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T12:12:14.889 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f220076bf70>, signals=[15]) 2023-10-20T12:12:14.891 INFO:teuthology.lock.ops:Start node 'smithi045.front.sepia.ceph.com' reimaging 2023-10-20T12:12:14.891 INFO:teuthology.lock.ops:Updating [smithi045.front.sepia.ceph.com]: reset os type and version on server 2023-10-20T12:12:14.891 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server 2023-10-20T12:12:14.917 INFO:teuthology.lock.ops:Start node 'smithi105.front.sepia.ceph.com' reimaging 2023-10-20T12:12:14.917 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: reset os type and version on server 2023-10-20T12:12:14.917 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server 2023-10-20T12:12:14.919 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /host {"name": "smithi045"} 2023-10-20T12:12:14.941 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /host {"name": "smithi105"} 2023-10-20T12:12:14.993 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-10-20T12:12:15.018 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-10-20T12:12:15.042 DEBUG:teuthology.provision.fog.smithi045:Requesting image smithi_centos_8.stream (ID 3) 2023-10-20T12:12:15.042 DEBUG:teuthology.provision.fog.smithi045:FOG request: PUT /host/150 {"imageID": 3} 2023-10-20T12:12:15.057 DEBUG:teuthology.provision.fog.smithi105:Requesting image smithi_centos_8.stream (ID 3) 2023-10-20T12:12:15.058 DEBUG:teuthology.provision.fog.smithi105:FOG request: PUT /host/210 {"imageID": 3} 2023-10-20T12:12:15.098 INFO:teuthology.provision.fog.smithi045:Scheduling deploy of centos 8.stream 2023-10-20T12:12:15.099 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-10-20T12:12:15.103 INFO:teuthology.provision.fog.smithi105:Scheduling deploy of centos 8.stream 2023-10-20T12:12:15.104 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-10-20T12:12:15.147 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /tasktype {"name": "deploy"} 2023-10-20T12:12:15.151 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /tasktype {"name": "deploy"} 2023-10-20T12:12:15.182 DEBUG:teuthology.provision.fog.smithi105:FOG request: POST /host/210/task {"taskTypeID": 1} 2023-10-20T12:12:15.185 DEBUG:teuthology.provision.fog.smithi045:FOG request: POST /host/150/task {"taskTypeID": 1} 2023-10-20T12:12:15.237 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-10-20T12:12:15.240 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-10-20T12:12:15.326 INFO:teuthology.orchestra.console.smithi045:Power off 2023-10-20T12:12:15.327 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-20T12:12:15.340 INFO:teuthology.orchestra.console.smithi105:Power off 2023-10-20T12:12:15.341 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-20T12:12:15.349 DEBUG:teuthology.orchestra.console.smithi045:power off output: Chassis Power Control: Down/Off 2023-10-20T12:12:15.350 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T12:12:15.362 DEBUG:teuthology.orchestra.console.smithi105:power off output: Chassis Power Control: Down/Off 2023-10-20T12:12:15.363 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T12:12:15.372 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is on 2023-10-20T12:12:15.384 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on 2023-10-20T12:12:19.374 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T12:12:19.385 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T12:12:19.483 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is on 2023-10-20T12:12:19.495 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on 2023-10-20T12:12:23.488 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T12:12:23.496 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T12:12:23.597 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is off 2023-10-20T12:12:23.605 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off 2023-10-20T12:12:23.698 INFO:teuthology.orchestra.console.smithi045:Power off completed 2023-10-20T12:12:23.706 INFO:teuthology.orchestra.console.smithi105:Power off completed 2023-10-20T12:12:23.800 INFO:teuthology.orchestra.console.smithi045:Power on 2023-10-20T12:12:23.800 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-20T12:12:23.807 INFO:teuthology.orchestra.console.smithi105:Power on 2023-10-20T12:12:23.808 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-20T12:12:23.825 DEBUG:teuthology.orchestra.console.smithi045:power on output: Chassis Power Control: Up/On 2023-10-20T12:12:23.826 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T12:12:23.833 DEBUG:teuthology.orchestra.console.smithi105:power on output: Chassis Power Control: Up/On 2023-10-20T12:12:23.834 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T12:12:23.850 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is off 2023-10-20T12:12:23.857 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off 2023-10-20T12:12:27.854 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T12:12:27.861 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T12:12:27.963 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is off 2023-10-20T12:12:27.968 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off 2023-10-20T12:12:31.968 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T12:12:31.975 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T12:12:32.078 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is on 2023-10-20T12:12:32.177 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on 2023-10-20T12:12:32.179 INFO:teuthology.orchestra.console.smithi045:Power on completed 2023-10-20T12:12:32.278 INFO:teuthology.orchestra.console.smithi105:Power on completed 2023-10-20T12:12:32.281 INFO:teuthology.provision.fog.smithi045:Waiting for deploy to finish 2023-10-20T12:12:32.281 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-10-20T12:12:32.379 INFO:teuthology.provision.fog.smithi105:Waiting for deploy to finish 2023-10-20T12:12:32.379 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-10-20T12:12:47.352 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-10-20T12:12:47.433 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-10-20T12:13:02.434 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-10-20T12:13:02.495 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-10-20T12:13:17.502 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-10-20T12:13:17.545 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-10-20T12:13:32.590 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-10-20T12:13:32.604 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-10-20T12:13:47.667 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-10-20T12:13:47.669 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-10-20T12:14:02.738 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-10-20T12:14:02.740 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-10-20T12:14:17.810 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-10-20T12:14:17.812 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-10-20T12:14:32.883 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-10-20T12:14:32.885 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-10-20T12:14:47.950 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-10-20T12:14:47.952 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-10-20T12:15:03.019 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-10-20T12:15:03.020 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-10-20T12:15:03.071 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T12:15:03.074 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T12:15:21.470 WARNING:teuthology.provision.fog.smithi045:[Errno None] Unable to connect to port 22 on 172.21.15.45 2023-10-20T12:15:21.472 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2023-10-20T12:15:27.481 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T12:15:27.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T12:15:30.554 WARNING:teuthology.provision.fog.smithi045:[Errno None] Unable to connect to port 22 on 172.21.15.45 2023-10-20T12:15:30.555 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2023-10-20T12:15:36.562 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T12:15:36.564 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T12:15:39.642 WARNING:teuthology.provision.fog.smithi045:[Errno None] Unable to connect to port 22 on 172.21.15.45 2023-10-20T12:15:39.643 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2023-10-20T12:15:45.647 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T12:15:45.648 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T12:15:48.698 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2023-10-20T12:15:48.699 WARNING:teuthology.provision.fog.smithi045:[Errno None] Unable to connect to port 22 on 172.21.15.45 2023-10-20T12:15:54.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T12:15:54.704 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T12:15:57.754 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2023-10-20T12:16:03.763 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T12:16:54.755 WARNING:teuthology.provision.fog.smithi045:timed out 2023-10-20T12:17:00.763 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T12:17:00.996 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-20T12:17:00.997 DEBUG:teuthology.orchestra.run.smithi045:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-20T12:17:01.229 INFO:teuthology.provision.fog.smithi045:Node is ready 2023-10-20T12:17:01.230 DEBUG:teuthology.orchestra.run.smithi045:> hostname 2023-10-20T12:17:01.290 INFO:teuthology.orchestra.run.smithi045.stdout:smithi045.front.sepia.ceph.com 2023-10-20T12:17:01.290 DEBUG:teuthology.orchestra.run.smithi045:> grep smithi045.front.sepia.ceph.com /etc/hosts 2023-10-20T12:17:01.350 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45 smithi045.front.sepia.ceph.com smithi045 2023-10-20T12:17:01.350 DEBUG:teuthology.orchestra.run.smithi045:> sudo hostname smithi045 2023-10-20T12:17:01.449 DEBUG:teuthology.orchestra.run.smithi045:> sudo sed -i -e 's/smithi045.front.sepia.ceph.com/smithi045/g' /etc/hosts 2023-10-20T12:17:01.480 DEBUG:teuthology.orchestra.run.smithi045:> sudo sed -i -e 's/172.21.15.45/172.21.15.45/g' /etc/hosts 2023-10-20T12:17:01.550 DEBUG:teuthology.orchestra.run.smithi045:> sudo sed -i -e 's/smithi045.front.sepia.ceph.com/smithi045/g' /etc/hostname 2023-10-20T12:17:01.619 DEBUG:teuthology.orchestra.run.smithi045:> sudo hostname smithi045 2023-10-20T12:17:01.688 DEBUG:teuthology.orchestra.run.smithi045:> cat /etc/os-release 2023-10-20T12:17:01.746 INFO:teuthology.orchestra.run.smithi045.stdout:NAME="CentOS Stream" 2023-10-20T12:17:01.747 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION="8" 2023-10-20T12:17:01.747 INFO:teuthology.orchestra.run.smithi045.stdout:ID="centos" 2023-10-20T12:17:01.747 INFO:teuthology.orchestra.run.smithi045.stdout:ID_LIKE="rhel fedora" 2023-10-20T12:17:01.747 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION_ID="8" 2023-10-20T12:17:01.748 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM_ID="platform:el8" 2023-10-20T12:17:01.748 INFO:teuthology.orchestra.run.smithi045.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-20T12:17:01.748 INFO:teuthology.orchestra.run.smithi045.stdout:ANSI_COLOR="0;31" 2023-10-20T12:17:01.748 INFO:teuthology.orchestra.run.smithi045.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-20T12:17:01.748 INFO:teuthology.orchestra.run.smithi045.stdout:HOME_URL="https://centos.org/" 2023-10-20T12:17:01.749 INFO:teuthology.orchestra.run.smithi045.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-20T12:17:01.749 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-20T12:17:01.749 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-20T12:17:01.750 INFO:teuthology.provision.fog.smithi045:Deploy complete! 2023-10-20T12:17:01.751 DEBUG:teuthology.parallel:result is None 2023-10-20T12:17:03.768 WARNING:teuthology.provision.fog.smithi105:timed out 2023-10-20T12:17:09.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T12:17:10.031 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-20T12:17:10.032 DEBUG:teuthology.orchestra.run.smithi105:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-20T12:17:10.276 INFO:teuthology.provision.fog.smithi105:Node is ready 2023-10-20T12:17:10.276 DEBUG:teuthology.orchestra.run.smithi105:> hostname 2023-10-20T12:17:10.296 INFO:teuthology.orchestra.run.smithi105.stdout:smithi105.front.sepia.ceph.com 2023-10-20T12:17:10.296 DEBUG:teuthology.orchestra.run.smithi105:> grep smithi105.front.sepia.ceph.com /etc/hosts 2023-10-20T12:17:10.356 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.15.105 smithi105.front.sepia.ceph.com smithi105 2023-10-20T12:17:10.356 DEBUG:teuthology.orchestra.run.smithi105:> sudo hostname smithi105 2023-10-20T12:17:10.477 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/smithi105.front.sepia.ceph.com/smithi105/g' /etc/hosts 2023-10-20T12:17:10.507 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/172.21.15.105/172.21.15.105/g' /etc/hosts 2023-10-20T12:17:10.576 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/smithi105.front.sepia.ceph.com/smithi105/g' /etc/hostname 2023-10-20T12:17:10.645 DEBUG:teuthology.orchestra.run.smithi105:> sudo hostname smithi105 2023-10-20T12:17:10.711 DEBUG:teuthology.orchestra.run.smithi105:> cat /etc/os-release 2023-10-20T12:17:10.770 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="CentOS Stream" 2023-10-20T12:17:10.770 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="8" 2023-10-20T12:17:10.771 INFO:teuthology.orchestra.run.smithi105.stdout:ID="centos" 2023-10-20T12:17:10.771 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="rhel fedora" 2023-10-20T12:17:10.771 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="8" 2023-10-20T12:17:10.771 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el8" 2023-10-20T12:17:10.772 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-20T12:17:10.772 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31" 2023-10-20T12:17:10.772 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-20T12:17:10.772 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://centos.org/" 2023-10-20T12:17:10.772 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-20T12:17:10.773 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-20T12:17:10.773 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-20T12:17:10.774 INFO:teuthology.provision.fog.smithi105:Deploy complete! 2023-10-20T12:17:10.774 DEBUG:teuthology.parallel:result is None 2023-10-20T12:17:10.923 INFO:teuthology.lock.ops:Checking smithi045.front.sepia.ceph.com 2023-10-20T12:17:10.924 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-20T12:17:10.948 INFO:teuthology.lock.ops:Checking smithi105.front.sepia.ceph.com 2023-10-20T12:17:10.948 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-20T12:17:10.973 INFO:teuthology.lock.ops:Updating [smithi045.front.sepia.ceph.com]: set os type and version on server 2023-10-20T12:17:10.974 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-10-20T12:17:10.977 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T12:17:11.045 DEBUG:teuthology.orchestra.run.smithi045:> true 2023-10-20T12:17:11.116 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-10-20T12:17:11.116 DEBUG:teuthology.orchestra.run.smithi045:> uname -m 2023-10-20T12:17:11.177 INFO:teuthology.orchestra.run.smithi045.stdout:x86_64 2023-10-20T12:17:11.177 DEBUG:teuthology.orchestra.run.smithi045:> cat /etc/os-release 2023-10-20T12:17:11.239 INFO:teuthology.orchestra.run.smithi045.stdout:NAME="CentOS Stream" 2023-10-20T12:17:11.239 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION="8" 2023-10-20T12:17:11.239 INFO:teuthology.orchestra.run.smithi045.stdout:ID="centos" 2023-10-20T12:17:11.240 INFO:teuthology.orchestra.run.smithi045.stdout:ID_LIKE="rhel fedora" 2023-10-20T12:17:11.240 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION_ID="8" 2023-10-20T12:17:11.240 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM_ID="platform:el8" 2023-10-20T12:17:11.240 INFO:teuthology.orchestra.run.smithi045.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-20T12:17:11.240 INFO:teuthology.orchestra.run.smithi045.stdout:ANSI_COLOR="0;31" 2023-10-20T12:17:11.240 INFO:teuthology.orchestra.run.smithi045.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-20T12:17:11.241 INFO:teuthology.orchestra.run.smithi045.stdout:HOME_URL="https://centos.org/" 2023-10-20T12:17:11.241 INFO:teuthology.orchestra.run.smithi045.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-20T12:17:11.241 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-20T12:17:11.241 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-20T12:17:11.242 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server 2023-10-20T12:17:11.264 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: set os type and version on server 2023-10-20T12:17:11.265 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com' 2023-10-20T12:17:11.265 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T12:17:11.331 DEBUG:teuthology.orchestra.run.smithi105:> true 2023-10-20T12:17:11.355 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi105.front.sepia.ceph.com' 2023-10-20T12:17:11.356 DEBUG:teuthology.orchestra.run.smithi105:> uname -m 2023-10-20T12:17:11.414 INFO:teuthology.orchestra.run.smithi105.stdout:x86_64 2023-10-20T12:17:11.414 DEBUG:teuthology.orchestra.run.smithi105:> cat /etc/os-release 2023-10-20T12:17:11.471 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="CentOS Stream" 2023-10-20T12:17:11.472 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="8" 2023-10-20T12:17:11.472 INFO:teuthology.orchestra.run.smithi105.stdout:ID="centos" 2023-10-20T12:17:11.472 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="rhel fedora" 2023-10-20T12:17:11.472 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="8" 2023-10-20T12:17:11.473 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el8" 2023-10-20T12:17:11.473 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-20T12:17:11.473 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31" 2023-10-20T12:17:11.473 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-20T12:17:11.473 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://centos.org/" 2023-10-20T12:17:11.474 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-20T12:17:11.474 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-20T12:17:11.474 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-20T12:17:11.474 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server 2023-10-20T12:17:11.498 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T12:17:11.597 INFO:teuthology.dispatcher.supervisor:Running job 7427588 2023-10-20T12:17:11.598 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2023-10-14_14:23:11-upgrade:pacific-x-reef-distro-default-smithi/7427588 --name teuthology-2023-10-14_14:23:11-upgrade:pacific-x-reef-distro-default-smithi --description upgrade:pacific-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} -- /home/teuthworker/archive/teuthology-2023-10-14_14:23:11-upgrade:pacific-x-reef-distro-default-smithi/7427588/orig.config.yaml 2023-10-20T12:17:11.601 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2023-10-14_14:23:11-upgrade:pacific-x-reef-distro-default-smithi/7427588 2023-10-20T12:17:11.602 INFO:teuthology.dispatcher.supervisor:Job PID: 1762239 2023-10-20T12:17:11.602 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-20T12:19:11.703 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T12:21:11.867 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T12:23:12.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T12:25:12.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T12:27:12.363 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T12:29:12.527 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T12:31:12.703 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T12:33:12.859 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T12:35:13.023 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T12:37:13.191 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T12:39:13.355 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T12:41:13.531 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T12:43:13.695 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T12:45:13.851 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T12:47:14.019 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T12:49:14.187 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T12:51:14.345 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T12:53:14.503 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T12:55:14.606 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T12:57:14.778 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T12:59:14.939 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:01:15.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:03:15.273 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:05:15.441 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:07:15.607 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:09:15.763 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:11:15.927 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:13:16.093 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:15:16.267 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:17:16.439 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:19:16.607 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:21:16.775 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:23:16.939 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:25:17.112 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:27:17.277 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:29:17.443 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:31:17.606 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:33:17.774 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:35:17.943 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:37:18.117 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:39:18.278 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:41:18.433 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:43:18.603 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:45:18.751 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:47:18.910 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:49:19.091 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:49:19.159 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-20T13:49:19.356 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-20T13:49:19.356 INFO:teuthology.nuke:Checking targets against current locks 2023-10-20T13:49:19.407 DEBUG:teuthology.nuke:shortname: smithi045 2023-10-20T13:49:19.407 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-20T13:49:19.424 DEBUG:teuthology.nuke:shortname: smithi105 2023-10-20T13:49:19.424 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-20T13:49:19.431 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi045.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-10-14_14:23:11-upgrade:pacific-x-reef-distro-default-smithi/7427588', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-20 12:12:13.928020', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC/TqQd5f8G9l3m7sbHxmX/FRPomWnHXXvlsCfIV7zCUugS1VqRM2y0Jki4jRz7F/U/sZmUBD3KmONg5NnCH3q8='} 2023-10-20T13:49:19.447 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi105.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-10-14_14:23:11-upgrade:pacific-x-reef-distro-default-smithi/7427588', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-20 12:12:13.929561', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFYliDq/XqAD48222kaGOfKQo3H1pIuQ5WScbGxhMeRVdVbNQt+Gd/f7kydc5wg9bSyDuihPFPuhQIYJD73KYZM='} 2023-10-20T13:49:19.478 INFO:teuthology.orchestra.console.smithi045:Power off 2023-10-20T13:49:19.479 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-20T13:49:19.496 INFO:teuthology.orchestra.console.smithi105:Power off 2023-10-20T13:49:19.496 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-20T13:49:19.504 DEBUG:teuthology.orchestra.console.smithi045:power off output: Chassis Power Control: Down/Off 2023-10-20T13:49:19.504 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T13:49:19.516 DEBUG:teuthology.orchestra.console.smithi105:power off output: Chassis Power Control: Down/Off 2023-10-20T13:49:19.516 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T13:49:19.526 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is off 2023-10-20T13:49:19.538 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off 2023-10-20T13:49:19.627 INFO:teuthology.orchestra.console.smithi045:Power off completed 2023-10-20T13:49:19.639 INFO:teuthology.orchestra.console.smithi105:Power off completed 2023-10-20T13:49:19.773 INFO:teuthology.lock.ops:unlocked: smithi045.front.sepia.ceph.com 2023-10-20T13:49:19.790 INFO:teuthology.lock.ops:unlocked: smithi105.front.sepia.ceph.com