2023-10-20T12:32:42.520 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-20T12:32:42.522 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T12:32:42.649 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8f3cd71f70>, signals=[15]) 2023-10-20T12:32:42.651 INFO:teuthology.lock.ops:Start node 'smithi124.front.sepia.ceph.com' reimaging 2023-10-20T12:32:42.651 INFO:teuthology.lock.ops:Updating [smithi124.front.sepia.ceph.com]: reset os type and version on server 2023-10-20T12:32:42.652 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server 2023-10-20T12:32:42.678 INFO:teuthology.lock.ops:Start node 'smithi136.front.sepia.ceph.com' reimaging 2023-10-20T12:32:42.678 INFO:teuthology.lock.ops:Updating [smithi136.front.sepia.ceph.com]: reset os type and version on server 2023-10-20T12:32:42.678 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server 2023-10-20T12:32:42.680 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /host {"name": "smithi124"} 2023-10-20T12:32:42.702 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /host {"name": "smithi136"} 2023-10-20T12:32:42.756 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-10-20T12:32:42.764 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-10-20T12:32:42.799 DEBUG:teuthology.provision.fog.smithi124:Requesting image smithi_centos_8.stream (ID 3) 2023-10-20T12:32:42.799 DEBUG:teuthology.provision.fog.smithi124:FOG request: PUT /host/229 {"imageID": 3} 2023-10-20T12:32:42.808 DEBUG:teuthology.provision.fog.smithi136:Requesting image smithi_centos_8.stream (ID 3) 2023-10-20T12:32:42.808 DEBUG:teuthology.provision.fog.smithi136:FOG request: PUT /host/241 {"imageID": 3} 2023-10-20T12:32:42.848 INFO:teuthology.provision.fog.smithi124:Scheduling deploy of centos 8.stream 2023-10-20T12:32:42.848 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-20T12:32:42.856 INFO:teuthology.provision.fog.smithi136:Scheduling deploy of centos 8.stream 2023-10-20T12:32:42.857 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-10-20T12:32:42.904 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /tasktype {"name": "deploy"} 2023-10-20T12:32:42.919 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /tasktype {"name": "deploy"} 2023-10-20T12:32:42.940 DEBUG:teuthology.provision.fog.smithi124:FOG request: POST /host/229/task {"taskTypeID": 1} 2023-10-20T12:32:42.955 DEBUG:teuthology.provision.fog.smithi136:FOG request: POST /host/241/task {"taskTypeID": 1} 2023-10-20T12:32:42.992 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-20T12:32:43.011 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-10-20T12:32:43.084 INFO:teuthology.orchestra.console.smithi124:Power off 2023-10-20T12:32:43.085 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-20T12:32:43.099 INFO:teuthology.orchestra.console.smithi136:Power off 2023-10-20T12:32:43.099 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-20T12:32:43.108 DEBUG:teuthology.orchestra.console.smithi124:power off output: Chassis Power Control: Down/Off 2023-10-20T12:32:43.108 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T12:32:43.121 DEBUG:teuthology.orchestra.console.smithi136:power off output: Chassis Power Control: Down/Off 2023-10-20T12:32:43.122 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T12:32:43.131 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on 2023-10-20T12:32:43.144 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on 2023-10-20T12:32:47.134 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T12:32:47.145 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T12:32:47.244 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on 2023-10-20T12:32:47.255 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on 2023-10-20T12:32:51.246 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T12:32:51.256 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T12:32:51.356 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on 2023-10-20T12:32:51.364 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on 2023-10-20T12:32:55.359 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T12:32:55.366 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T12:32:55.468 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off 2023-10-20T12:32:55.474 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off 2023-10-20T12:32:55.570 INFO:teuthology.orchestra.console.smithi124:Power off completed 2023-10-20T12:32:55.576 INFO:teuthology.orchestra.console.smithi136:Power off completed 2023-10-20T12:32:55.671 INFO:teuthology.orchestra.console.smithi124:Power on 2023-10-20T12:32:55.672 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-20T12:32:55.679 INFO:teuthology.orchestra.console.smithi136:Power on 2023-10-20T12:32:55.679 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-20T12:32:55.696 DEBUG:teuthology.orchestra.console.smithi124:power on output: Chassis Power Control: Up/On 2023-10-20T12:32:55.697 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T12:32:55.705 DEBUG:teuthology.orchestra.console.smithi136:power on output: Chassis Power Control: Up/On 2023-10-20T12:32:55.706 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T12:32:55.717 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off 2023-10-20T12:32:55.729 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off 2023-10-20T12:32:59.722 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T12:32:59.730 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T12:32:59.833 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off 2023-10-20T12:32:59.840 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on 2023-10-20T12:32:59.941 INFO:teuthology.orchestra.console.smithi136:Power on completed 2023-10-20T12:33:00.042 INFO:teuthology.provision.fog.smithi136:Waiting for deploy to finish 2023-10-20T12:33:00.043 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-10-20T12:33:03.838 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T12:33:03.947 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on 2023-10-20T12:33:04.048 INFO:teuthology.orchestra.console.smithi124:Power on completed 2023-10-20T12:33:04.149 INFO:teuthology.provision.fog.smithi124:Waiting for deploy to finish 2023-10-20T12:33:04.149 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-20T12:33:15.122 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-10-20T12:33:19.222 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-20T12:33:30.206 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-10-20T12:33:34.283 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-20T12:33:45.281 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-10-20T12:33:49.353 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-20T12:34:00.350 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-10-20T12:34:04.414 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-20T12:34:15.430 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-10-20T12:34:19.478 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-20T12:34:30.500 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-10-20T12:34:34.534 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-20T12:34:45.558 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-10-20T12:34:49.602 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-20T12:35:00.642 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-10-20T12:35:04.810 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-20T12:35:15.722 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-10-20T12:35:19.882 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-20T12:35:30.794 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-10-20T12:35:34.966 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-20T12:35:35.033 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T12:35:35.124 ERROR:teuthology.orchestra.connection:Error authenticating with smithi124.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-10-20T12:35:45.857 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-10-20T12:35:45.913 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T12:35:49.499 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-10-20T12:35:55.501 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T12:35:58.558 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-10-20T12:36:04.350 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2023-10-20T12:36:04.560 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T12:36:07.614 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-10-20T12:36:10.352 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T12:36:13.402 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2023-10-20T12:36:13.616 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T12:36:16.702 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-10-20T12:36:19.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T12:36:22.458 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2023-10-20T12:36:22.704 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T12:36:25.754 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-10-20T12:36:28.460 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T12:36:31.517 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2023-10-20T12:36:31.756 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T12:36:34.810 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-10-20T12:36:37.518 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T12:36:40.811 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T12:37:37.520 WARNING:teuthology.provision.fog.smithi136:timed out 2023-10-20T12:37:40.813 WARNING:teuthology.provision.fog.smithi124:timed out 2023-10-20T12:37:43.523 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T12:37:43.816 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-20T12:37:43.817 DEBUG:teuthology.orchestra.run.smithi136:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-20T12:37:44.101 INFO:teuthology.provision.fog.smithi136:Node is ready 2023-10-20T12:37:44.101 DEBUG:teuthology.orchestra.run.smithi136:> hostname 2023-10-20T12:37:44.122 INFO:teuthology.orchestra.run.smithi136.stdout:smithi136.front.sepia.ceph.com 2023-10-20T12:37:44.123 DEBUG:teuthology.orchestra.run.smithi136:> grep smithi136.front.sepia.ceph.com /etc/hosts 2023-10-20T12:37:44.183 INFO:teuthology.orchestra.run.smithi136.stdout:172.21.15.136 smithi136.front.sepia.ceph.com smithi136 2023-10-20T12:37:44.183 DEBUG:teuthology.orchestra.run.smithi136:> sudo hostname smithi136 2023-10-20T12:37:44.286 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/smithi136.front.sepia.ceph.com/smithi136/g' /etc/hosts 2023-10-20T12:37:44.315 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/172.21.15.136/172.21.15.136/g' /etc/hosts 2023-10-20T12:37:44.385 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/smithi136.front.sepia.ceph.com/smithi136/g' /etc/hostname 2023-10-20T12:37:44.455 DEBUG:teuthology.orchestra.run.smithi136:> sudo hostname smithi136 2023-10-20T12:37:44.522 DEBUG:teuthology.orchestra.run.smithi136:> cat /etc/os-release 2023-10-20T12:37:44.581 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="CentOS Stream" 2023-10-20T12:37:44.581 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="8" 2023-10-20T12:37:44.581 INFO:teuthology.orchestra.run.smithi136.stdout:ID="centos" 2023-10-20T12:37:44.582 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE="rhel fedora" 2023-10-20T12:37:44.582 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="8" 2023-10-20T12:37:44.582 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM_ID="platform:el8" 2023-10-20T12:37:44.582 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-20T12:37:44.582 INFO:teuthology.orchestra.run.smithi136.stdout:ANSI_COLOR="0;31" 2023-10-20T12:37:44.583 INFO:teuthology.orchestra.run.smithi136.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-20T12:37:44.583 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://centos.org/" 2023-10-20T12:37:44.583 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-20T12:37:44.583 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-20T12:37:44.584 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-20T12:37:44.584 INFO:teuthology.provision.fog.smithi136:Deploy complete! 2023-10-20T12:37:44.586 DEBUG:teuthology.parallel:result is None 2023-10-20T12:37:46.816 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T12:37:47.048 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-20T12:37:47.049 DEBUG:teuthology.orchestra.run.smithi124:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-20T12:37:47.311 INFO:teuthology.provision.fog.smithi124:Node is ready 2023-10-20T12:37:47.311 DEBUG:teuthology.orchestra.run.smithi124:> hostname 2023-10-20T12:37:47.332 INFO:teuthology.orchestra.run.smithi124.stdout:smithi124.front.sepia.ceph.com 2023-10-20T12:37:47.333 DEBUG:teuthology.orchestra.run.smithi124:> grep smithi124.front.sepia.ceph.com /etc/hosts 2023-10-20T12:37:47.395 INFO:teuthology.orchestra.run.smithi124.stdout:172.21.15.124 smithi124.front.sepia.ceph.com smithi124 2023-10-20T12:37:47.395 DEBUG:teuthology.orchestra.run.smithi124:> sudo hostname smithi124 2023-10-20T12:37:47.496 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/smithi124.front.sepia.ceph.com/smithi124/g' /etc/hosts 2023-10-20T12:37:47.531 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/172.21.15.124/172.21.15.124/g' /etc/hosts 2023-10-20T12:37:47.603 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/smithi124.front.sepia.ceph.com/smithi124/g' /etc/hostname 2023-10-20T12:37:47.676 DEBUG:teuthology.orchestra.run.smithi124:> sudo hostname smithi124 2023-10-20T12:37:47.749 DEBUG:teuthology.orchestra.run.smithi124:> cat /etc/os-release 2023-10-20T12:37:47.811 INFO:teuthology.orchestra.run.smithi124.stdout:NAME="CentOS Stream" 2023-10-20T12:37:47.812 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION="8" 2023-10-20T12:37:47.812 INFO:teuthology.orchestra.run.smithi124.stdout:ID="centos" 2023-10-20T12:37:47.812 INFO:teuthology.orchestra.run.smithi124.stdout:ID_LIKE="rhel fedora" 2023-10-20T12:37:47.812 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_ID="8" 2023-10-20T12:37:47.812 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM_ID="platform:el8" 2023-10-20T12:37:47.813 INFO:teuthology.orchestra.run.smithi124.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-20T12:37:47.813 INFO:teuthology.orchestra.run.smithi124.stdout:ANSI_COLOR="0;31" 2023-10-20T12:37:47.813 INFO:teuthology.orchestra.run.smithi124.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-20T12:37:47.813 INFO:teuthology.orchestra.run.smithi124.stdout:HOME_URL="https://centos.org/" 2023-10-20T12:37:47.814 INFO:teuthology.orchestra.run.smithi124.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-20T12:37:47.814 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-20T12:37:47.814 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-20T12:37:47.814 INFO:teuthology.provision.fog.smithi124:Deploy complete! 2023-10-20T12:37:47.815 DEBUG:teuthology.parallel:result is None 2023-10-20T12:37:47.967 INFO:teuthology.lock.ops:Checking smithi124.front.sepia.ceph.com 2023-10-20T12:37:47.968 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-20T12:37:47.990 INFO:teuthology.lock.ops:Checking smithi136.front.sepia.ceph.com 2023-10-20T12:37:47.991 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-20T12:37:48.008 INFO:teuthology.lock.ops:Updating [smithi124.front.sepia.ceph.com]: set os type and version on server 2023-10-20T12:37:48.008 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-10-20T12:37:48.009 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T12:37:48.077 DEBUG:teuthology.orchestra.run.smithi124:> true 2023-10-20T12:37:48.145 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-10-20T12:37:48.146 DEBUG:teuthology.orchestra.run.smithi124:> uname -m 2023-10-20T12:37:48.205 INFO:teuthology.orchestra.run.smithi124.stdout:x86_64 2023-10-20T12:37:48.205 DEBUG:teuthology.orchestra.run.smithi124:> cat /etc/os-release 2023-10-20T12:37:48.264 INFO:teuthology.orchestra.run.smithi124.stdout:NAME="CentOS Stream" 2023-10-20T12:37:48.265 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION="8" 2023-10-20T12:37:48.265 INFO:teuthology.orchestra.run.smithi124.stdout:ID="centos" 2023-10-20T12:37:48.265 INFO:teuthology.orchestra.run.smithi124.stdout:ID_LIKE="rhel fedora" 2023-10-20T12:37:48.265 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_ID="8" 2023-10-20T12:37:48.266 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM_ID="platform:el8" 2023-10-20T12:37:48.266 INFO:teuthology.orchestra.run.smithi124.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-20T12:37:48.266 INFO:teuthology.orchestra.run.smithi124.stdout:ANSI_COLOR="0;31" 2023-10-20T12:37:48.266 INFO:teuthology.orchestra.run.smithi124.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-20T12:37:48.266 INFO:teuthology.orchestra.run.smithi124.stdout:HOME_URL="https://centos.org/" 2023-10-20T12:37:48.267 INFO:teuthology.orchestra.run.smithi124.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-20T12:37:48.267 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-20T12:37:48.267 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-20T12:37:48.268 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server 2023-10-20T12:37:48.290 INFO:teuthology.lock.ops:Updating [smithi136.front.sepia.ceph.com]: set os type and version on server 2023-10-20T12:37:48.291 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2023-10-20T12:37:48.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T12:37:48.357 DEBUG:teuthology.orchestra.run.smithi136:> true 2023-10-20T12:37:48.427 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi136.front.sepia.ceph.com' 2023-10-20T12:37:48.427 DEBUG:teuthology.orchestra.run.smithi136:> uname -m 2023-10-20T12:37:48.488 INFO:teuthology.orchestra.run.smithi136.stdout:x86_64 2023-10-20T12:37:48.489 DEBUG:teuthology.orchestra.run.smithi136:> cat /etc/os-release 2023-10-20T12:37:48.549 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="CentOS Stream" 2023-10-20T12:37:48.550 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="8" 2023-10-20T12:37:48.550 INFO:teuthology.orchestra.run.smithi136.stdout:ID="centos" 2023-10-20T12:37:48.550 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE="rhel fedora" 2023-10-20T12:37:48.550 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="8" 2023-10-20T12:37:48.550 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM_ID="platform:el8" 2023-10-20T12:37:48.551 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-20T12:37:48.551 INFO:teuthology.orchestra.run.smithi136.stdout:ANSI_COLOR="0;31" 2023-10-20T12:37:48.551 INFO:teuthology.orchestra.run.smithi136.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-20T12:37:48.551 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://centos.org/" 2023-10-20T12:37:48.551 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-20T12:37:48.552 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-20T12:37:48.552 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-20T12:37:48.552 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server 2023-10-20T12:37:48.574 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T12:37:48.669 INFO:teuthology.dispatcher.supervisor:Running job 7427600 2023-10-20T12:37:48.670 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2023-10-14_14:23:11-upgrade:pacific-x-reef-distro-default-smithi/7427600 --name teuthology-2023-10-14_14:23:11-upgrade:pacific-x-reef-distro-default-smithi --description upgrade:pacific-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} -- /home/teuthworker/archive/teuthology-2023-10-14_14:23:11-upgrade:pacific-x-reef-distro-default-smithi/7427600/orig.config.yaml 2023-10-20T12:37:48.673 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2023-10-14_14:23:11-upgrade:pacific-x-reef-distro-default-smithi/7427600 2023-10-20T12:37:48.673 INFO:teuthology.dispatcher.supervisor:Job PID: 1876837 2023-10-20T12:37:48.674 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-20T12:39:48.675 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T12:41:48.743 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T12:43:48.810 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T12:45:48.883 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T12:47:48.948 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T12:49:49.023 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T12:51:49.104 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T12:53:49.173 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T12:55:49.241 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T12:57:49.317 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T12:59:49.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:01:49.450 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:03:49.508 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:05:49.576 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:07:49.639 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:09:49.702 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:11:49.765 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:13:49.839 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:15:49.909 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:17:49.976 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:19:50.050 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:21:50.112 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:23:50.187 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:25:50.259 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:27:50.323 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:29:50.389 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:31:50.451 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:33:50.517 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:35:50.589 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:37:50.654 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:39:50.718 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:41:50.774 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:43:50.845 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:45:50.910 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:47:53.567 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:49:53.621 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:51:53.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:53:53.753 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:55:53.825 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:57:53.890 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:59:53.954 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T14:01:54.043 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T14:01:54.101 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-20T14:01:54.294 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-20T14:01:54.295 INFO:teuthology.nuke:Checking targets against current locks 2023-10-20T14:01:54.348 DEBUG:teuthology.nuke:shortname: smithi124 2023-10-20T14:01:54.349 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-20T14:01:54.369 DEBUG:teuthology.nuke:shortname: smithi136 2023-10-20T14:01:54.369 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-20T14:01:54.373 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi124.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-10-14_14:23:11-upgrade:pacific-x-reef-distro-default-smithi/7427600', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-20 12:32:41.458640', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBItCIFPP/7TItjTBAQxcQMRt1vxOAt48QmYpNwC2sw11kvFU474tMOMOAoM/msAplG2Zs7am6mLErHb1PL6XGgY='} 2023-10-20T14:01:54.400 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi136.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-10-14_14:23:11-upgrade:pacific-x-reef-distro-default-smithi/7427600', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-20 12:32:41.460383', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBeiFWck9if9pmEfzeLf5zuAceJIDX4NvPLvYC6hvmZOUIlIQwn6ybuT8m3kGaEN9Z+LqCr9iQgKvc9tLOOtygE='} 2023-10-20T14:01:54.429 INFO:teuthology.orchestra.console.smithi124:Power off 2023-10-20T14:01:54.430 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-20T14:01:54.451 DEBUG:teuthology.orchestra.console.smithi124:power off output: Chassis Power Control: Down/Off 2023-10-20T14:01:54.451 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T14:01:54.465 INFO:teuthology.orchestra.console.smithi136:Power off 2023-10-20T14:01:54.465 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-20T14:01:54.474 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off 2023-10-20T14:01:54.486 DEBUG:teuthology.orchestra.console.smithi136:power off output: Chassis Power Control: Down/Off 2023-10-20T14:01:54.486 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T14:01:54.510 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off 2023-10-20T14:01:54.575 INFO:teuthology.orchestra.console.smithi124:Power off completed 2023-10-20T14:01:54.611 INFO:teuthology.orchestra.console.smithi136:Power off completed 2023-10-20T14:01:54.725 INFO:teuthology.lock.ops:unlocked: smithi124.front.sepia.ceph.com 2023-10-20T14:01:54.758 INFO:teuthology.lock.ops:unlocked: smithi136.front.sepia.ceph.com