2023-10-19T03:34:55.986 INFO:root:teuthology version: 0.0.1.dev201+g202b180 2023-10-19T03:34:55.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T03:34:56.136 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3aa579ce50>, signals=[15]) 2023-10-19T03:34:56.137 INFO:teuthology.lock.ops:Start node 'smithi032.front.sepia.ceph.com' reimaging 2023-10-19T03:34:56.138 INFO:teuthology.lock.ops:Updating [smithi032.front.sepia.ceph.com]: reset os type and version on server 2023-10-19T03:34:56.138 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server 2023-10-19T03:34:56.164 INFO:teuthology.lock.ops:Start node 'smithi194.front.sepia.ceph.com' reimaging 2023-10-19T03:34:56.165 INFO:teuthology.lock.ops:Updating [smithi194.front.sepia.ceph.com]: reset os type and version on server 2023-10-19T03:34:56.165 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server 2023-10-19T03:34:56.167 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /host {"name": "smithi032"} 2023-10-19T03:34:56.189 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /host {"name": "smithi194"} 2023-10-19T03:34:56.239 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-10-19T03:34:56.258 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-10-19T03:34:56.278 DEBUG:teuthology.provision.fog.smithi032:Requesting image smithi_rhel_8.6 (ID 5) 2023-10-19T03:34:56.279 DEBUG:teuthology.provision.fog.smithi032:FOG request: PUT /host/137 {"imageID": 5} 2023-10-19T03:34:56.308 DEBUG:teuthology.provision.fog.smithi194:Requesting image smithi_rhel_8.6 (ID 5) 2023-10-19T03:34:56.308 DEBUG:teuthology.provision.fog.smithi194:FOG request: PUT /host/299 {"imageID": 5} 2023-10-19T03:34:56.333 INFO:teuthology.provision.fog.smithi032:Scheduling deploy of rhel 8.6 2023-10-19T03:34:56.333 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-10-19T03:34:56.357 INFO:teuthology.provision.fog.smithi194:Scheduling deploy of rhel 8.6 2023-10-19T03:34:56.358 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-10-19T03:34:56.383 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /tasktype {"name": "deploy"} 2023-10-19T03:34:56.403 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /tasktype {"name": "deploy"} 2023-10-19T03:34:56.416 DEBUG:teuthology.provision.fog.smithi032:FOG request: POST /host/137/task {"taskTypeID": 1} 2023-10-19T03:34:56.436 DEBUG:teuthology.provision.fog.smithi194:FOG request: POST /host/299/task {"taskTypeID": 1} 2023-10-19T03:34:56.469 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-10-19T03:34:56.490 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-10-19T03:34:56.550 INFO:teuthology.orchestra.console.smithi032:Power off 2023-10-19T03:34:56.551 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-19T03:34:56.569 INFO:teuthology.orchestra.console.smithi194:Power off 2023-10-19T03:34:56.569 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-19T03:34:56.577 DEBUG:teuthology.orchestra.console.smithi032:power off output: Chassis Power Control: Down/Off 2023-10-19T03:34:56.578 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T03:34:56.589 DEBUG:teuthology.orchestra.console.smithi194:power off output: Chassis Power Control: Down/Off 2023-10-19T03:34:56.589 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T03:34:56.599 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is off 2023-10-19T03:34:56.613 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off 2023-10-19T03:34:56.700 INFO:teuthology.orchestra.console.smithi032:Power off completed 2023-10-19T03:34:56.714 INFO:teuthology.orchestra.console.smithi194:Power off completed 2023-10-19T03:34:56.802 INFO:teuthology.orchestra.console.smithi032:Power on 2023-10-19T03:34:56.802 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-19T03:34:56.816 INFO:teuthology.orchestra.console.smithi194:Power on 2023-10-19T03:34:56.816 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-19T03:34:56.831 DEBUG:teuthology.orchestra.console.smithi032:power on output: Chassis Power Control: Up/On 2023-10-19T03:34:56.832 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T03:34:56.840 DEBUG:teuthology.orchestra.console.smithi194:power on output: Chassis Power Control: Up/On 2023-10-19T03:34:56.841 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T03:34:56.858 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is off 2023-10-19T03:34:56.862 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off 2023-10-19T03:35:00.862 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T03:35:00.869 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T03:35:00.972 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is off 2023-10-19T03:35:00.982 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on 2023-10-19T03:35:01.083 INFO:teuthology.orchestra.console.smithi194:Power on completed 2023-10-19T03:35:01.184 INFO:teuthology.provision.fog.smithi194:Waiting for deploy to finish 2023-10-19T03:35:01.184 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-10-19T03:35:04.976 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T03:35:05.085 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is on 2023-10-19T03:35:05.186 INFO:teuthology.orchestra.console.smithi032:Power on completed 2023-10-19T03:35:05.287 INFO:teuthology.provision.fog.smithi032:Waiting for deploy to finish 2023-10-19T03:35:05.287 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-10-19T03:35:16.257 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-10-19T03:35:20.350 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-10-19T03:35:31.334 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-10-19T03:35:35.414 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-10-19T03:35:46.416 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-10-19T03:35:50.490 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-10-19T03:36:01.494 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-10-19T03:36:05.567 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-10-19T03:36:16.582 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-10-19T03:36:20.638 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-10-19T03:36:31.662 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-10-19T03:36:35.710 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-10-19T03:36:46.735 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-10-19T03:36:50.798 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-10-19T03:37:01.810 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-10-19T03:37:05.867 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-10-19T03:37:16.898 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-10-19T03:37:20.934 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-10-19T03:37:20.999 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T03:37:31.970 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-10-19T03:37:39.450 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2023-10-19T03:37:45.455 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T03:37:47.038 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-10-19T03:37:47.094 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T03:37:48.506 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2023-10-19T03:37:54.510 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T03:37:57.562 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2023-10-19T03:38:03.568 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T03:38:05.562 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-10-19T03:38:06.618 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2023-10-19T03:38:11.566 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T03:38:12.621 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T03:38:14.622 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-10-19T03:38:20.630 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T03:38:23.710 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-10-19T03:38:29.715 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T03:38:32.794 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-10-19T03:38:38.800 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T03:38:41.850 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-10-19T03:38:47.854 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T03:38:58.046 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-10-19T03:39:04.051 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T03:39:07.130 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-10-19T03:39:12.626 WARNING:teuthology.provision.fog.smithi032:timed out 2023-10-19T03:39:13.132 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T03:39:16.186 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-10-19T03:39:18.630 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T03:39:18.959 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-19T03:39:18.960 DEBUG:teuthology.orchestra.run.smithi032:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-19T03:39:19.282 INFO:teuthology.provision.fog.smithi032:Node is ready 2023-10-19T03:39:19.282 DEBUG:teuthology.orchestra.run.smithi032:> hostname 2023-10-19T03:39:19.301 INFO:teuthology.orchestra.run.smithi032.stdout:smithi032.front.sepia.ceph.com 2023-10-19T03:39:19.301 DEBUG:teuthology.orchestra.run.smithi032:> grep smithi032.front.sepia.ceph.com /etc/hosts 2023-10-19T03:39:19.360 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32 smithi032.front.sepia.ceph.com smithi032 2023-10-19T03:39:19.361 DEBUG:teuthology.orchestra.run.smithi032:> sudo hostname smithi032 2023-10-19T03:39:19.478 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i -e 's/smithi032.front.sepia.ceph.com/smithi032/g' /etc/hosts 2023-10-19T03:39:19.509 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i -e 's/172.21.15.32/172.21.15.32/g' /etc/hosts 2023-10-19T03:39:19.578 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i -e 's/smithi032.front.sepia.ceph.com/smithi032/g' /etc/hostname 2023-10-19T03:39:19.647 DEBUG:teuthology.orchestra.run.smithi032:> sudo hostname smithi032 2023-10-19T03:39:19.715 DEBUG:teuthology.orchestra.run.smithi032:> cat /etc/os-release 2023-10-19T03:39:19.772 INFO:teuthology.orchestra.run.smithi032.stdout:NAME="Red Hat Enterprise Linux" 2023-10-19T03:39:19.772 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION="8.6 (Ootpa)" 2023-10-19T03:39:19.772 INFO:teuthology.orchestra.run.smithi032.stdout:ID="rhel" 2023-10-19T03:39:19.772 INFO:teuthology.orchestra.run.smithi032.stdout:ID_LIKE="fedora" 2023-10-19T03:39:19.773 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_ID="8.6" 2023-10-19T03:39:19.773 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM_ID="platform:el8" 2023-10-19T03:39:19.773 INFO:teuthology.orchestra.run.smithi032.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-19T03:39:19.773 INFO:teuthology.orchestra.run.smithi032.stdout:ANSI_COLOR="0;31" 2023-10-19T03:39:19.774 INFO:teuthology.orchestra.run.smithi032.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-19T03:39:19.774 INFO:teuthology.orchestra.run.smithi032.stdout:HOME_URL="https://www.redhat.com/" 2023-10-19T03:39:19.774 INFO:teuthology.orchestra.run.smithi032.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-19T03:39:19.774 INFO:teuthology.orchestra.run.smithi032.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-19T03:39:19.774 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-19T03:39:19.775 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-19T03:39:19.775 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-19T03:39:19.775 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-19T03:39:19.775 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-19T03:39:19.776 INFO:teuthology.provision.fog.smithi032:Deploy complete! 2023-10-19T03:39:19.777 DEBUG:teuthology.parallel:result is None 2023-10-19T03:39:22.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T03:39:22.543 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-19T03:39:22.543 DEBUG:teuthology.orchestra.run.smithi194:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-19T03:39:22.832 INFO:teuthology.provision.fog.smithi194:Node is ready 2023-10-19T03:39:22.832 DEBUG:teuthology.orchestra.run.smithi194:> hostname 2023-10-19T03:39:22.848 INFO:teuthology.orchestra.run.smithi194.stdout:smithi194.front.sepia.ceph.com 2023-10-19T03:39:22.849 DEBUG:teuthology.orchestra.run.smithi194:> grep smithi194.front.sepia.ceph.com /etc/hosts 2023-10-19T03:39:22.905 INFO:teuthology.orchestra.run.smithi194.stdout:172.21.15.194 smithi194.front.sepia.ceph.com smithi194 2023-10-19T03:39:22.906 DEBUG:teuthology.orchestra.run.smithi194:> sudo hostname smithi194 2023-10-19T03:39:23.071 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/smithi194.front.sepia.ceph.com/smithi194/g' /etc/hosts 2023-10-19T03:39:23.099 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/172.21.15.194/172.21.15.194/g' /etc/hosts 2023-10-19T03:39:23.165 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/smithi194.front.sepia.ceph.com/smithi194/g' /etc/hostname 2023-10-19T03:39:23.233 DEBUG:teuthology.orchestra.run.smithi194:> sudo hostname smithi194 2023-10-19T03:39:23.299 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release 2023-10-19T03:39:23.355 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="Red Hat Enterprise Linux" 2023-10-19T03:39:23.356 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="8.6 (Ootpa)" 2023-10-19T03:39:23.356 INFO:teuthology.orchestra.run.smithi194.stdout:ID="rhel" 2023-10-19T03:39:23.356 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE="fedora" 2023-10-19T03:39:23.356 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="8.6" 2023-10-19T03:39:23.357 INFO:teuthology.orchestra.run.smithi194.stdout:PLATFORM_ID="platform:el8" 2023-10-19T03:39:23.357 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-19T03:39:23.357 INFO:teuthology.orchestra.run.smithi194.stdout:ANSI_COLOR="0;31" 2023-10-19T03:39:23.357 INFO:teuthology.orchestra.run.smithi194.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-19T03:39:23.357 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://www.redhat.com/" 2023-10-19T03:39:23.358 INFO:teuthology.orchestra.run.smithi194.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-19T03:39:23.358 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-19T03:39:23.358 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-10-19T03:39:23.358 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-19T03:39:23.358 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-19T03:39:23.359 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-19T03:39:23.359 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-19T03:39:23.359 INFO:teuthology.provision.fog.smithi194:Deploy complete! 2023-10-19T03:39:23.360 DEBUG:teuthology.parallel:result is None 2023-10-19T03:39:23.513 INFO:teuthology.lock.ops:Checking smithi032.front.sepia.ceph.com 2023-10-19T03:39:23.514 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-19T03:39:23.540 INFO:teuthology.lock.ops:Checking smithi194.front.sepia.ceph.com 2023-10-19T03:39:23.540 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-19T03:39:23.567 INFO:teuthology.lock.ops:Updating [smithi032.front.sepia.ceph.com]: set os type and version on server 2023-10-19T03:39:23.567 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2023-10-19T03:39:23.568 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T03:39:23.636 DEBUG:teuthology.orchestra.run.smithi032:> true 2023-10-19T03:39:23.711 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi032.front.sepia.ceph.com' 2023-10-19T03:39:23.711 DEBUG:teuthology.orchestra.run.smithi032:> uname -m 2023-10-19T03:39:23.774 INFO:teuthology.orchestra.run.smithi032.stdout:x86_64 2023-10-19T03:39:23.774 DEBUG:teuthology.orchestra.run.smithi032:> cat /etc/os-release 2023-10-19T03:39:23.834 INFO:teuthology.orchestra.run.smithi032.stdout:NAME="Red Hat Enterprise Linux" 2023-10-19T03:39:23.835 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION="8.6 (Ootpa)" 2023-10-19T03:39:23.835 INFO:teuthology.orchestra.run.smithi032.stdout:ID="rhel" 2023-10-19T03:39:23.835 INFO:teuthology.orchestra.run.smithi032.stdout:ID_LIKE="fedora" 2023-10-19T03:39:23.835 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_ID="8.6" 2023-10-19T03:39:23.836 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM_ID="platform:el8" 2023-10-19T03:39:23.836 INFO:teuthology.orchestra.run.smithi032.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-19T03:39:23.836 INFO:teuthology.orchestra.run.smithi032.stdout:ANSI_COLOR="0;31" 2023-10-19T03:39:23.836 INFO:teuthology.orchestra.run.smithi032.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-19T03:39:23.837 INFO:teuthology.orchestra.run.smithi032.stdout:HOME_URL="https://www.redhat.com/" 2023-10-19T03:39:23.837 INFO:teuthology.orchestra.run.smithi032.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-19T03:39:23.837 INFO:teuthology.orchestra.run.smithi032.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-19T03:39:23.837 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-19T03:39:23.837 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-19T03:39:23.838 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-19T03:39:23.838 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-19T03:39:23.838 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-19T03:39:23.839 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server 2023-10-19T03:39:23.865 INFO:teuthology.lock.ops:Updating [smithi194.front.sepia.ceph.com]: set os type and version on server 2023-10-19T03:39:23.865 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2023-10-19T03:39:23.866 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T03:39:23.932 DEBUG:teuthology.orchestra.run.smithi194:> true 2023-10-19T03:39:24.003 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi194.front.sepia.ceph.com' 2023-10-19T03:39:24.003 DEBUG:teuthology.orchestra.run.smithi194:> uname -m 2023-10-19T03:39:24.059 INFO:teuthology.orchestra.run.smithi194.stdout:x86_64 2023-10-19T03:39:24.060 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release 2023-10-19T03:39:24.115 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="Red Hat Enterprise Linux" 2023-10-19T03:39:24.116 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="8.6 (Ootpa)" 2023-10-19T03:39:24.116 INFO:teuthology.orchestra.run.smithi194.stdout:ID="rhel" 2023-10-19T03:39:24.117 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE="fedora" 2023-10-19T03:39:24.117 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="8.6" 2023-10-19T03:39:24.117 INFO:teuthology.orchestra.run.smithi194.stdout:PLATFORM_ID="platform:el8" 2023-10-19T03:39:24.117 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-19T03:39:24.118 INFO:teuthology.orchestra.run.smithi194.stdout:ANSI_COLOR="0;31" 2023-10-19T03:39:24.118 INFO:teuthology.orchestra.run.smithi194.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-19T03:39:24.118 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://www.redhat.com/" 2023-10-19T03:39:24.118 INFO:teuthology.orchestra.run.smithi194.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-19T03:39:24.119 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-19T03:39:24.119 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-10-19T03:39:24.119 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-19T03:39:24.119 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-19T03:39:24.119 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-19T03:39:24.120 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-19T03:39:24.120 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server 2023-10-19T03:39:24.140 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T03:39:24.246 INFO:teuthology.dispatcher.supervisor:Running job 7432027 2023-10-19T03:39:24.246 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2023-10-19_02:25:06-upgrade:reef-x-main-distro-default-smithi/7432027 --name teuthology-2023-10-19_02:25:06-upgrade:reef-x-main-distro-default-smithi --description upgrade:reef-x/stress-split/{0-distro/rhel_8.6_container_tools_3.0 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} -- /home/teuthworker/archive/teuthology-2023-10-19_02:25:06-upgrade:reef-x-main-distro-default-smithi/7432027/orig.config.yaml 2023-10-19T03:39:24.249 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2023-10-19_02:25:06-upgrade:reef-x-main-distro-default-smithi/7432027 2023-10-19T03:39:24.250 INFO:teuthology.dispatcher.supervisor:Job PID: 2417482 2023-10-19T03:39:24.250 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-19T03:41:24.351 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T03:43:24.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T03:45:24.683 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T03:47:24.840 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T03:49:24.967 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T03:51:25.125 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T03:53:25.291 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T03:55:25.460 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T03:57:25.627 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T03:59:25.800 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T03:59:25.865 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-19T03:59:25.991 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-19T03:59:25.992 INFO:teuthology.nuke:Checking targets against current locks 2023-10-19T03:59:26.042 DEBUG:teuthology.nuke:shortname: smithi032 2023-10-19T03:59:26.043 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-19T03:59:26.065 DEBUG:teuthology.nuke:shortname: smithi194 2023-10-19T03:59:26.065 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-19T03:59:26.069 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi032.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-10-19_02:25:06-upgrade:reef-x-main-distro-default-smithi/7432027', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-19 03:34:55.098991', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-19T03:59:26.093 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi194.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-10-19_02:25:06-upgrade:reef-x-main-distro-default-smithi/7432027', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-19 03:34:55.100679', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-19T03:59:26.125 INFO:teuthology.orchestra.console.smithi032:Power off 2023-10-19T03:59:26.125 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-19T03:59:26.146 DEBUG:teuthology.orchestra.console.smithi032:power off output: Chassis Power Control: Down/Off 2023-10-19T03:59:26.147 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T03:59:26.162 INFO:teuthology.orchestra.console.smithi194:Power off 2023-10-19T03:59:26.162 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-19T03:59:26.170 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is off 2023-10-19T03:59:26.183 DEBUG:teuthology.orchestra.console.smithi194:power off output: Chassis Power Control: Down/Off 2023-10-19T03:59:26.183 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T03:59:26.205 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off 2023-10-19T03:59:26.271 INFO:teuthology.orchestra.console.smithi032:Power off completed 2023-10-19T03:59:26.307 INFO:teuthology.orchestra.console.smithi194:Power off completed 2023-10-19T03:59:26.421 INFO:teuthology.lock.ops:unlocked: smithi032.front.sepia.ceph.com 2023-10-19T03:59:26.455 INFO:teuthology.lock.ops:unlocked: smithi194.front.sepia.ceph.com