2023-10-12T03:36:54.058 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-12T03:36:54.059 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-12T03:36:54.190 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3eccde5ee0>, signals=[15]) 2023-10-12T03:36:54.192 INFO:teuthology.lock.ops:Start node 'smithi123.front.sepia.ceph.com' reimaging 2023-10-12T03:36:54.192 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: reset os type and version on server 2023-10-12T03:36:54.193 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server 2023-10-12T03:36:54.215 INFO:teuthology.lock.ops:Start node 'smithi190.front.sepia.ceph.com' reimaging 2023-10-12T03:36:54.216 INFO:teuthology.lock.ops:Updating [smithi190.front.sepia.ceph.com]: reset os type and version on server 2023-10-12T03:36:54.216 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2023-10-12T03:36:54.217 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /host {"name": "smithi123"} 2023-10-12T03:36:54.240 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /host {"name": "smithi190"} 2023-10-12T03:36:54.299 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-10-12T03:36:54.309 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-10-12T03:36:54.340 DEBUG:teuthology.provision.fog.smithi123:Requesting image smithi_rhel_8.6 (ID 5) 2023-10-12T03:36:54.340 DEBUG:teuthology.provision.fog.smithi123:FOG request: PUT /host/228 {"imageID": 5} 2023-10-12T03:36:54.352 DEBUG:teuthology.provision.fog.smithi190:Requesting image smithi_rhel_8.6 (ID 5) 2023-10-12T03:36:54.353 DEBUG:teuthology.provision.fog.smithi190:FOG request: PUT /host/295 {"imageID": 5} 2023-10-12T03:36:54.390 INFO:teuthology.provision.fog.smithi123:Scheduling deploy of rhel 8.6 2023-10-12T03:36:54.391 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-10-12T03:36:54.399 INFO:teuthology.provision.fog.smithi190:Scheduling deploy of rhel 8.6 2023-10-12T03:36:54.399 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-10-12T03:36:54.448 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /tasktype {"name": "deploy"} 2023-10-12T03:36:54.459 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /tasktype {"name": "deploy"} 2023-10-12T03:36:54.487 DEBUG:teuthology.provision.fog.smithi123:FOG request: POST /host/228/task {"taskTypeID": 1} 2023-10-12T03:36:54.494 DEBUG:teuthology.provision.fog.smithi190:FOG request: POST /host/295/task {"taskTypeID": 1} 2023-10-12T03:36:54.543 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-10-12T03:36:54.556 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-10-12T03:36:54.634 INFO:teuthology.orchestra.console.smithi123:Power off 2023-10-12T03:36:54.635 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-12T03:36:54.648 INFO:teuthology.orchestra.console.smithi190:Power off 2023-10-12T03:36:54.649 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-12T03:36:54.657 DEBUG:teuthology.orchestra.console.smithi123:power off output: Chassis Power Control: Down/Off 2023-10-12T03:36:54.657 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-12T03:36:54.670 DEBUG:teuthology.orchestra.console.smithi190:power off output: Chassis Power Control: Down/Off 2023-10-12T03:36:54.671 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-12T03:36:54.679 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off 2023-10-12T03:36:54.691 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off 2023-10-12T03:36:54.780 INFO:teuthology.orchestra.console.smithi123:Power off completed 2023-10-12T03:36:54.793 INFO:teuthology.orchestra.console.smithi190:Power off completed 2023-10-12T03:36:54.881 INFO:teuthology.orchestra.console.smithi123:Power on 2023-10-12T03:36:54.882 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-12T03:36:54.894 INFO:teuthology.orchestra.console.smithi190:Power on 2023-10-12T03:36:54.894 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-12T03:36:54.902 DEBUG:teuthology.orchestra.console.smithi123:power on output: Chassis Power Control: Up/On 2023-10-12T03:36:54.902 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-12T03:36:54.914 DEBUG:teuthology.orchestra.console.smithi190:power on output: Chassis Power Control: Up/On 2023-10-12T03:36:54.915 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-12T03:36:54.922 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off 2023-10-12T03:36:54.938 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off 2023-10-12T03:36:58.926 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-12T03:36:58.939 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-12T03:36:59.035 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off 2023-10-12T03:36:59.048 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on 2023-10-12T03:36:59.149 INFO:teuthology.orchestra.console.smithi190:Power on completed 2023-10-12T03:36:59.250 INFO:teuthology.provision.fog.smithi190:Waiting for deploy to finish 2023-10-12T03:36:59.250 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-10-12T03:37:03.038 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-12T03:37:03.148 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on 2023-10-12T03:37:03.249 INFO:teuthology.orchestra.console.smithi123:Power on completed 2023-10-12T03:37:03.349 INFO:teuthology.provision.fog.smithi123:Waiting for deploy to finish 2023-10-12T03:37:03.350 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-10-12T03:37:14.330 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-10-12T03:37:18.426 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-10-12T03:37:29.402 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-10-12T03:37:33.502 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-10-12T03:37:44.498 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-10-12T03:37:48.575 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-10-12T03:37:59.570 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-10-12T03:38:03.656 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-10-12T03:38:14.642 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-10-12T03:38:18.722 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-10-12T03:38:29.706 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-10-12T03:38:33.790 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-10-12T03:38:44.774 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-10-12T03:38:48.854 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-10-12T03:38:59.842 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-10-12T03:39:03.946 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-10-12T03:39:14.918 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-10-12T03:39:19.022 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-10-12T03:39:29.994 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-10-12T03:39:34.098 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-10-12T03:39:34.177 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T03:39:45.078 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-10-12T03:39:45.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T03:39:52.573 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-10-12T03:39:58.578 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T03:40:01.662 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-10-12T03:40:03.582 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-10-12T03:40:07.666 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T03:40:09.586 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T03:40:10.750 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-10-12T03:40:12.666 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-10-12T03:40:16.754 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T03:40:18.669 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T03:40:19.834 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-10-12T03:40:21.723 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-10-12T03:40:25.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T03:40:27.726 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T03:40:28.890 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-10-12T03:40:30.782 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-10-12T03:40:34.895 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T03:40:36.786 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T03:40:39.866 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-10-12T03:40:45.873 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T03:40:53.242 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-10-12T03:40:59.247 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T03:41:02.298 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-10-12T03:41:08.302 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T03:41:09.805 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-12T03:41:09.807 DEBUG:teuthology.orchestra.run.smithi123:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-12T03:41:10.088 INFO:teuthology.provision.fog.smithi123:Node is ready 2023-10-12T03:41:10.088 DEBUG:teuthology.orchestra.run.smithi123:> hostname 2023-10-12T03:41:10.105 INFO:teuthology.orchestra.run.smithi123.stdout:smithi022 2023-10-12T03:41:10.106 DEBUG:teuthology.orchestra.run.smithi123:> grep smithi022 /etc/hosts 2023-10-12T03:41:10.163 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2023-10-12T03:41:10.163 DEBUG:teuthology.orchestra.run.smithi123:> sudo hostname smithi123 2023-10-12T03:41:10.278 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/smithi022/smithi123/g' /etc/hosts 2023-10-12T03:41:10.305 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/172.21.15.22/172.21.15.123/g' /etc/hosts 2023-10-12T03:41:10.372 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/smithi022/smithi123/g' /etc/hostname 2023-10-12T03:41:10.439 DEBUG:teuthology.orchestra.run.smithi123:> sudo hostname smithi123 2023-10-12T03:41:10.505 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release 2023-10-12T03:41:10.562 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="Red Hat Enterprise Linux" 2023-10-12T03:41:10.562 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="8.6 (Ootpa)" 2023-10-12T03:41:10.562 INFO:teuthology.orchestra.run.smithi123.stdout:ID="rhel" 2023-10-12T03:41:10.562 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE="fedora" 2023-10-12T03:41:10.563 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="8.6" 2023-10-12T03:41:10.563 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM_ID="platform:el8" 2023-10-12T03:41:10.563 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-12T03:41:10.563 INFO:teuthology.orchestra.run.smithi123.stdout:ANSI_COLOR="0;31" 2023-10-12T03:41:10.563 INFO:teuthology.orchestra.run.smithi123.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-12T03:41:10.564 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://www.redhat.com/" 2023-10-12T03:41:10.564 INFO:teuthology.orchestra.run.smithi123.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-12T03:41:10.564 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-12T03:41:10.564 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-10-12T03:41:10.564 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-12T03:41:10.565 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-12T03:41:10.565 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-12T03:41:10.565 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-12T03:41:10.566 INFO:teuthology.provision.fog.smithi123:Deploy complete! 2023-10-12T03:41:10.567 DEBUG:teuthology.parallel:result is None 2023-10-12T03:41:45.910 WARNING:teuthology.provision.fog.smithi190:timed out 2023-10-12T03:41:51.915 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T03:41:52.166 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-12T03:41:52.167 DEBUG:teuthology.orchestra.run.smithi190:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-12T03:41:52.485 INFO:teuthology.provision.fog.smithi190:Node is ready 2023-10-12T03:41:52.485 DEBUG:teuthology.orchestra.run.smithi190:> hostname 2023-10-12T03:41:52.503 INFO:teuthology.orchestra.run.smithi190.stdout:smithi190.front.sepia.ceph.com 2023-10-12T03:41:52.503 DEBUG:teuthology.orchestra.run.smithi190:> grep smithi190.front.sepia.ceph.com /etc/hosts 2023-10-12T03:41:52.564 INFO:teuthology.orchestra.run.smithi190.stdout:172.21.15.190 smithi190.front.sepia.ceph.com smithi190 2023-10-12T03:41:52.565 DEBUG:teuthology.orchestra.run.smithi190:> sudo hostname smithi190 2023-10-12T03:41:52.696 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/smithi190.front.sepia.ceph.com/smithi190/g' /etc/hosts 2023-10-12T03:41:52.724 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/172.21.15.190/172.21.15.190/g' /etc/hosts 2023-10-12T03:41:52.795 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/smithi190.front.sepia.ceph.com/smithi190/g' /etc/hostname 2023-10-12T03:41:52.866 DEBUG:teuthology.orchestra.run.smithi190:> sudo hostname smithi190 2023-10-12T03:41:52.935 DEBUG:teuthology.orchestra.run.smithi190:> cat /etc/os-release 2023-10-12T03:41:52.996 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="Red Hat Enterprise Linux" 2023-10-12T03:41:52.996 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="8.6 (Ootpa)" 2023-10-12T03:41:52.996 INFO:teuthology.orchestra.run.smithi190.stdout:ID="rhel" 2023-10-12T03:41:52.997 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE="fedora" 2023-10-12T03:41:52.997 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="8.6" 2023-10-12T03:41:52.997 INFO:teuthology.orchestra.run.smithi190.stdout:PLATFORM_ID="platform:el8" 2023-10-12T03:41:52.997 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-12T03:41:52.998 INFO:teuthology.orchestra.run.smithi190.stdout:ANSI_COLOR="0;31" 2023-10-12T03:41:52.998 INFO:teuthology.orchestra.run.smithi190.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-12T03:41:52.998 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://www.redhat.com/" 2023-10-12T03:41:52.998 INFO:teuthology.orchestra.run.smithi190.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-12T03:41:52.999 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-12T03:41:52.999 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-10-12T03:41:52.999 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-12T03:41:52.999 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-12T03:41:52.999 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-12T03:41:53.000 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-12T03:41:53.000 INFO:teuthology.provision.fog.smithi190:Deploy complete! 2023-10-12T03:41:53.001 DEBUG:teuthology.parallel:result is None 2023-10-12T03:41:53.158 INFO:teuthology.lock.ops:Checking smithi123.front.sepia.ceph.com 2023-10-12T03:41:53.159 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-12T03:41:53.179 INFO:teuthology.lock.ops:Checking smithi190.front.sepia.ceph.com 2023-10-12T03:41:53.180 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-12T03:41:53.197 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: set os type and version on server 2023-10-12T03:41:53.198 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-10-12T03:41:53.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T03:41:53.265 DEBUG:teuthology.orchestra.run.smithi123:> true 2023-10-12T03:41:53.395 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-10-12T03:41:53.396 DEBUG:teuthology.orchestra.run.smithi123:> uname -m 2023-10-12T03:41:53.452 INFO:teuthology.orchestra.run.smithi123.stdout:x86_64 2023-10-12T03:41:53.453 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release 2023-10-12T03:41:53.510 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="Red Hat Enterprise Linux" 2023-10-12T03:41:53.510 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="8.6 (Ootpa)" 2023-10-12T03:41:53.510 INFO:teuthology.orchestra.run.smithi123.stdout:ID="rhel" 2023-10-12T03:41:53.511 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE="fedora" 2023-10-12T03:41:53.511 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="8.6" 2023-10-12T03:41:53.511 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM_ID="platform:el8" 2023-10-12T03:41:53.511 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-12T03:41:53.511 INFO:teuthology.orchestra.run.smithi123.stdout:ANSI_COLOR="0;31" 2023-10-12T03:41:53.512 INFO:teuthology.orchestra.run.smithi123.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-12T03:41:53.512 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://www.redhat.com/" 2023-10-12T03:41:53.512 INFO:teuthology.orchestra.run.smithi123.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-12T03:41:53.512 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-12T03:41:53.512 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-10-12T03:41:53.513 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-12T03:41:53.513 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-12T03:41:53.513 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-12T03:41:53.513 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-12T03:41:53.514 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server 2023-10-12T03:41:53.538 INFO:teuthology.lock.ops:Updating [smithi190.front.sepia.ceph.com]: set os type and version on server 2023-10-12T03:41:53.539 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-10-12T03:41:53.539 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T03:41:53.609 DEBUG:teuthology.orchestra.run.smithi190:> true 2023-10-12T03:41:53.680 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-10-12T03:41:53.680 DEBUG:teuthology.orchestra.run.smithi190:> uname -m 2023-10-12T03:41:53.740 INFO:teuthology.orchestra.run.smithi190.stdout:x86_64 2023-10-12T03:41:53.741 DEBUG:teuthology.orchestra.run.smithi190:> cat /etc/os-release 2023-10-12T03:41:53.801 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="Red Hat Enterprise Linux" 2023-10-12T03:41:53.801 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="8.6 (Ootpa)" 2023-10-12T03:41:53.802 INFO:teuthology.orchestra.run.smithi190.stdout:ID="rhel" 2023-10-12T03:41:53.802 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE="fedora" 2023-10-12T03:41:53.802 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="8.6" 2023-10-12T03:41:53.802 INFO:teuthology.orchestra.run.smithi190.stdout:PLATFORM_ID="platform:el8" 2023-10-12T03:41:53.802 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-12T03:41:53.803 INFO:teuthology.orchestra.run.smithi190.stdout:ANSI_COLOR="0;31" 2023-10-12T03:41:53.803 INFO:teuthology.orchestra.run.smithi190.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-12T03:41:53.803 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://www.redhat.com/" 2023-10-12T03:41:53.803 INFO:teuthology.orchestra.run.smithi190.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-12T03:41:53.803 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-12T03:41:53.804 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-10-12T03:41:53.804 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-12T03:41:53.804 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-12T03:41:53.804 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-12T03:41:53.804 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-12T03:41:53.805 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2023-10-12T03:41:53.821 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-12T03:41:53.909 INFO:teuthology.dispatcher.supervisor:Running job 7422483 2023-10-12T03:41:53.909 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2023-10-12_02:25:02-upgrade:reef-x-main-distro-default-smithi/7422483 --name teuthology-2023-10-12_02:25:02-upgrade:reef-x-main-distro-default-smithi --description upgrade:reef-x/stress-split/{0-distro/rhel_8.6_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} -- /home/teuthworker/archive/teuthology-2023-10-12_02:25:02-upgrade:reef-x-main-distro-default-smithi/7422483/orig.config.yaml 2023-10-12T03:41:53.913 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2023-10-12_02:25:02-upgrade:reef-x-main-distro-default-smithi/7422483 2023-10-12T03:41:53.913 INFO:teuthology.dispatcher.supervisor:Job PID: 662464 2023-10-12T03:41:53.914 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-12T03:43:54.014 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-12T03:45:54.191 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-12T03:47:54.346 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-12T03:49:54.515 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-12T03:51:54.683 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-12T03:53:54.849 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-12T03:55:55.016 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-12T03:57:55.183 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-12T03:59:55.351 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-12T03:59:55.417 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-12T03:59:55.545 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-12T03:59:55.545 INFO:teuthology.nuke:Checking targets against current locks 2023-10-12T03:59:55.596 DEBUG:teuthology.nuke:shortname: smithi123 2023-10-12T03:59:55.597 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-12T03:59:55.616 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi123.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-10-12_02:25:02-upgrade:reef-x-main-distro-default-smithi/7422483', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-12 03:36:53.240346', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-12T03:59:55.624 DEBUG:teuthology.nuke:shortname: smithi190 2023-10-12T03:59:55.624 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-12T03:59:55.645 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi190.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-10-12_02:25:02-upgrade:reef-x-main-distro-default-smithi/7422483', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-12 03:36:53.242026', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-12T03:59:55.663 INFO:teuthology.orchestra.console.smithi123:Power off 2023-10-12T03:59:55.663 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-12T03:59:55.686 DEBUG:teuthology.orchestra.console.smithi123:power off output: Chassis Power Control: Down/Off 2023-10-12T03:59:55.686 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-12T03:59:55.700 INFO:teuthology.orchestra.console.smithi190:Power off 2023-10-12T03:59:55.701 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-12T03:59:55.709 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off 2023-10-12T03:59:55.722 DEBUG:teuthology.orchestra.console.smithi190:power off output: Chassis Power Control: Down/Off 2023-10-12T03:59:55.722 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-12T03:59:55.745 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off 2023-10-12T03:59:55.810 INFO:teuthology.orchestra.console.smithi123:Power off completed 2023-10-12T03:59:55.847 INFO:teuthology.orchestra.console.smithi190:Power off completed 2023-10-12T03:59:55.966 INFO:teuthology.lock.ops:unlocked: smithi123.front.sepia.ceph.com 2023-10-12T03:59:55.990 INFO:teuthology.lock.ops:unlocked: smithi190.front.sepia.ceph.com