2023-10-19T04:04:06.247 INFO:root:teuthology version: 0.0.1.dev201+g202b180 2023-10-19T04:04:06.249 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T04:04:06.405 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f84b2ea6ee0>, signals=[15]) 2023-10-19T04:04:06.406 INFO:teuthology.lock.ops:Start node 'smithi148.front.sepia.ceph.com' reimaging 2023-10-19T04:04:06.406 INFO:teuthology.lock.ops:Updating [smithi148.front.sepia.ceph.com]: reset os type and version on server 2023-10-19T04:04:06.407 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server 2023-10-19T04:04:06.432 INFO:teuthology.lock.ops:Start node 'smithi175.front.sepia.ceph.com' reimaging 2023-10-19T04:04:06.432 INFO:teuthology.lock.ops:Updating [smithi175.front.sepia.ceph.com]: reset os type and version on server 2023-10-19T04:04:06.432 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server 2023-10-19T04:04:06.434 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /host {"name": "smithi148"} 2023-10-19T04:04:06.456 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /host {"name": "smithi175"} 2023-10-19T04:04:06.505 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-10-19T04:04:06.529 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-10-19T04:04:06.551 DEBUG:teuthology.provision.fog.smithi148:Requesting image smithi_rhel_8.6 (ID 5) 2023-10-19T04:04:06.551 DEBUG:teuthology.provision.fog.smithi148:FOG request: PUT /host/253 {"imageID": 5} 2023-10-19T04:04:06.570 DEBUG:teuthology.provision.fog.smithi175:Requesting image smithi_rhel_8.6 (ID 5) 2023-10-19T04:04:06.571 DEBUG:teuthology.provision.fog.smithi175:FOG request: PUT /host/280 {"imageID": 5} 2023-10-19T04:04:06.593 INFO:teuthology.provision.fog.smithi148:Scheduling deploy of rhel 8.6 2023-10-19T04:04:06.593 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-10-19T04:04:06.612 INFO:teuthology.provision.fog.smithi175:Scheduling deploy of rhel 8.6 2023-10-19T04:04:06.612 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-10-19T04:04:06.650 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /tasktype {"name": "deploy"} 2023-10-19T04:04:06.669 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /tasktype {"name": "deploy"} 2023-10-19T04:04:06.693 DEBUG:teuthology.provision.fog.smithi148:FOG request: POST /host/253/task {"taskTypeID": 1} 2023-10-19T04:04:06.705 DEBUG:teuthology.provision.fog.smithi175:FOG request: POST /host/280/task {"taskTypeID": 1} 2023-10-19T04:04:06.745 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-10-19T04:04:06.757 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-10-19T04:04:06.847 INFO:teuthology.orchestra.console.smithi148:Power off 2023-10-19T04:04:06.848 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-19T04:04:06.863 INFO:teuthology.orchestra.console.smithi175:Power off 2023-10-19T04:04:06.864 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-19T04:04:06.872 DEBUG:teuthology.orchestra.console.smithi148:power off output: Chassis Power Control: Down/Off 2023-10-19T04:04:06.873 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T04:04:06.885 DEBUG:teuthology.orchestra.console.smithi175:power off output: Chassis Power Control: Down/Off 2023-10-19T04:04:06.886 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T04:04:06.894 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2023-10-19T04:04:06.908 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off 2023-10-19T04:04:06.996 INFO:teuthology.orchestra.console.smithi148:Power off completed 2023-10-19T04:04:07.010 INFO:teuthology.orchestra.console.smithi175:Power off completed 2023-10-19T04:04:07.098 INFO:teuthology.orchestra.console.smithi148:Power on 2023-10-19T04:04:07.098 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-19T04:04:07.111 INFO:teuthology.orchestra.console.smithi175:Power on 2023-10-19T04:04:07.111 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-19T04:04:07.119 DEBUG:teuthology.orchestra.console.smithi148:power on output: Chassis Power Control: Up/On 2023-10-19T04:04:07.120 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T04:04:07.133 DEBUG:teuthology.orchestra.console.smithi175:power on output: Chassis Power Control: Up/On 2023-10-19T04:04:07.133 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T04:04:07.143 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2023-10-19T04:04:07.158 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off 2023-10-19T04:04:11.146 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T04:04:11.159 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T04:04:11.256 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2023-10-19T04:04:11.270 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off 2023-10-19T04:04:15.259 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T04:04:15.271 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T04:04:15.369 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on 2023-10-19T04:04:15.380 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on 2023-10-19T04:04:15.470 INFO:teuthology.orchestra.console.smithi148:Power on completed 2023-10-19T04:04:15.481 INFO:teuthology.orchestra.console.smithi175:Power on completed 2023-10-19T04:04:15.571 INFO:teuthology.provision.fog.smithi148:Waiting for deploy to finish 2023-10-19T04:04:15.572 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-10-19T04:04:15.583 INFO:teuthology.provision.fog.smithi175:Waiting for deploy to finish 2023-10-19T04:04:15.583 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-10-19T04:04:30.646 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-10-19T04:04:30.649 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-10-19T04:04:45.722 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-10-19T04:04:45.724 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-10-19T04:05:00.798 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-10-19T04:05:00.800 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-10-19T04:05:15.883 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-10-19T04:05:15.885 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-10-19T04:05:30.978 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-10-19T04:05:30.980 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-10-19T04:05:46.062 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-10-19T04:05:46.064 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-10-19T04:06:01.154 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-10-19T04:06:01.155 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-10-19T04:06:16.237 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-10-19T04:06:16.239 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-10-19T04:06:31.332 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-10-19T04:06:31.334 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-10-19T04:06:46.412 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-10-19T04:06:46.414 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-10-19T04:07:01.490 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-10-19T04:07:01.492 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-10-19T04:07:01.559 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T04:07:01.562 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T04:07:19.931 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-10-19T04:07:19.932 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2023-10-19T04:07:25.938 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T04:07:25.942 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T04:07:29.018 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-10-19T04:07:29.019 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2023-10-19T04:07:35.022 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T04:07:35.024 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T04:07:38.078 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2023-10-19T04:07:38.079 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-10-19T04:07:44.082 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T04:07:44.085 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T04:07:47.166 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2023-10-19T04:07:47.167 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-10-19T04:07:53.170 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T04:07:53.173 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T04:07:56.250 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-10-19T04:08:02.254 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T04:08:11.642 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2023-10-19T04:08:17.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T04:08:20.606 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-10-19T04:08:20.698 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2023-10-19T04:08:26.610 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T04:08:26.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T04:08:29.662 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-19T04:08:29.663 DEBUG:teuthology.orchestra.run.smithi175:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-19T04:08:29.694 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-10-19T04:08:29.904 INFO:teuthology.provision.fog.smithi175:Node is ready 2023-10-19T04:08:29.904 DEBUG:teuthology.orchestra.run.smithi175:> hostname 2023-10-19T04:08:29.922 INFO:teuthology.orchestra.run.smithi175.stdout:smithi022 2023-10-19T04:08:29.922 DEBUG:teuthology.orchestra.run.smithi175:> grep smithi022 /etc/hosts 2023-10-19T04:08:29.978 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2023-10-19T04:08:29.979 DEBUG:teuthology.orchestra.run.smithi175:> sudo hostname smithi175 2023-10-19T04:08:30.097 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/smithi022/smithi175/g' /etc/hosts 2023-10-19T04:08:30.126 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/172.21.15.22/172.21.15.175/g' /etc/hosts 2023-10-19T04:08:30.193 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/smithi022/smithi175/g' /etc/hostname 2023-10-19T04:08:30.259 DEBUG:teuthology.orchestra.run.smithi175:> sudo hostname smithi175 2023-10-19T04:08:30.325 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release 2023-10-19T04:08:30.382 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="Red Hat Enterprise Linux" 2023-10-19T04:08:30.382 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="8.6 (Ootpa)" 2023-10-19T04:08:30.382 INFO:teuthology.orchestra.run.smithi175.stdout:ID="rhel" 2023-10-19T04:08:30.383 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE="fedora" 2023-10-19T04:08:30.383 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="8.6" 2023-10-19T04:08:30.383 INFO:teuthology.orchestra.run.smithi175.stdout:PLATFORM_ID="platform:el8" 2023-10-19T04:08:30.383 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-19T04:08:30.383 INFO:teuthology.orchestra.run.smithi175.stdout:ANSI_COLOR="0;31" 2023-10-19T04:08:30.384 INFO:teuthology.orchestra.run.smithi175.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-19T04:08:30.384 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://www.redhat.com/" 2023-10-19T04:08:30.384 INFO:teuthology.orchestra.run.smithi175.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-19T04:08:30.384 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-19T04:08:30.384 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-10-19T04:08:30.385 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-19T04:08:30.385 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-19T04:08:30.385 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-19T04:08:30.385 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-19T04:08:30.386 INFO:teuthology.provision.fog.smithi175:Deploy complete! 2023-10-19T04:08:30.387 DEBUG:teuthology.parallel:result is None 2023-10-19T04:08:35.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T04:08:38.778 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-10-19T04:08:44.785 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T04:08:45.102 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-19T04:08:45.103 DEBUG:teuthology.orchestra.run.smithi148:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-19T04:08:45.447 INFO:teuthology.provision.fog.smithi148:Node is ready 2023-10-19T04:08:45.447 DEBUG:teuthology.orchestra.run.smithi148:> hostname 2023-10-19T04:08:45.464 INFO:teuthology.orchestra.run.smithi148.stdout:smithi148.front.sepia.ceph.com 2023-10-19T04:08:45.465 DEBUG:teuthology.orchestra.run.smithi148:> grep smithi148.front.sepia.ceph.com /etc/hosts 2023-10-19T04:08:45.522 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148 smithi148.front.sepia.ceph.com smithi148 2023-10-19T04:08:45.522 DEBUG:teuthology.orchestra.run.smithi148:> sudo hostname smithi148 2023-10-19T04:08:45.639 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/smithi148.front.sepia.ceph.com/smithi148/g' /etc/hosts 2023-10-19T04:08:45.667 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/172.21.15.148/172.21.15.148/g' /etc/hosts 2023-10-19T04:08:45.735 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/smithi148.front.sepia.ceph.com/smithi148/g' /etc/hostname 2023-10-19T04:08:45.803 DEBUG:teuthology.orchestra.run.smithi148:> sudo hostname smithi148 2023-10-19T04:08:45.870 DEBUG:teuthology.orchestra.run.smithi148:> cat /etc/os-release 2023-10-19T04:08:45.926 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="Red Hat Enterprise Linux" 2023-10-19T04:08:45.926 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="8.6 (Ootpa)" 2023-10-19T04:08:45.926 INFO:teuthology.orchestra.run.smithi148.stdout:ID="rhel" 2023-10-19T04:08:45.926 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE="fedora" 2023-10-19T04:08:45.927 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="8.6" 2023-10-19T04:08:45.927 INFO:teuthology.orchestra.run.smithi148.stdout:PLATFORM_ID="platform:el8" 2023-10-19T04:08:45.927 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-19T04:08:45.927 INFO:teuthology.orchestra.run.smithi148.stdout:ANSI_COLOR="0;31" 2023-10-19T04:08:45.927 INFO:teuthology.orchestra.run.smithi148.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-19T04:08:45.928 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://www.redhat.com/" 2023-10-19T04:08:45.928 INFO:teuthology.orchestra.run.smithi148.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-19T04:08:45.928 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-19T04:08:45.928 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-19T04:08:45.928 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-19T04:08:45.930 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-19T04:08:45.931 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-19T04:08:45.931 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-19T04:08:45.931 INFO:teuthology.provision.fog.smithi148:Deploy complete! 2023-10-19T04:08:45.932 DEBUG:teuthology.parallel:result is None 2023-10-19T04:08:46.085 INFO:teuthology.lock.ops:Checking smithi148.front.sepia.ceph.com 2023-10-19T04:08:46.086 INFO:teuthology.lock.ops:Checking smithi175.front.sepia.ceph.com 2023-10-19T04:08:46.086 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-19T04:08:46.116 INFO:teuthology.lock.ops:Updating [smithi148.front.sepia.ceph.com]: set os type and version on server 2023-10-19T04:08:46.116 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2023-10-19T04:08:46.117 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T04:08:46.186 DEBUG:teuthology.orchestra.run.smithi148:> true 2023-10-19T04:08:46.208 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi148.front.sepia.ceph.com' 2023-10-19T04:08:46.209 DEBUG:teuthology.orchestra.run.smithi148:> uname -m 2023-10-19T04:08:46.266 INFO:teuthology.orchestra.run.smithi148.stdout:x86_64 2023-10-19T04:08:46.266 DEBUG:teuthology.orchestra.run.smithi148:> cat /etc/os-release 2023-10-19T04:08:46.324 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="Red Hat Enterprise Linux" 2023-10-19T04:08:46.324 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="8.6 (Ootpa)" 2023-10-19T04:08:46.325 INFO:teuthology.orchestra.run.smithi148.stdout:ID="rhel" 2023-10-19T04:08:46.325 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE="fedora" 2023-10-19T04:08:46.325 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="8.6" 2023-10-19T04:08:46.326 INFO:teuthology.orchestra.run.smithi148.stdout:PLATFORM_ID="platform:el8" 2023-10-19T04:08:46.326 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-19T04:08:46.326 INFO:teuthology.orchestra.run.smithi148.stdout:ANSI_COLOR="0;31" 2023-10-19T04:08:46.326 INFO:teuthology.orchestra.run.smithi148.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-19T04:08:46.327 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://www.redhat.com/" 2023-10-19T04:08:46.327 INFO:teuthology.orchestra.run.smithi148.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-19T04:08:46.327 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-19T04:08:46.327 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-19T04:08:46.327 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-19T04:08:46.328 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-19T04:08:46.328 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-19T04:08:46.328 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-19T04:08:46.329 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server 2023-10-19T04:08:46.348 INFO:teuthology.lock.ops:Updating [smithi175.front.sepia.ceph.com]: set os type and version on server 2023-10-19T04:08:46.349 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2023-10-19T04:08:46.350 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T04:08:46.418 DEBUG:teuthology.orchestra.run.smithi175:> true 2023-10-19T04:08:46.556 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi175.front.sepia.ceph.com' 2023-10-19T04:08:46.557 DEBUG:teuthology.orchestra.run.smithi175:> uname -m 2023-10-19T04:08:46.613 INFO:teuthology.orchestra.run.smithi175.stdout:x86_64 2023-10-19T04:08:46.614 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release 2023-10-19T04:08:46.671 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="Red Hat Enterprise Linux" 2023-10-19T04:08:46.671 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="8.6 (Ootpa)" 2023-10-19T04:08:46.671 INFO:teuthology.orchestra.run.smithi175.stdout:ID="rhel" 2023-10-19T04:08:46.672 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE="fedora" 2023-10-19T04:08:46.672 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="8.6" 2023-10-19T04:08:46.673 INFO:teuthology.orchestra.run.smithi175.stdout:PLATFORM_ID="platform:el8" 2023-10-19T04:08:46.673 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-19T04:08:46.673 INFO:teuthology.orchestra.run.smithi175.stdout:ANSI_COLOR="0;31" 2023-10-19T04:08:46.674 INFO:teuthology.orchestra.run.smithi175.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-19T04:08:46.674 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://www.redhat.com/" 2023-10-19T04:08:46.674 INFO:teuthology.orchestra.run.smithi175.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-19T04:08:46.675 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-19T04:08:46.675 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-10-19T04:08:46.676 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-19T04:08:46.676 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-19T04:08:46.676 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-19T04:08:46.677 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-19T04:08:46.677 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server 2023-10-19T04:08:46.699 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T04:08:46.793 INFO:teuthology.dispatcher.supervisor:Running job 7432068 2023-10-19T04:08:46.793 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2023-10-19_02:25:06-upgrade:reef-x-main-distro-default-smithi/7432068 --name teuthology-2023-10-19_02:25:06-upgrade:reef-x-main-distro-default-smithi --description upgrade:reef-x/stress-split/{0-distro/rhel_8.6_container_tools_3.0 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} -- /home/teuthworker/archive/teuthology-2023-10-19_02:25:06-upgrade:reef-x-main-distro-default-smithi/7432068/orig.config.yaml 2023-10-19T04:08:46.797 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2023-10-19_02:25:06-upgrade:reef-x-main-distro-default-smithi/7432068 2023-10-19T04:08:46.797 INFO:teuthology.dispatcher.supervisor:Job PID: 2851784 2023-10-19T04:08:46.798 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-19T04:10:46.898 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T04:12:47.067 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T04:14:47.229 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T04:16:47.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T04:18:47.571 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T04:20:47.735 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T04:22:47.907 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T04:24:48.071 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T04:26:48.263 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T04:26:48.324 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-19T04:26:48.503 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-19T04:26:48.503 INFO:teuthology.nuke:Checking targets against current locks 2023-10-19T04:26:48.553 DEBUG:teuthology.nuke:shortname: smithi148 2023-10-19T04:26:48.553 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-19T04:26:48.579 DEBUG:teuthology.nuke:shortname: smithi175 2023-10-19T04:26:48.579 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-19T04:26:48.583 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi148.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-10-19_02:25:06-upgrade:reef-x-main-distro-default-smithi/7432068', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-19 04:04:05.403920', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-19T04:26:48.604 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi175.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-10-19_02:25:06-upgrade:reef-x-main-distro-default-smithi/7432068', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-19 04:04:05.402635', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-19T04:26:48.641 INFO:teuthology.orchestra.console.smithi148:Power off 2023-10-19T04:26:48.641 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-19T04:26:48.664 DEBUG:teuthology.orchestra.console.smithi148:power off output: Chassis Power Control: Down/Off 2023-10-19T04:26:48.665 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T04:26:48.686 INFO:teuthology.orchestra.console.smithi175:Power off 2023-10-19T04:26:48.687 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-19T04:26:48.695 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2023-10-19T04:26:48.710 DEBUG:teuthology.orchestra.console.smithi175:power off output: Chassis Power Control: Down/Off 2023-10-19T04:26:48.711 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T04:26:48.737 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off 2023-10-19T04:26:48.796 INFO:teuthology.orchestra.console.smithi148:Power off completed 2023-10-19T04:26:48.839 INFO:teuthology.orchestra.console.smithi175:Power off completed 2023-10-19T04:26:48.951 INFO:teuthology.lock.ops:unlocked: smithi148.front.sepia.ceph.com 2023-10-19T04:26:48.983 INFO:teuthology.lock.ops:unlocked: smithi175.front.sepia.ceph.com