2023-10-21T16:23:37.912 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-21T16:23:37.914 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T16:23:38.060 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7efe10f34e50>, signals=[15]) 2023-10-21T16:23:38.062 INFO:teuthology.lock.ops:Start node 'smithi094.front.sepia.ceph.com' reimaging 2023-10-21T16:23:38.063 INFO:teuthology.lock.ops:Updating [smithi094.front.sepia.ceph.com]: reset os type and version on server 2023-10-21T16:23:38.063 INFO:teuthology.lock.ops:Updating smithi094.front.sepia.ceph.com on lock server 2023-10-21T16:23:38.094 INFO:teuthology.lock.ops:Start node 'smithi175.front.sepia.ceph.com' reimaging 2023-10-21T16:23:38.095 INFO:teuthology.lock.ops:Updating [smithi175.front.sepia.ceph.com]: reset os type and version on server 2023-10-21T16:23:38.095 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server 2023-10-21T16:23:38.096 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /host {"name": "smithi094"} 2023-10-21T16:23:38.119 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /host {"name": "smithi175"} 2023-10-21T16:23:38.168 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-10-21T16:23:38.190 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-10-21T16:23:38.211 DEBUG:teuthology.provision.fog.smithi094:Requesting image smithi_rhel_8.6 (ID 5) 2023-10-21T16:23:38.212 DEBUG:teuthology.provision.fog.smithi094:FOG request: PUT /host/199 {"imageID": 5} 2023-10-21T16:23:38.232 DEBUG:teuthology.provision.fog.smithi175:Requesting image smithi_rhel_8.6 (ID 5) 2023-10-21T16:23:38.232 DEBUG:teuthology.provision.fog.smithi175:FOG request: PUT /host/280 {"imageID": 5} 2023-10-21T16:23:38.259 INFO:teuthology.provision.fog.smithi094:Scheduling deploy of rhel 8.6 2023-10-21T16:23:38.259 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-10-21T16:23:38.279 INFO:teuthology.provision.fog.smithi175:Scheduling deploy of rhel 8.6 2023-10-21T16:23:38.279 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-10-21T16:23:38.308 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /tasktype {"name": "deploy"} 2023-10-21T16:23:38.319 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /tasktype {"name": "deploy"} 2023-10-21T16:23:38.339 DEBUG:teuthology.provision.fog.smithi094:FOG request: POST /host/199/task {"taskTypeID": 1} 2023-10-21T16:23:38.349 DEBUG:teuthology.provision.fog.smithi175:FOG request: POST /host/280/task {"taskTypeID": 1} 2023-10-21T16:23:38.393 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-10-21T16:23:38.399 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-10-21T16:23:38.481 INFO:teuthology.orchestra.console.smithi094:Power off 2023-10-21T16:23:38.482 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-21T16:23:38.496 INFO:teuthology.orchestra.console.smithi175:Power off 2023-10-21T16:23:38.497 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-21T16:23:38.505 DEBUG:teuthology.orchestra.console.smithi094:power off output: Chassis Power Control: Down/Off 2023-10-21T16:23:38.505 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T16:23:38.517 DEBUG:teuthology.orchestra.console.smithi175:power off output: Chassis Power Control: Down/Off 2023-10-21T16:23:38.518 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T16:23:38.529 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is off 2023-10-21T16:23:38.546 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on 2023-10-21T16:23:38.630 INFO:teuthology.orchestra.console.smithi094:Power off completed 2023-10-21T16:23:38.731 INFO:teuthology.orchestra.console.smithi094:Power on 2023-10-21T16:23:38.731 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-21T16:23:38.751 DEBUG:teuthology.orchestra.console.smithi094:power on output: Chassis Power Control: Up/On 2023-10-21T16:23:38.752 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T16:23:38.776 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is off 2023-10-21T16:23:42.550 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T16:23:42.661 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on 2023-10-21T16:23:42.777 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T16:23:42.887 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is off 2023-10-21T16:23:46.666 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T16:23:46.777 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off 2023-10-21T16:23:46.878 INFO:teuthology.orchestra.console.smithi175:Power off completed 2023-10-21T16:23:46.888 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T16:23:46.980 INFO:teuthology.orchestra.console.smithi175:Power on 2023-10-21T16:23:46.981 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-21T16:23:46.996 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is on 2023-10-21T16:23:47.002 DEBUG:teuthology.orchestra.console.smithi175:power on output: Chassis Power Control: Up/On 2023-10-21T16:23:47.002 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T16:23:47.023 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off 2023-10-21T16:23:47.098 INFO:teuthology.orchestra.console.smithi094:Power on completed 2023-10-21T16:23:47.198 INFO:teuthology.provision.fog.smithi094:Waiting for deploy to finish 2023-10-21T16:23:47.199 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-10-21T16:23:51.028 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T16:23:51.137 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off 2023-10-21T16:23:55.141 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T16:23:55.249 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on 2023-10-21T16:23:55.350 INFO:teuthology.orchestra.console.smithi175:Power on completed 2023-10-21T16:23:55.451 INFO:teuthology.provision.fog.smithi175:Waiting for deploy to finish 2023-10-21T16:23:55.451 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-10-21T16:24:02.266 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-10-21T16:24:10.515 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-10-21T16:24:17.322 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-10-21T16:24:25.579 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-10-21T16:24:32.382 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-10-21T16:24:40.638 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-10-21T16:24:47.447 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-10-21T16:24:55.705 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-10-21T16:25:02.508 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-10-21T16:25:10.770 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-10-21T16:25:17.586 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-10-21T16:25:25.838 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-10-21T16:25:32.654 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-10-21T16:25:40.910 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-10-21T16:25:47.728 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-10-21T16:25:55.974 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-10-21T16:26:02.805 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-10-21T16:26:11.034 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-10-21T16:26:17.866 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-10-21T16:26:26.094 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-10-21T16:26:32.929 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-10-21T16:26:32.989 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T16:26:41.159 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-10-21T16:26:41.213 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T16:26:51.386 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94 2023-10-21T16:26:57.391 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T16:26:59.578 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2023-10-21T16:27:00.442 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94 2023-10-21T16:27:05.583 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T16:27:06.445 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T16:27:08.634 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2023-10-21T16:27:09.498 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94 2023-10-21T16:27:14.639 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T16:27:15.500 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T16:27:17.695 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2023-10-21T16:27:18.558 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94 2023-10-21T16:27:23.698 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T16:27:24.561 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T16:27:26.778 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2023-10-21T16:27:32.782 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T16:28:24.614 WARNING:teuthology.provision.fog.smithi094:timed out 2023-10-21T16:28:30.623 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T16:28:30.954 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-21T16:28:30.955 DEBUG:teuthology.orchestra.run.smithi094:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-21T16:28:31.280 INFO:teuthology.provision.fog.smithi094:Node is ready 2023-10-21T16:28:31.280 DEBUG:teuthology.orchestra.run.smithi094:> hostname 2023-10-21T16:28:31.299 INFO:teuthology.orchestra.run.smithi094.stdout:smithi094.front.sepia.ceph.com 2023-10-21T16:28:31.299 DEBUG:teuthology.orchestra.run.smithi094:> grep smithi094.front.sepia.ceph.com /etc/hosts 2023-10-21T16:28:31.357 INFO:teuthology.orchestra.run.smithi094.stdout:172.21.15.94 smithi094.front.sepia.ceph.com smithi094 2023-10-21T16:28:31.358 DEBUG:teuthology.orchestra.run.smithi094:> sudo hostname smithi094 2023-10-21T16:28:31.517 DEBUG:teuthology.orchestra.run.smithi094:> sudo sed -i -e 's/smithi094.front.sepia.ceph.com/smithi094/g' /etc/hosts 2023-10-21T16:28:31.547 DEBUG:teuthology.orchestra.run.smithi094:> sudo sed -i -e 's/172.21.15.94/172.21.15.94/g' /etc/hosts 2023-10-21T16:28:31.615 DEBUG:teuthology.orchestra.run.smithi094:> sudo sed -i -e 's/smithi094.front.sepia.ceph.com/smithi094/g' /etc/hostname 2023-10-21T16:28:31.684 DEBUG:teuthology.orchestra.run.smithi094:> sudo hostname smithi094 2023-10-21T16:28:31.750 DEBUG:teuthology.orchestra.run.smithi094:> cat /etc/os-release 2023-10-21T16:28:31.808 INFO:teuthology.orchestra.run.smithi094.stdout:NAME="Red Hat Enterprise Linux" 2023-10-21T16:28:31.808 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION="8.6 (Ootpa)" 2023-10-21T16:28:31.808 INFO:teuthology.orchestra.run.smithi094.stdout:ID="rhel" 2023-10-21T16:28:31.808 INFO:teuthology.orchestra.run.smithi094.stdout:ID_LIKE="fedora" 2023-10-21T16:28:31.809 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION_ID="8.6" 2023-10-21T16:28:31.809 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM_ID="platform:el8" 2023-10-21T16:28:31.809 INFO:teuthology.orchestra.run.smithi094.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-21T16:28:31.809 INFO:teuthology.orchestra.run.smithi094.stdout:ANSI_COLOR="0;31" 2023-10-21T16:28:31.809 INFO:teuthology.orchestra.run.smithi094.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-21T16:28:31.810 INFO:teuthology.orchestra.run.smithi094.stdout:HOME_URL="https://www.redhat.com/" 2023-10-21T16:28:31.810 INFO:teuthology.orchestra.run.smithi094.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-21T16:28:31.810 INFO:teuthology.orchestra.run.smithi094.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-21T16:28:31.810 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-21T16:28:31.810 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-21T16:28:31.811 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-21T16:28:31.811 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-21T16:28:31.811 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-21T16:28:31.812 INFO:teuthology.provision.fog.smithi094:Deploy complete! 2023-10-21T16:28:31.813 DEBUG:teuthology.parallel:result is None 2023-10-21T16:28:32.786 WARNING:teuthology.provision.fog.smithi175:timed out 2023-10-21T16:28:38.790 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T16:28:39.145 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-21T16:28:39.145 DEBUG:teuthology.orchestra.run.smithi175:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-21T16:28:39.444 INFO:teuthology.provision.fog.smithi175:Node is ready 2023-10-21T16:28:39.445 DEBUG:teuthology.orchestra.run.smithi175:> hostname 2023-10-21T16:28:39.462 INFO:teuthology.orchestra.run.smithi175.stdout:smithi175.front.sepia.ceph.com 2023-10-21T16:28:39.462 DEBUG:teuthology.orchestra.run.smithi175:> grep smithi175.front.sepia.ceph.com /etc/hosts 2023-10-21T16:28:39.520 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.15.175 smithi175.front.sepia.ceph.com smithi175 2023-10-21T16:28:39.521 DEBUG:teuthology.orchestra.run.smithi175:> sudo hostname smithi175 2023-10-21T16:28:39.640 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/smithi175.front.sepia.ceph.com/smithi175/g' /etc/hosts 2023-10-21T16:28:39.668 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/172.21.15.175/172.21.15.175/g' /etc/hosts 2023-10-21T16:28:39.736 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/smithi175.front.sepia.ceph.com/smithi175/g' /etc/hostname 2023-10-21T16:28:39.802 DEBUG:teuthology.orchestra.run.smithi175:> sudo hostname smithi175 2023-10-21T16:28:39.868 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release 2023-10-21T16:28:39.925 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="Red Hat Enterprise Linux" 2023-10-21T16:28:39.925 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="8.6 (Ootpa)" 2023-10-21T16:28:39.926 INFO:teuthology.orchestra.run.smithi175.stdout:ID="rhel" 2023-10-21T16:28:39.926 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE="fedora" 2023-10-21T16:28:39.926 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="8.6" 2023-10-21T16:28:39.926 INFO:teuthology.orchestra.run.smithi175.stdout:PLATFORM_ID="platform:el8" 2023-10-21T16:28:39.926 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-21T16:28:39.927 INFO:teuthology.orchestra.run.smithi175.stdout:ANSI_COLOR="0;31" 2023-10-21T16:28:39.927 INFO:teuthology.orchestra.run.smithi175.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-21T16:28:39.927 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://www.redhat.com/" 2023-10-21T16:28:39.927 INFO:teuthology.orchestra.run.smithi175.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-21T16:28:39.927 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-21T16:28:39.928 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-10-21T16:28:39.928 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-21T16:28:39.928 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-21T16:28:39.928 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-21T16:28:39.928 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-21T16:28:39.929 INFO:teuthology.provision.fog.smithi175:Deploy complete! 2023-10-21T16:28:39.929 DEBUG:teuthology.parallel:result is None 2023-10-21T16:28:40.081 INFO:teuthology.lock.ops:Checking smithi094.front.sepia.ceph.com 2023-10-21T16:28:40.082 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-21T16:28:40.105 INFO:teuthology.lock.ops:Checking smithi175.front.sepia.ceph.com 2023-10-21T16:28:40.106 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-21T16:28:40.131 INFO:teuthology.lock.ops:Updating [smithi094.front.sepia.ceph.com]: set os type and version on server 2023-10-21T16:28:40.132 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com' 2023-10-21T16:28:40.133 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T16:28:40.199 DEBUG:teuthology.orchestra.run.smithi094:> true 2023-10-21T16:28:40.271 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi094.front.sepia.ceph.com' 2023-10-21T16:28:40.271 DEBUG:teuthology.orchestra.run.smithi094:> uname -m 2023-10-21T16:28:40.331 INFO:teuthology.orchestra.run.smithi094.stdout:x86_64 2023-10-21T16:28:40.331 DEBUG:teuthology.orchestra.run.smithi094:> cat /etc/os-release 2023-10-21T16:28:40.390 INFO:teuthology.orchestra.run.smithi094.stdout:NAME="Red Hat Enterprise Linux" 2023-10-21T16:28:40.391 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION="8.6 (Ootpa)" 2023-10-21T16:28:40.391 INFO:teuthology.orchestra.run.smithi094.stdout:ID="rhel" 2023-10-21T16:28:40.391 INFO:teuthology.orchestra.run.smithi094.stdout:ID_LIKE="fedora" 2023-10-21T16:28:40.392 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION_ID="8.6" 2023-10-21T16:28:40.392 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM_ID="platform:el8" 2023-10-21T16:28:40.392 INFO:teuthology.orchestra.run.smithi094.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-21T16:28:40.392 INFO:teuthology.orchestra.run.smithi094.stdout:ANSI_COLOR="0;31" 2023-10-21T16:28:40.392 INFO:teuthology.orchestra.run.smithi094.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-21T16:28:40.392 INFO:teuthology.orchestra.run.smithi094.stdout:HOME_URL="https://www.redhat.com/" 2023-10-21T16:28:40.393 INFO:teuthology.orchestra.run.smithi094.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-21T16:28:40.393 INFO:teuthology.orchestra.run.smithi094.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-21T16:28:40.393 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-21T16:28:40.393 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-21T16:28:40.393 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-21T16:28:40.394 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-21T16:28:40.394 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-21T16:28:40.394 INFO:teuthology.lock.ops:Updating smithi094.front.sepia.ceph.com on lock server 2023-10-21T16:28:40.414 INFO:teuthology.lock.ops:Updating [smithi175.front.sepia.ceph.com]: set os type and version on server 2023-10-21T16:28:40.415 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2023-10-21T16:28:40.415 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T16:28:40.480 DEBUG:teuthology.orchestra.run.smithi175:> true 2023-10-21T16:28:40.551 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi175.front.sepia.ceph.com' 2023-10-21T16:28:40.551 DEBUG:teuthology.orchestra.run.smithi175:> uname -m 2023-10-21T16:28:40.610 INFO:teuthology.orchestra.run.smithi175.stdout:x86_64 2023-10-21T16:28:40.611 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release 2023-10-21T16:28:40.667 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="Red Hat Enterprise Linux" 2023-10-21T16:28:40.667 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="8.6 (Ootpa)" 2023-10-21T16:28:40.667 INFO:teuthology.orchestra.run.smithi175.stdout:ID="rhel" 2023-10-21T16:28:40.668 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE="fedora" 2023-10-21T16:28:40.668 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="8.6" 2023-10-21T16:28:40.668 INFO:teuthology.orchestra.run.smithi175.stdout:PLATFORM_ID="platform:el8" 2023-10-21T16:28:40.668 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-21T16:28:40.669 INFO:teuthology.orchestra.run.smithi175.stdout:ANSI_COLOR="0;31" 2023-10-21T16:28:40.669 INFO:teuthology.orchestra.run.smithi175.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-21T16:28:40.669 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://www.redhat.com/" 2023-10-21T16:28:40.669 INFO:teuthology.orchestra.run.smithi175.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-21T16:28:40.669 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-21T16:28:40.670 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-10-21T16:28:40.670 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-21T16:28:40.670 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-21T16:28:40.670 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-21T16:28:40.670 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-21T16:28:40.671 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server 2023-10-21T16:28:40.799 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T16:28:40.903 INFO:teuthology.dispatcher.supervisor:Running job 7427666 2023-10-21T16:28:40.904 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2023-10-14_14:23:11-upgrade:pacific-x-reef-distro-default-smithi/7427666 --name teuthology-2023-10-14_14:23:11-upgrade:pacific-x-reef-distro-default-smithi --description upgrade:pacific-x/stress-split/{0-distro/rhel_8.6_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} -- /home/teuthworker/archive/teuthology-2023-10-14_14:23:11-upgrade:pacific-x-reef-distro-default-smithi/7427666/orig.config.yaml 2023-10-21T16:28:40.908 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2023-10-14_14:23:11-upgrade:pacific-x-reef-distro-default-smithi/7427666 2023-10-21T16:28:40.908 INFO:teuthology.dispatcher.supervisor:Job PID: 3689316 2023-10-21T16:28:40.909 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-21T16:30:41.006 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T16:32:41.183 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T16:34:41.351 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T16:36:41.515 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T16:38:41.683 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T16:40:41.855 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T16:42:42.023 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T16:44:42.181 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T16:46:42.367 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T16:48:42.535 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T16:50:42.699 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T16:52:42.867 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T16:54:43.050 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T16:56:43.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T16:58:43.431 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T17:00:43.603 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T17:02:43.781 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T17:04:43.961 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T17:06:44.134 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T17:08:44.291 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T17:10:44.457 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T17:12:44.628 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T17:14:44.795 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T17:16:44.959 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T17:18:45.127 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T17:20:45.292 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T17:22:45.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T17:24:45.627 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T17:26:45.799 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T17:28:45.966 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T17:30:46.127 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T17:32:46.293 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T17:34:46.459 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T17:36:46.591 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T17:38:46.737 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T17:40:46.907 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T17:42:47.067 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T17:42:47.132 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-21T17:42:47.355 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-21T17:42:47.356 INFO:teuthology.nuke:Checking targets against current locks 2023-10-21T17:42:47.405 DEBUG:teuthology.nuke:shortname: smithi094 2023-10-21T17:42:47.405 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-21T17:42:47.419 DEBUG:teuthology.nuke:shortname: smithi175 2023-10-21T17:42:47.419 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-21T17:42:47.428 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi094.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-10-14_14:23:11-upgrade:pacific-x-reef-distro-default-smithi/7427666', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-21 16:23:36.955593', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-21T17:42:47.438 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi175.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-10-14_14:23:11-upgrade:pacific-x-reef-distro-default-smithi/7427666', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-21 16:23:36.957609', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-21T17:42:47.469 INFO:teuthology.orchestra.console.smithi094:Power off 2023-10-21T17:42:47.469 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-21T17:42:47.486 INFO:teuthology.orchestra.console.smithi175:Power off 2023-10-21T17:42:47.487 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-21T17:42:47.495 DEBUG:teuthology.orchestra.console.smithi094:power off output: Chassis Power Control: Down/Off 2023-10-21T17:42:47.495 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T17:42:47.506 DEBUG:teuthology.orchestra.console.smithi175:power off output: Chassis Power Control: Down/Off 2023-10-21T17:42:47.507 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T17:42:47.515 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is off 2023-10-21T17:42:47.527 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off 2023-10-21T17:42:47.617 INFO:teuthology.orchestra.console.smithi094:Power off completed 2023-10-21T17:42:47.628 INFO:teuthology.orchestra.console.smithi175:Power off completed 2023-10-21T17:42:47.765 INFO:teuthology.lock.ops:unlocked: smithi094.front.sepia.ceph.com 2023-10-21T17:42:47.773 INFO:teuthology.lock.ops:unlocked: smithi175.front.sepia.ceph.com