2023-10-01T15:46:36.617 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-01T15:46:36.618 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T15:46:36.751 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4a73ae2670>, signals=[15]) 2023-10-01T15:46:36.752 INFO:teuthology.lock.ops:Start node 'smithi078.front.sepia.ceph.com' reimaging 2023-10-01T15:46:36.752 INFO:teuthology.lock.ops:Updating [smithi078.front.sepia.ceph.com]: reset os type and version on server 2023-10-01T15:46:36.752 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server 2023-10-01T15:46:36.770 INFO:teuthology.lock.ops:Start node 'smithi187.front.sepia.ceph.com' reimaging 2023-10-01T15:46:36.770 INFO:teuthology.lock.ops:Updating [smithi187.front.sepia.ceph.com]: reset os type and version on server 2023-10-01T15:46:36.770 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2023-10-01T15:46:36.771 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /host {"name": "smithi078"} 2023-10-01T15:46:36.794 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /host {"name": "smithi187"} 2023-10-01T15:46:36.854 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-10-01T15:46:36.863 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-10-01T15:46:36.897 DEBUG:teuthology.provision.fog.smithi078:Requesting image smithi_rhel_8.4 (ID 7) 2023-10-01T15:46:36.897 DEBUG:teuthology.provision.fog.smithi078:FOG request: PUT /host/183 {"imageID": 7} 2023-10-01T15:46:36.907 DEBUG:teuthology.provision.fog.smithi187:Requesting image smithi_rhel_8.4 (ID 7) 2023-10-01T15:46:36.907 DEBUG:teuthology.provision.fog.smithi187:FOG request: PUT /host/292 {"imageID": 7} 2023-10-01T15:46:36.944 INFO:teuthology.provision.fog.smithi187:Scheduling deploy of rhel 8.4 2023-10-01T15:46:36.944 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-01T15:46:36.947 INFO:teuthology.provision.fog.smithi078:Scheduling deploy of rhel 8.4 2023-10-01T15:46:36.947 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-10-01T15:46:36.985 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /tasktype {"name": "deploy"} 2023-10-01T15:46:36.988 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /tasktype {"name": "deploy"} 2023-10-01T15:46:37.031 DEBUG:teuthology.provision.fog.smithi078:FOG request: POST /host/183/task {"taskTypeID": 1} 2023-10-01T15:46:37.034 DEBUG:teuthology.provision.fog.smithi187:FOG request: POST /host/292/task {"taskTypeID": 1} 2023-10-01T15:46:37.148 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-01T15:46:37.149 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-10-01T15:46:37.221 INFO:teuthology.orchestra.console.smithi078:Power off 2023-10-01T15:46:37.221 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-01T15:46:37.234 INFO:teuthology.orchestra.console.smithi187:Power off 2023-10-01T15:46:37.234 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-01T15:46:37.243 DEBUG:teuthology.orchestra.console.smithi078:power off output: Chassis Power Control: Down/Off 2023-10-01T15:46:37.244 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T15:46:37.256 DEBUG:teuthology.orchestra.console.smithi187:power off output: Chassis Power Control: Down/Off 2023-10-01T15:46:37.256 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T15:46:37.264 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is on 2023-10-01T15:46:37.276 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on 2023-10-01T15:46:41.269 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T15:46:41.277 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T15:46:41.378 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is on 2023-10-01T15:46:41.385 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on 2023-10-01T15:46:45.379 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T15:46:45.385 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T15:46:45.487 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is on 2023-10-01T15:46:45.729 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on 2023-10-01T15:46:49.731 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T15:46:49.737 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T15:46:49.839 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is off 2023-10-01T15:46:49.845 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off 2023-10-01T15:46:49.940 INFO:teuthology.orchestra.console.smithi078:Power off completed 2023-10-01T15:46:49.946 INFO:teuthology.orchestra.console.smithi187:Power off completed 2023-10-01T15:46:50.041 INFO:teuthology.orchestra.console.smithi078:Power on 2023-10-01T15:46:50.042 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-01T15:46:50.048 INFO:teuthology.orchestra.console.smithi187:Power on 2023-10-01T15:46:50.048 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-01T15:46:50.061 DEBUG:teuthology.orchestra.console.smithi078:power on output: Chassis Power Control: Up/On 2023-10-01T15:46:50.061 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T15:46:50.068 DEBUG:teuthology.orchestra.console.smithi187:power on output: Chassis Power Control: Up/On 2023-10-01T15:46:50.068 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T15:46:50.079 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is off 2023-10-01T15:46:50.087 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off 2023-10-01T15:46:54.084 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T15:46:54.091 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T15:46:54.193 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is off 2023-10-01T15:46:54.198 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off 2023-10-01T15:46:58.198 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T15:46:58.205 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T15:46:58.307 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is on 2023-10-01T15:46:58.313 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on 2023-10-01T15:46:58.408 INFO:teuthology.orchestra.console.smithi078:Power on completed 2023-10-01T15:46:58.414 INFO:teuthology.orchestra.console.smithi187:Power on completed 2023-10-01T15:46:58.509 INFO:teuthology.provision.fog.smithi078:Waiting for deploy to finish 2023-10-01T15:46:58.510 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-10-01T15:46:58.515 INFO:teuthology.provision.fog.smithi187:Waiting for deploy to finish 2023-10-01T15:46:58.515 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-01T15:47:13.570 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-01T15:47:13.573 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-10-01T15:47:28.639 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-01T15:47:28.641 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-10-01T15:47:43.710 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-10-01T15:47:43.711 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-01T15:47:58.773 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-01T15:47:58.775 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-10-01T15:48:13.828 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-01T15:48:13.830 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-10-01T15:48:28.898 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-01T15:48:28.923 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-10-01T15:48:43.987 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-10-01T15:48:43.989 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-01T15:48:59.066 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-01T15:48:59.067 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-10-01T15:49:14.160 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-01T15:49:14.200 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-10-01T15:49:29.272 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-01T15:49:29.273 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-10-01T15:49:44.348 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-10-01T15:49:44.349 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-01T15:49:44.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T15:49:44.406 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T15:50:02.874 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-10-01T15:50:02.875 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78 2023-10-01T15:50:08.881 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T15:50:08.883 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T15:50:11.962 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-10-01T15:50:11.962 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78 2023-10-01T15:50:17.968 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T15:50:17.969 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T15:50:21.018 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-10-01T15:50:21.050 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78 2023-10-01T15:50:27.022 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T15:50:27.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T15:50:30.074 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-10-01T15:50:30.110 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78 2023-10-01T15:50:36.077 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T15:50:36.112 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T15:51:36.140 WARNING:teuthology.provision.fog.smithi187:timed out 2023-10-01T15:51:36.140 WARNING:teuthology.provision.fog.smithi078:timed out 2023-10-01T15:51:42.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T15:51:42.148 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T15:51:42.439 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-01T15:51:42.439 DEBUG:teuthology.orchestra.run.smithi078:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-01T15:51:42.552 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-01T15:51:42.552 DEBUG:teuthology.orchestra.run.smithi187:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-01T15:51:42.704 INFO:teuthology.provision.fog.smithi078:Node is ready 2023-10-01T15:51:42.705 DEBUG:teuthology.orchestra.run.smithi078:> hostname 2023-10-01T15:51:42.758 INFO:teuthology.orchestra.run.smithi078.stdout:smithi078 2023-10-01T15:51:42.759 DEBUG:teuthology.orchestra.run.smithi078:> grep smithi078 /etc/hosts 2023-10-01T15:51:42.812 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78 smithi078.front.sepia.ceph.com smithi078 2023-10-01T15:51:42.813 DEBUG:teuthology.orchestra.run.smithi078:> sudo hostname smithi078 2023-10-01T15:51:42.813 INFO:teuthology.provision.fog.smithi187:Node is ready 2023-10-01T15:51:42.814 DEBUG:teuthology.orchestra.run.smithi187:> hostname 2023-10-01T15:51:42.868 INFO:teuthology.orchestra.run.smithi187.stdout:smithi187 2023-10-01T15:51:42.868 DEBUG:teuthology.orchestra.run.smithi187:> grep smithi187 /etc/hosts 2023-10-01T15:51:42.923 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.15.187 smithi187.front.sepia.ceph.com smithi187 2023-10-01T15:51:42.924 DEBUG:teuthology.orchestra.run.smithi187:> sudo hostname smithi187 2023-10-01T15:51:42.948 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i -e 's/smithi078/smithi078/g' /etc/hosts 2023-10-01T15:51:42.971 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i -e 's/172.21.15.78/172.21.15.78/g' /etc/hosts 2023-10-01T15:51:43.026 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/smithi187/smithi187/g' /etc/hosts 2023-10-01T15:51:43.035 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i -e 's/smithi078/smithi078/g' /etc/hostname 2023-10-01T15:51:43.051 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/172.21.15.187/172.21.15.187/g' /etc/hosts 2023-10-01T15:51:43.098 DEBUG:teuthology.orchestra.run.smithi078:> sudo hostname smithi078 2023-10-01T15:51:43.116 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/smithi187/smithi187/g' /etc/hostname 2023-10-01T15:51:43.161 DEBUG:teuthology.orchestra.run.smithi078:> cat /etc/os-release 2023-10-01T15:51:43.181 DEBUG:teuthology.orchestra.run.smithi187:> sudo hostname smithi187 2023-10-01T15:51:43.215 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="Red Hat Enterprise Linux" 2023-10-01T15:51:43.215 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="8.4 (Ootpa)" 2023-10-01T15:51:43.215 INFO:teuthology.orchestra.run.smithi078.stdout:ID="rhel" 2023-10-01T15:51:43.215 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE="fedora" 2023-10-01T15:51:43.215 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="8.4" 2023-10-01T15:51:43.215 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM_ID="platform:el8" 2023-10-01T15:51:43.216 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-01T15:51:43.216 INFO:teuthology.orchestra.run.smithi078.stdout:ANSI_COLOR="0;31" 2023-10-01T15:51:43.216 INFO:teuthology.orchestra.run.smithi078.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-01T15:51:43.216 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://www.redhat.com/" 2023-10-01T15:51:43.216 INFO:teuthology.orchestra.run.smithi078.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-01T15:51:43.216 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-01T15:51:43.216 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-01T15:51:43.216 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-01T15:51:43.216 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-01T15:51:43.216 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-01T15:51:43.216 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-01T15:51:43.217 INFO:teuthology.provision.fog.smithi078:Deploy complete! 2023-10-01T15:51:43.218 DEBUG:teuthology.parallel:result is None 2023-10-01T15:51:43.245 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release 2023-10-01T15:51:43.299 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="Red Hat Enterprise Linux" 2023-10-01T15:51:43.299 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="8.4 (Ootpa)" 2023-10-01T15:51:43.299 INFO:teuthology.orchestra.run.smithi187.stdout:ID="rhel" 2023-10-01T15:51:43.299 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE="fedora" 2023-10-01T15:51:43.299 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="8.4" 2023-10-01T15:51:43.299 INFO:teuthology.orchestra.run.smithi187.stdout:PLATFORM_ID="platform:el8" 2023-10-01T15:51:43.299 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-01T15:51:43.299 INFO:teuthology.orchestra.run.smithi187.stdout:ANSI_COLOR="0;31" 2023-10-01T15:51:43.299 INFO:teuthology.orchestra.run.smithi187.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-01T15:51:43.299 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://www.redhat.com/" 2023-10-01T15:51:43.300 INFO:teuthology.orchestra.run.smithi187.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-01T15:51:43.300 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-01T15:51:43.300 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-10-01T15:51:43.300 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-01T15:51:43.300 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-01T15:51:43.300 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-01T15:51:43.300 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-01T15:51:43.300 INFO:teuthology.provision.fog.smithi187:Deploy complete! 2023-10-01T15:51:43.301 DEBUG:teuthology.parallel:result is None 2023-10-01T15:51:43.442 INFO:teuthology.lock.ops:Checking smithi078.front.sepia.ceph.com 2023-10-01T15:51:43.442 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-01T15:51:43.462 INFO:teuthology.lock.ops:Checking smithi187.front.sepia.ceph.com 2023-10-01T15:51:43.462 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-01T15:51:43.479 INFO:teuthology.lock.ops:Updating [smithi078.front.sepia.ceph.com]: set os type and version on server 2023-10-01T15:51:43.480 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2023-10-01T15:51:43.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T15:51:43.547 DEBUG:teuthology.orchestra.run.smithi078:> true 2023-10-01T15:51:43.612 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi078.front.sepia.ceph.com' 2023-10-01T15:51:43.612 DEBUG:teuthology.orchestra.run.smithi078:> uname -m 2023-10-01T15:51:43.665 INFO:teuthology.orchestra.run.smithi078.stdout:x86_64 2023-10-01T15:51:43.666 DEBUG:teuthology.orchestra.run.smithi078:> cat /etc/os-release 2023-10-01T15:51:43.719 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="Red Hat Enterprise Linux" 2023-10-01T15:51:43.720 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="8.4 (Ootpa)" 2023-10-01T15:51:43.720 INFO:teuthology.orchestra.run.smithi078.stdout:ID="rhel" 2023-10-01T15:51:43.720 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE="fedora" 2023-10-01T15:51:43.720 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="8.4" 2023-10-01T15:51:43.720 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM_ID="platform:el8" 2023-10-01T15:51:43.720 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-01T15:51:43.721 INFO:teuthology.orchestra.run.smithi078.stdout:ANSI_COLOR="0;31" 2023-10-01T15:51:43.721 INFO:teuthology.orchestra.run.smithi078.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-01T15:51:43.721 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://www.redhat.com/" 2023-10-01T15:51:43.721 INFO:teuthology.orchestra.run.smithi078.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-01T15:51:43.721 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-01T15:51:43.721 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-01T15:51:43.721 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-01T15:51:43.721 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-01T15:51:43.721 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-01T15:51:43.721 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-01T15:51:43.722 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server 2023-10-01T15:51:43.746 INFO:teuthology.lock.ops:Updating [smithi187.front.sepia.ceph.com]: set os type and version on server 2023-10-01T15:51:43.746 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2023-10-01T15:51:43.746 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T15:51:43.813 DEBUG:teuthology.orchestra.run.smithi187:> true 2023-10-01T15:51:43.875 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi187.front.sepia.ceph.com' 2023-10-01T15:51:43.875 DEBUG:teuthology.orchestra.run.smithi187:> uname -m 2023-10-01T15:51:43.929 INFO:teuthology.orchestra.run.smithi187.stdout:x86_64 2023-10-01T15:51:43.930 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release 2023-10-01T15:51:43.983 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="Red Hat Enterprise Linux" 2023-10-01T15:51:43.983 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="8.4 (Ootpa)" 2023-10-01T15:51:43.983 INFO:teuthology.orchestra.run.smithi187.stdout:ID="rhel" 2023-10-01T15:51:43.983 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE="fedora" 2023-10-01T15:51:43.984 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="8.4" 2023-10-01T15:51:43.984 INFO:teuthology.orchestra.run.smithi187.stdout:PLATFORM_ID="platform:el8" 2023-10-01T15:51:43.984 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-01T15:51:43.984 INFO:teuthology.orchestra.run.smithi187.stdout:ANSI_COLOR="0;31" 2023-10-01T15:51:43.984 INFO:teuthology.orchestra.run.smithi187.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-01T15:51:43.984 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://www.redhat.com/" 2023-10-01T15:51:43.984 INFO:teuthology.orchestra.run.smithi187.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-01T15:51:43.984 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-01T15:51:43.984 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-10-01T15:51:43.984 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-01T15:51:43.984 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-01T15:51:43.984 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-01T15:51:43.985 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-01T15:51:43.985 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2023-10-01T15:51:44.004 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T15:51:44.086 INFO:teuthology.dispatcher.supervisor:Running job 7408214 2023-10-01T15:51:44.086 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-10-01_15:20:09-fs-wip-yuri3-testing-2023-10-01-0603-quincy-distro-default-smithi/7408214 --name yuriw-2023-10-01_15:20:09-fs-wip-yuri3-testing-2023-10-01-0603-quincy-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/cap-flush} -- /home/teuthworker/archive/yuriw-2023-10-01_15:20:09-fs-wip-yuri3-testing-2023-10-01-0603-quincy-distro-default-smithi/7408214/orig.config.yaml 2023-10-01T15:51:44.089 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-10-01_15:20:09-fs-wip-yuri3-testing-2023-10-01-0603-quincy-distro-default-smithi/7408214 2023-10-01T15:51:44.090 INFO:teuthology.dispatcher.supervisor:Job PID: 1255389 2023-10-01T15:51:44.090 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-01T15:53:44.174 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T15:55:44.347 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T15:57:44.507 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T15:59:44.679 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T16:01:44.846 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T16:03:45.019 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T16:05:45.191 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T16:07:45.359 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T16:09:45.532 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T16:11:45.703 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T16:13:45.879 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T16:13:45.948 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-10-01T16:13:46.055 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-01T16:13:46.055 INFO:teuthology.nuke:Checking targets against current locks 2023-10-01T16:13:46.101 DEBUG:teuthology.nuke:shortname: smithi078 2023-10-01T16:13:46.101 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-01T16:13:46.124 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi078.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-01_15:20:09-fs-wip-yuri3-testing-2023-10-01-0603-quincy-distro-default-smithi/7408214', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-01 15:46:35.845468', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOIjeg+U6GnGzISgwK19aq5uddmqzzlZ1v8eu+HSahXR7kXD3rsY7QGK5rN59sC6jKq6YLU5Am+E+4ZxNO9SAL0='} 2023-10-01T16:13:46.127 DEBUG:teuthology.nuke:shortname: smithi187 2023-10-01T16:13:46.127 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-01T16:13:46.152 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi187.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-01_15:20:09-fs-wip-yuri3-testing-2023-10-01-0603-quincy-distro-default-smithi/7408214', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-01 15:46:35.843373', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL6r9xF/saYvAlPif+EbseeEZxS1BYKVKmdwwXhrD4AzXzBa63rBx8mGwL6kTkM2/vxRmP3oEkIC+fepI6Zy5Oo='} 2023-10-01T16:13:46.170 INFO:teuthology.orchestra.console.smithi078:Power off 2023-10-01T16:13:46.170 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-01T16:13:46.194 DEBUG:teuthology.orchestra.console.smithi078:power off output: Chassis Power Control: Down/Off 2023-10-01T16:13:46.194 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T16:13:46.207 INFO:teuthology.orchestra.console.smithi187:Power off 2023-10-01T16:13:46.207 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-01T16:13:46.216 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is off 2023-10-01T16:13:46.229 DEBUG:teuthology.orchestra.console.smithi187:power off output: Chassis Power Control: Down/Off 2023-10-01T16:13:46.229 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T16:13:46.254 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off 2023-10-01T16:13:46.317 INFO:teuthology.orchestra.console.smithi078:Power off completed 2023-10-01T16:13:46.355 INFO:teuthology.orchestra.console.smithi187:Power off completed 2023-10-01T16:13:46.483 INFO:teuthology.lock.ops:unlocked: smithi078.front.sepia.ceph.com 2023-10-01T16:13:46.506 INFO:teuthology.lock.ops:unlocked: smithi187.front.sepia.ceph.com