2023-10-18T18:20:39.052 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-18T18:20:39.054 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T18:20:39.204 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb4075b1670>, signals=[15]) 2023-10-18T18:20:39.205 INFO:teuthology.lock.ops:Start node 'smithi053.front.sepia.ceph.com' reimaging 2023-10-18T18:20:39.205 INFO:teuthology.lock.ops:Updating [smithi053.front.sepia.ceph.com]: reset os type and version on server 2023-10-18T18:20:39.206 INFO:teuthology.lock.ops:Updating smithi053.front.sepia.ceph.com on lock server 2023-10-18T18:20:39.228 INFO:teuthology.lock.ops:Start node 'smithi152.front.sepia.ceph.com' reimaging 2023-10-18T18:20:39.228 INFO:teuthology.lock.ops:Updating [smithi152.front.sepia.ceph.com]: reset os type and version on server 2023-10-18T18:20:39.229 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server 2023-10-18T18:20:39.230 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /host {"name": "smithi053"} 2023-10-18T18:20:39.253 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /host {"name": "smithi152"} 2023-10-18T18:20:39.321 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-10-18T18:20:39.376 DEBUG:teuthology.provision.fog.smithi152:Requesting image smithi_rhel_8.4 (ID 7) 2023-10-18T18:20:39.377 DEBUG:teuthology.provision.fog.smithi152:FOG request: PUT /host/257 {"imageID": 7} 2023-10-18T18:20:39.401 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-10-18T18:20:39.425 INFO:teuthology.provision.fog.smithi152:Scheduling deploy of rhel 8.4 2023-10-18T18:20:39.425 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-10-18T18:20:39.444 DEBUG:teuthology.provision.fog.smithi053:Requesting image smithi_rhel_8.4 (ID 7) 2023-10-18T18:20:39.444 DEBUG:teuthology.provision.fog.smithi053:FOG request: PUT /host/158 {"imageID": 7} 2023-10-18T18:20:39.487 INFO:teuthology.provision.fog.smithi053:Scheduling deploy of rhel 8.4 2023-10-18T18:20:39.488 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-10-18T18:20:39.498 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /tasktype {"name": "deploy"} 2023-10-18T18:20:39.533 DEBUG:teuthology.provision.fog.smithi152:FOG request: POST /host/257/task {"taskTypeID": 1} 2023-10-18T18:20:39.568 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /tasktype {"name": "deploy"} 2023-10-18T18:20:39.603 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-10-18T18:20:39.607 DEBUG:teuthology.provision.fog.smithi053:FOG request: POST /host/158/task {"taskTypeID": 1} 2023-10-18T18:20:39.674 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-10-18T18:20:39.729 INFO:teuthology.orchestra.console.smithi152:Power off 2023-10-18T18:20:39.730 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-18T18:20:39.752 DEBUG:teuthology.orchestra.console.smithi152:power off output: Chassis Power Control: Down/Off 2023-10-18T18:20:39.753 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T18:20:39.771 INFO:teuthology.orchestra.console.smithi053:Power off 2023-10-18T18:20:39.772 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-18T18:20:39.779 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off 2023-10-18T18:20:39.792 DEBUG:teuthology.orchestra.console.smithi053:power off output: Chassis Power Control: Down/Off 2023-10-18T18:20:39.792 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T18:20:39.814 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is off 2023-10-18T18:20:39.880 INFO:teuthology.orchestra.console.smithi152:Power off completed 2023-10-18T18:20:39.916 INFO:teuthology.orchestra.console.smithi053:Power off completed 2023-10-18T18:20:39.982 INFO:teuthology.orchestra.console.smithi152:Power on 2023-10-18T18:20:39.982 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-18T18:20:40.003 DEBUG:teuthology.orchestra.console.smithi152:power on output: Chassis Power Control: Up/On 2023-10-18T18:20:40.004 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T18:20:40.018 INFO:teuthology.orchestra.console.smithi053:Power on 2023-10-18T18:20:40.018 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-18T18:20:40.028 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off 2023-10-18T18:20:40.041 DEBUG:teuthology.orchestra.console.smithi053:power on output: Chassis Power Control: Up/On 2023-10-18T18:20:40.041 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T18:20:40.062 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is off 2023-10-18T18:20:44.030 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T18:20:44.064 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T18:20:44.140 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off 2023-10-18T18:20:44.173 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is on 2023-10-18T18:20:44.273 INFO:teuthology.orchestra.console.smithi053:Power on completed 2023-10-18T18:20:44.374 INFO:teuthology.provision.fog.smithi053:Waiting for deploy to finish 2023-10-18T18:20:44.375 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-10-18T18:20:48.142 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T18:20:48.251 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on 2023-10-18T18:20:48.352 INFO:teuthology.orchestra.console.smithi152:Power on completed 2023-10-18T18:20:48.453 INFO:teuthology.provision.fog.smithi152:Waiting for deploy to finish 2023-10-18T18:20:48.454 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-10-18T18:20:59.458 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-10-18T18:21:03.542 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-10-18T18:21:14.530 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-10-18T18:21:18.621 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-10-18T18:21:29.606 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-10-18T18:21:33.702 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-10-18T18:21:44.682 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-10-18T18:21:48.778 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-10-18T18:21:59.766 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-10-18T18:22:03.846 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-10-18T18:22:14.834 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-10-18T18:22:18.902 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-10-18T18:22:29.895 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-10-18T18:22:33.973 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-10-18T18:22:44.958 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-10-18T18:22:49.034 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-10-18T18:23:00.018 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-10-18T18:23:04.090 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-10-18T18:23:15.078 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-10-18T18:23:15.137 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T18:23:19.142 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-10-18T18:23:33.503 WARNING:teuthology.provision.fog.smithi053:[Errno None] Unable to connect to port 22 on 172.21.15.53 2023-10-18T18:23:34.198 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-10-18T18:23:39.506 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T18:23:42.590 WARNING:teuthology.provision.fog.smithi053:[Errno None] Unable to connect to port 22 on 172.21.15.53 2023-10-18T18:23:48.594 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T18:23:49.260 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-10-18T18:23:51.674 WARNING:teuthology.provision.fog.smithi053:[Errno None] Unable to connect to port 22 on 172.21.15.53 2023-10-18T18:23:57.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T18:24:04.330 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-10-18T18:24:19.398 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-10-18T18:24:34.470 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-10-18T18:24:49.541 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-10-18T18:24:49.599 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T18:24:57.690 WARNING:teuthology.provision.fog.smithi053:timed out 2023-10-18T18:25:03.695 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T18:25:03.985 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-18T18:25:03.986 DEBUG:teuthology.orchestra.run.smithi053:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-18T18:25:04.251 INFO:teuthology.provision.fog.smithi053:Node is ready 2023-10-18T18:25:04.252 DEBUG:teuthology.orchestra.run.smithi053:> hostname 2023-10-18T18:25:04.307 INFO:teuthology.orchestra.run.smithi053.stdout:smithi053.front.sepia.ceph.com 2023-10-18T18:25:04.308 DEBUG:teuthology.orchestra.run.smithi053:> grep smithi053.front.sepia.ceph.com /etc/hosts 2023-10-18T18:25:04.364 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53 smithi053.front.sepia.ceph.com smithi053 2023-10-18T18:25:04.364 DEBUG:teuthology.orchestra.run.smithi053:> sudo hostname smithi053 2023-10-18T18:25:04.475 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i -e 's/smithi053.front.sepia.ceph.com/smithi053/g' /etc/hosts 2023-10-18T18:25:04.503 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i -e 's/172.21.15.53/172.21.15.53/g' /etc/hosts 2023-10-18T18:25:04.570 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i -e 's/smithi053.front.sepia.ceph.com/smithi053/g' /etc/hostname 2023-10-18T18:25:04.635 DEBUG:teuthology.orchestra.run.smithi053:> sudo hostname smithi053 2023-10-18T18:25:04.701 DEBUG:teuthology.orchestra.run.smithi053:> cat /etc/os-release 2023-10-18T18:25:04.756 INFO:teuthology.orchestra.run.smithi053.stdout:NAME="Red Hat Enterprise Linux" 2023-10-18T18:25:04.757 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION="8.4 (Ootpa)" 2023-10-18T18:25:04.757 INFO:teuthology.orchestra.run.smithi053.stdout:ID="rhel" 2023-10-18T18:25:04.757 INFO:teuthology.orchestra.run.smithi053.stdout:ID_LIKE="fedora" 2023-10-18T18:25:04.758 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION_ID="8.4" 2023-10-18T18:25:04.758 INFO:teuthology.orchestra.run.smithi053.stdout:PLATFORM_ID="platform:el8" 2023-10-18T18:25:04.758 INFO:teuthology.orchestra.run.smithi053.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-18T18:25:04.759 INFO:teuthology.orchestra.run.smithi053.stdout:ANSI_COLOR="0;31" 2023-10-18T18:25:04.759 INFO:teuthology.orchestra.run.smithi053.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-18T18:25:04.759 INFO:teuthology.orchestra.run.smithi053.stdout:HOME_URL="https://www.redhat.com/" 2023-10-18T18:25:04.760 INFO:teuthology.orchestra.run.smithi053.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-18T18:25:04.760 INFO:teuthology.orchestra.run.smithi053.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-18T18:25:04.760 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-10-18T18:25:04.760 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-18T18:25:04.760 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-18T18:25:04.761 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-18T18:25:04.761 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-18T18:25:04.762 INFO:teuthology.provision.fog.smithi053:Deploy complete! 2023-10-18T18:25:04.763 DEBUG:teuthology.parallel:result is None 2023-10-18T18:25:07.962 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-10-18T18:25:13.966 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T18:25:17.018 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-10-18T18:25:23.022 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T18:25:26.078 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-10-18T18:25:32.082 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T18:25:35.162 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-10-18T18:25:41.165 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T18:25:44.218 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-10-18T18:25:50.226 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T18:26:08.635 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-10-18T18:26:14.642 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T18:26:17.722 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-10-18T18:26:23.726 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T18:26:26.778 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-10-18T18:26:32.782 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T18:26:33.142 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-18T18:26:33.143 DEBUG:teuthology.orchestra.run.smithi152:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-18T18:26:53.373 INFO:teuthology.provision.fog.smithi152:Node is ready 2023-10-18T18:26:53.373 DEBUG:teuthology.orchestra.run.smithi152:> hostname 2023-10-18T18:26:53.388 INFO:teuthology.orchestra.run.smithi152.stdout:smithi152.front.sepia.ceph.com 2023-10-18T18:26:53.389 DEBUG:teuthology.orchestra.run.smithi152:> grep smithi152.front.sepia.ceph.com /etc/hosts 2023-10-18T18:26:53.443 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152 smithi152.front.sepia.ceph.com smithi152 2023-10-18T18:26:53.444 DEBUG:teuthology.orchestra.run.smithi152:> sudo hostname smithi152 2023-10-18T18:26:53.592 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/smithi152.front.sepia.ceph.com/smithi152/g' /etc/hosts 2023-10-18T18:26:53.616 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/172.21.15.152/172.21.15.152/g' /etc/hosts 2023-10-18T18:26:53.679 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/smithi152.front.sepia.ceph.com/smithi152/g' /etc/hostname 2023-10-18T18:26:53.745 DEBUG:teuthology.orchestra.run.smithi152:> sudo hostname smithi152 2023-10-18T18:26:53.809 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release 2023-10-18T18:26:53.863 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="Red Hat Enterprise Linux" 2023-10-18T18:26:53.863 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="8.4 (Ootpa)" 2023-10-18T18:26:53.863 INFO:teuthology.orchestra.run.smithi152.stdout:ID="rhel" 2023-10-18T18:26:53.864 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="fedora" 2023-10-18T18:26:53.864 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="8.4" 2023-10-18T18:26:53.864 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM_ID="platform:el8" 2023-10-18T18:26:53.864 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-18T18:26:53.864 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31" 2023-10-18T18:26:53.865 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-18T18:26:53.865 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://www.redhat.com/" 2023-10-18T18:26:53.865 INFO:teuthology.orchestra.run.smithi152.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-18T18:26:53.865 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-18T18:26:53.865 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-18T18:26:53.866 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-18T18:26:53.866 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-18T18:26:53.866 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-18T18:26:53.866 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-18T18:26:53.867 INFO:teuthology.provision.fog.smithi152:Deploy complete! 2023-10-18T18:26:53.867 DEBUG:teuthology.parallel:result is None 2023-10-18T18:26:54.016 INFO:teuthology.lock.ops:Checking smithi053.front.sepia.ceph.com 2023-10-18T18:26:54.017 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-18T18:26:54.041 INFO:teuthology.lock.ops:Checking smithi152.front.sepia.ceph.com 2023-10-18T18:26:54.041 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-18T18:26:54.059 INFO:teuthology.lock.ops:Updating [smithi053.front.sepia.ceph.com]: set os type and version on server 2023-10-18T18:26:54.059 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2023-10-18T18:26:54.060 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T18:26:54.133 DEBUG:teuthology.orchestra.run.smithi053:> true 2023-10-18T18:26:54.213 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi053.front.sepia.ceph.com' 2023-10-18T18:26:54.213 DEBUG:teuthology.orchestra.run.smithi053:> uname -m 2023-10-18T18:26:54.267 INFO:teuthology.orchestra.run.smithi053.stdout:x86_64 2023-10-18T18:26:54.268 DEBUG:teuthology.orchestra.run.smithi053:> cat /etc/os-release 2023-10-18T18:26:54.322 INFO:teuthology.orchestra.run.smithi053.stdout:NAME="Red Hat Enterprise Linux" 2023-10-18T18:26:54.323 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION="8.4 (Ootpa)" 2023-10-18T18:26:54.323 INFO:teuthology.orchestra.run.smithi053.stdout:ID="rhel" 2023-10-18T18:26:54.323 INFO:teuthology.orchestra.run.smithi053.stdout:ID_LIKE="fedora" 2023-10-18T18:26:54.323 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION_ID="8.4" 2023-10-18T18:26:54.324 INFO:teuthology.orchestra.run.smithi053.stdout:PLATFORM_ID="platform:el8" 2023-10-18T18:26:54.324 INFO:teuthology.orchestra.run.smithi053.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-18T18:26:54.324 INFO:teuthology.orchestra.run.smithi053.stdout:ANSI_COLOR="0;31" 2023-10-18T18:26:54.324 INFO:teuthology.orchestra.run.smithi053.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-18T18:26:54.325 INFO:teuthology.orchestra.run.smithi053.stdout:HOME_URL="https://www.redhat.com/" 2023-10-18T18:26:54.325 INFO:teuthology.orchestra.run.smithi053.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-18T18:26:54.325 INFO:teuthology.orchestra.run.smithi053.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-18T18:26:54.325 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-10-18T18:26:54.325 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-18T18:26:54.326 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-18T18:26:54.326 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-18T18:26:54.326 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-18T18:26:54.327 INFO:teuthology.lock.ops:Updating smithi053.front.sepia.ceph.com on lock server 2023-10-18T18:26:54.349 INFO:teuthology.lock.ops:Updating [smithi152.front.sepia.ceph.com]: set os type and version on server 2023-10-18T18:26:54.349 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2023-10-18T18:26:54.350 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T18:26:54.420 DEBUG:teuthology.orchestra.run.smithi152:> true 2023-10-18T18:26:54.484 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi152.front.sepia.ceph.com' 2023-10-18T18:26:54.484 DEBUG:teuthology.orchestra.run.smithi152:> uname -m 2023-10-18T18:26:54.541 INFO:teuthology.orchestra.run.smithi152.stdout:x86_64 2023-10-18T18:26:54.542 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release 2023-10-18T18:26:54.599 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="Red Hat Enterprise Linux" 2023-10-18T18:26:54.599 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="8.4 (Ootpa)" 2023-10-18T18:26:54.600 INFO:teuthology.orchestra.run.smithi152.stdout:ID="rhel" 2023-10-18T18:26:54.600 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="fedora" 2023-10-18T18:26:54.600 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="8.4" 2023-10-18T18:26:54.600 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM_ID="platform:el8" 2023-10-18T18:26:54.600 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-18T18:26:54.601 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31" 2023-10-18T18:26:54.601 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-18T18:26:54.601 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://www.redhat.com/" 2023-10-18T18:26:54.601 INFO:teuthology.orchestra.run.smithi152.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-18T18:26:54.601 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-18T18:26:54.602 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-18T18:26:54.602 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-18T18:26:54.602 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-18T18:26:54.602 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-18T18:26:54.602 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-18T18:26:54.603 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server 2023-10-18T18:26:54.624 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T18:26:54.734 INFO:teuthology.dispatcher.supervisor:Running job 7429198 2023-10-18T18:26:54.735 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-10-16_12:48:28-fs-wip-vshankar-testing-pacific-20231016.091648-testing-default-smithi/7429198 --name vshankar-2023-10-16_12:48:28-fs-wip-vshankar-testing-pacific-20231016.091648-testing-default-smithi --description fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_misc} -- /home/teuthworker/archive/vshankar-2023-10-16_12:48:28-fs-wip-vshankar-testing-pacific-20231016.091648-testing-default-smithi/7429198/orig.config.yaml 2023-10-18T18:26:54.737 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-10-16_12:48:28-fs-wip-vshankar-testing-pacific-20231016.091648-testing-default-smithi/7429198 2023-10-18T18:26:54.738 INFO:teuthology.dispatcher.supervisor:Job PID: 2057856 2023-10-18T18:26:54.739 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-18T18:28:54.838 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T18:30:55.007 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T18:32:55.175 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T18:34:55.340 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T18:36:55.515 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T18:38:55.667 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T18:40:55.835 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T18:42:56.003 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T18:44:56.163 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T18:46:56.327 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T18:48:56.499 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T18:48:56.564 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-18T18:48:56.665 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-18T18:48:56.666 INFO:teuthology.nuke:Checking targets against current locks 2023-10-18T18:48:56.716 DEBUG:teuthology.nuke:shortname: smithi053 2023-10-18T18:48:56.717 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-18T18:48:56.746 DEBUG:teuthology.nuke:shortname: smithi152 2023-10-18T18:48:56.746 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-18T18:48:56.748 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi053.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-10-16_12:48:28-fs-wip-vshankar-testing-pacific-20231016.091648-testing-default-smithi/7429198', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-18 18:20:38.246398', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBErVVsgPu02GlrGATc7uSP7CQcojcDa6vfSqTAWN4+SMtPpAdJ1o1B0kiHNns4aPeHCoFg8vNOUN5JHIsq3D56I='} 2023-10-18T18:48:56.775 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi152.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-10-16_12:48:28-fs-wip-vshankar-testing-pacific-20231016.091648-testing-default-smithi/7429198', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-18 18:20:38.248248', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEv6AQmSYOYoPGfPdLVoutrVHA3m0IxA+AXFmDnhwQ0HozT4KrQlEDA/yMG56/QMSTeRAMtxLXR/DWkvRnzwXNo='} 2023-10-18T18:48:56.801 INFO:teuthology.orchestra.console.smithi053:Power off 2023-10-18T18:48:56.802 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-18T18:48:56.823 DEBUG:teuthology.orchestra.console.smithi053:power off output: Chassis Power Control: Down/Off 2023-10-18T18:48:56.824 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T18:48:56.844 INFO:teuthology.orchestra.console.smithi152:Power off 2023-10-18T18:48:56.845 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-18T18:48:56.853 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is off 2023-10-18T18:48:56.868 DEBUG:teuthology.orchestra.console.smithi152:power off output: Chassis Power Control: Down/Off 2023-10-18T18:48:56.868 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T18:48:56.893 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off 2023-10-18T18:48:56.955 INFO:teuthology.orchestra.console.smithi053:Power off completed 2023-10-18T18:48:56.994 INFO:teuthology.orchestra.console.smithi152:Power off completed 2023-10-18T18:48:57.105 INFO:teuthology.lock.ops:unlocked: smithi053.front.sepia.ceph.com 2023-10-18T18:48:57.139 INFO:teuthology.lock.ops:unlocked: smithi152.front.sepia.ceph.com