2023-10-10T10:32:29.804 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-10T10:32:29.806 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T10:32:29.978 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f564d069670>, signals=[15]) 2023-10-10T10:32:29.980 INFO:teuthology.lock.ops:Start node 'smithi049.front.sepia.ceph.com' reimaging 2023-10-10T10:32:29.980 INFO:teuthology.lock.ops:Updating [smithi049.front.sepia.ceph.com]: reset os type and version on server 2023-10-10T10:32:29.980 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server 2023-10-10T10:32:30.008 INFO:teuthology.lock.ops:Start node 'smithi179.front.sepia.ceph.com' reimaging 2023-10-10T10:32:30.008 INFO:teuthology.lock.ops:Updating [smithi179.front.sepia.ceph.com]: reset os type and version on server 2023-10-10T10:32:30.008 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server 2023-10-10T10:32:30.010 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /host {"name": "smithi049"} 2023-10-10T10:32:30.098 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-10-10T10:32:30.125 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /host {"name": "smithi179"} 2023-10-10T10:32:30.147 DEBUG:teuthology.provision.fog.smithi049:Requesting image smithi_rhel_8.4 (ID 7) 2023-10-10T10:32:30.147 DEBUG:teuthology.provision.fog.smithi049:FOG request: PUT /host/154 {"imageID": 7} 2023-10-10T10:32:30.206 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-10-10T10:32:30.214 INFO:teuthology.provision.fog.smithi049:Scheduling deploy of rhel 8.4 2023-10-10T10:32:30.215 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-10-10T10:32:30.261 DEBUG:teuthology.provision.fog.smithi179:Requesting image smithi_rhel_8.4 (ID 7) 2023-10-10T10:32:30.261 DEBUG:teuthology.provision.fog.smithi179:FOG request: PUT /host/284 {"imageID": 7} 2023-10-10T10:32:30.300 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /tasktype {"name": "deploy"} 2023-10-10T10:32:30.312 INFO:teuthology.provision.fog.smithi179:Scheduling deploy of rhel 8.4 2023-10-10T10:32:30.312 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-10-10T10:32:30.345 DEBUG:teuthology.provision.fog.smithi049:FOG request: POST /host/154/task {"taskTypeID": 1} 2023-10-10T10:32:30.394 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /tasktype {"name": "deploy"} 2023-10-10T10:32:30.431 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-10-10T10:32:30.437 DEBUG:teuthology.provision.fog.smithi179:FOG request: POST /host/284/task {"taskTypeID": 1} 2023-10-10T10:32:30.499 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-10-10T10:32:30.549 INFO:teuthology.orchestra.console.smithi049:Power off 2023-10-10T10:32:30.551 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-10T10:32:30.598 DEBUG:teuthology.orchestra.console.smithi049:power off output: Chassis Power Control: Down/Off 2023-10-10T10:32:30.599 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T10:32:30.618 INFO:teuthology.orchestra.console.smithi179:Power off 2023-10-10T10:32:30.620 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-10T10:32:30.646 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is on 2023-10-10T10:32:30.664 DEBUG:teuthology.orchestra.console.smithi179:power off output: Chassis Power Control: Down/Off 2023-10-10T10:32:30.664 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T10:32:30.691 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2023-10-10T10:32:30.792 INFO:teuthology.orchestra.console.smithi179:Power off completed 2023-10-10T10:32:30.893 INFO:teuthology.orchestra.console.smithi179:Power on 2023-10-10T10:32:30.893 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-10T10:32:30.928 DEBUG:teuthology.orchestra.console.smithi179:power on output: Chassis Power Control: Up/On 2023-10-10T10:32:30.929 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T10:32:30.955 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2023-10-10T10:32:34.650 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T10:32:34.760 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is on 2023-10-10T10:32:34.959 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T10:32:35.070 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2023-10-10T10:32:35.171 INFO:teuthology.orchestra.console.smithi179:Power on completed 2023-10-10T10:32:35.273 INFO:teuthology.provision.fog.smithi179:Waiting for deploy to finish 2023-10-10T10:32:35.273 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-10-10T10:32:38.764 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T10:32:38.873 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off 2023-10-10T10:32:38.975 INFO:teuthology.orchestra.console.smithi049:Power off completed 2023-10-10T10:32:39.077 INFO:teuthology.orchestra.console.smithi049:Power on 2023-10-10T10:32:39.078 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-10T10:32:39.101 DEBUG:teuthology.orchestra.console.smithi049:power on output: Chassis Power Control: Up/On 2023-10-10T10:32:39.101 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T10:32:39.124 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off 2023-10-10T10:32:43.128 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T10:32:43.237 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off 2023-10-10T10:32:47.242 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T10:32:47.353 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is on 2023-10-10T10:32:47.454 INFO:teuthology.orchestra.console.smithi049:Power on completed 2023-10-10T10:32:47.555 INFO:teuthology.provision.fog.smithi049:Waiting for deploy to finish 2023-10-10T10:32:47.557 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-10-10T10:32:50.354 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-10-10T10:33:02.662 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-10-10T10:33:05.448 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-10-10T10:33:17.754 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-10-10T10:33:20.530 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-10-10T10:33:32.850 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-10-10T10:33:35.614 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-10-10T10:33:47.942 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-10-10T10:33:50.706 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-10-10T10:34:03.030 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-10-10T10:34:05.795 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-10-10T10:34:18.110 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-10-10T10:34:20.883 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-10-10T10:34:33.202 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-10-10T10:34:35.968 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-10-10T10:34:48.286 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-10-10T10:34:51.042 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-10-10T10:35:03.354 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-10-10T10:35:06.102 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-10-10T10:35:18.434 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-10-10T10:35:21.166 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-10-10T10:35:21.227 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T10:35:33.506 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-10-10T10:35:39.770 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-10-10T10:35:45.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T10:35:48.570 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-10-10T10:35:48.830 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-10-10T10:35:54.834 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T10:35:57.914 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-10-10T10:36:03.638 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-10-10T10:36:03.916 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T10:36:06.970 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-10-10T10:36:12.976 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T10:36:16.058 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-10-10T10:36:18.711 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-10-10T10:36:18.780 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T10:36:22.062 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T10:36:37.114 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-10-10T10:36:43.119 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T10:36:46.170 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-10-10T10:36:52.174 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T10:36:55.230 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-10-10T10:37:01.234 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T10:37:04.314 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-10-10T10:37:10.318 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T10:37:13.370 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-10-10T10:37:19.375 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T10:37:22.066 WARNING:teuthology.provision.fog.smithi179:timed out 2023-10-10T10:37:22.430 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-10-10T10:37:28.070 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T10:37:28.386 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-10T10:37:28.387 DEBUG:teuthology.orchestra.run.smithi179:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-10T10:37:28.432 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T10:37:28.666 INFO:teuthology.provision.fog.smithi179:Node is ready 2023-10-10T10:37:28.667 DEBUG:teuthology.orchestra.run.smithi179:> hostname 2023-10-10T10:37:28.723 INFO:teuthology.orchestra.run.smithi179.stdout:smithi179 2023-10-10T10:37:28.724 DEBUG:teuthology.orchestra.run.smithi179:> grep smithi179 /etc/hosts 2023-10-10T10:37:28.779 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.15.179 smithi179.front.sepia.ceph.com smithi179 2023-10-10T10:37:28.780 DEBUG:teuthology.orchestra.run.smithi179:> sudo hostname smithi179 2023-10-10T10:37:28.894 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/smithi179/smithi179/g' /etc/hosts 2023-10-10T10:37:28.921 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/172.21.15.179/172.21.15.179/g' /etc/hosts 2023-10-10T10:37:28.986 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/smithi179/smithi179/g' /etc/hostname 2023-10-10T10:37:29.051 DEBUG:teuthology.orchestra.run.smithi179:> sudo hostname smithi179 2023-10-10T10:37:29.116 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release 2023-10-10T10:37:29.170 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="Red Hat Enterprise Linux" 2023-10-10T10:37:29.171 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="8.4 (Ootpa)" 2023-10-10T10:37:29.171 INFO:teuthology.orchestra.run.smithi179.stdout:ID="rhel" 2023-10-10T10:37:29.171 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE="fedora" 2023-10-10T10:37:29.171 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="8.4" 2023-10-10T10:37:29.171 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM_ID="platform:el8" 2023-10-10T10:37:29.172 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-10T10:37:29.172 INFO:teuthology.orchestra.run.smithi179.stdout:ANSI_COLOR="0;31" 2023-10-10T10:37:29.172 INFO:teuthology.orchestra.run.smithi179.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-10T10:37:29.172 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://www.redhat.com/" 2023-10-10T10:37:29.172 INFO:teuthology.orchestra.run.smithi179.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-10T10:37:29.173 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-10T10:37:29.173 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-10T10:37:29.173 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-10T10:37:29.173 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-10T10:37:29.173 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-10T10:37:29.174 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-10T10:37:29.174 INFO:teuthology.provision.fog.smithi179:Deploy complete! 2023-10-10T10:37:29.175 DEBUG:teuthology.parallel:result is None 2023-10-10T10:37:31.514 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-10-10T10:37:37.518 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T10:37:40.570 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-10-10T10:37:46.574 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T10:37:49.630 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-10-10T10:37:55.634 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T10:38:55.695 WARNING:teuthology.provision.fog.smithi049:timed out 2023-10-10T10:39:01.699 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T10:39:02.017 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-10T10:39:02.017 DEBUG:teuthology.orchestra.run.smithi049:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-10T10:39:02.283 INFO:teuthology.provision.fog.smithi049:Node is ready 2023-10-10T10:39:02.284 DEBUG:teuthology.orchestra.run.smithi049:> hostname 2023-10-10T10:39:02.299 INFO:teuthology.orchestra.run.smithi049.stdout:smithi049.front.sepia.ceph.com 2023-10-10T10:39:02.300 DEBUG:teuthology.orchestra.run.smithi049:> grep smithi049.front.sepia.ceph.com /etc/hosts 2023-10-10T10:39:02.356 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49 smithi049.front.sepia.ceph.com smithi049 2023-10-10T10:39:02.356 DEBUG:teuthology.orchestra.run.smithi049:> sudo hostname smithi049 2023-10-10T10:39:02.474 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i -e 's/smithi049.front.sepia.ceph.com/smithi049/g' /etc/hosts 2023-10-10T10:39:02.501 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i -e 's/172.21.15.49/172.21.15.49/g' /etc/hosts 2023-10-10T10:39:02.567 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i -e 's/smithi049.front.sepia.ceph.com/smithi049/g' /etc/hostname 2023-10-10T10:39:02.633 DEBUG:teuthology.orchestra.run.smithi049:> sudo hostname smithi049 2023-10-10T10:39:02.697 DEBUG:teuthology.orchestra.run.smithi049:> cat /etc/os-release 2023-10-10T10:39:02.752 INFO:teuthology.orchestra.run.smithi049.stdout:NAME="Red Hat Enterprise Linux" 2023-10-10T10:39:02.752 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION="8.4 (Ootpa)" 2023-10-10T10:39:02.753 INFO:teuthology.orchestra.run.smithi049.stdout:ID="rhel" 2023-10-10T10:39:02.753 INFO:teuthology.orchestra.run.smithi049.stdout:ID_LIKE="fedora" 2023-10-10T10:39:02.753 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_ID="8.4" 2023-10-10T10:39:02.753 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM_ID="platform:el8" 2023-10-10T10:39:02.753 INFO:teuthology.orchestra.run.smithi049.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-10T10:39:02.754 INFO:teuthology.orchestra.run.smithi049.stdout:ANSI_COLOR="0;31" 2023-10-10T10:39:02.754 INFO:teuthology.orchestra.run.smithi049.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-10T10:39:02.754 INFO:teuthology.orchestra.run.smithi049.stdout:HOME_URL="https://www.redhat.com/" 2023-10-10T10:39:02.754 INFO:teuthology.orchestra.run.smithi049.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-10T10:39:02.755 INFO:teuthology.orchestra.run.smithi049.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-10T10:39:02.755 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-10-10T10:39:02.755 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-10T10:39:02.755 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-10T10:39:02.755 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-10T10:39:02.755 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-10T10:39:02.756 INFO:teuthology.provision.fog.smithi049:Deploy complete! 2023-10-10T10:39:02.757 DEBUG:teuthology.parallel:result is None 2023-10-10T10:39:02.910 INFO:teuthology.lock.ops:Checking smithi049.front.sepia.ceph.com 2023-10-10T10:39:02.911 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-10T10:39:02.941 INFO:teuthology.lock.ops:Checking smithi179.front.sepia.ceph.com 2023-10-10T10:39:02.941 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-10T10:39:02.958 INFO:teuthology.lock.ops:Updating [smithi049.front.sepia.ceph.com]: set os type and version on server 2023-10-10T10:39:02.958 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2023-10-10T10:39:02.959 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T10:39:03.024 DEBUG:teuthology.orchestra.run.smithi049:> true 2023-10-10T10:39:03.088 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi049.front.sepia.ceph.com' 2023-10-10T10:39:03.089 DEBUG:teuthology.orchestra.run.smithi049:> uname -m 2023-10-10T10:39:03.143 INFO:teuthology.orchestra.run.smithi049.stdout:x86_64 2023-10-10T10:39:03.143 DEBUG:teuthology.orchestra.run.smithi049:> cat /etc/os-release 2023-10-10T10:39:03.198 INFO:teuthology.orchestra.run.smithi049.stdout:NAME="Red Hat Enterprise Linux" 2023-10-10T10:39:03.198 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION="8.4 (Ootpa)" 2023-10-10T10:39:03.198 INFO:teuthology.orchestra.run.smithi049.stdout:ID="rhel" 2023-10-10T10:39:03.199 INFO:teuthology.orchestra.run.smithi049.stdout:ID_LIKE="fedora" 2023-10-10T10:39:03.199 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_ID="8.4" 2023-10-10T10:39:03.199 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM_ID="platform:el8" 2023-10-10T10:39:03.199 INFO:teuthology.orchestra.run.smithi049.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-10T10:39:03.199 INFO:teuthology.orchestra.run.smithi049.stdout:ANSI_COLOR="0;31" 2023-10-10T10:39:03.200 INFO:teuthology.orchestra.run.smithi049.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-10T10:39:03.200 INFO:teuthology.orchestra.run.smithi049.stdout:HOME_URL="https://www.redhat.com/" 2023-10-10T10:39:03.200 INFO:teuthology.orchestra.run.smithi049.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-10T10:39:03.200 INFO:teuthology.orchestra.run.smithi049.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-10T10:39:03.200 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-10-10T10:39:03.201 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-10T10:39:03.201 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-10T10:39:03.201 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-10T10:39:03.201 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-10T10:39:03.202 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server 2023-10-10T10:39:03.224 INFO:teuthology.lock.ops:Updating [smithi179.front.sepia.ceph.com]: set os type and version on server 2023-10-10T10:39:03.225 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2023-10-10T10:39:03.225 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T10:39:03.290 DEBUG:teuthology.orchestra.run.smithi179:> true 2023-10-10T10:39:03.413 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi179.front.sepia.ceph.com' 2023-10-10T10:39:03.414 DEBUG:teuthology.orchestra.run.smithi179:> uname -m 2023-10-10T10:39:03.468 INFO:teuthology.orchestra.run.smithi179.stdout:x86_64 2023-10-10T10:39:03.469 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release 2023-10-10T10:39:03.523 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="Red Hat Enterprise Linux" 2023-10-10T10:39:03.524 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="8.4 (Ootpa)" 2023-10-10T10:39:03.524 INFO:teuthology.orchestra.run.smithi179.stdout:ID="rhel" 2023-10-10T10:39:03.524 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE="fedora" 2023-10-10T10:39:03.524 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="8.4" 2023-10-10T10:39:03.524 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM_ID="platform:el8" 2023-10-10T10:39:03.525 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-10T10:39:03.525 INFO:teuthology.orchestra.run.smithi179.stdout:ANSI_COLOR="0;31" 2023-10-10T10:39:03.525 INFO:teuthology.orchestra.run.smithi179.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-10T10:39:03.525 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://www.redhat.com/" 2023-10-10T10:39:03.525 INFO:teuthology.orchestra.run.smithi179.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-10T10:39:03.526 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-10T10:39:03.526 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-10T10:39:03.526 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-10T10:39:03.526 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-10T10:39:03.527 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-10T10:39:03.527 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-10T10:39:03.527 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server 2023-10-10T10:39:03.549 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T10:39:03.639 INFO:teuthology.dispatcher.supervisor:Running job 7419538 2023-10-10T10:39:03.639 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-10-10_04:31:01-fs-wip-yuri3-testing-2023-10-09-0727-quincy-distro-default-smithi/7419538 --name yuriw-2023-10-10_04:31:01-fs-wip-yuri3-testing-2023-10-09-0727-quincy-distro-default-smithi --description fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps} -- /home/teuthworker/archive/yuriw-2023-10-10_04:31:01-fs-wip-yuri3-testing-2023-10-09-0727-quincy-distro-default-smithi/7419538/orig.config.yaml 2023-10-10T10:39:03.642 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-10-10_04:31:01-fs-wip-yuri3-testing-2023-10-09-0727-quincy-distro-default-smithi/7419538 2023-10-10T10:39:03.643 INFO:teuthology.dispatcher.supervisor:Job PID: 1312280 2023-10-10T10:39:03.643 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-10T10:41:03.742 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T10:43:03.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T10:45:04.071 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T10:47:04.156 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T10:49:04.327 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T10:51:04.495 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T10:53:04.662 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T10:55:04.827 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T10:57:05.004 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T10:59:05.167 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T11:01:05.335 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T11:03:05.510 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T11:05:05.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T11:07:05.864 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T11:09:06.043 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T11:11:06.227 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T11:13:06.396 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T11:15:06.563 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T11:17:06.731 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T11:19:06.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T11:21:07.067 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T11:21:07.135 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-10T11:21:07.324 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-10T11:21:07.325 INFO:teuthology.nuke:Checking targets against current locks 2023-10-10T11:21:07.380 DEBUG:teuthology.nuke:shortname: smithi049 2023-10-10T11:21:07.380 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-10T11:21:07.398 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi049.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-10_04:31:01-fs-wip-yuri3-testing-2023-10-09-0727-quincy-distro-default-smithi/7419538', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-10 10:32:29.005901', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKHuQHbPml9x70GdtWM6ncNU0P6mfpKH3iK8ZXnu7wS3+I69z/VKtpoYZLjXsLeGeLXK7MKfWIvHn2ZN/Fl6vaQ='} 2023-10-10T11:21:07.402 DEBUG:teuthology.nuke:shortname: smithi179 2023-10-10T11:21:07.403 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-10T11:21:07.423 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi179.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-10_04:31:01-fs-wip-yuri3-testing-2023-10-09-0727-quincy-distro-default-smithi/7419538', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-10 10:32:29.004658', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIBAwyOdkDMHB30UX6yeu9x/Flzinm6jEjGhK1rNJ0HXlGAw3md/4W89VYUX9veTmfIQ+yQajEg6O8O5H+0iH7g='} 2023-10-10T11:21:07.454 INFO:teuthology.orchestra.console.smithi049:Power off 2023-10-10T11:21:07.454 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-10T11:21:07.477 DEBUG:teuthology.orchestra.console.smithi049:power off output: Chassis Power Control: Down/Off 2023-10-10T11:21:07.478 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T11:21:07.494 INFO:teuthology.orchestra.console.smithi179:Power off 2023-10-10T11:21:07.494 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-10T11:21:07.504 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off 2023-10-10T11:21:07.522 DEBUG:teuthology.orchestra.console.smithi179:power off output: Chassis Power Control: Down/Off 2023-10-10T11:21:07.523 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T11:21:07.545 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2023-10-10T11:21:07.605 INFO:teuthology.orchestra.console.smithi049:Power off completed 2023-10-10T11:21:07.647 INFO:teuthology.orchestra.console.smithi179:Power off completed 2023-10-10T11:21:07.759 INFO:teuthology.lock.ops:unlocked: smithi049.front.sepia.ceph.com 2023-10-10T11:21:07.792 INFO:teuthology.lock.ops:unlocked: smithi179.front.sepia.ceph.com