2023-08-15T04:00:04.164 INFO:root:teuthology version: 0.0.1.dev183+g5435569 2023-08-15T04:00:04.165 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T04:00:04.314 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff506979f70>, signals=[15]) 2023-08-15T04:00:04.315 INFO:teuthology.lock.ops:Start node 'smithi079.front.sepia.ceph.com' reimaging 2023-08-15T04:00:04.316 INFO:teuthology.lock.ops:Updating [smithi079.front.sepia.ceph.com]: reset os type and version on server 2023-08-15T04:00:04.316 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2023-08-15T04:00:04.335 INFO:teuthology.lock.ops:Start node 'smithi190.front.sepia.ceph.com' reimaging 2023-08-15T04:00:04.335 INFO:teuthology.lock.ops:Updating [smithi190.front.sepia.ceph.com]: reset os type and version on server 2023-08-15T04:00:04.335 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2023-08-15T04:00:04.337 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /host {"name": "smithi079"} 2023-08-15T04:00:04.359 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /host {"name": "smithi190"} 2023-08-15T04:00:04.423 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-08-15T04:00:04.426 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-08-15T04:00:04.468 DEBUG:teuthology.provision.fog.smithi079:Requesting image smithi_rhel_8.4 (ID 7) 2023-08-15T04:00:04.468 DEBUG:teuthology.provision.fog.smithi079:FOG request: PUT /host/184 {"imageID": 7} 2023-08-15T04:00:04.471 DEBUG:teuthology.provision.fog.smithi190:Requesting image smithi_rhel_8.4 (ID 7) 2023-08-15T04:00:04.471 DEBUG:teuthology.provision.fog.smithi190:FOG request: PUT /host/295 {"imageID": 7} 2023-08-15T04:00:04.520 INFO:teuthology.provision.fog.smithi079:Scheduling deploy of rhel 8.4 2023-08-15T04:00:04.520 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-08-15T04:00:04.523 INFO:teuthology.provision.fog.smithi190:Scheduling deploy of rhel 8.4 2023-08-15T04:00:04.523 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-15T04:00:04.588 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /tasktype {"name": "deploy"} 2023-08-15T04:00:04.592 DEBUG:teuthology.provision.fog.smithi079:Canceling deploy task with ID 438906 2023-08-15T04:00:04.592 DEBUG:teuthology.provision.fog.smithi079:FOG request: DELETE /task/cancel {"id": 438906} 2023-08-15T04:00:04.628 DEBUG:teuthology.provision.fog.smithi190:FOG request: POST /host/295/task {"taskTypeID": 1} 2023-08-15T04:00:04.638 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /tasktype {"name": "deploy"} 2023-08-15T04:00:04.673 DEBUG:teuthology.provision.fog.smithi079:FOG request: POST /host/184/task {"taskTypeID": 1} 2023-08-15T04:00:04.696 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-15T04:00:04.723 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-08-15T04:00:04.810 INFO:teuthology.orchestra.console.smithi190:Power off 2023-08-15T04:00:04.812 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-15T04:00:04.830 INFO:teuthology.orchestra.console.smithi079:Power off 2023-08-15T04:00:04.831 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-15T04:00:04.842 DEBUG:teuthology.orchestra.console.smithi190:power off output: Chassis Power Control: Down/Off 2023-08-15T04:00:04.843 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T04:00:04.854 DEBUG:teuthology.orchestra.console.smithi079:power off output: Chassis Power Control: Down/Off 2023-08-15T04:00:04.855 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T04:00:04.866 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on 2023-08-15T04:00:04.875 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off 2023-08-15T04:00:04.976 INFO:teuthology.orchestra.console.smithi079:Power off completed 2023-08-15T04:00:05.077 INFO:teuthology.orchestra.console.smithi079:Power on 2023-08-15T04:00:05.077 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-15T04:00:05.099 DEBUG:teuthology.orchestra.console.smithi079:power on output: Chassis Power Control: Up/On 2023-08-15T04:00:05.100 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T04:00:05.123 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off 2023-08-15T04:00:08.868 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T04:00:08.978 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on 2023-08-15T04:00:09.125 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T04:00:09.236 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off 2023-08-15T04:00:12.980 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T04:00:13.092 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off 2023-08-15T04:00:13.193 INFO:teuthology.orchestra.console.smithi190:Power off completed 2023-08-15T04:00:13.237 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T04:00:13.295 INFO:teuthology.orchestra.console.smithi190:Power on 2023-08-15T04:00:13.295 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-15T04:00:13.317 DEBUG:teuthology.orchestra.console.smithi190:power on output: Chassis Power Control: Up/On 2023-08-15T04:00:13.318 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T04:00:13.340 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off 2023-08-15T04:00:13.348 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is on 2023-08-15T04:00:13.452 INFO:teuthology.orchestra.console.smithi079:Power on completed 2023-08-15T04:00:13.552 INFO:teuthology.provision.fog.smithi079:Waiting for deploy to finish 2023-08-15T04:00:13.553 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-08-15T04:00:17.345 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T04:00:17.456 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on 2023-08-15T04:00:17.557 INFO:teuthology.orchestra.console.smithi190:Power on completed 2023-08-15T04:00:17.658 INFO:teuthology.provision.fog.smithi190:Waiting for deploy to finish 2023-08-15T04:00:17.658 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-15T04:00:28.644 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-08-15T04:00:32.744 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-15T04:00:43.724 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-08-15T04:00:47.826 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-15T04:00:58.816 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-08-15T04:01:02.908 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-15T04:01:13.904 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-08-15T04:01:17.980 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-15T04:01:29.004 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-08-15T04:01:33.048 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-15T04:01:44.084 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-08-15T04:01:48.123 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-15T04:01:59.164 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-08-15T04:02:03.192 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-15T04:02:14.252 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-08-15T04:02:18.272 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-15T04:02:29.328 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-08-15T04:02:33.352 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-15T04:02:44.405 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-08-15T04:02:48.424 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-15T04:02:59.472 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-08-15T04:02:59.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T04:03:03.497 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-15T04:03:03.552 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T04:03:22.096 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-08-15T04:03:28.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T04:03:31.152 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-08-15T04:03:34.128 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-08-15T04:03:37.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T04:03:40.134 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T04:03:40.209 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-08-15T04:03:43.184 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-08-15T04:03:46.212 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T04:03:49.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T04:03:49.265 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-08-15T04:03:55.272 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T04:04:49.242 WARNING:teuthology.provision.fog.smithi079:timed out 2023-08-15T04:04:55.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T04:04:55.274 WARNING:teuthology.provision.fog.smithi190:timed out 2023-08-15T04:04:55.588 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-15T04:04:55.590 DEBUG:teuthology.orchestra.run.smithi079:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-15T04:04:55.870 INFO:teuthology.provision.fog.smithi079:Node is ready 2023-08-15T04:04:55.870 DEBUG:teuthology.orchestra.run.smithi079:> hostname 2023-08-15T04:04:55.886 INFO:teuthology.orchestra.run.smithi079.stdout:smithi079.front.sepia.ceph.com 2023-08-15T04:04:55.886 DEBUG:teuthology.orchestra.run.smithi079:> grep smithi079.front.sepia.ceph.com /etc/hosts 2023-08-15T04:04:55.943 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79 smithi079.front.sepia.ceph.com smithi079 2023-08-15T04:04:55.943 DEBUG:teuthology.orchestra.run.smithi079:> sudo hostname smithi079 2023-08-15T04:04:56.057 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/smithi079.front.sepia.ceph.com/smithi079/g' /etc/hosts 2023-08-15T04:04:56.084 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/172.21.15.79/172.21.15.79/g' /etc/hosts 2023-08-15T04:04:56.151 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/smithi079.front.sepia.ceph.com/smithi079/g' /etc/hostname 2023-08-15T04:04:56.216 DEBUG:teuthology.orchestra.run.smithi079:> sudo hostname smithi079 2023-08-15T04:04:56.282 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release 2023-08-15T04:04:56.337 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="Red Hat Enterprise Linux" 2023-08-15T04:04:56.338 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="8.4 (Ootpa)" 2023-08-15T04:04:56.338 INFO:teuthology.orchestra.run.smithi079.stdout:ID="rhel" 2023-08-15T04:04:56.338 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="fedora" 2023-08-15T04:04:56.339 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="8.4" 2023-08-15T04:04:56.339 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el8" 2023-08-15T04:04:56.339 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-08-15T04:04:56.340 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31" 2023-08-15T04:04:56.340 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-08-15T04:04:56.341 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://www.redhat.com/" 2023-08-15T04:04:56.341 INFO:teuthology.orchestra.run.smithi079.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-15T04:04:56.342 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-15T04:04:56.342 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-08-15T04:04:56.342 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-15T04:04:56.342 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-08-15T04:04:56.343 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-15T04:04:56.343 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-08-15T04:04:56.345 INFO:teuthology.provision.fog.smithi079:Deploy complete! 2023-08-15T04:04:56.347 DEBUG:teuthology.parallel:result is None 2023-08-15T04:05:01.280 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T04:05:01.638 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-15T04:05:01.639 DEBUG:teuthology.orchestra.run.smithi190:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-15T04:05:01.895 INFO:teuthology.provision.fog.smithi190:Node is ready 2023-08-15T04:05:01.896 DEBUG:teuthology.orchestra.run.smithi190:> hostname 2023-08-15T04:05:01.951 INFO:teuthology.orchestra.run.smithi190.stdout:smithi190.front.sepia.ceph.com 2023-08-15T04:05:01.952 DEBUG:teuthology.orchestra.run.smithi190:> grep smithi190.front.sepia.ceph.com /etc/hosts 2023-08-15T04:05:02.007 INFO:teuthology.orchestra.run.smithi190.stdout:172.21.15.190 smithi190.front.sepia.ceph.com smithi190 2023-08-15T04:05:02.007 DEBUG:teuthology.orchestra.run.smithi190:> sudo hostname smithi190 2023-08-15T04:05:02.121 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/smithi190.front.sepia.ceph.com/smithi190/g' /etc/hosts 2023-08-15T04:05:02.147 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/172.21.15.190/172.21.15.190/g' /etc/hosts 2023-08-15T04:05:02.211 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/smithi190.front.sepia.ceph.com/smithi190/g' /etc/hostname 2023-08-15T04:05:02.276 DEBUG:teuthology.orchestra.run.smithi190:> sudo hostname smithi190 2023-08-15T04:05:02.340 DEBUG:teuthology.orchestra.run.smithi190:> cat /etc/os-release 2023-08-15T04:05:02.395 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="Red Hat Enterprise Linux" 2023-08-15T04:05:02.396 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="8.4 (Ootpa)" 2023-08-15T04:05:02.396 INFO:teuthology.orchestra.run.smithi190.stdout:ID="rhel" 2023-08-15T04:05:02.397 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE="fedora" 2023-08-15T04:05:02.397 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="8.4" 2023-08-15T04:05:02.397 INFO:teuthology.orchestra.run.smithi190.stdout:PLATFORM_ID="platform:el8" 2023-08-15T04:05:02.398 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-08-15T04:05:02.398 INFO:teuthology.orchestra.run.smithi190.stdout:ANSI_COLOR="0;31" 2023-08-15T04:05:02.398 INFO:teuthology.orchestra.run.smithi190.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-08-15T04:05:02.398 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://www.redhat.com/" 2023-08-15T04:05:02.399 INFO:teuthology.orchestra.run.smithi190.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-15T04:05:02.399 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-15T04:05:02.399 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-08-15T04:05:02.400 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-15T04:05:02.400 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-08-15T04:05:02.400 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-15T04:05:02.400 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-08-15T04:05:02.401 INFO:teuthology.provision.fog.smithi190:Deploy complete! 2023-08-15T04:05:02.402 DEBUG:teuthology.parallel:result is None 2023-08-15T04:05:02.559 INFO:teuthology.lock.ops:Checking smithi079.front.sepia.ceph.com 2023-08-15T04:05:02.560 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-15T04:05:02.586 INFO:teuthology.lock.ops:Checking smithi190.front.sepia.ceph.com 2023-08-15T04:05:02.586 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-15T04:05:02.612 INFO:teuthology.lock.ops:Updating [smithi079.front.sepia.ceph.com]: set os type and version on server 2023-08-15T04:05:02.612 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-08-15T04:05:02.613 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T04:05:02.679 DEBUG:teuthology.orchestra.run.smithi079:> true 2023-08-15T04:05:02.744 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-08-15T04:05:02.745 DEBUG:teuthology.orchestra.run.smithi079:> uname -m 2023-08-15T04:05:02.801 INFO:teuthology.orchestra.run.smithi079.stdout:x86_64 2023-08-15T04:05:02.802 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release 2023-08-15T04:05:02.858 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="Red Hat Enterprise Linux" 2023-08-15T04:05:02.858 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="8.4 (Ootpa)" 2023-08-15T04:05:02.858 INFO:teuthology.orchestra.run.smithi079.stdout:ID="rhel" 2023-08-15T04:05:02.859 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="fedora" 2023-08-15T04:05:02.859 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="8.4" 2023-08-15T04:05:02.859 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el8" 2023-08-15T04:05:02.859 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-08-15T04:05:02.859 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31" 2023-08-15T04:05:02.859 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-08-15T04:05:02.859 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://www.redhat.com/" 2023-08-15T04:05:02.860 INFO:teuthology.orchestra.run.smithi079.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-15T04:05:02.860 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-15T04:05:02.860 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-08-15T04:05:02.860 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-15T04:05:02.860 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-08-15T04:05:02.860 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-15T04:05:02.860 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-08-15T04:05:02.861 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2023-08-15T04:05:02.885 INFO:teuthology.lock.ops:Updating [smithi190.front.sepia.ceph.com]: set os type and version on server 2023-08-15T04:05:02.886 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-08-15T04:05:02.888 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T04:05:02.955 DEBUG:teuthology.orchestra.run.smithi190:> true 2023-08-15T04:05:02.975 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-08-15T04:05:02.976 DEBUG:teuthology.orchestra.run.smithi190:> uname -m 2023-08-15T04:05:03.030 INFO:teuthology.orchestra.run.smithi190.stdout:x86_64 2023-08-15T04:05:03.031 DEBUG:teuthology.orchestra.run.smithi190:> cat /etc/os-release 2023-08-15T04:05:03.084 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="Red Hat Enterprise Linux" 2023-08-15T04:05:03.085 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="8.4 (Ootpa)" 2023-08-15T04:05:03.085 INFO:teuthology.orchestra.run.smithi190.stdout:ID="rhel" 2023-08-15T04:05:03.085 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE="fedora" 2023-08-15T04:05:03.085 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="8.4" 2023-08-15T04:05:03.085 INFO:teuthology.orchestra.run.smithi190.stdout:PLATFORM_ID="platform:el8" 2023-08-15T04:05:03.085 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-08-15T04:05:03.085 INFO:teuthology.orchestra.run.smithi190.stdout:ANSI_COLOR="0;31" 2023-08-15T04:05:03.086 INFO:teuthology.orchestra.run.smithi190.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-08-15T04:05:03.086 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://www.redhat.com/" 2023-08-15T04:05:03.086 INFO:teuthology.orchestra.run.smithi190.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-15T04:05:03.086 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-15T04:05:03.086 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-08-15T04:05:03.087 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-15T04:05:03.087 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-08-15T04:05:03.087 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-15T04:05:03.087 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-08-15T04:05:03.088 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2023-08-15T04:05:03.110 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T04:05:03.202 INFO:teuthology.dispatcher.supervisor:Running job 7367793 2023-08-15T04:05:03.202 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-08-15_01:22:18-fs-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7367793 --name yuriw-2023-08-15_01:22:18-fs-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi --description fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/quota} -- /home/teuthworker/archive/yuriw-2023-08-15_01:22:18-fs-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7367793/orig.config.yaml 2023-08-15T04:05:03.207 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-08-15_01:22:18-fs-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7367793 2023-08-15T04:05:03.208 INFO:teuthology.dispatcher.supervisor:Job PID: 3661 2023-08-15T04:05:03.209 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-15T04:07:03.308 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T04:07:03.389 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-15T04:07:03.503 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi079 but it was locked by another job: /home/teuthworker/archive/yuriw-2023-08-15_01:22:18-fs-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7367797 2023-08-15T04:07:03.503 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-15T04:07:03.504 INFO:teuthology.nuke:Checking targets against current locks 2023-08-15T04:07:03.553 DEBUG:teuthology.nuke:shortname: smithi079 2023-08-15T04:07:03.554 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-15T04:07:03.574 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi079.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-15_01:22:18-fs-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7367797', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-15 04:06:25.822545', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDRgmRhutVphkjR4EmKBHaOD1zRDyhrxAvUfcshxiM791RF9QUPX2BcYxNSI+ucS/DMtt6kSgipOOX54ut0tyEoVG6fIx/nGkkleEXXjJ5x9cmv80LTXvFXeC8Nva1yXtHElFwSNr6PVBYjcMO02Q0nMhaSMIb7fdecj587H9JpTUI1V3Hjj4KGNYkd5TlMzcvi+zWFyjRLCzufmppbbwM+rT9Gok++WuXIE8sgO2WvAa8eNnK17C7qg9UNa7Nh41ipRJphfdNwib21tLg1V7EnayCObnQ7GfDZw1FZEkpLeNOS7aTzFrf41ijiepEXKZ+yqBHWKTbgh3/KZwZowuyP6XhLDQqTHH6NBFyKuRtx9ZlEKKb/OQPWQS7XnTLwqadIcKiwYU8BQVpRUsfrNQFKHok/YPkFvb3O8iNosIVJXcsI4mmiYEaop3evZA2i2zV3F4ETmJ5eEFjJ6ijZ1H+1ZqOZzv2ZrpyN0ZHFOw1NHOUn3TyG15mH+I3ETFfNSKs='} 2023-08-15T04:07:03.577 DEBUG:teuthology.nuke:shortname: smithi190 2023-08-15T04:07:03.577 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-15T04:07:03.600 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi190.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-15_01:22:18-fs-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7367793', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-15 04:00:03.328706', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDGElOTyd/tLCgoFVAscv8WgWj/fA2dLhhf62eSwrlRHXab4m5cC6qAXF5q1EvhcbUVPZvEzgzo9E4FUUfbfpoh3AFNu4uzmiKGk3EWWUbH9iBei5m8PXP1L1I7LBno3rbTnEJqVmumSanZCPWzpZlc4JpYz7rfd/7JmwM2IptDmAiyTG9w4orGUgh3HN0U5lks8n5c1feZ2I7NVheQj1yovzZIMrX5xykfHxDWHkBzTCysufIibkjSds8DHZ0XwsZdX73nmnWQPKb7/WVLRDYM1Rpbnb28+3l6D4OYKqwRjWmD4w65in4+U/X/P1bndzxMDFbr5b4+H53YnrZs6MHvFoqeBulFNc7xAa9ps/DffQMMb9OdyASe8Piw9SxD/0bfk2FTX8jX5GJ3rvSL0doRPwwm0Nc+AYZoMZSnnLYt7xSIx/2dHGsEP5+G/cxY2iRVMw6cWH+XXqtfu2+aEFK+/JQO8HWX9yVZP5U+3BY645T9fKkvnnd3vSQrWno1EUU='} 2023-08-15T04:07:03.617 INFO:teuthology.orchestra.console.smithi079:Power off 2023-08-15T04:07:03.618 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-15T04:07:03.642 DEBUG:teuthology.orchestra.console.smithi079:power off output: Chassis Power Control: Down/Off 2023-08-15T04:07:03.642 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T04:07:03.660 INFO:teuthology.orchestra.console.smithi190:Power off 2023-08-15T04:07:03.661 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-15T04:07:03.673 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is on 2023-08-15T04:07:03.683 DEBUG:teuthology.orchestra.console.smithi190:power off output: Chassis Power Control: Down/Off 2023-08-15T04:07:03.683 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T04:07:03.705 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off 2023-08-15T04:07:03.806 INFO:teuthology.orchestra.console.smithi190:Power off completed 2023-08-15T04:07:03.973 INFO:teuthology.lock.ops:unlocked: smithi190.front.sepia.ceph.com 2023-08-15T04:07:07.677 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T04:07:07.788 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is on 2023-08-15T04:07:11.792 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T04:07:11.904 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is on 2023-08-15T04:07:15.908 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T04:07:16.018 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off 2023-08-15T04:07:16.119 INFO:teuthology.orchestra.console.smithi079:Power off completed 2023-08-15T04:07:16.279 INFO:teuthology.lock.ops:unlocked: smithi079.front.sepia.ceph.com