2023-10-16T07:06:30.450 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-16T07:06:30.452 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T07:06:30.645 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7efc56b97c10>, signals=[15]) 2023-10-16T07:06:30.646 INFO:teuthology.lock.ops:Start node 'smithi064.front.sepia.ceph.com' reimaging 2023-10-16T07:06:30.647 INFO:teuthology.lock.ops:Updating [smithi064.front.sepia.ceph.com]: reset os type and version on server 2023-10-16T07:06:30.647 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server 2023-10-16T07:06:30.692 INFO:teuthology.lock.ops:Start node 'smithi081.front.sepia.ceph.com' reimaging 2023-10-16T07:06:30.692 INFO:teuthology.lock.ops:Updating [smithi081.front.sepia.ceph.com]: reset os type and version on server 2023-10-16T07:06:30.693 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2023-10-16T07:06:30.694 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /host {"name": "smithi064"} 2023-10-16T07:06:30.733 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /host {"name": "smithi081"} 2023-10-16T07:06:30.801 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-10-16T07:06:30.828 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-10-16T07:06:30.850 DEBUG:teuthology.provision.fog.smithi064:Requesting image smithi_rhel_8.6 (ID 5) 2023-10-16T07:06:30.850 DEBUG:teuthology.provision.fog.smithi064:FOG request: PUT /host/169 {"imageID": 5} 2023-10-16T07:06:30.880 DEBUG:teuthology.provision.fog.smithi081:Requesting image smithi_rhel_8.6 (ID 5) 2023-10-16T07:06:30.880 DEBUG:teuthology.provision.fog.smithi081:FOG request: PUT /host/186 {"imageID": 5} 2023-10-16T07:06:30.904 INFO:teuthology.provision.fog.smithi064:Scheduling deploy of rhel 8.6 2023-10-16T07:06:30.904 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-10-16T07:06:30.942 INFO:teuthology.provision.fog.smithi081:Scheduling deploy of rhel 8.6 2023-10-16T07:06:30.943 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-10-16T07:06:30.955 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /tasktype {"name": "deploy"} 2023-10-16T07:06:30.998 DEBUG:teuthology.provision.fog.smithi064:FOG request: POST /host/169/task {"taskTypeID": 1} 2023-10-16T07:06:31.015 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /tasktype {"name": "deploy"} 2023-10-16T07:06:31.057 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-10-16T07:06:31.068 DEBUG:teuthology.provision.fog.smithi081:FOG request: POST /host/186/task {"taskTypeID": 1} 2023-10-16T07:06:31.133 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-10-16T07:06:31.188 INFO:teuthology.orchestra.console.smithi064:Power off 2023-10-16T07:06:31.189 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-16T07:06:31.218 DEBUG:teuthology.orchestra.console.smithi064:power off output: Chassis Power Control: Down/Off 2023-10-16T07:06:31.219 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T07:06:31.237 INFO:teuthology.orchestra.console.smithi081:Power off 2023-10-16T07:06:31.238 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-16T07:06:31.255 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off 2023-10-16T07:06:31.283 DEBUG:teuthology.orchestra.console.smithi081:power off output: Chassis Power Control: Down/Off 2023-10-16T07:06:31.283 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T07:06:31.312 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off 2023-10-16T07:06:31.356 INFO:teuthology.orchestra.console.smithi064:Power off completed 2023-10-16T07:06:31.414 INFO:teuthology.orchestra.console.smithi081:Power off completed 2023-10-16T07:06:31.457 INFO:teuthology.orchestra.console.smithi064:Power on 2023-10-16T07:06:31.457 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-16T07:06:31.487 DEBUG:teuthology.orchestra.console.smithi064:power on output: Chassis Power Control: Up/On 2023-10-16T07:06:31.487 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T07:06:31.515 INFO:teuthology.orchestra.console.smithi081:Power on 2023-10-16T07:06:31.516 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-16T07:06:31.524 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off 2023-10-16T07:06:31.547 DEBUG:teuthology.orchestra.console.smithi081:power on output: Chassis Power Control: Up/On 2023-10-16T07:06:31.548 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T07:06:31.577 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off 2023-10-16T07:06:35.526 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T07:06:35.578 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T07:06:35.636 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on 2023-10-16T07:06:35.689 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off 2023-10-16T07:06:35.737 INFO:teuthology.orchestra.console.smithi064:Power on completed 2023-10-16T07:06:35.838 INFO:teuthology.provision.fog.smithi064:Waiting for deploy to finish 2023-10-16T07:06:35.839 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-10-16T07:06:39.694 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T07:06:39.802 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on 2023-10-16T07:06:39.903 INFO:teuthology.orchestra.console.smithi081:Power on completed 2023-10-16T07:06:40.004 INFO:teuthology.provision.fog.smithi081:Waiting for deploy to finish 2023-10-16T07:06:40.005 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-10-16T07:06:50.914 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-10-16T07:06:55.080 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-10-16T07:07:05.988 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-10-16T07:07:10.146 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-10-16T07:07:21.069 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-10-16T07:07:25.218 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-10-16T07:07:36.142 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-10-16T07:07:40.310 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-10-16T07:07:51.230 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-10-16T07:07:55.378 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-10-16T07:08:06.303 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-10-16T07:08:10.450 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-10-16T07:08:21.367 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-10-16T07:08:25.526 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-10-16T07:08:36.442 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-10-16T07:08:40.598 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-10-16T07:08:51.525 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-10-16T07:08:55.674 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-10-16T07:09:06.612 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-10-16T07:09:10.746 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-10-16T07:09:21.698 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-10-16T07:09:21.772 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T07:09:25.820 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-10-16T07:09:25.885 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T07:09:40.347 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-10-16T07:09:44.442 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-10-16T07:09:46.350 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T07:09:49.438 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-10-16T07:09:50.444 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T07:09:53.534 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-10-16T07:09:55.442 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T07:09:58.522 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-10-16T07:09:59.537 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T07:10:02.618 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-10-16T07:10:04.524 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T07:10:07.610 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-10-16T07:10:08.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T07:10:11.706 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-10-16T07:10:13.614 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T07:10:17.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T07:11:13.679 WARNING:teuthology.provision.fog.smithi064:timed out 2023-10-16T07:11:17.744 WARNING:teuthology.provision.fog.smithi081:timed out 2023-10-16T07:11:19.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T07:11:20.034 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-16T07:11:20.035 DEBUG:teuthology.orchestra.run.smithi064:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-16T07:11:20.318 INFO:teuthology.provision.fog.smithi064:Node is ready 2023-10-16T07:11:20.319 DEBUG:teuthology.orchestra.run.smithi064:> hostname 2023-10-16T07:11:20.336 INFO:teuthology.orchestra.run.smithi064.stdout:smithi064.front.sepia.ceph.com 2023-10-16T07:11:20.337 DEBUG:teuthology.orchestra.run.smithi064:> grep smithi064.front.sepia.ceph.com /etc/hosts 2023-10-16T07:11:20.395 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64 smithi064.front.sepia.ceph.com smithi064 2023-10-16T07:11:20.395 DEBUG:teuthology.orchestra.run.smithi064:> sudo hostname smithi064 2023-10-16T07:11:20.515 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/smithi064.front.sepia.ceph.com/smithi064/g' /etc/hosts 2023-10-16T07:11:20.545 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/172.21.15.64/172.21.15.64/g' /etc/hosts 2023-10-16T07:11:20.615 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/smithi064.front.sepia.ceph.com/smithi064/g' /etc/hostname 2023-10-16T07:11:20.684 DEBUG:teuthology.orchestra.run.smithi064:> sudo hostname smithi064 2023-10-16T07:11:20.753 DEBUG:teuthology.orchestra.run.smithi064:> cat /etc/os-release 2023-10-16T07:11:20.811 INFO:teuthology.orchestra.run.smithi064.stdout:NAME="Red Hat Enterprise Linux" 2023-10-16T07:11:20.811 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION="8.6 (Ootpa)" 2023-10-16T07:11:20.811 INFO:teuthology.orchestra.run.smithi064.stdout:ID="rhel" 2023-10-16T07:11:20.812 INFO:teuthology.orchestra.run.smithi064.stdout:ID_LIKE="fedora" 2023-10-16T07:11:20.812 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_ID="8.6" 2023-10-16T07:11:20.812 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM_ID="platform:el8" 2023-10-16T07:11:20.812 INFO:teuthology.orchestra.run.smithi064.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-16T07:11:20.812 INFO:teuthology.orchestra.run.smithi064.stdout:ANSI_COLOR="0;31" 2023-10-16T07:11:20.813 INFO:teuthology.orchestra.run.smithi064.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-16T07:11:20.813 INFO:teuthology.orchestra.run.smithi064.stdout:HOME_URL="https://www.redhat.com/" 2023-10-16T07:11:20.813 INFO:teuthology.orchestra.run.smithi064.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-16T07:11:20.813 INFO:teuthology.orchestra.run.smithi064.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-16T07:11:20.813 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-16T07:11:20.814 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-16T07:11:20.814 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-16T07:11:20.814 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-16T07:11:20.814 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-16T07:11:20.815 INFO:teuthology.provision.fog.smithi064:Deploy complete! 2023-10-16T07:11:20.818 DEBUG:teuthology.parallel:result is None 2023-10-16T07:11:23.749 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T07:11:24.111 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-16T07:11:24.112 DEBUG:teuthology.orchestra.run.smithi081:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-16T07:11:24.412 INFO:teuthology.provision.fog.smithi081:Node is ready 2023-10-16T07:11:24.412 DEBUG:teuthology.orchestra.run.smithi081:> hostname 2023-10-16T07:11:24.430 INFO:teuthology.orchestra.run.smithi081.stdout:smithi081.front.sepia.ceph.com 2023-10-16T07:11:24.431 DEBUG:teuthology.orchestra.run.smithi081:> grep smithi081.front.sepia.ceph.com /etc/hosts 2023-10-16T07:11:24.488 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81 smithi081.front.sepia.ceph.com smithi081 2023-10-16T07:11:24.489 DEBUG:teuthology.orchestra.run.smithi081:> sudo hostname smithi081 2023-10-16T07:11:24.608 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/smithi081.front.sepia.ceph.com/smithi081/g' /etc/hosts 2023-10-16T07:11:24.638 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/172.21.15.81/172.21.15.81/g' /etc/hosts 2023-10-16T07:11:24.706 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/smithi081.front.sepia.ceph.com/smithi081/g' /etc/hostname 2023-10-16T07:11:24.772 DEBUG:teuthology.orchestra.run.smithi081:> sudo hostname smithi081 2023-10-16T07:11:24.839 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release 2023-10-16T07:11:24.897 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="Red Hat Enterprise Linux" 2023-10-16T07:11:24.897 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="8.6 (Ootpa)" 2023-10-16T07:11:24.897 INFO:teuthology.orchestra.run.smithi081.stdout:ID="rhel" 2023-10-16T07:11:24.897 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="fedora" 2023-10-16T07:11:24.897 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="8.6" 2023-10-16T07:11:24.898 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el8" 2023-10-16T07:11:24.898 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-16T07:11:24.898 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31" 2023-10-16T07:11:24.898 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-16T07:11:24.898 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://www.redhat.com/" 2023-10-16T07:11:24.898 INFO:teuthology.orchestra.run.smithi081.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-16T07:11:24.899 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-16T07:11:24.899 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-16T07:11:24.899 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-16T07:11:24.899 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-16T07:11:24.899 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-16T07:11:24.900 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-16T07:11:24.900 INFO:teuthology.provision.fog.smithi081:Deploy complete! 2023-10-16T07:11:24.900 DEBUG:teuthology.parallel:result is None 2023-10-16T07:11:25.178 INFO:teuthology.lock.ops:Checking smithi064.front.sepia.ceph.com 2023-10-16T07:11:25.178 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-16T07:11:25.215 INFO:teuthology.lock.ops:Checking smithi081.front.sepia.ceph.com 2023-10-16T07:11:25.215 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-16T07:11:25.257 INFO:teuthology.lock.ops:Updating [smithi064.front.sepia.ceph.com]: set os type and version on server 2023-10-16T07:11:25.258 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi064.front.sepia.ceph.com' 2023-10-16T07:11:25.258 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T07:11:25.334 DEBUG:teuthology.orchestra.run.smithi064:> true 2023-10-16T07:11:25.407 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi064.front.sepia.ceph.com' 2023-10-16T07:11:25.407 DEBUG:teuthology.orchestra.run.smithi064:> uname -m 2023-10-16T07:11:25.465 INFO:teuthology.orchestra.run.smithi064.stdout:x86_64 2023-10-16T07:11:25.465 DEBUG:teuthology.orchestra.run.smithi064:> cat /etc/os-release 2023-10-16T07:11:25.522 INFO:teuthology.orchestra.run.smithi064.stdout:NAME="Red Hat Enterprise Linux" 2023-10-16T07:11:25.522 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION="8.6 (Ootpa)" 2023-10-16T07:11:25.523 INFO:teuthology.orchestra.run.smithi064.stdout:ID="rhel" 2023-10-16T07:11:25.523 INFO:teuthology.orchestra.run.smithi064.stdout:ID_LIKE="fedora" 2023-10-16T07:11:25.523 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_ID="8.6" 2023-10-16T07:11:25.523 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM_ID="platform:el8" 2023-10-16T07:11:25.523 INFO:teuthology.orchestra.run.smithi064.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-16T07:11:25.524 INFO:teuthology.orchestra.run.smithi064.stdout:ANSI_COLOR="0;31" 2023-10-16T07:11:25.524 INFO:teuthology.orchestra.run.smithi064.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-16T07:11:25.524 INFO:teuthology.orchestra.run.smithi064.stdout:HOME_URL="https://www.redhat.com/" 2023-10-16T07:11:25.524 INFO:teuthology.orchestra.run.smithi064.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-16T07:11:25.524 INFO:teuthology.orchestra.run.smithi064.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-16T07:11:25.525 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-16T07:11:25.525 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-16T07:11:25.525 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-16T07:11:25.525 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-16T07:11:25.525 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-16T07:11:25.526 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server 2023-10-16T07:11:25.556 INFO:teuthology.lock.ops:Updating [smithi081.front.sepia.ceph.com]: set os type and version on server 2023-10-16T07:11:25.556 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-10-16T07:11:25.557 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T07:11:25.632 DEBUG:teuthology.orchestra.run.smithi081:> true 2023-10-16T07:11:25.701 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-10-16T07:11:25.701 DEBUG:teuthology.orchestra.run.smithi081:> uname -m 2023-10-16T07:11:25.760 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64 2023-10-16T07:11:25.760 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release 2023-10-16T07:11:25.819 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="Red Hat Enterprise Linux" 2023-10-16T07:11:25.819 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="8.6 (Ootpa)" 2023-10-16T07:11:25.819 INFO:teuthology.orchestra.run.smithi081.stdout:ID="rhel" 2023-10-16T07:11:25.820 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="fedora" 2023-10-16T07:11:25.820 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="8.6" 2023-10-16T07:11:25.820 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el8" 2023-10-16T07:11:25.820 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-16T07:11:25.820 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31" 2023-10-16T07:11:25.821 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-16T07:11:25.821 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://www.redhat.com/" 2023-10-16T07:11:25.821 INFO:teuthology.orchestra.run.smithi081.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-16T07:11:25.821 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-16T07:11:25.821 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-16T07:11:25.821 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-16T07:11:25.822 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-16T07:11:25.822 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-16T07:11:25.822 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-16T07:11:25.823 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2023-10-16T07:11:25.856 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T07:11:25.956 INFO:teuthology.dispatcher.supervisor:Running job 7428878 2023-10-16T07:11:25.956 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-10-16_06:54:33-fs-rishabh-2023oct13-testing-default-smithi/7428878 --name rishabh-2023-10-16_06:54:33-fs-rishabh-2023oct13-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/test_journal_migration} -- /home/teuthworker/archive/rishabh-2023-10-16_06:54:33-fs-rishabh-2023oct13-testing-default-smithi/7428878/orig.config.yaml 2023-10-16T07:11:25.959 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-10-16_06:54:33-fs-rishabh-2023oct13-testing-default-smithi/7428878 2023-10-16T07:11:25.960 INFO:teuthology.dispatcher.supervisor:Job PID: 4050975 2023-10-16T07:11:25.960 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-16T07:13:26.060 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T07:15:26.239 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T07:17:26.439 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T07:19:26.692 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T07:21:26.863 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T07:23:27.051 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T07:25:27.222 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T07:27:27.411 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T07:29:27.588 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T07:29:27.660 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-16T07:29:27.812 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-16T07:29:27.812 INFO:teuthology.nuke:Checking targets against current locks 2023-10-16T07:29:27.885 DEBUG:teuthology.nuke:shortname: smithi064 2023-10-16T07:29:27.886 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-16T07:29:27.974 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi064.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-16_06:54:33-fs-rishabh-2023oct13-testing-default-smithi/7428878', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-16 07:06:29.583076', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-16T07:29:28.015 DEBUG:teuthology.nuke:shortname: smithi081 2023-10-16T07:29:28.016 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-16T07:29:28.054 INFO:teuthology.orchestra.console.smithi064:Power off 2023-10-16T07:29:28.054 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-16T07:29:28.061 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi081.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-16_06:54:33-fs-rishabh-2023oct13-testing-default-smithi/7428878', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-16 07:06:29.584819', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-16T07:29:28.109 DEBUG:teuthology.orchestra.console.smithi064:power off output: Chassis Power Control: Down/Off 2023-10-16T07:29:28.109 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T07:29:28.141 INFO:teuthology.orchestra.console.smithi081:Power off 2023-10-16T07:29:28.142 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-16T07:29:28.152 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off 2023-10-16T07:29:28.211 DEBUG:teuthology.orchestra.console.smithi081:power off output: Chassis Power Control: Down/Off 2023-10-16T07:29:28.211 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T07:29:28.242 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off 2023-10-16T07:29:28.253 INFO:teuthology.orchestra.console.smithi064:Power off completed 2023-10-16T07:29:28.344 INFO:teuthology.orchestra.console.smithi081:Power off completed 2023-10-16T07:29:28.426 INFO:teuthology.lock.ops:unlocked: smithi064.front.sepia.ceph.com 2023-10-16T07:29:28.509 INFO:teuthology.lock.ops:unlocked: smithi081.front.sepia.ceph.com