2023-09-02T09:19:20.085 INFO:root:teuthology version: 0.0.1.dev192+gf9a8556 2023-09-02T09:19:20.087 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T09:19:20.214 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7feb4c05e670>, signals=[15]) 2023-09-02T09:19:20.216 INFO:teuthology.lock.ops:Start node 'smithi104.front.sepia.ceph.com' reimaging 2023-09-02T09:19:20.216 INFO:teuthology.lock.ops:Updating [smithi104.front.sepia.ceph.com]: reset os type and version on server 2023-09-02T09:19:20.216 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server 2023-09-02T09:19:20.243 INFO:teuthology.lock.ops:Start node 'smithi141.front.sepia.ceph.com' reimaging 2023-09-02T09:19:20.244 INFO:teuthology.lock.ops:Updating [smithi141.front.sepia.ceph.com]: reset os type and version on server 2023-09-02T09:19:20.244 INFO:teuthology.lock.ops:Updating smithi141.front.sepia.ceph.com on lock server 2023-09-02T09:19:20.245 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /host {"name": "smithi104"} 2023-09-02T09:19:20.268 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /host {"name": "smithi141"} 2023-09-02T09:19:20.320 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-09-02T09:19:20.336 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-09-02T09:19:20.364 DEBUG:teuthology.provision.fog.smithi104:Requesting image smithi_rhel_8.6 (ID 5) 2023-09-02T09:19:20.364 DEBUG:teuthology.provision.fog.smithi104:FOG request: PUT /host/209 {"imageID": 5} 2023-09-02T09:19:20.377 DEBUG:teuthology.provision.fog.smithi141:Requesting image smithi_rhel_8.6 (ID 5) 2023-09-02T09:19:20.378 DEBUG:teuthology.provision.fog.smithi141:FOG request: PUT /host/246 {"imageID": 5} 2023-09-02T09:19:20.411 INFO:teuthology.provision.fog.smithi104:Scheduling deploy of rhel 8.6 2023-09-02T09:19:20.412 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-09-02T09:19:20.420 INFO:teuthology.provision.fog.smithi141:Scheduling deploy of rhel 8.6 2023-09-02T09:19:20.420 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-09-02T09:19:20.474 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /tasktype {"name": "deploy"} 2023-09-02T09:19:20.476 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /tasktype {"name": "deploy"} 2023-09-02T09:19:20.512 DEBUG:teuthology.provision.fog.smithi104:FOG request: POST /host/209/task {"taskTypeID": 1} 2023-09-02T09:19:20.515 DEBUG:teuthology.provision.fog.smithi141:FOG request: POST /host/246/task {"taskTypeID": 1} 2023-09-02T09:19:20.568 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-09-02T09:19:20.572 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-09-02T09:19:20.666 INFO:teuthology.orchestra.console.smithi104:Power off 2023-09-02T09:19:20.667 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-02T09:19:20.678 INFO:teuthology.orchestra.console.smithi141:Power off 2023-09-02T09:19:20.679 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-02T09:19:20.687 DEBUG:teuthology.orchestra.console.smithi104:power off output: Chassis Power Control: Down/Off 2023-09-02T09:19:20.688 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T09:19:20.698 DEBUG:teuthology.orchestra.console.smithi141:power off output: Chassis Power Control: Down/Off 2023-09-02T09:19:20.699 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T09:19:20.708 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is on 2023-09-02T09:19:20.718 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is on 2023-09-02T09:19:24.712 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T09:19:24.719 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T09:19:24.822 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is on 2023-09-02T09:19:24.828 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is on 2023-09-02T09:19:28.826 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T09:19:28.832 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T09:19:28.934 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off 2023-09-02T09:19:28.940 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is on 2023-09-02T09:19:29.036 INFO:teuthology.orchestra.console.smithi104:Power off completed 2023-09-02T09:19:29.137 INFO:teuthology.orchestra.console.smithi104:Power on 2023-09-02T09:19:29.137 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-02T09:19:29.158 DEBUG:teuthology.orchestra.console.smithi104:power on output: Chassis Power Control: Up/On 2023-09-02T09:19:29.159 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T09:19:29.178 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off 2023-09-02T09:19:32.942 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T09:19:33.051 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is off 2023-09-02T09:19:33.152 INFO:teuthology.orchestra.console.smithi141:Power off completed 2023-09-02T09:19:33.180 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T09:19:33.253 INFO:teuthology.orchestra.console.smithi141:Power on 2023-09-02T09:19:33.254 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-02T09:19:33.276 DEBUG:teuthology.orchestra.console.smithi141:power on output: Chassis Power Control: Up/On 2023-09-02T09:19:33.277 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T09:19:33.288 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off 2023-09-02T09:19:33.296 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is off 2023-09-02T09:19:37.290 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T09:19:37.297 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T09:19:37.398 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is on 2023-09-02T09:19:37.407 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is on 2023-09-02T09:19:37.499 INFO:teuthology.orchestra.console.smithi104:Power on completed 2023-09-02T09:19:37.508 INFO:teuthology.orchestra.console.smithi141:Power on completed 2023-09-02T09:19:37.601 INFO:teuthology.provision.fog.smithi104:Waiting for deploy to finish 2023-09-02T09:19:37.602 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-09-02T09:19:37.609 INFO:teuthology.provision.fog.smithi141:Waiting for deploy to finish 2023-09-02T09:19:37.610 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-09-02T09:19:52.684 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-09-02T09:19:52.685 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-09-02T09:20:07.762 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-09-02T09:20:07.763 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-09-02T09:20:22.838 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-09-02T09:20:22.839 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-09-02T09:20:37.930 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-09-02T09:20:37.931 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-09-02T09:20:53.013 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-09-02T09:20:53.015 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-09-02T09:21:08.099 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-09-02T09:21:08.104 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-09-02T09:21:23.198 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-09-02T09:21:23.200 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-09-02T09:21:38.301 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-09-02T09:21:38.306 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-09-02T09:21:53.385 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-09-02T09:21:53.386 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-09-02T09:22:08.478 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-09-02T09:22:08.480 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-09-02T09:22:23.574 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-09-02T09:22:23.575 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-09-02T09:22:23.645 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T09:22:23.649 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T09:22:26.718 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141 2023-09-02T09:22:26.719 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-09-02T09:22:32.725 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T09:22:32.727 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T09:22:35.802 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141 2023-09-02T09:22:35.803 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-09-02T09:22:41.806 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T09:22:41.808 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T09:22:44.865 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141 2023-09-02T09:22:44.890 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-09-02T09:22:50.873 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T09:22:50.891 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T09:22:53.946 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141 2023-09-02T09:22:53.946 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-09-02T09:22:59.950 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T09:22:59.953 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T09:23:03.002 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141 2023-09-02T09:23:03.034 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-09-02T09:23:09.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T09:23:09.036 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T09:23:12.059 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141 2023-09-02T09:23:12.094 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-09-02T09:23:18.062 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T09:23:18.096 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T09:24:18.119 WARNING:teuthology.provision.fog.smithi141:timed out 2023-09-02T09:24:18.120 WARNING:teuthology.provision.fog.smithi104:timed out 2023-09-02T09:24:24.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T09:24:24.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T09:24:24.459 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-02T09:24:24.460 DEBUG:teuthology.orchestra.run.smithi141:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-02T09:24:24.461 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-02T09:24:24.461 DEBUG:teuthology.orchestra.run.smithi104:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-02T09:24:24.731 INFO:teuthology.provision.fog.smithi104:Node is ready 2023-09-02T09:24:24.732 DEBUG:teuthology.orchestra.run.smithi104:> hostname 2023-09-02T09:24:24.749 INFO:teuthology.orchestra.run.smithi104.stdout:smithi104 2023-09-02T09:24:24.750 DEBUG:teuthology.orchestra.run.smithi104:> grep smithi104 /etc/hosts 2023-09-02T09:24:24.782 INFO:teuthology.provision.fog.smithi141:Node is ready 2023-09-02T09:24:24.783 DEBUG:teuthology.orchestra.run.smithi141:> hostname 2023-09-02T09:24:24.799 INFO:teuthology.orchestra.run.smithi141.stdout:smithi141.front.sepia.ceph.com 2023-09-02T09:24:24.800 DEBUG:teuthology.orchestra.run.smithi141:> grep smithi141.front.sepia.ceph.com /etc/hosts 2023-09-02T09:24:24.807 INFO:teuthology.orchestra.run.smithi104.stdout:172.21.15.104 smithi104.front.sepia.ceph.com smithi104 2023-09-02T09:24:24.808 DEBUG:teuthology.orchestra.run.smithi104:> sudo hostname smithi104 2023-09-02T09:24:24.857 INFO:teuthology.orchestra.run.smithi141.stdout:172.21.15.141 smithi141.front.sepia.ceph.com smithi141 2023-09-02T09:24:24.858 DEBUG:teuthology.orchestra.run.smithi141:> sudo hostname smithi141 2023-09-02T09:24:24.916 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/smithi104/smithi104/g' /etc/hosts 2023-09-02T09:24:24.944 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/172.21.15.104/172.21.15.104/g' /etc/hosts 2023-09-02T09:24:24.963 DEBUG:teuthology.orchestra.run.smithi141:> sudo sed -i -e 's/smithi141.front.sepia.ceph.com/smithi141/g' /etc/hosts 2023-09-02T09:24:24.990 DEBUG:teuthology.orchestra.run.smithi141:> sudo sed -i -e 's/172.21.15.141/172.21.15.141/g' /etc/hosts 2023-09-02T09:24:25.012 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/smithi104/smithi104/g' /etc/hostname 2023-09-02T09:24:25.057 DEBUG:teuthology.orchestra.run.smithi141:> sudo sed -i -e 's/smithi141.front.sepia.ceph.com/smithi141/g' /etc/hostname 2023-09-02T09:24:25.080 DEBUG:teuthology.orchestra.run.smithi104:> sudo hostname smithi104 2023-09-02T09:24:25.124 DEBUG:teuthology.orchestra.run.smithi141:> sudo hostname smithi141 2023-09-02T09:24:25.147 DEBUG:teuthology.orchestra.run.smithi104:> cat /etc/os-release 2023-09-02T09:24:25.190 DEBUG:teuthology.orchestra.run.smithi141:> cat /etc/os-release 2023-09-02T09:24:25.203 INFO:teuthology.orchestra.run.smithi104.stdout:NAME="Red Hat Enterprise Linux" 2023-09-02T09:24:25.203 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION="8.6 (Ootpa)" 2023-09-02T09:24:25.203 INFO:teuthology.orchestra.run.smithi104.stdout:ID="rhel" 2023-09-02T09:24:25.203 INFO:teuthology.orchestra.run.smithi104.stdout:ID_LIKE="fedora" 2023-09-02T09:24:25.204 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_ID="8.6" 2023-09-02T09:24:25.204 INFO:teuthology.orchestra.run.smithi104.stdout:PLATFORM_ID="platform:el8" 2023-09-02T09:24:25.204 INFO:teuthology.orchestra.run.smithi104.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-02T09:24:25.204 INFO:teuthology.orchestra.run.smithi104.stdout:ANSI_COLOR="0;31" 2023-09-02T09:24:25.204 INFO:teuthology.orchestra.run.smithi104.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-02T09:24:25.205 INFO:teuthology.orchestra.run.smithi104.stdout:HOME_URL="https://www.redhat.com/" 2023-09-02T09:24:25.205 INFO:teuthology.orchestra.run.smithi104.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-02T09:24:25.205 INFO:teuthology.orchestra.run.smithi104.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-02T09:24:25.205 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-02T09:24:25.205 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-02T09:24:25.205 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-02T09:24:25.206 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-02T09:24:25.206 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-02T09:24:25.206 INFO:teuthology.provision.fog.smithi104:Deploy complete! 2023-09-02T09:24:25.208 DEBUG:teuthology.parallel:result is None 2023-09-02T09:24:25.247 INFO:teuthology.orchestra.run.smithi141.stdout:NAME="Red Hat Enterprise Linux" 2023-09-02T09:24:25.247 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION="8.6 (Ootpa)" 2023-09-02T09:24:25.247 INFO:teuthology.orchestra.run.smithi141.stdout:ID="rhel" 2023-09-02T09:24:25.247 INFO:teuthology.orchestra.run.smithi141.stdout:ID_LIKE="fedora" 2023-09-02T09:24:25.247 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION_ID="8.6" 2023-09-02T09:24:25.248 INFO:teuthology.orchestra.run.smithi141.stdout:PLATFORM_ID="platform:el8" 2023-09-02T09:24:25.248 INFO:teuthology.orchestra.run.smithi141.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-02T09:24:25.248 INFO:teuthology.orchestra.run.smithi141.stdout:ANSI_COLOR="0;31" 2023-09-02T09:24:25.248 INFO:teuthology.orchestra.run.smithi141.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-02T09:24:25.248 INFO:teuthology.orchestra.run.smithi141.stdout:HOME_URL="https://www.redhat.com/" 2023-09-02T09:24:25.248 INFO:teuthology.orchestra.run.smithi141.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-02T09:24:25.249 INFO:teuthology.orchestra.run.smithi141.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-02T09:24:25.249 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-09-02T09:24:25.249 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-02T09:24:25.249 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-02T09:24:25.249 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-02T09:24:25.250 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-02T09:24:25.250 INFO:teuthology.provision.fog.smithi141:Deploy complete! 2023-09-02T09:24:25.250 DEBUG:teuthology.parallel:result is None 2023-09-02T09:24:25.394 INFO:teuthology.lock.ops:Checking smithi104.front.sepia.ceph.com 2023-09-02T09:24:25.395 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-02T09:24:25.423 INFO:teuthology.lock.ops:Checking smithi141.front.sepia.ceph.com 2023-09-02T09:24:25.424 INFO:teuthology.lock.ops:Updating [smithi104.front.sepia.ceph.com]: set os type and version on server 2023-09-02T09:24:25.424 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com' 2023-09-02T09:24:25.425 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T09:24:25.490 DEBUG:teuthology.orchestra.run.smithi104:> true 2023-09-02T09:24:25.512 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi104.front.sepia.ceph.com' 2023-09-02T09:24:25.512 DEBUG:teuthology.orchestra.run.smithi104:> uname -m 2023-09-02T09:24:25.567 INFO:teuthology.orchestra.run.smithi104.stdout:x86_64 2023-09-02T09:24:25.568 DEBUG:teuthology.orchestra.run.smithi104:> cat /etc/os-release 2023-09-02T09:24:25.623 INFO:teuthology.orchestra.run.smithi104.stdout:NAME="Red Hat Enterprise Linux" 2023-09-02T09:24:25.624 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION="8.6 (Ootpa)" 2023-09-02T09:24:25.624 INFO:teuthology.orchestra.run.smithi104.stdout:ID="rhel" 2023-09-02T09:24:25.624 INFO:teuthology.orchestra.run.smithi104.stdout:ID_LIKE="fedora" 2023-09-02T09:24:25.624 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_ID="8.6" 2023-09-02T09:24:25.624 INFO:teuthology.orchestra.run.smithi104.stdout:PLATFORM_ID="platform:el8" 2023-09-02T09:24:25.625 INFO:teuthology.orchestra.run.smithi104.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-02T09:24:25.625 INFO:teuthology.orchestra.run.smithi104.stdout:ANSI_COLOR="0;31" 2023-09-02T09:24:25.625 INFO:teuthology.orchestra.run.smithi104.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-02T09:24:25.625 INFO:teuthology.orchestra.run.smithi104.stdout:HOME_URL="https://www.redhat.com/" 2023-09-02T09:24:25.625 INFO:teuthology.orchestra.run.smithi104.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-02T09:24:25.625 INFO:teuthology.orchestra.run.smithi104.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-02T09:24:25.626 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-09-02T09:24:25.626 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-02T09:24:25.626 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-02T09:24:25.626 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-02T09:24:25.626 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-02T09:24:25.627 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server 2023-09-02T09:24:25.647 INFO:teuthology.lock.ops:Updating [smithi141.front.sepia.ceph.com]: set os type and version on server 2023-09-02T09:24:25.648 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-09-02T09:24:25.648 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T09:24:25.712 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-09-02T09:24:25.777 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-09-02T09:24:25.777 DEBUG:teuthology.orchestra.run.smithi141:> uname -m 2023-09-02T09:24:25.834 INFO:teuthology.orchestra.run.smithi141.stdout:x86_64 2023-09-02T09:24:25.834 DEBUG:teuthology.orchestra.run.smithi141:> cat /etc/os-release 2023-09-02T09:24:25.889 INFO:teuthology.orchestra.run.smithi141.stdout:NAME="Red Hat Enterprise Linux" 2023-09-02T09:24:25.890 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION="8.6 (Ootpa)" 2023-09-02T09:24:25.890 INFO:teuthology.orchestra.run.smithi141.stdout:ID="rhel" 2023-09-02T09:24:25.890 INFO:teuthology.orchestra.run.smithi141.stdout:ID_LIKE="fedora" 2023-09-02T09:24:25.890 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION_ID="8.6" 2023-09-02T09:24:25.890 INFO:teuthology.orchestra.run.smithi141.stdout:PLATFORM_ID="platform:el8" 2023-09-02T09:24:25.891 INFO:teuthology.orchestra.run.smithi141.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-02T09:24:25.891 INFO:teuthology.orchestra.run.smithi141.stdout:ANSI_COLOR="0;31" 2023-09-02T09:24:25.891 INFO:teuthology.orchestra.run.smithi141.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-02T09:24:25.891 INFO:teuthology.orchestra.run.smithi141.stdout:HOME_URL="https://www.redhat.com/" 2023-09-02T09:24:25.891 INFO:teuthology.orchestra.run.smithi141.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-02T09:24:25.891 INFO:teuthology.orchestra.run.smithi141.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-02T09:24:25.892 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-09-02T09:24:25.892 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-02T09:24:25.892 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-02T09:24:25.892 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-02T09:24:25.892 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-02T09:24:25.893 INFO:teuthology.lock.ops:Updating smithi141.front.sepia.ceph.com on lock server 2023-09-02T09:24:25.914 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T09:24:25.999 INFO:teuthology.dispatcher.supervisor:Running job 7386909 2023-09-02T09:24:26.000 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/virtualenv/bin/teuthology -v --owner scheduled_dis@teuthology --archive /home/teuthworker/archive/dis-2023-09-02_07:44:41-rbd-wip-dis-testing-distro-default-smithi/7386909 --name dis-2023-09-02_07:44:41-rbd-wip-dis-testing-distro-default-smithi --description rbd/immutable-object-cache/{clusters/{fix-2 openstack} pool/ceph_and_immutable_object_cache supported-random-distro$/{rhel_8} workloads/fio_on_immutable_object_cache} -- /home/teuthworker/archive/dis-2023-09-02_07:44:41-rbd-wip-dis-testing-distro-default-smithi/7386909/orig.config.yaml 2023-09-02T09:24:26.003 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/dis-2023-09-02_07:44:41-rbd-wip-dis-testing-distro-default-smithi/7386909 2023-09-02T09:24:26.004 INFO:teuthology.dispatcher.supervisor:Job PID: 2012313 2023-09-02T09:24:26.004 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-09-02T09:26:26.102 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T09:28:26.268 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T09:30:26.391 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T09:32:26.556 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T09:34:26.713 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T09:34:26.777 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-09-02T09:34:26.859 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-09-02T09:34:26.859 INFO:teuthology.nuke:Checking targets against current locks 2023-09-02T09:34:26.906 DEBUG:teuthology.nuke:shortname: smithi104 2023-09-02T09:34:26.906 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-02T09:34:26.927 DEBUG:teuthology.nuke:shortname: smithi141 2023-09-02T09:34:26.929 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-02T09:34:26.932 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi104.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dis-2023-09-02_07:44:41-rbd-wip-dis-testing-distro-default-smithi/7386909', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-02 09:19:19.010839', 'locked_by': 'scheduled_dis@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-09-02T09:34:26.955 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi141.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dis-2023-09-02_07:44:41-rbd-wip-dis-testing-distro-default-smithi/7386909', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-02 09:19:19.009460', 'locked_by': 'scheduled_dis@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-09-02T09:34:26.978 INFO:teuthology.orchestra.console.smithi104:Power off 2023-09-02T09:34:26.979 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-02T09:34:26.999 DEBUG:teuthology.orchestra.console.smithi104:power off output: Chassis Power Control: Down/Off 2023-09-02T09:34:26.999 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T09:34:27.011 INFO:teuthology.orchestra.console.smithi141:Power off 2023-09-02T09:34:27.012 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-02T09:34:27.020 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off 2023-09-02T09:34:27.031 DEBUG:teuthology.orchestra.console.smithi141:power off output: Chassis Power Control: Down/Off 2023-09-02T09:34:27.031 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T09:34:27.051 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is off 2023-09-02T09:34:27.121 INFO:teuthology.orchestra.console.smithi104:Power off completed 2023-09-02T09:34:27.153 INFO:teuthology.orchestra.console.smithi141:Power off completed 2023-09-02T09:34:27.278 INFO:teuthology.lock.ops:unlocked: smithi104.front.sepia.ceph.com 2023-09-02T09:34:27.301 INFO:teuthology.lock.ops:unlocked: smithi141.front.sepia.ceph.com