2023-10-25T01:21:50.174 INFO:root:teuthology version: 0.0.1.dev201+g202b180 2023-10-25T01:21:50.175 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T01:21:50.329 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd880017670>, signals=[15]) 2023-10-25T01:21:50.330 INFO:teuthology.lock.ops:Start node 'smithi124.front.sepia.ceph.com' reimaging 2023-10-25T01:21:50.331 INFO:teuthology.lock.ops:Updating [smithi124.front.sepia.ceph.com]: reset os type and version on server 2023-10-25T01:21:50.331 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server 2023-10-25T01:21:50.357 INFO:teuthology.lock.ops:Start node 'smithi172.front.sepia.ceph.com' reimaging 2023-10-25T01:21:50.357 INFO:teuthology.lock.ops:Updating [smithi172.front.sepia.ceph.com]: reset os type and version on server 2023-10-25T01:21:50.358 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2023-10-25T01:21:50.359 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /host {"name": "smithi124"} 2023-10-25T01:21:50.382 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /host {"name": "smithi172"} 2023-10-25T01:21:50.438 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-10-25T01:21:50.464 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-10-25T01:21:50.485 DEBUG:teuthology.provision.fog.smithi124:Requesting image smithi_rhel_8.6 (ID 5) 2023-10-25T01:21:50.485 DEBUG:teuthology.provision.fog.smithi124:FOG request: PUT /host/229 {"imageID": 5} 2023-10-25T01:21:50.509 DEBUG:teuthology.provision.fog.smithi172:Requesting image smithi_rhel_8.6 (ID 5) 2023-10-25T01:21:50.510 DEBUG:teuthology.provision.fog.smithi172:FOG request: PUT /host/277 {"imageID": 5} 2023-10-25T01:21:50.533 INFO:teuthology.provision.fog.smithi124:Scheduling deploy of rhel 8.6 2023-10-25T01:21:50.533 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-25T01:21:50.565 INFO:teuthology.provision.fog.smithi172:Scheduling deploy of rhel 8.6 2023-10-25T01:21:50.565 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-10-25T01:21:50.584 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /tasktype {"name": "deploy"} 2023-10-25T01:21:50.612 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /tasktype {"name": "deploy"} 2023-10-25T01:21:50.627 DEBUG:teuthology.provision.fog.smithi124:FOG request: POST /host/229/task {"taskTypeID": 1} 2023-10-25T01:21:50.642 DEBUG:teuthology.provision.fog.smithi172:FOG request: POST /host/277/task {"taskTypeID": 1} 2023-10-25T01:21:50.692 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-25T01:21:50.708 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-10-25T01:21:50.790 INFO:teuthology.orchestra.console.smithi124:Power off 2023-10-25T01:21:50.791 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-25T01:21:50.805 INFO:teuthology.orchestra.console.smithi172:Power off 2023-10-25T01:21:50.805 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-25T01:21:50.815 DEBUG:teuthology.orchestra.console.smithi124:power off output: Chassis Power Control: Down/Off 2023-10-25T01:21:50.816 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T01:21:50.826 DEBUG:teuthology.orchestra.console.smithi172:power off output: Chassis Power Control: Down/Off 2023-10-25T01:21:50.827 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T01:21:50.837 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on 2023-10-25T01:21:50.847 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2023-10-25T01:21:54.838 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T01:21:54.849 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T01:21:54.946 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on 2023-10-25T01:21:54.957 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2023-10-25T01:21:58.950 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T01:21:58.958 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T01:21:59.058 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on 2023-10-25T01:21:59.065 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off 2023-10-25T01:21:59.166 INFO:teuthology.orchestra.console.smithi172:Power off completed 2023-10-25T01:21:59.267 INFO:teuthology.orchestra.console.smithi172:Power on 2023-10-25T01:21:59.267 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-25T01:21:59.291 DEBUG:teuthology.orchestra.console.smithi172:power on output: Chassis Power Control: Up/On 2023-10-25T01:21:59.292 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T01:21:59.312 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off 2023-10-25T01:22:03.062 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T01:22:03.170 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off 2023-10-25T01:22:03.271 INFO:teuthology.orchestra.console.smithi124:Power off completed 2023-10-25T01:22:03.313 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T01:22:03.372 INFO:teuthology.orchestra.console.smithi124:Power on 2023-10-25T01:22:03.373 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-25T01:22:03.393 DEBUG:teuthology.orchestra.console.smithi124:power on output: Chassis Power Control: Up/On 2023-10-25T01:22:03.394 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T01:22:03.414 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off 2023-10-25T01:22:03.422 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off 2023-10-25T01:22:07.418 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T01:22:07.425 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T01:22:07.528 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on 2023-10-25T01:22:07.534 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2023-10-25T01:22:07.629 INFO:teuthology.orchestra.console.smithi124:Power on completed 2023-10-25T01:22:07.635 INFO:teuthology.orchestra.console.smithi172:Power on completed 2023-10-25T01:22:07.731 INFO:teuthology.provision.fog.smithi124:Waiting for deploy to finish 2023-10-25T01:22:07.731 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-25T01:22:07.736 INFO:teuthology.provision.fog.smithi172:Waiting for deploy to finish 2023-10-25T01:22:07.737 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-10-25T01:22:22.806 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-25T01:22:22.808 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-10-25T01:22:37.865 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-25T01:22:37.871 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-10-25T01:22:52.950 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-10-25T01:22:52.952 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-25T01:23:08.030 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-25T01:23:08.032 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-10-25T01:23:23.119 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-10-25T01:23:23.121 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-25T01:23:38.210 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-10-25T01:23:38.211 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-25T01:23:53.298 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-25T01:23:53.300 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-10-25T01:24:08.382 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-25T01:24:08.384 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-10-25T01:24:23.483 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-25T01:24:23.484 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-10-25T01:24:38.581 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-25T01:24:38.583 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-10-25T01:24:53.659 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-25T01:24:53.660 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-10-25T01:24:53.756 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T01:24:53.760 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T01:25:12.186 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-10-25T01:25:18.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T01:25:21.242 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-10-25T01:25:23.840 ERROR:teuthology.orchestra.connection:Error authenticating with smithi172.front.sepia.ceph.com: AuthenticationException('Authentication timeout.') 2023-10-25T01:25:27.244 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T01:25:30.298 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-10-25T01:25:30.618 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-10-25T01:25:36.301 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T01:25:36.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T01:25:37.530 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-10-25T01:25:39.354 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-10-25T01:25:43.532 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T01:25:44.186 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-10-25T01:25:45.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T01:25:50.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T01:25:50.842 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-10-25T01:25:56.844 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T01:25:57.502 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-10-25T01:26:03.504 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T01:26:04.154 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-10-25T01:26:10.156 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T01:26:20.282 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-10-25T01:26:26.283 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T01:26:29.338 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-10-25T01:26:35.339 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T01:26:37.690 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-10-25T01:26:43.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T01:26:45.157 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T01:26:45.158 DEBUG:teuthology.orchestra.run.smithi172:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-25T01:26:45.358 WARNING:teuthology.provision.fog.smithi124:timed out 2023-10-25T01:26:45.416 INFO:teuthology.provision.fog.smithi172:Node is ready 2023-10-25T01:26:45.416 DEBUG:teuthology.orchestra.run.smithi172:> hostname 2023-10-25T01:26:45.432 INFO:teuthology.orchestra.run.smithi172.stdout:smithi022 2023-10-25T01:26:45.432 DEBUG:teuthology.orchestra.run.smithi172:> grep smithi022 /etc/hosts 2023-10-25T01:26:45.489 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2023-10-25T01:26:45.490 DEBUG:teuthology.orchestra.run.smithi172:> sudo hostname smithi172 2023-10-25T01:26:45.617 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i -e 's/smithi022/smithi172/g' /etc/hosts 2023-10-25T01:26:45.645 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i -e 's/172.21.15.22/172.21.15.172/g' /etc/hosts 2023-10-25T01:26:45.710 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i -e 's/smithi022/smithi172/g' /etc/hostname 2023-10-25T01:26:45.778 DEBUG:teuthology.orchestra.run.smithi172:> sudo hostname smithi172 2023-10-25T01:26:45.843 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release 2023-10-25T01:26:45.899 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="Red Hat Enterprise Linux" 2023-10-25T01:26:45.900 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="8.6 (Ootpa)" 2023-10-25T01:26:45.900 INFO:teuthology.orchestra.run.smithi172.stdout:ID="rhel" 2023-10-25T01:26:45.900 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="fedora" 2023-10-25T01:26:45.900 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="8.6" 2023-10-25T01:26:45.901 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el8" 2023-10-25T01:26:45.901 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-25T01:26:45.901 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31" 2023-10-25T01:26:45.901 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-25T01:26:45.901 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://www.redhat.com/" 2023-10-25T01:26:45.902 INFO:teuthology.orchestra.run.smithi172.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-25T01:26:45.902 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-25T01:26:45.902 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-25T01:26:45.902 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-25T01:26:45.902 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-25T01:26:45.903 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-25T01:26:45.903 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-25T01:26:45.903 INFO:teuthology.provision.fog.smithi172:Deploy complete! 2023-10-25T01:26:45.905 DEBUG:teuthology.parallel:result is None 2023-10-25T01:26:47.930 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-10-25T01:26:51.363 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T01:26:51.573 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T01:26:51.574 DEBUG:teuthology.orchestra.run.smithi124:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-25T01:26:52.208 INFO:teuthology.provision.fog.smithi124:Node is ready 2023-10-25T01:26:52.208 DEBUG:teuthology.orchestra.run.smithi124:> hostname 2023-10-25T01:26:52.228 INFO:teuthology.orchestra.run.smithi124.stdout:smithi124 2023-10-25T01:26:52.228 DEBUG:teuthology.orchestra.run.smithi124:> grep smithi124 /etc/hosts 2023-10-25T01:26:52.287 INFO:teuthology.orchestra.run.smithi124.stdout:172.21.15.124 smithi124.front.sepia.ceph.com smithi124 2023-10-25T01:26:52.288 DEBUG:teuthology.orchestra.run.smithi124:> sudo hostname smithi124 2023-10-25T01:26:52.426 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/smithi124/smithi124/g' /etc/hosts 2023-10-25T01:26:52.460 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/172.21.15.124/172.21.15.124/g' /etc/hosts 2023-10-25T01:26:52.533 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/smithi124/smithi124/g' /etc/hostname 2023-10-25T01:26:52.606 DEBUG:teuthology.orchestra.run.smithi124:> sudo hostname smithi124 2023-10-25T01:26:52.678 DEBUG:teuthology.orchestra.run.smithi124:> cat /etc/os-release 2023-10-25T01:26:52.738 INFO:teuthology.orchestra.run.smithi124.stdout:NAME="Red Hat Enterprise Linux" 2023-10-25T01:26:52.739 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION="8.6 (Ootpa)" 2023-10-25T01:26:52.739 INFO:teuthology.orchestra.run.smithi124.stdout:ID="rhel" 2023-10-25T01:26:52.739 INFO:teuthology.orchestra.run.smithi124.stdout:ID_LIKE="fedora" 2023-10-25T01:26:52.739 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_ID="8.6" 2023-10-25T01:26:52.740 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM_ID="platform:el8" 2023-10-25T01:26:52.740 INFO:teuthology.orchestra.run.smithi124.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-25T01:26:52.740 INFO:teuthology.orchestra.run.smithi124.stdout:ANSI_COLOR="0;31" 2023-10-25T01:26:52.740 INFO:teuthology.orchestra.run.smithi124.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-25T01:26:52.740 INFO:teuthology.orchestra.run.smithi124.stdout:HOME_URL="https://www.redhat.com/" 2023-10-25T01:26:52.741 INFO:teuthology.orchestra.run.smithi124.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-25T01:26:52.741 INFO:teuthology.orchestra.run.smithi124.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-25T01:26:52.741 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-25T01:26:52.741 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-25T01:26:52.741 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-25T01:26:52.741 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-25T01:26:52.742 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-25T01:26:52.742 INFO:teuthology.provision.fog.smithi124:Deploy complete! 2023-10-25T01:26:52.743 DEBUG:teuthology.parallel:result is None 2023-10-25T01:26:52.892 INFO:teuthology.lock.ops:Checking smithi124.front.sepia.ceph.com 2023-10-25T01:26:52.893 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-25T01:26:52.913 INFO:teuthology.lock.ops:Checking smithi172.front.sepia.ceph.com 2023-10-25T01:26:52.913 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-25T01:26:52.931 INFO:teuthology.lock.ops:Updating [smithi124.front.sepia.ceph.com]: set os type and version on server 2023-10-25T01:26:52.931 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-10-25T01:26:52.932 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T01:26:52.999 DEBUG:teuthology.orchestra.run.smithi124:> true 2023-10-25T01:26:53.069 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-10-25T01:26:53.070 DEBUG:teuthology.orchestra.run.smithi124:> uname -m 2023-10-25T01:26:53.129 INFO:teuthology.orchestra.run.smithi124.stdout:x86_64 2023-10-25T01:26:53.129 DEBUG:teuthology.orchestra.run.smithi124:> cat /etc/os-release 2023-10-25T01:26:53.188 INFO:teuthology.orchestra.run.smithi124.stdout:NAME="Red Hat Enterprise Linux" 2023-10-25T01:26:53.189 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION="8.6 (Ootpa)" 2023-10-25T01:26:53.189 INFO:teuthology.orchestra.run.smithi124.stdout:ID="rhel" 2023-10-25T01:26:53.189 INFO:teuthology.orchestra.run.smithi124.stdout:ID_LIKE="fedora" 2023-10-25T01:26:53.189 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_ID="8.6" 2023-10-25T01:26:53.190 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM_ID="platform:el8" 2023-10-25T01:26:53.190 INFO:teuthology.orchestra.run.smithi124.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-25T01:26:53.190 INFO:teuthology.orchestra.run.smithi124.stdout:ANSI_COLOR="0;31" 2023-10-25T01:26:53.190 INFO:teuthology.orchestra.run.smithi124.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-25T01:26:53.191 INFO:teuthology.orchestra.run.smithi124.stdout:HOME_URL="https://www.redhat.com/" 2023-10-25T01:26:53.191 INFO:teuthology.orchestra.run.smithi124.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-25T01:26:53.191 INFO:teuthology.orchestra.run.smithi124.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-25T01:26:53.191 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-25T01:26:53.191 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-25T01:26:53.191 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-25T01:26:53.192 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-25T01:26:53.192 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-25T01:26:53.192 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server 2023-10-25T01:26:53.230 INFO:teuthology.lock.ops:Updating [smithi172.front.sepia.ceph.com]: set os type and version on server 2023-10-25T01:26:53.230 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-10-25T01:26:53.231 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T01:26:53.297 DEBUG:teuthology.orchestra.run.smithi172:> true 2023-10-25T01:26:53.372 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-10-25T01:26:53.372 DEBUG:teuthology.orchestra.run.smithi172:> uname -m 2023-10-25T01:26:53.432 INFO:teuthology.orchestra.run.smithi172.stdout:x86_64 2023-10-25T01:26:53.433 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release 2023-10-25T01:26:53.492 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="Red Hat Enterprise Linux" 2023-10-25T01:26:53.492 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="8.6 (Ootpa)" 2023-10-25T01:26:53.493 INFO:teuthology.orchestra.run.smithi172.stdout:ID="rhel" 2023-10-25T01:26:53.493 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="fedora" 2023-10-25T01:26:53.493 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="8.6" 2023-10-25T01:26:53.493 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el8" 2023-10-25T01:26:53.494 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-25T01:26:53.494 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31" 2023-10-25T01:26:53.494 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-25T01:26:53.494 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://www.redhat.com/" 2023-10-25T01:26:53.495 INFO:teuthology.orchestra.run.smithi172.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-25T01:26:53.495 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-25T01:26:53.495 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-25T01:26:53.495 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-25T01:26:53.496 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-25T01:26:53.496 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-25T01:26:53.496 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-25T01:26:53.497 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2023-10-25T01:26:53.521 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T01:26:53.610 INFO:teuthology.dispatcher.supervisor:Running job 7435410 2023-10-25T01:26:53.611 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-10-24_00:06:34-fs-wip-yuri6-testing-2023-10-23-1148-reef-distro-default-smithi/7435410 --name yuriw-2023-10-24_00:06:34-fs-wip-yuri6-testing-2023-10-23-1148-reef-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/strays} -- /home/teuthworker/archive/yuriw-2023-10-24_00:06:34-fs-wip-yuri6-testing-2023-10-23-1148-reef-distro-default-smithi/7435410/orig.config.yaml 2023-10-25T01:26:53.613 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-10-24_00:06:34-fs-wip-yuri6-testing-2023-10-23-1148-reef-distro-default-smithi/7435410 2023-10-25T01:26:53.614 INFO:teuthology.dispatcher.supervisor:Job PID: 3823293 2023-10-25T01:26:53.614 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-25T01:28:53.714 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T01:30:53.886 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T01:32:54.055 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T01:34:54.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T01:36:54.395 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T01:38:54.560 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T01:40:54.748 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T01:42:54.923 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T01:44:55.087 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T01:46:55.255 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T01:48:55.357 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T01:50:55.472 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T01:52:55.631 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T01:54:55.823 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T01:56:55.995 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T01:58:56.171 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T02:00:56.338 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T02:02:56.507 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T02:04:56.667 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T02:06:56.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T02:08:56.960 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T02:10:57.123 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T02:10:57.193 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-25T02:10:57.375 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-25T02:10:57.375 INFO:teuthology.nuke:Checking targets against current locks 2023-10-25T02:10:57.420 DEBUG:teuthology.nuke:shortname: smithi124 2023-10-25T02:10:57.420 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-25T02:10:57.444 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi124.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-24_00:06:34-fs-wip-yuri6-testing-2023-10-23-1148-reef-distro-default-smithi/7435410', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-25 01:21:49.407244', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-25T02:10:57.445 DEBUG:teuthology.nuke:shortname: smithi172 2023-10-25T02:10:57.445 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-25T02:10:57.467 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi172.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-24_00:06:34-fs-wip-yuri6-testing-2023-10-23-1148-reef-distro-default-smithi/7435410', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-25 01:21:49.405630', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-25T02:10:57.494 INFO:teuthology.orchestra.console.smithi124:Power off 2023-10-25T02:10:57.494 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-25T02:10:57.516 DEBUG:teuthology.orchestra.console.smithi124:power off output: Chassis Power Control: Down/Off 2023-10-25T02:10:57.516 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T02:10:57.532 INFO:teuthology.orchestra.console.smithi172:Power off 2023-10-25T02:10:57.533 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-25T02:10:57.541 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off 2023-10-25T02:10:57.554 DEBUG:teuthology.orchestra.console.smithi172:power off output: Chassis Power Control: Down/Off 2023-10-25T02:10:57.554 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T02:10:57.574 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off 2023-10-25T02:10:57.643 INFO:teuthology.orchestra.console.smithi124:Power off completed 2023-10-25T02:10:57.675 INFO:teuthology.orchestra.console.smithi172:Power off completed 2023-10-25T02:10:57.791 INFO:teuthology.lock.ops:unlocked: smithi124.front.sepia.ceph.com 2023-10-25T02:10:57.815 INFO:teuthology.lock.ops:unlocked: smithi172.front.sepia.ceph.com