2024-01-13T06:57:25.508 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-13T06:57:25.508 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T06:57:25.688 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5796e54c10>, signals=[15]) 2024-01-13T06:57:25.688 INFO:teuthology.lock.ops:Start node 'smithi038.front.sepia.ceph.com' reimaging 2024-01-13T06:57:25.689 INFO:teuthology.lock.ops:Updating [smithi038.front.sepia.ceph.com]: reset os type and version on server 2024-01-13T06:57:25.689 INFO:teuthology.lock.ops:Updating smithi038.front.sepia.ceph.com on lock server 2024-01-13T06:57:25.713 INFO:teuthology.lock.ops:Start node 'smithi100.front.sepia.ceph.com' reimaging 2024-01-13T06:57:25.713 INFO:teuthology.lock.ops:Updating [smithi100.front.sepia.ceph.com]: reset os type and version on server 2024-01-13T06:57:25.713 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server 2024-01-13T06:57:25.737 INFO:teuthology.lock.ops:Start node 'smithi184.front.sepia.ceph.com' reimaging 2024-01-13T06:57:25.737 INFO:teuthology.lock.ops:Updating [smithi184.front.sepia.ceph.com]: reset os type and version on server 2024-01-13T06:57:25.737 INFO:teuthology.lock.ops:Updating smithi184.front.sepia.ceph.com on lock server 2024-01-13T06:57:25.836 DEBUG:teuthology.provision.fog.smithi038:Requesting image smithi_rhel_8.6 (ID 5) 2024-01-13T06:57:25.851 DEBUG:teuthology.provision.fog.smithi100:Requesting image smithi_rhel_8.6 (ID 5) 2024-01-13T06:57:25.867 DEBUG:teuthology.provision.fog.smithi184:Requesting image smithi_rhel_8.6 (ID 5) 2024-01-13T06:57:25.876 INFO:teuthology.provision.fog.smithi038:Scheduling deploy of rhel 8.6 2024-01-13T06:57:25.905 INFO:teuthology.provision.fog.smithi100:Scheduling deploy of rhel 8.6 2024-01-13T06:57:25.927 INFO:teuthology.provision.fog.smithi184:Scheduling deploy of rhel 8.6 2024-01-13T06:57:26.218 INFO:teuthology.orchestra.console.smithi100:Power off 2024-01-13T06:57:26.219 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-13T06:57:26.237 INFO:teuthology.orchestra.console.smithi184:Power off 2024-01-13T06:57:26.237 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-13T06:57:26.248 INFO:teuthology.orchestra.console.smithi038:Power off 2024-01-13T06:57:26.248 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-13T06:57:26.257 DEBUG:teuthology.orchestra.console.smithi184:power off output: Chassis Power Control: Down/Off 2024-01-13T06:57:26.257 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T06:57:26.264 DEBUG:teuthology.orchestra.console.smithi100:power off output: Chassis Power Control: Down/Off 2024-01-13T06:57:26.264 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T06:57:26.273 DEBUG:teuthology.orchestra.console.smithi038:power off output: Chassis Power Control: Down/Off 2024-01-13T06:57:26.274 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T06:57:26.281 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is off 2024-01-13T06:57:26.287 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is off 2024-01-13T06:57:26.295 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is off 2024-01-13T06:57:26.383 INFO:teuthology.orchestra.console.smithi184:Power off completed 2024-01-13T06:57:26.387 INFO:teuthology.orchestra.console.smithi100:Power off completed 2024-01-13T06:57:26.396 INFO:teuthology.orchestra.console.smithi038:Power off completed 2024-01-13T06:57:26.484 INFO:teuthology.orchestra.console.smithi184:Power on 2024-01-13T06:57:26.485 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-13T06:57:26.493 INFO:teuthology.orchestra.console.smithi100:Power on 2024-01-13T06:57:26.493 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-13T06:57:26.500 INFO:teuthology.orchestra.console.smithi038:Power on 2024-01-13T06:57:26.500 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-13T06:57:26.509 DEBUG:teuthology.orchestra.console.smithi184:power on output: Chassis Power Control: Up/On 2024-01-13T06:57:26.509 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T06:57:26.517 DEBUG:teuthology.orchestra.console.smithi100:power on output: Chassis Power Control: Up/On 2024-01-13T06:57:26.517 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T06:57:26.525 DEBUG:teuthology.orchestra.console.smithi038:power on output: Chassis Power Control: Up/On 2024-01-13T06:57:26.526 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T06:57:26.534 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is off 2024-01-13T06:57:26.538 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is off 2024-01-13T06:57:26.546 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is off 2024-01-13T06:57:30.537 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T06:57:30.545 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T06:57:30.551 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T06:57:30.646 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is on 2024-01-13T06:57:30.652 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is off 2024-01-13T06:57:30.660 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is on 2024-01-13T06:57:30.747 INFO:teuthology.orchestra.console.smithi184:Power on completed 2024-01-13T06:57:30.761 INFO:teuthology.orchestra.console.smithi038:Power on completed 2024-01-13T06:57:30.849 INFO:teuthology.provision.fog.smithi184:Waiting for deploy to finish 2024-01-13T06:57:30.862 INFO:teuthology.provision.fog.smithi038:Waiting for deploy to finish 2024-01-13T06:57:34.656 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T06:57:34.833 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on 2024-01-13T06:57:34.934 INFO:teuthology.orchestra.console.smithi100:Power on completed 2024-01-13T06:57:35.034 INFO:teuthology.provision.fog.smithi100:Waiting for deploy to finish 2024-01-13T07:00:02.107 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T07:00:02.238 ERROR:teuthology.orchestra.connection:Error authenticating with smithi038.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-01-13T07:00:16.572 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2024-01-13T07:00:17.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T07:00:20.252 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2024-01-13T07:00:21.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T07:00:22.573 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T07:00:24.348 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100 2024-01-13T07:00:25.628 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2024-01-13T07:00:26.253 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T07:00:29.312 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2024-01-13T07:00:30.349 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T07:00:31.630 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T07:00:33.404 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100 2024-01-13T07:00:34.688 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2024-01-13T07:00:35.313 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T07:00:38.364 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2024-01-13T07:00:39.406 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T07:00:40.689 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T07:00:42.464 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100 2024-01-13T07:00:43.740 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2024-01-13T07:00:44.365 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T07:00:47.420 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2024-01-13T07:00:48.466 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T07:00:49.741 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T07:00:51.548 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100 2024-01-13T07:00:52.800 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2024-01-13T07:00:53.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T07:00:56.480 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2024-01-13T07:00:57.549 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T07:00:58.802 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T07:01:00.604 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100 2024-01-13T07:01:02.481 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T07:01:05.532 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2024-01-13T07:01:06.605 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T07:01:09.660 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100 2024-01-13T07:01:11.534 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T07:01:15.662 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T07:01:34.140 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100 2024-01-13T07:01:40.142 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T07:01:43.196 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100 2024-01-13T07:01:49.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T07:01:50.460 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-13T07:01:50.461 DEBUG:teuthology.orchestra.run.smithi100:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-13T07:01:58.804 WARNING:teuthology.provision.fog.smithi038:timed out 2024-01-13T07:02:04.806 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T07:02:05.087 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-13T07:02:05.087 DEBUG:teuthology.orchestra.run.smithi038:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-13T07:02:05.340 INFO:teuthology.provision.fog.smithi038:Node is ready 2024-01-13T07:02:05.340 DEBUG:teuthology.orchestra.run.smithi038:> hostname 2024-01-13T07:02:05.361 INFO:teuthology.orchestra.run.smithi038.stdout:smithi038.front.sepia.ceph.com 2024-01-13T07:02:05.361 DEBUG:teuthology.orchestra.run.smithi038:> grep smithi038.front.sepia.ceph.com /etc/hosts 2024-01-13T07:02:05.423 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38 smithi038.front.sepia.ceph.com smithi038 2024-01-13T07:02:05.423 DEBUG:teuthology.orchestra.run.smithi038:> sudo hostname smithi038 2024-01-13T07:02:05.553 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i -e 's/smithi038.front.sepia.ceph.com/smithi038/g' /etc/hosts 2024-01-13T07:02:05.587 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i -e 's/172.21.15.38/172.21.15.38/g' /etc/hosts 2024-01-13T07:02:05.663 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i -e 's/smithi038.front.sepia.ceph.com/smithi038/g' /etc/hostname 2024-01-13T07:02:05.738 DEBUG:teuthology.orchestra.run.smithi038:> sudo hostname smithi038 2024-01-13T07:02:05.813 DEBUG:teuthology.orchestra.run.smithi038:> cat /etc/os-release 2024-01-13T07:02:05.875 INFO:teuthology.orchestra.run.smithi038.stdout:NAME="Red Hat Enterprise Linux" 2024-01-13T07:02:05.875 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION="8.6 (Ootpa)" 2024-01-13T07:02:05.875 INFO:teuthology.orchestra.run.smithi038.stdout:ID="rhel" 2024-01-13T07:02:05.875 INFO:teuthology.orchestra.run.smithi038.stdout:ID_LIKE="fedora" 2024-01-13T07:02:05.875 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_ID="8.6" 2024-01-13T07:02:05.875 INFO:teuthology.orchestra.run.smithi038.stdout:PLATFORM_ID="platform:el8" 2024-01-13T07:02:05.876 INFO:teuthology.orchestra.run.smithi038.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-13T07:02:05.876 INFO:teuthology.orchestra.run.smithi038.stdout:ANSI_COLOR="0;31" 2024-01-13T07:02:05.876 INFO:teuthology.orchestra.run.smithi038.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-13T07:02:05.876 INFO:teuthology.orchestra.run.smithi038.stdout:HOME_URL="https://www.redhat.com/" 2024-01-13T07:02:05.876 INFO:teuthology.orchestra.run.smithi038.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-13T07:02:05.876 INFO:teuthology.orchestra.run.smithi038.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-13T07:02:05.876 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-01-13T07:02:05.876 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-13T07:02:05.876 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-13T07:02:05.876 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-13T07:02:05.876 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-13T07:02:05.877 INFO:teuthology.provision.fog.smithi038:Deploy complete! 2024-01-13T07:02:05.878 DEBUG:teuthology.parallel:result is None 2024-01-13T07:02:11.536 WARNING:teuthology.provision.fog.smithi184:timed out 2024-01-13T07:02:16.268 INFO:teuthology.provision.fog.smithi100:Node is ready 2024-01-13T07:02:16.268 DEBUG:teuthology.orchestra.run.smithi100:> hostname 2024-01-13T07:02:16.290 INFO:teuthology.orchestra.run.smithi100.stdout:smithi100.front.sepia.ceph.com 2024-01-13T07:02:16.291 DEBUG:teuthology.orchestra.run.smithi100:> grep smithi100.front.sepia.ceph.com /etc/hosts 2024-01-13T07:02:16.350 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100 smithi100.front.sepia.ceph.com smithi100 2024-01-13T07:02:16.350 DEBUG:teuthology.orchestra.run.smithi100:> sudo hostname smithi100 2024-01-13T07:02:16.478 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i -e 's/smithi100.front.sepia.ceph.com/smithi100/g' /etc/hosts 2024-01-13T07:02:16.509 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i -e 's/172.21.15.100/172.21.15.100/g' /etc/hosts 2024-01-13T07:02:16.578 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i -e 's/smithi100.front.sepia.ceph.com/smithi100/g' /etc/hostname 2024-01-13T07:02:16.646 DEBUG:teuthology.orchestra.run.smithi100:> sudo hostname smithi100 2024-01-13T07:02:16.713 DEBUG:teuthology.orchestra.run.smithi100:> cat /etc/os-release 2024-01-13T07:02:16.770 INFO:teuthology.orchestra.run.smithi100.stdout:NAME="Red Hat Enterprise Linux" 2024-01-13T07:02:16.770 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION="8.6 (Ootpa)" 2024-01-13T07:02:16.770 INFO:teuthology.orchestra.run.smithi100.stdout:ID="rhel" 2024-01-13T07:02:16.771 INFO:teuthology.orchestra.run.smithi100.stdout:ID_LIKE="fedora" 2024-01-13T07:02:16.771 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_ID="8.6" 2024-01-13T07:02:16.771 INFO:teuthology.orchestra.run.smithi100.stdout:PLATFORM_ID="platform:el8" 2024-01-13T07:02:16.771 INFO:teuthology.orchestra.run.smithi100.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-13T07:02:16.771 INFO:teuthology.orchestra.run.smithi100.stdout:ANSI_COLOR="0;31" 2024-01-13T07:02:16.771 INFO:teuthology.orchestra.run.smithi100.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-13T07:02:16.771 INFO:teuthology.orchestra.run.smithi100.stdout:HOME_URL="https://www.redhat.com/" 2024-01-13T07:02:16.771 INFO:teuthology.orchestra.run.smithi100.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-13T07:02:16.771 INFO:teuthology.orchestra.run.smithi100.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-13T07:02:16.771 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-13T07:02:16.771 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-13T07:02:16.771 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-13T07:02:16.771 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-13T07:02:16.771 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-13T07:02:16.772 INFO:teuthology.provision.fog.smithi100:Deploy complete! 2024-01-13T07:02:16.772 DEBUG:teuthology.parallel:result is None 2024-01-13T07:02:17.538 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T07:02:17.576 ERROR:paramiko.transport:Unknown exception: The socket has already been closed by another greenlet 2024-01-13T07:02:17.669 ERROR:paramiko.transport:Traceback (most recent call last): 2024-01-13T07:02:17.670 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2159, in run 2024-01-13T07:02:17.670 ERROR:paramiko.transport: ptype, m = self.packetizer.read_message() 2024-01-13T07:02:17.670 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 463, in read_message 2024-01-13T07:02:17.670 ERROR:paramiko.transport: header = self.read_all(self.__block_size_in, check_rekey=True) 2024-01-13T07:02:17.670 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 308, in read_all 2024-01-13T07:02:17.670 ERROR:paramiko.transport: x = self.__socket.recv(n) 2024-01-13T07:02:17.670 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 666, in recv 2024-01-13T07:02:17.670 ERROR:paramiko.transport: self._wait(self._read_event) 2024-01-13T07:02:17.670 ERROR:paramiko.transport: File "src/gevent/_hub_primitives.py", line 317, in gevent._gevent_c_hub_primitives.wait_on_socket 2024-01-13T07:02:17.670 ERROR:paramiko.transport: File "src/gevent/_hub_primitives.py", line 321, in gevent._gevent_c_hub_primitives.wait_on_socket 2024-01-13T07:02:17.670 ERROR:paramiko.transport:gevent.exceptions.ConcurrentObjectUseError: The socket has already been closed by another greenlet 2024-01-13T07:02:17.670 ERROR:paramiko.transport: 2024-01-13T07:02:17.846 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-13T07:02:17.847 DEBUG:teuthology.orchestra.run.smithi184:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-13T07:02:18.132 INFO:teuthology.provision.fog.smithi184:Node is ready 2024-01-13T07:02:18.132 DEBUG:teuthology.orchestra.run.smithi184:> hostname 2024-01-13T07:02:18.152 INFO:teuthology.orchestra.run.smithi184.stdout:smithi184 2024-01-13T07:02:18.152 DEBUG:teuthology.orchestra.run.smithi184:> grep smithi184 /etc/hosts 2024-01-13T07:02:18.212 INFO:teuthology.orchestra.run.smithi184.stdout:172.21.15.184 smithi184.front.sepia.ceph.com smithi184 2024-01-13T07:02:18.212 DEBUG:teuthology.orchestra.run.smithi184:> sudo hostname smithi184 2024-01-13T07:02:18.322 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i -e 's/smithi184/smithi184/g' /etc/hosts 2024-01-13T07:02:18.356 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i -e 's/172.21.15.184/172.21.15.184/g' /etc/hosts 2024-01-13T07:02:18.430 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i -e 's/smithi184/smithi184/g' /etc/hostname 2024-01-13T07:02:18.504 DEBUG:teuthology.orchestra.run.smithi184:> sudo hostname smithi184 2024-01-13T07:02:18.576 DEBUG:teuthology.orchestra.run.smithi184:> cat /etc/os-release 2024-01-13T07:02:18.636 INFO:teuthology.orchestra.run.smithi184.stdout:NAME="Red Hat Enterprise Linux" 2024-01-13T07:02:18.637 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION="8.6 (Ootpa)" 2024-01-13T07:02:18.637 INFO:teuthology.orchestra.run.smithi184.stdout:ID="rhel" 2024-01-13T07:02:18.637 INFO:teuthology.orchestra.run.smithi184.stdout:ID_LIKE="fedora" 2024-01-13T07:02:18.637 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_ID="8.6" 2024-01-13T07:02:18.637 INFO:teuthology.orchestra.run.smithi184.stdout:PLATFORM_ID="platform:el8" 2024-01-13T07:02:18.637 INFO:teuthology.orchestra.run.smithi184.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-13T07:02:18.637 INFO:teuthology.orchestra.run.smithi184.stdout:ANSI_COLOR="0;31" 2024-01-13T07:02:18.637 INFO:teuthology.orchestra.run.smithi184.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-13T07:02:18.637 INFO:teuthology.orchestra.run.smithi184.stdout:HOME_URL="https://www.redhat.com/" 2024-01-13T07:02:18.638 INFO:teuthology.orchestra.run.smithi184.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-13T07:02:18.638 INFO:teuthology.orchestra.run.smithi184.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-13T07:02:18.638 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-01-13T07:02:18.638 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-13T07:02:18.638 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-13T07:02:18.638 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-13T07:02:18.638 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-13T07:02:18.638 INFO:teuthology.provision.fog.smithi184:Deploy complete! 2024-01-13T07:02:18.639 DEBUG:teuthology.parallel:result is None 2024-01-13T07:02:18.831 INFO:teuthology.lock.ops:Checking smithi038.front.sepia.ceph.com 2024-01-13T07:02:18.832 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-13T07:02:18.858 INFO:teuthology.lock.ops:Checking smithi100.front.sepia.ceph.com 2024-01-13T07:02:18.858 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-13T07:02:18.883 INFO:teuthology.lock.ops:Checking smithi184.front.sepia.ceph.com 2024-01-13T07:02:18.883 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-13T07:02:18.907 INFO:teuthology.lock.ops:Updating [smithi038.front.sepia.ceph.com]: set os type and version on server 2024-01-13T07:02:18.907 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2024-01-13T07:02:18.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T07:02:18.984 DEBUG:teuthology.orchestra.run.smithi038:> true 2024-01-13T07:02:19.124 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi038.front.sepia.ceph.com' 2024-01-13T07:02:19.125 DEBUG:teuthology.orchestra.run.smithi038:> uname -m 2024-01-13T07:02:19.186 INFO:teuthology.orchestra.run.smithi038.stdout:x86_64 2024-01-13T07:02:19.186 DEBUG:teuthology.orchestra.run.smithi038:> cat /etc/os-release 2024-01-13T07:02:19.247 INFO:teuthology.orchestra.run.smithi038.stdout:NAME="Red Hat Enterprise Linux" 2024-01-13T07:02:19.247 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION="8.6 (Ootpa)" 2024-01-13T07:02:19.247 INFO:teuthology.orchestra.run.smithi038.stdout:ID="rhel" 2024-01-13T07:02:19.247 INFO:teuthology.orchestra.run.smithi038.stdout:ID_LIKE="fedora" 2024-01-13T07:02:19.247 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_ID="8.6" 2024-01-13T07:02:19.247 INFO:teuthology.orchestra.run.smithi038.stdout:PLATFORM_ID="platform:el8" 2024-01-13T07:02:19.248 INFO:teuthology.orchestra.run.smithi038.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-13T07:02:19.248 INFO:teuthology.orchestra.run.smithi038.stdout:ANSI_COLOR="0;31" 2024-01-13T07:02:19.248 INFO:teuthology.orchestra.run.smithi038.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-13T07:02:19.248 INFO:teuthology.orchestra.run.smithi038.stdout:HOME_URL="https://www.redhat.com/" 2024-01-13T07:02:19.248 INFO:teuthology.orchestra.run.smithi038.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-13T07:02:19.248 INFO:teuthology.orchestra.run.smithi038.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-13T07:02:19.248 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-01-13T07:02:19.248 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-13T07:02:19.248 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-13T07:02:19.248 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-13T07:02:19.248 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-13T07:02:19.249 INFO:teuthology.lock.ops:Updating smithi038.front.sepia.ceph.com on lock server 2024-01-13T07:02:19.273 INFO:teuthology.lock.ops:Updating [smithi100.front.sepia.ceph.com]: set os type and version on server 2024-01-13T07:02:19.273 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-01-13T07:02:19.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T07:02:19.346 DEBUG:teuthology.orchestra.run.smithi100:> true 2024-01-13T07:02:19.415 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-01-13T07:02:19.416 DEBUG:teuthology.orchestra.run.smithi100:> uname -m 2024-01-13T07:02:19.474 INFO:teuthology.orchestra.run.smithi100.stdout:x86_64 2024-01-13T07:02:19.474 DEBUG:teuthology.orchestra.run.smithi100:> cat /etc/os-release 2024-01-13T07:02:19.533 INFO:teuthology.orchestra.run.smithi100.stdout:NAME="Red Hat Enterprise Linux" 2024-01-13T07:02:19.533 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION="8.6 (Ootpa)" 2024-01-13T07:02:19.533 INFO:teuthology.orchestra.run.smithi100.stdout:ID="rhel" 2024-01-13T07:02:19.533 INFO:teuthology.orchestra.run.smithi100.stdout:ID_LIKE="fedora" 2024-01-13T07:02:19.533 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_ID="8.6" 2024-01-13T07:02:19.533 INFO:teuthology.orchestra.run.smithi100.stdout:PLATFORM_ID="platform:el8" 2024-01-13T07:02:19.533 INFO:teuthology.orchestra.run.smithi100.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-13T07:02:19.533 INFO:teuthology.orchestra.run.smithi100.stdout:ANSI_COLOR="0;31" 2024-01-13T07:02:19.533 INFO:teuthology.orchestra.run.smithi100.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-13T07:02:19.533 INFO:teuthology.orchestra.run.smithi100.stdout:HOME_URL="https://www.redhat.com/" 2024-01-13T07:02:19.534 INFO:teuthology.orchestra.run.smithi100.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-13T07:02:19.534 INFO:teuthology.orchestra.run.smithi100.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-13T07:02:19.534 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-13T07:02:19.534 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-13T07:02:19.534 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-13T07:02:19.534 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-13T07:02:19.534 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-13T07:02:19.534 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server 2024-01-13T07:02:19.558 INFO:teuthology.lock.ops:Updating [smithi184.front.sepia.ceph.com]: set os type and version on server 2024-01-13T07:02:19.558 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2024-01-13T07:02:19.558 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T07:02:19.630 DEBUG:teuthology.orchestra.run.smithi184:> true 2024-01-13T07:02:19.700 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi184.front.sepia.ceph.com' 2024-01-13T07:02:19.701 DEBUG:teuthology.orchestra.run.smithi184:> uname -m 2024-01-13T07:02:19.758 INFO:teuthology.orchestra.run.smithi184.stdout:x86_64 2024-01-13T07:02:19.758 DEBUG:teuthology.orchestra.run.smithi184:> cat /etc/os-release 2024-01-13T07:02:19.816 INFO:teuthology.orchestra.run.smithi184.stdout:NAME="Red Hat Enterprise Linux" 2024-01-13T07:02:19.816 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION="8.6 (Ootpa)" 2024-01-13T07:02:19.816 INFO:teuthology.orchestra.run.smithi184.stdout:ID="rhel" 2024-01-13T07:02:19.816 INFO:teuthology.orchestra.run.smithi184.stdout:ID_LIKE="fedora" 2024-01-13T07:02:19.816 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_ID="8.6" 2024-01-13T07:02:19.816 INFO:teuthology.orchestra.run.smithi184.stdout:PLATFORM_ID="platform:el8" 2024-01-13T07:02:19.816 INFO:teuthology.orchestra.run.smithi184.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-13T07:02:19.816 INFO:teuthology.orchestra.run.smithi184.stdout:ANSI_COLOR="0;31" 2024-01-13T07:02:19.816 INFO:teuthology.orchestra.run.smithi184.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-13T07:02:19.816 INFO:teuthology.orchestra.run.smithi184.stdout:HOME_URL="https://www.redhat.com/" 2024-01-13T07:02:19.817 INFO:teuthology.orchestra.run.smithi184.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-13T07:02:19.817 INFO:teuthology.orchestra.run.smithi184.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-13T07:02:19.817 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-01-13T07:02:19.817 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-13T07:02:19.817 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-13T07:02:19.817 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-13T07:02:19.817 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-13T07:02:19.817 INFO:teuthology.lock.ops:Updating smithi184.front.sepia.ceph.com on lock server 2024-01-13T07:02:19.840 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T07:02:19.935 INFO:teuthology.dispatcher.supervisor:Running job 7515547 2024-01-13T07:02:19.935 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-01-12_15:24:25-rados-wip-yuri5-testing-2024-01-11-1300-pacific-distro-default-smithi/7515547 --name yuriw-2024-01-12_15:24:25-rados-wip-yuri5-testing-2024-01-11-1300-pacific-distro-default-smithi --description rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_rgw_multisite} -- /home/teuthworker/archive/yuriw-2024-01-12_15:24:25-rados-wip-yuri5-testing-2024-01-11-1300-pacific-distro-default-smithi/7515547/orig.config.yaml 2024-01-13T07:02:19.939 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-01-12_15:24:25-rados-wip-yuri5-testing-2024-01-11-1300-pacific-distro-default-smithi/7515547 2024-01-13T07:02:19.939 INFO:teuthology.dispatcher.supervisor:Job PID: 3389249 2024-01-13T07:02:19.939 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-01-13T07:04:19.940 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T07:06:20.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T07:08:20.088 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T07:10:20.156 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T07:12:20.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T07:14:20.308 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T07:16:20.395 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T07:18:20.474 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T07:20:20.560 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T07:20:20.632 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2024-01-13T07:20:20.741 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2024-01-13T07:20:20.741 INFO:teuthology.nuke:Checking targets against current locks 2024-01-13T07:20:20.791 DEBUG:teuthology.nuke:shortname: smithi038 2024-01-13T07:20:20.791 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-13T07:20:20.822 DEBUG:teuthology.nuke:shortname: smithi100 2024-01-13T07:20:20.822 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-13T07:20:20.829 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi038.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-12_15:24:25-rados-wip-yuri5-testing-2024-01-11-1300-pacific-distro-default-smithi/7515547', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-13 06:57:24.455547', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD0OoD8TZFugjQCnhdYbd+eMC+8hnc6UsFnHB0sVNsc6wuPBekzh2qqssnd2ZX+fArICakjX9m4OgV9Ku3rrja8='} 2024-01-13T07:20:20.853 DEBUG:teuthology.nuke:shortname: smithi184 2024-01-13T07:20:20.853 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-13T07:20:20.857 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi100.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-12_15:24:25-rados-wip-yuri5-testing-2024-01-11-1300-pacific-distro-default-smithi/7515547', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-13 06:57:24.456814', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHebSy9a5QRINqd9hC/0id8nlWGg/hVt6Oh5RGEMyiL/mQjuR6UIsKJlZhCijSlq4kmQZooh7cA3a+r1AfAGTXc='} 2024-01-13T07:20:20.878 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi184.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-12_15:24:25-rados-wip-yuri5-testing-2024-01-11-1300-pacific-distro-default-smithi/7515547', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-13 06:57:24.453761', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJRd6Yb6HNZVrzyoyqhfslqaSrH+xQ0SqLhTygz3xU3bB9pn1Fj5xUfrSfStiEbJNZN6BPt4IfDb1HwNXIbt14Y='} 2024-01-13T07:20:20.888 INFO:teuthology.orchestra.console.smithi038:Power off 2024-01-13T07:20:20.888 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-13T07:20:20.908 DEBUG:teuthology.orchestra.console.smithi038:power off output: Chassis Power Control: Down/Off 2024-01-13T07:20:20.909 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T07:20:20.923 INFO:teuthology.orchestra.console.smithi100:Power off 2024-01-13T07:20:20.923 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-13T07:20:20.936 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is off 2024-01-13T07:20:20.946 DEBUG:teuthology.orchestra.console.smithi100:power off output: Chassis Power Control: Down/Off 2024-01-13T07:20:20.947 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T07:20:20.962 INFO:teuthology.orchestra.console.smithi184:Power off 2024-01-13T07:20:20.962 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-13T07:20:20.972 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is off 2024-01-13T07:20:20.984 DEBUG:teuthology.orchestra.console.smithi184:power off output: Chassis Power Control: Down/Off 2024-01-13T07:20:20.984 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T07:20:21.008 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is off 2024-01-13T07:20:21.036 INFO:teuthology.orchestra.console.smithi038:Power off completed 2024-01-13T07:20:21.073 INFO:teuthology.orchestra.console.smithi100:Power off completed 2024-01-13T07:20:21.109 INFO:teuthology.orchestra.console.smithi184:Power off completed 2024-01-13T07:20:21.188 INFO:teuthology.lock.ops:unlocked: smithi038.front.sepia.ceph.com 2024-01-13T07:20:21.223 INFO:teuthology.lock.ops:unlocked: smithi100.front.sepia.ceph.com 2024-01-13T07:20:21.255 INFO:teuthology.lock.ops:unlocked: smithi184.front.sepia.ceph.com