2024-02-06T17:23:14.529 INFO:root:teuthology version: 0.0.1.dev256+gd9fdb22 2024-02-06T17:23:14.530 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-06T17:23:14.680 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f274fb11c10>, signals=[15]) 2024-02-06T17:23:14.681 INFO:teuthology.lock.ops:Start node 'smithi100.front.sepia.ceph.com' reimaging 2024-02-06T17:23:14.681 INFO:teuthology.lock.ops:Updating [smithi100.front.sepia.ceph.com]: reset os type and version on server 2024-02-06T17:23:14.681 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server 2024-02-06T17:23:14.706 INFO:teuthology.lock.ops:Start node 'smithi191.front.sepia.ceph.com' reimaging 2024-02-06T17:23:14.707 INFO:teuthology.lock.ops:Updating [smithi191.front.sepia.ceph.com]: reset os type and version on server 2024-02-06T17:23:14.707 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2024-02-06T17:23:14.731 INFO:teuthology.lock.ops:Start node 'smithi195.front.sepia.ceph.com' reimaging 2024-02-06T17:23:14.731 INFO:teuthology.lock.ops:Updating [smithi195.front.sepia.ceph.com]: reset os type and version on server 2024-02-06T17:23:14.731 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2024-02-06T17:23:14.822 DEBUG:teuthology.provision.fog.smithi100:Requesting image smithi_rhel_8.6 (ID 5) 2024-02-06T17:23:14.865 DEBUG:teuthology.provision.fog.smithi191:Requesting image smithi_rhel_8.6 (ID 5) 2024-02-06T17:23:14.866 INFO:teuthology.provision.fog.smithi100:Scheduling deploy of rhel 8.6 2024-02-06T17:23:14.874 DEBUG:teuthology.provision.fog.smithi195:Requesting image smithi_rhel_8.6 (ID 5) 2024-02-06T17:23:14.910 INFO:teuthology.provision.fog.smithi191:Scheduling deploy of rhel 8.6 2024-02-06T17:23:14.914 INFO:teuthology.provision.fog.smithi195:Scheduling deploy of rhel 8.6 2024-02-06T17:23:15.157 INFO:teuthology.orchestra.console.smithi191:Power off 2024-02-06T17:23:15.158 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-06T17:23:15.171 INFO:teuthology.orchestra.console.smithi195:Power off 2024-02-06T17:23:15.171 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-06T17:23:15.183 INFO:teuthology.orchestra.console.smithi100:Power off 2024-02-06T17:23:15.184 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-06T17:23:15.192 DEBUG:teuthology.orchestra.console.smithi191:power off output: Chassis Power Control: Down/Off 2024-02-06T17:23:15.192 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-06T17:23:15.199 DEBUG:teuthology.orchestra.console.smithi195:power off output: Chassis Power Control: Down/Off 2024-02-06T17:23:15.200 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-06T17:23:15.208 DEBUG:teuthology.orchestra.console.smithi100:power off output: Chassis Power Control: Down/Off 2024-02-06T17:23:15.208 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-06T17:23:15.216 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on 2024-02-06T17:23:15.222 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2024-02-06T17:23:15.230 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on 2024-02-06T17:23:19.221 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-06T17:23:19.227 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-06T17:23:19.233 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-06T17:23:19.330 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on 2024-02-06T17:23:19.336 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2024-02-06T17:23:19.342 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on 2024-02-06T17:23:23.334 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-06T17:23:23.341 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-06T17:23:23.347 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-06T17:23:23.443 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on 2024-02-06T17:23:23.449 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2024-02-06T17:23:23.456 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is off 2024-02-06T17:23:23.550 INFO:teuthology.orchestra.console.smithi195:Power off completed 2024-02-06T17:23:23.557 INFO:teuthology.orchestra.console.smithi100:Power off completed 2024-02-06T17:23:23.651 INFO:teuthology.orchestra.console.smithi195:Power on 2024-02-06T17:23:23.652 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-06T17:23:23.659 INFO:teuthology.orchestra.console.smithi100:Power on 2024-02-06T17:23:23.659 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-06T17:23:23.673 DEBUG:teuthology.orchestra.console.smithi195:power on output: Chassis Power Control: Up/On 2024-02-06T17:23:23.673 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-06T17:23:23.682 DEBUG:teuthology.orchestra.console.smithi100:power on output: Chassis Power Control: Up/On 2024-02-06T17:23:23.682 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-06T17:23:23.695 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2024-02-06T17:23:23.701 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is off 2024-02-06T17:23:27.447 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-06T17:23:27.556 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off 2024-02-06T17:23:27.657 INFO:teuthology.orchestra.console.smithi191:Power off completed 2024-02-06T17:23:27.696 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-06T17:23:27.702 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-06T17:23:27.758 INFO:teuthology.orchestra.console.smithi191:Power on 2024-02-06T17:23:27.758 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-06T17:23:27.778 DEBUG:teuthology.orchestra.console.smithi191:power on output: Chassis Power Control: Up/On 2024-02-06T17:23:27.778 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-06T17:23:27.797 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off 2024-02-06T17:23:27.805 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2024-02-06T17:23:27.810 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is off 2024-02-06T17:23:31.800 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-06T17:23:31.807 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-06T17:23:31.813 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-06T17:23:31.908 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on 2024-02-06T17:23:31.914 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2024-02-06T17:23:31.921 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on 2024-02-06T17:23:32.009 INFO:teuthology.orchestra.console.smithi191:Power on completed 2024-02-06T17:23:32.015 INFO:teuthology.orchestra.console.smithi195:Power on completed 2024-02-06T17:23:32.022 INFO:teuthology.orchestra.console.smithi100:Power on completed 2024-02-06T17:23:32.110 INFO:teuthology.provision.fog.smithi191:Waiting for deploy to finish 2024-02-06T17:23:32.116 INFO:teuthology.provision.fog.smithi195:Waiting for deploy to finish 2024-02-06T17:23:32.123 INFO:teuthology.provision.fog.smithi100:Waiting for deploy to finish 2024-02-06T17:26:17.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-06T17:26:17.921 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-06T17:26:17.922 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-06T17:26:36.351 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100 2024-02-06T17:26:36.352 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2024-02-06T17:26:36.352 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-02-06T17:26:42.357 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-06T17:26:42.359 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-06T17:26:42.361 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-06T17:26:45.440 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100 2024-02-06T17:26:45.440 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2024-02-06T17:26:45.441 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-02-06T17:26:51.444 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-06T17:26:51.446 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-06T17:26:51.448 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-06T17:26:54.524 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100 2024-02-06T17:26:54.524 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2024-02-06T17:26:54.525 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-02-06T17:27:00.532 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-06T17:27:00.534 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-06T17:27:00.536 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-06T17:27:03.616 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100 2024-02-06T17:27:03.616 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2024-02-06T17:27:03.617 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-02-06T17:27:09.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-06T17:27:09.623 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-06T17:27:09.625 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-06T17:27:12.704 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-02-06T17:27:18.709 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-06T17:28:09.673 WARNING:teuthology.provision.fog.smithi100:timed out 2024-02-06T17:28:09.673 WARNING:teuthology.provision.fog.smithi195:timed out 2024-02-06T17:28:15.681 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-06T17:28:15.682 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-06T17:28:15.959 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-06T17:28:15.959 DEBUG:teuthology.orchestra.run.smithi100:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-06T17:28:15.978 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-06T17:28:15.978 DEBUG:teuthology.orchestra.run.smithi195:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-06T17:28:16.233 INFO:teuthology.provision.fog.smithi100:Node is ready 2024-02-06T17:28:16.233 DEBUG:teuthology.orchestra.run.smithi100:> hostname 2024-02-06T17:28:16.246 INFO:teuthology.provision.fog.smithi195:Node is ready 2024-02-06T17:28:16.246 DEBUG:teuthology.orchestra.run.smithi195:> hostname 2024-02-06T17:28:16.251 INFO:teuthology.orchestra.run.smithi100.stdout:smithi100.front.sepia.ceph.com 2024-02-06T17:28:16.251 DEBUG:teuthology.orchestra.run.smithi100:> grep smithi100.front.sepia.ceph.com /etc/hosts 2024-02-06T17:28:16.263 INFO:teuthology.orchestra.run.smithi195.stdout:smithi195.front.sepia.ceph.com 2024-02-06T17:28:16.263 DEBUG:teuthology.orchestra.run.smithi195:> grep smithi195.front.sepia.ceph.com /etc/hosts 2024-02-06T17:28:16.312 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100 smithi100.front.sepia.ceph.com smithi100 2024-02-06T17:28:16.312 DEBUG:teuthology.orchestra.run.smithi100:> sudo hostname smithi100 2024-02-06T17:28:16.324 INFO:teuthology.orchestra.run.smithi195.stdout:172.21.15.195 smithi195.front.sepia.ceph.com smithi195 2024-02-06T17:28:16.324 DEBUG:teuthology.orchestra.run.smithi195:> sudo hostname smithi195 2024-02-06T17:28:16.414 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i -e 's/smithi100.front.sepia.ceph.com/smithi100/g' /etc/hosts 2024-02-06T17:28:16.433 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/smithi195.front.sepia.ceph.com/smithi195/g' /etc/hosts 2024-02-06T17:28:16.441 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i -e 's/172.21.15.100/172.21.15.100/g' /etc/hosts 2024-02-06T17:28:16.461 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/172.21.15.195/172.21.15.195/g' /etc/hosts 2024-02-06T17:28:16.512 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i -e 's/smithi100.front.sepia.ceph.com/smithi100/g' /etc/hostname 2024-02-06T17:28:16.533 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/smithi195.front.sepia.ceph.com/smithi195/g' /etc/hostname 2024-02-06T17:28:16.582 DEBUG:teuthology.orchestra.run.smithi100:> sudo hostname smithi100 2024-02-06T17:28:16.603 DEBUG:teuthology.orchestra.run.smithi195:> sudo hostname smithi195 2024-02-06T17:28:16.651 DEBUG:teuthology.orchestra.run.smithi100:> cat /etc/os-release 2024-02-06T17:28:16.672 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2024-02-06T17:28:16.712 INFO:teuthology.orchestra.run.smithi100.stdout:NAME="Red Hat Enterprise Linux" 2024-02-06T17:28:16.713 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION="8.6 (Ootpa)" 2024-02-06T17:28:16.713 INFO:teuthology.orchestra.run.smithi100.stdout:ID="rhel" 2024-02-06T17:28:16.713 INFO:teuthology.orchestra.run.smithi100.stdout:ID_LIKE="fedora" 2024-02-06T17:28:16.713 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_ID="8.6" 2024-02-06T17:28:16.713 INFO:teuthology.orchestra.run.smithi100.stdout:PLATFORM_ID="platform:el8" 2024-02-06T17:28:16.713 INFO:teuthology.orchestra.run.smithi100.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-02-06T17:28:16.713 INFO:teuthology.orchestra.run.smithi100.stdout:ANSI_COLOR="0;31" 2024-02-06T17:28:16.713 INFO:teuthology.orchestra.run.smithi100.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-02-06T17:28:16.713 INFO:teuthology.orchestra.run.smithi100.stdout:HOME_URL="https://www.redhat.com/" 2024-02-06T17:28:16.713 INFO:teuthology.orchestra.run.smithi100.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-02-06T17:28:16.713 INFO:teuthology.orchestra.run.smithi100.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-06T17:28:16.713 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-06T17:28:16.713 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-06T17:28:16.713 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-02-06T17:28:16.713 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-02-06T17:28:16.714 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-02-06T17:28:16.714 INFO:teuthology.provision.fog.smithi100:Deploy complete! 2024-02-06T17:28:16.715 DEBUG:teuthology.parallel:result is None 2024-02-06T17:28:16.731 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="Red Hat Enterprise Linux" 2024-02-06T17:28:16.731 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="8.6 (Ootpa)" 2024-02-06T17:28:16.731 INFO:teuthology.orchestra.run.smithi195.stdout:ID="rhel" 2024-02-06T17:28:16.731 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE="fedora" 2024-02-06T17:28:16.731 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="8.6" 2024-02-06T17:28:16.731 INFO:teuthology.orchestra.run.smithi195.stdout:PLATFORM_ID="platform:el8" 2024-02-06T17:28:16.732 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-02-06T17:28:16.732 INFO:teuthology.orchestra.run.smithi195.stdout:ANSI_COLOR="0;31" 2024-02-06T17:28:16.732 INFO:teuthology.orchestra.run.smithi195.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-02-06T17:28:16.732 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://www.redhat.com/" 2024-02-06T17:28:16.732 INFO:teuthology.orchestra.run.smithi195.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-02-06T17:28:16.732 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-06T17:28:16.732 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-02-06T17:28:16.732 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-06T17:28:16.732 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-02-06T17:28:16.732 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-02-06T17:28:16.732 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-02-06T17:28:16.733 INFO:teuthology.provision.fog.smithi195:Deploy complete! 2024-02-06T17:28:16.733 DEBUG:teuthology.parallel:result is None 2024-02-06T17:28:18.712 WARNING:teuthology.provision.fog.smithi191:timed out 2024-02-06T17:28:24.716 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-06T17:28:25.006 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-06T17:28:25.007 DEBUG:teuthology.orchestra.run.smithi191:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-06T17:28:25.261 INFO:teuthology.provision.fog.smithi191:Node is ready 2024-02-06T17:28:25.261 DEBUG:teuthology.orchestra.run.smithi191:> hostname 2024-02-06T17:28:25.278 INFO:teuthology.orchestra.run.smithi191.stdout:smithi191.front.sepia.ceph.com 2024-02-06T17:28:25.278 DEBUG:teuthology.orchestra.run.smithi191:> grep smithi191.front.sepia.ceph.com /etc/hosts 2024-02-06T17:28:25.336 INFO:teuthology.orchestra.run.smithi191.stdout:172.21.15.191 smithi191.front.sepia.ceph.com smithi191 2024-02-06T17:28:25.336 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname smithi191 2024-02-06T17:28:25.434 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/smithi191.front.sepia.ceph.com/smithi191/g' /etc/hosts 2024-02-06T17:28:25.461 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/172.21.15.191/172.21.15.191/g' /etc/hosts 2024-02-06T17:28:25.529 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/smithi191.front.sepia.ceph.com/smithi191/g' /etc/hostname 2024-02-06T17:28:25.596 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname smithi191 2024-02-06T17:28:25.662 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release 2024-02-06T17:28:25.719 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="Red Hat Enterprise Linux" 2024-02-06T17:28:25.719 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="8.6 (Ootpa)" 2024-02-06T17:28:25.719 INFO:teuthology.orchestra.run.smithi191.stdout:ID="rhel" 2024-02-06T17:28:25.720 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="fedora" 2024-02-06T17:28:25.720 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="8.6" 2024-02-06T17:28:25.720 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el8" 2024-02-06T17:28:25.720 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-02-06T17:28:25.720 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31" 2024-02-06T17:28:25.720 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-02-06T17:28:25.720 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://www.redhat.com/" 2024-02-06T17:28:25.720 INFO:teuthology.orchestra.run.smithi191.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-02-06T17:28:25.720 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-06T17:28:25.720 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-02-06T17:28:25.720 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-06T17:28:25.720 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-02-06T17:28:25.720 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-02-06T17:28:25.721 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-02-06T17:28:25.721 INFO:teuthology.provision.fog.smithi191:Deploy complete! 2024-02-06T17:28:25.721 DEBUG:teuthology.parallel:result is None 2024-02-06T17:28:25.919 INFO:teuthology.lock.ops:Checking smithi100.front.sepia.ceph.com 2024-02-06T17:28:25.919 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-06T17:28:25.949 INFO:teuthology.lock.ops:Checking smithi191.front.sepia.ceph.com 2024-02-06T17:28:25.949 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-06T17:28:25.974 INFO:teuthology.lock.ops:Checking smithi195.front.sepia.ceph.com 2024-02-06T17:28:25.974 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-06T17:28:25.991 INFO:teuthology.lock.ops:Updating [smithi100.front.sepia.ceph.com]: set os type and version on server 2024-02-06T17:28:25.992 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-02-06T17:28:25.992 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-06T17:28:26.067 DEBUG:teuthology.orchestra.run.smithi100:> true 2024-02-06T17:28:26.135 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-02-06T17:28:26.135 DEBUG:teuthology.orchestra.run.smithi100:> uname -m 2024-02-06T17:28:26.195 INFO:teuthology.orchestra.run.smithi100.stdout:x86_64 2024-02-06T17:28:26.195 DEBUG:teuthology.orchestra.run.smithi100:> cat /etc/os-release 2024-02-06T17:28:26.254 INFO:teuthology.orchestra.run.smithi100.stdout:NAME="Red Hat Enterprise Linux" 2024-02-06T17:28:26.254 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION="8.6 (Ootpa)" 2024-02-06T17:28:26.254 INFO:teuthology.orchestra.run.smithi100.stdout:ID="rhel" 2024-02-06T17:28:26.254 INFO:teuthology.orchestra.run.smithi100.stdout:ID_LIKE="fedora" 2024-02-06T17:28:26.255 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_ID="8.6" 2024-02-06T17:28:26.255 INFO:teuthology.orchestra.run.smithi100.stdout:PLATFORM_ID="platform:el8" 2024-02-06T17:28:26.255 INFO:teuthology.orchestra.run.smithi100.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-02-06T17:28:26.255 INFO:teuthology.orchestra.run.smithi100.stdout:ANSI_COLOR="0;31" 2024-02-06T17:28:26.255 INFO:teuthology.orchestra.run.smithi100.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-02-06T17:28:26.255 INFO:teuthology.orchestra.run.smithi100.stdout:HOME_URL="https://www.redhat.com/" 2024-02-06T17:28:26.255 INFO:teuthology.orchestra.run.smithi100.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-02-06T17:28:26.255 INFO:teuthology.orchestra.run.smithi100.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-06T17:28:26.255 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-06T17:28:26.255 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-06T17:28:26.255 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-02-06T17:28:26.255 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-02-06T17:28:26.255 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-02-06T17:28:26.256 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server 2024-02-06T17:28:26.274 INFO:teuthology.lock.ops:Updating [smithi191.front.sepia.ceph.com]: set os type and version on server 2024-02-06T17:28:26.274 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-02-06T17:28:26.274 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-06T17:28:26.347 DEBUG:teuthology.orchestra.run.smithi191:> true 2024-02-06T17:28:26.416 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-02-06T17:28:26.416 DEBUG:teuthology.orchestra.run.smithi191:> uname -m 2024-02-06T17:28:26.476 INFO:teuthology.orchestra.run.smithi191.stdout:x86_64 2024-02-06T17:28:26.477 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release 2024-02-06T17:28:26.536 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="Red Hat Enterprise Linux" 2024-02-06T17:28:26.536 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="8.6 (Ootpa)" 2024-02-06T17:28:26.536 INFO:teuthology.orchestra.run.smithi191.stdout:ID="rhel" 2024-02-06T17:28:26.536 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="fedora" 2024-02-06T17:28:26.536 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="8.6" 2024-02-06T17:28:26.537 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el8" 2024-02-06T17:28:26.537 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-02-06T17:28:26.537 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31" 2024-02-06T17:28:26.537 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-02-06T17:28:26.537 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://www.redhat.com/" 2024-02-06T17:28:26.537 INFO:teuthology.orchestra.run.smithi191.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-02-06T17:28:26.537 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-06T17:28:26.537 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-02-06T17:28:26.537 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-06T17:28:26.537 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-02-06T17:28:26.537 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-02-06T17:28:26.537 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-02-06T17:28:26.539 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2024-02-06T17:28:26.558 INFO:teuthology.lock.ops:Updating [smithi195.front.sepia.ceph.com]: set os type and version on server 2024-02-06T17:28:26.558 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-02-06T17:28:26.559 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-06T17:28:26.632 DEBUG:teuthology.orchestra.run.smithi195:> true 2024-02-06T17:28:26.699 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-02-06T17:28:26.700 DEBUG:teuthology.orchestra.run.smithi195:> uname -m 2024-02-06T17:28:26.759 INFO:teuthology.orchestra.run.smithi195.stdout:x86_64 2024-02-06T17:28:26.759 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2024-02-06T17:28:26.819 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="Red Hat Enterprise Linux" 2024-02-06T17:28:26.819 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="8.6 (Ootpa)" 2024-02-06T17:28:26.819 INFO:teuthology.orchestra.run.smithi195.stdout:ID="rhel" 2024-02-06T17:28:26.819 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE="fedora" 2024-02-06T17:28:26.819 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="8.6" 2024-02-06T17:28:26.819 INFO:teuthology.orchestra.run.smithi195.stdout:PLATFORM_ID="platform:el8" 2024-02-06T17:28:26.820 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-02-06T17:28:26.820 INFO:teuthology.orchestra.run.smithi195.stdout:ANSI_COLOR="0;31" 2024-02-06T17:28:26.820 INFO:teuthology.orchestra.run.smithi195.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-02-06T17:28:26.820 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://www.redhat.com/" 2024-02-06T17:28:26.820 INFO:teuthology.orchestra.run.smithi195.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-02-06T17:28:26.820 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-06T17:28:26.820 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-02-06T17:28:26.820 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-06T17:28:26.820 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-02-06T17:28:26.820 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-02-06T17:28:26.820 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-02-06T17:28:26.821 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2024-02-06T17:28:26.841 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-06T17:28:26.925 INFO:teuthology.dispatcher.supervisor:Running job 7548082 2024-02-06T17:28:26.925 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-02-06_00:23:51-rados-wip-yuri10-testing-2024-02-02-1149-pacific-distro-default-smithi/7548082 --name yuriw-2024-02-06_00:23:51-rados-wip-yuri10-testing-2024-02-02-1149-pacific-distro-default-smithi --description rados/cephadm/rbd_iscsi/{base/install cluster/{fixed-3 openstack} pool/datapool supported-random-distro$/{rhel_8} workloads/ceph_iscsi} -- /home/teuthworker/archive/yuriw-2024-02-06_00:23:51-rados-wip-yuri10-testing-2024-02-02-1149-pacific-distro-default-smithi/7548082/orig.config.yaml 2024-02-06T17:28:26.928 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-02-06_00:23:51-rados-wip-yuri10-testing-2024-02-02-1149-pacific-distro-default-smithi/7548082 2024-02-06T17:28:26.928 INFO:teuthology.dispatcher.supervisor:Job PID: 2893651 2024-02-06T17:28:26.928 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-02-06T17:30:27.029 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-06T17:32:27.168 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-06T17:34:27.317 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-06T17:36:27.484 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-06T17:38:27.643 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-06T17:40:27.741 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-06T17:42:27.908 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-06T17:44:28.080 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-06T17:46:28.221 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-06T17:46:28.284 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1