2024-01-22T22:09:31.537 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-22T22:09:31.538 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-22T22:09:31.682 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f083e8e3c10>, signals=[15]) 2024-01-22T22:09:31.682 INFO:teuthology.lock.ops:Start node 'smithi050.front.sepia.ceph.com' reimaging 2024-01-22T22:09:31.683 INFO:teuthology.lock.ops:Updating [smithi050.front.sepia.ceph.com]: reset os type and version on server 2024-01-22T22:09:31.683 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server 2024-01-22T22:09:31.712 INFO:teuthology.lock.ops:Start node 'smithi133.front.sepia.ceph.com' reimaging 2024-01-22T22:09:31.712 INFO:teuthology.lock.ops:Updating [smithi133.front.sepia.ceph.com]: reset os type and version on server 2024-01-22T22:09:31.712 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2024-01-22T22:09:31.824 DEBUG:teuthology.provision.fog.smithi050:Requesting image smithi_rhel_8.6 (ID 5) 2024-01-22T22:09:31.847 DEBUG:teuthology.provision.fog.smithi133:Requesting image smithi_rhel_8.6 (ID 5) 2024-01-22T22:09:31.869 INFO:teuthology.provision.fog.smithi050:Scheduling deploy of rhel 8.6 2024-01-22T22:09:31.896 INFO:teuthology.provision.fog.smithi133:Scheduling deploy of rhel 8.6 2024-01-22T22:09:32.097 INFO:teuthology.orchestra.console.smithi050:Power off 2024-01-22T22:09:32.097 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-22T22:09:32.116 INFO:teuthology.orchestra.console.smithi133:Power off 2024-01-22T22:09:32.116 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-22T22:09:32.125 DEBUG:teuthology.orchestra.console.smithi050:power off output: Chassis Power Control: Down/Off 2024-01-22T22:09:32.126 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-22T22:09:32.139 DEBUG:teuthology.orchestra.console.smithi133:power off output: Chassis Power Control: Down/Off 2024-01-22T22:09:32.139 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-22T22:09:32.148 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is on 2024-01-22T22:09:32.162 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2024-01-22T22:09:36.152 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-22T22:09:36.163 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-22T22:09:36.262 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is on 2024-01-22T22:09:36.272 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2024-01-22T22:09:40.264 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-22T22:09:40.273 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-22T22:09:40.373 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is off 2024-01-22T22:09:40.381 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2024-01-22T22:09:40.474 INFO:teuthology.orchestra.console.smithi050:Power off completed 2024-01-22T22:09:40.482 INFO:teuthology.orchestra.console.smithi133:Power off completed 2024-01-22T22:09:40.576 INFO:teuthology.orchestra.console.smithi050:Power on 2024-01-22T22:09:40.576 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-22T22:09:40.583 INFO:teuthology.orchestra.console.smithi133:Power on 2024-01-22T22:09:40.583 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-22T22:09:40.597 DEBUG:teuthology.orchestra.console.smithi050:power on output: Chassis Power Control: Up/On 2024-01-22T22:09:40.597 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-22T22:09:40.605 DEBUG:teuthology.orchestra.console.smithi133:power on output: Chassis Power Control: Up/On 2024-01-22T22:09:40.605 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-22T22:09:40.618 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is off 2024-01-22T22:09:40.625 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2024-01-22T22:09:44.619 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-22T22:09:44.627 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-22T22:09:44.729 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is off 2024-01-22T22:09:44.736 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2024-01-22T22:09:48.732 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-22T22:09:48.739 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-22T22:09:48.842 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is on 2024-01-22T22:09:48.848 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2024-01-22T22:09:48.943 INFO:teuthology.orchestra.console.smithi050:Power on completed 2024-01-22T22:09:48.949 INFO:teuthology.orchestra.console.smithi133:Power on completed 2024-01-22T22:09:49.044 INFO:teuthology.provision.fog.smithi050:Waiting for deploy to finish 2024-01-22T22:09:49.050 INFO:teuthology.provision.fog.smithi133:Waiting for deploy to finish 2024-01-22T22:12:19.803 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-22T22:12:34.876 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-22T22:12:38.332 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50 2024-01-22T22:12:44.339 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-22T22:12:47.420 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50 2024-01-22T22:12:53.427 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-22T22:12:53.436 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-01-22T22:12:56.508 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50 2024-01-22T22:12:59.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-22T22:13:02.492 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-01-22T22:13:02.509 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-22T22:13:05.564 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50 2024-01-22T22:13:08.496 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-22T22:13:11.548 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-01-22T22:13:11.565 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-22T22:13:17.552 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-22T22:13:20.604 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-01-22T22:13:26.611 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-22T22:14:11.611 WARNING:teuthology.provision.fog.smithi050:timed out 2024-01-22T22:14:17.617 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-22T22:14:17.843 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-22T22:14:17.843 DEBUG:teuthology.orchestra.run.smithi050:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-22T22:14:18.117 INFO:teuthology.provision.fog.smithi050:Node is ready 2024-01-22T22:14:18.118 DEBUG:teuthology.orchestra.run.smithi050:> hostname 2024-01-22T22:14:18.138 INFO:teuthology.orchestra.run.smithi050.stdout:smithi050.front.sepia.ceph.com 2024-01-22T22:14:18.139 DEBUG:teuthology.orchestra.run.smithi050:> grep smithi050.front.sepia.ceph.com /etc/hosts 2024-01-22T22:14:18.200 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50 smithi050.front.sepia.ceph.com smithi050 2024-01-22T22:14:18.200 DEBUG:teuthology.orchestra.run.smithi050:> sudo hostname smithi050 2024-01-22T22:14:18.329 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i -e 's/smithi050.front.sepia.ceph.com/smithi050/g' /etc/hosts 2024-01-22T22:14:18.363 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i -e 's/172.21.15.50/172.21.15.50/g' /etc/hosts 2024-01-22T22:14:18.439 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i -e 's/smithi050.front.sepia.ceph.com/smithi050/g' /etc/hostname 2024-01-22T22:14:18.514 DEBUG:teuthology.orchestra.run.smithi050:> sudo hostname smithi050 2024-01-22T22:14:18.587 DEBUG:teuthology.orchestra.run.smithi050:> cat /etc/os-release 2024-01-22T22:14:18.649 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="Red Hat Enterprise Linux" 2024-01-22T22:14:18.649 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="8.6 (Ootpa)" 2024-01-22T22:14:18.649 INFO:teuthology.orchestra.run.smithi050.stdout:ID="rhel" 2024-01-22T22:14:18.649 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE="fedora" 2024-01-22T22:14:18.649 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="8.6" 2024-01-22T22:14:18.649 INFO:teuthology.orchestra.run.smithi050.stdout:PLATFORM_ID="platform:el8" 2024-01-22T22:14:18.649 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-22T22:14:18.649 INFO:teuthology.orchestra.run.smithi050.stdout:ANSI_COLOR="0;31" 2024-01-22T22:14:18.649 INFO:teuthology.orchestra.run.smithi050.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-22T22:14:18.649 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://www.redhat.com/" 2024-01-22T22:14:18.649 INFO:teuthology.orchestra.run.smithi050.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-22T22:14:18.650 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-22T22:14:18.650 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-22T22:14:18.650 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-22T22:14:18.650 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-22T22:14:18.650 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-22T22:14:18.650 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-22T22:14:18.651 INFO:teuthology.provision.fog.smithi050:Deploy complete! 2024-01-22T22:14:18.652 DEBUG:teuthology.parallel:result is None 2024-01-22T22:14:26.620 WARNING:teuthology.provision.fog.smithi133:timed out 2024-01-22T22:14:32.627 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-22T22:14:32.900 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-22T22:14:32.901 DEBUG:teuthology.orchestra.run.smithi133:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-22T22:14:33.149 INFO:teuthology.provision.fog.smithi133:Node is ready 2024-01-22T22:14:33.149 DEBUG:teuthology.orchestra.run.smithi133:> hostname 2024-01-22T22:14:33.166 INFO:teuthology.orchestra.run.smithi133.stdout:smithi133.front.sepia.ceph.com 2024-01-22T22:14:33.167 DEBUG:teuthology.orchestra.run.smithi133:> grep smithi133.front.sepia.ceph.com /etc/hosts 2024-01-22T22:14:33.225 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.15.133 smithi133.front.sepia.ceph.com smithi133 2024-01-22T22:14:33.225 DEBUG:teuthology.orchestra.run.smithi133:> sudo hostname smithi133 2024-01-22T22:14:33.336 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/smithi133.front.sepia.ceph.com/smithi133/g' /etc/hosts 2024-01-22T22:14:33.365 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/172.21.15.133/172.21.15.133/g' /etc/hosts 2024-01-22T22:14:33.433 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/smithi133.front.sepia.ceph.com/smithi133/g' /etc/hostname 2024-01-22T22:14:33.501 DEBUG:teuthology.orchestra.run.smithi133:> sudo hostname smithi133 2024-01-22T22:14:33.567 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release 2024-01-22T22:14:33.624 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="Red Hat Enterprise Linux" 2024-01-22T22:14:33.624 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="8.6 (Ootpa)" 2024-01-22T22:14:33.624 INFO:teuthology.orchestra.run.smithi133.stdout:ID="rhel" 2024-01-22T22:14:33.624 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE="fedora" 2024-01-22T22:14:33.624 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="8.6" 2024-01-22T22:14:33.625 INFO:teuthology.orchestra.run.smithi133.stdout:PLATFORM_ID="platform:el8" 2024-01-22T22:14:33.625 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-22T22:14:33.625 INFO:teuthology.orchestra.run.smithi133.stdout:ANSI_COLOR="0;31" 2024-01-22T22:14:33.625 INFO:teuthology.orchestra.run.smithi133.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-22T22:14:33.625 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://www.redhat.com/" 2024-01-22T22:14:33.625 INFO:teuthology.orchestra.run.smithi133.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-22T22:14:33.625 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-22T22:14:33.625 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-22T22:14:33.625 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-22T22:14:33.625 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-22T22:14:33.625 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-22T22:14:33.625 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-22T22:14:33.626 INFO:teuthology.provision.fog.smithi133:Deploy complete! 2024-01-22T22:14:33.626 DEBUG:teuthology.parallel:result is None 2024-01-22T22:14:33.781 INFO:teuthology.lock.ops:Checking smithi050.front.sepia.ceph.com 2024-01-22T22:14:33.782 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-22T22:14:33.810 INFO:teuthology.lock.ops:Checking smithi133.front.sepia.ceph.com 2024-01-22T22:14:33.811 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-22T22:14:33.836 INFO:teuthology.lock.ops:Updating [smithi050.front.sepia.ceph.com]: set os type and version on server 2024-01-22T22:14:33.837 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-01-22T22:14:33.837 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-22T22:14:33.950 DEBUG:teuthology.orchestra.run.smithi050:> true 2024-01-22T22:14:34.046 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-01-22T22:14:34.046 DEBUG:teuthology.orchestra.run.smithi050:> uname -m 2024-01-22T22:14:34.107 INFO:teuthology.orchestra.run.smithi050.stdout:x86_64 2024-01-22T22:14:34.107 DEBUG:teuthology.orchestra.run.smithi050:> cat /etc/os-release 2024-01-22T22:14:34.168 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="Red Hat Enterprise Linux" 2024-01-22T22:14:34.169 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="8.6 (Ootpa)" 2024-01-22T22:14:34.169 INFO:teuthology.orchestra.run.smithi050.stdout:ID="rhel" 2024-01-22T22:14:34.169 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE="fedora" 2024-01-22T22:14:34.169 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="8.6" 2024-01-22T22:14:34.169 INFO:teuthology.orchestra.run.smithi050.stdout:PLATFORM_ID="platform:el8" 2024-01-22T22:14:34.169 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-22T22:14:34.169 INFO:teuthology.orchestra.run.smithi050.stdout:ANSI_COLOR="0;31" 2024-01-22T22:14:34.169 INFO:teuthology.orchestra.run.smithi050.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-22T22:14:34.169 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://www.redhat.com/" 2024-01-22T22:14:34.169 INFO:teuthology.orchestra.run.smithi050.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-22T22:14:34.169 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-22T22:14:34.170 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-22T22:14:34.170 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-22T22:14:34.170 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-22T22:14:34.170 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-22T22:14:34.170 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-22T22:14:34.170 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server 2024-01-22T22:14:34.194 INFO:teuthology.lock.ops:Updating [smithi133.front.sepia.ceph.com]: set os type and version on server 2024-01-22T22:14:34.194 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-01-22T22:14:34.194 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-22T22:14:34.267 DEBUG:teuthology.orchestra.run.smithi133:> true 2024-01-22T22:14:34.337 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-01-22T22:14:34.337 DEBUG:teuthology.orchestra.run.smithi133:> uname -m 2024-01-22T22:14:34.394 INFO:teuthology.orchestra.run.smithi133.stdout:x86_64 2024-01-22T22:14:34.395 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release 2024-01-22T22:14:34.451 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="Red Hat Enterprise Linux" 2024-01-22T22:14:34.452 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="8.6 (Ootpa)" 2024-01-22T22:14:34.452 INFO:teuthology.orchestra.run.smithi133.stdout:ID="rhel" 2024-01-22T22:14:34.452 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE="fedora" 2024-01-22T22:14:34.452 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="8.6" 2024-01-22T22:14:34.452 INFO:teuthology.orchestra.run.smithi133.stdout:PLATFORM_ID="platform:el8" 2024-01-22T22:14:34.452 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-22T22:14:34.452 INFO:teuthology.orchestra.run.smithi133.stdout:ANSI_COLOR="0;31" 2024-01-22T22:14:34.452 INFO:teuthology.orchestra.run.smithi133.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-22T22:14:34.452 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://www.redhat.com/" 2024-01-22T22:14:34.452 INFO:teuthology.orchestra.run.smithi133.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-22T22:14:34.452 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-22T22:14:34.452 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-22T22:14:34.452 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-22T22:14:34.453 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-22T22:14:34.453 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-22T22:14:34.453 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-22T22:14:34.453 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2024-01-22T22:14:34.477 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-22T22:14:34.569 INFO:teuthology.dispatcher.supervisor:Running job 7526566 2024-01-22T22:14:34.569 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-01-22_15:55:46-rados-wip-yuri-testing-2024-01-21-0805-reef-distro-default-smithi/7526566 --name yuriw-2024-01-22_15:55:46-rados-wip-yuri-testing-2024-01-21-0805-reef-distro-default-smithi --description rados/upgrade/parallel/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} -- /home/teuthworker/archive/yuriw-2024-01-22_15:55:46-rados-wip-yuri-testing-2024-01-21-0805-reef-distro-default-smithi/7526566/orig.config.yaml 2024-01-22T22:14:34.573 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-01-22_15:55:46-rados-wip-yuri-testing-2024-01-21-0805-reef-distro-default-smithi/7526566 2024-01-22T22:14:34.573 INFO:teuthology.dispatcher.supervisor:Job PID: 3656211 2024-01-22T22:14:34.573 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-01-22T22:16:34.669 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-22T22:18:34.839 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-22T22:20:35.016 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-22T22:22:35.188 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-22T22:24:35.360 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-22T22:26:35.530 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-22T22:28:35.699 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-22T22:30:35.860 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-22T22:32:36.028 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-22T22:34:36.198 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-22T22:36:36.366 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-22T22:38:36.532 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-22T22:40:36.711 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-22T22:42:36.900 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-22T22:44:37.072 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-22T22:46:37.246 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-22T22:48:37.416 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-22T22:50:37.588 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-22T22:52:37.756 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-22T22:54:37.930 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-22T22:56:38.092 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-22T22:58:38.260 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-22T23:00:38.428 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-22T23:02:38.852 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-22T23:04:39.021 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-22T23:06:39.188 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-22T23:08:39.360 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-22T23:10:39.536 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-22T23:12:39.713 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-22T23:14:39.884 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-22T23:16:40.052 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-22T23:18:40.221 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-22T23:20:40.392 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-22T23:22:40.556 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-22T23:24:40.728 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-22T23:26:40.804 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-22T23:28:40.966 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-22T23:30:41.125 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-22T23:32:41.292 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-22T23:34:41.464 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-22T23:36:41.636 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-22T23:38:41.804 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-22T23:40:41.976 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-22T23:42:42.140 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-22T23:44:42.304 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-22T23:46:42.473 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-22T23:48:42.637 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-22T23:48:42.705 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2024-01-22T23:48:42.893 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2024-01-22T23:48:42.893 INFO:teuthology.nuke:Checking targets against current locks 2024-01-22T23:48:42.944 DEBUG:teuthology.nuke:shortname: smithi050 2024-01-22T23:48:42.945 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-22T23:48:42.969 DEBUG:teuthology.nuke:shortname: smithi133 2024-01-22T23:48:42.969 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-22T23:48:42.972 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi050.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-22_15:55:46-rados-wip-yuri-testing-2024-01-21-0805-reef-distro-default-smithi/7526566', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-22 22:09:30.474484', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBILYxa2c/uzE2wtNWtumc+jbTVKR6qtncbBHxX/ZHFNRn3p9jQ1O2JB4gmcsydG4X9N+oXpvsg+TEfc4qezZhjw='} 2024-01-22T23:48:42.993 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi133.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-22_15:55:46-rados-wip-yuri-testing-2024-01-21-0805-reef-distro-default-smithi/7526566', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-22 22:09:30.476494', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI4J+w7GJDZWJtJqXzENb/nqMi02Y2hjgd0bXp0lzQ2ob6EuZ6thXlj9KZ96aCxvuu6pBWTClecMLJaspyzekW0='} 2024-01-22T23:48:43.022 INFO:teuthology.orchestra.console.smithi050:Power off 2024-01-22T23:48:43.022 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-22T23:48:43.044 DEBUG:teuthology.orchestra.console.smithi050:power off output: Chassis Power Control: Down/Off 2024-01-22T23:48:43.044 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-22T23:48:43.055 INFO:teuthology.orchestra.console.smithi133:Power off 2024-01-22T23:48:43.056 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-22T23:48:43.063 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is off 2024-01-22T23:48:43.077 DEBUG:teuthology.orchestra.console.smithi133:power off output: Chassis Power Control: Down/Off 2024-01-22T23:48:43.077 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-22T23:48:43.099 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2024-01-22T23:48:43.165 INFO:teuthology.orchestra.console.smithi050:Power off completed 2024-01-22T23:48:43.200 INFO:teuthology.orchestra.console.smithi133:Power off completed 2024-01-22T23:48:43.314 INFO:teuthology.lock.ops:unlocked: smithi050.front.sepia.ceph.com 2024-01-22T23:48:43.346 INFO:teuthology.lock.ops:unlocked: smithi133.front.sepia.ceph.com