2024-01-11T21:16:15.749 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-11T21:16:15.750 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T21:16:15.870 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f51b9460c10>, signals=[15]) 2024-01-11T21:16:15.870 INFO:teuthology.lock.ops:Start node 'smithi029.front.sepia.ceph.com' reimaging 2024-01-11T21:16:15.871 INFO:teuthology.lock.ops:Updating [smithi029.front.sepia.ceph.com]: reset os type and version on server 2024-01-11T21:16:15.871 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server 2024-01-11T21:16:15.894 INFO:teuthology.lock.ops:Start node 'smithi148.front.sepia.ceph.com' reimaging 2024-01-11T21:16:15.895 INFO:teuthology.lock.ops:Updating [smithi148.front.sepia.ceph.com]: reset os type and version on server 2024-01-11T21:16:15.895 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server 2024-01-11T21:16:16.012 DEBUG:teuthology.provision.fog.smithi029:Requesting image smithi_centos_9.stream (ID 10) 2024-01-11T21:16:16.031 DEBUG:teuthology.provision.fog.smithi148:Requesting image smithi_centos_9.stream (ID 10) 2024-01-11T21:16:16.065 INFO:teuthology.provision.fog.smithi029:Scheduling deploy of centos 9.stream 2024-01-11T21:16:16.080 INFO:teuthology.provision.fog.smithi148:Scheduling deploy of centos 9.stream 2024-01-11T21:16:16.295 INFO:teuthology.orchestra.console.smithi029:Power off 2024-01-11T21:16:16.295 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-11T21:16:16.318 DEBUG:teuthology.orchestra.console.smithi029:power off output: Chassis Power Control: Down/Off 2024-01-11T21:16:16.318 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T21:16:16.335 INFO:teuthology.orchestra.console.smithi148:Power off 2024-01-11T21:16:16.335 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-11T21:16:16.342 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is on 2024-01-11T21:16:16.356 DEBUG:teuthology.orchestra.console.smithi148:power off output: Chassis Power Control: Down/Off 2024-01-11T21:16:16.356 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T21:16:16.378 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on 2024-01-11T21:16:20.344 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T21:16:20.380 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T21:16:20.453 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is on 2024-01-11T21:16:20.489 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on 2024-01-11T21:16:24.456 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T21:16:24.490 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T21:16:24.565 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is off 2024-01-11T21:16:24.600 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on 2024-01-11T21:16:24.666 INFO:teuthology.orchestra.console.smithi029:Power off completed 2024-01-11T21:16:24.767 INFO:teuthology.orchestra.console.smithi029:Power on 2024-01-11T21:16:24.767 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-11T21:16:24.791 DEBUG:teuthology.orchestra.console.smithi029:power on output: Chassis Power Control: Up/On 2024-01-11T21:16:24.791 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T21:16:24.813 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is off 2024-01-11T21:16:28.604 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T21:16:28.713 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2024-01-11T21:16:28.813 INFO:teuthology.orchestra.console.smithi148:Power off completed 2024-01-11T21:16:28.814 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T21:16:28.915 INFO:teuthology.orchestra.console.smithi148:Power on 2024-01-11T21:16:28.915 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-11T21:16:28.928 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is off 2024-01-11T21:16:28.941 DEBUG:teuthology.orchestra.console.smithi148:power on output: Chassis Power Control: Up/On 2024-01-11T21:16:28.941 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T21:16:28.964 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2024-01-11T21:16:32.932 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T21:16:32.965 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T21:16:33.041 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is on 2024-01-11T21:16:33.076 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on 2024-01-11T21:16:33.142 INFO:teuthology.orchestra.console.smithi029:Power on completed 2024-01-11T21:16:33.177 INFO:teuthology.orchestra.console.smithi148:Power on completed 2024-01-11T21:16:33.243 INFO:teuthology.provision.fog.smithi029:Waiting for deploy to finish 2024-01-11T21:16:33.278 INFO:teuthology.provision.fog.smithi148:Waiting for deploy to finish 2024-01-11T21:19:19.193 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T21:19:22.268 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-01-11T21:19:28.275 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T21:19:31.356 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-01-11T21:19:34.280 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T21:19:37.341 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29 2024-01-11T21:19:37.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T21:19:40.412 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-01-11T21:19:43.346 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T21:19:46.416 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T21:19:46.428 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29 2024-01-11T21:19:49.468 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-01-11T21:19:52.432 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T21:19:55.469 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T21:19:55.488 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29 2024-01-11T21:19:58.524 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-01-11T21:20:01.492 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T21:20:04.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T21:20:04.572 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29 2024-01-11T21:20:07.580 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-01-11T21:20:10.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T21:20:13.584 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T21:20:13.628 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29 2024-01-11T21:20:19.635 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T21:21:13.641 WARNING:teuthology.provision.fog.smithi148:timed out 2024-01-11T21:21:19.640 WARNING:teuthology.provision.fog.smithi029:timed out 2024-01-11T21:21:19.642 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T21:21:20.131 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-11T21:21:20.131 DEBUG:teuthology.orchestra.run.smithi148:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-11T21:21:20.509 INFO:teuthology.provision.fog.smithi148:Node is ready 2024-01-11T21:21:20.509 DEBUG:teuthology.orchestra.run.smithi148:> hostname 2024-01-11T21:21:20.524 INFO:teuthology.orchestra.run.smithi148.stdout:smithi148.front.sepia.ceph.com 2024-01-11T21:21:20.524 DEBUG:teuthology.orchestra.run.smithi148:> grep smithi148.front.sepia.ceph.com /etc/hosts 2024-01-11T21:21:20.581 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148 smithi148.front.sepia.ceph.com smithi148 2024-01-11T21:21:20.581 DEBUG:teuthology.orchestra.run.smithi148:> sudo hostname smithi148 2024-01-11T21:21:20.694 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/smithi148.front.sepia.ceph.com/smithi148/g' /etc/hosts 2024-01-11T21:21:20.722 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/172.21.15.148/172.21.15.148/g' /etc/hosts 2024-01-11T21:21:20.790 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/smithi148.front.sepia.ceph.com/smithi148/g' /etc/hostname 2024-01-11T21:21:20.858 DEBUG:teuthology.orchestra.run.smithi148:> sudo hostname smithi148 2024-01-11T21:21:20.925 DEBUG:teuthology.orchestra.run.smithi148:> cat /etc/os-release 2024-01-11T21:21:20.979 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="CentOS Stream" 2024-01-11T21:21:20.979 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="9" 2024-01-11T21:21:20.979 INFO:teuthology.orchestra.run.smithi148.stdout:ID="centos" 2024-01-11T21:21:20.980 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE="rhel fedora" 2024-01-11T21:21:20.980 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="9" 2024-01-11T21:21:20.980 INFO:teuthology.orchestra.run.smithi148.stdout:PLATFORM_ID="platform:el9" 2024-01-11T21:21:20.980 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-11T21:21:20.980 INFO:teuthology.orchestra.run.smithi148.stdout:ANSI_COLOR="0;31" 2024-01-11T21:21:20.980 INFO:teuthology.orchestra.run.smithi148.stdout:LOGO="fedora-logo-icon" 2024-01-11T21:21:20.980 INFO:teuthology.orchestra.run.smithi148.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-11T21:21:20.980 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://centos.org/" 2024-01-11T21:21:20.980 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-11T21:21:20.980 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-11T21:21:20.980 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-11T21:21:20.981 INFO:teuthology.provision.fog.smithi148:Deploy complete! 2024-01-11T21:21:20.982 DEBUG:teuthology.parallel:result is None 2024-01-11T21:21:25.644 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T21:21:25.966 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-11T21:21:25.967 DEBUG:teuthology.orchestra.run.smithi029:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-11T21:21:31.337 INFO:teuthology.provision.fog.smithi029:Node is ready 2024-01-11T21:21:31.338 DEBUG:teuthology.orchestra.run.smithi029:> hostname 2024-01-11T21:21:31.356 INFO:teuthology.orchestra.run.smithi029.stdout:smithi029.front.sepia.ceph.com 2024-01-11T21:21:31.356 DEBUG:teuthology.orchestra.run.smithi029:> grep smithi029.front.sepia.ceph.com /etc/hosts 2024-01-11T21:21:31.415 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29 smithi029.front.sepia.ceph.com smithi029 2024-01-11T21:21:31.416 DEBUG:teuthology.orchestra.run.smithi029:> sudo hostname smithi029 2024-01-11T21:21:31.575 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i -e 's/smithi029.front.sepia.ceph.com/smithi029/g' /etc/hosts 2024-01-11T21:21:31.610 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i -e 's/172.21.15.29/172.21.15.29/g' /etc/hosts 2024-01-11T21:21:31.684 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i -e 's/smithi029.front.sepia.ceph.com/smithi029/g' /etc/hostname 2024-01-11T21:21:31.756 DEBUG:teuthology.orchestra.run.smithi029:> sudo hostname smithi029 2024-01-11T21:21:31.829 DEBUG:teuthology.orchestra.run.smithi029:> cat /etc/os-release 2024-01-11T21:21:31.884 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="CentOS Stream" 2024-01-11T21:21:31.884 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="9" 2024-01-11T21:21:31.885 INFO:teuthology.orchestra.run.smithi029.stdout:ID="centos" 2024-01-11T21:21:31.885 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE="rhel fedora" 2024-01-11T21:21:31.885 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="9" 2024-01-11T21:21:31.885 INFO:teuthology.orchestra.run.smithi029.stdout:PLATFORM_ID="platform:el9" 2024-01-11T21:21:31.885 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-11T21:21:31.885 INFO:teuthology.orchestra.run.smithi029.stdout:ANSI_COLOR="0;31" 2024-01-11T21:21:31.885 INFO:teuthology.orchestra.run.smithi029.stdout:LOGO="fedora-logo-icon" 2024-01-11T21:21:31.885 INFO:teuthology.orchestra.run.smithi029.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-11T21:21:31.885 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://centos.org/" 2024-01-11T21:21:31.885 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-11T21:21:31.885 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-11T21:21:31.886 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-11T21:21:31.886 INFO:teuthology.provision.fog.smithi029:Deploy complete! 2024-01-11T21:21:31.886 DEBUG:teuthology.parallel:result is None 2024-01-11T21:21:32.059 INFO:teuthology.lock.ops:Checking smithi029.front.sepia.ceph.com 2024-01-11T21:21:32.059 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-11T21:21:32.082 INFO:teuthology.lock.ops:Checking smithi148.front.sepia.ceph.com 2024-01-11T21:21:32.082 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-11T21:21:32.108 INFO:teuthology.lock.ops:Updating [smithi029.front.sepia.ceph.com]: set os type and version on server 2024-01-11T21:21:32.108 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-01-11T21:21:32.109 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T21:21:32.207 DEBUG:teuthology.orchestra.run.smithi029:> true 2024-01-11T21:21:32.274 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-01-11T21:21:32.275 DEBUG:teuthology.orchestra.run.smithi029:> uname -m 2024-01-11T21:21:32.329 INFO:teuthology.orchestra.run.smithi029.stdout:x86_64 2024-01-11T21:21:32.329 DEBUG:teuthology.orchestra.run.smithi029:> cat /etc/os-release 2024-01-11T21:21:32.384 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="CentOS Stream" 2024-01-11T21:21:32.385 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="9" 2024-01-11T21:21:32.385 INFO:teuthology.orchestra.run.smithi029.stdout:ID="centos" 2024-01-11T21:21:32.385 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE="rhel fedora" 2024-01-11T21:21:32.385 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="9" 2024-01-11T21:21:32.385 INFO:teuthology.orchestra.run.smithi029.stdout:PLATFORM_ID="platform:el9" 2024-01-11T21:21:32.385 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-11T21:21:32.385 INFO:teuthology.orchestra.run.smithi029.stdout:ANSI_COLOR="0;31" 2024-01-11T21:21:32.385 INFO:teuthology.orchestra.run.smithi029.stdout:LOGO="fedora-logo-icon" 2024-01-11T21:21:32.385 INFO:teuthology.orchestra.run.smithi029.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-11T21:21:32.385 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://centos.org/" 2024-01-11T21:21:32.385 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-11T21:21:32.385 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-11T21:21:32.385 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-11T21:21:32.386 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server 2024-01-11T21:21:32.407 INFO:teuthology.lock.ops:Updating [smithi148.front.sepia.ceph.com]: set os type and version on server 2024-01-11T21:21:32.407 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-01-11T21:21:32.408 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T21:21:32.496 DEBUG:teuthology.orchestra.run.smithi148:> true 2024-01-11T21:21:32.670 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-01-11T21:21:32.670 DEBUG:teuthology.orchestra.run.smithi148:> uname -m 2024-01-11T21:21:32.724 INFO:teuthology.orchestra.run.smithi148.stdout:x86_64 2024-01-11T21:21:32.725 DEBUG:teuthology.orchestra.run.smithi148:> cat /etc/os-release 2024-01-11T21:21:32.779 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="CentOS Stream" 2024-01-11T21:21:32.779 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="9" 2024-01-11T21:21:32.779 INFO:teuthology.orchestra.run.smithi148.stdout:ID="centos" 2024-01-11T21:21:32.779 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE="rhel fedora" 2024-01-11T21:21:32.780 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="9" 2024-01-11T21:21:32.780 INFO:teuthology.orchestra.run.smithi148.stdout:PLATFORM_ID="platform:el9" 2024-01-11T21:21:32.780 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-11T21:21:32.780 INFO:teuthology.orchestra.run.smithi148.stdout:ANSI_COLOR="0;31" 2024-01-11T21:21:32.780 INFO:teuthology.orchestra.run.smithi148.stdout:LOGO="fedora-logo-icon" 2024-01-11T21:21:32.780 INFO:teuthology.orchestra.run.smithi148.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-11T21:21:32.780 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://centos.org/" 2024-01-11T21:21:32.780 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-11T21:21:32.780 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-11T21:21:32.780 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-11T21:21:32.781 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server 2024-01-11T21:21:32.798 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T21:21:32.887 INFO:teuthology.dispatcher.supervisor:Running job 7511203 2024-01-11T21:21:32.887 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/bin/teuthology -v --owner scheduled_vallariag@teuthology --archive /home/teuthworker/archive/vallariag-2024-01-10_10:23:13-rbd:migration-external-wip-vallariag-rbd-external-migrate-amend-distro-default-smithi/7511203 --name vallariag-2024-01-10_10:23:13-rbd:migration-external-wip-vallariag-rbd-external-migrate-amend-distro-default-smithi --description rbd:migration-external/{1-base/install 2-clusters/{2-node} 3-objectstore/bluestore-comp-lz4 4-supported-random-distro$/{centos_latest} 5-pool/none 6-prepare/native-flatten 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} -- /home/teuthworker/archive/vallariag-2024-01-10_10:23:13-rbd:migration-external-wip-vallariag-rbd-external-migrate-amend-distro-default-smithi/7511203/orig.config.yaml 2024-01-11T21:21:32.890 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vallariag-2024-01-10_10:23:13-rbd:migration-external-wip-vallariag-rbd-external-migrate-amend-distro-default-smithi/7511203 2024-01-11T21:21:32.891 INFO:teuthology.dispatcher.supervisor:Job PID: 4181351 2024-01-11T21:21:32.891 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-01-11T21:23:32.989 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T21:25:33.163 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T21:27:33.336 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T21:29:33.504 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T21:31:33.673 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T21:33:33.833 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T21:35:34.002 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T21:37:34.164 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T21:39:34.327 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T21:41:34.462 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T21:43:34.628 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T21:45:34.791 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T21:47:34.964 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T21:49:35.120 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T21:51:35.271 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T21:53:35.420 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T21:55:35.588 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T21:57:35.749 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T21:59:35.919 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T22:01:36.084 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T22:03:36.294 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T22:05:36.416 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T22:07:36.536 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T22:09:36.694 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T22:11:36.865 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T22:13:37.032 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T22:15:37.200 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T22:17:37.368 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T22:19:37.544 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T22:21:37.699 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T22:23:37.856 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T22:25:38.016 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T22:27:38.175 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T22:29:38.336 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T22:31:38.508 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T22:33:38.672 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T22:33:38.741 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2024-01-11T22:33:38.903 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2024-01-11T22:33:38.903 INFO:teuthology.nuke:Checking targets against current locks 2024-01-11T22:33:38.951 DEBUG:teuthology.nuke:shortname: smithi029 2024-01-11T22:33:38.952 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-11T22:33:38.976 DEBUG:teuthology.nuke:shortname: smithi148 2024-01-11T22:33:38.976 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-11T22:33:38.979 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi029.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vallariag-2024-01-10_10:23:13-rbd:migration-external-wip-vallariag-rbd-external-migrate-amend-distro-default-smithi/7511203', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-11 21:16:14.676027', 'locked_by': 'scheduled_vallariag@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF64W8AXYZ4ypRujU6NnZTn6JK/4yHR5T/tnkLOyumPWVw7BrYfx0Hkrh/9Z+Rl0Duk1Do8ivBIVmVt7GUV0oB8='} 2024-01-11T22:33:39.007 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi148.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vallariag-2024-01-10_10:23:13-rbd:migration-external-wip-vallariag-rbd-external-migrate-amend-distro-default-smithi/7511203', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-11 21:16:14.677458', 'locked_by': 'scheduled_vallariag@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDElQw7V7Ztd1hWAepoPkB2IZI4AYqamfy+GP2O2XCTARck9taYawB3PRA0O35OvNXIjSkRTBGBTtFzYYw/cvyE='} 2024-01-11T22:33:39.031 INFO:teuthology.orchestra.console.smithi029:Power off 2024-01-11T22:33:39.031 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-11T22:33:39.052 DEBUG:teuthology.orchestra.console.smithi029:power off output: Chassis Power Control: Down/Off 2024-01-11T22:33:39.053 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T22:33:39.069 INFO:teuthology.orchestra.console.smithi148:Power off 2024-01-11T22:33:39.070 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-11T22:33:39.078 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is off 2024-01-11T22:33:39.090 DEBUG:teuthology.orchestra.console.smithi148:power off output: Chassis Power Control: Down/Off 2024-01-11T22:33:39.090 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T22:33:39.112 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2024-01-11T22:33:39.178 INFO:teuthology.orchestra.console.smithi029:Power off completed 2024-01-11T22:33:39.213 INFO:teuthology.orchestra.console.smithi148:Power off completed 2024-01-11T22:33:39.331 INFO:teuthology.lock.ops:unlocked: smithi029.front.sepia.ceph.com 2024-01-11T22:33:39.364 INFO:teuthology.lock.ops:unlocked: smithi148.front.sepia.ceph.com