2023-12-15T22:33:15.054 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-15T22:33:15.054 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:33:15.187 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd92dca1940>, signals=[15]) 2023-12-15T22:33:15.187 INFO:teuthology.lock.ops:Start node 'smithi002.front.sepia.ceph.com' reimaging 2023-12-15T22:33:15.187 INFO:teuthology.lock.ops:Updating [smithi002.front.sepia.ceph.com]: reset os type and version on server 2023-12-15T22:33:15.187 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server 2023-12-15T22:33:15.206 INFO:teuthology.lock.ops:Start node 'smithi176.front.sepia.ceph.com' reimaging 2023-12-15T22:33:15.206 INFO:teuthology.lock.ops:Updating [smithi176.front.sepia.ceph.com]: reset os type and version on server 2023-12-15T22:33:15.206 INFO:teuthology.lock.ops:Updating smithi176.front.sepia.ceph.com on lock server 2023-12-15T22:33:15.319 DEBUG:teuthology.provision.fog.smithi002:Requesting image smithi_centos_9.stream (ID 10) 2023-12-15T22:33:15.350 DEBUG:teuthology.provision.fog.smithi176:Requesting image smithi_centos_9.stream (ID 10) 2023-12-15T22:33:15.369 INFO:teuthology.provision.fog.smithi002:Scheduling deploy of centos 9.stream 2023-12-15T22:33:15.394 INFO:teuthology.provision.fog.smithi176:Scheduling deploy of centos 9.stream 2023-12-15T22:33:15.564 INFO:teuthology.orchestra.console.smithi002:Power off 2023-12-15T22:33:15.564 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-15T22:33:15.581 INFO:teuthology.orchestra.console.smithi176:Power off 2023-12-15T22:33:15.582 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-15T22:33:15.589 DEBUG:teuthology.orchestra.console.smithi002:power off output: Chassis Power Control: Down/Off 2023-12-15T22:33:15.589 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-15T22:33:15.601 DEBUG:teuthology.orchestra.console.smithi176:power off output: Chassis Power Control: Down/Off 2023-12-15T22:33:15.602 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-15T22:33:15.612 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is on 2023-12-15T22:33:15.622 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is on 2023-12-15T22:33:19.618 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-15T22:33:19.624 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-15T22:33:19.727 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is on 2023-12-15T22:33:19.733 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is on 2023-12-15T22:33:23.733 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-15T22:33:23.739 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-15T22:33:23.841 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is on 2023-12-15T22:33:23.846 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is off 2023-12-15T22:33:23.946 INFO:teuthology.orchestra.console.smithi176:Power off completed 2023-12-15T22:33:24.047 INFO:teuthology.orchestra.console.smithi176:Power on 2023-12-15T22:33:24.047 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-15T22:33:24.067 DEBUG:teuthology.orchestra.console.smithi176:power on output: Chassis Power Control: Up/On 2023-12-15T22:33:24.067 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-15T22:33:24.087 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is off 2023-12-15T22:33:27.846 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-15T22:33:27.954 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is off 2023-12-15T22:33:28.055 INFO:teuthology.orchestra.console.smithi002:Power off completed 2023-12-15T22:33:28.089 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-15T22:33:28.157 INFO:teuthology.orchestra.console.smithi002:Power on 2023-12-15T22:33:28.157 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-15T22:33:28.178 DEBUG:teuthology.orchestra.console.smithi002:power on output: Chassis Power Control: Up/On 2023-12-15T22:33:28.178 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-15T22:33:28.196 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is off 2023-12-15T22:33:28.197 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is off 2023-12-15T22:33:32.201 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-15T22:33:32.208 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-15T22:33:32.310 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is on 2023-12-15T22:33:32.316 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is on 2023-12-15T22:33:32.412 INFO:teuthology.orchestra.console.smithi176:Power on completed 2023-12-15T22:33:32.417 INFO:teuthology.orchestra.console.smithi002:Power on completed 2023-12-15T22:33:32.512 INFO:teuthology.provision.fog.smithi176:Waiting for deploy to finish 2023-12-15T22:33:32.518 INFO:teuthology.provision.fog.smithi002:Waiting for deploy to finish 2023-12-15T22:36:03.863 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-15T22:36:03.884 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-15T22:36:22.418 WARNING:teuthology.provision.fog.smithi176:[Errno None] Unable to connect to port 22 on 172.21.15.176 2023-12-15T22:36:22.418 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2 2023-12-15T22:36:28.425 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-15T22:36:28.427 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-15T22:36:31.506 WARNING:teuthology.provision.fog.smithi176:[Errno None] Unable to connect to port 22 on 172.21.15.176 2023-12-15T22:36:31.506 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2 2023-12-15T22:36:37.509 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-15T22:36:37.512 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-15T22:36:40.562 WARNING:teuthology.provision.fog.smithi176:[Errno None] Unable to connect to port 22 on 172.21.15.176 2023-12-15T22:36:40.562 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2 2023-12-15T22:36:46.569 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-15T22:36:46.572 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-15T22:36:49.649 WARNING:teuthology.provision.fog.smithi176:[Errno None] Unable to connect to port 22 on 172.21.15.176 2023-12-15T22:36:49.650 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2 2023-12-15T22:36:55.656 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-15T22:36:55.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-15T22:36:58.737 WARNING:teuthology.provision.fog.smithi176:[Errno None] Unable to connect to port 22 on 172.21.15.176 2023-12-15T22:37:04.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-15T22:37:55.694 WARNING:teuthology.provision.fog.smithi002:timed out 2023-12-15T22:38:01.699 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-15T22:38:01.966 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-15T22:38:01.966 DEBUG:teuthology.orchestra.run.smithi002:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-15T22:38:02.303 INFO:teuthology.provision.fog.smithi002:Node is ready 2023-12-15T22:38:02.303 DEBUG:teuthology.orchestra.run.smithi002:> hostname 2023-12-15T22:38:02.318 INFO:teuthology.orchestra.run.smithi002.stdout:smithi002.front.sepia.ceph.com 2023-12-15T22:38:02.319 DEBUG:teuthology.orchestra.run.smithi002:> grep smithi002.front.sepia.ceph.com /etc/hosts 2023-12-15T22:38:02.374 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2 smithi002.front.sepia.ceph.com smithi002 2023-12-15T22:38:02.375 DEBUG:teuthology.orchestra.run.smithi002:> sudo hostname smithi002 2023-12-15T22:38:02.504 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i -e 's/smithi002.front.sepia.ceph.com/smithi002/g' /etc/hosts 2023-12-15T22:38:02.536 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i -e 's/172.21.15.2/172.21.15.2/g' /etc/hosts 2023-12-15T22:38:02.608 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i -e 's/smithi002.front.sepia.ceph.com/smithi002/g' /etc/hostname 2023-12-15T22:38:02.680 DEBUG:teuthology.orchestra.run.smithi002:> sudo hostname smithi002 2023-12-15T22:38:02.751 DEBUG:teuthology.orchestra.run.smithi002:> cat /etc/os-release 2023-12-15T22:38:02.807 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="CentOS Stream" 2023-12-15T22:38:02.807 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="9" 2023-12-15T22:38:02.807 INFO:teuthology.orchestra.run.smithi002.stdout:ID="centos" 2023-12-15T22:38:02.807 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE="rhel fedora" 2023-12-15T22:38:02.807 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="9" 2023-12-15T22:38:02.807 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM_ID="platform:el9" 2023-12-15T22:38:02.807 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-15T22:38:02.807 INFO:teuthology.orchestra.run.smithi002.stdout:ANSI_COLOR="0;31" 2023-12-15T22:38:02.807 INFO:teuthology.orchestra.run.smithi002.stdout:LOGO="fedora-logo-icon" 2023-12-15T22:38:02.807 INFO:teuthology.orchestra.run.smithi002.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-15T22:38:02.807 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://centos.org/" 2023-12-15T22:38:02.807 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-15T22:38:02.808 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-15T22:38:02.808 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-15T22:38:02.808 INFO:teuthology.provision.fog.smithi002:Deploy complete! 2023-12-15T22:38:02.810 DEBUG:teuthology.parallel:result is None 2023-12-15T22:38:04.748 WARNING:teuthology.provision.fog.smithi176:timed out 2023-12-15T22:38:10.756 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-15T22:38:11.052 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-15T22:38:11.052 DEBUG:teuthology.orchestra.run.smithi176:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-15T22:38:11.411 INFO:teuthology.provision.fog.smithi176:Node is ready 2023-12-15T22:38:11.411 DEBUG:teuthology.orchestra.run.smithi176:> hostname 2023-12-15T22:38:11.426 INFO:teuthology.orchestra.run.smithi176.stdout:smithi176.front.sepia.ceph.com 2023-12-15T22:38:11.426 DEBUG:teuthology.orchestra.run.smithi176:> grep smithi176.front.sepia.ceph.com /etc/hosts 2023-12-15T22:38:11.483 INFO:teuthology.orchestra.run.smithi176.stdout:172.21.15.176 smithi176.front.sepia.ceph.com smithi176 2023-12-15T22:38:11.483 DEBUG:teuthology.orchestra.run.smithi176:> sudo hostname smithi176 2023-12-15T22:38:11.599 DEBUG:teuthology.orchestra.run.smithi176:> sudo sed -i -e 's/smithi176.front.sepia.ceph.com/smithi176/g' /etc/hosts 2023-12-15T22:38:11.628 DEBUG:teuthology.orchestra.run.smithi176:> sudo sed -i -e 's/172.21.15.176/172.21.15.176/g' /etc/hosts 2023-12-15T22:38:11.697 DEBUG:teuthology.orchestra.run.smithi176:> sudo sed -i -e 's/smithi176.front.sepia.ceph.com/smithi176/g' /etc/hostname 2023-12-15T22:38:11.765 DEBUG:teuthology.orchestra.run.smithi176:> sudo hostname smithi176 2023-12-15T22:38:11.832 DEBUG:teuthology.orchestra.run.smithi176:> cat /etc/os-release 2023-12-15T22:38:11.888 INFO:teuthology.orchestra.run.smithi176.stdout:NAME="CentOS Stream" 2023-12-15T22:38:11.888 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION="9" 2023-12-15T22:38:11.888 INFO:teuthology.orchestra.run.smithi176.stdout:ID="centos" 2023-12-15T22:38:11.888 INFO:teuthology.orchestra.run.smithi176.stdout:ID_LIKE="rhel fedora" 2023-12-15T22:38:11.888 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION_ID="9" 2023-12-15T22:38:11.888 INFO:teuthology.orchestra.run.smithi176.stdout:PLATFORM_ID="platform:el9" 2023-12-15T22:38:11.888 INFO:teuthology.orchestra.run.smithi176.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-15T22:38:11.888 INFO:teuthology.orchestra.run.smithi176.stdout:ANSI_COLOR="0;31" 2023-12-15T22:38:11.888 INFO:teuthology.orchestra.run.smithi176.stdout:LOGO="fedora-logo-icon" 2023-12-15T22:38:11.888 INFO:teuthology.orchestra.run.smithi176.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-15T22:38:11.889 INFO:teuthology.orchestra.run.smithi176.stdout:HOME_URL="https://centos.org/" 2023-12-15T22:38:11.889 INFO:teuthology.orchestra.run.smithi176.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-15T22:38:11.889 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-15T22:38:11.889 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-15T22:38:11.889 INFO:teuthology.provision.fog.smithi176:Deploy complete! 2023-12-15T22:38:11.890 DEBUG:teuthology.parallel:result is None 2023-12-15T22:38:12.093 INFO:teuthology.lock.ops:Checking smithi002.front.sepia.ceph.com 2023-12-15T22:38:12.093 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-15T22:38:12.115 INFO:teuthology.lock.ops:Checking smithi176.front.sepia.ceph.com 2023-12-15T22:38:12.115 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-15T22:38:12.132 INFO:teuthology.lock.ops:Updating [smithi002.front.sepia.ceph.com]: set os type and version on server 2023-12-15T22:38:12.132 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2023-12-15T22:38:12.133 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-15T22:38:12.231 DEBUG:teuthology.orchestra.run.smithi002:> true 2023-12-15T22:38:12.302 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi002.front.sepia.ceph.com' 2023-12-15T22:38:12.302 DEBUG:teuthology.orchestra.run.smithi002:> uname -m 2023-12-15T22:38:12.359 INFO:teuthology.orchestra.run.smithi002.stdout:x86_64 2023-12-15T22:38:12.359 DEBUG:teuthology.orchestra.run.smithi002:> cat /etc/os-release 2023-12-15T22:38:12.416 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="CentOS Stream" 2023-12-15T22:38:12.416 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="9" 2023-12-15T22:38:12.416 INFO:teuthology.orchestra.run.smithi002.stdout:ID="centos" 2023-12-15T22:38:12.416 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE="rhel fedora" 2023-12-15T22:38:12.416 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="9" 2023-12-15T22:38:12.416 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM_ID="platform:el9" 2023-12-15T22:38:12.417 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-15T22:38:12.417 INFO:teuthology.orchestra.run.smithi002.stdout:ANSI_COLOR="0;31" 2023-12-15T22:38:12.417 INFO:teuthology.orchestra.run.smithi002.stdout:LOGO="fedora-logo-icon" 2023-12-15T22:38:12.417 INFO:teuthology.orchestra.run.smithi002.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-15T22:38:12.417 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://centos.org/" 2023-12-15T22:38:12.417 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-15T22:38:12.417 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-15T22:38:12.417 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-15T22:38:12.417 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server 2023-12-15T22:38:12.440 INFO:teuthology.lock.ops:Updating [smithi176.front.sepia.ceph.com]: set os type and version on server 2023-12-15T22:38:12.440 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2023-12-15T22:38:12.441 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-15T22:38:12.521 DEBUG:teuthology.orchestra.run.smithi176:> true 2023-12-15T22:38:12.588 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi176.front.sepia.ceph.com' 2023-12-15T22:38:12.588 DEBUG:teuthology.orchestra.run.smithi176:> uname -m 2023-12-15T22:38:12.646 INFO:teuthology.orchestra.run.smithi176.stdout:x86_64 2023-12-15T22:38:12.647 DEBUG:teuthology.orchestra.run.smithi176:> cat /etc/os-release 2023-12-15T22:38:12.704 INFO:teuthology.orchestra.run.smithi176.stdout:NAME="CentOS Stream" 2023-12-15T22:38:12.704 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION="9" 2023-12-15T22:38:12.705 INFO:teuthology.orchestra.run.smithi176.stdout:ID="centos" 2023-12-15T22:38:12.705 INFO:teuthology.orchestra.run.smithi176.stdout:ID_LIKE="rhel fedora" 2023-12-15T22:38:12.705 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION_ID="9" 2023-12-15T22:38:12.705 INFO:teuthology.orchestra.run.smithi176.stdout:PLATFORM_ID="platform:el9" 2023-12-15T22:38:12.705 INFO:teuthology.orchestra.run.smithi176.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-15T22:38:12.705 INFO:teuthology.orchestra.run.smithi176.stdout:ANSI_COLOR="0;31" 2023-12-15T22:38:12.705 INFO:teuthology.orchestra.run.smithi176.stdout:LOGO="fedora-logo-icon" 2023-12-15T22:38:12.705 INFO:teuthology.orchestra.run.smithi176.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-15T22:38:12.705 INFO:teuthology.orchestra.run.smithi176.stdout:HOME_URL="https://centos.org/" 2023-12-15T22:38:12.705 INFO:teuthology.orchestra.run.smithi176.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-15T22:38:12.705 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-15T22:38:12.705 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-15T22:38:12.706 INFO:teuthology.lock.ops:Updating smithi176.front.sepia.ceph.com on lock server 2023-12-15T22:38:12.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:38:12.806 INFO:teuthology.dispatcher.supervisor:Running job 7493332 2023-12-15T22:38:12.806 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_sjust@teuthology --archive /home/teuthworker/archive/sjust-2023-12-15_22:32:12-crimson-rados-wip-sjust-crimson-testing-2023-12-15-distro-default-smithi/7493332 --name sjust-2023-12-15_22:32:12-crimson-rados-wip-sjust-crimson-testing-2023-12-15-distro-default-smithi --description crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rados_api_tests} -- /home/teuthworker/archive/sjust-2023-12-15_22:32:12-crimson-rados-wip-sjust-crimson-testing-2023-12-15-distro-default-smithi/7493332/orig.config.yaml 2023-12-15T22:38:12.809 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/sjust-2023-12-15_22:32:12-crimson-rados-wip-sjust-crimson-testing-2023-12-15-distro-default-smithi/7493332 2023-12-15T22:38:12.810 INFO:teuthology.dispatcher.supervisor:Job PID: 1690047 2023-12-15T22:38:12.810 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-15T22:40:12.909 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:42:13.078 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:44:13.242 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:46:13.690 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:48:13.854 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:50:14.094 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:52:14.261 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:54:14.424 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:56:14.593 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:58:14.764 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:00:15.092 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:02:15.322 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:04:15.500 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:06:15.637 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:08:15.806 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:10:15.965 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:12:16.197 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:14:16.366 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:16:16.523 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:18:16.618 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:20:16.790 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:22:17.030 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:24:17.175 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:26:17.342 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:28:17.459 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:30:17.620 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:32:17.844 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:34:18.047 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:36:18.203 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:38:18.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:40:18.442 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:42:18.555 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:44:18.706 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:46:18.898 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:48:19.055 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:50:19.205 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:52:19.368 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:54:19.512 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:56:19.575 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:58:19.793 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:00:19.962 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:02:20.207 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:04:20.326 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:06:20.499 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:08:20.642 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:10:20.862 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:12:21.034 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:14:21.142 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:16:21.286 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:18:21.451 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:20:21.622 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:22:21.793 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:24:21.962 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:26:22.138 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:28:22.358 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:30:22.534 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:32:22.730 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:34:22.906 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:36:23.045 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:38:23.218 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:40:23.349 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:42:23.526 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:44:23.707 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:46:23.886 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:48:24.032 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:50:24.195 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:52:24.373 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:54:24.546 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:56:24.722 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:58:24.886 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:00:25.062 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:02:25.223 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:04:25.394 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:06:25.570 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:08:25.742 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:10:25.906 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:12:26.098 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:14:26.278 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:16:26.450 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:18:26.633 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:20:26.798 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:22:26.966 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:24:27.131 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:26:27.301 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:28:27.466 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:30:27.642 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:32:27.806 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:34:27.978 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:36:28.154 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:38:28.316 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:40:28.495 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:42:28.663 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:44:28.834 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:46:29.002 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:48:29.174 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:50:29.354 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:52:29.516 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:54:29.686 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:54:29.753 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-16T01:54:29.896 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-16T01:54:29.896 INFO:teuthology.nuke:Checking targets against current locks 2023-12-16T01:54:29.943 DEBUG:teuthology.nuke:shortname: smithi002 2023-12-16T01:54:29.943 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-16T01:54:29.961 DEBUG:teuthology.nuke:shortname: smithi176 2023-12-16T01:54:29.962 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-16T01:54:29.965 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi002.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/sjust-2023-12-15_22:32:12-crimson-rados-wip-sjust-crimson-testing-2023-12-15-distro-default-smithi/7493332', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-15 22:33:14.307651', 'locked_by': 'scheduled_sjust@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP3VcGnv0OxVeE+h8PMe2U1950roNDAIkBii4+I5fc34H1msAhUEhRNxQFri3aVTGCYlqfRdoJbHhCS/gs2QTQc='} 2023-12-16T01:54:29.987 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi176.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/sjust-2023-12-15_22:32:12-crimson-rados-wip-sjust-crimson-testing-2023-12-15-distro-default-smithi/7493332', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-15 22:33:14.306072', 'locked_by': 'scheduled_sjust@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKLWulOWYK5AU+ufRqrNhCmKjQJCVxMReEwbOHJTr4sYJi5mBEU7itSZEgzDkasIMc5OAfdY7kaRMMvx2utDNRQ='} 2023-12-16T01:54:30.019 INFO:teuthology.orchestra.console.smithi002:Power off 2023-12-16T01:54:30.019 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-16T01:54:30.040 DEBUG:teuthology.orchestra.console.smithi002:power off output: Chassis Power Control: Down/Off 2023-12-16T01:54:30.040 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T01:54:30.056 INFO:teuthology.orchestra.console.smithi176:Power off 2023-12-16T01:54:30.056 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-16T01:54:30.078 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is off 2023-12-16T01:54:30.104 DEBUG:teuthology.orchestra.console.smithi176:power off output: Chassis Power Control: Down/Off 2023-12-16T01:54:30.104 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T01:54:30.127 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is off 2023-12-16T01:54:30.179 INFO:teuthology.orchestra.console.smithi002:Power off completed 2023-12-16T01:54:30.228 INFO:teuthology.orchestra.console.smithi176:Power off completed 2023-12-16T01:54:30.326 INFO:teuthology.lock.ops:unlocked: smithi002.front.sepia.ceph.com 2023-12-16T01:54:30.376 INFO:teuthology.lock.ops:unlocked: smithi176.front.sepia.ceph.com