2023-12-12T11:45:37.830 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-12T11:45:37.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T11:45:37.967 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb88b166940>, signals=[15]) 2023-12-12T11:45:37.967 INFO:teuthology.lock.ops:Start node 'smithi113.front.sepia.ceph.com' reimaging 2023-12-12T11:45:37.967 INFO:teuthology.lock.ops:Updating [smithi113.front.sepia.ceph.com]: reset os type and version on server 2023-12-12T11:45:37.968 INFO:teuthology.lock.ops:Updating smithi113.front.sepia.ceph.com on lock server 2023-12-12T11:45:37.996 INFO:teuthology.lock.ops:Start node 'smithi167.front.sepia.ceph.com' reimaging 2023-12-12T11:45:37.996 INFO:teuthology.lock.ops:Updating [smithi167.front.sepia.ceph.com]: reset os type and version on server 2023-12-12T11:45:37.996 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2023-12-12T11:45:38.115 DEBUG:teuthology.provision.fog.smithi113:Requesting image smithi_centos_9.stream (ID 10) 2023-12-12T11:45:38.130 DEBUG:teuthology.provision.fog.smithi167:Requesting image smithi_centos_9.stream (ID 10) 2023-12-12T11:45:38.157 INFO:teuthology.provision.fog.smithi113:Scheduling deploy of centos 9.stream 2023-12-12T11:45:38.180 INFO:teuthology.provision.fog.smithi167:Scheduling deploy of centos 9.stream 2023-12-12T11:45:38.403 INFO:teuthology.orchestra.console.smithi167:Power off 2023-12-12T11:45:38.404 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-12T11:45:38.422 INFO:teuthology.orchestra.console.smithi113:Power off 2023-12-12T11:45:38.422 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-12T11:45:38.431 DEBUG:teuthology.orchestra.console.smithi167:power off output: Chassis Power Control: Down/Off 2023-12-12T11:45:38.432 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T11:45:38.446 DEBUG:teuthology.orchestra.console.smithi113:power off output: Chassis Power Control: Down/Off 2023-12-12T11:45:38.447 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T11:45:38.455 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on 2023-12-12T11:45:38.467 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is on 2023-12-12T11:45:42.461 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T11:45:42.469 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T11:45:42.570 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on 2023-12-12T11:45:42.577 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is on 2023-12-12T11:45:46.574 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T11:45:46.582 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T11:45:46.684 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off 2023-12-12T11:45:46.692 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is off 2023-12-12T11:45:46.786 INFO:teuthology.orchestra.console.smithi167:Power off completed 2023-12-12T11:45:46.794 INFO:teuthology.orchestra.console.smithi113:Power off completed 2023-12-12T11:45:46.887 INFO:teuthology.orchestra.console.smithi167:Power on 2023-12-12T11:45:46.887 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-12T11:45:46.895 INFO:teuthology.orchestra.console.smithi113:Power on 2023-12-12T11:45:46.895 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-12T11:45:46.911 DEBUG:teuthology.orchestra.console.smithi167:power on output: Chassis Power Control: Up/On 2023-12-12T11:45:46.911 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T11:45:46.921 DEBUG:teuthology.orchestra.console.smithi113:power on output: Chassis Power Control: Up/On 2023-12-12T11:45:46.921 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T11:45:46.935 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off 2023-12-12T11:45:46.948 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is off 2023-12-12T11:45:50.938 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T11:45:50.949 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T11:45:51.048 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off 2023-12-12T11:45:51.058 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is off 2023-12-12T11:45:55.052 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T11:45:55.059 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T11:45:55.161 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on 2023-12-12T11:45:55.167 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is on 2023-12-12T11:45:55.263 INFO:teuthology.orchestra.console.smithi167:Power on completed 2023-12-12T11:45:55.268 INFO:teuthology.orchestra.console.smithi113:Power on completed 2023-12-12T11:45:55.364 INFO:teuthology.provision.fog.smithi167:Waiting for deploy to finish 2023-12-12T11:45:55.369 INFO:teuthology.provision.fog.smithi113:Waiting for deploy to finish 2023-12-12T11:48:41.300 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T11:48:41.303 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T11:48:44.358 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2023-12-12T11:48:44.359 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-12-12T11:48:50.362 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T11:48:50.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T11:48:53.442 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2023-12-12T11:48:53.442 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-12-12T11:48:59.447 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T11:48:59.449 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T11:49:02.498 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2023-12-12T11:49:02.530 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-12-12T11:49:08.502 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T11:49:08.531 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T11:49:11.554 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2023-12-12T11:49:11.586 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-12-12T11:49:17.559 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T11:49:17.587 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T11:49:20.610 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2023-12-12T11:49:20.642 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-12-12T11:49:26.614 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T11:49:26.643 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T11:49:29.666 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2023-12-12T11:49:29.702 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-12-12T11:49:35.671 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T11:49:35.703 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T11:49:38.722 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2023-12-12T11:49:38.754 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-12-12T11:49:44.728 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T11:49:44.755 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T11:49:47.810 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2023-12-12T11:49:53.817 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T11:49:56.901 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2023-12-12T11:50:02.906 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T11:50:03.106 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-12-12T11:50:09.111 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T11:50:12.166 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-12-12T11:50:18.170 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T11:50:21.250 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-12-12T11:50:27.255 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T11:50:27.498 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-12T11:50:27.499 DEBUG:teuthology.orchestra.run.smithi167:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-12T11:50:47.855 INFO:teuthology.provision.fog.smithi167:Node is ready 2023-12-12T11:50:47.856 DEBUG:teuthology.orchestra.run.smithi167:> hostname 2023-12-12T11:50:47.875 INFO:teuthology.orchestra.run.smithi167.stdout:smithi167.front.sepia.ceph.com 2023-12-12T11:50:47.875 DEBUG:teuthology.orchestra.run.smithi167:> grep smithi167.front.sepia.ceph.com /etc/hosts 2023-12-12T11:50:47.933 INFO:teuthology.orchestra.run.smithi167.stdout:172.21.15.167 smithi167.front.sepia.ceph.com smithi167 2023-12-12T11:50:47.933 DEBUG:teuthology.orchestra.run.smithi167:> sudo hostname smithi167 2023-12-12T11:50:48.304 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/smithi167.front.sepia.ceph.com/smithi167/g' /etc/hosts 2023-12-12T11:50:48.337 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/172.21.15.167/172.21.15.167/g' /etc/hosts 2023-12-12T11:50:48.406 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/smithi167.front.sepia.ceph.com/smithi167/g' /etc/hostname 2023-12-12T11:50:48.475 DEBUG:teuthology.orchestra.run.smithi167:> sudo hostname smithi167 2023-12-12T11:50:48.544 DEBUG:teuthology.orchestra.run.smithi167:> cat /etc/os-release 2023-12-12T11:50:48.599 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="CentOS Stream" 2023-12-12T11:50:48.599 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="9" 2023-12-12T11:50:48.599 INFO:teuthology.orchestra.run.smithi167.stdout:ID="centos" 2023-12-12T11:50:48.599 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE="rhel fedora" 2023-12-12T11:50:48.599 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="9" 2023-12-12T11:50:48.600 INFO:teuthology.orchestra.run.smithi167.stdout:PLATFORM_ID="platform:el9" 2023-12-12T11:50:48.600 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-12T11:50:48.600 INFO:teuthology.orchestra.run.smithi167.stdout:ANSI_COLOR="0;31" 2023-12-12T11:50:48.600 INFO:teuthology.orchestra.run.smithi167.stdout:LOGO="fedora-logo-icon" 2023-12-12T11:50:48.600 INFO:teuthology.orchestra.run.smithi167.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-12T11:50:48.601 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://centos.org/" 2023-12-12T11:50:48.601 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-12T11:50:48.601 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-12T11:50:48.601 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-12T11:50:48.602 INFO:teuthology.provision.fog.smithi167:Deploy complete! 2023-12-12T11:50:48.604 DEBUG:teuthology.parallel:result is None 2023-12-12T11:51:02.930 WARNING:teuthology.provision.fog.smithi113:timed out 2023-12-12T11:51:08.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T11:51:09.168 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-12T11:51:09.168 DEBUG:teuthology.orchestra.run.smithi113:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-12T11:51:09.474 INFO:teuthology.provision.fog.smithi113:Node is ready 2023-12-12T11:51:09.475 DEBUG:teuthology.orchestra.run.smithi113:> hostname 2023-12-12T11:51:09.490 INFO:teuthology.orchestra.run.smithi113.stdout:smithi113.front.sepia.ceph.com 2023-12-12T11:51:09.490 DEBUG:teuthology.orchestra.run.smithi113:> grep smithi113.front.sepia.ceph.com /etc/hosts 2023-12-12T11:51:09.544 INFO:teuthology.orchestra.run.smithi113.stdout:172.21.15.113 smithi113.front.sepia.ceph.com smithi113 2023-12-12T11:51:09.545 DEBUG:teuthology.orchestra.run.smithi113:> sudo hostname smithi113 2023-12-12T11:51:09.650 DEBUG:teuthology.orchestra.run.smithi113:> sudo sed -i -e 's/smithi113.front.sepia.ceph.com/smithi113/g' /etc/hosts 2023-12-12T11:51:09.678 DEBUG:teuthology.orchestra.run.smithi113:> sudo sed -i -e 's/172.21.15.113/172.21.15.113/g' /etc/hosts 2023-12-12T11:51:09.744 DEBUG:teuthology.orchestra.run.smithi113:> sudo sed -i -e 's/smithi113.front.sepia.ceph.com/smithi113/g' /etc/hostname 2023-12-12T11:51:09.811 DEBUG:teuthology.orchestra.run.smithi113:> sudo hostname smithi113 2023-12-12T11:51:09.878 DEBUG:teuthology.orchestra.run.smithi113:> cat /etc/os-release 2023-12-12T11:51:09.933 INFO:teuthology.orchestra.run.smithi113.stdout:NAME="CentOS Stream" 2023-12-12T11:51:09.933 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION="9" 2023-12-12T11:51:09.933 INFO:teuthology.orchestra.run.smithi113.stdout:ID="centos" 2023-12-12T11:51:09.933 INFO:teuthology.orchestra.run.smithi113.stdout:ID_LIKE="rhel fedora" 2023-12-12T11:51:09.933 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION_ID="9" 2023-12-12T11:51:09.933 INFO:teuthology.orchestra.run.smithi113.stdout:PLATFORM_ID="platform:el9" 2023-12-12T11:51:09.933 INFO:teuthology.orchestra.run.smithi113.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-12T11:51:09.933 INFO:teuthology.orchestra.run.smithi113.stdout:ANSI_COLOR="0;31" 2023-12-12T11:51:09.933 INFO:teuthology.orchestra.run.smithi113.stdout:LOGO="fedora-logo-icon" 2023-12-12T11:51:09.933 INFO:teuthology.orchestra.run.smithi113.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-12T11:51:09.934 INFO:teuthology.orchestra.run.smithi113.stdout:HOME_URL="https://centos.org/" 2023-12-12T11:51:09.934 INFO:teuthology.orchestra.run.smithi113.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-12T11:51:09.934 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-12T11:51:09.934 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-12T11:51:09.934 INFO:teuthology.provision.fog.smithi113:Deploy complete! 2023-12-12T11:51:09.935 DEBUG:teuthology.parallel:result is None 2023-12-12T11:51:10.098 INFO:teuthology.lock.ops:Checking smithi113.front.sepia.ceph.com 2023-12-12T11:51:10.098 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-12T11:51:10.124 INFO:teuthology.lock.ops:Checking smithi167.front.sepia.ceph.com 2023-12-12T11:51:10.124 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-12T11:51:10.149 INFO:teuthology.lock.ops:Updating [smithi113.front.sepia.ceph.com]: set os type and version on server 2023-12-12T11:51:10.150 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi113.front.sepia.ceph.com' 2023-12-12T11:51:10.151 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T11:51:10.232 DEBUG:teuthology.orchestra.run.smithi113:> true 2023-12-12T11:51:10.297 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi113.front.sepia.ceph.com' 2023-12-12T11:51:10.297 DEBUG:teuthology.orchestra.run.smithi113:> uname -m 2023-12-12T11:51:10.351 INFO:teuthology.orchestra.run.smithi113.stdout:x86_64 2023-12-12T11:51:10.351 DEBUG:teuthology.orchestra.run.smithi113:> cat /etc/os-release 2023-12-12T11:51:10.405 INFO:teuthology.orchestra.run.smithi113.stdout:NAME="CentOS Stream" 2023-12-12T11:51:10.405 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION="9" 2023-12-12T11:51:10.406 INFO:teuthology.orchestra.run.smithi113.stdout:ID="centos" 2023-12-12T11:51:10.406 INFO:teuthology.orchestra.run.smithi113.stdout:ID_LIKE="rhel fedora" 2023-12-12T11:51:10.406 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION_ID="9" 2023-12-12T11:51:10.406 INFO:teuthology.orchestra.run.smithi113.stdout:PLATFORM_ID="platform:el9" 2023-12-12T11:51:10.406 INFO:teuthology.orchestra.run.smithi113.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-12T11:51:10.406 INFO:teuthology.orchestra.run.smithi113.stdout:ANSI_COLOR="0;31" 2023-12-12T11:51:10.406 INFO:teuthology.orchestra.run.smithi113.stdout:LOGO="fedora-logo-icon" 2023-12-12T11:51:10.406 INFO:teuthology.orchestra.run.smithi113.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-12T11:51:10.406 INFO:teuthology.orchestra.run.smithi113.stdout:HOME_URL="https://centos.org/" 2023-12-12T11:51:10.406 INFO:teuthology.orchestra.run.smithi113.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-12T11:51:10.406 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-12T11:51:10.406 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-12T11:51:10.407 INFO:teuthology.lock.ops:Updating smithi113.front.sepia.ceph.com on lock server 2023-12-12T11:51:10.432 INFO:teuthology.lock.ops:Updating [smithi167.front.sepia.ceph.com]: set os type and version on server 2023-12-12T11:51:10.432 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-12-12T11:51:10.432 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T11:51:10.516 DEBUG:teuthology.orchestra.run.smithi167:> true 2023-12-12T11:51:10.688 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-12-12T11:51:10.689 DEBUG:teuthology.orchestra.run.smithi167:> uname -m 2023-12-12T11:51:10.743 INFO:teuthology.orchestra.run.smithi167.stdout:x86_64 2023-12-12T11:51:10.744 DEBUG:teuthology.orchestra.run.smithi167:> cat /etc/os-release 2023-12-12T11:51:10.798 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="CentOS Stream" 2023-12-12T11:51:10.798 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="9" 2023-12-12T11:51:10.799 INFO:teuthology.orchestra.run.smithi167.stdout:ID="centos" 2023-12-12T11:51:10.799 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE="rhel fedora" 2023-12-12T11:51:10.799 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="9" 2023-12-12T11:51:10.799 INFO:teuthology.orchestra.run.smithi167.stdout:PLATFORM_ID="platform:el9" 2023-12-12T11:51:10.799 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-12T11:51:10.799 INFO:teuthology.orchestra.run.smithi167.stdout:ANSI_COLOR="0;31" 2023-12-12T11:51:10.799 INFO:teuthology.orchestra.run.smithi167.stdout:LOGO="fedora-logo-icon" 2023-12-12T11:51:10.799 INFO:teuthology.orchestra.run.smithi167.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-12T11:51:10.799 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://centos.org/" 2023-12-12T11:51:10.799 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-12T11:51:10.799 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-12T11:51:10.799 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-12T11:51:10.800 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2023-12-12T11:51:10.823 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T11:51:10.916 INFO:teuthology.dispatcher.supervisor:Running job 7488444 2023-12-12T11:51:10.916 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_yuvalif@teuthology --archive /home/teuthworker/archive/yuvalif-2023-12-12_11:37:16-rgw-wip-yuval-test-gsoc-distro-default-smithi/7488444 --name yuvalif-2023-12-12_11:37:16-rgw-wip-yuval-test-gsoc-distro-default-smithi --description rgw/notifications/{beast bluestore-bitmap centos_latest fixed-2 ignore-pg-availability overrides tasks/{0-install test_amqp test_kafka test_others}} -- /home/teuthworker/archive/yuvalif-2023-12-12_11:37:16-rgw-wip-yuval-test-gsoc-distro-default-smithi/7488444/orig.config.yaml 2023-12-12T11:51:10.919 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuvalif-2023-12-12_11:37:16-rgw-wip-yuval-test-gsoc-distro-default-smithi/7488444 2023-12-12T11:51:10.919 INFO:teuthology.dispatcher.supervisor:Job PID: 498362 2023-12-12T11:51:10.919 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-12T11:53:11.019 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T11:55:11.182 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T11:57:11.351 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T11:59:11.516 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T12:01:11.682 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T12:03:11.860 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T12:05:12.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T12:05:12.112 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-12T12:05:12.217 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-12T12:05:12.218 INFO:teuthology.nuke:Checking targets against current locks 2023-12-12T12:05:12.265 DEBUG:teuthology.nuke:shortname: smithi113 2023-12-12T12:05:12.265 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-12T12:05:12.289 DEBUG:teuthology.nuke:shortname: smithi167 2023-12-12T12:05:12.289 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-12T12:05:12.294 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi113.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuvalif-2023-12-12_11:37:16-rgw-wip-yuval-test-gsoc-distro-default-smithi/7488444', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-12 11:45:36.994036', 'locked_by': 'scheduled_yuvalif@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE64FH7O10Jf6rY79SHEkCQJ40miqZnZD9oyhrTQUhPmyZOYSnr5XYYNLxHJ4o4DTyOlxH7uorld8U5KcCS0KW0='} 2023-12-12T12:05:12.310 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi167.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuvalif-2023-12-12_11:37:16-rgw-wip-yuval-test-gsoc-distro-default-smithi/7488444', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-12 11:45:36.992620', 'locked_by': 'scheduled_yuvalif@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNSFp+ZgldQ9qOETdjGyb6JnS8UiB1j3GUmSPNQo3bj5k4Zw/JekgOxHzWqIxiidScmwOReN+EP1pBQrkAv+QwI='} 2023-12-12T12:05:12.338 INFO:teuthology.orchestra.console.smithi113:Power off 2023-12-12T12:05:12.339 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-12T12:05:12.360 DEBUG:teuthology.orchestra.console.smithi113:power off output: Chassis Power Control: Down/Off 2023-12-12T12:05:12.361 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T12:05:12.379 INFO:teuthology.orchestra.console.smithi167:Power off 2023-12-12T12:05:12.380 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-12T12:05:12.390 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is off 2023-12-12T12:05:12.404 DEBUG:teuthology.orchestra.console.smithi167:power off output: Chassis Power Control: Down/Off 2023-12-12T12:05:12.404 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T12:05:12.426 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off 2023-12-12T12:05:12.491 INFO:teuthology.orchestra.console.smithi113:Power off completed 2023-12-12T12:05:12.528 INFO:teuthology.orchestra.console.smithi167:Power off completed 2023-12-12T12:05:12.641 INFO:teuthology.lock.ops:unlocked: smithi113.front.sepia.ceph.com 2023-12-12T12:05:12.675 INFO:teuthology.lock.ops:unlocked: smithi167.front.sepia.ceph.com