2023-11-25T16:55:30.491 INFO:root:teuthology version: 0.0.1.dev205+g2442239 2023-11-25T16:55:30.492 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-25T16:55:30.643 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8f7a662670>, signals=[15]) 2023-11-25T16:55:30.644 INFO:teuthology.lock.ops:Start node 'smithi156.front.sepia.ceph.com' reimaging 2023-11-25T16:55:30.644 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: reset os type and version on server 2023-11-25T16:55:30.645 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2023-11-25T16:55:30.669 INFO:teuthology.lock.ops:Start node 'smithi186.front.sepia.ceph.com' reimaging 2023-11-25T16:55:30.670 INFO:teuthology.lock.ops:Updating [smithi186.front.sepia.ceph.com]: reset os type and version on server 2023-11-25T16:55:30.671 INFO:teuthology.lock.ops:Updating smithi186.front.sepia.ceph.com on lock server 2023-11-25T16:55:30.789 DEBUG:teuthology.provision.fog.smithi156:Requesting image smithi_centos_9.stream (ID 10) 2023-11-25T16:55:30.809 DEBUG:teuthology.provision.fog.smithi186:Requesting image smithi_centos_9.stream (ID 10) 2023-11-25T16:55:30.841 INFO:teuthology.provision.fog.smithi156:Scheduling deploy of centos 9.stream 2023-11-25T16:55:30.859 INFO:teuthology.provision.fog.smithi186:Scheduling deploy of centos 9.stream 2023-11-25T16:55:31.094 INFO:teuthology.orchestra.console.smithi156:Power off 2023-11-25T16:55:31.095 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-25T16:55:31.195 INFO:teuthology.orchestra.console.smithi186:Power off 2023-11-25T16:55:31.195 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-25T16:55:31.260 DEBUG:teuthology.orchestra.console.smithi186:power off output: Chassis Power Control: Down/Off 2023-11-25T16:55:31.261 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-25T16:55:31.268 DEBUG:teuthology.orchestra.console.smithi156:power off output: Chassis Power Control: Down/Off 2023-11-25T16:55:31.269 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-25T16:55:31.305 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2023-11-25T16:55:31.325 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on 2023-11-25T16:55:35.310 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-25T16:55:35.326 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-25T16:55:35.419 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2023-11-25T16:55:35.436 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on 2023-11-25T16:55:39.422 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-25T16:55:39.437 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-25T16:55:39.532 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2023-11-25T16:55:39.546 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on 2023-11-25T16:55:39.634 INFO:teuthology.orchestra.console.smithi156:Power off completed 2023-11-25T16:55:39.734 INFO:teuthology.orchestra.console.smithi156:Power on 2023-11-25T16:55:39.735 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-25T16:55:39.756 DEBUG:teuthology.orchestra.console.smithi156:power on output: Chassis Power Control: Up/On 2023-11-25T16:55:39.757 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-25T16:55:39.781 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2023-11-25T16:55:43.553 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-25T16:55:43.663 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off 2023-11-25T16:55:43.764 INFO:teuthology.orchestra.console.smithi186:Power off completed 2023-11-25T16:55:43.782 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-25T16:55:43.866 INFO:teuthology.orchestra.console.smithi186:Power on 2023-11-25T16:55:43.866 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-25T16:55:43.891 DEBUG:teuthology.orchestra.console.smithi186:power on output: Chassis Power Control: Up/On 2023-11-25T16:55:43.891 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-25T16:55:43.901 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2023-11-25T16:55:43.915 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off 2023-11-25T16:55:47.902 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-25T16:55:47.916 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-25T16:55:48.016 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2023-11-25T16:55:48.027 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on 2023-11-25T16:55:48.117 INFO:teuthology.orchestra.console.smithi156:Power on completed 2023-11-25T16:55:48.128 INFO:teuthology.orchestra.console.smithi186:Power on completed 2023-11-25T16:55:48.218 INFO:teuthology.provision.fog.smithi156:Waiting for deploy to finish 2023-11-25T16:55:48.229 INFO:teuthology.provision.fog.smithi186:Waiting for deploy to finish 2023-11-25T16:58:34.186 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-25T16:58:34.209 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-25T16:58:37.282 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-11-25T16:58:37.283 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-11-25T16:58:43.287 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-25T16:58:43.289 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-25T16:58:46.338 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-11-25T16:58:46.370 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-11-25T16:58:52.345 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-25T16:58:52.374 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-25T16:58:55.426 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-11-25T16:58:55.426 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-11-25T16:59:01.432 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-25T16:59:01.434 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-25T16:59:04.514 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-11-25T16:59:04.518 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-11-25T16:59:10.522 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-25T16:59:10.523 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-25T16:59:13.602 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-11-25T16:59:13.606 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-11-25T16:59:19.607 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-25T16:59:19.609 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-25T16:59:22.658 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-11-25T16:59:23.406 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-11-25T16:59:29.408 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-25T16:59:29.410 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-25T16:59:32.482 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-11-25T16:59:32.483 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-11-25T16:59:38.489 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-25T16:59:38.491 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-25T16:59:56.902 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-11-25T17:00:02.906 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-25T17:00:06.018 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-11-25T17:00:12.022 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-25T17:00:15.074 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-11-25T17:00:21.081 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-25T17:00:21.375 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-25T17:00:21.376 DEBUG:teuthology.orchestra.run.smithi186:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-25T17:00:38.493 WARNING:teuthology.provision.fog.smithi156:timed out 2023-11-25T17:00:41.725 INFO:teuthology.provision.fog.smithi186:Node is ready 2023-11-25T17:00:41.726 DEBUG:teuthology.orchestra.run.smithi186:> hostname 2023-11-25T17:00:41.786 INFO:teuthology.orchestra.run.smithi186.stdout:smithi186.front.sepia.ceph.com 2023-11-25T17:00:41.787 DEBUG:teuthology.orchestra.run.smithi186:> grep smithi186.front.sepia.ceph.com /etc/hosts 2023-11-25T17:00:41.844 INFO:teuthology.orchestra.run.smithi186.stdout:172.21.15.186 smithi186.front.sepia.ceph.com smithi186 2023-11-25T17:00:41.844 DEBUG:teuthology.orchestra.run.smithi186:> sudo hostname smithi186 2023-11-25T17:00:41.984 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/smithi186.front.sepia.ceph.com/smithi186/g' /etc/hosts 2023-11-25T17:00:42.016 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/172.21.15.186/172.21.15.186/g' /etc/hosts 2023-11-25T17:00:42.087 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/smithi186.front.sepia.ceph.com/smithi186/g' /etc/hostname 2023-11-25T17:00:42.158 DEBUG:teuthology.orchestra.run.smithi186:> sudo hostname smithi186 2023-11-25T17:00:42.227 DEBUG:teuthology.orchestra.run.smithi186:> cat /etc/os-release 2023-11-25T17:00:42.284 INFO:teuthology.orchestra.run.smithi186.stdout:NAME="CentOS Stream" 2023-11-25T17:00:42.284 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION="9" 2023-11-25T17:00:42.284 INFO:teuthology.orchestra.run.smithi186.stdout:ID="centos" 2023-11-25T17:00:42.284 INFO:teuthology.orchestra.run.smithi186.stdout:ID_LIKE="rhel fedora" 2023-11-25T17:00:42.285 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_ID="9" 2023-11-25T17:00:42.285 INFO:teuthology.orchestra.run.smithi186.stdout:PLATFORM_ID="platform:el9" 2023-11-25T17:00:42.285 INFO:teuthology.orchestra.run.smithi186.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-25T17:00:42.285 INFO:teuthology.orchestra.run.smithi186.stdout:ANSI_COLOR="0;31" 2023-11-25T17:00:42.285 INFO:teuthology.orchestra.run.smithi186.stdout:LOGO="fedora-logo-icon" 2023-11-25T17:00:42.285 INFO:teuthology.orchestra.run.smithi186.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-25T17:00:42.285 INFO:teuthology.orchestra.run.smithi186.stdout:HOME_URL="https://centos.org/" 2023-11-25T17:00:42.285 INFO:teuthology.orchestra.run.smithi186.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-25T17:00:42.285 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-25T17:00:42.285 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-25T17:00:42.286 INFO:teuthology.provision.fog.smithi186:Deploy complete! 2023-11-25T17:00:42.287 DEBUG:teuthology.parallel:result is None 2023-11-25T17:00:44.495 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-25T17:00:44.740 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-25T17:00:44.740 DEBUG:teuthology.orchestra.run.smithi156:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-25T17:00:45.070 INFO:teuthology.provision.fog.smithi156:Node is ready 2023-11-25T17:00:45.070 DEBUG:teuthology.orchestra.run.smithi156:> hostname 2023-11-25T17:00:45.084 INFO:teuthology.orchestra.run.smithi156.stdout:smithi156.front.sepia.ceph.com 2023-11-25T17:00:45.085 DEBUG:teuthology.orchestra.run.smithi156:> grep smithi156.front.sepia.ceph.com /etc/hosts 2023-11-25T17:00:45.140 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.15.156 smithi156.front.sepia.ceph.com smithi156 2023-11-25T17:00:45.140 DEBUG:teuthology.orchestra.run.smithi156:> sudo hostname smithi156 2023-11-25T17:00:45.258 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/smithi156.front.sepia.ceph.com/smithi156/g' /etc/hosts 2023-11-25T17:00:45.286 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/172.21.15.156/172.21.15.156/g' /etc/hosts 2023-11-25T17:00:45.354 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/smithi156.front.sepia.ceph.com/smithi156/g' /etc/hostname 2023-11-25T17:00:45.421 DEBUG:teuthology.orchestra.run.smithi156:> sudo hostname smithi156 2023-11-25T17:00:45.487 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release 2023-11-25T17:00:45.542 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="CentOS Stream" 2023-11-25T17:00:45.542 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="9" 2023-11-25T17:00:45.542 INFO:teuthology.orchestra.run.smithi156.stdout:ID="centos" 2023-11-25T17:00:45.542 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="rhel fedora" 2023-11-25T17:00:45.542 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="9" 2023-11-25T17:00:45.542 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el9" 2023-11-25T17:00:45.542 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-25T17:00:45.542 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31" 2023-11-25T17:00:45.542 INFO:teuthology.orchestra.run.smithi156.stdout:LOGO="fedora-logo-icon" 2023-11-25T17:00:45.543 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-25T17:00:45.543 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://centos.org/" 2023-11-25T17:00:45.543 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-25T17:00:45.543 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-25T17:00:45.543 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-25T17:00:45.543 INFO:teuthology.provision.fog.smithi156:Deploy complete! 2023-11-25T17:00:45.544 DEBUG:teuthology.parallel:result is None 2023-11-25T17:00:45.710 INFO:teuthology.lock.ops:Checking smithi156.front.sepia.ceph.com 2023-11-25T17:00:45.710 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-25T17:00:45.738 INFO:teuthology.lock.ops:Checking smithi186.front.sepia.ceph.com 2023-11-25T17:00:45.739 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-25T17:00:45.756 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: set os type and version on server 2023-11-25T17:00:45.756 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-11-25T17:00:45.757 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-25T17:00:45.839 DEBUG:teuthology.orchestra.run.smithi156:> true 2023-11-25T17:00:45.904 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-11-25T17:00:45.904 DEBUG:teuthology.orchestra.run.smithi156:> uname -m 2023-11-25T17:00:45.958 INFO:teuthology.orchestra.run.smithi156.stdout:x86_64 2023-11-25T17:00:45.958 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release 2023-11-25T17:00:46.012 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="CentOS Stream" 2023-11-25T17:00:46.012 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="9" 2023-11-25T17:00:46.013 INFO:teuthology.orchestra.run.smithi156.stdout:ID="centos" 2023-11-25T17:00:46.013 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="rhel fedora" 2023-11-25T17:00:46.013 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="9" 2023-11-25T17:00:46.013 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el9" 2023-11-25T17:00:46.013 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-25T17:00:46.014 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31" 2023-11-25T17:00:46.014 INFO:teuthology.orchestra.run.smithi156.stdout:LOGO="fedora-logo-icon" 2023-11-25T17:00:46.014 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-25T17:00:46.014 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://centos.org/" 2023-11-25T17:00:46.014 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-25T17:00:46.015 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-25T17:00:46.015 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-25T17:00:46.015 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2023-11-25T17:00:46.039 INFO:teuthology.lock.ops:Updating [smithi186.front.sepia.ceph.com]: set os type and version on server 2023-11-25T17:00:46.039 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi186.front.sepia.ceph.com' 2023-11-25T17:00:46.039 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-25T17:00:46.120 DEBUG:teuthology.orchestra.run.smithi186:> true 2023-11-25T17:00:46.191 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi186.front.sepia.ceph.com' 2023-11-25T17:00:46.191 DEBUG:teuthology.orchestra.run.smithi186:> uname -m 2023-11-25T17:00:46.251 INFO:teuthology.orchestra.run.smithi186.stdout:x86_64 2023-11-25T17:00:46.372 DEBUG:teuthology.orchestra.run.smithi186:> cat /etc/os-release 2023-11-25T17:00:46.405 INFO:teuthology.orchestra.run.smithi186.stdout:NAME="CentOS Stream" 2023-11-25T17:00:46.405 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION="9" 2023-11-25T17:00:46.405 INFO:teuthology.orchestra.run.smithi186.stdout:ID="centos" 2023-11-25T17:00:46.405 INFO:teuthology.orchestra.run.smithi186.stdout:ID_LIKE="rhel fedora" 2023-11-25T17:00:46.406 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_ID="9" 2023-11-25T17:00:46.406 INFO:teuthology.orchestra.run.smithi186.stdout:PLATFORM_ID="platform:el9" 2023-11-25T17:00:46.406 INFO:teuthology.orchestra.run.smithi186.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-25T17:00:46.406 INFO:teuthology.orchestra.run.smithi186.stdout:ANSI_COLOR="0;31" 2023-11-25T17:00:46.406 INFO:teuthology.orchestra.run.smithi186.stdout:LOGO="fedora-logo-icon" 2023-11-25T17:00:46.406 INFO:teuthology.orchestra.run.smithi186.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-25T17:00:46.406 INFO:teuthology.orchestra.run.smithi186.stdout:HOME_URL="https://centos.org/" 2023-11-25T17:00:46.406 INFO:teuthology.orchestra.run.smithi186.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-25T17:00:46.406 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-25T17:00:46.406 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-25T17:00:46.407 INFO:teuthology.lock.ops:Updating smithi186.front.sepia.ceph.com on lock server 2023-11-25T17:00:46.440 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-25T17:00:46.574 INFO:teuthology.dispatcher.supervisor:Running job 7467294 2023-11-25T17:00:46.574 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/virtualenv/bin/teuthology -v --owner scheduled_kkeithle@teuthology --archive /home/teuthworker/archive/kkeithle-2023-11-25_16:43:53-rgw:verify-wip-kkeithley-zipper-aya-distro-default-smithi/7467294 --name kkeithle-2023-11-25_16:43:53-rgw:verify-wip-kkeithley-zipper-aya-distro-default-smithi --description rgw:verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} -- /home/teuthworker/archive/kkeithle-2023-11-25_16:43:53-rgw:verify-wip-kkeithley-zipper-aya-distro-default-smithi/7467294/orig.config.yaml 2023-11-25T17:00:46.578 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/kkeithle-2023-11-25_16:43:53-rgw:verify-wip-kkeithley-zipper-aya-distro-default-smithi/7467294 2023-11-25T17:00:46.578 INFO:teuthology.dispatcher.supervisor:Job PID: 973725 2023-11-25T17:00:46.578 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-25T17:02:46.678 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-25T17:04:46.859 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-25T17:06:47.339 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-25T17:08:47.512 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-25T17:10:47.691 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-25T17:12:47.863 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-25T17:14:48.065 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-25T17:16:48.503 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-25T17:18:48.691 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-25T17:20:48.863 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-25T17:22:49.063 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-25T17:24:49.239 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-25T17:26:49.404 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-25T17:26:49.486 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-11-25T17:26:51.103 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-25T17:26:51.103 INFO:teuthology.nuke:Checking targets against current locks 2023-11-25T17:26:51.150 DEBUG:teuthology.nuke:shortname: smithi156 2023-11-25T17:26:51.151 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-25T17:26:51.171 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi156.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/kkeithle-2023-11-25_16:43:53-rgw:verify-wip-kkeithley-zipper-aya-distro-default-smithi/7467294', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-25 16:55:29.398362', 'locked_by': 'scheduled_kkeithle@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAnnKshE/6U2wDCA1UjxbwqX86vXTRxG1bxFV/6FmAjhP543DRkaBDwKhu/KuSbMj6a7JpdyyonL63azKj2/ti8='} 2023-11-25T17:26:51.174 DEBUG:teuthology.nuke:shortname: smithi186 2023-11-25T17:26:51.174 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-25T17:26:51.201 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi186.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/kkeithle-2023-11-25_16:43:53-rgw:verify-wip-kkeithley-zipper-aya-distro-default-smithi/7467294', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-25 16:55:29.400258', 'locked_by': 'scheduled_kkeithle@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCRoz5MSFx0SLfKHfPauZqOXyFWz3SjPLLz0/7otdTSXz+UgI6omyxAdRHpNNLn1afl9mzPFgp7gjMNdn2YRdnI='} 2023-11-25T17:26:51.236 INFO:teuthology.orchestra.console.smithi156:Power off 2023-11-25T17:26:51.237 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-25T17:26:51.276 DEBUG:teuthology.orchestra.console.smithi156:power off output: Chassis Power Control: Down/Off 2023-11-25T17:26:51.276 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-25T17:26:51.299 INFO:teuthology.orchestra.console.smithi186:Power off 2023-11-25T17:26:51.299 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-25T17:26:51.315 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2023-11-25T17:26:51.326 DEBUG:teuthology.orchestra.console.smithi186:power off output: Chassis Power Control: Down/Off 2023-11-25T17:26:51.326 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-25T17:26:51.352 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off 2023-11-25T17:26:51.416 INFO:teuthology.orchestra.console.smithi156:Power off completed 2023-11-25T17:26:51.454 INFO:teuthology.orchestra.console.smithi186:Power off completed 2023-11-25T17:26:51.577 INFO:teuthology.lock.ops:unlocked: smithi156.front.sepia.ceph.com 2023-11-25T17:26:51.601 INFO:teuthology.lock.ops:unlocked: smithi186.front.sepia.ceph.com