2023-12-12T23:25:28.938 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-12T23:25:28.939 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T23:25:29.072 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc1a0d70940>, signals=[15]) 2023-12-12T23:25:29.072 INFO:teuthology.lock.ops:Start node 'smithi055.front.sepia.ceph.com' reimaging 2023-12-12T23:25:29.072 INFO:teuthology.lock.ops:Updating [smithi055.front.sepia.ceph.com]: reset os type and version on server 2023-12-12T23:25:29.073 INFO:teuthology.lock.ops:Updating smithi055.front.sepia.ceph.com on lock server 2023-12-12T23:25:29.102 INFO:teuthology.lock.ops:Start node 'smithi152.front.sepia.ceph.com' reimaging 2023-12-12T23:25:29.103 INFO:teuthology.lock.ops:Updating [smithi152.front.sepia.ceph.com]: reset os type and version on server 2023-12-12T23:25:29.103 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server 2023-12-12T23:25:29.227 DEBUG:teuthology.provision.fog.smithi055:Requesting image smithi_centos_9.stream (ID 10) 2023-12-12T23:25:29.258 DEBUG:teuthology.provision.fog.smithi152:Requesting image smithi_centos_9.stream (ID 10) 2023-12-12T23:25:29.270 INFO:teuthology.provision.fog.smithi055:Scheduling deploy of centos 9.stream 2023-12-12T23:25:29.301 INFO:teuthology.provision.fog.smithi152:Scheduling deploy of centos 9.stream 2023-12-12T23:25:29.597 INFO:teuthology.orchestra.console.smithi055:Power off 2023-12-12T23:25:29.597 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-12T23:25:29.612 INFO:teuthology.orchestra.console.smithi152:Power off 2023-12-12T23:25:29.612 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-12T23:25:29.620 DEBUG:teuthology.orchestra.console.smithi055:power off output: Chassis Power Control: Down/Off 2023-12-12T23:25:29.620 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T23:25:29.632 DEBUG:teuthology.orchestra.console.smithi152:power off output: Chassis Power Control: Down/Off 2023-12-12T23:25:29.633 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T23:25:29.645 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is off 2023-12-12T23:25:29.653 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off 2023-12-12T23:25:29.746 INFO:teuthology.orchestra.console.smithi055:Power off completed 2023-12-12T23:25:29.754 INFO:teuthology.orchestra.console.smithi152:Power off completed 2023-12-12T23:25:29.847 INFO:teuthology.orchestra.console.smithi055:Power on 2023-12-12T23:25:29.847 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-12T23:25:29.855 INFO:teuthology.orchestra.console.smithi152:Power on 2023-12-12T23:25:29.855 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-12T23:25:29.874 DEBUG:teuthology.orchestra.console.smithi055:power on output: Chassis Power Control: Up/On 2023-12-12T23:25:29.875 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T23:25:29.883 DEBUG:teuthology.orchestra.console.smithi152:power on output: Chassis Power Control: Up/On 2023-12-12T23:25:29.883 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T23:25:29.895 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is off 2023-12-12T23:25:29.906 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off 2023-12-12T23:25:33.898 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T23:25:33.906 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T23:25:34.006 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is off 2023-12-12T23:25:34.015 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on 2023-12-12T23:25:34.116 INFO:teuthology.orchestra.console.smithi152:Power on completed 2023-12-12T23:25:34.216 INFO:teuthology.provision.fog.smithi152:Waiting for deploy to finish 2023-12-12T23:25:38.011 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T23:25:38.119 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is on 2023-12-12T23:25:38.221 INFO:teuthology.orchestra.console.smithi055:Power on completed 2023-12-12T23:25:38.321 INFO:teuthology.provision.fog.smithi055:Waiting for deploy to finish 2023-12-12T23:27:53.967 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T23:27:57.030 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55 2023-12-12T23:28:03.038 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T23:28:06.114 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55 2023-12-12T23:28:12.121 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T23:28:15.202 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55 2023-12-12T23:28:20.017 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T23:28:21.205 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T23:28:23.078 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-12-12T23:28:24.258 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55 2023-12-12T23:28:29.082 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T23:28:30.260 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T23:28:32.166 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-12-12T23:28:33.314 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55 2023-12-12T23:28:38.171 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T23:28:39.317 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T23:28:41.254 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-12-12T23:28:42.370 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55 2023-12-12T23:28:47.259 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T23:28:48.373 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T23:28:50.338 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-12-12T23:28:56.343 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T23:28:59.394 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-12-12T23:29:05.402 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T23:29:08.486 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-12-12T23:29:14.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T23:29:17.578 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-12-12T23:29:23.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T23:29:26.662 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-12-12T23:29:32.666 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T23:29:48.387 WARNING:teuthology.provision.fog.smithi055:timed out 2023-12-12T23:29:54.392 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T23:29:54.633 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-12T23:29:54.634 DEBUG:teuthology.orchestra.run.smithi055:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-12T23:29:54.984 INFO:teuthology.provision.fog.smithi055:Node is ready 2023-12-12T23:29:54.984 DEBUG:teuthology.orchestra.run.smithi055:> hostname 2023-12-12T23:29:54.999 INFO:teuthology.orchestra.run.smithi055.stdout:smithi055.front.sepia.ceph.com 2023-12-12T23:29:54.999 DEBUG:teuthology.orchestra.run.smithi055:> grep smithi055.front.sepia.ceph.com /etc/hosts 2023-12-12T23:29:55.055 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55 smithi055.front.sepia.ceph.com smithi055 2023-12-12T23:29:55.055 DEBUG:teuthology.orchestra.run.smithi055:> sudo hostname smithi055 2023-12-12T23:29:55.168 DEBUG:teuthology.orchestra.run.smithi055:> sudo sed -i -e 's/smithi055.front.sepia.ceph.com/smithi055/g' /etc/hosts 2023-12-12T23:29:55.201 DEBUG:teuthology.orchestra.run.smithi055:> sudo sed -i -e 's/172.21.15.55/172.21.15.55/g' /etc/hosts 2023-12-12T23:29:55.271 DEBUG:teuthology.orchestra.run.smithi055:> sudo sed -i -e 's/smithi055.front.sepia.ceph.com/smithi055/g' /etc/hostname 2023-12-12T23:29:55.342 DEBUG:teuthology.orchestra.run.smithi055:> sudo hostname smithi055 2023-12-12T23:29:55.412 DEBUG:teuthology.orchestra.run.smithi055:> cat /etc/os-release 2023-12-12T23:29:55.467 INFO:teuthology.orchestra.run.smithi055.stdout:NAME="CentOS Stream" 2023-12-12T23:29:55.467 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION="9" 2023-12-12T23:29:55.468 INFO:teuthology.orchestra.run.smithi055.stdout:ID="centos" 2023-12-12T23:29:55.468 INFO:teuthology.orchestra.run.smithi055.stdout:ID_LIKE="rhel fedora" 2023-12-12T23:29:55.468 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION_ID="9" 2023-12-12T23:29:55.468 INFO:teuthology.orchestra.run.smithi055.stdout:PLATFORM_ID="platform:el9" 2023-12-12T23:29:55.468 INFO:teuthology.orchestra.run.smithi055.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-12T23:29:55.469 INFO:teuthology.orchestra.run.smithi055.stdout:ANSI_COLOR="0;31" 2023-12-12T23:29:55.469 INFO:teuthology.orchestra.run.smithi055.stdout:LOGO="fedora-logo-icon" 2023-12-12T23:29:55.469 INFO:teuthology.orchestra.run.smithi055.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-12T23:29:55.469 INFO:teuthology.orchestra.run.smithi055.stdout:HOME_URL="https://centos.org/" 2023-12-12T23:29:55.469 INFO:teuthology.orchestra.run.smithi055.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-12T23:29:55.470 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-12T23:29:55.470 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-12T23:29:55.471 INFO:teuthology.provision.fog.smithi055:Deploy complete! 2023-12-12T23:29:55.472 DEBUG:teuthology.parallel:result is None 2023-12-12T23:30:32.703 WARNING:teuthology.provision.fog.smithi152:timed out 2023-12-12T23:30:38.710 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T23:30:39.029 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-12T23:30:39.029 DEBUG:teuthology.orchestra.run.smithi152:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-12T23:30:39.365 INFO:teuthology.provision.fog.smithi152:Node is ready 2023-12-12T23:30:39.366 DEBUG:teuthology.orchestra.run.smithi152:> hostname 2023-12-12T23:30:39.380 INFO:teuthology.orchestra.run.smithi152.stdout:smithi152.front.sepia.ceph.com 2023-12-12T23:30:39.380 DEBUG:teuthology.orchestra.run.smithi152:> grep smithi152.front.sepia.ceph.com /etc/hosts 2023-12-12T23:30:39.439 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152 smithi152.front.sepia.ceph.com smithi152 2023-12-12T23:30:39.439 DEBUG:teuthology.orchestra.run.smithi152:> sudo hostname smithi152 2023-12-12T23:30:39.553 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/smithi152.front.sepia.ceph.com/smithi152/g' /etc/hosts 2023-12-12T23:30:39.581 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/172.21.15.152/172.21.15.152/g' /etc/hosts 2023-12-12T23:30:39.651 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/smithi152.front.sepia.ceph.com/smithi152/g' /etc/hostname 2023-12-12T23:30:39.722 DEBUG:teuthology.orchestra.run.smithi152:> sudo hostname smithi152 2023-12-12T23:30:39.793 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release 2023-12-12T23:30:39.850 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="CentOS Stream" 2023-12-12T23:30:39.850 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="9" 2023-12-12T23:30:39.850 INFO:teuthology.orchestra.run.smithi152.stdout:ID="centos" 2023-12-12T23:30:39.851 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="rhel fedora" 2023-12-12T23:30:39.851 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="9" 2023-12-12T23:30:39.851 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM_ID="platform:el9" 2023-12-12T23:30:39.851 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-12T23:30:39.851 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31" 2023-12-12T23:30:39.851 INFO:teuthology.orchestra.run.smithi152.stdout:LOGO="fedora-logo-icon" 2023-12-12T23:30:39.851 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-12T23:30:39.851 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://centos.org/" 2023-12-12T23:30:39.851 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-12T23:30:39.851 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-12T23:30:39.851 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-12T23:30:39.852 INFO:teuthology.provision.fog.smithi152:Deploy complete! 2023-12-12T23:30:39.852 DEBUG:teuthology.parallel:result is None 2023-12-12T23:30:40.020 INFO:teuthology.lock.ops:Checking smithi055.front.sepia.ceph.com 2023-12-12T23:30:40.020 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-12T23:30:40.038 INFO:teuthology.lock.ops:Checking smithi152.front.sepia.ceph.com 2023-12-12T23:30:40.038 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-12T23:30:40.056 INFO:teuthology.lock.ops:Updating [smithi055.front.sepia.ceph.com]: set os type and version on server 2023-12-12T23:30:40.056 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com' 2023-12-12T23:30:40.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T23:30:40.154 DEBUG:teuthology.orchestra.run.smithi055:> true 2023-12-12T23:30:40.341 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi055.front.sepia.ceph.com' 2023-12-12T23:30:40.341 DEBUG:teuthology.orchestra.run.smithi055:> uname -m 2023-12-12T23:30:40.397 INFO:teuthology.orchestra.run.smithi055.stdout:x86_64 2023-12-12T23:30:40.397 DEBUG:teuthology.orchestra.run.smithi055:> cat /etc/os-release 2023-12-12T23:30:40.452 INFO:teuthology.orchestra.run.smithi055.stdout:NAME="CentOS Stream" 2023-12-12T23:30:40.453 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION="9" 2023-12-12T23:30:40.453 INFO:teuthology.orchestra.run.smithi055.stdout:ID="centos" 2023-12-12T23:30:40.453 INFO:teuthology.orchestra.run.smithi055.stdout:ID_LIKE="rhel fedora" 2023-12-12T23:30:40.453 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION_ID="9" 2023-12-12T23:30:40.453 INFO:teuthology.orchestra.run.smithi055.stdout:PLATFORM_ID="platform:el9" 2023-12-12T23:30:40.453 INFO:teuthology.orchestra.run.smithi055.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-12T23:30:40.453 INFO:teuthology.orchestra.run.smithi055.stdout:ANSI_COLOR="0;31" 2023-12-12T23:30:40.453 INFO:teuthology.orchestra.run.smithi055.stdout:LOGO="fedora-logo-icon" 2023-12-12T23:30:40.453 INFO:teuthology.orchestra.run.smithi055.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-12T23:30:40.453 INFO:teuthology.orchestra.run.smithi055.stdout:HOME_URL="https://centos.org/" 2023-12-12T23:30:40.453 INFO:teuthology.orchestra.run.smithi055.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-12T23:30:40.454 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-12T23:30:40.454 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-12T23:30:40.454 INFO:teuthology.lock.ops:Updating smithi055.front.sepia.ceph.com on lock server 2023-12-12T23:30:40.471 INFO:teuthology.lock.ops:Updating [smithi152.front.sepia.ceph.com]: set os type and version on server 2023-12-12T23:30:40.471 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2023-12-12T23:30:40.472 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T23:30:40.559 DEBUG:teuthology.orchestra.run.smithi152:> true 2023-12-12T23:30:40.628 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi152.front.sepia.ceph.com' 2023-12-12T23:30:40.628 DEBUG:teuthology.orchestra.run.smithi152:> uname -m 2023-12-12T23:30:40.685 INFO:teuthology.orchestra.run.smithi152.stdout:x86_64 2023-12-12T23:30:40.686 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release 2023-12-12T23:30:40.743 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="CentOS Stream" 2023-12-12T23:30:40.743 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="9" 2023-12-12T23:30:40.743 INFO:teuthology.orchestra.run.smithi152.stdout:ID="centos" 2023-12-12T23:30:40.743 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="rhel fedora" 2023-12-12T23:30:40.744 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="9" 2023-12-12T23:30:40.744 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM_ID="platform:el9" 2023-12-12T23:30:40.744 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-12T23:30:40.744 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31" 2023-12-12T23:30:40.744 INFO:teuthology.orchestra.run.smithi152.stdout:LOGO="fedora-logo-icon" 2023-12-12T23:30:40.744 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-12T23:30:40.744 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://centos.org/" 2023-12-12T23:30:40.744 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-12T23:30:40.744 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-12T23:30:40.744 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-12T23:30:40.745 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server 2023-12-12T23:30:40.763 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T23:30:40.855 INFO:teuthology.dispatcher.supervisor:Running job 7489241 2023-12-12T23:30:40.855 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-12-12_23:05:14-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7489241 --name yuriw-2023-12-12_23:05:14-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/osd 2-workunit/suites/ffsb}} -- /home/teuthworker/archive/yuriw-2023-12-12_23:05:14-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7489241/orig.config.yaml 2023-12-12T23:30:40.858 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-12-12_23:05:14-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7489241 2023-12-12T23:30:40.859 INFO:teuthology.dispatcher.supervisor:Job PID: 3879424 2023-12-12T23:30:40.859 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-12T23:32:40.959 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T23:34:41.131 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T23:36:41.300 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T23:38:41.471 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T23:40:41.637 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T23:42:41.815 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T23:44:41.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T23:46:42.163 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T23:48:42.335 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T23:50:42.509 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T23:52:42.675 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T23:54:42.836 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T23:56:43.007 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T23:58:43.176 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T00:00:43.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T00:02:43.507 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T00:04:43.688 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T00:04:43.755 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-13T00:04:43.868 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-13T00:04:43.869 INFO:teuthology.nuke:Checking targets against current locks 2023-12-13T00:04:43.919 DEBUG:teuthology.nuke:shortname: smithi055 2023-12-13T00:04:43.919 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-13T00:04:43.940 DEBUG:teuthology.nuke:shortname: smithi152 2023-12-13T00:04:43.941 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-13T00:04:43.945 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi055.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-12_23:05:14-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7489241', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-12 23:25:28.043503', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLzAzuw/0zlUch6w77W44bjLp8UbItmZ4uCek0h7OArFJF4D1AvoH4wGJ+6qgNLpXp0Qt0Pac3b0hVKLhZ6ejq4='} 2023-12-13T00:04:43.961 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi152.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-12_23:05:14-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7489241', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-12 23:25:28.045463', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFk0gQ3TkFTwz4k8yZMaY5sRGPZhFhsuwvM9vBiel6uxuRSLerRQBa4KLgxqKTbu8VEinU75zRwqPnoNvuJ+Uq4='} 2023-12-13T00:04:43.996 INFO:teuthology.orchestra.console.smithi055:Power off 2023-12-13T00:04:43.996 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-13T00:04:44.013 INFO:teuthology.orchestra.console.smithi152:Power off 2023-12-13T00:04:44.014 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-13T00:04:44.022 DEBUG:teuthology.orchestra.console.smithi055:power off output: Chassis Power Control: Down/Off 2023-12-13T00:04:44.023 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T00:04:44.035 DEBUG:teuthology.orchestra.console.smithi152:power off output: Chassis Power Control: Down/Off 2023-12-13T00:04:44.035 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T00:04:44.043 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is off 2023-12-13T00:04:44.056 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off 2023-12-13T00:04:44.144 INFO:teuthology.orchestra.console.smithi055:Power off completed 2023-12-13T00:04:44.157 INFO:teuthology.orchestra.console.smithi152:Power off completed 2023-12-13T00:04:44.304 INFO:teuthology.lock.ops:unlocked: smithi055.front.sepia.ceph.com 2023-12-13T00:04:44.312 INFO:teuthology.lock.ops:unlocked: smithi152.front.sepia.ceph.com