2023-12-04T05:08:32.154 INFO:root:teuthology version: 0.0.1.dev214+gf2de108 2023-12-04T05:08:32.154 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T05:08:32.359 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc86cfaf550>, signals=[15]) 2023-12-04T05:08:32.359 INFO:teuthology.lock.ops:Start node 'smithi064.front.sepia.ceph.com' reimaging 2023-12-04T05:08:32.360 INFO:teuthology.lock.ops:Updating [smithi064.front.sepia.ceph.com]: reset os type and version on server 2023-12-04T05:08:32.360 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server 2023-12-04T05:08:32.528 INFO:teuthology.lock.ops:Start node 'smithi184.front.sepia.ceph.com' reimaging 2023-12-04T05:08:32.528 INFO:teuthology.lock.ops:Updating [smithi184.front.sepia.ceph.com]: reset os type and version on server 2023-12-04T05:08:32.528 INFO:teuthology.lock.ops:Updating smithi184.front.sepia.ceph.com on lock server 2023-12-04T05:08:32.653 DEBUG:teuthology.provision.fog.smithi064:Requesting image smithi_centos_9.stream (ID 10) 2023-12-04T05:08:32.697 INFO:teuthology.provision.fog.smithi064:Scheduling deploy of centos 9.stream 2023-12-04T05:08:32.760 DEBUG:teuthology.provision.fog.smithi184:Requesting image smithi_centos_9.stream (ID 10) 2023-12-04T05:08:32.808 INFO:teuthology.provision.fog.smithi184:Scheduling deploy of centos 9.stream 2023-12-04T05:08:33.215 INFO:teuthology.orchestra.console.smithi064:Power off 2023-12-04T05:08:33.215 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-04T05:08:33.236 DEBUG:teuthology.orchestra.console.smithi064:power off output: Chassis Power Control: Down/Off 2023-12-04T05:08:33.236 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T05:08:33.257 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on 2023-12-04T05:08:33.312 INFO:teuthology.orchestra.console.smithi184:Power off 2023-12-04T05:08:33.313 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-04T05:08:33.334 DEBUG:teuthology.orchestra.console.smithi184:power off output: Chassis Power Control: Down/Off 2023-12-04T05:08:33.334 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T05:08:33.353 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is on 2023-12-04T05:08:37.262 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T05:08:37.355 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T05:08:37.371 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on 2023-12-04T05:08:37.465 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is on 2023-12-04T05:08:41.374 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T05:08:41.466 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T05:08:41.483 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on 2023-12-04T05:08:41.575 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is on 2023-12-04T05:08:45.489 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T05:08:45.576 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T05:08:45.596 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off 2023-12-04T05:08:45.683 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is off 2023-12-04T05:08:45.698 INFO:teuthology.orchestra.console.smithi064:Power off completed 2023-12-04T05:08:45.784 INFO:teuthology.orchestra.console.smithi184:Power off completed 2023-12-04T05:08:45.798 INFO:teuthology.orchestra.console.smithi064:Power on 2023-12-04T05:08:45.798 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-04T05:08:45.817 DEBUG:teuthology.orchestra.console.smithi064:power on output: Chassis Power Control: Up/On 2023-12-04T05:08:45.817 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T05:08:45.836 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off 2023-12-04T05:08:45.885 INFO:teuthology.orchestra.console.smithi184:Power on 2023-12-04T05:08:45.885 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-04T05:08:45.905 DEBUG:teuthology.orchestra.console.smithi184:power on output: Chassis Power Control: Up/On 2023-12-04T05:08:45.905 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T05:08:45.924 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is off 2023-12-04T05:08:49.841 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T05:08:49.925 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T05:08:49.953 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on 2023-12-04T05:08:50.034 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is on 2023-12-04T05:08:50.054 INFO:teuthology.orchestra.console.smithi064:Power on completed 2023-12-04T05:08:50.135 INFO:teuthology.orchestra.console.smithi184:Power on completed 2023-12-04T05:08:50.155 INFO:teuthology.provision.fog.smithi064:Waiting for deploy to finish 2023-12-04T05:08:50.237 INFO:teuthology.provision.fog.smithi184:Waiting for deploy to finish 2023-12-04T05:12:56.690 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T05:13:15.106 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-12-04T05:13:21.110 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T05:13:24.162 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-12-04T05:13:30.166 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T05:13:33.218 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-12-04T05:13:39.225 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T05:13:42.274 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-12-04T05:13:48.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T05:13:58.626 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-12-04T05:14:04.634 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T05:14:07.714 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-12-04T05:14:13.717 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T05:14:16.770 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-12-04T05:14:22.778 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T05:14:24.913 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-04T05:14:24.914 DEBUG:teuthology.orchestra.run.smithi184:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-04T05:14:45.270 INFO:teuthology.provision.fog.smithi184:Node is ready 2023-12-04T05:14:45.270 DEBUG:teuthology.orchestra.run.smithi184:> hostname 2023-12-04T05:14:45.288 INFO:teuthology.orchestra.run.smithi184.stdout:smithi184.front.sepia.ceph.com 2023-12-04T05:14:45.289 DEBUG:teuthology.orchestra.run.smithi184:> grep smithi184.front.sepia.ceph.com /etc/hosts 2023-12-04T05:14:45.347 INFO:teuthology.orchestra.run.smithi184.stdout:172.21.15.184 smithi184.front.sepia.ceph.com smithi184 2023-12-04T05:14:45.347 DEBUG:teuthology.orchestra.run.smithi184:> sudo hostname smithi184 2023-12-04T05:14:45.492 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i -e 's/smithi184.front.sepia.ceph.com/smithi184/g' /etc/hosts 2023-12-04T05:14:45.525 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i -e 's/172.21.15.184/172.21.15.184/g' /etc/hosts 2023-12-04T05:14:45.597 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i -e 's/smithi184.front.sepia.ceph.com/smithi184/g' /etc/hostname 2023-12-04T05:14:45.668 DEBUG:teuthology.orchestra.run.smithi184:> sudo hostname smithi184 2023-12-04T05:14:45.737 DEBUG:teuthology.orchestra.run.smithi184:> cat /etc/os-release 2023-12-04T05:14:45.793 INFO:teuthology.orchestra.run.smithi184.stdout:NAME="CentOS Stream" 2023-12-04T05:14:45.793 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION="9" 2023-12-04T05:14:45.793 INFO:teuthology.orchestra.run.smithi184.stdout:ID="centos" 2023-12-04T05:14:45.793 INFO:teuthology.orchestra.run.smithi184.stdout:ID_LIKE="rhel fedora" 2023-12-04T05:14:45.793 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_ID="9" 2023-12-04T05:14:45.793 INFO:teuthology.orchestra.run.smithi184.stdout:PLATFORM_ID="platform:el9" 2023-12-04T05:14:45.794 INFO:teuthology.orchestra.run.smithi184.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-04T05:14:45.794 INFO:teuthology.orchestra.run.smithi184.stdout:ANSI_COLOR="0;31" 2023-12-04T05:14:45.794 INFO:teuthology.orchestra.run.smithi184.stdout:LOGO="fedora-logo-icon" 2023-12-04T05:14:45.794 INFO:teuthology.orchestra.run.smithi184.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-04T05:14:45.794 INFO:teuthology.orchestra.run.smithi184.stdout:HOME_URL="https://centos.org/" 2023-12-04T05:14:45.794 INFO:teuthology.orchestra.run.smithi184.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-04T05:14:45.794 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-04T05:14:45.794 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-04T05:14:45.795 INFO:teuthology.provision.fog.smithi184:Deploy complete! 2023-12-04T05:14:45.796 DEBUG:teuthology.parallel:result is None 2023-12-04T05:18:52.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T05:18:55.814 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-12-04T05:19:01.818 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T05:19:04.898 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-12-04T05:19:10.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T05:19:13.954 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-12-04T05:19:19.958 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T05:19:23.010 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-12-04T05:19:29.016 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T05:19:32.070 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-12-04T05:19:38.075 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T05:19:41.154 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-12-04T05:19:47.161 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T05:20:47.222 WARNING:teuthology.provision.fog.smithi064:timed out 2023-12-04T05:20:53.228 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T05:20:53.514 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-04T05:20:53.514 DEBUG:teuthology.orchestra.run.smithi064:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-04T05:20:53.850 INFO:teuthology.provision.fog.smithi064:Node is ready 2023-12-04T05:20:53.851 DEBUG:teuthology.orchestra.run.smithi064:> hostname 2023-12-04T05:20:53.867 INFO:teuthology.orchestra.run.smithi064.stdout:smithi064.front.sepia.ceph.com 2023-12-04T05:20:53.867 DEBUG:teuthology.orchestra.run.smithi064:> grep smithi064.front.sepia.ceph.com /etc/hosts 2023-12-04T05:20:53.923 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64 smithi064.front.sepia.ceph.com smithi064 2023-12-04T05:20:53.924 DEBUG:teuthology.orchestra.run.smithi064:> sudo hostname smithi064 2023-12-04T05:20:54.031 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/smithi064.front.sepia.ceph.com/smithi064/g' /etc/hosts 2023-12-04T05:20:54.064 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/172.21.15.64/172.21.15.64/g' /etc/hosts 2023-12-04T05:20:54.136 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/smithi064.front.sepia.ceph.com/smithi064/g' /etc/hostname 2023-12-04T05:20:54.209 DEBUG:teuthology.orchestra.run.smithi064:> sudo hostname smithi064 2023-12-04T05:20:54.280 DEBUG:teuthology.orchestra.run.smithi064:> cat /etc/os-release 2023-12-04T05:20:54.335 INFO:teuthology.orchestra.run.smithi064.stdout:NAME="CentOS Stream" 2023-12-04T05:20:54.336 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION="9" 2023-12-04T05:20:54.336 INFO:teuthology.orchestra.run.smithi064.stdout:ID="centos" 2023-12-04T05:20:54.336 INFO:teuthology.orchestra.run.smithi064.stdout:ID_LIKE="rhel fedora" 2023-12-04T05:20:54.336 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_ID="9" 2023-12-04T05:20:54.336 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM_ID="platform:el9" 2023-12-04T05:20:54.337 INFO:teuthology.orchestra.run.smithi064.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-04T05:20:54.337 INFO:teuthology.orchestra.run.smithi064.stdout:ANSI_COLOR="0;31" 2023-12-04T05:20:54.337 INFO:teuthology.orchestra.run.smithi064.stdout:LOGO="fedora-logo-icon" 2023-12-04T05:20:54.337 INFO:teuthology.orchestra.run.smithi064.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-04T05:20:54.338 INFO:teuthology.orchestra.run.smithi064.stdout:HOME_URL="https://centos.org/" 2023-12-04T05:20:54.338 INFO:teuthology.orchestra.run.smithi064.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-04T05:20:54.338 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-04T05:20:54.339 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-04T05:20:54.339 INFO:teuthology.provision.fog.smithi064:Deploy complete! 2023-12-04T05:20:54.340 DEBUG:teuthology.parallel:result is None 2023-12-04T05:20:54.546 INFO:teuthology.lock.ops:Checking smithi064.front.sepia.ceph.com 2023-12-04T05:20:54.546 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-04T05:20:54.578 INFO:teuthology.lock.ops:Checking smithi184.front.sepia.ceph.com 2023-12-04T05:20:54.579 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-04T05:20:54.596 INFO:teuthology.lock.ops:Updating [smithi064.front.sepia.ceph.com]: set os type and version on server 2023-12-04T05:20:54.597 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi064.front.sepia.ceph.com' 2023-12-04T05:20:54.597 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T05:20:54.735 DEBUG:teuthology.orchestra.run.smithi064:> true 2023-12-04T05:20:54.801 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi064.front.sepia.ceph.com' 2023-12-04T05:20:54.801 DEBUG:teuthology.orchestra.run.smithi064:> uname -m 2023-12-04T05:20:54.859 INFO:teuthology.orchestra.run.smithi064.stdout:x86_64 2023-12-04T05:20:54.859 DEBUG:teuthology.orchestra.run.smithi064:> cat /etc/os-release 2023-12-04T05:20:54.914 INFO:teuthology.orchestra.run.smithi064.stdout:NAME="CentOS Stream" 2023-12-04T05:20:54.914 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION="9" 2023-12-04T05:20:54.914 INFO:teuthology.orchestra.run.smithi064.stdout:ID="centos" 2023-12-04T05:20:54.914 INFO:teuthology.orchestra.run.smithi064.stdout:ID_LIKE="rhel fedora" 2023-12-04T05:20:54.914 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_ID="9" 2023-12-04T05:20:54.914 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM_ID="platform:el9" 2023-12-04T05:20:54.914 INFO:teuthology.orchestra.run.smithi064.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-04T05:20:54.914 INFO:teuthology.orchestra.run.smithi064.stdout:ANSI_COLOR="0;31" 2023-12-04T05:20:54.914 INFO:teuthology.orchestra.run.smithi064.stdout:LOGO="fedora-logo-icon" 2023-12-04T05:20:54.914 INFO:teuthology.orchestra.run.smithi064.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-04T05:20:54.915 INFO:teuthology.orchestra.run.smithi064.stdout:HOME_URL="https://centos.org/" 2023-12-04T05:20:54.915 INFO:teuthology.orchestra.run.smithi064.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-04T05:20:54.915 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-04T05:20:54.915 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-04T05:20:54.915 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server 2023-12-04T05:20:54.938 INFO:teuthology.lock.ops:Updating [smithi184.front.sepia.ceph.com]: set os type and version on server 2023-12-04T05:20:54.938 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2023-12-04T05:20:54.938 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T05:20:55.025 DEBUG:teuthology.orchestra.run.smithi184:> true 2023-12-04T05:20:55.197 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi184.front.sepia.ceph.com' 2023-12-04T05:20:55.197 DEBUG:teuthology.orchestra.run.smithi184:> uname -m 2023-12-04T05:20:55.251 INFO:teuthology.orchestra.run.smithi184.stdout:x86_64 2023-12-04T05:20:55.252 DEBUG:teuthology.orchestra.run.smithi184:> cat /etc/os-release 2023-12-04T05:20:55.307 INFO:teuthology.orchestra.run.smithi184.stdout:NAME="CentOS Stream" 2023-12-04T05:20:55.307 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION="9" 2023-12-04T05:20:55.307 INFO:teuthology.orchestra.run.smithi184.stdout:ID="centos" 2023-12-04T05:20:55.307 INFO:teuthology.orchestra.run.smithi184.stdout:ID_LIKE="rhel fedora" 2023-12-04T05:20:55.307 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_ID="9" 2023-12-04T05:20:55.307 INFO:teuthology.orchestra.run.smithi184.stdout:PLATFORM_ID="platform:el9" 2023-12-04T05:20:55.307 INFO:teuthology.orchestra.run.smithi184.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-04T05:20:55.307 INFO:teuthology.orchestra.run.smithi184.stdout:ANSI_COLOR="0;31" 2023-12-04T05:20:55.307 INFO:teuthology.orchestra.run.smithi184.stdout:LOGO="fedora-logo-icon" 2023-12-04T05:20:55.308 INFO:teuthology.orchestra.run.smithi184.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-04T05:20:55.308 INFO:teuthology.orchestra.run.smithi184.stdout:HOME_URL="https://centos.org/" 2023-12-04T05:20:55.308 INFO:teuthology.orchestra.run.smithi184.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-04T05:20:55.308 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-04T05:20:55.308 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-04T05:20:55.308 INFO:teuthology.lock.ops:Updating smithi184.front.sepia.ceph.com on lock server 2023-12-04T05:20:55.337 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T05:20:55.454 INFO:teuthology.dispatcher.supervisor:Running job 7476657 2023-12-04T05:20:55.455 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-12-04_05:06:51-fs-wip-vshankar-testing-20231127.102654-distro-default-smithi/7476657 --name vshankar-2023-12-04_05:06:51-fs-wip-vshankar-testing-20231127.102654-distro-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/ffsb}} -- /home/teuthworker/archive/vshankar-2023-12-04_05:06:51-fs-wip-vshankar-testing-20231127.102654-distro-default-smithi/7476657/orig.config.yaml 2023-12-04T05:20:55.464 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-12-04_05:06:51-fs-wip-vshankar-testing-20231127.102654-distro-default-smithi/7476657 2023-12-04T05:20:55.464 INFO:teuthology.dispatcher.supervisor:Job PID: 3999492 2023-12-04T05:20:55.464 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-04T05:22:55.564 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T05:24:55.742 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T05:26:55.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T05:28:56.067 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T05:30:56.242 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T05:32:56.414 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T05:34:56.579 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T05:36:56.774 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T05:38:56.927 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T05:40:57.105 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T05:42:57.265 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T05:44:57.431 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T05:46:57.595 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T05:48:57.767 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T05:50:57.939 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T05:52:58.111 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T05:54:58.277 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T05:56:58.441 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T05:56:58.514 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-04T05:56:58.621 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-04T05:56:58.621 INFO:teuthology.nuke:Checking targets against current locks 2023-12-04T05:56:58.671 DEBUG:teuthology.nuke:shortname: smithi064 2023-12-04T05:56:58.671 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-04T05:56:58.691 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi064.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-04_05:06:51-fs-wip-vshankar-testing-20231127.102654-distro-default-smithi/7476657', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-04 05:08:31.343259', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGd5tekRbirUkK668TbLwlb5JMigt+ORcaYCJ188nDL6DTPmosiQhczk5R5qnwZ2FqGzJ7D+QKhHY2Wwskuh+iI='} 2023-12-04T05:56:58.694 DEBUG:teuthology.nuke:shortname: smithi184 2023-12-04T05:56:58.695 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-04T05:56:58.720 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi184.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-04_05:06:51-fs-wip-vshankar-testing-20231127.102654-distro-default-smithi/7476657', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-04 05:08:31.341515', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM9GNfnWt3gx5J+mF9XtH7dGp6Wn8U4abGRjyNn7vxBnkvDR7zcOdoqZ7mTjg0nQ8/c/HVQx8rk1On3TZoKiDmo='} 2023-12-04T05:56:58.739 INFO:teuthology.orchestra.console.smithi064:Power off 2023-12-04T05:56:58.739 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-04T05:56:58.760 DEBUG:teuthology.orchestra.console.smithi064:power off output: Chassis Power Control: Down/Off 2023-12-04T05:56:58.760 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T05:56:58.772 INFO:teuthology.orchestra.console.smithi184:Power off 2023-12-04T05:56:58.772 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-04T05:56:58.780 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off 2023-12-04T05:56:58.792 DEBUG:teuthology.orchestra.console.smithi184:power off output: Chassis Power Control: Down/Off 2023-12-04T05:56:58.792 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T05:56:58.813 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is off 2023-12-04T05:56:58.881 INFO:teuthology.orchestra.console.smithi064:Power off completed 2023-12-04T05:56:58.915 INFO:teuthology.orchestra.console.smithi184:Power off completed 2023-12-04T05:56:59.031 INFO:teuthology.lock.ops:unlocked: smithi064.front.sepia.ceph.com 2023-12-04T05:56:59.062 INFO:teuthology.lock.ops:unlocked: smithi184.front.sepia.ceph.com