2024-04-01T15:53:06.606 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-04-01T15:53:06.606 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T15:53:06.776 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f9796b9fc10>, signals=[15]) 2024-04-01T15:53:06.776 INFO:teuthology.lock.ops:Start node 'smithi073.front.sepia.ceph.com' reimaging 2024-04-01T15:53:06.776 INFO:teuthology.lock.ops:Updating [smithi073.front.sepia.ceph.com]: reset os type and version on server 2024-04-01T15:53:06.776 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2024-04-01T15:53:06.794 INFO:teuthology.lock.ops:Start node 'smithi099.front.sepia.ceph.com' reimaging 2024-04-01T15:53:06.794 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: reset os type and version on server 2024-04-01T15:53:06.794 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2024-04-01T15:53:06.819 INFO:teuthology.lock.ops:Start node 'smithi162.front.sepia.ceph.com' reimaging 2024-04-01T15:53:06.819 INFO:teuthology.lock.ops:Updating [smithi162.front.sepia.ceph.com]: reset os type and version on server 2024-04-01T15:53:06.819 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server 2024-04-01T15:53:06.910 DEBUG:teuthology.provision.fog.smithi073:Requesting image smithi_centos_9.stream (ID 10) 2024-04-01T15:53:06.938 DEBUG:teuthology.provision.fog.smithi099:Requesting image smithi_centos_9.stream (ID 10) 2024-04-01T15:53:06.957 INFO:teuthology.provision.fog.smithi073:Scheduling deploy of centos 9.stream 2024-04-01T15:53:06.966 DEBUG:teuthology.provision.fog.smithi162:Requesting image smithi_centos_9.stream (ID 10) 2024-04-01T15:53:06.999 INFO:teuthology.provision.fog.smithi099:Scheduling deploy of centos 9.stream 2024-04-01T15:53:07.008 INFO:teuthology.provision.fog.smithi162:Scheduling deploy of centos 9.stream 2024-04-01T15:53:07.217 INFO:teuthology.orchestra.console.smithi099:Power off 2024-04-01T15:53:07.217 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-01T15:53:07.229 INFO:teuthology.orchestra.console.smithi073:Power off 2024-04-01T15:53:07.229 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-01T15:53:07.242 DEBUG:teuthology.orchestra.console.smithi099:power off output: Chassis Power Control: Down/Off 2024-04-01T15:53:07.243 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T15:53:07.252 DEBUG:teuthology.orchestra.console.smithi073:power off output: Chassis Power Control: Down/Off 2024-04-01T15:53:07.252 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T15:53:07.271 INFO:teuthology.orchestra.console.smithi162:Power off 2024-04-01T15:53:07.272 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-01T15:53:07.280 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2024-04-01T15:53:07.280 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on 2024-04-01T15:53:07.295 DEBUG:teuthology.orchestra.console.smithi162:power off output: Chassis Power Control: Down/Off 2024-04-01T15:53:07.295 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T15:53:07.317 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is on 2024-04-01T15:53:11.281 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T15:53:11.288 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T15:53:11.318 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T15:53:11.391 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2024-04-01T15:53:11.397 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on 2024-04-01T15:53:11.428 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is on 2024-04-01T15:53:15.394 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T15:53:15.402 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T15:53:15.430 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T15:53:15.504 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2024-04-01T15:53:15.510 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is off 2024-04-01T15:53:15.539 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is off 2024-04-01T15:53:15.611 INFO:teuthology.orchestra.console.smithi073:Power off completed 2024-04-01T15:53:15.640 INFO:teuthology.orchestra.console.smithi162:Power off completed 2024-04-01T15:53:15.712 INFO:teuthology.orchestra.console.smithi073:Power on 2024-04-01T15:53:15.712 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-01T15:53:15.736 DEBUG:teuthology.orchestra.console.smithi073:power on output: Chassis Power Control: Up/On 2024-04-01T15:53:15.736 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T15:53:15.745 INFO:teuthology.orchestra.console.smithi162:Power on 2024-04-01T15:53:15.745 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-01T15:53:15.758 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is off 2024-04-01T15:53:15.766 DEBUG:teuthology.orchestra.console.smithi162:power on output: Chassis Power Control: Up/On 2024-04-01T15:53:15.767 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T15:53:15.789 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is off 2024-04-01T15:53:19.509 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T15:53:19.619 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2024-04-01T15:53:19.720 INFO:teuthology.orchestra.console.smithi099:Power off completed 2024-04-01T15:53:19.759 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T15:53:19.790 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T15:53:19.820 INFO:teuthology.orchestra.console.smithi099:Power on 2024-04-01T15:53:19.821 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-01T15:53:19.841 DEBUG:teuthology.orchestra.console.smithi099:power on output: Chassis Power Control: Up/On 2024-04-01T15:53:19.842 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T15:53:19.869 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is off 2024-04-01T15:53:19.883 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2024-04-01T15:53:19.899 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is on 2024-04-01T15:53:19.999 INFO:teuthology.orchestra.console.smithi162:Power on completed 2024-04-01T15:53:20.100 INFO:teuthology.provision.fog.smithi162:Waiting for deploy to finish 2024-04-01T15:53:23.874 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T15:53:23.884 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T15:53:23.984 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on 2024-04-01T15:53:23.993 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2024-04-01T15:53:24.086 INFO:teuthology.orchestra.console.smithi073:Power on completed 2024-04-01T15:53:24.094 INFO:teuthology.orchestra.console.smithi099:Power on completed 2024-04-01T15:53:24.187 INFO:teuthology.provision.fog.smithi073:Waiting for deploy to finish 2024-04-01T15:53:24.195 INFO:teuthology.provision.fog.smithi099:Waiting for deploy to finish 2024-04-01T15:55:54.940 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T15:55:54.942 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T15:56:05.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T15:56:13.470 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-04-01T15:56:13.471 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2024-04-01T15:56:19.477 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T15:56:19.479 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T15:56:22.558 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-04-01T15:56:22.559 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2024-04-01T15:56:24.478 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2024-04-01T15:56:28.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T15:56:28.565 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T15:56:30.481 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T15:56:31.614 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-04-01T15:56:31.646 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2024-04-01T15:56:33.534 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2024-04-01T15:56:37.619 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T15:56:37.648 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T15:56:39.537 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T15:56:40.670 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-04-01T15:56:40.702 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2024-04-01T15:56:42.590 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2024-04-01T15:56:46.673 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T15:56:46.703 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T15:56:48.592 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T15:56:49.726 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-04-01T15:56:49.762 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2024-04-01T15:56:51.646 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2024-04-01T15:56:55.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T15:56:55.767 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T15:56:57.650 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T15:57:00.702 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2024-04-01T15:57:06.709 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T15:57:55.782 WARNING:teuthology.provision.fog.smithi099:timed out 2024-04-01T15:57:55.783 WARNING:teuthology.provision.fog.smithi073:timed out 2024-04-01T15:58:01.790 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T15:58:01.792 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T15:58:02.139 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-01T15:58:02.139 DEBUG:teuthology.orchestra.run.smithi073:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-01T15:58:02.183 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-01T15:58:02.183 DEBUG:teuthology.orchestra.run.smithi099:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-01T15:58:02.462 INFO:teuthology.provision.fog.smithi073:Node is ready 2024-04-01T15:58:02.462 DEBUG:teuthology.orchestra.run.smithi073:> hostname 2024-04-01T15:58:02.476 INFO:teuthology.orchestra.run.smithi073.stdout:smithi073.front.sepia.ceph.com 2024-04-01T15:58:02.477 DEBUG:teuthology.orchestra.run.smithi073:> grep smithi073.front.sepia.ceph.com /etc/hosts 2024-04-01T15:58:02.531 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73 smithi073.front.sepia.ceph.com smithi073 2024-04-01T15:58:02.532 DEBUG:teuthology.orchestra.run.smithi073:> sudo hostname smithi073 2024-04-01T15:58:02.535 INFO:teuthology.provision.fog.smithi099:Node is ready 2024-04-01T15:58:02.535 DEBUG:teuthology.orchestra.run.smithi099:> hostname 2024-04-01T15:58:02.550 INFO:teuthology.orchestra.run.smithi099.stdout:smithi099.front.sepia.ceph.com 2024-04-01T15:58:02.550 DEBUG:teuthology.orchestra.run.smithi099:> grep smithi099.front.sepia.ceph.com /etc/hosts 2024-04-01T15:58:02.605 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99 smithi099.front.sepia.ceph.com smithi099 2024-04-01T15:58:02.606 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099 2024-04-01T15:58:02.660 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i -e 's/smithi073.front.sepia.ceph.com/smithi073/g' /etc/hosts 2024-04-01T15:58:02.688 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i -e 's/172.21.15.73/172.21.15.73/g' /etc/hosts 2024-04-01T15:58:02.711 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hosts 2024-04-01T15:58:02.739 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/172.21.15.99/172.21.15.99/g' /etc/hosts 2024-04-01T15:58:02.754 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i -e 's/smithi073.front.sepia.ceph.com/smithi073/g' /etc/hostname 2024-04-01T15:58:02.806 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hostname 2024-04-01T15:58:02.821 DEBUG:teuthology.orchestra.run.smithi073:> sudo hostname smithi073 2024-04-01T15:58:02.873 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099 2024-04-01T15:58:02.887 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release 2024-04-01T15:58:02.939 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2024-04-01T15:58:02.941 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="CentOS Stream" 2024-04-01T15:58:02.942 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="9" 2024-04-01T15:58:02.942 INFO:teuthology.orchestra.run.smithi073.stdout:ID="centos" 2024-04-01T15:58:02.942 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="rhel fedora" 2024-04-01T15:58:02.942 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="9" 2024-04-01T15:58:02.942 INFO:teuthology.orchestra.run.smithi073.stdout:PLATFORM_ID="platform:el9" 2024-04-01T15:58:02.942 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-01T15:58:02.942 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31" 2024-04-01T15:58:02.942 INFO:teuthology.orchestra.run.smithi073.stdout:LOGO="fedora-logo-icon" 2024-04-01T15:58:02.942 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-01T15:58:02.942 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://centos.org/" 2024-04-01T15:58:02.942 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-01T15:58:02.942 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-01T15:58:02.942 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-01T15:58:02.943 INFO:teuthology.provision.fog.smithi073:Deploy complete! 2024-04-01T15:58:02.944 DEBUG:teuthology.parallel:result is None 2024-04-01T15:58:02.993 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="CentOS Stream" 2024-04-01T15:58:02.993 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="9" 2024-04-01T15:58:02.994 INFO:teuthology.orchestra.run.smithi099.stdout:ID="centos" 2024-04-01T15:58:02.994 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="rhel fedora" 2024-04-01T15:58:02.994 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="9" 2024-04-01T15:58:02.994 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el9" 2024-04-01T15:58:02.994 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-01T15:58:02.994 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31" 2024-04-01T15:58:02.994 INFO:teuthology.orchestra.run.smithi099.stdout:LOGO="fedora-logo-icon" 2024-04-01T15:58:02.994 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-01T15:58:02.994 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://centos.org/" 2024-04-01T15:58:02.994 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-01T15:58:02.994 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-01T15:58:02.994 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-01T15:58:02.995 INFO:teuthology.provision.fog.smithi099:Deploy complete! 2024-04-01T15:58:02.995 DEBUG:teuthology.parallel:result is None 2024-04-01T15:58:06.715 WARNING:teuthology.provision.fog.smithi162:timed out 2024-04-01T15:58:12.722 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T15:58:12.993 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-01T15:58:12.993 DEBUG:teuthology.orchestra.run.smithi162:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-01T15:58:13.302 INFO:teuthology.provision.fog.smithi162:Node is ready 2024-04-01T15:58:13.302 DEBUG:teuthology.orchestra.run.smithi162:> hostname 2024-04-01T15:58:13.317 INFO:teuthology.orchestra.run.smithi162.stdout:smithi162.front.sepia.ceph.com 2024-04-01T15:58:13.317 DEBUG:teuthology.orchestra.run.smithi162:> grep smithi162.front.sepia.ceph.com /etc/hosts 2024-04-01T15:58:13.372 INFO:teuthology.orchestra.run.smithi162.stdout:172.21.15.162 smithi162.front.sepia.ceph.com smithi162 2024-04-01T15:58:13.372 DEBUG:teuthology.orchestra.run.smithi162:> sudo hostname smithi162 2024-04-01T15:58:13.477 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i -e 's/smithi162.front.sepia.ceph.com/smithi162/g' /etc/hosts 2024-04-01T15:58:13.505 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i -e 's/172.21.15.162/172.21.15.162/g' /etc/hosts 2024-04-01T15:58:13.571 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i -e 's/smithi162.front.sepia.ceph.com/smithi162/g' /etc/hostname 2024-04-01T15:58:13.638 DEBUG:teuthology.orchestra.run.smithi162:> sudo hostname smithi162 2024-04-01T15:58:13.704 DEBUG:teuthology.orchestra.run.smithi162:> cat /etc/os-release 2024-04-01T15:58:13.759 INFO:teuthology.orchestra.run.smithi162.stdout:NAME="CentOS Stream" 2024-04-01T15:58:13.759 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION="9" 2024-04-01T15:58:13.759 INFO:teuthology.orchestra.run.smithi162.stdout:ID="centos" 2024-04-01T15:58:13.759 INFO:teuthology.orchestra.run.smithi162.stdout:ID_LIKE="rhel fedora" 2024-04-01T15:58:13.759 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_ID="9" 2024-04-01T15:58:13.759 INFO:teuthology.orchestra.run.smithi162.stdout:PLATFORM_ID="platform:el9" 2024-04-01T15:58:13.759 INFO:teuthology.orchestra.run.smithi162.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-01T15:58:13.759 INFO:teuthology.orchestra.run.smithi162.stdout:ANSI_COLOR="0;31" 2024-04-01T15:58:13.760 INFO:teuthology.orchestra.run.smithi162.stdout:LOGO="fedora-logo-icon" 2024-04-01T15:58:13.760 INFO:teuthology.orchestra.run.smithi162.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-01T15:58:13.760 INFO:teuthology.orchestra.run.smithi162.stdout:HOME_URL="https://centos.org/" 2024-04-01T15:58:13.760 INFO:teuthology.orchestra.run.smithi162.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-01T15:58:13.760 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-01T15:58:13.760 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-01T15:58:13.760 INFO:teuthology.provision.fog.smithi162:Deploy complete! 2024-04-01T15:58:13.761 DEBUG:teuthology.parallel:result is None 2024-04-01T15:58:13.970 INFO:teuthology.lock.ops:Checking smithi073.front.sepia.ceph.com 2024-04-01T15:58:13.970 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-01T15:58:14.000 INFO:teuthology.lock.ops:Checking smithi099.front.sepia.ceph.com 2024-04-01T15:58:14.000 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-01T15:58:14.024 INFO:teuthology.lock.ops:Checking smithi162.front.sepia.ceph.com 2024-04-01T15:58:14.025 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-01T15:58:14.042 INFO:teuthology.lock.ops:Updating [smithi073.front.sepia.ceph.com]: set os type and version on server 2024-04-01T15:58:14.043 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-04-01T15:58:14.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T15:58:14.135 DEBUG:teuthology.orchestra.run.smithi073:> true 2024-04-01T15:58:14.300 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-04-01T15:58:14.301 DEBUG:teuthology.orchestra.run.smithi073:> uname -m 2024-04-01T15:58:14.355 INFO:teuthology.orchestra.run.smithi073.stdout:x86_64 2024-04-01T15:58:14.355 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release 2024-04-01T15:58:14.410 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="CentOS Stream" 2024-04-01T15:58:14.410 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="9" 2024-04-01T15:58:14.410 INFO:teuthology.orchestra.run.smithi073.stdout:ID="centos" 2024-04-01T15:58:14.411 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="rhel fedora" 2024-04-01T15:58:14.411 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="9" 2024-04-01T15:58:14.411 INFO:teuthology.orchestra.run.smithi073.stdout:PLATFORM_ID="platform:el9" 2024-04-01T15:58:14.411 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-01T15:58:14.411 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31" 2024-04-01T15:58:14.411 INFO:teuthology.orchestra.run.smithi073.stdout:LOGO="fedora-logo-icon" 2024-04-01T15:58:14.411 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-01T15:58:14.411 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://centos.org/" 2024-04-01T15:58:14.411 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-01T15:58:14.411 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-01T15:58:14.411 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-01T15:58:14.412 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2024-04-01T15:58:14.433 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: set os type and version on server 2024-04-01T15:58:14.433 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-04-01T15:58:14.434 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T15:58:14.520 DEBUG:teuthology.orchestra.run.smithi099:> true 2024-04-01T15:58:14.684 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-04-01T15:58:14.684 DEBUG:teuthology.orchestra.run.smithi099:> uname -m 2024-04-01T15:58:14.739 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64 2024-04-01T15:58:14.739 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2024-04-01T15:58:14.794 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="CentOS Stream" 2024-04-01T15:58:14.794 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="9" 2024-04-01T15:58:14.794 INFO:teuthology.orchestra.run.smithi099.stdout:ID="centos" 2024-04-01T15:58:14.794 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="rhel fedora" 2024-04-01T15:58:14.794 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="9" 2024-04-01T15:58:14.794 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el9" 2024-04-01T15:58:14.794 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-01T15:58:14.794 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31" 2024-04-01T15:58:14.794 INFO:teuthology.orchestra.run.smithi099.stdout:LOGO="fedora-logo-icon" 2024-04-01T15:58:14.794 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-01T15:58:14.794 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://centos.org/" 2024-04-01T15:58:14.795 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-01T15:58:14.795 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-01T15:58:14.795 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-01T15:58:14.795 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2024-04-01T15:58:14.817 INFO:teuthology.lock.ops:Updating [smithi162.front.sepia.ceph.com]: set os type and version on server 2024-04-01T15:58:14.817 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-04-01T15:58:14.817 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T15:58:14.906 DEBUG:teuthology.orchestra.run.smithi162:> true 2024-04-01T15:58:14.973 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-04-01T15:58:14.974 DEBUG:teuthology.orchestra.run.smithi162:> uname -m 2024-04-01T15:58:15.030 INFO:teuthology.orchestra.run.smithi162.stdout:x86_64 2024-04-01T15:58:15.030 DEBUG:teuthology.orchestra.run.smithi162:> cat /etc/os-release 2024-04-01T15:58:15.086 INFO:teuthology.orchestra.run.smithi162.stdout:NAME="CentOS Stream" 2024-04-01T15:58:15.086 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION="9" 2024-04-01T15:58:15.087 INFO:teuthology.orchestra.run.smithi162.stdout:ID="centos" 2024-04-01T15:58:15.087 INFO:teuthology.orchestra.run.smithi162.stdout:ID_LIKE="rhel fedora" 2024-04-01T15:58:15.087 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_ID="9" 2024-04-01T15:58:15.087 INFO:teuthology.orchestra.run.smithi162.stdout:PLATFORM_ID="platform:el9" 2024-04-01T15:58:15.087 INFO:teuthology.orchestra.run.smithi162.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-01T15:58:15.087 INFO:teuthology.orchestra.run.smithi162.stdout:ANSI_COLOR="0;31" 2024-04-01T15:58:15.087 INFO:teuthology.orchestra.run.smithi162.stdout:LOGO="fedora-logo-icon" 2024-04-01T15:58:15.087 INFO:teuthology.orchestra.run.smithi162.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-01T15:58:15.087 INFO:teuthology.orchestra.run.smithi162.stdout:HOME_URL="https://centos.org/" 2024-04-01T15:58:15.087 INFO:teuthology.orchestra.run.smithi162.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-01T15:58:15.087 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-01T15:58:15.088 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-01T15:58:15.088 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server 2024-04-01T15:58:15.108 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T15:58:15.211 INFO:teuthology.dispatcher.supervisor:Running job 7633950 2024-04-01T15:58:15.211 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-04-01_14:09:42-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7633950 --name vshankar-2024-04-01_14:09:42-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-workunit/suites/iogen}} -- /home/teuthworker/archive/vshankar-2024-04-01_14:09:42-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7633950/orig.config.yaml 2024-04-01T15:58:15.214 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-04-01_14:09:42-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7633950 2024-04-01T15:58:15.214 INFO:teuthology.dispatcher.supervisor:Job PID: 3273696 2024-04-01T15:58:15.214 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-01T16:00:15.315 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T16:02:15.502 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T16:04:15.675 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T16:06:15.848 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T16:08:16.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T16:10:16.184 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T16:12:16.355 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T16:14:16.523 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T16:16:16.703 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T16:16:16.777 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1