2024-03-01T19:35:18.006 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-03-01T19:35:18.007 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-01T19:35:18.193 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe17b6c6c10>, signals=[15]) 2024-03-01T19:35:18.194 INFO:teuthology.lock.ops:Start node 'smithi080.front.sepia.ceph.com' reimaging 2024-03-01T19:35:18.194 INFO:teuthology.lock.ops:Updating [smithi080.front.sepia.ceph.com]: reset os type and version on server 2024-03-01T19:35:18.194 INFO:teuthology.lock.ops:Updating smithi080.front.sepia.ceph.com on lock server 2024-03-01T19:35:18.211 INFO:teuthology.lock.ops:Start node 'smithi148.front.sepia.ceph.com' reimaging 2024-03-01T19:35:18.212 INFO:teuthology.lock.ops:Updating [smithi148.front.sepia.ceph.com]: reset os type and version on server 2024-03-01T19:35:18.212 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server 2024-03-01T19:35:18.227 INFO:teuthology.lock.ops:Start node 'smithi195.front.sepia.ceph.com' reimaging 2024-03-01T19:35:18.228 INFO:teuthology.lock.ops:Updating [smithi195.front.sepia.ceph.com]: reset os type and version on server 2024-03-01T19:35:18.228 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2024-03-01T19:35:18.318 DEBUG:teuthology.provision.fog.smithi080:Requesting image smithi_centos_9.stream (ID 10) 2024-03-01T19:35:18.329 DEBUG:teuthology.provision.fog.smithi148:Requesting image smithi_centos_9.stream (ID 10) 2024-03-01T19:35:18.345 DEBUG:teuthology.provision.fog.smithi195:Requesting image smithi_centos_9.stream (ID 10) 2024-03-01T19:35:18.363 INFO:teuthology.provision.fog.smithi080:Scheduling deploy of centos 9.stream 2024-03-01T19:35:18.369 INFO:teuthology.provision.fog.smithi148:Scheduling deploy of centos 9.stream 2024-03-01T19:35:18.391 INFO:teuthology.provision.fog.smithi195:Scheduling deploy of centos 9.stream 2024-03-01T19:35:18.632 INFO:teuthology.orchestra.console.smithi080:Power off 2024-03-01T19:35:18.632 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-01T19:35:18.650 INFO:teuthology.orchestra.console.smithi148:Power off 2024-03-01T19:35:18.651 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-01T19:35:18.665 DEBUG:teuthology.orchestra.console.smithi080:power off output: Chassis Power Control: Down/Off 2024-03-01T19:35:18.665 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-01T19:35:18.673 DEBUG:teuthology.orchestra.console.smithi148:power off output: Chassis Power Control: Down/Off 2024-03-01T19:35:18.674 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-01T19:35:18.685 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is off 2024-03-01T19:35:18.699 INFO:teuthology.orchestra.console.smithi195:Power off 2024-03-01T19:35:18.699 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-01T19:35:18.705 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2024-03-01T19:35:18.719 DEBUG:teuthology.orchestra.console.smithi195:power off output: Chassis Power Control: Down/Off 2024-03-01T19:35:18.719 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-01T19:35:18.741 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2024-03-01T19:35:18.787 INFO:teuthology.orchestra.console.smithi080:Power off completed 2024-03-01T19:35:18.806 INFO:teuthology.orchestra.console.smithi148:Power off completed 2024-03-01T19:35:18.842 INFO:teuthology.orchestra.console.smithi195:Power off completed 2024-03-01T19:35:18.888 INFO:teuthology.orchestra.console.smithi080:Power on 2024-03-01T19:35:18.888 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-01T19:35:18.907 INFO:teuthology.orchestra.console.smithi148:Power on 2024-03-01T19:35:18.908 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-01T19:35:18.913 DEBUG:teuthology.orchestra.console.smithi080:power on output: Chassis Power Control: Up/On 2024-03-01T19:35:18.914 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-01T19:35:18.927 DEBUG:teuthology.orchestra.console.smithi148:power on output: Chassis Power Control: Up/On 2024-03-01T19:35:18.927 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-01T19:35:18.935 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is off 2024-03-01T19:35:18.943 INFO:teuthology.orchestra.console.smithi195:Power on 2024-03-01T19:35:18.943 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-01T19:35:18.952 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2024-03-01T19:35:18.966 DEBUG:teuthology.orchestra.console.smithi195:power on output: Chassis Power Control: Up/On 2024-03-01T19:35:18.967 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-01T19:35:18.987 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2024-03-01T19:35:22.940 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-01T19:35:22.953 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-01T19:35:22.988 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-01T19:35:23.050 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is on 2024-03-01T19:35:23.062 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on 2024-03-01T19:35:23.098 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2024-03-01T19:35:23.151 INFO:teuthology.orchestra.console.smithi080:Power on completed 2024-03-01T19:35:23.162 INFO:teuthology.orchestra.console.smithi148:Power on completed 2024-03-01T19:35:23.252 INFO:teuthology.provision.fog.smithi080:Waiting for deploy to finish 2024-03-01T19:35:23.264 INFO:teuthology.provision.fog.smithi148:Waiting for deploy to finish 2024-03-01T19:35:27.102 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-01T19:35:27.212 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2024-03-01T19:35:27.313 INFO:teuthology.orchestra.console.smithi195:Power on completed 2024-03-01T19:35:27.413 INFO:teuthology.provision.fog.smithi195:Waiting for deploy to finish 2024-03-01T19:37:58.429 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-01T19:38:01.500 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2024-03-01T19:38:07.503 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-01T19:38:09.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-01T19:38:09.475 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-01T19:38:10.556 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2024-03-01T19:38:12.540 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-03-01T19:38:12.540 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80 2024-03-01T19:38:16.560 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-01T19:38:18.543 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-01T19:38:18.545 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-01T19:38:19.616 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2024-03-01T19:38:21.596 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-03-01T19:38:21.596 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80 2024-03-01T19:38:25.618 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-01T19:38:27.600 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-01T19:38:27.601 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-01T19:38:28.704 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2024-03-01T19:38:30.656 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-03-01T19:38:30.656 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80 2024-03-01T19:38:34.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-01T19:38:36.659 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-01T19:38:36.661 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-01T19:38:37.788 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2024-03-01T19:38:39.740 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-03-01T19:38:39.740 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80 2024-03-01T19:38:43.792 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-01T19:38:45.742 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-01T19:38:45.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-01T19:38:46.844 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2024-03-01T19:38:48.796 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-03-01T19:38:48.796 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80 2024-03-01T19:38:52.848 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-01T19:38:54.799 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-01T19:38:54.801 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-01T19:38:57.852 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80 2024-03-01T19:38:57.853 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-03-01T19:39:03.856 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-01T19:39:03.859 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-01T19:39:11.292 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2024-03-01T19:39:17.296 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-01T19:39:20.348 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2024-03-01T19:39:22.300 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80 2024-03-01T19:39:26.352 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-01T19:39:28.303 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-01T19:39:29.404 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2024-03-01T19:39:31.356 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80 2024-03-01T19:39:35.408 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-01T19:39:35.658 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-01T19:39:35.659 DEBUG:teuthology.orchestra.run.smithi195:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-01T19:39:37.359 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-01T19:39:40.416 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80 2024-03-01T19:39:46.418 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-01T19:39:46.766 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-01T19:39:46.767 DEBUG:teuthology.orchestra.run.smithi080:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-01T19:39:51.060 INFO:teuthology.provision.fog.smithi195:Node is ready 2024-03-01T19:39:51.061 DEBUG:teuthology.orchestra.run.smithi195:> hostname 2024-03-01T19:39:51.078 INFO:teuthology.orchestra.run.smithi195.stdout:smithi195.front.sepia.ceph.com 2024-03-01T19:39:51.078 DEBUG:teuthology.orchestra.run.smithi195:> grep smithi195.front.sepia.ceph.com /etc/hosts 2024-03-01T19:39:51.136 INFO:teuthology.orchestra.run.smithi195.stdout:172.21.15.195 smithi195.front.sepia.ceph.com smithi195 2024-03-01T19:39:51.136 DEBUG:teuthology.orchestra.run.smithi195:> sudo hostname smithi195 2024-03-01T19:39:51.231 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/smithi195.front.sepia.ceph.com/smithi195/g' /etc/hosts 2024-03-01T19:39:51.263 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/172.21.15.195/172.21.15.195/g' /etc/hosts 2024-03-01T19:39:51.332 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/smithi195.front.sepia.ceph.com/smithi195/g' /etc/hostname 2024-03-01T19:39:51.402 DEBUG:teuthology.orchestra.run.smithi195:> sudo hostname smithi195 2024-03-01T19:39:51.470 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2024-03-01T19:39:51.526 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="CentOS Stream" 2024-03-01T19:39:51.526 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="9" 2024-03-01T19:39:51.526 INFO:teuthology.orchestra.run.smithi195.stdout:ID="centos" 2024-03-01T19:39:51.526 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE="rhel fedora" 2024-03-01T19:39:51.526 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="9" 2024-03-01T19:39:51.526 INFO:teuthology.orchestra.run.smithi195.stdout:PLATFORM_ID="platform:el9" 2024-03-01T19:39:51.526 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-01T19:39:51.526 INFO:teuthology.orchestra.run.smithi195.stdout:ANSI_COLOR="0;31" 2024-03-01T19:39:51.526 INFO:teuthology.orchestra.run.smithi195.stdout:LOGO="fedora-logo-icon" 2024-03-01T19:39:51.526 INFO:teuthology.orchestra.run.smithi195.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-01T19:39:51.527 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://centos.org/" 2024-03-01T19:39:51.527 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-01T19:39:51.527 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-01T19:39:51.527 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-01T19:39:51.527 INFO:teuthology.provision.fog.smithi195:Deploy complete! 2024-03-01T19:39:51.529 DEBUG:teuthology.parallel:result is None 2024-03-01T19:40:02.239 INFO:teuthology.provision.fog.smithi080:Node is ready 2024-03-01T19:40:02.239 DEBUG:teuthology.orchestra.run.smithi080:> hostname 2024-03-01T19:40:02.297 INFO:teuthology.orchestra.run.smithi080.stdout:smithi080.front.sepia.ceph.com 2024-03-01T19:40:02.298 DEBUG:teuthology.orchestra.run.smithi080:> grep smithi080.front.sepia.ceph.com /etc/hosts 2024-03-01T19:40:02.355 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80 smithi080.front.sepia.ceph.com smithi080 2024-03-01T19:40:02.355 DEBUG:teuthology.orchestra.run.smithi080:> sudo hostname smithi080 2024-03-01T19:40:02.503 DEBUG:teuthology.orchestra.run.smithi080:> sudo sed -i -e 's/smithi080.front.sepia.ceph.com/smithi080/g' /etc/hosts 2024-03-01T19:40:02.533 DEBUG:teuthology.orchestra.run.smithi080:> sudo sed -i -e 's/172.21.15.80/172.21.15.80/g' /etc/hosts 2024-03-01T19:40:02.604 DEBUG:teuthology.orchestra.run.smithi080:> sudo sed -i -e 's/smithi080.front.sepia.ceph.com/smithi080/g' /etc/hostname 2024-03-01T19:40:02.674 DEBUG:teuthology.orchestra.run.smithi080:> sudo hostname smithi080 2024-03-01T19:40:02.742 DEBUG:teuthology.orchestra.run.smithi080:> cat /etc/os-release 2024-03-01T19:40:02.798 INFO:teuthology.orchestra.run.smithi080.stdout:NAME="CentOS Stream" 2024-03-01T19:40:02.798 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION="9" 2024-03-01T19:40:02.798 INFO:teuthology.orchestra.run.smithi080.stdout:ID="centos" 2024-03-01T19:40:02.798 INFO:teuthology.orchestra.run.smithi080.stdout:ID_LIKE="rhel fedora" 2024-03-01T19:40:02.798 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION_ID="9" 2024-03-01T19:40:02.798 INFO:teuthology.orchestra.run.smithi080.stdout:PLATFORM_ID="platform:el9" 2024-03-01T19:40:02.798 INFO:teuthology.orchestra.run.smithi080.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-01T19:40:02.798 INFO:teuthology.orchestra.run.smithi080.stdout:ANSI_COLOR="0;31" 2024-03-01T19:40:02.798 INFO:teuthology.orchestra.run.smithi080.stdout:LOGO="fedora-logo-icon" 2024-03-01T19:40:02.798 INFO:teuthology.orchestra.run.smithi080.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-01T19:40:02.799 INFO:teuthology.orchestra.run.smithi080.stdout:HOME_URL="https://centos.org/" 2024-03-01T19:40:02.799 INFO:teuthology.orchestra.run.smithi080.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-01T19:40:02.799 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-01T19:40:02.799 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-01T19:40:02.799 INFO:teuthology.provision.fog.smithi080:Deploy complete! 2024-03-01T19:40:02.799 DEBUG:teuthology.parallel:result is None 2024-03-01T19:40:03.860 WARNING:teuthology.provision.fog.smithi148:timed out 2024-03-01T19:40:09.862 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-01T19:40:10.175 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-01T19:40:10.175 DEBUG:teuthology.orchestra.run.smithi148:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-01T19:40:10.528 INFO:teuthology.provision.fog.smithi148:Node is ready 2024-03-01T19:40:10.529 DEBUG:teuthology.orchestra.run.smithi148:> hostname 2024-03-01T19:40:10.542 INFO:teuthology.orchestra.run.smithi148.stdout:smithi148.front.sepia.ceph.com 2024-03-01T19:40:10.543 DEBUG:teuthology.orchestra.run.smithi148:> grep smithi148.front.sepia.ceph.com /etc/hosts 2024-03-01T19:40:10.597 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148 smithi148.front.sepia.ceph.com smithi148 2024-03-01T19:40:10.598 DEBUG:teuthology.orchestra.run.smithi148:> sudo hostname smithi148 2024-03-01T19:40:10.689 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/smithi148.front.sepia.ceph.com/smithi148/g' /etc/hosts 2024-03-01T19:40:10.716 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/172.21.15.148/172.21.15.148/g' /etc/hosts 2024-03-01T19:40:10.784 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/smithi148.front.sepia.ceph.com/smithi148/g' /etc/hostname 2024-03-01T19:40:10.851 DEBUG:teuthology.orchestra.run.smithi148:> sudo hostname smithi148 2024-03-01T19:40:10.918 DEBUG:teuthology.orchestra.run.smithi148:> cat /etc/os-release 2024-03-01T19:40:10.972 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="CentOS Stream" 2024-03-01T19:40:10.972 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="9" 2024-03-01T19:40:10.972 INFO:teuthology.orchestra.run.smithi148.stdout:ID="centos" 2024-03-01T19:40:10.972 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE="rhel fedora" 2024-03-01T19:40:10.972 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="9" 2024-03-01T19:40:10.972 INFO:teuthology.orchestra.run.smithi148.stdout:PLATFORM_ID="platform:el9" 2024-03-01T19:40:10.972 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-01T19:40:10.972 INFO:teuthology.orchestra.run.smithi148.stdout:ANSI_COLOR="0;31" 2024-03-01T19:40:10.973 INFO:teuthology.orchestra.run.smithi148.stdout:LOGO="fedora-logo-icon" 2024-03-01T19:40:10.973 INFO:teuthology.orchestra.run.smithi148.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-01T19:40:10.973 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://centos.org/" 2024-03-01T19:40:10.973 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-01T19:40:10.973 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-01T19:40:10.973 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-01T19:40:10.973 INFO:teuthology.provision.fog.smithi148:Deploy complete! 2024-03-01T19:40:10.974 DEBUG:teuthology.parallel:result is None 2024-03-01T19:40:11.182 INFO:teuthology.lock.ops:Checking smithi080.front.sepia.ceph.com 2024-03-01T19:40:11.183 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-01T19:40:11.203 INFO:teuthology.lock.ops:Checking smithi148.front.sepia.ceph.com 2024-03-01T19:40:11.203 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-01T19:40:11.219 INFO:teuthology.lock.ops:Checking smithi195.front.sepia.ceph.com 2024-03-01T19:40:11.219 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-01T19:40:11.237 INFO:teuthology.lock.ops:Updating [smithi080.front.sepia.ceph.com]: set os type and version on server 2024-03-01T19:40:11.237 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-03-01T19:40:11.237 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-01T19:40:11.329 DEBUG:teuthology.orchestra.run.smithi080:> true 2024-03-01T19:40:11.400 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-03-01T19:40:11.400 DEBUG:teuthology.orchestra.run.smithi080:> uname -m 2024-03-01T19:40:11.456 INFO:teuthology.orchestra.run.smithi080.stdout:x86_64 2024-03-01T19:40:11.456 DEBUG:teuthology.orchestra.run.smithi080:> cat /etc/os-release 2024-03-01T19:40:11.513 INFO:teuthology.orchestra.run.smithi080.stdout:NAME="CentOS Stream" 2024-03-01T19:40:11.513 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION="9" 2024-03-01T19:40:11.513 INFO:teuthology.orchestra.run.smithi080.stdout:ID="centos" 2024-03-01T19:40:11.513 INFO:teuthology.orchestra.run.smithi080.stdout:ID_LIKE="rhel fedora" 2024-03-01T19:40:11.513 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION_ID="9" 2024-03-01T19:40:11.513 INFO:teuthology.orchestra.run.smithi080.stdout:PLATFORM_ID="platform:el9" 2024-03-01T19:40:11.513 INFO:teuthology.orchestra.run.smithi080.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-01T19:40:11.513 INFO:teuthology.orchestra.run.smithi080.stdout:ANSI_COLOR="0;31" 2024-03-01T19:40:11.513 INFO:teuthology.orchestra.run.smithi080.stdout:LOGO="fedora-logo-icon" 2024-03-01T19:40:11.513 INFO:teuthology.orchestra.run.smithi080.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-01T19:40:11.513 INFO:teuthology.orchestra.run.smithi080.stdout:HOME_URL="https://centos.org/" 2024-03-01T19:40:11.514 INFO:teuthology.orchestra.run.smithi080.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-01T19:40:11.514 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-01T19:40:11.514 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-01T19:40:11.514 INFO:teuthology.lock.ops:Updating smithi080.front.sepia.ceph.com on lock server 2024-03-01T19:40:11.536 INFO:teuthology.lock.ops:Updating [smithi148.front.sepia.ceph.com]: set os type and version on server 2024-03-01T19:40:11.536 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-03-01T19:40:11.536 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-01T19:40:11.623 DEBUG:teuthology.orchestra.run.smithi148:> true 2024-03-01T19:40:11.694 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-03-01T19:40:11.694 DEBUG:teuthology.orchestra.run.smithi148:> uname -m 2024-03-01T19:40:11.748 INFO:teuthology.orchestra.run.smithi148.stdout:x86_64 2024-03-01T19:40:11.748 DEBUG:teuthology.orchestra.run.smithi148:> cat /etc/os-release 2024-03-01T19:40:11.802 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="CentOS Stream" 2024-03-01T19:40:11.802 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="9" 2024-03-01T19:40:11.802 INFO:teuthology.orchestra.run.smithi148.stdout:ID="centos" 2024-03-01T19:40:11.802 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE="rhel fedora" 2024-03-01T19:40:11.802 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="9" 2024-03-01T19:40:11.802 INFO:teuthology.orchestra.run.smithi148.stdout:PLATFORM_ID="platform:el9" 2024-03-01T19:40:11.802 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-01T19:40:11.802 INFO:teuthology.orchestra.run.smithi148.stdout:ANSI_COLOR="0;31" 2024-03-01T19:40:11.802 INFO:teuthology.orchestra.run.smithi148.stdout:LOGO="fedora-logo-icon" 2024-03-01T19:40:11.802 INFO:teuthology.orchestra.run.smithi148.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-01T19:40:11.802 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://centos.org/" 2024-03-01T19:40:11.803 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-01T19:40:11.803 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-01T19:40:11.803 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-01T19:40:11.803 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server 2024-03-01T19:40:11.827 INFO:teuthology.lock.ops:Updating [smithi195.front.sepia.ceph.com]: set os type and version on server 2024-03-01T19:40:11.828 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-03-01T19:40:11.828 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-01T19:40:11.925 DEBUG:teuthology.orchestra.run.smithi195:> true 2024-03-01T19:40:12.099 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-03-01T19:40:12.099 DEBUG:teuthology.orchestra.run.smithi195:> uname -m 2024-03-01T19:40:12.154 INFO:teuthology.orchestra.run.smithi195.stdout:x86_64 2024-03-01T19:40:12.154 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2024-03-01T19:40:12.210 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="CentOS Stream" 2024-03-01T19:40:12.210 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="9" 2024-03-01T19:40:12.210 INFO:teuthology.orchestra.run.smithi195.stdout:ID="centos" 2024-03-01T19:40:12.210 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE="rhel fedora" 2024-03-01T19:40:12.210 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="9" 2024-03-01T19:40:12.210 INFO:teuthology.orchestra.run.smithi195.stdout:PLATFORM_ID="platform:el9" 2024-03-01T19:40:12.210 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-01T19:40:12.210 INFO:teuthology.orchestra.run.smithi195.stdout:ANSI_COLOR="0;31" 2024-03-01T19:40:12.210 INFO:teuthology.orchestra.run.smithi195.stdout:LOGO="fedora-logo-icon" 2024-03-01T19:40:12.211 INFO:teuthology.orchestra.run.smithi195.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-01T19:40:12.211 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://centos.org/" 2024-03-01T19:40:12.211 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-01T19:40:12.211 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-01T19:40:12.211 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-01T19:40:12.212 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2024-03-01T19:40:12.235 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-01T19:40:12.336 INFO:teuthology.dispatcher.supervisor:Running job 7577764 2024-03-01T19:40:12.336 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2024-03-01_17:28:49-fs-main-2024feb28-testing-default-smithi/7577764 --name rishabh-2024-03-01_17:28:49-fs-main-2024feb28-testing-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-workunit/suites/fsync-tester}} -- /home/teuthworker/archive/rishabh-2024-03-01_17:28:49-fs-main-2024feb28-testing-default-smithi/7577764/orig.config.yaml 2024-03-01T19:40:12.339 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2024-03-01_17:28:49-fs-main-2024feb28-testing-default-smithi/7577764 2024-03-01T19:40:12.339 INFO:teuthology.dispatcher.supervisor:Job PID: 2787292 2024-03-01T19:40:12.339 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-03-01T19:42:12.441 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-01T19:44:12.612 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-01T19:46:12.781 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-01T19:48:12.952 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-01T19:50:13.113 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-01T19:52:13.283 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-01T19:54:13.447 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-01T19:56:13.612 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-01T19:58:13.776 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-01T20:00:13.948 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-01T20:02:14.123 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-01T20:04:14.288 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-01T20:06:14.460 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-01T20:08:14.634 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-01T20:10:14.812 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-01T20:12:15.026 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-01T20:14:15.188 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-01T20:14:15.259 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1