2024-04-17T05:29:00.905 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-17T05:29:00.906 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T05:29:01.072 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8e27f48c10>, signals=[15]) 2024-04-17T05:29:01.073 INFO:teuthology.lock.ops:Start node 'smithi052.front.sepia.ceph.com' reimaging 2024-04-17T05:29:01.073 INFO:teuthology.lock.ops:Updating [smithi052.front.sepia.ceph.com]: reset os type and version on server 2024-04-17T05:29:01.073 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server 2024-04-17T05:29:01.118 INFO:teuthology.lock.ops:Start node 'smithi133.front.sepia.ceph.com' reimaging 2024-04-17T05:29:01.118 INFO:teuthology.lock.ops:Updating [smithi133.front.sepia.ceph.com]: reset os type and version on server 2024-04-17T05:29:01.119 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2024-04-17T05:29:01.143 INFO:teuthology.lock.ops:Start node 'smithi175.front.sepia.ceph.com' reimaging 2024-04-17T05:29:01.143 INFO:teuthology.lock.ops:Updating [smithi175.front.sepia.ceph.com]: reset os type and version on server 2024-04-17T05:29:01.143 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server 2024-04-17T05:29:01.229 DEBUG:teuthology.provision.fog.smithi052:Requesting image smithi_centos_9.stream (ID 10) 2024-04-17T05:29:01.255 DEBUG:teuthology.provision.fog.smithi133:Requesting image smithi_centos_9.stream (ID 10) 2024-04-17T05:29:01.276 DEBUG:teuthology.provision.fog.smithi175:Requesting image smithi_centos_9.stream (ID 10) 2024-04-17T05:29:01.279 INFO:teuthology.provision.fog.smithi052:Scheduling deploy of centos 9.stream 2024-04-17T05:29:01.299 INFO:teuthology.provision.fog.smithi133:Scheduling deploy of centos 9.stream 2024-04-17T05:29:01.326 INFO:teuthology.provision.fog.smithi175:Scheduling deploy of centos 9.stream 2024-04-17T05:29:01.472 INFO:teuthology.orchestra.console.smithi052:Power off 2024-04-17T05:29:01.472 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-17T05:29:01.486 INFO:teuthology.orchestra.console.smithi133:Power off 2024-04-17T05:29:01.486 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-17T05:29:01.500 DEBUG:teuthology.orchestra.console.smithi052:power off output: Chassis Power Control: Down/Off 2024-04-17T05:29:01.500 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T05:29:01.510 DEBUG:teuthology.orchestra.console.smithi133:power off output: Chassis Power Control: Down/Off 2024-04-17T05:29:01.510 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T05:29:01.523 INFO:teuthology.orchestra.console.smithi175:Power off 2024-04-17T05:29:01.523 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-17T05:29:01.531 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is on 2024-04-17T05:29:01.533 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2024-04-17T05:29:01.545 DEBUG:teuthology.orchestra.console.smithi175:power off output: Chassis Power Control: Down/Off 2024-04-17T05:29:01.545 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T05:29:01.567 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on 2024-04-17T05:29:05.534 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T05:29:05.544 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T05:29:05.568 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T05:29:05.646 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is on 2024-04-17T05:29:05.653 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2024-04-17T05:29:05.677 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on 2024-04-17T05:29:09.649 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T05:29:09.657 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T05:29:09.678 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T05:29:09.759 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is off 2024-04-17T05:29:09.766 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2024-04-17T05:29:09.787 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off 2024-04-17T05:29:09.860 INFO:teuthology.orchestra.console.smithi052:Power off completed 2024-04-17T05:29:09.867 INFO:teuthology.orchestra.console.smithi133:Power off completed 2024-04-17T05:29:09.888 INFO:teuthology.orchestra.console.smithi175:Power off completed 2024-04-17T05:29:09.962 INFO:teuthology.orchestra.console.smithi052:Power on 2024-04-17T05:29:09.962 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-17T05:29:09.970 INFO:teuthology.orchestra.console.smithi133:Power on 2024-04-17T05:29:09.970 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-17T05:29:09.984 DEBUG:teuthology.orchestra.console.smithi052:power on output: Chassis Power Control: Up/On 2024-04-17T05:29:09.984 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T05:29:09.992 INFO:teuthology.orchestra.console.smithi175:Power on 2024-04-17T05:29:09.993 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-17T05:29:09.999 DEBUG:teuthology.orchestra.console.smithi133:power on output: Chassis Power Control: Up/On 2024-04-17T05:29:10.000 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T05:29:10.008 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is off 2024-04-17T05:29:10.012 DEBUG:teuthology.orchestra.console.smithi175:power on output: Chassis Power Control: Up/On 2024-04-17T05:29:10.012 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T05:29:10.020 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2024-04-17T05:29:10.032 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off 2024-04-17T05:29:14.011 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T05:29:14.021 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T05:29:14.034 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T05:29:14.121 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is off 2024-04-17T05:29:14.130 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2024-04-17T05:29:14.142 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off 2024-04-17T05:29:18.126 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T05:29:18.134 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T05:29:18.144 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T05:29:18.243 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2024-04-17T05:29:18.253 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on 2024-04-17T05:29:18.325 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is on 2024-04-17T05:29:18.344 INFO:teuthology.orchestra.console.smithi133:Power on completed 2024-04-17T05:29:18.354 INFO:teuthology.orchestra.console.smithi175:Power on completed 2024-04-17T05:29:18.426 INFO:teuthology.orchestra.console.smithi052:Power on completed 2024-04-17T05:29:18.445 INFO:teuthology.provision.fog.smithi133:Waiting for deploy to finish 2024-04-17T05:29:18.455 INFO:teuthology.provision.fog.smithi175:Waiting for deploy to finish 2024-04-17T05:29:18.527 INFO:teuthology.provision.fog.smithi052:Waiting for deploy to finish 2024-04-17T05:31:49.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T05:31:49.249 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T05:31:49.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T05:31:52.318 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2024-04-17T05:31:52.319 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52 2024-04-17T05:31:52.319 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-04-17T05:31:58.323 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T05:31:58.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T05:31:58.326 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T05:32:01.374 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2024-04-17T05:32:01.374 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52 2024-04-17T05:32:01.406 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-04-17T05:32:07.379 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T05:32:07.381 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T05:32:07.407 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T05:32:10.430 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2024-04-17T05:32:10.431 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52 2024-04-17T05:32:10.466 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-04-17T05:32:16.437 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T05:32:16.439 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T05:32:16.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T05:32:19.518 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2024-04-17T05:32:19.519 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52 2024-04-17T05:32:19.519 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-04-17T05:32:25.526 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T05:32:25.527 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T05:32:25.529 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T05:32:28.606 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2024-04-17T05:32:28.607 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52 2024-04-17T05:32:28.607 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-04-17T05:32:34.611 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T05:32:34.612 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T05:32:34.614 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T05:32:37.666 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2024-04-17T05:32:37.694 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-04-17T05:32:43.671 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T05:32:43.695 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T05:32:46.750 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-04-17T05:32:52.752 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T05:33:34.656 WARNING:teuthology.provision.fog.smithi052:timed out 2024-04-17T05:33:40.663 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T05:33:40.920 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-17T05:33:40.921 DEBUG:teuthology.orchestra.run.smithi052:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-17T05:33:41.219 INFO:teuthology.provision.fog.smithi052:Node is ready 2024-04-17T05:33:41.219 DEBUG:teuthology.orchestra.run.smithi052:> hostname 2024-04-17T05:33:41.233 INFO:teuthology.orchestra.run.smithi052.stdout:smithi052.front.sepia.ceph.com 2024-04-17T05:33:41.234 DEBUG:teuthology.orchestra.run.smithi052:> grep smithi052.front.sepia.ceph.com /etc/hosts 2024-04-17T05:33:41.289 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52 smithi052.front.sepia.ceph.com smithi052 2024-04-17T05:33:41.289 DEBUG:teuthology.orchestra.run.smithi052:> sudo hostname smithi052 2024-04-17T05:33:41.391 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i -e 's/smithi052.front.sepia.ceph.com/smithi052/g' /etc/hosts 2024-04-17T05:33:41.422 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i -e 's/172.21.15.52/172.21.15.52/g' /etc/hosts 2024-04-17T05:33:41.492 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i -e 's/smithi052.front.sepia.ceph.com/smithi052/g' /etc/hostname 2024-04-17T05:33:41.563 DEBUG:teuthology.orchestra.run.smithi052:> sudo hostname smithi052 2024-04-17T05:33:41.633 DEBUG:teuthology.orchestra.run.smithi052:> cat /etc/os-release 2024-04-17T05:33:41.688 INFO:teuthology.orchestra.run.smithi052.stdout:NAME="CentOS Stream" 2024-04-17T05:33:41.688 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION="9" 2024-04-17T05:33:41.688 INFO:teuthology.orchestra.run.smithi052.stdout:ID="centos" 2024-04-17T05:33:41.688 INFO:teuthology.orchestra.run.smithi052.stdout:ID_LIKE="rhel fedora" 2024-04-17T05:33:41.688 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_ID="9" 2024-04-17T05:33:41.688 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM_ID="platform:el9" 2024-04-17T05:33:41.688 INFO:teuthology.orchestra.run.smithi052.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T05:33:41.688 INFO:teuthology.orchestra.run.smithi052.stdout:ANSI_COLOR="0;31" 2024-04-17T05:33:41.688 INFO:teuthology.orchestra.run.smithi052.stdout:LOGO="fedora-logo-icon" 2024-04-17T05:33:41.688 INFO:teuthology.orchestra.run.smithi052.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T05:33:41.688 INFO:teuthology.orchestra.run.smithi052.stdout:HOME_URL="https://centos.org/" 2024-04-17T05:33:41.688 INFO:teuthology.orchestra.run.smithi052.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T05:33:41.688 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T05:33:41.689 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T05:33:41.689 INFO:teuthology.provision.fog.smithi052:Deploy complete! 2024-04-17T05:33:41.691 DEBUG:teuthology.parallel:result is None 2024-04-17T05:33:43.675 WARNING:teuthology.provision.fog.smithi175:timed out 2024-04-17T05:33:49.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T05:33:49.936 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-17T05:33:49.936 DEBUG:teuthology.orchestra.run.smithi175:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-17T05:33:50.261 INFO:teuthology.provision.fog.smithi175:Node is ready 2024-04-17T05:33:50.261 DEBUG:teuthology.orchestra.run.smithi175:> hostname 2024-04-17T05:33:50.276 INFO:teuthology.orchestra.run.smithi175.stdout:smithi175.front.sepia.ceph.com 2024-04-17T05:33:50.276 DEBUG:teuthology.orchestra.run.smithi175:> grep smithi175.front.sepia.ceph.com /etc/hosts 2024-04-17T05:33:50.332 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.15.175 smithi175.front.sepia.ceph.com smithi175 2024-04-17T05:33:50.332 DEBUG:teuthology.orchestra.run.smithi175:> sudo hostname smithi175 2024-04-17T05:33:50.435 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/smithi175.front.sepia.ceph.com/smithi175/g' /etc/hosts 2024-04-17T05:33:50.464 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/172.21.15.175/172.21.15.175/g' /etc/hosts 2024-04-17T05:33:50.532 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/smithi175.front.sepia.ceph.com/smithi175/g' /etc/hostname 2024-04-17T05:33:50.601 DEBUG:teuthology.orchestra.run.smithi175:> sudo hostname smithi175 2024-04-17T05:33:50.669 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release 2024-04-17T05:33:50.724 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="CentOS Stream" 2024-04-17T05:33:50.724 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="9" 2024-04-17T05:33:50.725 INFO:teuthology.orchestra.run.smithi175.stdout:ID="centos" 2024-04-17T05:33:50.725 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE="rhel fedora" 2024-04-17T05:33:50.725 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="9" 2024-04-17T05:33:50.725 INFO:teuthology.orchestra.run.smithi175.stdout:PLATFORM_ID="platform:el9" 2024-04-17T05:33:50.725 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T05:33:50.725 INFO:teuthology.orchestra.run.smithi175.stdout:ANSI_COLOR="0;31" 2024-04-17T05:33:50.725 INFO:teuthology.orchestra.run.smithi175.stdout:LOGO="fedora-logo-icon" 2024-04-17T05:33:50.725 INFO:teuthology.orchestra.run.smithi175.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T05:33:50.725 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://centos.org/" 2024-04-17T05:33:50.725 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T05:33:50.725 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T05:33:50.726 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T05:33:50.726 INFO:teuthology.provision.fog.smithi175:Deploy complete! 2024-04-17T05:33:50.726 DEBUG:teuthology.parallel:result is None 2024-04-17T05:33:52.756 WARNING:teuthology.provision.fog.smithi133:timed out 2024-04-17T05:33:58.763 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T05:33:59.145 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-17T05:33:59.145 DEBUG:teuthology.orchestra.run.smithi133:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-17T05:33:59.465 INFO:teuthology.provision.fog.smithi133:Node is ready 2024-04-17T05:33:59.465 DEBUG:teuthology.orchestra.run.smithi133:> hostname 2024-04-17T05:33:59.480 INFO:teuthology.orchestra.run.smithi133.stdout:smithi133.front.sepia.ceph.com 2024-04-17T05:33:59.480 DEBUG:teuthology.orchestra.run.smithi133:> grep smithi133.front.sepia.ceph.com /etc/hosts 2024-04-17T05:33:59.536 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.15.133 smithi133.front.sepia.ceph.com smithi133 2024-04-17T05:33:59.536 DEBUG:teuthology.orchestra.run.smithi133:> sudo hostname smithi133 2024-04-17T05:33:59.634 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/smithi133.front.sepia.ceph.com/smithi133/g' /etc/hosts 2024-04-17T05:33:59.663 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/172.21.15.133/172.21.15.133/g' /etc/hosts 2024-04-17T05:33:59.730 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/smithi133.front.sepia.ceph.com/smithi133/g' /etc/hostname 2024-04-17T05:33:59.797 DEBUG:teuthology.orchestra.run.smithi133:> sudo hostname smithi133 2024-04-17T05:33:59.863 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release 2024-04-17T05:33:59.917 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="CentOS Stream" 2024-04-17T05:33:59.917 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="9" 2024-04-17T05:33:59.917 INFO:teuthology.orchestra.run.smithi133.stdout:ID="centos" 2024-04-17T05:33:59.918 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE="rhel fedora" 2024-04-17T05:33:59.918 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="9" 2024-04-17T05:33:59.918 INFO:teuthology.orchestra.run.smithi133.stdout:PLATFORM_ID="platform:el9" 2024-04-17T05:33:59.918 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T05:33:59.918 INFO:teuthology.orchestra.run.smithi133.stdout:ANSI_COLOR="0;31" 2024-04-17T05:33:59.918 INFO:teuthology.orchestra.run.smithi133.stdout:LOGO="fedora-logo-icon" 2024-04-17T05:33:59.918 INFO:teuthology.orchestra.run.smithi133.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T05:33:59.918 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://centos.org/" 2024-04-17T05:33:59.918 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T05:33:59.918 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T05:33:59.918 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T05:33:59.919 INFO:teuthology.provision.fog.smithi133:Deploy complete! 2024-04-17T05:33:59.919 DEBUG:teuthology.parallel:result is None 2024-04-17T05:34:00.132 INFO:teuthology.lock.ops:Checking smithi052.front.sepia.ceph.com 2024-04-17T05:34:00.132 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-17T05:34:00.157 INFO:teuthology.lock.ops:Checking smithi133.front.sepia.ceph.com 2024-04-17T05:34:00.157 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-17T05:34:00.173 INFO:teuthology.lock.ops:Checking smithi175.front.sepia.ceph.com 2024-04-17T05:34:00.174 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-17T05:34:00.192 INFO:teuthology.lock.ops:Updating [smithi052.front.sepia.ceph.com]: set os type and version on server 2024-04-17T05:34:00.192 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-04-17T05:34:00.193 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T05:34:00.294 DEBUG:teuthology.orchestra.run.smithi052:> true 2024-04-17T05:34:00.477 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-04-17T05:34:00.477 DEBUG:teuthology.orchestra.run.smithi052:> uname -m 2024-04-17T05:34:00.532 INFO:teuthology.orchestra.run.smithi052.stdout:x86_64 2024-04-17T05:34:00.533 DEBUG:teuthology.orchestra.run.smithi052:> cat /etc/os-release 2024-04-17T05:34:00.588 INFO:teuthology.orchestra.run.smithi052.stdout:NAME="CentOS Stream" 2024-04-17T05:34:00.588 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION="9" 2024-04-17T05:34:00.589 INFO:teuthology.orchestra.run.smithi052.stdout:ID="centos" 2024-04-17T05:34:00.589 INFO:teuthology.orchestra.run.smithi052.stdout:ID_LIKE="rhel fedora" 2024-04-17T05:34:00.589 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_ID="9" 2024-04-17T05:34:00.589 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM_ID="platform:el9" 2024-04-17T05:34:00.589 INFO:teuthology.orchestra.run.smithi052.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T05:34:00.589 INFO:teuthology.orchestra.run.smithi052.stdout:ANSI_COLOR="0;31" 2024-04-17T05:34:00.589 INFO:teuthology.orchestra.run.smithi052.stdout:LOGO="fedora-logo-icon" 2024-04-17T05:34:00.590 INFO:teuthology.orchestra.run.smithi052.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T05:34:00.590 INFO:teuthology.orchestra.run.smithi052.stdout:HOME_URL="https://centos.org/" 2024-04-17T05:34:00.590 INFO:teuthology.orchestra.run.smithi052.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T05:34:00.590 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T05:34:00.590 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T05:34:00.591 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server 2024-04-17T05:34:00.607 INFO:teuthology.lock.ops:Updating [smithi133.front.sepia.ceph.com]: set os type and version on server 2024-04-17T05:34:00.608 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-04-17T05:34:00.608 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T05:34:00.696 DEBUG:teuthology.orchestra.run.smithi133:> true 2024-04-17T05:34:00.764 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-04-17T05:34:00.764 DEBUG:teuthology.orchestra.run.smithi133:> uname -m 2024-04-17T05:34:00.819 INFO:teuthology.orchestra.run.smithi133.stdout:x86_64 2024-04-17T05:34:00.819 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release 2024-04-17T05:34:00.875 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="CentOS Stream" 2024-04-17T05:34:00.875 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="9" 2024-04-17T05:34:00.875 INFO:teuthology.orchestra.run.smithi133.stdout:ID="centos" 2024-04-17T05:34:00.875 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE="rhel fedora" 2024-04-17T05:34:00.875 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="9" 2024-04-17T05:34:00.875 INFO:teuthology.orchestra.run.smithi133.stdout:PLATFORM_ID="platform:el9" 2024-04-17T05:34:00.875 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T05:34:00.875 INFO:teuthology.orchestra.run.smithi133.stdout:ANSI_COLOR="0;31" 2024-04-17T05:34:00.876 INFO:teuthology.orchestra.run.smithi133.stdout:LOGO="fedora-logo-icon" 2024-04-17T05:34:00.876 INFO:teuthology.orchestra.run.smithi133.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T05:34:00.876 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://centos.org/" 2024-04-17T05:34:00.876 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T05:34:00.876 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T05:34:00.876 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T05:34:00.876 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2024-04-17T05:34:00.899 INFO:teuthology.lock.ops:Updating [smithi175.front.sepia.ceph.com]: set os type and version on server 2024-04-17T05:34:00.900 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-04-17T05:34:00.900 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T05:34:00.989 DEBUG:teuthology.orchestra.run.smithi175:> true 2024-04-17T05:34:01.058 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-04-17T05:34:01.058 DEBUG:teuthology.orchestra.run.smithi175:> uname -m 2024-04-17T05:34:01.114 INFO:teuthology.orchestra.run.smithi175.stdout:x86_64 2024-04-17T05:34:01.114 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release 2024-04-17T05:34:01.170 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="CentOS Stream" 2024-04-17T05:34:01.170 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="9" 2024-04-17T05:34:01.170 INFO:teuthology.orchestra.run.smithi175.stdout:ID="centos" 2024-04-17T05:34:01.170 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE="rhel fedora" 2024-04-17T05:34:01.170 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="9" 2024-04-17T05:34:01.170 INFO:teuthology.orchestra.run.smithi175.stdout:PLATFORM_ID="platform:el9" 2024-04-17T05:34:01.170 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T05:34:01.170 INFO:teuthology.orchestra.run.smithi175.stdout:ANSI_COLOR="0;31" 2024-04-17T05:34:01.170 INFO:teuthology.orchestra.run.smithi175.stdout:LOGO="fedora-logo-icon" 2024-04-17T05:34:01.170 INFO:teuthology.orchestra.run.smithi175.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T05:34:01.171 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://centos.org/" 2024-04-17T05:34:01.171 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T05:34:01.171 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T05:34:01.171 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T05:34:01.171 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server 2024-04-17T05:34:01.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T05:34:01.295 INFO:teuthology.dispatcher.supervisor:Running job 7659853 2024-04-17T05:34:01.296 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7659853 --name rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-workunit/suites/fsx}} -- /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7659853/orig.config.yaml 2024-04-17T05:34:01.298 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7659853 2024-04-17T05:34:01.299 INFO:teuthology.dispatcher.supervisor:Job PID: 3959126 2024-04-17T05:34:01.299 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-17T05:36:01.399 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T05:38:01.571 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T05:40:01.746 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T05:42:01.919 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T05:44:02.086 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T05:46:02.263 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T05:48:02.439 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T05:50:02.612 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T05:52:02.777 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T05:54:02.951 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T05:56:03.128 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T05:58:03.291 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T06:00:03.455 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T06:02:03.627 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T06:04:03.795 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T06:06:03.994 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T06:08:04.154 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T06:10:04.328 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T06:10:04.403 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1