2024-03-21T16:29:12.001 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-21T16:29:12.001 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:29:12.177 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f38394efc10>, signals=[15]) 2024-03-21T16:29:12.178 INFO:teuthology.lock.ops:Start node 'smithi039.front.sepia.ceph.com' reimaging 2024-03-21T16:29:12.178 INFO:teuthology.lock.ops:Updating [smithi039.front.sepia.ceph.com]: reset os type and version on server 2024-03-21T16:29:12.178 INFO:teuthology.lock.ops:Updating smithi039.front.sepia.ceph.com on lock server 2024-03-21T16:29:12.201 INFO:teuthology.lock.ops:Start node 'smithi105.front.sepia.ceph.com' reimaging 2024-03-21T16:29:12.201 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: reset os type and version on server 2024-03-21T16:29:12.202 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server 2024-03-21T16:29:12.225 INFO:teuthology.lock.ops:Start node 'smithi106.front.sepia.ceph.com' reimaging 2024-03-21T16:29:12.226 INFO:teuthology.lock.ops:Updating [smithi106.front.sepia.ceph.com]: reset os type and version on server 2024-03-21T16:29:12.226 INFO:teuthology.lock.ops:Updating smithi106.front.sepia.ceph.com on lock server 2024-03-21T16:29:12.317 DEBUG:teuthology.provision.fog.smithi039:Requesting image smithi_centos_9.stream (ID 10) 2024-03-21T16:29:12.334 DEBUG:teuthology.provision.fog.smithi105:Requesting image smithi_centos_9.stream (ID 10) 2024-03-21T16:29:12.343 DEBUG:teuthology.provision.fog.smithi106:Requesting image smithi_centos_9.stream (ID 10) 2024-03-21T16:29:12.370 INFO:teuthology.provision.fog.smithi039:Scheduling deploy of centos 9.stream 2024-03-21T16:29:12.381 INFO:teuthology.provision.fog.smithi105:Scheduling deploy of centos 9.stream 2024-03-21T16:29:12.387 INFO:teuthology.provision.fog.smithi106:Scheduling deploy of centos 9.stream 2024-03-21T16:29:12.608 INFO:teuthology.orchestra.console.smithi106:Power off 2024-03-21T16:29:12.608 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-21T16:29:12.623 INFO:teuthology.orchestra.console.smithi039:Power off 2024-03-21T16:29:12.623 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-21T16:29:12.635 INFO:teuthology.orchestra.console.smithi105:Power off 2024-03-21T16:29:12.636 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-21T16:29:12.644 DEBUG:teuthology.orchestra.console.smithi106:power off output: Chassis Power Control: Down/Off 2024-03-21T16:29:12.644 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T16:29:12.652 DEBUG:teuthology.orchestra.console.smithi039:power off output: Chassis Power Control: Down/Off 2024-03-21T16:29:12.652 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T16:29:12.661 DEBUG:teuthology.orchestra.console.smithi105:power off output: Chassis Power Control: Down/Off 2024-03-21T16:29:12.661 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T16:29:12.669 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is off 2024-03-21T16:29:12.674 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is on 2024-03-21T16:29:12.682 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on 2024-03-21T16:29:12.769 INFO:teuthology.orchestra.console.smithi106:Power off completed 2024-03-21T16:29:12.870 INFO:teuthology.orchestra.console.smithi106:Power on 2024-03-21T16:29:12.870 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-21T16:29:12.893 DEBUG:teuthology.orchestra.console.smithi106:power on output: Chassis Power Control: Up/On 2024-03-21T16:29:12.893 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T16:29:12.914 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is off 2024-03-21T16:29:16.679 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T16:29:16.687 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T16:29:16.789 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is on 2024-03-21T16:29:16.796 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on 2024-03-21T16:29:16.916 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T16:29:17.024 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is off 2024-03-21T16:29:20.792 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T16:29:20.799 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T16:29:20.901 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is off 2024-03-21T16:29:20.908 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off 2024-03-21T16:29:21.002 INFO:teuthology.orchestra.console.smithi039:Power off completed 2024-03-21T16:29:21.009 INFO:teuthology.orchestra.console.smithi105:Power off completed 2024-03-21T16:29:21.025 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T16:29:21.104 INFO:teuthology.orchestra.console.smithi039:Power on 2024-03-21T16:29:21.104 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-21T16:29:21.111 INFO:teuthology.orchestra.console.smithi105:Power on 2024-03-21T16:29:21.111 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-21T16:29:21.124 DEBUG:teuthology.orchestra.console.smithi039:power on output: Chassis Power Control: Up/On 2024-03-21T16:29:21.125 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T16:29:21.131 DEBUG:teuthology.orchestra.console.smithi105:power on output: Chassis Power Control: Up/On 2024-03-21T16:29:21.132 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T16:29:21.141 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is on 2024-03-21T16:29:21.144 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is off 2024-03-21T16:29:21.152 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off 2024-03-21T16:29:21.241 INFO:teuthology.orchestra.console.smithi106:Power on completed 2024-03-21T16:29:21.342 INFO:teuthology.provision.fog.smithi106:Waiting for deploy to finish 2024-03-21T16:29:25.147 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T16:29:25.154 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T16:29:25.256 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is off 2024-03-21T16:29:25.262 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off 2024-03-21T16:29:29.262 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T16:29:29.270 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T16:29:29.372 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is on 2024-03-21T16:29:29.378 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on 2024-03-21T16:29:29.473 INFO:teuthology.orchestra.console.smithi039:Power on completed 2024-03-21T16:29:29.479 INFO:teuthology.orchestra.console.smithi105:Power on completed 2024-03-21T16:29:29.574 INFO:teuthology.provision.fog.smithi039:Waiting for deploy to finish 2024-03-21T16:29:29.580 INFO:teuthology.provision.fog.smithi105:Waiting for deploy to finish 2024-03-21T16:31:52.093 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T16:31:55.166 WARNING:teuthology.provision.fog.smithi106:[Errno None] Unable to connect to port 22 on 172.21.15.106 2024-03-21T16:32:00.369 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T16:32:01.169 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T16:32:03.422 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2024-03-21T16:32:04.222 WARNING:teuthology.provision.fog.smithi106:[Errno None] Unable to connect to port 22 on 172.21.15.106 2024-03-21T16:32:09.428 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T16:32:10.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T16:32:12.514 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2024-03-21T16:32:13.278 WARNING:teuthology.provision.fog.smithi106:[Errno None] Unable to connect to port 22 on 172.21.15.106 2024-03-21T16:32:18.518 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T16:32:19.280 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T16:32:21.602 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2024-03-21T16:32:22.338 WARNING:teuthology.provision.fog.smithi106:[Errno None] Unable to connect to port 22 on 172.21.15.106 2024-03-21T16:32:27.607 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T16:32:28.340 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T16:32:30.503 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T16:32:30.651 ERROR:teuthology.orchestra.connection:Error authenticating with smithi039.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-03-21T16:32:30.686 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2024-03-21T16:32:31.390 WARNING:teuthology.provision.fog.smithi106:[Errno None] Unable to connect to port 22 on 172.21.15.106 2024-03-21T16:32:36.688 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T16:32:37.392 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T16:32:39.742 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2024-03-21T16:32:40.450 WARNING:teuthology.provision.fog.smithi106:[Errno None] Unable to connect to port 22 on 172.21.15.106 2024-03-21T16:32:45.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T16:32:46.452 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T16:32:48.798 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2024-03-21T16:32:49.502 WARNING:teuthology.provision.fog.smithi106:[Errno None] Unable to connect to port 22 on 172.21.15.106 2024-03-21T16:32:54.800 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T16:32:55.503 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T16:33:13.247 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2024-03-21T16:33:14.018 WARNING:teuthology.provision.fog.smithi106:[Errno None] Unable to connect to port 22 on 172.21.15.106 2024-03-21T16:33:19.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T16:33:20.020 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T16:33:22.302 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2024-03-21T16:33:23.070 WARNING:teuthology.provision.fog.smithi106:[Errno None] Unable to connect to port 22 on 172.21.15.106 2024-03-21T16:33:28.304 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T16:33:29.072 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T16:33:31.362 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2024-03-21T16:33:32.130 WARNING:teuthology.provision.fog.smithi106:[Errno None] Unable to connect to port 22 on 172.21.15.106 2024-03-21T16:33:34.655 WARNING:teuthology.provision.fog.smithi039:timed out 2024-03-21T16:33:37.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T16:33:37.621 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-21T16:33:37.621 DEBUG:teuthology.orchestra.run.smithi105:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-21T16:33:38.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T16:33:38.409 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-21T16:33:38.410 DEBUG:teuthology.orchestra.run.smithi106:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-21T16:33:40.656 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T16:33:43.710 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39 2024-03-21T16:33:49.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T16:33:52.770 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39 2024-03-21T16:33:52.923 INFO:teuthology.provision.fog.smithi105:Node is ready 2024-03-21T16:33:52.923 DEBUG:teuthology.orchestra.run.smithi105:> hostname 2024-03-21T16:33:52.940 INFO:teuthology.orchestra.run.smithi105.stdout:smithi046 2024-03-21T16:33:52.940 DEBUG:teuthology.orchestra.run.smithi105:> grep smithi046 /etc/hosts 2024-03-21T16:33:52.997 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2024-03-21T16:33:52.997 DEBUG:teuthology.orchestra.run.smithi105:> sudo hostname smithi105 2024-03-21T16:33:53.152 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/smithi046/smithi105/g' /etc/hosts 2024-03-21T16:33:53.182 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/172.21.15.46/172.21.15.105/g' /etc/hosts 2024-03-21T16:33:53.252 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/smithi046/smithi105/g' /etc/hostname 2024-03-21T16:33:53.321 DEBUG:teuthology.orchestra.run.smithi105:> sudo hostname smithi105 2024-03-21T16:33:53.388 DEBUG:teuthology.orchestra.run.smithi105:> cat /etc/os-release 2024-03-21T16:33:53.443 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="CentOS Stream" 2024-03-21T16:33:53.443 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="9" 2024-03-21T16:33:53.443 INFO:teuthology.orchestra.run.smithi105.stdout:ID="centos" 2024-03-21T16:33:53.443 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="rhel fedora" 2024-03-21T16:33:53.443 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="9" 2024-03-21T16:33:53.443 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el9" 2024-03-21T16:33:53.444 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-21T16:33:53.444 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31" 2024-03-21T16:33:53.444 INFO:teuthology.orchestra.run.smithi105.stdout:LOGO="fedora-logo-icon" 2024-03-21T16:33:53.444 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-21T16:33:53.444 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://centos.org/" 2024-03-21T16:33:53.444 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-21T16:33:53.444 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-21T16:33:53.444 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-21T16:33:53.445 INFO:teuthology.provision.fog.smithi105:Deploy complete! 2024-03-21T16:33:53.447 DEBUG:teuthology.parallel:result is None 2024-03-21T16:33:53.784 INFO:teuthology.provision.fog.smithi106:Node is ready 2024-03-21T16:33:53.784 DEBUG:teuthology.orchestra.run.smithi106:> hostname 2024-03-21T16:33:53.801 INFO:teuthology.orchestra.run.smithi106.stdout:smithi046 2024-03-21T16:33:53.801 DEBUG:teuthology.orchestra.run.smithi106:> grep smithi046 /etc/hosts 2024-03-21T16:33:53.859 INFO:teuthology.orchestra.run.smithi106.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2024-03-21T16:33:53.859 DEBUG:teuthology.orchestra.run.smithi106:> sudo hostname smithi106 2024-03-21T16:33:54.004 DEBUG:teuthology.orchestra.run.smithi106:> sudo sed -i -e 's/smithi046/smithi106/g' /etc/hosts 2024-03-21T16:33:54.037 DEBUG:teuthology.orchestra.run.smithi106:> sudo sed -i -e 's/172.21.15.46/172.21.15.106/g' /etc/hosts 2024-03-21T16:33:54.111 DEBUG:teuthology.orchestra.run.smithi106:> sudo sed -i -e 's/smithi046/smithi106/g' /etc/hostname 2024-03-21T16:33:54.183 DEBUG:teuthology.orchestra.run.smithi106:> sudo hostname smithi106 2024-03-21T16:33:54.255 DEBUG:teuthology.orchestra.run.smithi106:> cat /etc/os-release 2024-03-21T16:33:54.313 INFO:teuthology.orchestra.run.smithi106.stdout:NAME="CentOS Stream" 2024-03-21T16:33:54.313 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION="9" 2024-03-21T16:33:54.313 INFO:teuthology.orchestra.run.smithi106.stdout:ID="centos" 2024-03-21T16:33:54.313 INFO:teuthology.orchestra.run.smithi106.stdout:ID_LIKE="rhel fedora" 2024-03-21T16:33:54.313 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION_ID="9" 2024-03-21T16:33:54.313 INFO:teuthology.orchestra.run.smithi106.stdout:PLATFORM_ID="platform:el9" 2024-03-21T16:33:54.314 INFO:teuthology.orchestra.run.smithi106.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-21T16:33:54.314 INFO:teuthology.orchestra.run.smithi106.stdout:ANSI_COLOR="0;31" 2024-03-21T16:33:54.314 INFO:teuthology.orchestra.run.smithi106.stdout:LOGO="fedora-logo-icon" 2024-03-21T16:33:54.314 INFO:teuthology.orchestra.run.smithi106.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-21T16:33:54.314 INFO:teuthology.orchestra.run.smithi106.stdout:HOME_URL="https://centos.org/" 2024-03-21T16:33:54.314 INFO:teuthology.orchestra.run.smithi106.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-21T16:33:54.314 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-21T16:33:54.314 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-21T16:33:54.314 INFO:teuthology.provision.fog.smithi106:Deploy complete! 2024-03-21T16:33:54.315 DEBUG:teuthology.parallel:result is None 2024-03-21T16:33:58.772 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T16:34:58.775 WARNING:teuthology.provision.fog.smithi039:timed out 2024-03-21T16:35:04.777 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T16:35:05.029 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-21T16:35:05.029 DEBUG:teuthology.orchestra.run.smithi039:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-21T16:35:05.345 INFO:teuthology.provision.fog.smithi039:Node is ready 2024-03-21T16:35:05.345 DEBUG:teuthology.orchestra.run.smithi039:> hostname 2024-03-21T16:35:05.400 INFO:teuthology.orchestra.run.smithi039.stdout:smithi039.front.sepia.ceph.com 2024-03-21T16:35:05.401 DEBUG:teuthology.orchestra.run.smithi039:> grep smithi039.front.sepia.ceph.com /etc/hosts 2024-03-21T16:35:05.456 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39 smithi039.front.sepia.ceph.com smithi039 2024-03-21T16:35:05.457 DEBUG:teuthology.orchestra.run.smithi039:> sudo hostname smithi039 2024-03-21T16:35:05.555 DEBUG:teuthology.orchestra.run.smithi039:> sudo sed -i -e 's/smithi039.front.sepia.ceph.com/smithi039/g' /etc/hosts 2024-03-21T16:35:05.587 DEBUG:teuthology.orchestra.run.smithi039:> sudo sed -i -e 's/172.21.15.39/172.21.15.39/g' /etc/hosts 2024-03-21T16:35:05.658 DEBUG:teuthology.orchestra.run.smithi039:> sudo sed -i -e 's/smithi039.front.sepia.ceph.com/smithi039/g' /etc/hostname 2024-03-21T16:35:05.729 DEBUG:teuthology.orchestra.run.smithi039:> sudo hostname smithi039 2024-03-21T16:35:05.799 DEBUG:teuthology.orchestra.run.smithi039:> cat /etc/os-release 2024-03-21T16:35:05.855 INFO:teuthology.orchestra.run.smithi039.stdout:NAME="CentOS Stream" 2024-03-21T16:35:05.855 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION="9" 2024-03-21T16:35:05.855 INFO:teuthology.orchestra.run.smithi039.stdout:ID="centos" 2024-03-21T16:35:05.855 INFO:teuthology.orchestra.run.smithi039.stdout:ID_LIKE="rhel fedora" 2024-03-21T16:35:05.855 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION_ID="9" 2024-03-21T16:35:05.855 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM_ID="platform:el9" 2024-03-21T16:35:05.855 INFO:teuthology.orchestra.run.smithi039.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-21T16:35:05.855 INFO:teuthology.orchestra.run.smithi039.stdout:ANSI_COLOR="0;31" 2024-03-21T16:35:05.855 INFO:teuthology.orchestra.run.smithi039.stdout:LOGO="fedora-logo-icon" 2024-03-21T16:35:05.856 INFO:teuthology.orchestra.run.smithi039.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-21T16:35:05.856 INFO:teuthology.orchestra.run.smithi039.stdout:HOME_URL="https://centos.org/" 2024-03-21T16:35:05.856 INFO:teuthology.orchestra.run.smithi039.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-21T16:35:05.856 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-21T16:35:05.856 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-21T16:35:05.856 INFO:teuthology.provision.fog.smithi039:Deploy complete! 2024-03-21T16:35:05.857 DEBUG:teuthology.parallel:result is None 2024-03-21T16:35:06.103 INFO:teuthology.lock.ops:Checking smithi039.front.sepia.ceph.com 2024-03-21T16:35:06.103 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-21T16:35:06.124 INFO:teuthology.lock.ops:Checking smithi105.front.sepia.ceph.com 2024-03-21T16:35:06.124 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-21T16:35:06.148 INFO:teuthology.lock.ops:Checking smithi106.front.sepia.ceph.com 2024-03-21T16:35:06.148 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-21T16:35:06.166 INFO:teuthology.lock.ops:Updating [smithi039.front.sepia.ceph.com]: set os type and version on server 2024-03-21T16:35:06.167 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-03-21T16:35:06.167 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T16:35:06.268 DEBUG:teuthology.orchestra.run.smithi039:> true 2024-03-21T16:35:06.332 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-03-21T16:35:06.332 DEBUG:teuthology.orchestra.run.smithi039:> uname -m 2024-03-21T16:35:06.387 INFO:teuthology.orchestra.run.smithi039.stdout:x86_64 2024-03-21T16:35:06.387 DEBUG:teuthology.orchestra.run.smithi039:> cat /etc/os-release 2024-03-21T16:35:06.442 INFO:teuthology.orchestra.run.smithi039.stdout:NAME="CentOS Stream" 2024-03-21T16:35:06.442 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION="9" 2024-03-21T16:35:06.442 INFO:teuthology.orchestra.run.smithi039.stdout:ID="centos" 2024-03-21T16:35:06.443 INFO:teuthology.orchestra.run.smithi039.stdout:ID_LIKE="rhel fedora" 2024-03-21T16:35:06.443 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION_ID="9" 2024-03-21T16:35:06.443 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM_ID="platform:el9" 2024-03-21T16:35:06.443 INFO:teuthology.orchestra.run.smithi039.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-21T16:35:06.443 INFO:teuthology.orchestra.run.smithi039.stdout:ANSI_COLOR="0;31" 2024-03-21T16:35:06.443 INFO:teuthology.orchestra.run.smithi039.stdout:LOGO="fedora-logo-icon" 2024-03-21T16:35:06.443 INFO:teuthology.orchestra.run.smithi039.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-21T16:35:06.443 INFO:teuthology.orchestra.run.smithi039.stdout:HOME_URL="https://centos.org/" 2024-03-21T16:35:06.443 INFO:teuthology.orchestra.run.smithi039.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-21T16:35:06.443 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-21T16:35:06.443 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-21T16:35:06.444 INFO:teuthology.lock.ops:Updating smithi039.front.sepia.ceph.com on lock server 2024-03-21T16:35:06.466 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: set os type and version on server 2024-03-21T16:35:06.466 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com' 2024-03-21T16:35:06.466 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T16:35:06.570 DEBUG:teuthology.orchestra.run.smithi105:> true 2024-03-21T16:35:06.736 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi105.front.sepia.ceph.com' 2024-03-21T16:35:06.736 DEBUG:teuthology.orchestra.run.smithi105:> uname -m 2024-03-21T16:35:06.791 INFO:teuthology.orchestra.run.smithi105.stdout:x86_64 2024-03-21T16:35:06.791 DEBUG:teuthology.orchestra.run.smithi105:> cat /etc/os-release 2024-03-21T16:35:06.846 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="CentOS Stream" 2024-03-21T16:35:06.846 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="9" 2024-03-21T16:35:06.846 INFO:teuthology.orchestra.run.smithi105.stdout:ID="centos" 2024-03-21T16:35:06.846 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="rhel fedora" 2024-03-21T16:35:06.846 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="9" 2024-03-21T16:35:06.846 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el9" 2024-03-21T16:35:06.846 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-21T16:35:06.846 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31" 2024-03-21T16:35:06.846 INFO:teuthology.orchestra.run.smithi105.stdout:LOGO="fedora-logo-icon" 2024-03-21T16:35:06.846 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-21T16:35:06.846 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://centos.org/" 2024-03-21T16:35:06.847 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-21T16:35:06.847 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-21T16:35:06.847 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-21T16:35:06.847 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server 2024-03-21T16:35:06.865 INFO:teuthology.lock.ops:Updating [smithi106.front.sepia.ceph.com]: set os type and version on server 2024-03-21T16:35:06.865 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-03-21T16:35:06.866 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T16:35:06.954 DEBUG:teuthology.orchestra.run.smithi106:> true 2024-03-21T16:35:07.124 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-03-21T16:35:07.124 DEBUG:teuthology.orchestra.run.smithi106:> uname -m 2024-03-21T16:35:07.179 INFO:teuthology.orchestra.run.smithi106.stdout:x86_64 2024-03-21T16:35:07.179 DEBUG:teuthology.orchestra.run.smithi106:> cat /etc/os-release 2024-03-21T16:35:07.234 INFO:teuthology.orchestra.run.smithi106.stdout:NAME="CentOS Stream" 2024-03-21T16:35:07.234 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION="9" 2024-03-21T16:35:07.234 INFO:teuthology.orchestra.run.smithi106.stdout:ID="centos" 2024-03-21T16:35:07.234 INFO:teuthology.orchestra.run.smithi106.stdout:ID_LIKE="rhel fedora" 2024-03-21T16:35:07.234 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION_ID="9" 2024-03-21T16:35:07.234 INFO:teuthology.orchestra.run.smithi106.stdout:PLATFORM_ID="platform:el9" 2024-03-21T16:35:07.234 INFO:teuthology.orchestra.run.smithi106.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-21T16:35:07.234 INFO:teuthology.orchestra.run.smithi106.stdout:ANSI_COLOR="0;31" 2024-03-21T16:35:07.234 INFO:teuthology.orchestra.run.smithi106.stdout:LOGO="fedora-logo-icon" 2024-03-21T16:35:07.234 INFO:teuthology.orchestra.run.smithi106.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-21T16:35:07.234 INFO:teuthology.orchestra.run.smithi106.stdout:HOME_URL="https://centos.org/" 2024-03-21T16:35:07.234 INFO:teuthology.orchestra.run.smithi106.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-21T16:35:07.235 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-21T16:35:07.235 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-21T16:35:07.235 INFO:teuthology.lock.ops:Updating smithi106.front.sepia.ceph.com on lock server 2024-03-21T16:35:07.257 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:35:07.370 INFO:teuthology.dispatcher.supervisor:Running job 7613917 2024-03-21T16:35:07.370 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-03-20_21:24:03-fs-squid-distro-default-smithi/7613917 --name teuthology-2024-03-20_21:24:03-fs-squid-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/suites/ffsb}} -- /home/teuthworker/archive/teuthology-2024-03-20_21:24:03-fs-squid-distro-default-smithi/7613917/orig.config.yaml 2024-03-21T16:35:07.374 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-03-20_21:24:03-fs-squid-distro-default-smithi/7613917 2024-03-21T16:35:07.374 INFO:teuthology.dispatcher.supervisor:Job PID: 1954626 2024-03-21T16:35:07.374 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-03-21T16:37:07.376 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:39:07.451 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:41:07.513 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:43:07.597 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:45:07.675 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:47:07.746 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:49:07.840 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:51:07.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:53:07.991 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:55:08.059 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:57:08.126 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:59:08.204 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T17:01:08.285 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T17:03:08.361 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T17:05:08.436 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T17:07:08.538 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T17:09:08.603 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T17:11:08.677 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T17:13:08.754 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T17:15:08.829 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T17:17:08.906 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T17:19:08.984 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T17:21:09.057 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T17:23:09.131 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T17:25:09.198 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T17:27:09.276 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T17:29:09.338 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T17:31:09.425 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T17:33:09.497 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T17:35:09.581 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T17:37:09.659 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T17:37:09.727 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1