2024-04-17T22:54:11.565 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-17T22:54:11.565 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T22:54:11.738 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f642c73bc10>, signals=[15]) 2024-04-17T22:54:11.738 INFO:teuthology.lock.ops:Start node 'smithi026.front.sepia.ceph.com' reimaging 2024-04-17T22:54:11.738 INFO:teuthology.lock.ops:Updating [smithi026.front.sepia.ceph.com]: reset os type and version on server 2024-04-17T22:54:11.738 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server 2024-04-17T22:54:11.764 INFO:teuthology.lock.ops:Start node 'smithi133.front.sepia.ceph.com' reimaging 2024-04-17T22:54:11.765 INFO:teuthology.lock.ops:Updating [smithi133.front.sepia.ceph.com]: reset os type and version on server 2024-04-17T22:54:11.765 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2024-04-17T22:54:11.781 INFO:teuthology.lock.ops:Start node 'smithi136.front.sepia.ceph.com' reimaging 2024-04-17T22:54:11.781 INFO:teuthology.lock.ops:Updating [smithi136.front.sepia.ceph.com]: reset os type and version on server 2024-04-17T22:54:11.781 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server 2024-04-17T22:54:11.878 DEBUG:teuthology.provision.fog.smithi026:Requesting image smithi_centos_9.stream (ID 10) 2024-04-17T22:54:11.888 DEBUG:teuthology.provision.fog.smithi133:Requesting image smithi_centos_9.stream (ID 10) 2024-04-17T22:54:11.901 DEBUG:teuthology.provision.fog.smithi136:Requesting image smithi_centos_9.stream (ID 10) 2024-04-17T22:54:11.915 INFO:teuthology.provision.fog.smithi026:Scheduling deploy of centos 9.stream 2024-04-17T22:54:11.924 INFO:teuthology.provision.fog.smithi133:Scheduling deploy of centos 9.stream 2024-04-17T22:54:11.943 INFO:teuthology.provision.fog.smithi136:Scheduling deploy of centos 9.stream 2024-04-17T22:54:12.236 INFO:teuthology.orchestra.console.smithi026:Power off 2024-04-17T22:54:12.236 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-17T22:54:12.249 INFO:teuthology.orchestra.console.smithi136:Power off 2024-04-17T22:54:12.249 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-17T22:54:12.260 DEBUG:teuthology.orchestra.console.smithi026:power off output: Chassis Power Control: Down/Off 2024-04-17T22:54:12.260 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T22:54:12.270 DEBUG:teuthology.orchestra.console.smithi136:power off output: Chassis Power Control: Down/Off 2024-04-17T22:54:12.271 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T22:54:12.284 INFO:teuthology.orchestra.console.smithi133:Power off 2024-04-17T22:54:12.285 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-17T22:54:12.294 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off 2024-04-17T22:54:12.294 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is off 2024-04-17T22:54:12.306 DEBUG:teuthology.orchestra.console.smithi133:power off output: Chassis Power Control: Down/Off 2024-04-17T22:54:12.306 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T22:54:12.326 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2024-04-17T22:54:12.395 INFO:teuthology.orchestra.console.smithi136:Power off completed 2024-04-17T22:54:12.396 INFO:teuthology.orchestra.console.smithi026:Power off completed 2024-04-17T22:54:12.427 INFO:teuthology.orchestra.console.smithi133:Power off completed 2024-04-17T22:54:12.497 INFO:teuthology.orchestra.console.smithi136:Power on 2024-04-17T22:54:12.497 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-17T22:54:12.505 INFO:teuthology.orchestra.console.smithi026:Power on 2024-04-17T22:54:12.505 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-17T22:54:12.518 DEBUG:teuthology.orchestra.console.smithi136:power on output: Chassis Power Control: Up/On 2024-04-17T22:54:12.518 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T22:54:12.527 DEBUG:teuthology.orchestra.console.smithi026:power on output: Chassis Power Control: Up/On 2024-04-17T22:54:12.528 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T22:54:12.534 INFO:teuthology.orchestra.console.smithi133:Power on 2024-04-17T22:54:12.535 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-17T22:54:12.543 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off 2024-04-17T22:54:12.547 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is off 2024-04-17T22:54:12.561 DEBUG:teuthology.orchestra.console.smithi133:power on output: Chassis Power Control: Up/On 2024-04-17T22:54:12.562 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T22:54:12.588 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2024-04-17T22:54:16.548 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T22:54:16.555 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T22:54:16.589 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T22:54:16.658 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on 2024-04-17T22:54:16.664 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is on 2024-04-17T22:54:16.697 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2024-04-17T22:54:16.759 INFO:teuthology.orchestra.console.smithi136:Power on completed 2024-04-17T22:54:16.765 INFO:teuthology.orchestra.console.smithi026:Power on completed 2024-04-17T22:54:16.860 INFO:teuthology.provision.fog.smithi136:Waiting for deploy to finish 2024-04-17T22:54:16.865 INFO:teuthology.provision.fog.smithi026:Waiting for deploy to finish 2024-04-17T22:54:20.702 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T22:54:20.812 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2024-04-17T22:54:20.912 INFO:teuthology.orchestra.console.smithi133:Power on completed 2024-04-17T22:54:21.013 INFO:teuthology.provision.fog.smithi133:Waiting for deploy to finish 2024-04-17T22:56:33.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T22:56:48.213 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T22:56:48.511 ERROR:teuthology.orchestra.connection:Error authenticating with smithi136.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-04-17T22:56:51.486 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2024-04-17T22:56:57.487 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T22:57:00.542 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2024-04-17T22:57:06.543 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T22:57:09.598 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2024-04-17T22:57:15.600 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T22:57:18.654 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2024-04-17T22:57:24.656 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T22:57:27.710 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2024-04-17T22:57:33.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T22:57:36.766 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2024-04-17T22:57:37.613 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T22:57:40.674 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-04-17T22:57:42.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T22:57:45.826 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2024-04-17T22:57:46.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T22:57:49.726 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-04-17T22:57:51.828 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T22:57:52.514 WARNING:teuthology.provision.fog.smithi136:timed out 2024-04-17T22:57:54.878 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2024-04-17T22:57:55.728 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T22:57:58.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T22:57:58.782 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-04-17T22:58:00.880 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T22:58:03.934 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2024-04-17T22:58:04.784 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T22:58:07.838 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-04-17T22:58:09.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T22:58:12.990 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2024-04-17T22:58:13.840 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T22:58:16.898 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-04-17T22:58:16.990 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-04-17T22:58:18.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T22:58:22.046 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2024-04-17T22:58:22.900 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T22:58:22.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T22:58:23.129 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-04-17T22:58:25.950 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-04-17T22:58:28.047 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T22:58:29.130 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T22:58:29.377 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-17T22:58:29.378 DEBUG:teuthology.orchestra.run.smithi136:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-17T22:58:31.952 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T22:58:35.006 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-04-17T22:58:38.238 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2024-04-17T22:58:41.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T22:58:44.240 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T22:58:47.298 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2024-04-17T22:58:49.950 INFO:teuthology.provision.fog.smithi136:Node is ready 2024-04-17T22:58:49.950 DEBUG:teuthology.orchestra.run.smithi136:> hostname 2024-04-17T22:58:49.969 INFO:teuthology.orchestra.run.smithi136.stdout:smithi046 2024-04-17T22:58:49.969 DEBUG:teuthology.orchestra.run.smithi136:> grep smithi046 /etc/hosts 2024-04-17T22:58:50.025 INFO:teuthology.orchestra.run.smithi136.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2024-04-17T22:58:50.026 DEBUG:teuthology.orchestra.run.smithi136:> sudo hostname smithi136 2024-04-17T22:58:50.220 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/smithi046/smithi136/g' /etc/hosts 2024-04-17T22:58:50.251 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/172.21.15.46/172.21.15.136/g' /etc/hosts 2024-04-17T22:58:50.321 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/smithi046/smithi136/g' /etc/hostname 2024-04-17T22:58:50.392 DEBUG:teuthology.orchestra.run.smithi136:> sudo hostname smithi136 2024-04-17T22:58:50.460 DEBUG:teuthology.orchestra.run.smithi136:> cat /etc/os-release 2024-04-17T22:58:50.516 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="CentOS Stream" 2024-04-17T22:58:50.516 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="9" 2024-04-17T22:58:50.516 INFO:teuthology.orchestra.run.smithi136.stdout:ID="centos" 2024-04-17T22:58:50.516 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE="rhel fedora" 2024-04-17T22:58:50.516 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="9" 2024-04-17T22:58:50.516 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM_ID="platform:el9" 2024-04-17T22:58:50.516 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T22:58:50.516 INFO:teuthology.orchestra.run.smithi136.stdout:ANSI_COLOR="0;31" 2024-04-17T22:58:50.516 INFO:teuthology.orchestra.run.smithi136.stdout:LOGO="fedora-logo-icon" 2024-04-17T22:58:50.516 INFO:teuthology.orchestra.run.smithi136.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T22:58:50.517 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://centos.org/" 2024-04-17T22:58:50.517 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T22:58:50.517 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T22:58:50.517 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T22:58:50.517 INFO:teuthology.provision.fog.smithi136:Deploy complete! 2024-04-17T22:58:50.519 DEBUG:teuthology.parallel:result is None 2024-04-17T22:58:53.300 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T22:58:56.354 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2024-04-17T22:59:02.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T22:59:02.598 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-17T22:59:02.599 DEBUG:teuthology.orchestra.run.smithi026:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-17T22:59:23.079 INFO:teuthology.provision.fog.smithi026:Node is ready 2024-04-17T22:59:23.079 DEBUG:teuthology.orchestra.run.smithi026:> hostname 2024-04-17T22:59:23.098 INFO:teuthology.orchestra.run.smithi026.stdout:smithi026.front.sepia.ceph.com 2024-04-17T22:59:23.099 DEBUG:teuthology.orchestra.run.smithi026:> grep smithi026.front.sepia.ceph.com /etc/hosts 2024-04-17T22:59:23.156 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26 smithi026.front.sepia.ceph.com smithi026 2024-04-17T22:59:23.156 DEBUG:teuthology.orchestra.run.smithi026:> sudo hostname smithi026 2024-04-17T22:59:23.285 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/smithi026.front.sepia.ceph.com/smithi026/g' /etc/hosts 2024-04-17T22:59:23.319 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/172.21.15.26/172.21.15.26/g' /etc/hosts 2024-04-17T22:59:23.392 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/smithi026.front.sepia.ceph.com/smithi026/g' /etc/hostname 2024-04-17T22:59:23.465 DEBUG:teuthology.orchestra.run.smithi026:> sudo hostname smithi026 2024-04-17T22:59:23.537 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release 2024-04-17T22:59:23.593 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="CentOS Stream" 2024-04-17T22:59:23.593 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="9" 2024-04-17T22:59:23.593 INFO:teuthology.orchestra.run.smithi026.stdout:ID="centos" 2024-04-17T22:59:23.593 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE="rhel fedora" 2024-04-17T22:59:23.594 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="9" 2024-04-17T22:59:23.594 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM_ID="platform:el9" 2024-04-17T22:59:23.594 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T22:59:23.594 INFO:teuthology.orchestra.run.smithi026.stdout:ANSI_COLOR="0;31" 2024-04-17T22:59:23.594 INFO:teuthology.orchestra.run.smithi026.stdout:LOGO="fedora-logo-icon" 2024-04-17T22:59:23.594 INFO:teuthology.orchestra.run.smithi026.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T22:59:23.594 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://centos.org/" 2024-04-17T22:59:23.594 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T22:59:23.594 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T22:59:23.594 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T22:59:23.594 INFO:teuthology.provision.fog.smithi026:Deploy complete! 2024-04-17T22:59:23.595 DEBUG:teuthology.parallel:result is None 2024-04-17T22:59:41.010 WARNING:teuthology.provision.fog.smithi133:timed out 2024-04-17T22:59:47.013 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T22:59:47.420 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-17T22:59:47.420 DEBUG:teuthology.orchestra.run.smithi133:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-17T22:59:47.732 INFO:teuthology.provision.fog.smithi133:Node is ready 2024-04-17T22:59:47.732 DEBUG:teuthology.orchestra.run.smithi133:> hostname 2024-04-17T22:59:47.747 INFO:teuthology.orchestra.run.smithi133.stdout:smithi133.front.sepia.ceph.com 2024-04-17T22:59:47.747 DEBUG:teuthology.orchestra.run.smithi133:> grep smithi133.front.sepia.ceph.com /etc/hosts 2024-04-17T22:59:47.802 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.15.133 smithi133.front.sepia.ceph.com smithi133 2024-04-17T22:59:47.803 DEBUG:teuthology.orchestra.run.smithi133:> sudo hostname smithi133 2024-04-17T22:59:47.901 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/smithi133.front.sepia.ceph.com/smithi133/g' /etc/hosts 2024-04-17T22:59:47.929 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/172.21.15.133/172.21.15.133/g' /etc/hosts 2024-04-17T22:59:47.996 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/smithi133.front.sepia.ceph.com/smithi133/g' /etc/hostname 2024-04-17T22:59:48.063 DEBUG:teuthology.orchestra.run.smithi133:> sudo hostname smithi133 2024-04-17T22:59:48.129 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release 2024-04-17T22:59:48.183 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="CentOS Stream" 2024-04-17T22:59:48.183 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="9" 2024-04-17T22:59:48.184 INFO:teuthology.orchestra.run.smithi133.stdout:ID="centos" 2024-04-17T22:59:48.184 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE="rhel fedora" 2024-04-17T22:59:48.184 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="9" 2024-04-17T22:59:48.184 INFO:teuthology.orchestra.run.smithi133.stdout:PLATFORM_ID="platform:el9" 2024-04-17T22:59:48.184 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T22:59:48.184 INFO:teuthology.orchestra.run.smithi133.stdout:ANSI_COLOR="0;31" 2024-04-17T22:59:48.184 INFO:teuthology.orchestra.run.smithi133.stdout:LOGO="fedora-logo-icon" 2024-04-17T22:59:48.184 INFO:teuthology.orchestra.run.smithi133.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T22:59:48.184 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://centos.org/" 2024-04-17T22:59:48.184 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T22:59:48.184 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T22:59:48.184 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T22:59:48.185 INFO:teuthology.provision.fog.smithi133:Deploy complete! 2024-04-17T22:59:48.185 DEBUG:teuthology.parallel:result is None 2024-04-17T22:59:48.402 INFO:teuthology.lock.ops:Checking smithi026.front.sepia.ceph.com 2024-04-17T22:59:48.402 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-17T22:59:48.435 INFO:teuthology.lock.ops:Checking smithi133.front.sepia.ceph.com 2024-04-17T22:59:48.435 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-17T22:59:48.451 INFO:teuthology.lock.ops:Checking smithi136.front.sepia.ceph.com 2024-04-17T22:59:48.451 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-17T22:59:48.470 INFO:teuthology.lock.ops:Updating [smithi026.front.sepia.ceph.com]: set os type and version on server 2024-04-17T22:59:48.470 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2024-04-17T22:59:48.471 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T22:59:48.574 DEBUG:teuthology.orchestra.run.smithi026:> true 2024-04-17T22:59:48.647 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi026.front.sepia.ceph.com' 2024-04-17T22:59:48.647 DEBUG:teuthology.orchestra.run.smithi026:> uname -m 2024-04-17T22:59:48.703 INFO:teuthology.orchestra.run.smithi026.stdout:x86_64 2024-04-17T22:59:48.703 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release 2024-04-17T22:59:48.759 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="CentOS Stream" 2024-04-17T22:59:48.759 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="9" 2024-04-17T22:59:48.759 INFO:teuthology.orchestra.run.smithi026.stdout:ID="centos" 2024-04-17T22:59:48.759 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE="rhel fedora" 2024-04-17T22:59:48.759 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="9" 2024-04-17T22:59:48.759 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM_ID="platform:el9" 2024-04-17T22:59:48.759 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T22:59:48.759 INFO:teuthology.orchestra.run.smithi026.stdout:ANSI_COLOR="0;31" 2024-04-17T22:59:48.759 INFO:teuthology.orchestra.run.smithi026.stdout:LOGO="fedora-logo-icon" 2024-04-17T22:59:48.759 INFO:teuthology.orchestra.run.smithi026.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T22:59:48.759 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://centos.org/" 2024-04-17T22:59:48.759 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T22:59:48.759 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T22:59:48.760 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T22:59:48.760 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server 2024-04-17T22:59:48.794 INFO:teuthology.lock.ops:Updating [smithi133.front.sepia.ceph.com]: set os type and version on server 2024-04-17T22:59:48.794 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-04-17T22:59:48.795 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T22:59:48.879 DEBUG:teuthology.orchestra.run.smithi133:> true 2024-04-17T22:59:48.949 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-04-17T22:59:48.949 DEBUG:teuthology.orchestra.run.smithi133:> uname -m 2024-04-17T22:59:49.004 INFO:teuthology.orchestra.run.smithi133.stdout:x86_64 2024-04-17T22:59:49.004 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release 2024-04-17T22:59:49.058 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="CentOS Stream" 2024-04-17T22:59:49.059 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="9" 2024-04-17T22:59:49.059 INFO:teuthology.orchestra.run.smithi133.stdout:ID="centos" 2024-04-17T22:59:49.059 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE="rhel fedora" 2024-04-17T22:59:49.059 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="9" 2024-04-17T22:59:49.059 INFO:teuthology.orchestra.run.smithi133.stdout:PLATFORM_ID="platform:el9" 2024-04-17T22:59:49.059 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T22:59:49.059 INFO:teuthology.orchestra.run.smithi133.stdout:ANSI_COLOR="0;31" 2024-04-17T22:59:49.059 INFO:teuthology.orchestra.run.smithi133.stdout:LOGO="fedora-logo-icon" 2024-04-17T22:59:49.059 INFO:teuthology.orchestra.run.smithi133.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T22:59:49.059 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://centos.org/" 2024-04-17T22:59:49.059 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T22:59:49.059 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T22:59:49.060 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T22:59:49.060 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2024-04-17T22:59:49.086 INFO:teuthology.lock.ops:Updating [smithi136.front.sepia.ceph.com]: set os type and version on server 2024-04-17T22:59:49.086 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-04-17T22:59:49.086 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T22:59:49.172 DEBUG:teuthology.orchestra.run.smithi136:> true 2024-04-17T22:59:49.349 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-04-17T22:59:49.349 DEBUG:teuthology.orchestra.run.smithi136:> uname -m 2024-04-17T22:59:49.404 INFO:teuthology.orchestra.run.smithi136.stdout:x86_64 2024-04-17T22:59:49.405 DEBUG:teuthology.orchestra.run.smithi136:> cat /etc/os-release 2024-04-17T22:59:49.458 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="CentOS Stream" 2024-04-17T22:59:49.458 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="9" 2024-04-17T22:59:49.459 INFO:teuthology.orchestra.run.smithi136.stdout:ID="centos" 2024-04-17T22:59:49.459 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE="rhel fedora" 2024-04-17T22:59:49.459 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="9" 2024-04-17T22:59:49.459 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM_ID="platform:el9" 2024-04-17T22:59:49.459 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T22:59:49.459 INFO:teuthology.orchestra.run.smithi136.stdout:ANSI_COLOR="0;31" 2024-04-17T22:59:49.459 INFO:teuthology.orchestra.run.smithi136.stdout:LOGO="fedora-logo-icon" 2024-04-17T22:59:49.459 INFO:teuthology.orchestra.run.smithi136.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T22:59:49.459 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://centos.org/" 2024-04-17T22:59:49.459 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T22:59:49.459 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T22:59:49.459 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T22:59:49.460 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server 2024-04-17T22:59:49.486 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T22:59:49.599 INFO:teuthology.dispatcher.supervisor:Running job 7661223 2024-04-17T22:59:49.599 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-04-17_21:24:02-fs-squid-distro-default-smithi/7661223 --name teuthology-2024-04-17_21:24:02-fs-squid-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-workunit/suites/fsync-tester}} -- /home/teuthworker/archive/teuthology-2024-04-17_21:24:02-fs-squid-distro-default-smithi/7661223/orig.config.yaml 2024-04-17T22:59:49.604 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-04-17_21:24:02-fs-squid-distro-default-smithi/7661223 2024-04-17T22:59:49.605 INFO:teuthology.dispatcher.supervisor:Job PID: 3661866 2024-04-17T22:59:49.605 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-17T23:01:49.610 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T23:03:49.683 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T23:05:49.760 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T23:07:49.828 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T23:09:49.904 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T23:09:49.973 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1