2024-04-04T05:15:28.566 INFO:root:teuthology version: 0.0.1.dev265+gd7d6e60 2024-04-04T05:15:28.567 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T05:15:28.731 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fae82ed5c10>, signals=[15]) 2024-04-04T05:15:28.731 INFO:teuthology.lock.ops:Start node 'smithi121.front.sepia.ceph.com' reimaging 2024-04-04T05:15:28.732 INFO:teuthology.lock.ops:Updating [smithi121.front.sepia.ceph.com]: reset os type and version on server 2024-04-04T05:15:28.732 INFO:teuthology.lock.ops:Updating smithi121.front.sepia.ceph.com on lock server 2024-04-04T05:15:28.752 INFO:teuthology.lock.ops:Start node 'smithi172.front.sepia.ceph.com' reimaging 2024-04-04T05:15:28.752 INFO:teuthology.lock.ops:Updating [smithi172.front.sepia.ceph.com]: reset os type and version on server 2024-04-04T05:15:28.753 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2024-04-04T05:15:28.778 INFO:teuthology.lock.ops:Start node 'smithi187.front.sepia.ceph.com' reimaging 2024-04-04T05:15:28.778 INFO:teuthology.lock.ops:Updating [smithi187.front.sepia.ceph.com]: reset os type and version on server 2024-04-04T05:15:28.778 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2024-04-04T05:15:28.884 DEBUG:teuthology.provision.fog.smithi121:Requesting image smithi_centos_9.stream (ID 10) 2024-04-04T05:15:28.887 DEBUG:teuthology.provision.fog.smithi172:Requesting image smithi_centos_9.stream (ID 10) 2024-04-04T05:15:28.907 DEBUG:teuthology.provision.fog.smithi187:Requesting image smithi_centos_9.stream (ID 10) 2024-04-04T05:15:28.925 INFO:teuthology.provision.fog.smithi172:Scheduling deploy of centos 9.stream 2024-04-04T05:15:28.929 INFO:teuthology.provision.fog.smithi121:Scheduling deploy of centos 9.stream 2024-04-04T05:15:28.961 INFO:teuthology.provision.fog.smithi187:Scheduling deploy of centos 9.stream 2024-04-04T05:15:29.171 INFO:teuthology.orchestra.console.smithi121:Power off 2024-04-04T05:15:29.171 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-04T05:15:29.192 DEBUG:teuthology.orchestra.console.smithi121:power off output: Chassis Power Control: Down/Off 2024-04-04T05:15:29.192 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-04T05:15:29.214 INFO:teuthology.orchestra.console.smithi172:Power off 2024-04-04T05:15:29.214 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-04T05:15:29.226 INFO:teuthology.orchestra.console.smithi187:Power off 2024-04-04T05:15:29.227 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-04T05:15:29.233 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is off 2024-04-04T05:15:29.235 DEBUG:teuthology.orchestra.console.smithi172:power off output: Chassis Power Control: Down/Off 2024-04-04T05:15:29.235 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-04T05:15:29.247 DEBUG:teuthology.orchestra.console.smithi187:power off output: Chassis Power Control: Down/Off 2024-04-04T05:15:29.248 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-04T05:15:29.257 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off 2024-04-04T05:15:29.270 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on 2024-04-04T05:15:29.334 INFO:teuthology.orchestra.console.smithi121:Power off completed 2024-04-04T05:15:29.359 INFO:teuthology.orchestra.console.smithi172:Power off completed 2024-04-04T05:15:29.435 INFO:teuthology.orchestra.console.smithi121:Power on 2024-04-04T05:15:29.435 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-04T05:15:29.458 DEBUG:teuthology.orchestra.console.smithi121:power on output: Chassis Power Control: Up/On 2024-04-04T05:15:29.458 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-04T05:15:29.465 INFO:teuthology.orchestra.console.smithi172:Power on 2024-04-04T05:15:29.465 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-04T05:15:29.479 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is off 2024-04-04T05:15:29.486 DEBUG:teuthology.orchestra.console.smithi172:power on output: Chassis Power Control: Up/On 2024-04-04T05:15:29.486 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-04T05:15:29.506 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off 2024-04-04T05:15:33.277 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-04T05:15:33.386 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on 2024-04-04T05:15:33.481 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-04T05:15:33.508 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-04T05:15:33.590 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is off 2024-04-04T05:15:33.617 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2024-04-04T05:15:33.718 INFO:teuthology.orchestra.console.smithi172:Power on completed 2024-04-04T05:15:33.818 INFO:teuthology.provision.fog.smithi172:Waiting for deploy to finish 2024-04-04T05:15:37.390 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-04T05:15:37.498 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on 2024-04-04T05:15:37.591 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-04T05:15:37.699 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is on 2024-04-04T05:15:37.799 INFO:teuthology.orchestra.console.smithi121:Power on completed 2024-04-04T05:15:37.900 INFO:teuthology.provision.fog.smithi121:Waiting for deploy to finish 2024-04-04T05:15:41.503 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-04T05:15:41.614 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off 2024-04-04T05:15:41.714 INFO:teuthology.orchestra.console.smithi187:Power off completed 2024-04-04T05:15:41.815 INFO:teuthology.orchestra.console.smithi187:Power on 2024-04-04T05:15:41.815 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-04T05:15:41.835 DEBUG:teuthology.orchestra.console.smithi187:power on output: Chassis Power Control: Up/On 2024-04-04T05:15:41.836 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-04T05:15:41.855 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off 2024-04-04T05:15:45.860 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-04T05:15:45.970 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on 2024-04-04T05:15:46.071 INFO:teuthology.orchestra.console.smithi187:Power on completed 2024-04-04T05:15:46.172 INFO:teuthology.provision.fog.smithi187:Waiting for deploy to finish 2024-04-04T05:18:08.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T05:18:11.966 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2024-04-04T05:18:17.969 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T05:18:19.856 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T05:18:21.022 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2024-04-04T05:18:27.028 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T05:18:30.079 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2024-04-04T05:18:32.232 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T05:18:35.294 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2024-04-04T05:18:36.081 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T05:18:38.370 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-04-04T05:18:39.138 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2024-04-04T05:18:41.298 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T05:18:44.350 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2024-04-04T05:18:44.371 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T05:18:45.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T05:18:47.426 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-04-04T05:18:48.194 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2024-04-04T05:18:50.354 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T05:18:53.406 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2024-04-04T05:18:53.427 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T05:18:54.196 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T05:18:56.478 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-04-04T05:18:57.246 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2024-04-04T05:18:59.410 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T05:19:02.462 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2024-04-04T05:19:02.479 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T05:19:03.250 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T05:19:05.538 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-04-04T05:19:06.302 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2024-04-04T05:19:08.466 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T05:19:11.518 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2024-04-04T05:19:11.539 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T05:19:12.305 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T05:19:14.590 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-04-04T05:19:17.521 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T05:19:20.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T05:20:12.359 WARNING:teuthology.provision.fog.smithi121:timed out 2024-04-04T05:20:17.527 WARNING:teuthology.provision.fog.smithi187:timed out 2024-04-04T05:20:18.362 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T05:20:18.609 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-04T05:20:18.610 DEBUG:teuthology.orchestra.run.smithi121:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-04T05:20:18.939 INFO:teuthology.provision.fog.smithi121:Node is ready 2024-04-04T05:20:18.939 DEBUG:teuthology.orchestra.run.smithi121:> hostname 2024-04-04T05:20:18.953 INFO:teuthology.orchestra.run.smithi121.stdout:smithi121.front.sepia.ceph.com 2024-04-04T05:20:18.953 DEBUG:teuthology.orchestra.run.smithi121:> grep smithi121.front.sepia.ceph.com /etc/hosts 2024-04-04T05:20:19.012 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121 smithi121.front.sepia.ceph.com smithi121 2024-04-04T05:20:19.012 DEBUG:teuthology.orchestra.run.smithi121:> sudo hostname smithi121 2024-04-04T05:20:19.135 DEBUG:teuthology.orchestra.run.smithi121:> sudo sed -i -e 's/smithi121.front.sepia.ceph.com/smithi121/g' /etc/hosts 2024-04-04T05:20:19.161 DEBUG:teuthology.orchestra.run.smithi121:> sudo sed -i -e 's/172.21.15.121/172.21.15.121/g' /etc/hosts 2024-04-04T05:20:19.232 DEBUG:teuthology.orchestra.run.smithi121:> sudo sed -i -e 's/smithi121.front.sepia.ceph.com/smithi121/g' /etc/hostname 2024-04-04T05:20:19.303 DEBUG:teuthology.orchestra.run.smithi121:> sudo hostname smithi121 2024-04-04T05:20:19.373 DEBUG:teuthology.orchestra.run.smithi121:> cat /etc/os-release 2024-04-04T05:20:19.431 INFO:teuthology.orchestra.run.smithi121.stdout:NAME="CentOS Stream" 2024-04-04T05:20:19.431 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION="9" 2024-04-04T05:20:19.431 INFO:teuthology.orchestra.run.smithi121.stdout:ID="centos" 2024-04-04T05:20:19.431 INFO:teuthology.orchestra.run.smithi121.stdout:ID_LIKE="rhel fedora" 2024-04-04T05:20:19.431 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_ID="9" 2024-04-04T05:20:19.431 INFO:teuthology.orchestra.run.smithi121.stdout:PLATFORM_ID="platform:el9" 2024-04-04T05:20:19.431 INFO:teuthology.orchestra.run.smithi121.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-04T05:20:19.431 INFO:teuthology.orchestra.run.smithi121.stdout:ANSI_COLOR="0;31" 2024-04-04T05:20:19.431 INFO:teuthology.orchestra.run.smithi121.stdout:LOGO="fedora-logo-icon" 2024-04-04T05:20:19.432 INFO:teuthology.orchestra.run.smithi121.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-04T05:20:19.432 INFO:teuthology.orchestra.run.smithi121.stdout:HOME_URL="https://centos.org/" 2024-04-04T05:20:19.432 INFO:teuthology.orchestra.run.smithi121.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-04T05:20:19.432 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-04T05:20:19.432 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-04T05:20:19.433 INFO:teuthology.provision.fog.smithi121:Deploy complete! 2024-04-04T05:20:19.434 DEBUG:teuthology.parallel:result is None 2024-04-04T05:20:20.598 WARNING:teuthology.provision.fog.smithi172:timed out 2024-04-04T05:20:23.531 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T05:20:23.785 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-04T05:20:23.786 DEBUG:teuthology.orchestra.run.smithi187:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-04T05:20:24.133 INFO:teuthology.provision.fog.smithi187:Node is ready 2024-04-04T05:20:24.134 DEBUG:teuthology.orchestra.run.smithi187:> hostname 2024-04-04T05:20:24.149 INFO:teuthology.orchestra.run.smithi187.stdout:smithi187.front.sepia.ceph.com 2024-04-04T05:20:24.149 DEBUG:teuthology.orchestra.run.smithi187:> grep smithi187.front.sepia.ceph.com /etc/hosts 2024-04-04T05:20:24.204 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.15.187 smithi187.front.sepia.ceph.com smithi187 2024-04-04T05:20:24.205 DEBUG:teuthology.orchestra.run.smithi187:> sudo hostname smithi187 2024-04-04T05:20:24.325 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/smithi187.front.sepia.ceph.com/smithi187/g' /etc/hosts 2024-04-04T05:20:24.352 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/172.21.15.187/172.21.15.187/g' /etc/hosts 2024-04-04T05:20:24.419 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/smithi187.front.sepia.ceph.com/smithi187/g' /etc/hostname 2024-04-04T05:20:24.486 DEBUG:teuthology.orchestra.run.smithi187:> sudo hostname smithi187 2024-04-04T05:20:24.552 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release 2024-04-04T05:20:24.606 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="CentOS Stream" 2024-04-04T05:20:24.606 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="9" 2024-04-04T05:20:24.606 INFO:teuthology.orchestra.run.smithi187.stdout:ID="centos" 2024-04-04T05:20:24.606 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE="rhel fedora" 2024-04-04T05:20:24.606 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="9" 2024-04-04T05:20:24.606 INFO:teuthology.orchestra.run.smithi187.stdout:PLATFORM_ID="platform:el9" 2024-04-04T05:20:24.607 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-04T05:20:24.607 INFO:teuthology.orchestra.run.smithi187.stdout:ANSI_COLOR="0;31" 2024-04-04T05:20:24.607 INFO:teuthology.orchestra.run.smithi187.stdout:LOGO="fedora-logo-icon" 2024-04-04T05:20:24.607 INFO:teuthology.orchestra.run.smithi187.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-04T05:20:24.607 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://centos.org/" 2024-04-04T05:20:24.607 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-04T05:20:24.607 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-04T05:20:24.607 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-04T05:20:24.607 INFO:teuthology.provision.fog.smithi187:Deploy complete! 2024-04-04T05:20:24.608 DEBUG:teuthology.parallel:result is None 2024-04-04T05:20:26.601 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T05:20:26.828 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-04T05:20:26.828 DEBUG:teuthology.orchestra.run.smithi172:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-04T05:20:27.149 INFO:teuthology.provision.fog.smithi172:Node is ready 2024-04-04T05:20:27.149 DEBUG:teuthology.orchestra.run.smithi172:> hostname 2024-04-04T05:20:27.163 INFO:teuthology.orchestra.run.smithi172.stdout:smithi172.front.sepia.ceph.com 2024-04-04T05:20:27.163 DEBUG:teuthology.orchestra.run.smithi172:> grep smithi172.front.sepia.ceph.com /etc/hosts 2024-04-04T05:20:27.222 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.15.172 smithi172.front.sepia.ceph.com smithi172 2024-04-04T05:20:27.222 DEBUG:teuthology.orchestra.run.smithi172:> sudo hostname smithi172 2024-04-04T05:20:27.338 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i -e 's/smithi172.front.sepia.ceph.com/smithi172/g' /etc/hosts 2024-04-04T05:20:27.365 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i -e 's/172.21.15.172/172.21.15.172/g' /etc/hosts 2024-04-04T05:20:27.436 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i -e 's/smithi172.front.sepia.ceph.com/smithi172/g' /etc/hostname 2024-04-04T05:20:27.506 DEBUG:teuthology.orchestra.run.smithi172:> sudo hostname smithi172 2024-04-04T05:20:27.576 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release 2024-04-04T05:20:27.635 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="CentOS Stream" 2024-04-04T05:20:27.635 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="9" 2024-04-04T05:20:27.635 INFO:teuthology.orchestra.run.smithi172.stdout:ID="centos" 2024-04-04T05:20:27.635 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="rhel fedora" 2024-04-04T05:20:27.635 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="9" 2024-04-04T05:20:27.635 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el9" 2024-04-04T05:20:27.635 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-04T05:20:27.635 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31" 2024-04-04T05:20:27.635 INFO:teuthology.orchestra.run.smithi172.stdout:LOGO="fedora-logo-icon" 2024-04-04T05:20:27.635 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-04T05:20:27.635 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://centos.org/" 2024-04-04T05:20:27.636 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-04T05:20:27.636 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-04T05:20:27.636 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-04T05:20:27.636 INFO:teuthology.provision.fog.smithi172:Deploy complete! 2024-04-04T05:20:27.636 DEBUG:teuthology.parallel:result is None 2024-04-04T05:20:27.870 INFO:teuthology.lock.ops:Checking smithi121.front.sepia.ceph.com 2024-04-04T05:20:27.870 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-04T05:20:27.898 INFO:teuthology.lock.ops:Checking smithi172.front.sepia.ceph.com 2024-04-04T05:20:27.898 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-04T05:20:27.915 INFO:teuthology.lock.ops:Checking smithi187.front.sepia.ceph.com 2024-04-04T05:20:27.915 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-04T05:20:27.933 INFO:teuthology.lock.ops:Updating [smithi121.front.sepia.ceph.com]: set os type and version on server 2024-04-04T05:20:27.933 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-04-04T05:20:27.934 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T05:20:28.021 DEBUG:teuthology.orchestra.run.smithi121:> true 2024-04-04T05:20:28.089 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-04-04T05:20:28.089 DEBUG:teuthology.orchestra.run.smithi121:> uname -m 2024-04-04T05:20:28.146 INFO:teuthology.orchestra.run.smithi121.stdout:x86_64 2024-04-04T05:20:28.147 DEBUG:teuthology.orchestra.run.smithi121:> cat /etc/os-release 2024-04-04T05:20:28.201 INFO:teuthology.orchestra.run.smithi121.stdout:NAME="CentOS Stream" 2024-04-04T05:20:28.202 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION="9" 2024-04-04T05:20:28.202 INFO:teuthology.orchestra.run.smithi121.stdout:ID="centos" 2024-04-04T05:20:28.202 INFO:teuthology.orchestra.run.smithi121.stdout:ID_LIKE="rhel fedora" 2024-04-04T05:20:28.202 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_ID="9" 2024-04-04T05:20:28.202 INFO:teuthology.orchestra.run.smithi121.stdout:PLATFORM_ID="platform:el9" 2024-04-04T05:20:28.202 INFO:teuthology.orchestra.run.smithi121.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-04T05:20:28.202 INFO:teuthology.orchestra.run.smithi121.stdout:ANSI_COLOR="0;31" 2024-04-04T05:20:28.202 INFO:teuthology.orchestra.run.smithi121.stdout:LOGO="fedora-logo-icon" 2024-04-04T05:20:28.202 INFO:teuthology.orchestra.run.smithi121.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-04T05:20:28.202 INFO:teuthology.orchestra.run.smithi121.stdout:HOME_URL="https://centos.org/" 2024-04-04T05:20:28.202 INFO:teuthology.orchestra.run.smithi121.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-04T05:20:28.202 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-04T05:20:28.202 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-04T05:20:28.203 INFO:teuthology.lock.ops:Updating smithi121.front.sepia.ceph.com on lock server 2024-04-04T05:20:28.224 INFO:teuthology.lock.ops:Updating [smithi172.front.sepia.ceph.com]: set os type and version on server 2024-04-04T05:20:28.224 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-04-04T05:20:28.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T05:20:28.309 DEBUG:teuthology.orchestra.run.smithi172:> true 2024-04-04T05:20:28.380 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-04-04T05:20:28.381 DEBUG:teuthology.orchestra.run.smithi172:> uname -m 2024-04-04T05:20:28.438 INFO:teuthology.orchestra.run.smithi172.stdout:x86_64 2024-04-04T05:20:28.438 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release 2024-04-04T05:20:28.496 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="CentOS Stream" 2024-04-04T05:20:28.496 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="9" 2024-04-04T05:20:28.496 INFO:teuthology.orchestra.run.smithi172.stdout:ID="centos" 2024-04-04T05:20:28.496 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="rhel fedora" 2024-04-04T05:20:28.496 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="9" 2024-04-04T05:20:28.496 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el9" 2024-04-04T05:20:28.496 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-04T05:20:28.496 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31" 2024-04-04T05:20:28.496 INFO:teuthology.orchestra.run.smithi172.stdout:LOGO="fedora-logo-icon" 2024-04-04T05:20:28.496 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-04T05:20:28.496 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://centos.org/" 2024-04-04T05:20:28.496 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-04T05:20:28.496 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-04T05:20:28.497 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-04T05:20:28.497 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2024-04-04T05:20:28.523 INFO:teuthology.lock.ops:Updating [smithi187.front.sepia.ceph.com]: set os type and version on server 2024-04-04T05:20:28.523 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2024-04-04T05:20:28.524 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T05:20:28.611 DEBUG:teuthology.orchestra.run.smithi187:> true 2024-04-04T05:20:28.682 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi187.front.sepia.ceph.com' 2024-04-04T05:20:28.682 DEBUG:teuthology.orchestra.run.smithi187:> uname -m 2024-04-04T05:20:28.738 INFO:teuthology.orchestra.run.smithi187.stdout:x86_64 2024-04-04T05:20:28.738 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release 2024-04-04T05:20:28.793 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="CentOS Stream" 2024-04-04T05:20:28.794 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="9" 2024-04-04T05:20:28.794 INFO:teuthology.orchestra.run.smithi187.stdout:ID="centos" 2024-04-04T05:20:28.794 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE="rhel fedora" 2024-04-04T05:20:28.794 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="9" 2024-04-04T05:20:28.794 INFO:teuthology.orchestra.run.smithi187.stdout:PLATFORM_ID="platform:el9" 2024-04-04T05:20:28.794 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-04T05:20:28.794 INFO:teuthology.orchestra.run.smithi187.stdout:ANSI_COLOR="0;31" 2024-04-04T05:20:28.794 INFO:teuthology.orchestra.run.smithi187.stdout:LOGO="fedora-logo-icon" 2024-04-04T05:20:28.794 INFO:teuthology.orchestra.run.smithi187.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-04T05:20:28.794 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://centos.org/" 2024-04-04T05:20:28.794 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-04T05:20:28.794 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-04T05:20:28.794 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-04T05:20:28.795 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2024-04-04T05:20:28.815 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T05:20:28.910 INFO:teuthology.dispatcher.supervisor:Running job 7638591 2024-04-04T05:20:28.910 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_d7d6e60867cadf19fbfd7655a551ae7d58060757/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-04-03_21:24:03-fs-squid-distro-default-smithi/7638591 --name teuthology-2024-04-03_21:24:03-fs-squid-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/suites/blogbench}} -- /home/teuthworker/archive/teuthology-2024-04-03_21:24:03-fs-squid-distro-default-smithi/7638591/orig.config.yaml 2024-04-04T05:20:28.914 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-04-03_21:24:03-fs-squid-distro-default-smithi/7638591 2024-04-04T05:20:28.914 INFO:teuthology.dispatcher.supervisor:Job PID: 1124959 2024-04-04T05:20:28.914 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-04T05:22:29.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T05:24:29.179 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T05:26:29.347 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T05:28:29.513 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T05:30:29.685 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T05:32:29.855 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T05:34:30.011 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T05:36:30.183 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T05:38:30.347 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T05:40:30.523 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T05:42:30.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T05:44:30.868 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T05:46:31.053 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T05:48:31.223 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T05:50:31.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T05:52:31.567 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T05:54:31.751 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T05:56:31.923 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T05:58:32.087 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T06:00:32.256 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T06:02:32.418 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T06:04:32.573 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T06:06:32.741 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T06:08:32.905 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T06:10:33.075 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T06:12:33.267 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T06:14:33.427 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T06:16:33.607 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T06:18:33.775 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T06:20:33.930 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T06:22:34.063 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T06:24:34.240 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T06:26:34.389 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T06:28:34.567 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T06:30:34.731 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T06:32:34.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T06:34:35.083 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T06:36:35.248 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T06:38:35.423 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T06:40:35.625 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T06:42:35.800 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T06:42:35.871 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1