2024-03-11T17:53:01.263 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-11T17:53:01.263 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T17:53:01.436 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f42275e5c10>, signals=[15]) 2024-03-11T17:53:01.436 INFO:teuthology.lock.ops:Start node 'smithi094.front.sepia.ceph.com' reimaging 2024-03-11T17:53:01.437 INFO:teuthology.lock.ops:Updating [smithi094.front.sepia.ceph.com]: reset os type and version on server 2024-03-11T17:53:01.437 INFO:teuthology.lock.ops:Updating smithi094.front.sepia.ceph.com on lock server 2024-03-11T17:53:01.457 INFO:teuthology.lock.ops:Start node 'smithi150.front.sepia.ceph.com' reimaging 2024-03-11T17:53:01.457 INFO:teuthology.lock.ops:Updating [smithi150.front.sepia.ceph.com]: reset os type and version on server 2024-03-11T17:53:01.458 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server 2024-03-11T17:53:01.474 INFO:teuthology.lock.ops:Start node 'smithi162.front.sepia.ceph.com' reimaging 2024-03-11T17:53:01.474 INFO:teuthology.lock.ops:Updating [smithi162.front.sepia.ceph.com]: reset os type and version on server 2024-03-11T17:53:01.474 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server 2024-03-11T17:53:01.581 DEBUG:teuthology.provision.fog.smithi094:Requesting image smithi_centos_9.stream (ID 10) 2024-03-11T17:53:01.585 DEBUG:teuthology.provision.fog.smithi150:Requesting image smithi_centos_9.stream (ID 10) 2024-03-11T17:53:01.590 DEBUG:teuthology.provision.fog.smithi162:Requesting image smithi_centos_9.stream (ID 10) 2024-03-11T17:53:01.620 INFO:teuthology.provision.fog.smithi094:Scheduling deploy of centos 9.stream 2024-03-11T17:53:01.632 INFO:teuthology.provision.fog.smithi162:Scheduling deploy of centos 9.stream 2024-03-11T17:53:01.636 INFO:teuthology.provision.fog.smithi150:Scheduling deploy of centos 9.stream 2024-03-11T17:53:01.858 INFO:teuthology.orchestra.console.smithi094:Power off 2024-03-11T17:53:01.859 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-11T17:53:01.872 INFO:teuthology.orchestra.console.smithi150:Power off 2024-03-11T17:53:01.872 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-11T17:53:01.886 INFO:teuthology.orchestra.console.smithi162:Power off 2024-03-11T17:53:01.886 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-11T17:53:01.893 DEBUG:teuthology.orchestra.console.smithi094:power off output: Chassis Power Control: Down/Off 2024-03-11T17:53:01.893 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T17:53:01.901 DEBUG:teuthology.orchestra.console.smithi150:power off output: Chassis Power Control: Down/Off 2024-03-11T17:53:01.901 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T17:53:01.909 DEBUG:teuthology.orchestra.console.smithi162:power off output: Chassis Power Control: Down/Off 2024-03-11T17:53:01.910 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T17:53:01.917 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is off 2024-03-11T17:53:01.928 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is on 2024-03-11T17:53:01.930 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is on 2024-03-11T17:53:02.018 INFO:teuthology.orchestra.console.smithi094:Power off completed 2024-03-11T17:53:02.119 INFO:teuthology.orchestra.console.smithi094:Power on 2024-03-11T17:53:02.119 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-11T17:53:02.140 DEBUG:teuthology.orchestra.console.smithi094:power on output: Chassis Power Control: Up/On 2024-03-11T17:53:02.140 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T17:53:02.159 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is off 2024-03-11T17:53:05.931 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T17:53:05.939 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T17:53:06.042 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is on 2024-03-11T17:53:06.048 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is on 2024-03-11T17:53:06.160 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T17:53:06.269 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is on 2024-03-11T17:53:06.369 INFO:teuthology.orchestra.console.smithi094:Power on completed 2024-03-11T17:53:06.470 INFO:teuthology.provision.fog.smithi094:Waiting for deploy to finish 2024-03-11T17:53:10.045 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T17:53:10.052 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T17:53:10.154 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is off 2024-03-11T17:53:10.161 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is on 2024-03-11T17:53:10.256 INFO:teuthology.orchestra.console.smithi150:Power off completed 2024-03-11T17:53:10.356 INFO:teuthology.orchestra.console.smithi150:Power on 2024-03-11T17:53:10.357 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-11T17:53:10.378 DEBUG:teuthology.orchestra.console.smithi150:power on output: Chassis Power Control: Up/On 2024-03-11T17:53:10.378 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T17:53:10.399 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is off 2024-03-11T17:53:14.166 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T17:53:14.274 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is off 2024-03-11T17:53:14.375 INFO:teuthology.orchestra.console.smithi162:Power off completed 2024-03-11T17:53:14.400 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T17:53:14.476 INFO:teuthology.orchestra.console.smithi162:Power on 2024-03-11T17:53:14.477 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-11T17:53:14.498 DEBUG:teuthology.orchestra.console.smithi162:power on output: Chassis Power Control: Up/On 2024-03-11T17:53:14.498 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T17:53:14.510 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is off 2024-03-11T17:53:14.519 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is off 2024-03-11T17:53:18.514 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T17:53:18.522 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T17:53:18.624 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is on 2024-03-11T17:53:18.630 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is off 2024-03-11T17:53:18.725 INFO:teuthology.orchestra.console.smithi150:Power on completed 2024-03-11T17:53:18.826 INFO:teuthology.provision.fog.smithi150:Waiting for deploy to finish 2024-03-11T17:53:22.632 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T17:53:22.740 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is on 2024-03-11T17:53:22.841 INFO:teuthology.orchestra.console.smithi162:Power on completed 2024-03-11T17:53:22.942 INFO:teuthology.provision.fog.smithi162:Waiting for deploy to finish 2024-03-11T17:55:37.294 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T17:55:40.350 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94 2024-03-11T17:55:46.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T17:55:49.406 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94 2024-03-11T17:55:55.409 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T17:55:58.462 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94 2024-03-11T17:56:04.469 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T17:56:04.792 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T17:56:07.554 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94 2024-03-11T17:56:07.870 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2024-03-11T17:56:08.826 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T17:56:11.906 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2024-03-11T17:56:13.558 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T17:56:13.872 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T17:56:16.638 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94 2024-03-11T17:56:16.926 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2024-03-11T17:56:17.909 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T17:56:20.990 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2024-03-11T17:56:22.640 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T17:56:22.928 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T17:56:25.694 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94 2024-03-11T17:56:25.982 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2024-03-11T17:56:26.993 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T17:56:30.046 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2024-03-11T17:56:31.697 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T17:56:31.985 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T17:56:35.038 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2024-03-11T17:56:36.049 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T17:56:39.106 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2024-03-11T17:56:41.041 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T17:56:44.094 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2024-03-11T17:56:45.109 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T17:56:48.194 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2024-03-11T17:56:50.098 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T17:56:53.150 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2024-03-11T17:56:54.196 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T17:56:57.250 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2024-03-11T17:56:59.153 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T17:57:02.210 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2024-03-11T17:57:03.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T17:57:06.306 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2024-03-11T17:57:08.213 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T17:57:12.312 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T17:57:26.687 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2024-03-11T17:57:30.782 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2024-03-11T17:57:31.700 WARNING:teuthology.provision.fog.smithi094:timed out 2024-03-11T17:57:32.689 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T17:57:35.746 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2024-03-11T17:57:36.785 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T17:57:37.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T17:57:38.031 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-11T17:57:38.032 DEBUG:teuthology.orchestra.run.smithi094:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-11T17:57:38.371 INFO:teuthology.provision.fog.smithi094:Node is ready 2024-03-11T17:57:38.372 DEBUG:teuthology.orchestra.run.smithi094:> hostname 2024-03-11T17:57:38.386 INFO:teuthology.orchestra.run.smithi094.stdout:smithi094.front.sepia.ceph.com 2024-03-11T17:57:38.386 DEBUG:teuthology.orchestra.run.smithi094:> grep smithi094.front.sepia.ceph.com /etc/hosts 2024-03-11T17:57:38.441 INFO:teuthology.orchestra.run.smithi094.stdout:172.21.15.94 smithi094.front.sepia.ceph.com smithi094 2024-03-11T17:57:38.441 DEBUG:teuthology.orchestra.run.smithi094:> sudo hostname smithi094 2024-03-11T17:57:38.563 DEBUG:teuthology.orchestra.run.smithi094:> sudo sed -i -e 's/smithi094.front.sepia.ceph.com/smithi094/g' /etc/hosts 2024-03-11T17:57:38.590 DEBUG:teuthology.orchestra.run.smithi094:> sudo sed -i -e 's/172.21.15.94/172.21.15.94/g' /etc/hosts 2024-03-11T17:57:38.657 DEBUG:teuthology.orchestra.run.smithi094:> sudo sed -i -e 's/smithi094.front.sepia.ceph.com/smithi094/g' /etc/hostname 2024-03-11T17:57:38.724 DEBUG:teuthology.orchestra.run.smithi094:> sudo hostname smithi094 2024-03-11T17:57:38.790 DEBUG:teuthology.orchestra.run.smithi094:> cat /etc/os-release 2024-03-11T17:57:38.845 INFO:teuthology.orchestra.run.smithi094.stdout:NAME="CentOS Stream" 2024-03-11T17:57:38.846 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION="9" 2024-03-11T17:57:38.846 INFO:teuthology.orchestra.run.smithi094.stdout:ID="centos" 2024-03-11T17:57:38.846 INFO:teuthology.orchestra.run.smithi094.stdout:ID_LIKE="rhel fedora" 2024-03-11T17:57:38.846 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION_ID="9" 2024-03-11T17:57:38.846 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM_ID="platform:el9" 2024-03-11T17:57:38.846 INFO:teuthology.orchestra.run.smithi094.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-11T17:57:38.846 INFO:teuthology.orchestra.run.smithi094.stdout:ANSI_COLOR="0;31" 2024-03-11T17:57:38.846 INFO:teuthology.orchestra.run.smithi094.stdout:LOGO="fedora-logo-icon" 2024-03-11T17:57:38.846 INFO:teuthology.orchestra.run.smithi094.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-11T17:57:38.846 INFO:teuthology.orchestra.run.smithi094.stdout:HOME_URL="https://centos.org/" 2024-03-11T17:57:38.846 INFO:teuthology.orchestra.run.smithi094.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-11T17:57:38.846 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-11T17:57:38.847 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-11T17:57:38.848 INFO:teuthology.provision.fog.smithi094:Deploy complete! 2024-03-11T17:57:38.850 DEBUG:teuthology.parallel:result is None 2024-03-11T17:57:39.838 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2024-03-11T17:57:41.750 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T17:57:45.844 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T17:57:49.214 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-11T17:57:49.214 DEBUG:teuthology.orchestra.run.smithi150:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-11T17:57:53.305 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-11T17:57:53.306 DEBUG:teuthology.orchestra.run.smithi162:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-11T17:58:13.596 INFO:teuthology.provision.fog.smithi162:Node is ready 2024-03-11T17:58:13.597 DEBUG:teuthology.orchestra.run.smithi162:> hostname 2024-03-11T17:58:13.616 INFO:teuthology.orchestra.run.smithi162.stdout:smithi162.front.sepia.ceph.com 2024-03-11T17:58:13.616 DEBUG:teuthology.orchestra.run.smithi162:> grep smithi162.front.sepia.ceph.com /etc/hosts 2024-03-11T17:58:13.673 INFO:teuthology.orchestra.run.smithi162.stdout:172.21.15.162 smithi162.front.sepia.ceph.com smithi162 2024-03-11T17:58:13.673 DEBUG:teuthology.orchestra.run.smithi162:> sudo hostname smithi162 2024-03-11T17:58:13.803 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i -e 's/smithi162.front.sepia.ceph.com/smithi162/g' /etc/hosts 2024-03-11T17:58:13.833 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i -e 's/172.21.15.162/172.21.15.162/g' /etc/hosts 2024-03-11T17:58:13.902 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i -e 's/smithi162.front.sepia.ceph.com/smithi162/g' /etc/hostname 2024-03-11T17:58:13.970 DEBUG:teuthology.orchestra.run.smithi162:> sudo hostname smithi162 2024-03-11T17:58:14.037 DEBUG:teuthology.orchestra.run.smithi162:> cat /etc/os-release 2024-03-11T17:58:14.091 INFO:teuthology.orchestra.run.smithi162.stdout:NAME="CentOS Stream" 2024-03-11T17:58:14.091 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION="9" 2024-03-11T17:58:14.091 INFO:teuthology.orchestra.run.smithi162.stdout:ID="centos" 2024-03-11T17:58:14.092 INFO:teuthology.orchestra.run.smithi162.stdout:ID_LIKE="rhel fedora" 2024-03-11T17:58:14.092 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_ID="9" 2024-03-11T17:58:14.092 INFO:teuthology.orchestra.run.smithi162.stdout:PLATFORM_ID="platform:el9" 2024-03-11T17:58:14.092 INFO:teuthology.orchestra.run.smithi162.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-11T17:58:14.092 INFO:teuthology.orchestra.run.smithi162.stdout:ANSI_COLOR="0;31" 2024-03-11T17:58:14.092 INFO:teuthology.orchestra.run.smithi162.stdout:LOGO="fedora-logo-icon" 2024-03-11T17:58:14.092 INFO:teuthology.orchestra.run.smithi162.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-11T17:58:14.092 INFO:teuthology.orchestra.run.smithi162.stdout:HOME_URL="https://centos.org/" 2024-03-11T17:58:14.092 INFO:teuthology.orchestra.run.smithi162.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-11T17:58:14.092 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-11T17:58:14.092 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-11T17:58:14.093 INFO:teuthology.provision.fog.smithi162:Deploy complete! 2024-03-11T17:58:14.093 DEBUG:teuthology.parallel:result is None 2024-03-11T17:58:14.688 INFO:teuthology.provision.fog.smithi150:Node is ready 2024-03-11T17:58:14.688 DEBUG:teuthology.orchestra.run.smithi150:> hostname 2024-03-11T17:58:14.707 INFO:teuthology.orchestra.run.smithi150.stdout:smithi150.front.sepia.ceph.com 2024-03-11T17:58:14.707 DEBUG:teuthology.orchestra.run.smithi150:> grep smithi150.front.sepia.ceph.com /etc/hosts 2024-03-11T17:58:14.764 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.15.150 smithi150.front.sepia.ceph.com smithi150 2024-03-11T17:58:14.765 DEBUG:teuthology.orchestra.run.smithi150:> sudo hostname smithi150 2024-03-11T17:58:14.898 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/smithi150.front.sepia.ceph.com/smithi150/g' /etc/hosts 2024-03-11T17:58:14.929 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/172.21.15.150/172.21.15.150/g' /etc/hosts 2024-03-11T17:58:14.999 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/smithi150.front.sepia.ceph.com/smithi150/g' /etc/hostname 2024-03-11T17:58:15.068 DEBUG:teuthology.orchestra.run.smithi150:> sudo hostname smithi150 2024-03-11T17:58:15.136 DEBUG:teuthology.orchestra.run.smithi150:> cat /etc/os-release 2024-03-11T17:58:15.192 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="CentOS Stream" 2024-03-11T17:58:15.192 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="9" 2024-03-11T17:58:15.192 INFO:teuthology.orchestra.run.smithi150.stdout:ID="centos" 2024-03-11T17:58:15.192 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE="rhel fedora" 2024-03-11T17:58:15.192 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="9" 2024-03-11T17:58:15.193 INFO:teuthology.orchestra.run.smithi150.stdout:PLATFORM_ID="platform:el9" 2024-03-11T17:58:15.193 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-11T17:58:15.193 INFO:teuthology.orchestra.run.smithi150.stdout:ANSI_COLOR="0;31" 2024-03-11T17:58:15.193 INFO:teuthology.orchestra.run.smithi150.stdout:LOGO="fedora-logo-icon" 2024-03-11T17:58:15.193 INFO:teuthology.orchestra.run.smithi150.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-11T17:58:15.193 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://centos.org/" 2024-03-11T17:58:15.193 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-11T17:58:15.193 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-11T17:58:15.193 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-11T17:58:15.193 INFO:teuthology.provision.fog.smithi150:Deploy complete! 2024-03-11T17:58:15.194 DEBUG:teuthology.parallel:result is None 2024-03-11T17:58:15.408 INFO:teuthology.lock.ops:Checking smithi094.front.sepia.ceph.com 2024-03-11T17:58:15.408 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-11T17:58:15.429 INFO:teuthology.lock.ops:Checking smithi150.front.sepia.ceph.com 2024-03-11T17:58:15.430 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-11T17:58:15.455 INFO:teuthology.lock.ops:Checking smithi162.front.sepia.ceph.com 2024-03-11T17:58:15.455 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-11T17:58:15.481 INFO:teuthology.lock.ops:Updating [smithi094.front.sepia.ceph.com]: set os type and version on server 2024-03-11T17:58:15.481 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com' 2024-03-11T17:58:15.482 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T17:58:15.573 DEBUG:teuthology.orchestra.run.smithi094:> true 2024-03-11T17:58:15.741 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi094.front.sepia.ceph.com' 2024-03-11T17:58:15.741 DEBUG:teuthology.orchestra.run.smithi094:> uname -m 2024-03-11T17:58:15.795 INFO:teuthology.orchestra.run.smithi094.stdout:x86_64 2024-03-11T17:58:15.795 DEBUG:teuthology.orchestra.run.smithi094:> cat /etc/os-release 2024-03-11T17:58:15.850 INFO:teuthology.orchestra.run.smithi094.stdout:NAME="CentOS Stream" 2024-03-11T17:58:15.850 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION="9" 2024-03-11T17:58:15.850 INFO:teuthology.orchestra.run.smithi094.stdout:ID="centos" 2024-03-11T17:58:15.850 INFO:teuthology.orchestra.run.smithi094.stdout:ID_LIKE="rhel fedora" 2024-03-11T17:58:15.851 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION_ID="9" 2024-03-11T17:58:15.851 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM_ID="platform:el9" 2024-03-11T17:58:15.851 INFO:teuthology.orchestra.run.smithi094.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-11T17:58:15.851 INFO:teuthology.orchestra.run.smithi094.stdout:ANSI_COLOR="0;31" 2024-03-11T17:58:15.851 INFO:teuthology.orchestra.run.smithi094.stdout:LOGO="fedora-logo-icon" 2024-03-11T17:58:15.851 INFO:teuthology.orchestra.run.smithi094.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-11T17:58:15.851 INFO:teuthology.orchestra.run.smithi094.stdout:HOME_URL="https://centos.org/" 2024-03-11T17:58:15.851 INFO:teuthology.orchestra.run.smithi094.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-11T17:58:15.851 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-11T17:58:15.851 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-11T17:58:15.852 INFO:teuthology.lock.ops:Updating smithi094.front.sepia.ceph.com on lock server 2024-03-11T17:58:15.872 INFO:teuthology.lock.ops:Updating [smithi150.front.sepia.ceph.com]: set os type and version on server 2024-03-11T17:58:15.872 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-03-11T17:58:15.872 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T17:58:15.960 DEBUG:teuthology.orchestra.run.smithi150:> true 2024-03-11T17:58:16.030 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-03-11T17:58:16.030 DEBUG:teuthology.orchestra.run.smithi150:> uname -m 2024-03-11T17:58:16.087 INFO:teuthology.orchestra.run.smithi150.stdout:x86_64 2024-03-11T17:58:16.087 DEBUG:teuthology.orchestra.run.smithi150:> cat /etc/os-release 2024-03-11T17:58:16.143 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="CentOS Stream" 2024-03-11T17:58:16.143 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="9" 2024-03-11T17:58:16.144 INFO:teuthology.orchestra.run.smithi150.stdout:ID="centos" 2024-03-11T17:58:16.144 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE="rhel fedora" 2024-03-11T17:58:16.144 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="9" 2024-03-11T17:58:16.144 INFO:teuthology.orchestra.run.smithi150.stdout:PLATFORM_ID="platform:el9" 2024-03-11T17:58:16.144 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-11T17:58:16.144 INFO:teuthology.orchestra.run.smithi150.stdout:ANSI_COLOR="0;31" 2024-03-11T17:58:16.144 INFO:teuthology.orchestra.run.smithi150.stdout:LOGO="fedora-logo-icon" 2024-03-11T17:58:16.144 INFO:teuthology.orchestra.run.smithi150.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-11T17:58:16.144 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://centos.org/" 2024-03-11T17:58:16.144 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-11T17:58:16.144 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-11T17:58:16.144 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-11T17:58:16.145 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server 2024-03-11T17:58:16.163 INFO:teuthology.lock.ops:Updating [smithi162.front.sepia.ceph.com]: set os type and version on server 2024-03-11T17:58:16.163 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-03-11T17:58:16.163 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T17:58:16.251 DEBUG:teuthology.orchestra.run.smithi162:> true 2024-03-11T17:58:16.279 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-03-11T17:58:16.279 DEBUG:teuthology.orchestra.run.smithi162:> uname -m 2024-03-11T17:58:16.335 INFO:teuthology.orchestra.run.smithi162.stdout:x86_64 2024-03-11T17:58:16.335 DEBUG:teuthology.orchestra.run.smithi162:> cat /etc/os-release 2024-03-11T17:58:16.390 INFO:teuthology.orchestra.run.smithi162.stdout:NAME="CentOS Stream" 2024-03-11T17:58:16.390 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION="9" 2024-03-11T17:58:16.390 INFO:teuthology.orchestra.run.smithi162.stdout:ID="centos" 2024-03-11T17:58:16.391 INFO:teuthology.orchestra.run.smithi162.stdout:ID_LIKE="rhel fedora" 2024-03-11T17:58:16.391 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_ID="9" 2024-03-11T17:58:16.391 INFO:teuthology.orchestra.run.smithi162.stdout:PLATFORM_ID="platform:el9" 2024-03-11T17:58:16.391 INFO:teuthology.orchestra.run.smithi162.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-11T17:58:16.391 INFO:teuthology.orchestra.run.smithi162.stdout:ANSI_COLOR="0;31" 2024-03-11T17:58:16.391 INFO:teuthology.orchestra.run.smithi162.stdout:LOGO="fedora-logo-icon" 2024-03-11T17:58:16.391 INFO:teuthology.orchestra.run.smithi162.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-11T17:58:16.391 INFO:teuthology.orchestra.run.smithi162.stdout:HOME_URL="https://centos.org/" 2024-03-11T17:58:16.391 INFO:teuthology.orchestra.run.smithi162.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-11T17:58:16.391 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-11T17:58:16.391 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-11T17:58:16.392 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server 2024-03-11T17:58:16.413 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T17:58:16.536 INFO:teuthology.dispatcher.supervisor:Running job 7591216 2024-03-11T17:58:16.536 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-03-11_14:02:35-fs-squid-distro-default-smithi/7591216 --name teuthology-2024-03-11_14:02:35-fs-squid-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-workunit/kernel_untar_build}} -- /home/teuthworker/archive/teuthology-2024-03-11_14:02:35-fs-squid-distro-default-smithi/7591216/orig.config.yaml 2024-03-11T17:58:16.541 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-03-11_14:02:35-fs-squid-distro-default-smithi/7591216 2024-03-11T17:58:16.541 INFO:teuthology.dispatcher.supervisor:Job PID: 2672416 2024-03-11T17:58:16.541 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-03-11T18:00:16.639 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T18:02:16.815 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T18:04:16.983 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T18:06:17.156 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T18:08:17.324 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T18:10:17.488 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T18:12:17.675 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T18:14:17.843 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T18:16:18.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T18:18:18.195 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T18:20:18.363 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T18:22:18.536 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T18:24:18.703 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T18:26:18.828 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T18:28:19.007 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T18:30:19.173 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T18:32:19.347 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T18:34:19.515 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T18:36:19.688 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T18:38:19.826 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T18:40:20.003 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T18:42:20.171 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T18:44:20.344 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T18:46:20.507 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T18:48:20.683 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T18:48:20.751 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1