2024-03-12T03:50:44.067 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-12T03:50:44.068 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-12T03:50:44.226 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2188e90c10>, signals=[15]) 2024-03-12T03:50:44.226 INFO:teuthology.lock.ops:Start node 'smithi143.front.sepia.ceph.com' reimaging 2024-03-12T03:50:44.226 INFO:teuthology.lock.ops:Updating [smithi143.front.sepia.ceph.com]: reset os type and version on server 2024-03-12T03:50:44.227 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server 2024-03-12T03:50:44.241 INFO:teuthology.lock.ops:Start node 'smithi145.front.sepia.ceph.com' reimaging 2024-03-12T03:50:44.241 INFO:teuthology.lock.ops:Updating [smithi145.front.sepia.ceph.com]: reset os type and version on server 2024-03-12T03:50:44.241 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server 2024-03-12T03:50:44.258 INFO:teuthology.lock.ops:Start node 'smithi172.front.sepia.ceph.com' reimaging 2024-03-12T03:50:44.258 INFO:teuthology.lock.ops:Updating [smithi172.front.sepia.ceph.com]: reset os type and version on server 2024-03-12T03:50:44.258 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2024-03-12T03:50:44.353 DEBUG:teuthology.provision.fog.smithi143:Requesting image smithi_centos_9.stream (ID 10) 2024-03-12T03:50:44.392 DEBUG:teuthology.provision.fog.smithi145:Requesting image smithi_centos_9.stream (ID 10) 2024-03-12T03:50:44.406 INFO:teuthology.provision.fog.smithi143:Scheduling deploy of centos 9.stream 2024-03-12T03:50:44.413 DEBUG:teuthology.provision.fog.smithi172:Requesting image smithi_centos_9.stream (ID 10) 2024-03-12T03:50:44.436 INFO:teuthology.provision.fog.smithi145:Scheduling deploy of centos 9.stream 2024-03-12T03:50:44.465 INFO:teuthology.provision.fog.smithi172:Scheduling deploy of centos 9.stream 2024-03-12T03:50:44.642 INFO:teuthology.orchestra.console.smithi145:Power off 2024-03-12T03:50:44.642 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-12T03:50:44.663 DEBUG:teuthology.orchestra.console.smithi145:power off output: Chassis Power Control: Down/Off 2024-03-12T03:50:44.663 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-12T03:50:44.681 INFO:teuthology.orchestra.console.smithi143:Power off 2024-03-12T03:50:44.681 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-12T03:50:44.693 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is on 2024-03-12T03:50:44.702 DEBUG:teuthology.orchestra.console.smithi143:power off output: Chassis Power Control: Down/Off 2024-03-12T03:50:44.702 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-12T03:50:44.720 INFO:teuthology.orchestra.console.smithi172:Power off 2024-03-12T03:50:44.720 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-12T03:50:44.727 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is on 2024-03-12T03:50:44.739 DEBUG:teuthology.orchestra.console.smithi172:power off output: Chassis Power Control: Down/Off 2024-03-12T03:50:44.740 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-12T03:50:44.761 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2024-03-12T03:50:48.698 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-12T03:50:48.728 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-12T03:50:48.762 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-12T03:50:48.807 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is on 2024-03-12T03:50:48.837 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is on 2024-03-12T03:50:48.872 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2024-03-12T03:50:52.812 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-12T03:50:52.838 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-12T03:50:52.872 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-12T03:50:52.922 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is on 2024-03-12T03:50:52.949 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is off 2024-03-12T03:50:52.980 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2024-03-12T03:50:53.050 INFO:teuthology.orchestra.console.smithi143:Power off completed 2024-03-12T03:50:53.150 INFO:teuthology.orchestra.console.smithi143:Power on 2024-03-12T03:50:53.151 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-12T03:50:53.176 DEBUG:teuthology.orchestra.console.smithi143:power on output: Chassis Power Control: Up/On 2024-03-12T03:50:53.176 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-12T03:50:53.196 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is off 2024-03-12T03:50:56.929 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-12T03:50:56.981 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-12T03:50:57.038 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is off 2024-03-12T03:50:57.090 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off 2024-03-12T03:50:57.140 INFO:teuthology.orchestra.console.smithi145:Power off completed 2024-03-12T03:50:57.191 INFO:teuthology.orchestra.console.smithi172:Power off completed 2024-03-12T03:50:57.198 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-12T03:50:57.241 INFO:teuthology.orchestra.console.smithi145:Power on 2024-03-12T03:50:57.241 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-12T03:50:57.263 DEBUG:teuthology.orchestra.console.smithi145:power on output: Chassis Power Control: Up/On 2024-03-12T03:50:57.264 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-12T03:50:57.285 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is off 2024-03-12T03:50:57.292 INFO:teuthology.orchestra.console.smithi172:Power on 2024-03-12T03:50:57.292 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-12T03:50:57.307 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is off 2024-03-12T03:50:57.315 DEBUG:teuthology.orchestra.console.smithi172:power on output: Chassis Power Control: Up/On 2024-03-12T03:50:57.315 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-12T03:50:57.337 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off 2024-03-12T03:51:01.290 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-12T03:51:01.308 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-12T03:51:01.337 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-12T03:51:01.399 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is off 2024-03-12T03:51:01.416 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is on 2024-03-12T03:51:01.446 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off 2024-03-12T03:51:01.517 INFO:teuthology.orchestra.console.smithi143:Power on completed 2024-03-12T03:51:01.618 INFO:teuthology.provision.fog.smithi143:Waiting for deploy to finish 2024-03-12T03:51:05.403 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-12T03:51:05.447 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-12T03:51:05.513 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is on 2024-03-12T03:51:05.614 INFO:teuthology.orchestra.console.smithi145:Power on completed 2024-03-12T03:51:05.672 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2024-03-12T03:51:05.716 INFO:teuthology.provision.fog.smithi145:Waiting for deploy to finish 2024-03-12T03:51:05.773 INFO:teuthology.orchestra.console.smithi172:Power on completed 2024-03-12T03:51:05.873 INFO:teuthology.provision.fog.smithi172:Waiting for deploy to finish 2024-03-12T03:53:32.288 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-12T03:53:35.358 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2024-03-12T03:53:41.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-12T03:53:44.450 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2024-03-12T03:53:50.455 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-12T03:53:51.415 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-12T03:53:51.508 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-12T03:53:53.534 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2024-03-12T03:53:54.494 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-03-12T03:53:54.558 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-03-12T03:53:59.538 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-12T03:54:00.497 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-12T03:54:00.560 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-12T03:54:02.594 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2024-03-12T03:54:03.550 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-03-12T03:54:03.614 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-03-12T03:54:08.599 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-12T03:54:09.552 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-12T03:54:09.615 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-12T03:54:11.678 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2024-03-12T03:54:12.610 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-03-12T03:54:12.674 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-03-12T03:54:17.685 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-12T03:54:18.612 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-12T03:54:18.675 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-12T03:54:20.766 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2024-03-12T03:54:21.662 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-03-12T03:54:21.726 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-03-12T03:54:26.771 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-12T03:54:27.665 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-12T03:54:27.728 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-12T03:54:29.822 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2024-03-12T03:54:30.718 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-03-12T03:54:30.782 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-03-12T03:54:35.829 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-12T03:54:36.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-12T03:54:36.784 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-12T03:54:39.838 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-03-12T03:54:45.844 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-12T03:55:04.354 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-03-12T03:55:10.359 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-12T03:55:13.438 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-03-12T03:55:19.441 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-12T03:55:22.494 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-03-12T03:55:28.500 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-12T03:55:28.760 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-12T03:55:28.761 DEBUG:teuthology.orchestra.run.smithi172:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-12T03:55:35.832 WARNING:teuthology.provision.fog.smithi143:timed out 2024-03-12T03:55:36.723 WARNING:teuthology.provision.fog.smithi145:timed out 2024-03-12T03:55:41.834 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-12T03:55:42.085 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-12T03:55:42.086 DEBUG:teuthology.orchestra.run.smithi143:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-12T03:55:42.403 INFO:teuthology.provision.fog.smithi143:Node is ready 2024-03-12T03:55:42.403 DEBUG:teuthology.orchestra.run.smithi143:> hostname 2024-03-12T03:55:42.418 INFO:teuthology.orchestra.run.smithi143.stdout:smithi143.front.sepia.ceph.com 2024-03-12T03:55:42.419 DEBUG:teuthology.orchestra.run.smithi143:> grep smithi143.front.sepia.ceph.com /etc/hosts 2024-03-12T03:55:42.475 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.15.143 smithi143.front.sepia.ceph.com smithi143 2024-03-12T03:55:42.476 DEBUG:teuthology.orchestra.run.smithi143:> sudo hostname smithi143 2024-03-12T03:55:42.581 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i -e 's/smithi143.front.sepia.ceph.com/smithi143/g' /etc/hosts 2024-03-12T03:55:42.608 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i -e 's/172.21.15.143/172.21.15.143/g' /etc/hosts 2024-03-12T03:55:42.679 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i -e 's/smithi143.front.sepia.ceph.com/smithi143/g' /etc/hostname 2024-03-12T03:55:42.724 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-12T03:55:42.747 DEBUG:teuthology.orchestra.run.smithi143:> sudo hostname smithi143 2024-03-12T03:55:42.812 DEBUG:teuthology.orchestra.run.smithi143:> cat /etc/os-release 2024-03-12T03:55:42.905 INFO:teuthology.orchestra.run.smithi143.stdout:NAME="CentOS Stream" 2024-03-12T03:55:42.906 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION="9" 2024-03-12T03:55:42.906 INFO:teuthology.orchestra.run.smithi143.stdout:ID="centos" 2024-03-12T03:55:42.906 INFO:teuthology.orchestra.run.smithi143.stdout:ID_LIKE="rhel fedora" 2024-03-12T03:55:42.906 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_ID="9" 2024-03-12T03:55:42.906 INFO:teuthology.orchestra.run.smithi143.stdout:PLATFORM_ID="platform:el9" 2024-03-12T03:55:42.906 INFO:teuthology.orchestra.run.smithi143.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-12T03:55:42.906 INFO:teuthology.orchestra.run.smithi143.stdout:ANSI_COLOR="0;31" 2024-03-12T03:55:42.906 INFO:teuthology.orchestra.run.smithi143.stdout:LOGO="fedora-logo-icon" 2024-03-12T03:55:42.906 INFO:teuthology.orchestra.run.smithi143.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-12T03:55:42.906 INFO:teuthology.orchestra.run.smithi143.stdout:HOME_URL="https://centos.org/" 2024-03-12T03:55:42.906 INFO:teuthology.orchestra.run.smithi143.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-12T03:55:42.906 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-12T03:55:42.907 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-12T03:55:42.907 INFO:teuthology.provision.fog.smithi143:Deploy complete! 2024-03-12T03:55:42.909 DEBUG:teuthology.parallel:result is None 2024-03-12T03:55:43.065 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-12T03:55:43.065 DEBUG:teuthology.orchestra.run.smithi145:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-12T03:55:43.392 INFO:teuthology.provision.fog.smithi145:Node is ready 2024-03-12T03:55:43.392 DEBUG:teuthology.orchestra.run.smithi145:> hostname 2024-03-12T03:55:43.407 INFO:teuthology.orchestra.run.smithi145.stdout:smithi145.front.sepia.ceph.com 2024-03-12T03:55:43.407 DEBUG:teuthology.orchestra.run.smithi145:> grep smithi145.front.sepia.ceph.com /etc/hosts 2024-03-12T03:55:43.463 INFO:teuthology.orchestra.run.smithi145.stdout:172.21.15.145 smithi145.front.sepia.ceph.com smithi145 2024-03-12T03:55:43.463 DEBUG:teuthology.orchestra.run.smithi145:> sudo hostname smithi145 2024-03-12T03:55:43.577 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/smithi145.front.sepia.ceph.com/smithi145/g' /etc/hosts 2024-03-12T03:55:43.604 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/172.21.15.145/172.21.15.145/g' /etc/hosts 2024-03-12T03:55:43.672 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/smithi145.front.sepia.ceph.com/smithi145/g' /etc/hostname 2024-03-12T03:55:43.740 DEBUG:teuthology.orchestra.run.smithi145:> sudo hostname smithi145 2024-03-12T03:55:43.807 DEBUG:teuthology.orchestra.run.smithi145:> cat /etc/os-release 2024-03-12T03:55:43.861 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="CentOS Stream" 2024-03-12T03:55:43.862 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="9" 2024-03-12T03:55:43.862 INFO:teuthology.orchestra.run.smithi145.stdout:ID="centos" 2024-03-12T03:55:43.862 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE="rhel fedora" 2024-03-12T03:55:43.862 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="9" 2024-03-12T03:55:43.862 INFO:teuthology.orchestra.run.smithi145.stdout:PLATFORM_ID="platform:el9" 2024-03-12T03:55:43.862 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-12T03:55:43.862 INFO:teuthology.orchestra.run.smithi145.stdout:ANSI_COLOR="0;31" 2024-03-12T03:55:43.862 INFO:teuthology.orchestra.run.smithi145.stdout:LOGO="fedora-logo-icon" 2024-03-12T03:55:43.863 INFO:teuthology.orchestra.run.smithi145.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-12T03:55:43.863 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://centos.org/" 2024-03-12T03:55:43.863 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-12T03:55:43.863 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-12T03:55:43.863 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-12T03:55:43.863 INFO:teuthology.provision.fog.smithi145:Deploy complete! 2024-03-12T03:55:43.864 DEBUG:teuthology.parallel:result is None 2024-03-12T03:55:49.087 INFO:teuthology.provision.fog.smithi172:Node is ready 2024-03-12T03:55:49.087 DEBUG:teuthology.orchestra.run.smithi172:> hostname 2024-03-12T03:55:49.105 INFO:teuthology.orchestra.run.smithi172.stdout:smithi172.front.sepia.ceph.com 2024-03-12T03:55:49.105 DEBUG:teuthology.orchestra.run.smithi172:> grep smithi172.front.sepia.ceph.com /etc/hosts 2024-03-12T03:55:49.163 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.15.172 smithi172.front.sepia.ceph.com smithi172 2024-03-12T03:55:49.163 DEBUG:teuthology.orchestra.run.smithi172:> sudo hostname smithi172 2024-03-12T03:55:49.317 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i -e 's/smithi172.front.sepia.ceph.com/smithi172/g' /etc/hosts 2024-03-12T03:55:49.349 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i -e 's/172.21.15.172/172.21.15.172/g' /etc/hosts 2024-03-12T03:55:49.420 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i -e 's/smithi172.front.sepia.ceph.com/smithi172/g' /etc/hostname 2024-03-12T03:55:49.490 DEBUG:teuthology.orchestra.run.smithi172:> sudo hostname smithi172 2024-03-12T03:55:49.559 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release 2024-03-12T03:55:49.613 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="CentOS Stream" 2024-03-12T03:55:49.614 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="9" 2024-03-12T03:55:49.614 INFO:teuthology.orchestra.run.smithi172.stdout:ID="centos" 2024-03-12T03:55:49.614 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="rhel fedora" 2024-03-12T03:55:49.614 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="9" 2024-03-12T03:55:49.614 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el9" 2024-03-12T03:55:49.614 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-12T03:55:49.614 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31" 2024-03-12T03:55:49.614 INFO:teuthology.orchestra.run.smithi172.stdout:LOGO="fedora-logo-icon" 2024-03-12T03:55:49.614 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-12T03:55:49.614 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://centos.org/" 2024-03-12T03:55:49.614 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-12T03:55:49.614 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-12T03:55:49.615 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-12T03:55:49.615 INFO:teuthology.provision.fog.smithi172:Deploy complete! 2024-03-12T03:55:49.615 DEBUG:teuthology.parallel:result is None 2024-03-12T03:55:49.856 INFO:teuthology.lock.ops:Checking smithi143.front.sepia.ceph.com 2024-03-12T03:55:49.857 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-12T03:55:49.880 INFO:teuthology.lock.ops:Checking smithi145.front.sepia.ceph.com 2024-03-12T03:55:49.880 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-12T03:55:49.904 INFO:teuthology.lock.ops:Checking smithi172.front.sepia.ceph.com 2024-03-12T03:55:49.904 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-12T03:55:49.922 INFO:teuthology.lock.ops:Updating [smithi143.front.sepia.ceph.com]: set os type and version on server 2024-03-12T03:55:49.922 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com' 2024-03-12T03:55:49.923 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-12T03:55:50.011 DEBUG:teuthology.orchestra.run.smithi143:> true 2024-03-12T03:55:50.083 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi143.front.sepia.ceph.com' 2024-03-12T03:55:50.083 DEBUG:teuthology.orchestra.run.smithi143:> uname -m 2024-03-12T03:55:50.140 INFO:teuthology.orchestra.run.smithi143.stdout:x86_64 2024-03-12T03:55:50.140 DEBUG:teuthology.orchestra.run.smithi143:> cat /etc/os-release 2024-03-12T03:55:50.195 INFO:teuthology.orchestra.run.smithi143.stdout:NAME="CentOS Stream" 2024-03-12T03:55:50.196 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION="9" 2024-03-12T03:55:50.196 INFO:teuthology.orchestra.run.smithi143.stdout:ID="centos" 2024-03-12T03:55:50.196 INFO:teuthology.orchestra.run.smithi143.stdout:ID_LIKE="rhel fedora" 2024-03-12T03:55:50.196 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_ID="9" 2024-03-12T03:55:50.196 INFO:teuthology.orchestra.run.smithi143.stdout:PLATFORM_ID="platform:el9" 2024-03-12T03:55:50.196 INFO:teuthology.orchestra.run.smithi143.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-12T03:55:50.196 INFO:teuthology.orchestra.run.smithi143.stdout:ANSI_COLOR="0;31" 2024-03-12T03:55:50.196 INFO:teuthology.orchestra.run.smithi143.stdout:LOGO="fedora-logo-icon" 2024-03-12T03:55:50.196 INFO:teuthology.orchestra.run.smithi143.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-12T03:55:50.196 INFO:teuthology.orchestra.run.smithi143.stdout:HOME_URL="https://centos.org/" 2024-03-12T03:55:50.196 INFO:teuthology.orchestra.run.smithi143.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-12T03:55:50.196 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-12T03:55:50.197 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-12T03:55:50.197 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server 2024-03-12T03:55:50.222 INFO:teuthology.lock.ops:Updating [smithi145.front.sepia.ceph.com]: set os type and version on server 2024-03-12T03:55:50.222 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-03-12T03:55:50.222 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-12T03:55:50.312 DEBUG:teuthology.orchestra.run.smithi145:> true 2024-03-12T03:55:50.383 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-03-12T03:55:50.383 DEBUG:teuthology.orchestra.run.smithi145:> uname -m 2024-03-12T03:55:50.440 INFO:teuthology.orchestra.run.smithi145.stdout:x86_64 2024-03-12T03:55:50.440 DEBUG:teuthology.orchestra.run.smithi145:> cat /etc/os-release 2024-03-12T03:55:50.496 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="CentOS Stream" 2024-03-12T03:55:50.496 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="9" 2024-03-12T03:55:50.496 INFO:teuthology.orchestra.run.smithi145.stdout:ID="centos" 2024-03-12T03:55:50.496 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE="rhel fedora" 2024-03-12T03:55:50.496 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="9" 2024-03-12T03:55:50.497 INFO:teuthology.orchestra.run.smithi145.stdout:PLATFORM_ID="platform:el9" 2024-03-12T03:55:50.497 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-12T03:55:50.497 INFO:teuthology.orchestra.run.smithi145.stdout:ANSI_COLOR="0;31" 2024-03-12T03:55:50.497 INFO:teuthology.orchestra.run.smithi145.stdout:LOGO="fedora-logo-icon" 2024-03-12T03:55:50.497 INFO:teuthology.orchestra.run.smithi145.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-12T03:55:50.497 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://centos.org/" 2024-03-12T03:55:50.497 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-12T03:55:50.497 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-12T03:55:50.497 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-12T03:55:50.497 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server 2024-03-12T03:55:50.521 INFO:teuthology.lock.ops:Updating [smithi172.front.sepia.ceph.com]: set os type and version on server 2024-03-12T03:55:50.522 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-03-12T03:55:50.522 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-12T03:55:50.611 DEBUG:teuthology.orchestra.run.smithi172:> true 2024-03-12T03:55:50.683 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-03-12T03:55:50.683 DEBUG:teuthology.orchestra.run.smithi172:> uname -m 2024-03-12T03:55:50.740 INFO:teuthology.orchestra.run.smithi172.stdout:x86_64 2024-03-12T03:55:50.741 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release 2024-03-12T03:55:50.797 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="CentOS Stream" 2024-03-12T03:55:50.797 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="9" 2024-03-12T03:55:50.797 INFO:teuthology.orchestra.run.smithi172.stdout:ID="centos" 2024-03-12T03:55:50.798 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="rhel fedora" 2024-03-12T03:55:50.798 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="9" 2024-03-12T03:55:50.798 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el9" 2024-03-12T03:55:50.798 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-12T03:55:50.798 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31" 2024-03-12T03:55:50.798 INFO:teuthology.orchestra.run.smithi172.stdout:LOGO="fedora-logo-icon" 2024-03-12T03:55:50.798 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-12T03:55:50.798 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://centos.org/" 2024-03-12T03:55:50.798 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-12T03:55:50.798 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-12T03:55:50.798 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-12T03:55:50.799 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2024-03-12T03:55:50.822 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-12T03:55:50.923 INFO:teuthology.dispatcher.supervisor:Running job 7591360 2024-03-12T03:55:50.923 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-03-11_14:02:35-fs-squid-distro-default-smithi/7591360 --name teuthology-2024-03-11_14:02:35-fs-squid-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-workunit/suites/iozone}} -- /home/teuthworker/archive/teuthology-2024-03-11_14:02:35-fs-squid-distro-default-smithi/7591360/orig.config.yaml 2024-03-12T03:55:50.927 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-03-11_14:02:35-fs-squid-distro-default-smithi/7591360 2024-03-12T03:55:50.927 INFO:teuthology.dispatcher.supervisor:Job PID: 1585963 2024-03-12T03:55:50.927 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-03-12T03:57:51.026 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-12T03:59:51.194 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-12T04:01:51.378 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-12T04:03:51.542 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-12T04:05:51.713 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-12T04:07:51.883 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-12T04:09:52.051 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-12T04:11:52.223 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-12T04:13:52.392 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-12T04:15:52.579 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-12T04:17:52.705 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-12T04:19:52.875 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-12T04:21:53.087 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-12T04:23:53.263 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-12T04:25:53.435 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-12T04:27:53.613 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-12T04:29:53.741 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-12T04:31:53.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-12T04:33:54.083 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-12T04:35:54.263 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-12T04:37:54.439 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-12T04:37:54.526 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1