2024-04-17T08:08:35.846 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-17T08:08:35.847 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T08:08:36.010 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f790d876c10>, signals=[15]) 2024-04-17T08:08:36.010 INFO:teuthology.lock.ops:Start node 'smithi017.front.sepia.ceph.com' reimaging 2024-04-17T08:08:36.010 INFO:teuthology.lock.ops:Updating [smithi017.front.sepia.ceph.com]: reset os type and version on server 2024-04-17T08:08:36.010 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server 2024-04-17T08:08:36.036 INFO:teuthology.lock.ops:Start node 'smithi079.front.sepia.ceph.com' reimaging 2024-04-17T08:08:36.036 INFO:teuthology.lock.ops:Updating [smithi079.front.sepia.ceph.com]: reset os type and version on server 2024-04-17T08:08:36.036 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2024-04-17T08:08:36.060 INFO:teuthology.lock.ops:Start node 'smithi120.front.sepia.ceph.com' reimaging 2024-04-17T08:08:36.060 INFO:teuthology.lock.ops:Updating [smithi120.front.sepia.ceph.com]: reset os type and version on server 2024-04-17T08:08:36.060 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server 2024-04-17T08:08:36.178 DEBUG:teuthology.provision.fog.smithi079:Requesting image smithi_centos_9.stream (ID 10) 2024-04-17T08:08:36.181 DEBUG:teuthology.provision.fog.smithi017:Requesting image smithi_centos_9.stream (ID 10) 2024-04-17T08:08:36.193 DEBUG:teuthology.provision.fog.smithi120:Requesting image smithi_centos_9.stream (ID 10) 2024-04-17T08:08:36.222 INFO:teuthology.provision.fog.smithi017:Scheduling deploy of centos 9.stream 2024-04-17T08:08:36.226 INFO:teuthology.provision.fog.smithi079:Scheduling deploy of centos 9.stream 2024-04-17T08:08:36.239 INFO:teuthology.provision.fog.smithi120:Scheduling deploy of centos 9.stream 2024-04-17T08:08:36.514 INFO:teuthology.orchestra.console.smithi017:Power off 2024-04-17T08:08:36.515 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-17T08:08:36.543 DEBUG:teuthology.orchestra.console.smithi017:power off output: Chassis Power Control: Down/Off 2024-04-17T08:08:36.543 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T08:08:36.558 INFO:teuthology.orchestra.console.smithi079:Power off 2024-04-17T08:08:36.558 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-17T08:08:36.574 INFO:teuthology.orchestra.console.smithi120:Power off 2024-04-17T08:08:36.574 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-17T08:08:36.581 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is on 2024-04-17T08:08:36.581 DEBUG:teuthology.orchestra.console.smithi079:power off output: Chassis Power Control: Down/Off 2024-04-17T08:08:36.581 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T08:08:36.595 DEBUG:teuthology.orchestra.console.smithi120:power off output: Chassis Power Control: Down/Off 2024-04-17T08:08:36.595 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T08:08:36.603 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is on 2024-04-17T08:08:36.616 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is on 2024-04-17T08:08:40.586 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T08:08:40.604 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T08:08:40.617 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T08:08:40.695 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is on 2024-04-17T08:08:40.713 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is on 2024-04-17T08:08:40.726 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is on 2024-04-17T08:08:44.698 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T08:08:44.713 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T08:08:44.727 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T08:08:44.808 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off 2024-04-17T08:08:44.823 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is on 2024-04-17T08:08:44.834 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is off 2024-04-17T08:08:44.909 INFO:teuthology.orchestra.console.smithi017:Power off completed 2024-04-17T08:08:44.935 INFO:teuthology.orchestra.console.smithi120:Power off completed 2024-04-17T08:08:45.010 INFO:teuthology.orchestra.console.smithi017:Power on 2024-04-17T08:08:45.010 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-17T08:08:45.032 DEBUG:teuthology.orchestra.console.smithi017:power on output: Chassis Power Control: Up/On 2024-04-17T08:08:45.032 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T08:08:45.039 INFO:teuthology.orchestra.console.smithi120:Power on 2024-04-17T08:08:45.039 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-17T08:08:45.052 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off 2024-04-17T08:08:45.060 DEBUG:teuthology.orchestra.console.smithi120:power on output: Chassis Power Control: Up/On 2024-04-17T08:08:45.060 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T08:08:45.098 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is off 2024-04-17T08:08:48.826 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T08:08:48.935 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off 2024-04-17T08:08:49.036 INFO:teuthology.orchestra.console.smithi079:Power off completed 2024-04-17T08:08:49.053 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T08:08:49.099 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T08:08:49.137 INFO:teuthology.orchestra.console.smithi079:Power on 2024-04-17T08:08:49.137 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-17T08:08:49.157 DEBUG:teuthology.orchestra.console.smithi079:power on output: Chassis Power Control: Up/On 2024-04-17T08:08:49.157 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T08:08:49.165 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off 2024-04-17T08:08:49.178 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off 2024-04-17T08:08:49.210 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is off 2024-04-17T08:08:53.170 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T08:08:53.179 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T08:08:53.211 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T08:08:53.279 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is on 2024-04-17T08:08:53.287 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off 2024-04-17T08:08:53.380 INFO:teuthology.orchestra.console.smithi017:Power on completed 2024-04-17T08:08:53.434 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is on 2024-04-17T08:08:53.481 INFO:teuthology.provision.fog.smithi017:Waiting for deploy to finish 2024-04-17T08:08:53.535 INFO:teuthology.orchestra.console.smithi120:Power on completed 2024-04-17T08:08:53.636 INFO:teuthology.provision.fog.smithi120:Waiting for deploy to finish 2024-04-17T08:08:57.292 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T08:08:57.401 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is on 2024-04-17T08:08:57.502 INFO:teuthology.orchestra.console.smithi079:Power on completed 2024-04-17T08:08:57.603 INFO:teuthology.provision.fog.smithi079:Waiting for deploy to finish 2024-04-17T08:11:24.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:11:24.207 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:11:27.262 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17 2024-04-17T08:11:27.263 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-04-17T08:11:28.278 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:11:31.358 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2024-04-17T08:11:33.266 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:11:33.268 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:11:36.318 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-04-17T08:11:36.322 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17 2024-04-17T08:11:37.361 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:11:40.414 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2024-04-17T08:11:42.321 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:11:42.323 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:11:45.374 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-04-17T08:11:45.375 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17 2024-04-17T08:11:46.417 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:11:49.470 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2024-04-17T08:11:51.377 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:11:51.379 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:11:54.430 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-04-17T08:11:54.431 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17 2024-04-17T08:11:55.473 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:11:58.526 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2024-04-17T08:12:00.434 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:12:00.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:12:03.490 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-04-17T08:12:03.491 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17 2024-04-17T08:12:04.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:12:07.586 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2024-04-17T08:12:09.493 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:12:09.495 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:12:12.574 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-04-17T08:12:13.591 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:12:16.670 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2024-04-17T08:12:18.579 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:12:21.630 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-04-17T08:12:22.673 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:12:25.726 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2024-04-17T08:12:27.633 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:12:31.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:13:09.528 WARNING:teuthology.provision.fog.smithi017:timed out 2024-04-17T08:13:15.535 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:13:15.812 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-17T08:13:15.813 DEBUG:teuthology.orchestra.run.smithi017:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-17T08:13:16.160 INFO:teuthology.provision.fog.smithi017:Node is ready 2024-04-17T08:13:16.160 DEBUG:teuthology.orchestra.run.smithi017:> hostname 2024-04-17T08:13:16.175 INFO:teuthology.orchestra.run.smithi017.stdout:smithi017.front.sepia.ceph.com 2024-04-17T08:13:16.175 DEBUG:teuthology.orchestra.run.smithi017:> grep smithi017.front.sepia.ceph.com /etc/hosts 2024-04-17T08:13:16.231 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17 smithi017.front.sepia.ceph.com smithi017 2024-04-17T08:13:16.231 DEBUG:teuthology.orchestra.run.smithi017:> sudo hostname smithi017 2024-04-17T08:13:16.339 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i -e 's/smithi017.front.sepia.ceph.com/smithi017/g' /etc/hosts 2024-04-17T08:13:16.372 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i -e 's/172.21.15.17/172.21.15.17/g' /etc/hosts 2024-04-17T08:13:16.443 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i -e 's/smithi017.front.sepia.ceph.com/smithi017/g' /etc/hostname 2024-04-17T08:13:16.514 DEBUG:teuthology.orchestra.run.smithi017:> sudo hostname smithi017 2024-04-17T08:13:16.584 DEBUG:teuthology.orchestra.run.smithi017:> cat /etc/os-release 2024-04-17T08:13:16.639 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="CentOS Stream" 2024-04-17T08:13:16.639 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="9" 2024-04-17T08:13:16.639 INFO:teuthology.orchestra.run.smithi017.stdout:ID="centos" 2024-04-17T08:13:16.639 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE="rhel fedora" 2024-04-17T08:13:16.639 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="9" 2024-04-17T08:13:16.639 INFO:teuthology.orchestra.run.smithi017.stdout:PLATFORM_ID="platform:el9" 2024-04-17T08:13:16.639 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T08:13:16.640 INFO:teuthology.orchestra.run.smithi017.stdout:ANSI_COLOR="0;31" 2024-04-17T08:13:16.640 INFO:teuthology.orchestra.run.smithi017.stdout:LOGO="fedora-logo-icon" 2024-04-17T08:13:16.640 INFO:teuthology.orchestra.run.smithi017.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T08:13:16.640 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://centos.org/" 2024-04-17T08:13:16.640 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T08:13:16.640 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T08:13:16.640 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T08:13:16.641 INFO:teuthology.provision.fog.smithi017:Deploy complete! 2024-04-17T08:13:16.642 DEBUG:teuthology.parallel:result is None 2024-04-17T08:13:27.646 WARNING:teuthology.provision.fog.smithi120:timed out 2024-04-17T08:13:31.734 WARNING:teuthology.provision.fog.smithi079:timed out 2024-04-17T08:13:33.649 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:13:34.106 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-17T08:13:34.106 DEBUG:teuthology.orchestra.run.smithi120:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-17T08:13:34.417 INFO:teuthology.provision.fog.smithi120:Node is ready 2024-04-17T08:13:34.417 DEBUG:teuthology.orchestra.run.smithi120:> hostname 2024-04-17T08:13:34.430 INFO:teuthology.orchestra.run.smithi120.stdout:smithi120.front.sepia.ceph.com 2024-04-17T08:13:34.431 DEBUG:teuthology.orchestra.run.smithi120:> grep smithi120.front.sepia.ceph.com /etc/hosts 2024-04-17T08:13:34.486 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120 smithi120.front.sepia.ceph.com smithi120 2024-04-17T08:13:34.487 DEBUG:teuthology.orchestra.run.smithi120:> sudo hostname smithi120 2024-04-17T08:13:34.595 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i -e 's/smithi120.front.sepia.ceph.com/smithi120/g' /etc/hosts 2024-04-17T08:13:34.622 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i -e 's/172.21.15.120/172.21.15.120/g' /etc/hosts 2024-04-17T08:13:34.690 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i -e 's/smithi120.front.sepia.ceph.com/smithi120/g' /etc/hostname 2024-04-17T08:13:34.758 DEBUG:teuthology.orchestra.run.smithi120:> sudo hostname smithi120 2024-04-17T08:13:34.826 DEBUG:teuthology.orchestra.run.smithi120:> cat /etc/os-release 2024-04-17T08:13:34.882 INFO:teuthology.orchestra.run.smithi120.stdout:NAME="CentOS Stream" 2024-04-17T08:13:34.882 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION="9" 2024-04-17T08:13:34.882 INFO:teuthology.orchestra.run.smithi120.stdout:ID="centos" 2024-04-17T08:13:34.882 INFO:teuthology.orchestra.run.smithi120.stdout:ID_LIKE="rhel fedora" 2024-04-17T08:13:34.883 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_ID="9" 2024-04-17T08:13:34.883 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM_ID="platform:el9" 2024-04-17T08:13:34.883 INFO:teuthology.orchestra.run.smithi120.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T08:13:34.883 INFO:teuthology.orchestra.run.smithi120.stdout:ANSI_COLOR="0;31" 2024-04-17T08:13:34.883 INFO:teuthology.orchestra.run.smithi120.stdout:LOGO="fedora-logo-icon" 2024-04-17T08:13:34.883 INFO:teuthology.orchestra.run.smithi120.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T08:13:34.883 INFO:teuthology.orchestra.run.smithi120.stdout:HOME_URL="https://centos.org/" 2024-04-17T08:13:34.883 INFO:teuthology.orchestra.run.smithi120.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T08:13:34.883 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T08:13:34.883 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T08:13:34.883 INFO:teuthology.provision.fog.smithi120:Deploy complete! 2024-04-17T08:13:34.884 DEBUG:teuthology.parallel:result is None 2024-04-17T08:13:37.739 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:13:38.032 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-17T08:13:38.033 DEBUG:teuthology.orchestra.run.smithi079:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-17T08:13:38.366 INFO:teuthology.provision.fog.smithi079:Node is ready 2024-04-17T08:13:38.367 DEBUG:teuthology.orchestra.run.smithi079:> hostname 2024-04-17T08:13:38.381 INFO:teuthology.orchestra.run.smithi079.stdout:smithi079.front.sepia.ceph.com 2024-04-17T08:13:38.381 DEBUG:teuthology.orchestra.run.smithi079:> grep smithi079.front.sepia.ceph.com /etc/hosts 2024-04-17T08:13:38.437 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79 smithi079.front.sepia.ceph.com smithi079 2024-04-17T08:13:38.438 DEBUG:teuthology.orchestra.run.smithi079:> sudo hostname smithi079 2024-04-17T08:13:38.536 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/smithi079.front.sepia.ceph.com/smithi079/g' /etc/hosts 2024-04-17T08:13:38.565 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/172.21.15.79/172.21.15.79/g' /etc/hosts 2024-04-17T08:13:38.633 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/smithi079.front.sepia.ceph.com/smithi079/g' /etc/hostname 2024-04-17T08:13:38.700 DEBUG:teuthology.orchestra.run.smithi079:> sudo hostname smithi079 2024-04-17T08:13:38.766 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release 2024-04-17T08:13:38.820 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="CentOS Stream" 2024-04-17T08:13:38.821 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="9" 2024-04-17T08:13:38.821 INFO:teuthology.orchestra.run.smithi079.stdout:ID="centos" 2024-04-17T08:13:38.821 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="rhel fedora" 2024-04-17T08:13:38.821 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="9" 2024-04-17T08:13:38.821 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el9" 2024-04-17T08:13:38.821 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T08:13:38.821 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31" 2024-04-17T08:13:38.821 INFO:teuthology.orchestra.run.smithi079.stdout:LOGO="fedora-logo-icon" 2024-04-17T08:13:38.821 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T08:13:38.821 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://centos.org/" 2024-04-17T08:13:38.822 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T08:13:38.822 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T08:13:38.822 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T08:13:38.822 INFO:teuthology.provision.fog.smithi079:Deploy complete! 2024-04-17T08:13:38.823 DEBUG:teuthology.parallel:result is None 2024-04-17T08:13:39.038 INFO:teuthology.lock.ops:Checking smithi017.front.sepia.ceph.com 2024-04-17T08:13:39.038 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-17T08:13:39.057 INFO:teuthology.lock.ops:Checking smithi079.front.sepia.ceph.com 2024-04-17T08:13:39.057 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-17T08:13:39.074 INFO:teuthology.lock.ops:Checking smithi120.front.sepia.ceph.com 2024-04-17T08:13:39.074 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-17T08:13:39.092 INFO:teuthology.lock.ops:Updating [smithi017.front.sepia.ceph.com]: set os type and version on server 2024-04-17T08:13:39.092 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-04-17T08:13:39.093 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:13:39.200 DEBUG:teuthology.orchestra.run.smithi017:> true 2024-04-17T08:13:39.380 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-04-17T08:13:39.381 DEBUG:teuthology.orchestra.run.smithi017:> uname -m 2024-04-17T08:13:39.435 INFO:teuthology.orchestra.run.smithi017.stdout:x86_64 2024-04-17T08:13:39.436 DEBUG:teuthology.orchestra.run.smithi017:> cat /etc/os-release 2024-04-17T08:13:39.490 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="CentOS Stream" 2024-04-17T08:13:39.494 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="9" 2024-04-17T08:13:39.494 INFO:teuthology.orchestra.run.smithi017.stdout:ID="centos" 2024-04-17T08:13:39.494 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE="rhel fedora" 2024-04-17T08:13:39.494 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="9" 2024-04-17T08:13:39.494 INFO:teuthology.orchestra.run.smithi017.stdout:PLATFORM_ID="platform:el9" 2024-04-17T08:13:39.494 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T08:13:39.494 INFO:teuthology.orchestra.run.smithi017.stdout:ANSI_COLOR="0;31" 2024-04-17T08:13:39.494 INFO:teuthology.orchestra.run.smithi017.stdout:LOGO="fedora-logo-icon" 2024-04-17T08:13:39.494 INFO:teuthology.orchestra.run.smithi017.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T08:13:39.494 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://centos.org/" 2024-04-17T08:13:39.494 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T08:13:39.494 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T08:13:39.494 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T08:13:39.495 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server 2024-04-17T08:13:39.516 INFO:teuthology.lock.ops:Updating [smithi079.front.sepia.ceph.com]: set os type and version on server 2024-04-17T08:13:39.516 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-04-17T08:13:39.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:13:39.603 DEBUG:teuthology.orchestra.run.smithi079:> true 2024-04-17T08:13:39.669 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-04-17T08:13:39.669 DEBUG:teuthology.orchestra.run.smithi079:> uname -m 2024-04-17T08:13:39.722 INFO:teuthology.orchestra.run.smithi079.stdout:x86_64 2024-04-17T08:13:39.722 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release 2024-04-17T08:13:39.773 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="CentOS Stream" 2024-04-17T08:13:39.774 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="9" 2024-04-17T08:13:39.774 INFO:teuthology.orchestra.run.smithi079.stdout:ID="centos" 2024-04-17T08:13:39.774 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="rhel fedora" 2024-04-17T08:13:39.774 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="9" 2024-04-17T08:13:39.774 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el9" 2024-04-17T08:13:39.774 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T08:13:39.774 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31" 2024-04-17T08:13:39.774 INFO:teuthology.orchestra.run.smithi079.stdout:LOGO="fedora-logo-icon" 2024-04-17T08:13:39.774 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T08:13:39.774 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://centos.org/" 2024-04-17T08:13:39.774 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T08:13:39.774 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T08:13:39.774 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T08:13:39.775 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2024-04-17T08:13:39.811 INFO:teuthology.lock.ops:Updating [smithi120.front.sepia.ceph.com]: set os type and version on server 2024-04-17T08:13:39.812 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-04-17T08:13:39.812 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:13:39.900 DEBUG:teuthology.orchestra.run.smithi120:> true 2024-04-17T08:13:39.970 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-04-17T08:13:39.971 DEBUG:teuthology.orchestra.run.smithi120:> uname -m 2024-04-17T08:13:40.027 INFO:teuthology.orchestra.run.smithi120.stdout:x86_64 2024-04-17T08:13:40.027 DEBUG:teuthology.orchestra.run.smithi120:> cat /etc/os-release 2024-04-17T08:13:40.082 INFO:teuthology.orchestra.run.smithi120.stdout:NAME="CentOS Stream" 2024-04-17T08:13:40.083 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION="9" 2024-04-17T08:13:40.083 INFO:teuthology.orchestra.run.smithi120.stdout:ID="centos" 2024-04-17T08:13:40.083 INFO:teuthology.orchestra.run.smithi120.stdout:ID_LIKE="rhel fedora" 2024-04-17T08:13:40.083 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_ID="9" 2024-04-17T08:13:40.083 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM_ID="platform:el9" 2024-04-17T08:13:40.083 INFO:teuthology.orchestra.run.smithi120.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T08:13:40.083 INFO:teuthology.orchestra.run.smithi120.stdout:ANSI_COLOR="0;31" 2024-04-17T08:13:40.083 INFO:teuthology.orchestra.run.smithi120.stdout:LOGO="fedora-logo-icon" 2024-04-17T08:13:40.083 INFO:teuthology.orchestra.run.smithi120.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T08:13:40.083 INFO:teuthology.orchestra.run.smithi120.stdout:HOME_URL="https://centos.org/" 2024-04-17T08:13:40.083 INFO:teuthology.orchestra.run.smithi120.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T08:13:40.083 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T08:13:40.083 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T08:13:40.084 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server 2024-04-17T08:13:40.112 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T08:13:40.217 INFO:teuthology.dispatcher.supervisor:Running job 7659943 2024-04-17T08:13:40.217 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7659943 --name rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-workunit/postgres}} -- /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7659943/orig.config.yaml 2024-04-17T08:13:40.220 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7659943 2024-04-17T08:13:40.221 INFO:teuthology.dispatcher.supervisor:Job PID: 331164 2024-04-17T08:13:40.221 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-17T08:15:40.319 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T08:17:40.475 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T08:19:40.655 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T08:21:40.829 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T08:23:40.993 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T08:23:41.074 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1