2024-03-02T13:10:59.120 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-03-02T13:10:59.121 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-02T13:10:59.293 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa458155c10>, signals=[15]) 2024-03-02T13:10:59.293 INFO:teuthology.lock.ops:Start node 'smithi007.front.sepia.ceph.com' reimaging 2024-03-02T13:10:59.294 INFO:teuthology.lock.ops:Updating [smithi007.front.sepia.ceph.com]: reset os type and version on server 2024-03-02T13:10:59.294 INFO:teuthology.lock.ops:Updating smithi007.front.sepia.ceph.com on lock server 2024-03-02T13:10:59.316 INFO:teuthology.lock.ops:Start node 'smithi119.front.sepia.ceph.com' reimaging 2024-03-02T13:10:59.316 INFO:teuthology.lock.ops:Updating [smithi119.front.sepia.ceph.com]: reset os type and version on server 2024-03-02T13:10:59.316 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server 2024-03-02T13:10:59.341 INFO:teuthology.lock.ops:Start node 'smithi149.front.sepia.ceph.com' reimaging 2024-03-02T13:10:59.341 INFO:teuthology.lock.ops:Updating [smithi149.front.sepia.ceph.com]: reset os type and version on server 2024-03-02T13:10:59.341 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server 2024-03-02T13:10:59.429 DEBUG:teuthology.provision.fog.smithi007:Requesting image smithi_centos_9.stream (ID 10) 2024-03-02T13:10:59.459 DEBUG:teuthology.provision.fog.smithi119:Requesting image smithi_centos_9.stream (ID 10) 2024-03-02T13:10:59.471 DEBUG:teuthology.provision.fog.smithi149:Requesting image smithi_centos_9.stream (ID 10) 2024-03-02T13:10:59.475 INFO:teuthology.provision.fog.smithi007:Scheduling deploy of centos 9.stream 2024-03-02T13:10:59.507 INFO:teuthology.provision.fog.smithi149:Scheduling deploy of centos 9.stream 2024-03-02T13:10:59.511 INFO:teuthology.provision.fog.smithi119:Scheduling deploy of centos 9.stream 2024-03-02T13:10:59.709 INFO:teuthology.orchestra.console.smithi149:Power off 2024-03-02T13:10:59.710 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-02T13:10:59.724 INFO:teuthology.orchestra.console.smithi119:Power off 2024-03-02T13:10:59.724 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-02T13:10:59.737 INFO:teuthology.orchestra.console.smithi007:Power off 2024-03-02T13:10:59.737 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-02T13:10:59.747 DEBUG:teuthology.orchestra.console.smithi119:power off output: Chassis Power Control: Down/Off 2024-03-02T13:10:59.747 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-02T13:10:59.755 DEBUG:teuthology.orchestra.console.smithi149:power off output: Chassis Power Control: Down/Off 2024-03-02T13:10:59.756 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-02T13:10:59.763 DEBUG:teuthology.orchestra.console.smithi007:power off output: Chassis Power Control: Down/Off 2024-03-02T13:10:59.764 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-02T13:10:59.772 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off 2024-03-02T13:10:59.775 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is off 2024-03-02T13:10:59.784 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is off 2024-03-02T13:10:59.873 INFO:teuthology.orchestra.console.smithi119:Power off completed 2024-03-02T13:10:59.875 INFO:teuthology.orchestra.console.smithi149:Power off completed 2024-03-02T13:10:59.885 INFO:teuthology.orchestra.console.smithi007:Power off completed 2024-03-02T13:10:59.974 INFO:teuthology.orchestra.console.smithi119:Power on 2024-03-02T13:10:59.974 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-02T13:10:59.982 INFO:teuthology.orchestra.console.smithi149:Power on 2024-03-02T13:10:59.982 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-02T13:10:59.989 INFO:teuthology.orchestra.console.smithi007:Power on 2024-03-02T13:10:59.989 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-02T13:10:59.997 DEBUG:teuthology.orchestra.console.smithi119:power on output: Chassis Power Control: Up/On 2024-03-02T13:10:59.997 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-02T13:11:00.006 DEBUG:teuthology.orchestra.console.smithi149:power on output: Chassis Power Control: Up/On 2024-03-02T13:11:00.006 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-02T13:11:00.015 DEBUG:teuthology.orchestra.console.smithi007:power on output: Chassis Power Control: Up/On 2024-03-02T13:11:00.016 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-02T13:11:00.024 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off 2024-03-02T13:11:00.027 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is off 2024-03-02T13:11:00.037 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is off 2024-03-02T13:11:04.028 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-02T13:11:04.036 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-02T13:11:04.042 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-02T13:11:04.138 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off 2024-03-02T13:11:04.143 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is off 2024-03-02T13:11:04.151 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is on 2024-03-02T13:11:04.251 INFO:teuthology.orchestra.console.smithi007:Power on completed 2024-03-02T13:11:04.352 INFO:teuthology.provision.fog.smithi007:Waiting for deploy to finish 2024-03-02T13:11:08.140 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-02T13:11:08.146 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-02T13:11:08.249 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on 2024-03-02T13:11:08.254 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is on 2024-03-02T13:11:08.350 INFO:teuthology.orchestra.console.smithi119:Power on completed 2024-03-02T13:11:08.355 INFO:teuthology.orchestra.console.smithi149:Power on completed 2024-03-02T13:11:08.451 INFO:teuthology.provision.fog.smithi119:Waiting for deploy to finish 2024-03-02T13:11:08.456 INFO:teuthology.provision.fog.smithi149:Waiting for deploy to finish 2024-03-02T13:13:35.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-02T13:13:38.364 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7 2024-03-02T13:13:39.366 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-02T13:13:42.428 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-03-02T13:13:44.368 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-02T13:13:47.420 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7 2024-03-02T13:13:48.430 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-02T13:13:51.484 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-03-02T13:13:53.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-02T13:13:54.418 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-02T13:13:56.476 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7 2024-03-02T13:13:57.468 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2024-03-02T13:13:57.485 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-02T13:14:00.540 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-03-02T13:14:02.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-02T13:14:03.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-02T13:14:05.532 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7 2024-03-02T13:14:06.524 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2024-03-02T13:14:06.542 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-02T13:14:09.596 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-03-02T13:14:11.535 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-02T13:14:12.526 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-02T13:14:14.588 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7 2024-03-02T13:14:15.580 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2024-03-02T13:14:15.598 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-02T13:14:18.652 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-03-02T13:14:20.591 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-02T13:14:21.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-02T13:14:23.644 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7 2024-03-02T13:14:24.636 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2024-03-02T13:14:24.653 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-02T13:14:27.708 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-03-02T13:14:29.648 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-02T13:14:30.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-02T13:14:33.692 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2024-03-02T13:14:33.709 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-02T13:14:36.764 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-03-02T13:14:39.697 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-02T13:14:42.748 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2024-03-02T13:14:42.767 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-02T13:14:48.752 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-02T13:15:01.308 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-03-02T13:15:07.315 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-02T13:15:10.396 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-03-02T13:15:16.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-02T13:15:19.484 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-03-02T13:15:25.485 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-02T13:15:25.762 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-02T13:15:25.763 DEBUG:teuthology.orchestra.run.smithi119:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-02T13:15:29.650 WARNING:teuthology.provision.fog.smithi007:timed out 2024-03-02T13:15:35.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-02T13:15:35.923 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-02T13:15:35.924 DEBUG:teuthology.orchestra.run.smithi007:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-02T13:15:36.277 INFO:teuthology.provision.fog.smithi007:Node is ready 2024-03-02T13:15:36.277 DEBUG:teuthology.orchestra.run.smithi007:> hostname 2024-03-02T13:15:36.292 INFO:teuthology.orchestra.run.smithi007.stdout:smithi007.front.sepia.ceph.com 2024-03-02T13:15:36.293 DEBUG:teuthology.orchestra.run.smithi007:> grep smithi007.front.sepia.ceph.com /etc/hosts 2024-03-02T13:15:36.348 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7 smithi007.front.sepia.ceph.com smithi007 2024-03-02T13:15:36.348 DEBUG:teuthology.orchestra.run.smithi007:> sudo hostname smithi007 2024-03-02T13:15:36.462 DEBUG:teuthology.orchestra.run.smithi007:> sudo sed -i -e 's/smithi007.front.sepia.ceph.com/smithi007/g' /etc/hosts 2024-03-02T13:15:36.494 DEBUG:teuthology.orchestra.run.smithi007:> sudo sed -i -e 's/172.21.15.7/172.21.15.7/g' /etc/hosts 2024-03-02T13:15:36.565 DEBUG:teuthology.orchestra.run.smithi007:> sudo sed -i -e 's/smithi007.front.sepia.ceph.com/smithi007/g' /etc/hostname 2024-03-02T13:15:36.636 DEBUG:teuthology.orchestra.run.smithi007:> sudo hostname smithi007 2024-03-02T13:15:36.706 DEBUG:teuthology.orchestra.run.smithi007:> cat /etc/os-release 2024-03-02T13:15:36.761 INFO:teuthology.orchestra.run.smithi007.stdout:NAME="CentOS Stream" 2024-03-02T13:15:36.761 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION="9" 2024-03-02T13:15:36.761 INFO:teuthology.orchestra.run.smithi007.stdout:ID="centos" 2024-03-02T13:15:36.761 INFO:teuthology.orchestra.run.smithi007.stdout:ID_LIKE="rhel fedora" 2024-03-02T13:15:36.761 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION_ID="9" 2024-03-02T13:15:36.761 INFO:teuthology.orchestra.run.smithi007.stdout:PLATFORM_ID="platform:el9" 2024-03-02T13:15:36.761 INFO:teuthology.orchestra.run.smithi007.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-02T13:15:36.761 INFO:teuthology.orchestra.run.smithi007.stdout:ANSI_COLOR="0;31" 2024-03-02T13:15:36.761 INFO:teuthology.orchestra.run.smithi007.stdout:LOGO="fedora-logo-icon" 2024-03-02T13:15:36.761 INFO:teuthology.orchestra.run.smithi007.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-02T13:15:36.761 INFO:teuthology.orchestra.run.smithi007.stdout:HOME_URL="https://centos.org/" 2024-03-02T13:15:36.761 INFO:teuthology.orchestra.run.smithi007.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-02T13:15:36.762 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-02T13:15:36.762 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-02T13:15:36.762 INFO:teuthology.provision.fog.smithi007:Deploy complete! 2024-03-02T13:15:36.764 DEBUG:teuthology.parallel:result is None 2024-03-02T13:15:41.116 INFO:teuthology.provision.fog.smithi119:Node is ready 2024-03-02T13:15:41.116 DEBUG:teuthology.orchestra.run.smithi119:> hostname 2024-03-02T13:15:41.174 INFO:teuthology.orchestra.run.smithi119.stdout:smithi046 2024-03-02T13:15:41.174 DEBUG:teuthology.orchestra.run.smithi119:> grep smithi046 /etc/hosts 2024-03-02T13:15:41.231 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2024-03-02T13:15:41.232 DEBUG:teuthology.orchestra.run.smithi119:> sudo hostname smithi119 2024-03-02T13:15:41.403 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/smithi046/smithi119/g' /etc/hosts 2024-03-02T13:15:41.434 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/172.21.15.46/172.21.15.119/g' /etc/hosts 2024-03-02T13:15:41.503 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/smithi046/smithi119/g' /etc/hostname 2024-03-02T13:15:41.572 DEBUG:teuthology.orchestra.run.smithi119:> sudo hostname smithi119 2024-03-02T13:15:41.640 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release 2024-03-02T13:15:41.695 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="CentOS Stream" 2024-03-02T13:15:41.696 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="9" 2024-03-02T13:15:41.696 INFO:teuthology.orchestra.run.smithi119.stdout:ID="centos" 2024-03-02T13:15:41.696 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="rhel fedora" 2024-03-02T13:15:41.696 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="9" 2024-03-02T13:15:41.696 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el9" 2024-03-02T13:15:41.696 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-02T13:15:41.696 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31" 2024-03-02T13:15:41.696 INFO:teuthology.orchestra.run.smithi119.stdout:LOGO="fedora-logo-icon" 2024-03-02T13:15:41.696 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-02T13:15:41.696 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://centos.org/" 2024-03-02T13:15:41.696 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-02T13:15:41.696 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-02T13:15:41.696 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-02T13:15:41.697 INFO:teuthology.provision.fog.smithi119:Deploy complete! 2024-03-02T13:15:41.697 DEBUG:teuthology.parallel:result is None 2024-03-02T13:15:48.762 WARNING:teuthology.provision.fog.smithi149:timed out 2024-03-02T13:15:54.763 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-02T13:15:54.974 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-02T13:15:54.975 DEBUG:teuthology.orchestra.run.smithi149:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-02T13:15:55.295 INFO:teuthology.provision.fog.smithi149:Node is ready 2024-03-02T13:15:55.296 DEBUG:teuthology.orchestra.run.smithi149:> hostname 2024-03-02T13:15:55.311 INFO:teuthology.orchestra.run.smithi149.stdout:smithi149.front.sepia.ceph.com 2024-03-02T13:15:55.311 DEBUG:teuthology.orchestra.run.smithi149:> grep smithi149.front.sepia.ceph.com /etc/hosts 2024-03-02T13:15:55.369 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.15.149 smithi149.front.sepia.ceph.com smithi149 2024-03-02T13:15:55.370 DEBUG:teuthology.orchestra.run.smithi149:> sudo hostname smithi149 2024-03-02T13:15:55.481 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/smithi149.front.sepia.ceph.com/smithi149/g' /etc/hosts 2024-03-02T13:15:55.508 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/172.21.15.149/172.21.15.149/g' /etc/hosts 2024-03-02T13:15:55.576 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/smithi149.front.sepia.ceph.com/smithi149/g' /etc/hostname 2024-03-02T13:15:55.644 DEBUG:teuthology.orchestra.run.smithi149:> sudo hostname smithi149 2024-03-02T13:15:55.710 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release 2024-03-02T13:15:55.764 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="CentOS Stream" 2024-03-02T13:15:55.764 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="9" 2024-03-02T13:15:55.764 INFO:teuthology.orchestra.run.smithi149.stdout:ID="centos" 2024-03-02T13:15:55.765 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE="rhel fedora" 2024-03-02T13:15:55.765 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="9" 2024-03-02T13:15:55.765 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM_ID="platform:el9" 2024-03-02T13:15:55.765 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-02T13:15:55.765 INFO:teuthology.orchestra.run.smithi149.stdout:ANSI_COLOR="0;31" 2024-03-02T13:15:55.765 INFO:teuthology.orchestra.run.smithi149.stdout:LOGO="fedora-logo-icon" 2024-03-02T13:15:55.765 INFO:teuthology.orchestra.run.smithi149.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-02T13:15:55.765 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://centos.org/" 2024-03-02T13:15:55.765 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-02T13:15:55.765 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-02T13:15:55.765 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-02T13:15:55.765 INFO:teuthology.provision.fog.smithi149:Deploy complete! 2024-03-02T13:15:55.766 DEBUG:teuthology.parallel:result is None 2024-03-02T13:15:56.017 INFO:teuthology.lock.ops:Checking smithi007.front.sepia.ceph.com 2024-03-02T13:15:56.018 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-02T13:15:56.037 INFO:teuthology.lock.ops:Checking smithi119.front.sepia.ceph.com 2024-03-02T13:15:56.037 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-02T13:15:56.062 INFO:teuthology.lock.ops:Checking smithi149.front.sepia.ceph.com 2024-03-02T13:15:56.062 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-02T13:15:56.080 INFO:teuthology.lock.ops:Updating [smithi007.front.sepia.ceph.com]: set os type and version on server 2024-03-02T13:15:56.080 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-03-02T13:15:56.081 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-02T13:15:56.185 DEBUG:teuthology.orchestra.run.smithi007:> true 2024-03-02T13:15:56.366 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-03-02T13:15:56.366 DEBUG:teuthology.orchestra.run.smithi007:> uname -m 2024-03-02T13:15:56.421 INFO:teuthology.orchestra.run.smithi007.stdout:x86_64 2024-03-02T13:15:56.421 DEBUG:teuthology.orchestra.run.smithi007:> cat /etc/os-release 2024-03-02T13:15:56.476 INFO:teuthology.orchestra.run.smithi007.stdout:NAME="CentOS Stream" 2024-03-02T13:15:56.476 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION="9" 2024-03-02T13:15:56.476 INFO:teuthology.orchestra.run.smithi007.stdout:ID="centos" 2024-03-02T13:15:56.476 INFO:teuthology.orchestra.run.smithi007.stdout:ID_LIKE="rhel fedora" 2024-03-02T13:15:56.476 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION_ID="9" 2024-03-02T13:15:56.477 INFO:teuthology.orchestra.run.smithi007.stdout:PLATFORM_ID="platform:el9" 2024-03-02T13:15:56.477 INFO:teuthology.orchestra.run.smithi007.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-02T13:15:56.477 INFO:teuthology.orchestra.run.smithi007.stdout:ANSI_COLOR="0;31" 2024-03-02T13:15:56.477 INFO:teuthology.orchestra.run.smithi007.stdout:LOGO="fedora-logo-icon" 2024-03-02T13:15:56.477 INFO:teuthology.orchestra.run.smithi007.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-02T13:15:56.477 INFO:teuthology.orchestra.run.smithi007.stdout:HOME_URL="https://centos.org/" 2024-03-02T13:15:56.477 INFO:teuthology.orchestra.run.smithi007.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-02T13:15:56.477 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-02T13:15:56.477 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-02T13:15:56.478 INFO:teuthology.lock.ops:Updating smithi007.front.sepia.ceph.com on lock server 2024-03-02T13:15:56.495 INFO:teuthology.lock.ops:Updating [smithi119.front.sepia.ceph.com]: set os type and version on server 2024-03-02T13:15:56.496 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-03-02T13:15:56.496 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-02T13:15:56.583 DEBUG:teuthology.orchestra.run.smithi119:> true 2024-03-02T13:15:56.758 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-03-02T13:15:56.758 DEBUG:teuthology.orchestra.run.smithi119:> uname -m 2024-03-02T13:15:56.812 INFO:teuthology.orchestra.run.smithi119.stdout:x86_64 2024-03-02T13:15:56.812 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release 2024-03-02T13:15:56.866 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="CentOS Stream" 2024-03-02T13:15:56.866 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="9" 2024-03-02T13:15:56.867 INFO:teuthology.orchestra.run.smithi119.stdout:ID="centos" 2024-03-02T13:15:56.867 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="rhel fedora" 2024-03-02T13:15:56.867 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="9" 2024-03-02T13:15:56.867 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el9" 2024-03-02T13:15:56.867 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-02T13:15:56.867 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31" 2024-03-02T13:15:56.867 INFO:teuthology.orchestra.run.smithi119.stdout:LOGO="fedora-logo-icon" 2024-03-02T13:15:56.867 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-02T13:15:56.867 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://centos.org/" 2024-03-02T13:15:56.867 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-02T13:15:56.867 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-02T13:15:56.867 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-02T13:15:56.868 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server 2024-03-02T13:15:56.896 INFO:teuthology.lock.ops:Updating [smithi149.front.sepia.ceph.com]: set os type and version on server 2024-03-02T13:15:56.896 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-03-02T13:15:56.897 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-02T13:15:56.984 DEBUG:teuthology.orchestra.run.smithi149:> true 2024-03-02T13:15:57.051 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-03-02T13:15:57.051 DEBUG:teuthology.orchestra.run.smithi149:> uname -m 2024-03-02T13:15:57.105 INFO:teuthology.orchestra.run.smithi149.stdout:x86_64 2024-03-02T13:15:57.106 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release 2024-03-02T13:15:57.160 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="CentOS Stream" 2024-03-02T13:15:57.160 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="9" 2024-03-02T13:15:57.160 INFO:teuthology.orchestra.run.smithi149.stdout:ID="centos" 2024-03-02T13:15:57.160 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE="rhel fedora" 2024-03-02T13:15:57.160 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="9" 2024-03-02T13:15:57.160 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM_ID="platform:el9" 2024-03-02T13:15:57.160 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-02T13:15:57.161 INFO:teuthology.orchestra.run.smithi149.stdout:ANSI_COLOR="0;31" 2024-03-02T13:15:57.161 INFO:teuthology.orchestra.run.smithi149.stdout:LOGO="fedora-logo-icon" 2024-03-02T13:15:57.161 INFO:teuthology.orchestra.run.smithi149.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-02T13:15:57.161 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://centos.org/" 2024-03-02T13:15:57.161 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-02T13:15:57.161 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-02T13:15:57.161 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-02T13:15:57.161 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server 2024-03-02T13:15:57.188 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-02T13:15:57.280 INFO:teuthology.dispatcher.supervisor:Running job 7579343 2024-03-02T13:15:57.281 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2024-03-02_11:23:29-fs-main-2024feb28-testing-default-smithi/7579343 --name rishabh-2024-03-02_11:23:29-fs-main-2024feb28-testing-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-workunit/suites/fsx}} -- /home/teuthworker/archive/rishabh-2024-03-02_11:23:29-fs-main-2024feb28-testing-default-smithi/7579343/orig.config.yaml 2024-03-02T13:15:57.284 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2024-03-02_11:23:29-fs-main-2024feb28-testing-default-smithi/7579343 2024-03-02T13:15:57.284 INFO:teuthology.dispatcher.supervisor:Job PID: 4085075 2024-03-02T13:15:57.284 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-03-02T13:17:57.375 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-02T13:19:57.550 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-02T13:21:57.721 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-02T13:23:57.901 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-02T13:25:58.068 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-02T13:27:58.228 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-02T13:29:58.351 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-02T13:31:58.532 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-02T13:33:58.724 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-02T13:35:58.874 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-02T13:37:59.041 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-02T13:39:59.222 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-02T13:41:59.393 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-02T13:43:59.558 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-02T13:45:59.720 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-02T13:47:59.885 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-02T13:50:00.056 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-02T13:52:00.237 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-02T13:52:00.310 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1