2024-02-21T06:35:05.695 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55
2024-02-21T06:35:05.695 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T06:35:05.869 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f4c38fc1f70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f4c3a035c10>, signals=[15])
2024-02-21T06:35:05.869 INFO:teuthology.lock.ops:Start node 'smithi050.front.sepia.ceph.com' reimaging
2024-02-21T06:35:05.870 INFO:teuthology.lock.ops:Updating [smithi050.front.sepia.ceph.com]: reset os type and version on server
2024-02-21T06:35:05.870 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server
2024-02-21T06:35:05.891 INFO:teuthology.lock.ops:Start node 'smithi125.front.sepia.ceph.com' reimaging
2024-02-21T06:35:05.891 INFO:teuthology.lock.ops:Updating [smithi125.front.sepia.ceph.com]: reset os type and version on server
2024-02-21T06:35:05.892 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server
2024-02-21T06:35:05.916 INFO:teuthology.lock.ops:Start node 'smithi171.front.sepia.ceph.com' reimaging
2024-02-21T06:35:05.916 INFO:teuthology.lock.ops:Updating [smithi171.front.sepia.ceph.com]: reset os type and version on server
2024-02-21T06:35:05.916 INFO:teuthology.lock.ops:Updating smithi171.front.sepia.ceph.com on lock server
2024-02-21T06:35:06.029 DEBUG:teuthology.provision.fog.smithi050:Requesting image smithi_centos_9.stream (ID 10)
2024-02-21T06:35:06.043 DEBUG:teuthology.provision.fog.smithi125:Requesting image smithi_centos_9.stream (ID 10)
2024-02-21T06:35:06.073 INFO:teuthology.provision.fog.smithi050:Scheduling deploy of centos 9.stream
2024-02-21T06:35:06.076 DEBUG:teuthology.provision.fog.smithi171:Requesting image smithi_centos_9.stream (ID 10)
2024-02-21T06:35:06.091 INFO:teuthology.provision.fog.smithi125:Scheduling deploy of centos 9.stream
2024-02-21T06:35:06.129 INFO:teuthology.provision.fog.smithi171:Scheduling deploy of centos 9.stream
2024-02-21T06:35:06.590 INFO:teuthology.orchestra.console.smithi125:Power off
2024-02-21T06:35:06.590 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-21T06:35:06.607 INFO:teuthology.orchestra.console.smithi171:Power off
2024-02-21T06:35:06.607 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-21T06:35:06.619 INFO:teuthology.orchestra.console.smithi050:Power off
2024-02-21T06:35:06.619 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-21T06:35:06.627 DEBUG:teuthology.orchestra.console.smithi125:power off output: Chassis Power Control: Down/Off
2024-02-21T06:35:06.627 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-21T06:35:06.635 DEBUG:teuthology.orchestra.console.smithi171:power off output: Chassis Power Control: Down/Off
2024-02-21T06:35:06.635 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-21T06:35:06.642 DEBUG:teuthology.orchestra.console.smithi050:power off output: Chassis Power Control: Down/Off
2024-02-21T06:35:06.643 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-21T06:35:06.651 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is on
2024-02-21T06:35:06.654 DEBUG:teuthology.orchestra.console.smithi171:check power output: Chassis Power is on
2024-02-21T06:35:06.668 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is on
2024-02-21T06:35:10.656 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-21T06:35:10.662 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-21T06:35:10.668 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-21T06:35:10.765 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is on
2024-02-21T06:35:10.771 DEBUG:teuthology.orchestra.console.smithi171:check power output: Chassis Power is on
2024-02-21T06:35:10.775 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is on
2024-02-21T06:35:14.770 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-21T06:35:14.776 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-21T06:35:14.782 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-21T06:35:14.878 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off
2024-02-21T06:35:14.884 DEBUG:teuthology.orchestra.console.smithi171:check power output: Chassis Power is on
2024-02-21T06:35:14.889 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is off
2024-02-21T06:35:14.979 INFO:teuthology.orchestra.console.smithi125:Power off completed
2024-02-21T06:35:14.990 INFO:teuthology.orchestra.console.smithi050:Power off completed
2024-02-21T06:35:15.079 INFO:teuthology.orchestra.console.smithi125:Power on
2024-02-21T06:35:15.079 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-21T06:35:15.090 INFO:teuthology.orchestra.console.smithi050:Power on
2024-02-21T06:35:15.091 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-21T06:35:15.100 DEBUG:teuthology.orchestra.console.smithi125:power on output: Chassis Power Control: Up/On
2024-02-21T06:35:15.100 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-21T06:35:15.111 DEBUG:teuthology.orchestra.console.smithi050:power on output: Chassis Power Control: Up/On
2024-02-21T06:35:15.111 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-21T06:35:15.118 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off
2024-02-21T06:35:15.130 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is off
2024-02-21T06:35:18.888 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-21T06:35:18.997 DEBUG:teuthology.orchestra.console.smithi171:check power output: Chassis Power is off
2024-02-21T06:35:19.097 INFO:teuthology.orchestra.console.smithi171:Power off completed
2024-02-21T06:35:19.119 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-21T06:35:19.131 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-21T06:35:19.199 INFO:teuthology.orchestra.console.smithi171:Power on
2024-02-21T06:35:19.199 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-21T06:35:19.220 DEBUG:teuthology.orchestra.console.smithi171:power on output: Chassis Power Control: Up/On
2024-02-21T06:35:19.220 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-21T06:35:19.227 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off
2024-02-21T06:35:19.238 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is off
2024-02-21T06:35:19.239 DEBUG:teuthology.orchestra.console.smithi171:check power output: Chassis Power is off
2024-02-21T06:35:23.232 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-21T06:35:23.240 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-21T06:35:23.248 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-21T06:35:23.343 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is on
2024-02-21T06:35:23.350 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is on
2024-02-21T06:35:23.359 DEBUG:teuthology.orchestra.console.smithi171:check power output: Chassis Power is off
2024-02-21T06:35:23.444 INFO:teuthology.orchestra.console.smithi125:Power on completed
2024-02-21T06:35:23.451 INFO:teuthology.orchestra.console.smithi050:Power on completed
2024-02-21T06:35:23.545 INFO:teuthology.provision.fog.smithi125:Waiting for deploy to finish
2024-02-21T06:35:23.552 INFO:teuthology.provision.fog.smithi050:Waiting for deploy to finish
2024-02-21T06:35:27.360 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-21T06:35:27.468 DEBUG:teuthology.orchestra.console.smithi171:check power output: Chassis Power is on
2024-02-21T06:35:27.569 INFO:teuthology.orchestra.console.smithi171:Power on completed
2024-02-21T06:35:27.670 INFO:teuthology.provision.fog.smithi171:Waiting for deploy to finish
2024-02-21T06:37:54.932 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T06:37:54.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T06:37:58.012 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50
2024-02-21T06:37:58.013 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125
2024-02-21T06:38:04.016 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T06:38:04.018 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T06:38:07.072 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50
2024-02-21T06:38:07.072 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125
2024-02-21T06:38:13.076 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T06:38:13.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T06:38:14.102 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T06:38:16.156 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50
2024-02-21T06:38:16.156 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125
2024-02-21T06:38:17.180 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171
2024-02-21T06:38:22.163 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T06:38:22.165 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T06:38:23.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T06:38:25.244 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50
2024-02-21T06:38:25.244 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125
2024-02-21T06:38:26.236 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171
2024-02-21T06:38:31.245 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T06:38:31.247 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T06:38:32.240 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T06:38:34.300 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50
2024-02-21T06:38:34.300 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125
2024-02-21T06:38:35.292 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171
2024-02-21T06:38:40.305 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T06:38:40.308 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T06:38:41.294 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T06:38:43.388 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125
2024-02-21T06:38:44.348 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171
2024-02-21T06:38:49.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T06:38:50.350 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T06:38:52.476 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125
2024-02-21T06:38:53.404 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171
2024-02-21T06:38:58.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T06:38:59.407 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T06:39:02.460 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171
2024-02-21T06:39:08.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T06:39:11.548 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171
2024-02-21T06:39:17.555 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T06:39:40.330 WARNING:teuthology.provision.fog.smithi050:timed out
2024-02-21T06:39:46.338 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T06:39:46.630 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-21T06:39:46.631 DEBUG:teuthology.orchestra.run.smithi050:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-21T06:39:46.944 INFO:teuthology.provision.fog.smithi050:Node is ready
2024-02-21T06:39:46.944 DEBUG:teuthology.orchestra.run.smithi050:> hostname
2024-02-21T06:39:46.960 INFO:teuthology.orchestra.run.smithi050.stdout:smithi050.front.sepia.ceph.com
2024-02-21T06:39:46.960 DEBUG:teuthology.orchestra.run.smithi050:> grep smithi050.front.sepia.ceph.com /etc/hosts
2024-02-21T06:39:47.016 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50 smithi050.front.sepia.ceph.com smithi050
2024-02-21T06:39:47.016 DEBUG:teuthology.orchestra.run.smithi050:> sudo hostname smithi050
2024-02-21T06:39:47.123 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i -e 's/smithi050.front.sepia.ceph.com/smithi050/g' /etc/hosts
2024-02-21T06:39:47.155 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i -e 's/172.21.15.50/172.21.15.50/g' /etc/hosts
2024-02-21T06:39:47.226 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i -e 's/smithi050.front.sepia.ceph.com/smithi050/g' /etc/hostname
2024-02-21T06:39:47.297 DEBUG:teuthology.orchestra.run.smithi050:> sudo hostname smithi050
2024-02-21T06:39:47.367 DEBUG:teuthology.orchestra.run.smithi050:> cat /etc/os-release
2024-02-21T06:39:47.422 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="CentOS Stream"
2024-02-21T06:39:47.422 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="9"
2024-02-21T06:39:47.422 INFO:teuthology.orchestra.run.smithi050.stdout:ID="centos"
2024-02-21T06:39:47.422 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE="rhel fedora"
2024-02-21T06:39:47.422 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="9"
2024-02-21T06:39:47.422 INFO:teuthology.orchestra.run.smithi050.stdout:PLATFORM_ID="platform:el9"
2024-02-21T06:39:47.422 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-21T06:39:47.422 INFO:teuthology.orchestra.run.smithi050.stdout:ANSI_COLOR="0;31"
2024-02-21T06:39:47.422 INFO:teuthology.orchestra.run.smithi050.stdout:LOGO="fedora-logo-icon"
2024-02-21T06:39:47.423 INFO:teuthology.orchestra.run.smithi050.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-21T06:39:47.423 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://centos.org/"
2024-02-21T06:39:47.423 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-21T06:39:47.423 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-21T06:39:47.423 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-21T06:39:47.424 INFO:teuthology.provision.fog.smithi050:Deploy complete!
2024-02-21T06:39:47.425 DEBUG:teuthology.parallel:result is None
2024-02-21T06:39:58.492 WARNING:teuthology.provision.fog.smithi125:timed out
2024-02-21T06:40:04.497 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T06:40:04.720 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-21T06:40:04.720 DEBUG:teuthology.orchestra.run.smithi125:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-21T06:40:05.015 INFO:teuthology.provision.fog.smithi125:Node is ready
2024-02-21T06:40:05.015 DEBUG:teuthology.orchestra.run.smithi125:> hostname
2024-02-21T06:40:05.069 INFO:teuthology.orchestra.run.smithi125.stdout:smithi125.front.sepia.ceph.com
2024-02-21T06:40:05.069 DEBUG:teuthology.orchestra.run.smithi125:> grep smithi125.front.sepia.ceph.com /etc/hosts
2024-02-21T06:40:05.125 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.15.125 smithi125.front.sepia.ceph.com smithi125
2024-02-21T06:40:05.125 DEBUG:teuthology.orchestra.run.smithi125:> sudo hostname smithi125
2024-02-21T06:40:05.236 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i -e 's/smithi125.front.sepia.ceph.com/smithi125/g' /etc/hosts
2024-02-21T06:40:05.264 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i -e 's/172.21.15.125/172.21.15.125/g' /etc/hosts
2024-02-21T06:40:05.331 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i -e 's/smithi125.front.sepia.ceph.com/smithi125/g' /etc/hostname
2024-02-21T06:40:05.398 DEBUG:teuthology.orchestra.run.smithi125:> sudo hostname smithi125
2024-02-21T06:40:05.464 DEBUG:teuthology.orchestra.run.smithi125:> cat /etc/os-release
2024-02-21T06:40:05.519 INFO:teuthology.orchestra.run.smithi125.stdout:NAME="CentOS Stream"
2024-02-21T06:40:05.519 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION="9"
2024-02-21T06:40:05.519 INFO:teuthology.orchestra.run.smithi125.stdout:ID="centos"
2024-02-21T06:40:05.520 INFO:teuthology.orchestra.run.smithi125.stdout:ID_LIKE="rhel fedora"
2024-02-21T06:40:05.520 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_ID="9"
2024-02-21T06:40:05.520 INFO:teuthology.orchestra.run.smithi125.stdout:PLATFORM_ID="platform:el9"
2024-02-21T06:40:05.520 INFO:teuthology.orchestra.run.smithi125.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-21T06:40:05.520 INFO:teuthology.orchestra.run.smithi125.stdout:ANSI_COLOR="0;31"
2024-02-21T06:40:05.520 INFO:teuthology.orchestra.run.smithi125.stdout:LOGO="fedora-logo-icon"
2024-02-21T06:40:05.520 INFO:teuthology.orchestra.run.smithi125.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-21T06:40:05.520 INFO:teuthology.orchestra.run.smithi125.stdout:HOME_URL="https://centos.org/"
2024-02-21T06:40:05.520 INFO:teuthology.orchestra.run.smithi125.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-21T06:40:05.520 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-21T06:40:05.520 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-21T06:40:05.523 INFO:teuthology.provision.fog.smithi125:Deploy complete!
2024-02-21T06:40:05.524 DEBUG:teuthology.parallel:result is None
2024-02-21T06:40:17.568 WARNING:teuthology.provision.fog.smithi171:timed out
2024-02-21T06:40:23.573 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T06:40:23.794 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-21T06:40:23.794 DEBUG:teuthology.orchestra.run.smithi171:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-21T06:40:24.135 INFO:teuthology.provision.fog.smithi171:Node is ready
2024-02-21T06:40:24.135 DEBUG:teuthology.orchestra.run.smithi171:> hostname
2024-02-21T06:40:24.150 INFO:teuthology.orchestra.run.smithi171.stdout:smithi171.front.sepia.ceph.com
2024-02-21T06:40:24.150 DEBUG:teuthology.orchestra.run.smithi171:> grep smithi171.front.sepia.ceph.com /etc/hosts
2024-02-21T06:40:24.205 INFO:teuthology.orchestra.run.smithi171.stdout:172.21.15.171 smithi171.front.sepia.ceph.com smithi171
2024-02-21T06:40:24.205 DEBUG:teuthology.orchestra.run.smithi171:> sudo hostname smithi171
2024-02-21T06:40:24.313 DEBUG:teuthology.orchestra.run.smithi171:> sudo sed -i -e 's/smithi171.front.sepia.ceph.com/smithi171/g' /etc/hosts
2024-02-21T06:40:24.340 DEBUG:teuthology.orchestra.run.smithi171:> sudo sed -i -e 's/172.21.15.171/172.21.15.171/g' /etc/hosts
2024-02-21T06:40:24.408 DEBUG:teuthology.orchestra.run.smithi171:> sudo sed -i -e 's/smithi171.front.sepia.ceph.com/smithi171/g' /etc/hostname
2024-02-21T06:40:24.474 DEBUG:teuthology.orchestra.run.smithi171:> sudo hostname smithi171
2024-02-21T06:40:24.541 DEBUG:teuthology.orchestra.run.smithi171:> cat /etc/os-release
2024-02-21T06:40:24.595 INFO:teuthology.orchestra.run.smithi171.stdout:NAME="CentOS Stream"
2024-02-21T06:40:24.595 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION="9"
2024-02-21T06:40:24.595 INFO:teuthology.orchestra.run.smithi171.stdout:ID="centos"
2024-02-21T06:40:24.596 INFO:teuthology.orchestra.run.smithi171.stdout:ID_LIKE="rhel fedora"
2024-02-21T06:40:24.596 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION_ID="9"
2024-02-21T06:40:24.596 INFO:teuthology.orchestra.run.smithi171.stdout:PLATFORM_ID="platform:el9"
2024-02-21T06:40:24.596 INFO:teuthology.orchestra.run.smithi171.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-21T06:40:24.596 INFO:teuthology.orchestra.run.smithi171.stdout:ANSI_COLOR="0;31"
2024-02-21T06:40:24.596 INFO:teuthology.orchestra.run.smithi171.stdout:LOGO="fedora-logo-icon"
2024-02-21T06:40:24.596 INFO:teuthology.orchestra.run.smithi171.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-21T06:40:24.596 INFO:teuthology.orchestra.run.smithi171.stdout:HOME_URL="https://centos.org/"
2024-02-21T06:40:24.596 INFO:teuthology.orchestra.run.smithi171.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-21T06:40:24.596 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-21T06:40:24.596 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-21T06:40:24.597 INFO:teuthology.provision.fog.smithi171:Deploy complete!
2024-02-21T06:40:24.597 DEBUG:teuthology.parallel:result is None
2024-02-21T06:40:24.819 INFO:teuthology.lock.ops:Checking smithi050.front.sepia.ceph.com
2024-02-21T06:40:24.820 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-21T06:40:24.835 INFO:teuthology.lock.ops:Checking smithi125.front.sepia.ceph.com
2024-02-21T06:40:24.835 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-21T06:40:24.851 INFO:teuthology.lock.ops:Checking smithi171.front.sepia.ceph.com
2024-02-21T06:40:24.851 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-21T06:40:24.869 INFO:teuthology.lock.ops:Updating [smithi050.front.sepia.ceph.com]: set os type and version on server
2024-02-21T06:40:24.869 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com'
2024-02-21T06:40:24.870 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T06:40:24.972 DEBUG:teuthology.orchestra.run.smithi050:> true
2024-02-21T06:40:25.154 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi050.front.sepia.ceph.com'
2024-02-21T06:40:25.154 DEBUG:teuthology.orchestra.run.smithi050:> uname -m
2024-02-21T06:40:25.209 INFO:teuthology.orchestra.run.smithi050.stdout:x86_64
2024-02-21T06:40:25.209 DEBUG:teuthology.orchestra.run.smithi050:> cat /etc/os-release
2024-02-21T06:40:25.264 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="CentOS Stream"
2024-02-21T06:40:25.264 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="9"
2024-02-21T06:40:25.264 INFO:teuthology.orchestra.run.smithi050.stdout:ID="centos"
2024-02-21T06:40:25.265 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE="rhel fedora"
2024-02-21T06:40:25.265 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="9"
2024-02-21T06:40:25.265 INFO:teuthology.orchestra.run.smithi050.stdout:PLATFORM_ID="platform:el9"
2024-02-21T06:40:25.265 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-21T06:40:25.265 INFO:teuthology.orchestra.run.smithi050.stdout:ANSI_COLOR="0;31"
2024-02-21T06:40:25.265 INFO:teuthology.orchestra.run.smithi050.stdout:LOGO="fedora-logo-icon"
2024-02-21T06:40:25.265 INFO:teuthology.orchestra.run.smithi050.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-21T06:40:25.265 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://centos.org/"
2024-02-21T06:40:25.265 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-21T06:40:25.265 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-21T06:40:25.265 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-21T06:40:25.266 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server
2024-02-21T06:40:25.285 INFO:teuthology.lock.ops:Updating [smithi125.front.sepia.ceph.com]: set os type and version on server
2024-02-21T06:40:25.285 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi125.front.sepia.ceph.com'
2024-02-21T06:40:25.285 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T06:40:25.374 DEBUG:teuthology.orchestra.run.smithi125:> true
2024-02-21T06:40:25.538 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi125.front.sepia.ceph.com'
2024-02-21T06:40:25.538 DEBUG:teuthology.orchestra.run.smithi125:> uname -m
2024-02-21T06:40:25.592 INFO:teuthology.orchestra.run.smithi125.stdout:x86_64
2024-02-21T06:40:25.593 DEBUG:teuthology.orchestra.run.smithi125:> cat /etc/os-release
2024-02-21T06:40:25.646 INFO:teuthology.orchestra.run.smithi125.stdout:NAME="CentOS Stream"
2024-02-21T06:40:25.646 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION="9"
2024-02-21T06:40:25.647 INFO:teuthology.orchestra.run.smithi125.stdout:ID="centos"
2024-02-21T06:40:25.647 INFO:teuthology.orchestra.run.smithi125.stdout:ID_LIKE="rhel fedora"
2024-02-21T06:40:25.647 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_ID="9"
2024-02-21T06:40:25.647 INFO:teuthology.orchestra.run.smithi125.stdout:PLATFORM_ID="platform:el9"
2024-02-21T06:40:25.647 INFO:teuthology.orchestra.run.smithi125.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-21T06:40:25.647 INFO:teuthology.orchestra.run.smithi125.stdout:ANSI_COLOR="0;31"
2024-02-21T06:40:25.647 INFO:teuthology.orchestra.run.smithi125.stdout:LOGO="fedora-logo-icon"
2024-02-21T06:40:25.647 INFO:teuthology.orchestra.run.smithi125.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-21T06:40:25.647 INFO:teuthology.orchestra.run.smithi125.stdout:HOME_URL="https://centos.org/"
2024-02-21T06:40:25.647 INFO:teuthology.orchestra.run.smithi125.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-21T06:40:25.647 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-21T06:40:25.647 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-21T06:40:25.648 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server
2024-02-21T06:40:25.668 INFO:teuthology.lock.ops:Updating [smithi171.front.sepia.ceph.com]: set os type and version on server
2024-02-21T06:40:25.668 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com'
2024-02-21T06:40:25.669 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T06:40:25.757 DEBUG:teuthology.orchestra.run.smithi171:> true
2024-02-21T06:40:25.823 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi171.front.sepia.ceph.com'
2024-02-21T06:40:25.823 DEBUG:teuthology.orchestra.run.smithi171:> uname -m
2024-02-21T06:40:25.878 INFO:teuthology.orchestra.run.smithi171.stdout:x86_64
2024-02-21T06:40:25.879 DEBUG:teuthology.orchestra.run.smithi171:> cat /etc/os-release
2024-02-21T06:40:25.933 INFO:teuthology.orchestra.run.smithi171.stdout:NAME="CentOS Stream"
2024-02-21T06:40:25.934 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION="9"
2024-02-21T06:40:25.934 INFO:teuthology.orchestra.run.smithi171.stdout:ID="centos"
2024-02-21T06:40:25.934 INFO:teuthology.orchestra.run.smithi171.stdout:ID_LIKE="rhel fedora"
2024-02-21T06:40:25.934 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION_ID="9"
2024-02-21T06:40:25.934 INFO:teuthology.orchestra.run.smithi171.stdout:PLATFORM_ID="platform:el9"
2024-02-21T06:40:25.934 INFO:teuthology.orchestra.run.smithi171.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-21T06:40:25.934 INFO:teuthology.orchestra.run.smithi171.stdout:ANSI_COLOR="0;31"
2024-02-21T06:40:25.934 INFO:teuthology.orchestra.run.smithi171.stdout:LOGO="fedora-logo-icon"
2024-02-21T06:40:25.934 INFO:teuthology.orchestra.run.smithi171.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-21T06:40:25.934 INFO:teuthology.orchestra.run.smithi171.stdout:HOME_URL="https://centos.org/"
2024-02-21T06:40:25.934 INFO:teuthology.orchestra.run.smithi171.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-21T06:40:25.934 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-21T06:40:25.934 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-21T06:40:25.935 INFO:teuthology.lock.ops:Updating smithi171.front.sepia.ceph.com on lock server
2024-02-21T06:40:25.960 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T06:40:26.065 INFO:teuthology.dispatcher.supervisor:Running job 7569264
2024-02-21T06:40:26.065 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-02-21_06:28:57-fs-wip-vshankar-testing-20240216.060239-testing-default-smithi/7569264 --name vshankar-2024-02-21_06:28:57-fs-wip-vshankar-testing-20240216.060239-testing-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/suites/blogbench}} -- /home/teuthworker/archive/vshankar-2024-02-21_06:28:57-fs-wip-vshankar-testing-20240216.060239-testing-default-smithi/7569264/orig.config.yaml
2024-02-21T06:40:26.068 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-02-21_06:28:57-fs-wip-vshankar-testing-20240216.060239-testing-default-smithi/7569264
2024-02-21T06:40:26.068 INFO:teuthology.dispatcher.supervisor:Job PID: 4059309
2024-02-21T06:40:26.068 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-02-21T06:42:26.166 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T06:44:26.337 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T06:46:26.505 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T06:48:26.685 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T06:50:26.837 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T06:52:27.009 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T06:54:27.172 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T06:56:27.351 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T06:58:27.529 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T07:00:27.709 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T07:02:27.881 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T07:04:28.051 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T07:06:28.217 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T07:08:28.385 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T07:10:28.573 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T07:12:28.761 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T07:14:28.949 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T07:16:29.122 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T07:18:29.229 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T07:20:29.421 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T07:22:29.593 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T07:24:29.765 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T07:26:29.937 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T07:28:30.157 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T07:30:30.333 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T07:32:30.508 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T07:34:30.678 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T07:34:30.767 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1