2024-02-24T10:12:49.836 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55
2024-02-24T10:12:49.837 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-24T10:12:50.268 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f7a06468f40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f7a07407c10>, signals=[15])
2024-02-24T10:12:50.269 INFO:teuthology.lock.ops:Start node 'smithi064.front.sepia.ceph.com' reimaging
2024-02-24T10:12:50.269 INFO:teuthology.lock.ops:Updating [smithi064.front.sepia.ceph.com]: reset os type and version on server
2024-02-24T10:12:50.269 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server
2024-02-24T10:12:50.390 INFO:teuthology.lock.ops:Start node 'smithi149.front.sepia.ceph.com' reimaging
2024-02-24T10:12:50.390 INFO:teuthology.lock.ops:Updating [smithi149.front.sepia.ceph.com]: reset os type and version on server
2024-02-24T10:12:50.391 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server
2024-02-24T10:12:50.407 INFO:teuthology.lock.ops:Start node 'smithi163.front.sepia.ceph.com' reimaging
2024-02-24T10:12:50.407 INFO:teuthology.lock.ops:Updating [smithi163.front.sepia.ceph.com]: reset os type and version on server
2024-02-24T10:12:50.407 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server
2024-02-24T10:12:50.624 DEBUG:teuthology.provision.fog.smithi064:Requesting image smithi_centos_9.stream (ID 10)
2024-02-24T10:12:50.655 DEBUG:teuthology.provision.fog.smithi149:Requesting image smithi_centos_9.stream (ID 10)
2024-02-24T10:12:50.700 DEBUG:teuthology.provision.fog.smithi163:Requesting image smithi_centos_9.stream (ID 10)
2024-02-24T10:12:50.768 INFO:teuthology.provision.fog.smithi064:Scheduling deploy of centos 9.stream
2024-02-24T10:12:50.817 INFO:teuthology.provision.fog.smithi149:Scheduling deploy of centos 9.stream
2024-02-24T10:12:50.861 INFO:teuthology.provision.fog.smithi163:Scheduling deploy of centos 9.stream
2024-02-24T10:12:51.607 INFO:teuthology.orchestra.console.smithi149:Power off
2024-02-24T10:12:51.607 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-24T10:12:51.623 INFO:teuthology.orchestra.console.smithi064:Power off
2024-02-24T10:12:51.623 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-24T10:12:51.633 DEBUG:teuthology.orchestra.console.smithi149:power off output: Chassis Power Control: Down/Off
2024-02-24T10:12:51.634 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-24T10:12:51.648 DEBUG:teuthology.orchestra.console.smithi064:power off output: Chassis Power Control: Down/Off
2024-02-24T10:12:51.648 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-24T10:12:51.661 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is on
2024-02-24T10:12:51.668 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off
2024-02-24T10:12:51.681 INFO:teuthology.orchestra.console.smithi163:Power off
2024-02-24T10:12:51.681 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-24T10:12:51.702 DEBUG:teuthology.orchestra.console.smithi163:power off output: Chassis Power Control: Down/Off
2024-02-24T10:12:51.702 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-24T10:12:51.723 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off
2024-02-24T10:12:51.769 INFO:teuthology.orchestra.console.smithi064:Power off completed
2024-02-24T10:12:51.824 INFO:teuthology.orchestra.console.smithi163:Power off completed
2024-02-24T10:12:51.870 INFO:teuthology.orchestra.console.smithi064:Power on
2024-02-24T10:12:51.870 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-24T10:12:51.896 DEBUG:teuthology.orchestra.console.smithi064:power on output: Chassis Power Control: Up/On
2024-02-24T10:12:51.896 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-24T10:12:51.919 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off
2024-02-24T10:12:51.925 INFO:teuthology.orchestra.console.smithi163:Power on
2024-02-24T10:12:51.925 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-24T10:12:51.947 DEBUG:teuthology.orchestra.console.smithi163:power on output: Chassis Power Control: Up/On
2024-02-24T10:12:51.947 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-24T10:12:51.968 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off
2024-02-24T10:12:55.666 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-24T10:12:55.775 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is on
2024-02-24T10:12:55.921 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-24T10:12:55.969 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-24T10:12:56.029 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on
2024-02-24T10:12:56.077 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on
2024-02-24T10:12:56.131 INFO:teuthology.orchestra.console.smithi064:Power on completed
2024-02-24T10:12:56.178 INFO:teuthology.orchestra.console.smithi163:Power on completed
2024-02-24T10:12:56.232 INFO:teuthology.provision.fog.smithi064:Waiting for deploy to finish
2024-02-24T10:12:56.279 INFO:teuthology.provision.fog.smithi163:Waiting for deploy to finish
2024-02-24T10:12:59.779 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-24T10:12:59.888 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is off
2024-02-24T10:12:59.988 INFO:teuthology.orchestra.console.smithi149:Power off completed
2024-02-24T10:13:00.089 INFO:teuthology.orchestra.console.smithi149:Power on
2024-02-24T10:13:00.089 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-24T10:13:00.110 DEBUG:teuthology.orchestra.console.smithi149:power on output: Chassis Power Control: Up/On
2024-02-24T10:13:00.111 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-24T10:13:00.130 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is off
2024-02-24T10:13:04.132 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-24T10:13:04.241 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is off
2024-02-24T10:13:08.244 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-24T10:13:08.426 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is on
2024-02-24T10:13:08.527 INFO:teuthology.orchestra.console.smithi149:Power on completed
2024-02-24T10:13:08.628 INFO:teuthology.provision.fog.smithi149:Waiting for deploy to finish
2024-02-24T10:17:39.245 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-24T10:17:42.300 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-02-24T10:17:48.304 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-24T10:17:51.356 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-02-24T10:17:57.360 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-24T10:18:00.412 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-02-24T10:18:06.415 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-24T10:18:09.472 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-02-24T10:18:15.476 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-24T10:18:18.560 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-02-24T10:18:24.561 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-24T10:18:27.612 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-02-24T10:18:33.614 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-24T10:18:36.668 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-02-24T10:18:42.672 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-24T10:18:45.724 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-02-24T10:18:51.727 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-24T10:18:54.780 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-02-24T10:19:00.788 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-24T10:19:04.867 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-24T10:19:07.932 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149
2024-02-24T10:19:13.937 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-24T10:19:16.988 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149
2024-02-24T10:19:19.228 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-02-24T10:19:22.993 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-24T10:19:24.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-24T10:19:25.229 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-24T10:19:26.044 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149
2024-02-24T10:19:28.064 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64
2024-02-24T10:19:28.284 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-02-24T10:19:32.048 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-24T10:19:34.067 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-24T10:19:34.285 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-24T10:19:35.100 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149
2024-02-24T10:19:37.148 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64
2024-02-24T10:19:37.340 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-02-24T10:19:41.105 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-24T10:19:43.152 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-24T10:19:43.341 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-24T10:19:43.585 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-24T10:19:43.585 DEBUG:teuthology.orchestra.run.smithi163:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-24T10:19:44.156 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149
2024-02-24T10:19:46.204 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64
2024-02-24T10:19:50.157 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-24T10:19:52.205 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-24T10:19:53.212 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149
2024-02-24T10:19:55.260 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64
2024-02-24T10:19:59.213 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-24T10:20:01.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-24T10:20:02.268 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149
2024-02-24T10:20:03.902 INFO:teuthology.provision.fog.smithi163:Node is ready
2024-02-24T10:20:03.902 DEBUG:teuthology.orchestra.run.smithi163:> hostname
2024-02-24T10:20:03.921 INFO:teuthology.orchestra.run.smithi163.stdout:smithi163.front.sepia.ceph.com
2024-02-24T10:20:03.921 DEBUG:teuthology.orchestra.run.smithi163:> grep smithi163.front.sepia.ceph.com /etc/hosts
2024-02-24T10:20:03.978 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163 smithi163.front.sepia.ceph.com smithi163
2024-02-24T10:20:03.978 DEBUG:teuthology.orchestra.run.smithi163:> sudo hostname smithi163
2024-02-24T10:20:04.101 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/smithi163.front.sepia.ceph.com/smithi163/g' /etc/hosts
2024-02-24T10:20:04.131 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/172.21.15.163/172.21.15.163/g' /etc/hosts
2024-02-24T10:20:04.202 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/smithi163.front.sepia.ceph.com/smithi163/g' /etc/hostname
2024-02-24T10:20:04.271 DEBUG:teuthology.orchestra.run.smithi163:> sudo hostname smithi163
2024-02-24T10:20:04.316 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64
2024-02-24T10:20:04.340 DEBUG:teuthology.orchestra.run.smithi163:> cat /etc/os-release
2024-02-24T10:20:04.396 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="CentOS Stream"
2024-02-24T10:20:04.396 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="9"
2024-02-24T10:20:04.396 INFO:teuthology.orchestra.run.smithi163.stdout:ID="centos"
2024-02-24T10:20:04.396 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE="rhel fedora"
2024-02-24T10:20:04.396 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="9"
2024-02-24T10:20:04.396 INFO:teuthology.orchestra.run.smithi163.stdout:PLATFORM_ID="platform:el9"
2024-02-24T10:20:04.397 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-24T10:20:04.397 INFO:teuthology.orchestra.run.smithi163.stdout:ANSI_COLOR="0;31"
2024-02-24T10:20:04.397 INFO:teuthology.orchestra.run.smithi163.stdout:LOGO="fedora-logo-icon"
2024-02-24T10:20:04.397 INFO:teuthology.orchestra.run.smithi163.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-24T10:20:04.397 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://centos.org/"
2024-02-24T10:20:04.397 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-24T10:20:04.397 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-24T10:20:04.397 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-24T10:20:04.398 INFO:teuthology.provision.fog.smithi163:Deploy complete!
2024-02-24T10:20:04.400 DEBUG:teuthology.parallel:result is None
2024-02-24T10:20:08.272 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-24T10:20:10.319 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-24T10:20:13.372 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64
2024-02-24T10:20:19.379 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-24T10:20:22.460 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64
2024-02-24T10:20:28.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-24T10:20:38.844 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64
2024-02-24T10:20:44.845 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-24T10:20:47.900 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64
2024-02-24T10:20:53.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-24T10:20:56.992 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64
2024-02-24T10:21:02.998 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-24T10:21:04.465 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-24T10:21:04.466 DEBUG:teuthology.orchestra.run.smithi064:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-24T10:21:08.275 WARNING:teuthology.provision.fog.smithi149:timed out
2024-02-24T10:21:14.277 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-24T10:21:14.632 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-24T10:21:14.632 DEBUG:teuthology.orchestra.run.smithi149:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-24T10:21:14.944 INFO:teuthology.provision.fog.smithi149:Node is ready
2024-02-24T10:21:14.944 DEBUG:teuthology.orchestra.run.smithi149:> hostname
2024-02-24T10:21:14.958 INFO:teuthology.orchestra.run.smithi149.stdout:smithi149.front.sepia.ceph.com
2024-02-24T10:21:14.959 DEBUG:teuthology.orchestra.run.smithi149:> grep smithi149.front.sepia.ceph.com /etc/hosts
2024-02-24T10:21:15.014 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.15.149 smithi149.front.sepia.ceph.com smithi149
2024-02-24T10:21:15.014 DEBUG:teuthology.orchestra.run.smithi149:> sudo hostname smithi149
2024-02-24T10:21:15.121 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/smithi149.front.sepia.ceph.com/smithi149/g' /etc/hosts
2024-02-24T10:21:15.150 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/172.21.15.149/172.21.15.149/g' /etc/hosts
2024-02-24T10:21:15.217 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/smithi149.front.sepia.ceph.com/smithi149/g' /etc/hostname
2024-02-24T10:21:15.284 DEBUG:teuthology.orchestra.run.smithi149:> sudo hostname smithi149
2024-02-24T10:21:15.351 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release
2024-02-24T10:21:15.405 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="CentOS Stream"
2024-02-24T10:21:15.405 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="9"
2024-02-24T10:21:15.405 INFO:teuthology.orchestra.run.smithi149.stdout:ID="centos"
2024-02-24T10:21:15.405 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE="rhel fedora"
2024-02-24T10:21:15.405 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="9"
2024-02-24T10:21:15.405 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM_ID="platform:el9"
2024-02-24T10:21:15.405 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-24T10:21:15.405 INFO:teuthology.orchestra.run.smithi149.stdout:ANSI_COLOR="0;31"
2024-02-24T10:21:15.405 INFO:teuthology.orchestra.run.smithi149.stdout:LOGO="fedora-logo-icon"
2024-02-24T10:21:15.406 INFO:teuthology.orchestra.run.smithi149.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-24T10:21:15.406 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://centos.org/"
2024-02-24T10:21:15.406 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-24T10:21:15.406 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-24T10:21:15.406 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-24T10:21:15.406 INFO:teuthology.provision.fog.smithi149:Deploy complete!
2024-02-24T10:21:15.407 DEBUG:teuthology.parallel:result is None
2024-02-24T10:21:24.828 INFO:teuthology.provision.fog.smithi064:Node is ready
2024-02-24T10:21:24.828 DEBUG:teuthology.orchestra.run.smithi064:> hostname
2024-02-24T10:21:24.847 INFO:teuthology.orchestra.run.smithi064.stdout:smithi046
2024-02-24T10:21:24.847 DEBUG:teuthology.orchestra.run.smithi064:> grep smithi046 /etc/hosts
2024-02-24T10:21:24.904 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046
2024-02-24T10:21:24.905 DEBUG:teuthology.orchestra.run.smithi064:> sudo hostname smithi064
2024-02-24T10:21:25.049 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/smithi046/smithi064/g' /etc/hosts
2024-02-24T10:21:25.084 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/172.21.15.46/172.21.15.64/g' /etc/hosts
2024-02-24T10:21:25.157 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/smithi046/smithi064/g' /etc/hostname
2024-02-24T10:21:25.229 DEBUG:teuthology.orchestra.run.smithi064:> sudo hostname smithi064
2024-02-24T10:21:25.301 DEBUG:teuthology.orchestra.run.smithi064:> cat /etc/os-release
2024-02-24T10:21:25.356 INFO:teuthology.orchestra.run.smithi064.stdout:NAME="CentOS Stream"
2024-02-24T10:21:25.356 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION="9"
2024-02-24T10:21:25.357 INFO:teuthology.orchestra.run.smithi064.stdout:ID="centos"
2024-02-24T10:21:25.357 INFO:teuthology.orchestra.run.smithi064.stdout:ID_LIKE="rhel fedora"
2024-02-24T10:21:25.357 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_ID="9"
2024-02-24T10:21:25.357 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM_ID="platform:el9"
2024-02-24T10:21:25.357 INFO:teuthology.orchestra.run.smithi064.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-24T10:21:25.357 INFO:teuthology.orchestra.run.smithi064.stdout:ANSI_COLOR="0;31"
2024-02-24T10:21:25.357 INFO:teuthology.orchestra.run.smithi064.stdout:LOGO="fedora-logo-icon"
2024-02-24T10:21:25.357 INFO:teuthology.orchestra.run.smithi064.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-24T10:21:25.357 INFO:teuthology.orchestra.run.smithi064.stdout:HOME_URL="https://centos.org/"
2024-02-24T10:21:25.357 INFO:teuthology.orchestra.run.smithi064.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-24T10:21:25.357 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-24T10:21:25.357 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-24T10:21:25.358 INFO:teuthology.provision.fog.smithi064:Deploy complete!
2024-02-24T10:21:25.358 DEBUG:teuthology.parallel:result is None
2024-02-24T10:21:25.571 INFO:teuthology.lock.ops:Checking smithi064.front.sepia.ceph.com
2024-02-24T10:21:25.571 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-24T10:21:25.590 INFO:teuthology.lock.ops:Checking smithi149.front.sepia.ceph.com
2024-02-24T10:21:25.590 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-24T10:21:25.606 INFO:teuthology.lock.ops:Checking smithi163.front.sepia.ceph.com
2024-02-24T10:21:25.606 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-24T10:21:25.624 INFO:teuthology.lock.ops:Updating [smithi064.front.sepia.ceph.com]: set os type and version on server
2024-02-24T10:21:25.624 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi064.front.sepia.ceph.com'
2024-02-24T10:21:25.624 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-24T10:21:25.722 DEBUG:teuthology.orchestra.run.smithi064:> true
2024-02-24T10:21:25.790 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi064.front.sepia.ceph.com'
2024-02-24T10:21:25.790 DEBUG:teuthology.orchestra.run.smithi064:> uname -m
2024-02-24T10:21:25.844 INFO:teuthology.orchestra.run.smithi064.stdout:x86_64
2024-02-24T10:21:25.845 DEBUG:teuthology.orchestra.run.smithi064:> cat /etc/os-release
2024-02-24T10:21:25.899 INFO:teuthology.orchestra.run.smithi064.stdout:NAME="CentOS Stream"
2024-02-24T10:21:25.899 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION="9"
2024-02-24T10:21:25.899 INFO:teuthology.orchestra.run.smithi064.stdout:ID="centos"
2024-02-24T10:21:25.899 INFO:teuthology.orchestra.run.smithi064.stdout:ID_LIKE="rhel fedora"
2024-02-24T10:21:25.899 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_ID="9"
2024-02-24T10:21:25.899 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM_ID="platform:el9"
2024-02-24T10:21:25.899 INFO:teuthology.orchestra.run.smithi064.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-24T10:21:25.899 INFO:teuthology.orchestra.run.smithi064.stdout:ANSI_COLOR="0;31"
2024-02-24T10:21:25.899 INFO:teuthology.orchestra.run.smithi064.stdout:LOGO="fedora-logo-icon"
2024-02-24T10:21:25.899 INFO:teuthology.orchestra.run.smithi064.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-24T10:21:25.899 INFO:teuthology.orchestra.run.smithi064.stdout:HOME_URL="https://centos.org/"
2024-02-24T10:21:25.900 INFO:teuthology.orchestra.run.smithi064.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-24T10:21:25.900 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-24T10:21:25.900 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-24T10:21:25.900 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server
2024-02-24T10:21:25.923 INFO:teuthology.lock.ops:Updating [smithi149.front.sepia.ceph.com]: set os type and version on server
2024-02-24T10:21:25.923 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com'
2024-02-24T10:21:25.923 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-24T10:21:26.011 DEBUG:teuthology.orchestra.run.smithi149:> true
2024-02-24T10:21:26.178 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi149.front.sepia.ceph.com'
2024-02-24T10:21:26.178 DEBUG:teuthology.orchestra.run.smithi149:> uname -m
2024-02-24T10:21:26.232 INFO:teuthology.orchestra.run.smithi149.stdout:x86_64
2024-02-24T10:21:26.232 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release
2024-02-24T10:21:26.287 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="CentOS Stream"
2024-02-24T10:21:26.287 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="9"
2024-02-24T10:21:26.287 INFO:teuthology.orchestra.run.smithi149.stdout:ID="centos"
2024-02-24T10:21:26.287 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE="rhel fedora"
2024-02-24T10:21:26.287 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="9"
2024-02-24T10:21:26.287 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM_ID="platform:el9"
2024-02-24T10:21:26.288 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-24T10:21:26.288 INFO:teuthology.orchestra.run.smithi149.stdout:ANSI_COLOR="0;31"
2024-02-24T10:21:26.288 INFO:teuthology.orchestra.run.smithi149.stdout:LOGO="fedora-logo-icon"
2024-02-24T10:21:26.288 INFO:teuthology.orchestra.run.smithi149.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-24T10:21:26.288 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://centos.org/"
2024-02-24T10:21:26.288 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-24T10:21:26.288 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-24T10:21:26.288 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-24T10:21:26.288 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server
2024-02-24T10:21:26.307 INFO:teuthology.lock.ops:Updating [smithi163.front.sepia.ceph.com]: set os type and version on server
2024-02-24T10:21:26.307 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com'
2024-02-24T10:21:26.307 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-24T10:21:26.393 DEBUG:teuthology.orchestra.run.smithi163:> true
2024-02-24T10:21:26.566 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi163.front.sepia.ceph.com'
2024-02-24T10:21:26.566 DEBUG:teuthology.orchestra.run.smithi163:> uname -m
2024-02-24T10:21:26.621 INFO:teuthology.orchestra.run.smithi163.stdout:x86_64
2024-02-24T10:21:26.621 DEBUG:teuthology.orchestra.run.smithi163:> cat /etc/os-release
2024-02-24T10:21:26.675 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="CentOS Stream"
2024-02-24T10:21:26.675 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="9"
2024-02-24T10:21:26.675 INFO:teuthology.orchestra.run.smithi163.stdout:ID="centos"
2024-02-24T10:21:26.676 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE="rhel fedora"
2024-02-24T10:21:26.676 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="9"
2024-02-24T10:21:26.676 INFO:teuthology.orchestra.run.smithi163.stdout:PLATFORM_ID="platform:el9"
2024-02-24T10:21:26.676 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-24T10:21:26.676 INFO:teuthology.orchestra.run.smithi163.stdout:ANSI_COLOR="0;31"
2024-02-24T10:21:26.676 INFO:teuthology.orchestra.run.smithi163.stdout:LOGO="fedora-logo-icon"
2024-02-24T10:21:26.676 INFO:teuthology.orchestra.run.smithi163.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-24T10:21:26.676 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://centos.org/"
2024-02-24T10:21:26.676 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-24T10:21:26.676 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-24T10:21:26.676 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-24T10:21:26.677 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server
2024-02-24T10:21:26.698 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-24T10:21:26.782 INFO:teuthology.dispatcher.supervisor:Running job 7572945
2024-02-24T10:21:26.782 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-02-24_10:11:26-fs-wip-vshankar-testing-20240216.060239-testing-default-smithi/7572945 --name vshankar-2024-02-24_10:11:26-fs-wip-vshankar-testing-20240216.060239-testing-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/fs/norstats}} -- /home/teuthworker/archive/vshankar-2024-02-24_10:11:26-fs-wip-vshankar-testing-20240216.060239-testing-default-smithi/7572945/orig.config.yaml
2024-02-24T10:21:26.785 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-02-24_10:11:26-fs-wip-vshankar-testing-20240216.060239-testing-default-smithi/7572945
2024-02-24T10:21:26.786 INFO:teuthology.dispatcher.supervisor:Job PID: 1476173
2024-02-24T10:21:26.786 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-02-24T10:23:26.885 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-24T10:25:27.054 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-24T10:27:27.224 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-24T10:29:27.392 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-24T10:31:27.564 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-24T10:33:27.728 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-24T10:35:27.900 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-24T10:37:28.076 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-24T10:39:28.246 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-24T10:41:28.402 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-24T10:43:28.559 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-24T10:45:28.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-24T10:47:28.876 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-24T10:49:29.039 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-24T10:51:29.204 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-24T10:53:29.364 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-24T10:55:29.525 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-24T10:57:29.696 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-24T10:59:29.860 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-24T11:01:30.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-24T11:03:30.212 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-24T11:03:30.281 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1