2024-04-15T02:32:59.806 INFO:root:teuthology version: 0.0.1.dev267+g6c63784
2024-04-15T02:32:59.807 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-15T02:32:59.976 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f11daa4ff40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f11dbaafc10>, signals=[15])
2024-04-15T02:32:59.977 INFO:teuthology.lock.ops:Start node 'smithi027.front.sepia.ceph.com' reimaging
2024-04-15T02:32:59.977 INFO:teuthology.lock.ops:Updating [smithi027.front.sepia.ceph.com]: reset os type and version on server
2024-04-15T02:32:59.977 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server
2024-04-15T02:33:00.000 INFO:teuthology.lock.ops:Start node 'smithi043.front.sepia.ceph.com' reimaging
2024-04-15T02:33:00.001 INFO:teuthology.lock.ops:Updating [smithi043.front.sepia.ceph.com]: reset os type and version on server
2024-04-15T02:33:00.001 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server
2024-04-15T02:33:00.025 INFO:teuthology.lock.ops:Start node 'smithi165.front.sepia.ceph.com' reimaging
2024-04-15T02:33:00.026 INFO:teuthology.lock.ops:Updating [smithi165.front.sepia.ceph.com]: reset os type and version on server
2024-04-15T02:33:00.026 INFO:teuthology.lock.ops:Updating smithi165.front.sepia.ceph.com on lock server
2024-04-15T02:33:00.121 DEBUG:teuthology.provision.fog.smithi027:Requesting image smithi_centos_8.stream (ID 3)
2024-04-15T02:33:00.147 DEBUG:teuthology.provision.fog.smithi043:Requesting image smithi_centos_8.stream (ID 3)
2024-04-15T02:33:00.165 DEBUG:teuthology.provision.fog.smithi165:Requesting image smithi_centos_8.stream (ID 3)
2024-04-15T02:33:00.168 INFO:teuthology.provision.fog.smithi027:Scheduling deploy of centos 8.stream
2024-04-15T02:33:00.188 INFO:teuthology.provision.fog.smithi043:Scheduling deploy of centos 8.stream
2024-04-15T02:33:00.212 INFO:teuthology.provision.fog.smithi165:Scheduling deploy of centos 8.stream
2024-04-15T02:33:00.421 INFO:teuthology.orchestra.console.smithi027:Power off
2024-04-15T02:33:00.422 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-15T02:33:00.444 DEBUG:teuthology.orchestra.console.smithi027:power off output: Chassis Power Control: Down/Off
2024-04-15T02:33:00.445 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-15T02:33:00.458 INFO:teuthology.orchestra.console.smithi165:Power off
2024-04-15T02:33:00.459 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-15T02:33:00.470 INFO:teuthology.orchestra.console.smithi043:Power off
2024-04-15T02:33:00.471 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-15T02:33:00.480 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on
2024-04-15T02:33:00.480 DEBUG:teuthology.orchestra.console.smithi165:power off output: Chassis Power Control: Down/Off
2024-04-15T02:33:00.480 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-15T02:33:00.493 DEBUG:teuthology.orchestra.console.smithi043:power off output: Chassis Power Control: Down/Off
2024-04-15T02:33:00.494 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-15T02:33:00.502 DEBUG:teuthology.orchestra.console.smithi165:check power output: Chassis Power is on
2024-04-15T02:33:00.526 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is on
2024-04-15T02:33:04.482 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-15T02:33:04.503 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-15T02:33:04.529 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-15T02:33:04.591 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on
2024-04-15T02:33:04.612 DEBUG:teuthology.orchestra.console.smithi165:check power output: Chassis Power is on
2024-04-15T02:33:04.638 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is on
2024-04-15T02:33:08.594 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-15T02:33:08.613 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-15T02:33:08.639 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-15T02:33:08.703 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off
2024-04-15T02:33:08.724 DEBUG:teuthology.orchestra.console.smithi165:check power output: Chassis Power is on
2024-04-15T02:33:08.747 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is off
2024-04-15T02:33:08.805 INFO:teuthology.orchestra.console.smithi027:Power off completed
2024-04-15T02:33:08.848 INFO:teuthology.orchestra.console.smithi043:Power off completed
2024-04-15T02:33:08.906 INFO:teuthology.orchestra.console.smithi027:Power on
2024-04-15T02:33:08.906 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-15T02:33:08.929 DEBUG:teuthology.orchestra.console.smithi027:power on output: Chassis Power Control: Up/On
2024-04-15T02:33:08.929 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-15T02:33:08.949 INFO:teuthology.orchestra.console.smithi043:Power on
2024-04-15T02:33:08.950 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-15T02:33:08.957 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off
2024-04-15T02:33:08.971 DEBUG:teuthology.orchestra.console.smithi043:power on output: Chassis Power Control: Up/On
2024-04-15T02:33:08.972 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-15T02:33:08.995 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is off
2024-04-15T02:33:12.726 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-15T02:33:12.836 DEBUG:teuthology.orchestra.console.smithi165:check power output: Chassis Power is off
2024-04-15T02:33:12.936 INFO:teuthology.orchestra.console.smithi165:Power off completed
2024-04-15T02:33:12.959 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-15T02:33:12.996 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-15T02:33:13.037 INFO:teuthology.orchestra.console.smithi165:Power on
2024-04-15T02:33:13.038 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-15T02:33:13.060 DEBUG:teuthology.orchestra.console.smithi165:power on output: Chassis Power Control: Up/On
2024-04-15T02:33:13.060 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-15T02:33:13.068 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off
2024-04-15T02:33:13.081 DEBUG:teuthology.orchestra.console.smithi165:check power output: Chassis Power is off
2024-04-15T02:33:13.105 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is on
2024-04-15T02:33:13.205 INFO:teuthology.orchestra.console.smithi043:Power on completed
2024-04-15T02:33:13.306 INFO:teuthology.provision.fog.smithi043:Waiting for deploy to finish
2024-04-15T02:33:17.070 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-15T02:33:17.082 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-15T02:33:17.179 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on
2024-04-15T02:33:17.190 DEBUG:teuthology.orchestra.console.smithi165:check power output: Chassis Power is off
2024-04-15T02:33:17.281 INFO:teuthology.orchestra.console.smithi027:Power on completed
2024-04-15T02:33:17.381 INFO:teuthology.provision.fog.smithi027:Waiting for deploy to finish
2024-04-15T02:33:21.194 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-15T02:33:21.306 DEBUG:teuthology.orchestra.console.smithi165:check power output: Chassis Power is on
2024-04-15T02:33:21.407 INFO:teuthology.orchestra.console.smithi165:Power on completed
2024-04-15T02:33:21.508 INFO:teuthology.provision.fog.smithi165:Waiting for deploy to finish
2024-04-15T02:35:44.111 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-15T02:35:47.166 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43
2024-04-15T02:35:53.169 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-15T02:35:56.222 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43
2024-04-15T02:36:02.227 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-15T02:36:05.278 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43
2024-04-15T02:36:07.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-15T02:36:10.462 WARNING:teuthology.provision.fog.smithi165:[Errno None] Unable to connect to port 22 on 172.21.15.165
2024-04-15T02:36:11.280 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-15T02:36:14.334 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43
2024-04-15T02:36:16.466 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-15T02:36:19.518 WARNING:teuthology.provision.fog.smithi165:[Errno None] Unable to connect to port 22 on 172.21.15.165
2024-04-15T02:36:20.337 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-15T02:36:23.394 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43
2024-04-15T02:36:25.522 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-15T02:36:28.574 WARNING:teuthology.provision.fog.smithi165:[Errno None] Unable to connect to port 22 on 172.21.15.165
2024-04-15T02:36:29.396 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-15T02:36:32.450 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43
2024-04-15T02:36:33.371 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-15T02:36:33.514 ERROR:teuthology.orchestra.connection:Error authenticating with smithi027.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-15T02:36:34.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-15T02:36:37.630 WARNING:teuthology.provision.fog.smithi165:[Errno None] Unable to connect to port 22 on 172.21.15.165
2024-04-15T02:36:38.452 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-15T02:36:43.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-15T02:36:46.690 WARNING:teuthology.provision.fog.smithi165:[Errno None] Unable to connect to port 22 on 172.21.15.165
2024-04-15T02:36:52.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-15T02:36:55.742 WARNING:teuthology.provision.fog.smithi165:[Errno None] Unable to connect to port 22 on 172.21.15.165
2024-04-15T02:37:01.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-15T02:37:04.802 WARNING:teuthology.provision.fog.smithi165:[Errno None] Unable to connect to port 22 on 172.21.15.165
2024-04-15T02:37:10.804 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-15T02:37:13.854 WARNING:teuthology.provision.fog.smithi165:[Errno None] Unable to connect to port 22 on 172.21.15.165
2024-04-15T02:37:19.856 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-15T02:37:37.517 WARNING:teuthology.provision.fog.smithi027:timed out
2024-04-15T02:37:38.454 WARNING:teuthology.provision.fog.smithi043:timed out
2024-04-15T02:37:43.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-15T02:37:44.456 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-15T02:37:44.718 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-15T02:37:44.721 DEBUG:teuthology.orchestra.run.smithi043:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-15T02:37:44.977 INFO:teuthology.provision.fog.smithi043:Node is ready
2024-04-15T02:37:44.977 DEBUG:teuthology.orchestra.run.smithi043:> hostname
2024-04-15T02:37:45.041 INFO:teuthology.orchestra.run.smithi043.stdout:smithi043.front.sepia.ceph.com
2024-04-15T02:37:45.041 DEBUG:teuthology.orchestra.run.smithi043:> grep smithi043.front.sepia.ceph.com /etc/hosts
2024-04-15T02:37:45.105 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43 smithi043.front.sepia.ceph.com smithi043
2024-04-15T02:37:45.105 DEBUG:teuthology.orchestra.run.smithi043:> sudo hostname smithi043
2024-04-15T02:37:45.231 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i -e 's/smithi043.front.sepia.ceph.com/smithi043/g' /etc/hosts
2024-04-15T02:37:45.262 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i -e 's/172.21.15.43/172.21.15.43/g' /etc/hosts
2024-04-15T02:37:45.335 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i -e 's/smithi043.front.sepia.ceph.com/smithi043/g' /etc/hostname
2024-04-15T02:37:45.408 DEBUG:teuthology.orchestra.run.smithi043:> sudo hostname smithi043
2024-04-15T02:37:45.480 DEBUG:teuthology.orchestra.run.smithi043:> cat /etc/os-release
2024-04-15T02:37:45.542 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="CentOS Stream"
2024-04-15T02:37:45.542 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="8"
2024-04-15T02:37:45.542 INFO:teuthology.orchestra.run.smithi043.stdout:ID="centos"
2024-04-15T02:37:45.542 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE="rhel fedora"
2024-04-15T02:37:45.542 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="8"
2024-04-15T02:37:45.542 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM_ID="platform:el8"
2024-04-15T02:37:45.542 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="CentOS Stream 8"
2024-04-15T02:37:45.543 INFO:teuthology.orchestra.run.smithi043.stdout:ANSI_COLOR="0;31"
2024-04-15T02:37:45.543 INFO:teuthology.orchestra.run.smithi043.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-04-15T02:37:45.543 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://centos.org/"
2024-04-15T02:37:45.543 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-15T02:37:45.543 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-15T02:37:45.543 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-15T02:37:45.544 INFO:teuthology.provision.fog.smithi043:Deploy complete!
2024-04-15T02:37:45.545 DEBUG:teuthology.parallel:result is None
2024-04-15T02:37:46.590 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2024-04-15T02:37:52.592 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-15T02:37:55.646 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2024-04-15T02:38:01.648 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-15T02:38:04.702 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2024-04-15T02:38:10.704 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-15T02:38:19.859 WARNING:teuthology.provision.fog.smithi165:timed out
2024-04-15T02:38:25.861 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-15T02:38:26.131 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-15T02:38:26.131 DEBUG:teuthology.orchestra.run.smithi165:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-15T02:38:26.360 INFO:teuthology.provision.fog.smithi165:Node is ready
2024-04-15T02:38:26.360 DEBUG:teuthology.orchestra.run.smithi165:> hostname
2024-04-15T02:38:26.378 INFO:teuthology.orchestra.run.smithi165.stdout:smithi165.front.sepia.ceph.com
2024-04-15T02:38:26.379 DEBUG:teuthology.orchestra.run.smithi165:> grep smithi165.front.sepia.ceph.com /etc/hosts
2024-04-15T02:38:26.437 INFO:teuthology.orchestra.run.smithi165.stdout:172.21.15.165 smithi165.front.sepia.ceph.com smithi165
2024-04-15T02:38:26.438 DEBUG:teuthology.orchestra.run.smithi165:> sudo hostname smithi165
2024-04-15T02:38:26.552 DEBUG:teuthology.orchestra.run.smithi165:> sudo sed -i -e 's/smithi165.front.sepia.ceph.com/smithi165/g' /etc/hosts
2024-04-15T02:38:26.581 DEBUG:teuthology.orchestra.run.smithi165:> sudo sed -i -e 's/172.21.15.165/172.21.15.165/g' /etc/hosts
2024-04-15T02:38:26.650 DEBUG:teuthology.orchestra.run.smithi165:> sudo sed -i -e 's/smithi165.front.sepia.ceph.com/smithi165/g' /etc/hostname
2024-04-15T02:38:26.719 DEBUG:teuthology.orchestra.run.smithi165:> sudo hostname smithi165
2024-04-15T02:38:26.785 DEBUG:teuthology.orchestra.run.smithi165:> cat /etc/os-release
2024-04-15T02:38:26.843 INFO:teuthology.orchestra.run.smithi165.stdout:NAME="CentOS Stream"
2024-04-15T02:38:26.843 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION="8"
2024-04-15T02:38:26.843 INFO:teuthology.orchestra.run.smithi165.stdout:ID="centos"
2024-04-15T02:38:26.844 INFO:teuthology.orchestra.run.smithi165.stdout:ID_LIKE="rhel fedora"
2024-04-15T02:38:26.844 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION_ID="8"
2024-04-15T02:38:26.844 INFO:teuthology.orchestra.run.smithi165.stdout:PLATFORM_ID="platform:el8"
2024-04-15T02:38:26.844 INFO:teuthology.orchestra.run.smithi165.stdout:PRETTY_NAME="CentOS Stream 8"
2024-04-15T02:38:26.844 INFO:teuthology.orchestra.run.smithi165.stdout:ANSI_COLOR="0;31"
2024-04-15T02:38:26.844 INFO:teuthology.orchestra.run.smithi165.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-04-15T02:38:26.844 INFO:teuthology.orchestra.run.smithi165.stdout:HOME_URL="https://centos.org/"
2024-04-15T02:38:26.844 INFO:teuthology.orchestra.run.smithi165.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-15T02:38:26.844 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-15T02:38:26.844 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-15T02:38:26.844 INFO:teuthology.provision.fog.smithi165:Deploy complete!
2024-04-15T02:38:26.845 DEBUG:teuthology.parallel:result is None
2024-04-15T02:39:10.706 WARNING:teuthology.provision.fog.smithi027:timed out
2024-04-15T02:39:16.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-15T02:39:16.968 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-15T02:39:16.968 DEBUG:teuthology.orchestra.run.smithi027:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-15T02:39:17.218 INFO:teuthology.provision.fog.smithi027:Node is ready
2024-04-15T02:39:17.218 DEBUG:teuthology.orchestra.run.smithi027:> hostname
2024-04-15T02:39:17.237 INFO:teuthology.orchestra.run.smithi027.stdout:smithi027.front.sepia.ceph.com
2024-04-15T02:39:17.238 DEBUG:teuthology.orchestra.run.smithi027:> grep smithi027.front.sepia.ceph.com /etc/hosts
2024-04-15T02:39:17.298 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27 smithi027.front.sepia.ceph.com smithi027
2024-04-15T02:39:17.299 DEBUG:teuthology.orchestra.run.smithi027:> sudo hostname smithi027
2024-04-15T02:39:17.408 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i -e 's/smithi027.front.sepia.ceph.com/smithi027/g' /etc/hosts
2024-04-15T02:39:17.439 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i -e 's/172.21.15.27/172.21.15.27/g' /etc/hosts
2024-04-15T02:39:17.509 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i -e 's/smithi027.front.sepia.ceph.com/smithi027/g' /etc/hostname
2024-04-15T02:39:17.578 DEBUG:teuthology.orchestra.run.smithi027:> sudo hostname smithi027
2024-04-15T02:39:17.646 DEBUG:teuthology.orchestra.run.smithi027:> cat /etc/os-release
2024-04-15T02:39:17.704 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="CentOS Stream"
2024-04-15T02:39:17.704 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="8"
2024-04-15T02:39:17.704 INFO:teuthology.orchestra.run.smithi027.stdout:ID="centos"
2024-04-15T02:39:17.704 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE="rhel fedora"
2024-04-15T02:39:17.705 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="8"
2024-04-15T02:39:17.705 INFO:teuthology.orchestra.run.smithi027.stdout:PLATFORM_ID="platform:el8"
2024-04-15T02:39:17.705 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="CentOS Stream 8"
2024-04-15T02:39:17.705 INFO:teuthology.orchestra.run.smithi027.stdout:ANSI_COLOR="0;31"
2024-04-15T02:39:17.705 INFO:teuthology.orchestra.run.smithi027.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-04-15T02:39:17.705 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://centos.org/"
2024-04-15T02:39:17.705 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-15T02:39:17.705 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-15T02:39:17.705 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-15T02:39:17.705 INFO:teuthology.provision.fog.smithi027:Deploy complete!
2024-04-15T02:39:17.706 DEBUG:teuthology.parallel:result is None
2024-04-15T02:39:17.901 INFO:teuthology.lock.ops:Checking smithi027.front.sepia.ceph.com
2024-04-15T02:39:17.901 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-15T02:39:17.943 INFO:teuthology.lock.ops:Checking smithi043.front.sepia.ceph.com
2024-04-15T02:39:17.944 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-15T02:39:17.968 INFO:teuthology.lock.ops:Checking smithi165.front.sepia.ceph.com
2024-04-15T02:39:17.968 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-15T02:39:17.986 INFO:teuthology.lock.ops:Updating [smithi027.front.sepia.ceph.com]: set os type and version on server
2024-04-15T02:39:17.986 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com'
2024-04-15T02:39:17.987 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-15T02:39:18.061 DEBUG:teuthology.orchestra.run.smithi027:> true
2024-04-15T02:39:18.129 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi027.front.sepia.ceph.com'
2024-04-15T02:39:18.129 DEBUG:teuthology.orchestra.run.smithi027:> uname -m
2024-04-15T02:39:18.187 INFO:teuthology.orchestra.run.smithi027.stdout:x86_64
2024-04-15T02:39:18.187 DEBUG:teuthology.orchestra.run.smithi027:> cat /etc/os-release
2024-04-15T02:39:18.245 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="CentOS Stream"
2024-04-15T02:39:18.245 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="8"
2024-04-15T02:39:18.245 INFO:teuthology.orchestra.run.smithi027.stdout:ID="centos"
2024-04-15T02:39:18.245 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE="rhel fedora"
2024-04-15T02:39:18.245 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="8"
2024-04-15T02:39:18.245 INFO:teuthology.orchestra.run.smithi027.stdout:PLATFORM_ID="platform:el8"
2024-04-15T02:39:18.245 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="CentOS Stream 8"
2024-04-15T02:39:18.245 INFO:teuthology.orchestra.run.smithi027.stdout:ANSI_COLOR="0;31"
2024-04-15T02:39:18.246 INFO:teuthology.orchestra.run.smithi027.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-04-15T02:39:18.246 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://centos.org/"
2024-04-15T02:39:18.246 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-15T02:39:18.246 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-15T02:39:18.246 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-15T02:39:18.246 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server
2024-04-15T02:39:18.268 INFO:teuthology.lock.ops:Updating [smithi043.front.sepia.ceph.com]: set os type and version on server
2024-04-15T02:39:18.269 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com'
2024-04-15T02:39:18.269 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-15T02:39:18.344 DEBUG:teuthology.orchestra.run.smithi043:> true
2024-04-15T02:39:18.483 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi043.front.sepia.ceph.com'
2024-04-15T02:39:18.483 DEBUG:teuthology.orchestra.run.smithi043:> uname -m
2024-04-15T02:39:18.543 INFO:teuthology.orchestra.run.smithi043.stdout:x86_64
2024-04-15T02:39:18.543 DEBUG:teuthology.orchestra.run.smithi043:> cat /etc/os-release
2024-04-15T02:39:18.603 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="CentOS Stream"
2024-04-15T02:39:18.603 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="8"
2024-04-15T02:39:18.603 INFO:teuthology.orchestra.run.smithi043.stdout:ID="centos"
2024-04-15T02:39:18.603 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE="rhel fedora"
2024-04-15T02:39:18.603 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="8"
2024-04-15T02:39:18.604 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM_ID="platform:el8"
2024-04-15T02:39:18.604 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="CentOS Stream 8"
2024-04-15T02:39:18.604 INFO:teuthology.orchestra.run.smithi043.stdout:ANSI_COLOR="0;31"
2024-04-15T02:39:18.604 INFO:teuthology.orchestra.run.smithi043.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-04-15T02:39:18.604 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://centos.org/"
2024-04-15T02:39:18.604 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-15T02:39:18.604 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-15T02:39:18.604 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-15T02:39:18.604 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server
2024-04-15T02:39:18.627 INFO:teuthology.lock.ops:Updating [smithi165.front.sepia.ceph.com]: set os type and version on server
2024-04-15T02:39:18.627 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi165.front.sepia.ceph.com'
2024-04-15T02:39:18.627 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-15T02:39:18.706 DEBUG:teuthology.orchestra.run.smithi165:> true
2024-04-15T02:39:18.841 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi165.front.sepia.ceph.com'
2024-04-15T02:39:18.841 DEBUG:teuthology.orchestra.run.smithi165:> uname -m
2024-04-15T02:39:18.902 INFO:teuthology.orchestra.run.smithi165.stdout:x86_64
2024-04-15T02:39:18.902 DEBUG:teuthology.orchestra.run.smithi165:> cat /etc/os-release
2024-04-15T02:39:18.961 INFO:teuthology.orchestra.run.smithi165.stdout:NAME="CentOS Stream"
2024-04-15T02:39:18.961 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION="8"
2024-04-15T02:39:18.961 INFO:teuthology.orchestra.run.smithi165.stdout:ID="centos"
2024-04-15T02:39:18.961 INFO:teuthology.orchestra.run.smithi165.stdout:ID_LIKE="rhel fedora"
2024-04-15T02:39:18.961 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION_ID="8"
2024-04-15T02:39:18.961 INFO:teuthology.orchestra.run.smithi165.stdout:PLATFORM_ID="platform:el8"
2024-04-15T02:39:18.961 INFO:teuthology.orchestra.run.smithi165.stdout:PRETTY_NAME="CentOS Stream 8"
2024-04-15T02:39:18.961 INFO:teuthology.orchestra.run.smithi165.stdout:ANSI_COLOR="0;31"
2024-04-15T02:39:18.961 INFO:teuthology.orchestra.run.smithi165.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-04-15T02:39:18.961 INFO:teuthology.orchestra.run.smithi165.stdout:HOME_URL="https://centos.org/"
2024-04-15T02:39:18.962 INFO:teuthology.orchestra.run.smithi165.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-15T02:39:18.962 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-15T02:39:18.962 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-15T02:39:18.962 INFO:teuthology.lock.ops:Updating smithi165.front.sepia.ceph.com on lock server
2024-04-15T02:39:18.985 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-15T02:39:19.074 INFO:teuthology.dispatcher.supervisor:Running job 7657001
2024-04-15T02:39:19.075 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-04-15_00:40:02-upgrade:quincy-p2p-quincy-distro-default-smithi/7657001 --name teuthology-2024-04-15_00:40:02-upgrade:quincy-p2p-quincy-distro-default-smithi --description upgrade:quincy-p2p/quincy-p2p-parallel/{point-to-point-upgrade supported-all-distro/centos_8} -- /home/teuthworker/archive/teuthology-2024-04-15_00:40:02-upgrade:quincy-p2p-quincy-distro-default-smithi/7657001/orig.config.yaml
2024-04-15T02:39:19.078 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-04-15_00:40:02-upgrade:quincy-p2p-quincy-distro-default-smithi/7657001
2024-04-15T02:39:19.078 INFO:teuthology.dispatcher.supervisor:Job PID: 3874240
2024-04-15T02:39:19.078 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-04-15T02:41:19.080 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-15T02:43:19.149 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-15T02:45:19.224 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-15T02:47:19.298 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-15T02:49:19.363 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-15T02:51:19.439 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-15T02:53:19.505 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-15T02:55:19.586 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-15T02:57:19.650 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-15T02:59:19.725 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-15T03:01:19.788 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-15T03:03:19.861 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-15T03:05:19.926 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-15T03:07:20.032 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-15T03:09:20.106 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-15T03:11:20.170 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-15T03:13:20.234 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-15T03:15:20.307 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-15T03:17:20.380 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-15T03:19:20.454 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-15T03:21:20.527 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-15T03:23:20.600 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-15T03:25:20.679 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-15T03:27:20.748 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-15T03:29:20.824 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-15T03:31:20.901 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-15T03:33:20.981 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-15T03:35:21.073 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-15T03:37:21.144 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-15T03:39:21.219 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-15T03:41:21.292 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-15T03:43:21.383 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-15T03:45:21.451 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-15T03:47:21.515 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-15T03:49:21.593 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-15T03:51:21.675 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-15T03:53:21.744 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-15T03:53:21.810 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1