2023-11-23T02:26:21.218 INFO:root:teuthology version: 0.0.1.dev205+g2442239
2023-11-23T02:26:21.218 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T02:26:21.337 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fbabbfa27f0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fbabbca6f70>, signals=[15])
2023-11-23T02:26:21.337 INFO:teuthology.lock.ops:Start node 'smithi174.front.sepia.ceph.com' reimaging
2023-11-23T02:26:21.338 INFO:teuthology.lock.ops:Updating [smithi174.front.sepia.ceph.com]: reset os type and version on server
2023-11-23T02:26:21.338 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server
2023-11-23T02:26:21.359 INFO:teuthology.lock.ops:Start node 'smithi178.front.sepia.ceph.com' reimaging
2023-11-23T02:26:21.360 INFO:teuthology.lock.ops:Updating [smithi178.front.sepia.ceph.com]: reset os type and version on server
2023-11-23T02:26:21.360 INFO:teuthology.lock.ops:Updating smithi178.front.sepia.ceph.com on lock server
2023-11-23T02:26:21.464 DEBUG:teuthology.provision.fog.smithi174:Requesting image smithi_centos_8.stream (ID 3)
2023-11-23T02:26:21.482 DEBUG:teuthology.provision.fog.smithi178:Requesting image smithi_centos_8.stream (ID 3)
2023-11-23T02:26:21.500 INFO:teuthology.provision.fog.smithi174:Scheduling deploy of centos 8.stream
2023-11-23T02:26:21.522 INFO:teuthology.provision.fog.smithi178:Scheduling deploy of centos 8.stream
2023-11-23T02:26:21.955 INFO:teuthology.orchestra.console.smithi178:Power off
2023-11-23T02:26:21.955 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-23T02:26:21.973 INFO:teuthology.orchestra.console.smithi174:Power off
2023-11-23T02:26:21.974 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-23T02:26:21.980 DEBUG:teuthology.orchestra.console.smithi178:power off output: Chassis Power Control: Down/Off
2023-11-23T02:26:21.980 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-23T02:26:21.992 DEBUG:teuthology.orchestra.console.smithi174:power off output: Chassis Power Control: Down/Off
2023-11-23T02:26:21.993 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-23T02:26:22.000 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is off
2023-11-23T02:26:22.011 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off
2023-11-23T02:26:22.101 INFO:teuthology.orchestra.console.smithi178:Power off completed
2023-11-23T02:26:22.112 INFO:teuthology.orchestra.console.smithi174:Power off completed
2023-11-23T02:26:22.202 INFO:teuthology.orchestra.console.smithi178:Power on
2023-11-23T02:26:22.202 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-23T02:26:22.213 INFO:teuthology.orchestra.console.smithi174:Power on
2023-11-23T02:26:22.214 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-23T02:26:22.224 DEBUG:teuthology.orchestra.console.smithi178:power on output: Chassis Power Control: Up/On
2023-11-23T02:26:22.224 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-23T02:26:22.233 DEBUG:teuthology.orchestra.console.smithi174:power on output: Chassis Power Control: Up/On
2023-11-23T02:26:22.233 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-23T02:26:22.243 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is off
2023-11-23T02:26:22.253 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off
2023-11-23T02:26:26.248 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-23T02:26:26.255 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-23T02:26:26.356 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is off
2023-11-23T02:26:26.362 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on
2023-11-23T02:26:26.462 INFO:teuthology.orchestra.console.smithi174:Power on completed
2023-11-23T02:26:26.563 INFO:teuthology.provision.fog.smithi174:Waiting for deploy to finish
2023-11-23T02:26:30.358 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-23T02:26:30.466 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is on
2023-11-23T02:26:30.567 INFO:teuthology.orchestra.console.smithi178:Power on completed
2023-11-23T02:26:30.667 INFO:teuthology.provision.fog.smithi178:Waiting for deploy to finish
2023-11-23T02:31:47.864 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:31:50.914 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178
2023-11-23T02:31:56.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:31:59.970 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178
2023-11-23T02:32:05.977 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:32:09.059 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178
2023-11-23T02:32:15.066 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:32:18.146 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178
2023-11-23T02:32:24.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:32:27.202 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178
2023-11-23T02:32:33.209 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:32:36.290 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178
2023-11-23T02:32:42.293 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:32:45.346 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178
2023-11-23T02:32:51.353 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:32:54.434 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178
2023-11-23T02:33:00.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:34:00.442 WARNING:teuthology.provision.fog.smithi178:timed out
2023-11-23T02:34:06.450 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:34:06.697 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-23T02:34:06.698 DEBUG:teuthology.orchestra.run.smithi178:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-23T02:34:06.955 INFO:teuthology.provision.fog.smithi178:Node is ready
2023-11-23T02:34:06.955 DEBUG:teuthology.orchestra.run.smithi178:> hostname
2023-11-23T02:34:06.976 INFO:teuthology.orchestra.run.smithi178.stdout:smithi178.front.sepia.ceph.com
2023-11-23T02:34:06.976 DEBUG:teuthology.orchestra.run.smithi178:> grep smithi178.front.sepia.ceph.com /etc/hosts
2023-11-23T02:34:07.038 INFO:teuthology.orchestra.run.smithi178.stdout:172.21.15.178 smithi178.front.sepia.ceph.com smithi178
2023-11-23T02:34:07.038 DEBUG:teuthology.orchestra.run.smithi178:> sudo hostname smithi178
2023-11-23T02:34:07.137 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i -e 's/smithi178.front.sepia.ceph.com/smithi178/g' /etc/hosts
2023-11-23T02:34:07.167 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i -e 's/172.21.15.178/172.21.15.178/g' /etc/hosts
2023-11-23T02:34:07.236 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i -e 's/smithi178.front.sepia.ceph.com/smithi178/g' /etc/hostname
2023-11-23T02:34:07.305 DEBUG:teuthology.orchestra.run.smithi178:> sudo hostname smithi178
2023-11-23T02:34:07.373 DEBUG:teuthology.orchestra.run.smithi178:> cat /etc/os-release
2023-11-23T02:34:07.431 INFO:teuthology.orchestra.run.smithi178.stdout:NAME="CentOS Stream"
2023-11-23T02:34:07.431 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION="8"
2023-11-23T02:34:07.431 INFO:teuthology.orchestra.run.smithi178.stdout:ID="centos"
2023-11-23T02:34:07.431 INFO:teuthology.orchestra.run.smithi178.stdout:ID_LIKE="rhel fedora"
2023-11-23T02:34:07.431 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_ID="8"
2023-11-23T02:34:07.431 INFO:teuthology.orchestra.run.smithi178.stdout:PLATFORM_ID="platform:el8"
2023-11-23T02:34:07.431 INFO:teuthology.orchestra.run.smithi178.stdout:PRETTY_NAME="CentOS Stream 8"
2023-11-23T02:34:07.432 INFO:teuthology.orchestra.run.smithi178.stdout:ANSI_COLOR="0;31"
2023-11-23T02:34:07.432 INFO:teuthology.orchestra.run.smithi178.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-11-23T02:34:07.432 INFO:teuthology.orchestra.run.smithi178.stdout:HOME_URL="https://centos.org/"
2023-11-23T02:34:07.432 INFO:teuthology.orchestra.run.smithi178.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-23T02:34:07.432 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-23T02:34:07.432 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-23T02:34:07.432 INFO:teuthology.provision.fog.smithi178:Deploy complete!
2023-11-23T02:34:07.433 DEBUG:teuthology.parallel:result is None
2023-11-23T02:35:27.778 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:35:30.850 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174
2023-11-23T02:35:36.855 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:35:39.913 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174
2023-11-23T02:35:45.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:35:48.994 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174
2023-11-23T02:35:54.999 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:35:58.054 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174
2023-11-23T02:36:04.058 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:36:07.138 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174
2023-11-23T02:36:13.144 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:36:16.198 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174
2023-11-23T02:36:22.202 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:36:25.282 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174
2023-11-23T02:36:31.286 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:37:02.930 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-23T02:37:02.931 DEBUG:teuthology.orchestra.run.smithi174:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-23T02:37:27.460 INFO:teuthology.provision.fog.smithi174:Node is ready
2023-11-23T02:37:27.460 DEBUG:teuthology.orchestra.run.smithi174:> hostname
2023-11-23T02:37:27.484 INFO:teuthology.orchestra.run.smithi174.stdout:smithi174.front.sepia.ceph.com
2023-11-23T02:37:27.484 DEBUG:teuthology.orchestra.run.smithi174:> grep smithi174.front.sepia.ceph.com /etc/hosts
2023-11-23T02:37:27.545 INFO:teuthology.orchestra.run.smithi174.stdout:172.21.15.174 smithi174.front.sepia.ceph.com smithi174
2023-11-23T02:37:27.546 DEBUG:teuthology.orchestra.run.smithi174:> sudo hostname smithi174
2023-11-23T02:37:27.679 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/smithi174.front.sepia.ceph.com/smithi174/g' /etc/hosts
2023-11-23T02:37:27.710 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/172.21.15.174/172.21.15.174/g' /etc/hosts
2023-11-23T02:37:27.780 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/smithi174.front.sepia.ceph.com/smithi174/g' /etc/hostname
2023-11-23T02:37:27.851 DEBUG:teuthology.orchestra.run.smithi174:> sudo hostname smithi174
2023-11-23T02:37:27.919 DEBUG:teuthology.orchestra.run.smithi174:> cat /etc/os-release
2023-11-23T02:37:27.977 INFO:teuthology.orchestra.run.smithi174.stdout:NAME="CentOS Stream"
2023-11-23T02:37:27.978 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION="8"
2023-11-23T02:37:27.978 INFO:teuthology.orchestra.run.smithi174.stdout:ID="centos"
2023-11-23T02:37:27.978 INFO:teuthology.orchestra.run.smithi174.stdout:ID_LIKE="rhel fedora"
2023-11-23T02:37:27.978 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_ID="8"
2023-11-23T02:37:27.978 INFO:teuthology.orchestra.run.smithi174.stdout:PLATFORM_ID="platform:el8"
2023-11-23T02:37:27.978 INFO:teuthology.orchestra.run.smithi174.stdout:PRETTY_NAME="CentOS Stream 8"
2023-11-23T02:37:27.978 INFO:teuthology.orchestra.run.smithi174.stdout:ANSI_COLOR="0;31"
2023-11-23T02:37:27.978 INFO:teuthology.orchestra.run.smithi174.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-11-23T02:37:27.979 INFO:teuthology.orchestra.run.smithi174.stdout:HOME_URL="https://centos.org/"
2023-11-23T02:37:27.979 INFO:teuthology.orchestra.run.smithi174.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-23T02:37:27.979 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-23T02:37:27.979 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-23T02:37:27.979 INFO:teuthology.provision.fog.smithi174:Deploy complete!
2023-11-23T02:37:27.980 DEBUG:teuthology.parallel:result is None
2023-11-23T02:37:28.131 INFO:teuthology.lock.ops:Checking smithi174.front.sepia.ceph.com
2023-11-23T02:37:28.132 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-23T02:37:28.158 INFO:teuthology.lock.ops:Checking smithi178.front.sepia.ceph.com
2023-11-23T02:37:28.158 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-23T02:37:28.183 INFO:teuthology.lock.ops:Updating [smithi174.front.sepia.ceph.com]: set os type and version on server
2023-11-23T02:37:28.183 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com'
2023-11-23T02:37:28.184 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:37:28.250 DEBUG:teuthology.orchestra.run.smithi174:> true
2023-11-23T02:37:28.316 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi174.front.sepia.ceph.com'
2023-11-23T02:37:28.316 DEBUG:teuthology.orchestra.run.smithi174:> uname -m
2023-11-23T02:37:28.374 INFO:teuthology.orchestra.run.smithi174.stdout:x86_64
2023-11-23T02:37:28.374 DEBUG:teuthology.orchestra.run.smithi174:> cat /etc/os-release
2023-11-23T02:37:28.432 INFO:teuthology.orchestra.run.smithi174.stdout:NAME="CentOS Stream"
2023-11-23T02:37:28.433 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION="8"
2023-11-23T02:37:28.433 INFO:teuthology.orchestra.run.smithi174.stdout:ID="centos"
2023-11-23T02:37:28.433 INFO:teuthology.orchestra.run.smithi174.stdout:ID_LIKE="rhel fedora"
2023-11-23T02:37:28.433 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_ID="8"
2023-11-23T02:37:28.434 INFO:teuthology.orchestra.run.smithi174.stdout:PLATFORM_ID="platform:el8"
2023-11-23T02:37:28.434 INFO:teuthology.orchestra.run.smithi174.stdout:PRETTY_NAME="CentOS Stream 8"
2023-11-23T02:37:28.434 INFO:teuthology.orchestra.run.smithi174.stdout:ANSI_COLOR="0;31"
2023-11-23T02:37:28.434 INFO:teuthology.orchestra.run.smithi174.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-11-23T02:37:28.434 INFO:teuthology.orchestra.run.smithi174.stdout:HOME_URL="https://centos.org/"
2023-11-23T02:37:28.434 INFO:teuthology.orchestra.run.smithi174.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-23T02:37:28.435 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-23T02:37:28.435 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-23T02:37:28.436 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server
2023-11-23T02:37:28.457 INFO:teuthology.lock.ops:Updating [smithi178.front.sepia.ceph.com]: set os type and version on server
2023-11-23T02:37:28.457 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com'
2023-11-23T02:37:28.457 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:37:28.529 DEBUG:teuthology.orchestra.run.smithi178:> true
2023-11-23T02:37:28.662 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi178.front.sepia.ceph.com'
2023-11-23T02:37:28.662 DEBUG:teuthology.orchestra.run.smithi178:> uname -m
2023-11-23T02:37:28.720 INFO:teuthology.orchestra.run.smithi178.stdout:x86_64
2023-11-23T02:37:28.721 DEBUG:teuthology.orchestra.run.smithi178:> cat /etc/os-release
2023-11-23T02:37:28.779 INFO:teuthology.orchestra.run.smithi178.stdout:NAME="CentOS Stream"
2023-11-23T02:37:28.780 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION="8"
2023-11-23T02:37:28.780 INFO:teuthology.orchestra.run.smithi178.stdout:ID="centos"
2023-11-23T02:37:28.780 INFO:teuthology.orchestra.run.smithi178.stdout:ID_LIKE="rhel fedora"
2023-11-23T02:37:28.780 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_ID="8"
2023-11-23T02:37:28.780 INFO:teuthology.orchestra.run.smithi178.stdout:PLATFORM_ID="platform:el8"
2023-11-23T02:37:28.780 INFO:teuthology.orchestra.run.smithi178.stdout:PRETTY_NAME="CentOS Stream 8"
2023-11-23T02:37:28.780 INFO:teuthology.orchestra.run.smithi178.stdout:ANSI_COLOR="0;31"
2023-11-23T02:37:28.780 INFO:teuthology.orchestra.run.smithi178.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-11-23T02:37:28.780 INFO:teuthology.orchestra.run.smithi178.stdout:HOME_URL="https://centos.org/"
2023-11-23T02:37:28.780 INFO:teuthology.orchestra.run.smithi178.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-23T02:37:28.781 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-23T02:37:28.781 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-23T02:37:28.781 INFO:teuthology.lock.ops:Updating smithi178.front.sepia.ceph.com on lock server
2023-11-23T02:37:28.807 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T02:37:28.906 INFO:teuthology.dispatcher.supervisor:Running job 7464514
2023-11-23T02:37:28.906 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2023-11-23_02:25:02-upgrade:reef-x-main-distro-default-smithi/7464514 --name teuthology-2023-11-23_02:25:02-upgrade:reef-x-main-distro-default-smithi --description upgrade:reef-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} -- /home/teuthworker/archive/teuthology-2023-11-23_02:25:02-upgrade:reef-x-main-distro-default-smithi/7464514/orig.config.yaml
2023-11-23T02:37:28.910 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2023-11-23_02:25:02-upgrade:reef-x-main-distro-default-smithi/7464514
2023-11-23T02:37:28.911 INFO:teuthology.dispatcher.supervisor:Job PID: 279554
2023-11-23T02:37:28.911 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-11-23T02:39:29.010 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T02:41:29.175 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T02:43:29.355 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T02:45:29.539 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T02:47:29.711 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T02:49:29.869 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T02:51:30.027 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T02:53:30.191 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T02:55:30.351 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T02:57:30.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T02:59:30.686 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:01:30.843 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:03:31.003 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:05:31.166 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:07:31.439 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:09:31.620 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:11:31.787 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:13:31.944 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:15:32.103 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:17:32.267 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:19:32.435 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:21:32.595 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:23:32.759 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:25:32.927 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:27:33.100 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:29:33.263 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:31:33.435 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:33:33.603 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:35:33.771 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:37:33.936 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:39:34.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:41:34.272 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:43:34.384 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:45:34.558 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:47:34.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:49:34.884 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:51:35.039 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:53:35.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:55:35.356 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:57:35.508 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:59:35.668 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T04:01:35.829 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T04:03:35.989 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T04:05:36.156 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T04:07:36.304 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T04:09:36.437 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T04:11:36.589 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T04:13:36.761 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T04:15:36.924 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T04:17:37.078 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T04:17:37.136 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-11-23T04:17:37.256 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-11-23T04:17:37.256 INFO:teuthology.nuke:Checking targets against current locks
2023-11-23T04:17:37.300 DEBUG:teuthology.nuke:shortname: smithi174
2023-11-23T04:17:37.300 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-23T04:17:37.325 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi174.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-11-23_02:25:02-upgrade:reef-x-main-distro-default-smithi/7464514', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-23 02:26:20.420322', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJTstfUNRGqWid7SJs+lkY3/7mqGRzkU9dz1edZVFiOYlO9427fD+nsnyNICn/I11jGw6tXs0kbpCiYdtxdL3Zk='}
2023-11-23T04:17:37.328 DEBUG:teuthology.nuke:shortname: smithi178
2023-11-23T04:17:37.328 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-23T04:17:37.350 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi178.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-11-23_02:25:02-upgrade:reef-x-main-distro-default-smithi/7464514', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-23 02:26:20.418966', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCREMO9OiKHhuVUrQvXztMYpJ0G+LeIGNDOlWCu3nIrbJvxLVtZ5HnpuiI7CHC6EJa3NpobznJ+d1OSfFEjjbC8='}
2023-11-23T04:17:37.380 INFO:teuthology.orchestra.console.smithi174:Power off
2023-11-23T04:17:37.380 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-23T04:17:37.402 DEBUG:teuthology.orchestra.console.smithi174:power off output: Chassis Power Control: Down/Off
2023-11-23T04:17:37.403 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-23T04:17:37.422 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off
2023-11-23T04:17:37.437 INFO:teuthology.orchestra.console.smithi178:Power off
2023-11-23T04:17:37.438 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-23T04:17:37.458 DEBUG:teuthology.orchestra.console.smithi178:power off output: Chassis Power Control: Down/Off
2023-11-23T04:17:37.458 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-23T04:17:37.478 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is off
2023-11-23T04:17:37.524 INFO:teuthology.orchestra.console.smithi174:Power off completed
2023-11-23T04:17:37.579 INFO:teuthology.orchestra.console.smithi178:Power off completed
2023-11-23T04:17:37.678 INFO:teuthology.lock.ops:unlocked: smithi174.front.sepia.ceph.com
2023-11-23T04:17:37.727 INFO:teuthology.lock.ops:unlocked: smithi178.front.sepia.ceph.com