2024-01-03T02:11:38.932 INFO:root:teuthology version: 0.0.1.dev228+g01dd171
2024-01-03T02:11:38.933 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-03T02:11:39.073 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fcf9c949280>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fcf9d8a4940>, signals=[15])
2024-01-03T02:11:39.074 INFO:teuthology.lock.ops:Start node 'smithi160.front.sepia.ceph.com' reimaging
2024-01-03T02:11:39.074 INFO:teuthology.lock.ops:Updating [smithi160.front.sepia.ceph.com]: reset os type and version on server
2024-01-03T02:11:39.074 INFO:teuthology.lock.ops:Updating smithi160.front.sepia.ceph.com on lock server
2024-01-03T02:11:39.092 INFO:teuthology.lock.ops:Start node 'smithi194.front.sepia.ceph.com' reimaging
2024-01-03T02:11:39.093 INFO:teuthology.lock.ops:Updating [smithi194.front.sepia.ceph.com]: reset os type and version on server
2024-01-03T02:11:39.093 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server
2024-01-03T02:11:39.225 DEBUG:teuthology.provision.fog.smithi160:Requesting image smithi_centos_9.stream (ID 10)
2024-01-03T02:11:39.245 DEBUG:teuthology.provision.fog.smithi194:Requesting image smithi_centos_9.stream (ID 10)
2024-01-03T02:11:39.276 INFO:teuthology.provision.fog.smithi160:Scheduling deploy of centos 9.stream
2024-01-03T02:11:39.286 INFO:teuthology.provision.fog.smithi194:Scheduling deploy of centos 9.stream
2024-01-03T02:11:39.542 INFO:teuthology.orchestra.console.smithi160:Power off
2024-01-03T02:11:39.543 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-03T02:11:39.557 INFO:teuthology.orchestra.console.smithi194:Power off
2024-01-03T02:11:39.558 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-03T02:11:39.567 DEBUG:teuthology.orchestra.console.smithi160:power off output: Chassis Power Control: Down/Off
2024-01-03T02:11:39.567 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-03T02:11:39.579 DEBUG:teuthology.orchestra.console.smithi194:power off output: Chassis Power Control: Down/Off
2024-01-03T02:11:39.579 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-03T02:11:39.590 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is on
2024-01-03T02:11:39.604 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on
2024-01-03T02:11:43.592 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-03T02:11:43.606 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-03T02:11:43.701 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is on
2024-01-03T02:11:43.718 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on
2024-01-03T02:11:47.704 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-03T02:11:47.720 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-03T02:11:47.813 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is off
2024-01-03T02:11:47.830 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on
2024-01-03T02:11:47.914 INFO:teuthology.orchestra.console.smithi160:Power off completed
2024-01-03T02:11:48.015 INFO:teuthology.orchestra.console.smithi160:Power on
2024-01-03T02:11:48.015 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-03T02:11:48.036 DEBUG:teuthology.orchestra.console.smithi160:power on output: Chassis Power Control: Up/On
2024-01-03T02:11:48.037 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-03T02:11:48.058 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is off
2024-01-03T02:11:51.833 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-03T02:11:51.944 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off
2024-01-03T02:11:52.045 INFO:teuthology.orchestra.console.smithi194:Power off completed
2024-01-03T02:11:52.058 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-03T02:11:52.146 INFO:teuthology.orchestra.console.smithi194:Power on
2024-01-03T02:11:52.147 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-03T02:11:52.168 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is off
2024-01-03T02:11:52.173 DEBUG:teuthology.orchestra.console.smithi194:power on output: Chassis Power Control: Up/On
2024-01-03T02:11:52.173 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-03T02:11:52.196 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off
2024-01-03T02:11:56.172 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-03T02:11:56.198 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-03T02:11:56.281 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is on
2024-01-03T02:11:56.307 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on
2024-01-03T02:11:56.382 INFO:teuthology.orchestra.console.smithi160:Power on completed
2024-01-03T02:11:56.408 INFO:teuthology.orchestra.console.smithi194:Power on completed
2024-01-03T02:11:56.483 INFO:teuthology.provision.fog.smithi160:Waiting for deploy to finish
2024-01-03T02:11:56.509 INFO:teuthology.provision.fog.smithi194:Waiting for deploy to finish
2024-01-03T02:14:27.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-03T02:14:27.773 ERROR:teuthology.orchestra.connection:Error authenticating with smithi194.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-01-03T02:14:42.592 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-03T02:15:00.924 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160
2024-01-03T02:15:06.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-03T02:15:09.980 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160
2024-01-03T02:15:15.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-03T02:15:19.036 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160
2024-01-03T02:15:25.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-03T02:15:28.092 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160
2024-01-03T02:15:31.777 WARNING:teuthology.provision.fog.smithi194:timed out
2024-01-03T02:15:34.094 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-03T02:15:37.148 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160
2024-01-03T02:15:37.778 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-03T02:15:43.149 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-03T02:15:46.204 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160
2024-01-03T02:15:52.205 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-03T02:15:56.224 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194
2024-01-03T02:16:02.225 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-03T02:16:05.276 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194
2024-01-03T02:16:11.277 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-03T02:16:11.615 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-03T02:16:11.616 DEBUG:teuthology.orchestra.run.smithi194:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-03T02:16:31.847 INFO:teuthology.provision.fog.smithi194:Node is ready
2024-01-03T02:16:31.847 DEBUG:teuthology.orchestra.run.smithi194:> hostname
2024-01-03T02:16:31.865 INFO:teuthology.orchestra.run.smithi194.stdout:smithi046
2024-01-03T02:16:31.866 DEBUG:teuthology.orchestra.run.smithi194:> grep smithi046 /etc/hosts
2024-01-03T02:16:31.924 INFO:teuthology.orchestra.run.smithi194.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046
2024-01-03T02:16:31.924 DEBUG:teuthology.orchestra.run.smithi194:> sudo hostname smithi194
2024-01-03T02:16:32.083 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/smithi046/smithi194/g' /etc/hosts
2024-01-03T02:16:32.123 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/172.21.15.46/172.21.15.194/g' /etc/hosts
2024-01-03T02:16:32.191 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/smithi046/smithi194/g' /etc/hostname
2024-01-03T02:16:32.257 DEBUG:teuthology.orchestra.run.smithi194:> sudo hostname smithi194
2024-01-03T02:16:32.323 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release
2024-01-03T02:16:32.378 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="CentOS Stream"
2024-01-03T02:16:32.378 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="9"
2024-01-03T02:16:32.378 INFO:teuthology.orchestra.run.smithi194.stdout:ID="centos"
2024-01-03T02:16:32.378 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE="rhel fedora"
2024-01-03T02:16:32.378 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="9"
2024-01-03T02:16:32.378 INFO:teuthology.orchestra.run.smithi194.stdout:PLATFORM_ID="platform:el9"
2024-01-03T02:16:32.378 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="CentOS Stream 9"
2024-01-03T02:16:32.379 INFO:teuthology.orchestra.run.smithi194.stdout:ANSI_COLOR="0;31"
2024-01-03T02:16:32.379 INFO:teuthology.orchestra.run.smithi194.stdout:LOGO="fedora-logo-icon"
2024-01-03T02:16:32.379 INFO:teuthology.orchestra.run.smithi194.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-01-03T02:16:32.379 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://centos.org/"
2024-01-03T02:16:32.379 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-03T02:16:32.379 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-01-03T02:16:32.379 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-03T02:16:32.380 INFO:teuthology.provision.fog.smithi194:Deploy complete!
2024-01-03T02:16:32.381 DEBUG:teuthology.parallel:result is None
2024-01-03T02:16:52.207 WARNING:teuthology.provision.fog.smithi160:timed out
2024-01-03T02:16:58.209 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-03T02:16:58.511 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-03T02:16:58.511 DEBUG:teuthology.orchestra.run.smithi160:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-03T02:16:58.815 INFO:teuthology.provision.fog.smithi160:Node is ready
2024-01-03T02:16:58.815 DEBUG:teuthology.orchestra.run.smithi160:> hostname
2024-01-03T02:16:58.873 INFO:teuthology.orchestra.run.smithi160.stdout:smithi160.front.sepia.ceph.com
2024-01-03T02:16:58.874 DEBUG:teuthology.orchestra.run.smithi160:> grep smithi160.front.sepia.ceph.com /etc/hosts
2024-01-03T02:16:58.931 INFO:teuthology.orchestra.run.smithi160.stdout:172.21.15.160 smithi160.front.sepia.ceph.com smithi160
2024-01-03T02:16:58.932 DEBUG:teuthology.orchestra.run.smithi160:> sudo hostname smithi160
2024-01-03T02:16:59.053 DEBUG:teuthology.orchestra.run.smithi160:> sudo sed -i -e 's/smithi160.front.sepia.ceph.com/smithi160/g' /etc/hosts
2024-01-03T02:16:59.080 DEBUG:teuthology.orchestra.run.smithi160:> sudo sed -i -e 's/172.21.15.160/172.21.15.160/g' /etc/hosts
2024-01-03T02:16:59.151 DEBUG:teuthology.orchestra.run.smithi160:> sudo sed -i -e 's/smithi160.front.sepia.ceph.com/smithi160/g' /etc/hostname
2024-01-03T02:16:59.222 DEBUG:teuthology.orchestra.run.smithi160:> sudo hostname smithi160
2024-01-03T02:16:59.292 DEBUG:teuthology.orchestra.run.smithi160:> cat /etc/os-release
2024-01-03T02:16:59.350 INFO:teuthology.orchestra.run.smithi160.stdout:NAME="CentOS Stream"
2024-01-03T02:16:59.350 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION="9"
2024-01-03T02:16:59.350 INFO:teuthology.orchestra.run.smithi160.stdout:ID="centos"
2024-01-03T02:16:59.350 INFO:teuthology.orchestra.run.smithi160.stdout:ID_LIKE="rhel fedora"
2024-01-03T02:16:59.350 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION_ID="9"
2024-01-03T02:16:59.350 INFO:teuthology.orchestra.run.smithi160.stdout:PLATFORM_ID="platform:el9"
2024-01-03T02:16:59.351 INFO:teuthology.orchestra.run.smithi160.stdout:PRETTY_NAME="CentOS Stream 9"
2024-01-03T02:16:59.351 INFO:teuthology.orchestra.run.smithi160.stdout:ANSI_COLOR="0;31"
2024-01-03T02:16:59.351 INFO:teuthology.orchestra.run.smithi160.stdout:LOGO="fedora-logo-icon"
2024-01-03T02:16:59.351 INFO:teuthology.orchestra.run.smithi160.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-01-03T02:16:59.351 INFO:teuthology.orchestra.run.smithi160.stdout:HOME_URL="https://centos.org/"
2024-01-03T02:16:59.351 INFO:teuthology.orchestra.run.smithi160.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-03T02:16:59.351 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-01-03T02:16:59.351 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-03T02:16:59.351 INFO:teuthology.provision.fog.smithi160:Deploy complete!
2024-01-03T02:16:59.352 DEBUG:teuthology.parallel:result is None
2024-01-03T02:16:59.522 INFO:teuthology.lock.ops:Checking smithi160.front.sepia.ceph.com
2024-01-03T02:16:59.523 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-03T02:16:59.548 INFO:teuthology.lock.ops:Checking smithi194.front.sepia.ceph.com
2024-01-03T02:16:59.549 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-03T02:16:59.566 INFO:teuthology.lock.ops:Updating [smithi160.front.sepia.ceph.com]: set os type and version on server
2024-01-03T02:16:59.566 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com'
2024-01-03T02:16:59.566 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-03T02:16:59.651 DEBUG:teuthology.orchestra.run.smithi160:> true
2024-01-03T02:16:59.714 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi160.front.sepia.ceph.com'
2024-01-03T02:16:59.714 DEBUG:teuthology.orchestra.run.smithi160:> uname -m
2024-01-03T02:16:59.772 INFO:teuthology.orchestra.run.smithi160.stdout:x86_64
2024-01-03T02:16:59.772 DEBUG:teuthology.orchestra.run.smithi160:> cat /etc/os-release
2024-01-03T02:16:59.830 INFO:teuthology.orchestra.run.smithi160.stdout:NAME="CentOS Stream"
2024-01-03T02:16:59.830 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION="9"
2024-01-03T02:16:59.831 INFO:teuthology.orchestra.run.smithi160.stdout:ID="centos"
2024-01-03T02:16:59.831 INFO:teuthology.orchestra.run.smithi160.stdout:ID_LIKE="rhel fedora"
2024-01-03T02:16:59.831 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION_ID="9"
2024-01-03T02:16:59.831 INFO:teuthology.orchestra.run.smithi160.stdout:PLATFORM_ID="platform:el9"
2024-01-03T02:16:59.831 INFO:teuthology.orchestra.run.smithi160.stdout:PRETTY_NAME="CentOS Stream 9"
2024-01-03T02:16:59.831 INFO:teuthology.orchestra.run.smithi160.stdout:ANSI_COLOR="0;31"
2024-01-03T02:16:59.832 INFO:teuthology.orchestra.run.smithi160.stdout:LOGO="fedora-logo-icon"
2024-01-03T02:16:59.832 INFO:teuthology.orchestra.run.smithi160.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-01-03T02:16:59.832 INFO:teuthology.orchestra.run.smithi160.stdout:HOME_URL="https://centos.org/"
2024-01-03T02:16:59.832 INFO:teuthology.orchestra.run.smithi160.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-03T02:16:59.832 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-01-03T02:16:59.833 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-03T02:16:59.833 INFO:teuthology.lock.ops:Updating smithi160.front.sepia.ceph.com on lock server
2024-01-03T02:16:59.856 INFO:teuthology.lock.ops:Updating [smithi194.front.sepia.ceph.com]: set os type and version on server
2024-01-03T02:16:59.857 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com'
2024-01-03T02:16:59.857 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-03T02:16:59.939 DEBUG:teuthology.orchestra.run.smithi194:> true
2024-01-03T02:17:00.110 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi194.front.sepia.ceph.com'
2024-01-03T02:17:00.111 DEBUG:teuthology.orchestra.run.smithi194:> uname -m
2024-01-03T02:17:00.165 INFO:teuthology.orchestra.run.smithi194.stdout:x86_64
2024-01-03T02:17:00.165 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release
2024-01-03T02:17:00.220 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="CentOS Stream"
2024-01-03T02:17:00.220 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="9"
2024-01-03T02:17:00.220 INFO:teuthology.orchestra.run.smithi194.stdout:ID="centos"
2024-01-03T02:17:00.220 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE="rhel fedora"
2024-01-03T02:17:00.220 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="9"
2024-01-03T02:17:00.220 INFO:teuthology.orchestra.run.smithi194.stdout:PLATFORM_ID="platform:el9"
2024-01-03T02:17:00.221 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="CentOS Stream 9"
2024-01-03T02:17:00.221 INFO:teuthology.orchestra.run.smithi194.stdout:ANSI_COLOR="0;31"
2024-01-03T02:17:00.221 INFO:teuthology.orchestra.run.smithi194.stdout:LOGO="fedora-logo-icon"
2024-01-03T02:17:00.221 INFO:teuthology.orchestra.run.smithi194.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-01-03T02:17:00.221 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://centos.org/"
2024-01-03T02:17:00.221 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-03T02:17:00.221 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-01-03T02:17:00.221 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-03T02:17:00.221 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server
2024-01-03T02:17:00.240 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-03T02:17:00.329 INFO:teuthology.dispatcher.supervisor:Running job 7504639
2024-01-03T02:17:00.329 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/virtualenv/bin/teuthology -v --owner scheduled_sjust@teuthology --archive /home/teuthworker/archive/sjust-2024-01-03_01:38:51-rados:thrash-erasure-code-wip-sjust-msr-testing-2024-01-02-distro-default-smithi/7504639 --name sjust-2024-01-03_01:38:51-rados:thrash-erasure-code-wip-sjust-msr-testing-2024-01-02-distro-default-smithi --description rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-small-objects-many-deletes} -- /home/teuthworker/archive/sjust-2024-01-03_01:38:51-rados:thrash-erasure-code-wip-sjust-msr-testing-2024-01-02-distro-default-smithi/7504639/orig.config.yaml
2024-01-03T02:17:00.332 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/sjust-2024-01-03_01:38:51-rados:thrash-erasure-code-wip-sjust-msr-testing-2024-01-02-distro-default-smithi/7504639
2024-01-03T02:17:00.333 INFO:teuthology.dispatcher.supervisor:Job PID: 3203161
2024-01-03T02:17:00.333 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-01-03T02:19:00.334 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-03T02:21:00.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-03T02:23:00.475 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-03T02:25:00.547 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-03T02:27:00.615 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-03T02:29:00.680 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-03T02:31:00.744 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-03T02:33:00.814 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-03T02:35:00.879 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-03T02:37:00.957 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-03T02:37:01.048 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2024-01-03T02:37:01.147 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2024-01-03T02:37:01.148 INFO:teuthology.nuke:Checking targets against current locks
2024-01-03T02:37:01.198 DEBUG:teuthology.nuke:shortname: smithi160
2024-01-03T02:37:01.198 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-03T02:37:01.219 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi160.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/sjust-2024-01-03_01:38:51-rados:thrash-erasure-code-wip-sjust-msr-testing-2024-01-02-distro-default-smithi/7504639', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-03 02:11:38.070595', 'locked_by': 'scheduled_sjust@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEEUaJr53hprLlRh9yqBXnhNfrYk5Mn4+6Ob5mmspWPQBJ/rVOKXflLf97N7WOwz7V3eGlPczaIAXL+HqVu896c='}
2024-01-03T02:37:01.222 DEBUG:teuthology.nuke:shortname: smithi194
2024-01-03T02:37:01.222 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-03T02:37:01.249 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi194.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/sjust-2024-01-03_01:38:51-rados:thrash-erasure-code-wip-sjust-msr-testing-2024-01-02-distro-default-smithi/7504639', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-03 02:11:38.072613', 'locked_by': 'scheduled_sjust@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGcg19rYTssJ0Rc+5oWWBeM2Jz+ckFGldmDdWh4qE0rM2JC1EQUW10xUzONCr0APr1demS+7u1LzIGXwWEd46fA='}
2024-01-03T02:37:01.280 INFO:teuthology.orchestra.console.smithi160:Power off
2024-01-03T02:37:01.280 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-03T02:37:01.301 DEBUG:teuthology.orchestra.console.smithi160:power off output: Chassis Power Control: Down/Off
2024-01-03T02:37:01.302 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-03T02:37:01.313 INFO:teuthology.orchestra.console.smithi194:Power off
2024-01-03T02:37:01.313 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-03T02:37:01.322 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is off
2024-01-03T02:37:01.333 DEBUG:teuthology.orchestra.console.smithi194:power off output: Chassis Power Control: Down/Off
2024-01-03T02:37:01.333 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-03T02:37:01.353 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off
2024-01-03T02:37:01.423 INFO:teuthology.orchestra.console.smithi160:Power off completed
2024-01-03T02:37:01.454 INFO:teuthology.orchestra.console.smithi194:Power off completed
2024-01-03T02:37:01.586 INFO:teuthology.lock.ops:unlocked: smithi160.front.sepia.ceph.com
2024-01-03T02:37:01.603 INFO:teuthology.lock.ops:unlocked: smithi194.front.sepia.ceph.com