2024-01-03T02:12:40.692 INFO:root:teuthology version: 0.0.1.dev228+g01dd171
2024-01-03T02:12:40.692 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-03T02:12:40.828 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f8086bbd580>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f8087b13940>, signals=[15])
2024-01-03T02:12:40.829 INFO:teuthology.lock.ops:Start node 'smithi150.front.sepia.ceph.com' reimaging
2024-01-03T02:12:40.829 INFO:teuthology.lock.ops:Updating [smithi150.front.sepia.ceph.com]: reset os type and version on server
2024-01-03T02:12:40.829 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server
2024-01-03T02:12:40.850 INFO:teuthology.lock.ops:Start node 'smithi157.front.sepia.ceph.com' reimaging
2024-01-03T02:12:40.851 INFO:teuthology.lock.ops:Updating [smithi157.front.sepia.ceph.com]: reset os type and version on server
2024-01-03T02:12:40.851 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server
2024-01-03T02:12:40.975 DEBUG:teuthology.provision.fog.smithi150:Requesting image smithi_centos_9.stream (ID 10)
2024-01-03T02:12:40.995 DEBUG:teuthology.provision.fog.smithi157:Requesting image smithi_centos_9.stream (ID 10)
2024-01-03T02:12:41.024 INFO:teuthology.provision.fog.smithi150:Scheduling deploy of centos 9.stream
2024-01-03T02:12:41.049 INFO:teuthology.provision.fog.smithi157:Scheduling deploy of centos 9.stream
2024-01-03T02:12:41.388 INFO:teuthology.orchestra.console.smithi150:Power off
2024-01-03T02:12:41.389 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-03T02:12:41.402 INFO:teuthology.orchestra.console.smithi157:Power off
2024-01-03T02:12:41.402 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-03T02:12:41.410 DEBUG:teuthology.orchestra.console.smithi150:power off output: Chassis Power Control: Down/Off
2024-01-03T02:12:41.410 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-03T02:12:41.424 DEBUG:teuthology.orchestra.console.smithi157:power off output: Chassis Power Control: Down/Off
2024-01-03T02:12:41.424 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-03T02:12:41.435 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is on
2024-01-03T02:12:41.445 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on
2024-01-03T02:12:45.440 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-03T02:12:45.450 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-03T02:12:45.552 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is on
2024-01-03T02:12:45.560 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on
2024-01-03T02:12:49.556 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-03T02:12:49.563 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-03T02:12:49.666 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is off
2024-01-03T02:12:49.671 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on
2024-01-03T02:12:49.767 INFO:teuthology.orchestra.console.smithi150:Power off completed
2024-01-03T02:12:49.868 INFO:teuthology.orchestra.console.smithi150:Power on
2024-01-03T02:12:49.868 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-03T02:12:49.891 DEBUG:teuthology.orchestra.console.smithi150:power on output: Chassis Power Control: Up/On
2024-01-03T02:12:49.891 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-03T02:12:49.912 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is off
2024-01-03T02:12:53.676 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-03T02:12:53.785 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off
2024-01-03T02:12:53.886 INFO:teuthology.orchestra.console.smithi157:Power off completed
2024-01-03T02:12:53.914 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-03T02:12:53.987 INFO:teuthology.orchestra.console.smithi157:Power on
2024-01-03T02:12:53.987 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-03T02:12:54.009 DEBUG:teuthology.orchestra.console.smithi157:power on output: Chassis Power Control: Up/On
2024-01-03T02:12:54.009 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-03T02:12:54.023 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is off
2024-01-03T02:12:54.031 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off
2024-01-03T02:12:58.028 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-03T02:12:58.038 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-03T02:12:58.140 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is on
2024-01-03T02:12:58.147 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on
2024-01-03T02:12:58.241 INFO:teuthology.orchestra.console.smithi150:Power on completed
2024-01-03T02:12:58.248 INFO:teuthology.orchestra.console.smithi157:Power on completed
2024-01-03T02:12:58.342 INFO:teuthology.provision.fog.smithi150:Waiting for deploy to finish
2024-01-03T02:12:58.349 INFO:teuthology.provision.fog.smithi157:Waiting for deploy to finish
2024-01-03T02:15:44.384 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-03T02:15:59.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-03T02:16:02.876 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2024-01-03T02:16:08.883 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-03T02:16:11.968 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2024-01-03T02:16:17.970 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-03T02:16:17.984 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157
2024-01-03T02:16:21.020 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2024-01-03T02:16:23.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-03T02:16:27.024 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-03T02:16:27.068 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157
2024-01-03T02:16:30.076 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2024-01-03T02:16:33.072 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-03T02:16:36.080 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-03T02:16:36.128 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157
2024-01-03T02:16:39.132 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2024-01-03T02:16:42.129 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-03T02:16:45.136 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-03T02:16:45.184 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157
2024-01-03T02:16:51.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-03T02:16:54.268 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157
2024-01-03T02:17:00.272 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-03T02:17:03.324 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157
2024-01-03T02:17:09.328 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-03T02:17:27.868 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157
2024-01-03T02:17:33.872 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-03T02:17:36.928 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157
2024-01-03T02:17:42.932 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-03T02:17:45.140 WARNING:teuthology.provision.fog.smithi150:timed out
2024-01-03T02:17:46.016 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157
2024-01-03T02:17:51.143 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-03T02:17:51.461 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-03T02:17:51.461 DEBUG:teuthology.orchestra.run.smithi150:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-03T02:17:51.810 INFO:teuthology.provision.fog.smithi150:Node is ready
2024-01-03T02:17:51.810 DEBUG:teuthology.orchestra.run.smithi150:> hostname
2024-01-03T02:17:51.824 INFO:teuthology.orchestra.run.smithi150.stdout:smithi150.front.sepia.ceph.com
2024-01-03T02:17:51.825 DEBUG:teuthology.orchestra.run.smithi150:> grep smithi150.front.sepia.ceph.com /etc/hosts
2024-01-03T02:17:51.880 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.15.150 smithi150.front.sepia.ceph.com smithi150
2024-01-03T02:17:51.880 DEBUG:teuthology.orchestra.run.smithi150:> sudo hostname smithi150
2024-01-03T02:17:52.006 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/smithi150.front.sepia.ceph.com/smithi150/g' /etc/hosts
2024-01-03T02:17:52.017 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-03T02:17:52.034 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/172.21.15.150/172.21.15.150/g' /etc/hosts
2024-01-03T02:17:52.102 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/smithi150.front.sepia.ceph.com/smithi150/g' /etc/hostname
2024-01-03T02:17:52.170 DEBUG:teuthology.orchestra.run.smithi150:> sudo hostname smithi150
2024-01-03T02:17:52.237 DEBUG:teuthology.orchestra.run.smithi150:> cat /etc/os-release
2024-01-03T02:17:52.291 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="CentOS Stream"
2024-01-03T02:17:52.292 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="9"
2024-01-03T02:17:52.292 INFO:teuthology.orchestra.run.smithi150.stdout:ID="centos"
2024-01-03T02:17:52.292 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE="rhel fedora"
2024-01-03T02:17:52.292 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="9"
2024-01-03T02:17:52.292 INFO:teuthology.orchestra.run.smithi150.stdout:PLATFORM_ID="platform:el9"
2024-01-03T02:17:52.292 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="CentOS Stream 9"
2024-01-03T02:17:52.292 INFO:teuthology.orchestra.run.smithi150.stdout:ANSI_COLOR="0;31"
2024-01-03T02:17:52.292 INFO:teuthology.orchestra.run.smithi150.stdout:LOGO="fedora-logo-icon"
2024-01-03T02:17:52.292 INFO:teuthology.orchestra.run.smithi150.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-01-03T02:17:52.292 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://centos.org/"
2024-01-03T02:17:52.292 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-03T02:17:52.292 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-01-03T02:17:52.292 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-03T02:17:52.293 INFO:teuthology.provision.fog.smithi150:Deploy complete!
2024-01-03T02:17:52.294 DEBUG:teuthology.parallel:result is None
2024-01-03T02:17:52.364 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-03T02:17:52.365 DEBUG:teuthology.orchestra.run.smithi157:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-03T02:18:07.760 INFO:teuthology.provision.fog.smithi157:Node is ready
2024-01-03T02:18:07.760 DEBUG:teuthology.orchestra.run.smithi157:> hostname
2024-01-03T02:18:07.818 INFO:teuthology.orchestra.run.smithi157.stdout:smithi046
2024-01-03T02:18:07.818 DEBUG:teuthology.orchestra.run.smithi157:> grep smithi046 /etc/hosts
2024-01-03T02:18:07.875 INFO:teuthology.orchestra.run.smithi157.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046
2024-01-03T02:18:07.876 DEBUG:teuthology.orchestra.run.smithi157:> sudo hostname smithi157
2024-01-03T02:18:08.036 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/smithi046/smithi157/g' /etc/hosts
2024-01-03T02:18:08.067 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/172.21.15.46/172.21.15.157/g' /etc/hosts
2024-01-03T02:18:08.137 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/smithi046/smithi157/g' /etc/hostname
2024-01-03T02:18:08.207 DEBUG:teuthology.orchestra.run.smithi157:> sudo hostname smithi157
2024-01-03T02:18:08.275 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release
2024-01-03T02:18:08.330 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="CentOS Stream"
2024-01-03T02:18:08.330 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="9"
2024-01-03T02:18:08.330 INFO:teuthology.orchestra.run.smithi157.stdout:ID="centos"
2024-01-03T02:18:08.330 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="rhel fedora"
2024-01-03T02:18:08.330 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="9"
2024-01-03T02:18:08.330 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el9"
2024-01-03T02:18:08.330 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="CentOS Stream 9"
2024-01-03T02:18:08.330 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31"
2024-01-03T02:18:08.331 INFO:teuthology.orchestra.run.smithi157.stdout:LOGO="fedora-logo-icon"
2024-01-03T02:18:08.331 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-01-03T02:18:08.331 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://centos.org/"
2024-01-03T02:18:08.331 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-03T02:18:08.331 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-01-03T02:18:08.331 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-03T02:18:08.331 INFO:teuthology.provision.fog.smithi157:Deploy complete!
2024-01-03T02:18:08.332 DEBUG:teuthology.parallel:result is None
2024-01-03T02:18:08.499 INFO:teuthology.lock.ops:Checking smithi150.front.sepia.ceph.com
2024-01-03T02:18:08.500 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-03T02:18:08.521 INFO:teuthology.lock.ops:Checking smithi157.front.sepia.ceph.com
2024-01-03T02:18:08.521 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-03T02:18:08.538 INFO:teuthology.lock.ops:Updating [smithi150.front.sepia.ceph.com]: set os type and version on server
2024-01-03T02:18:08.539 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com'
2024-01-03T02:18:08.539 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-03T02:18:08.623 DEBUG:teuthology.orchestra.run.smithi150:> true
2024-01-03T02:18:08.792 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi150.front.sepia.ceph.com'
2024-01-03T02:18:08.792 DEBUG:teuthology.orchestra.run.smithi150:> uname -m
2024-01-03T02:18:08.847 INFO:teuthology.orchestra.run.smithi150.stdout:x86_64
2024-01-03T02:18:08.847 DEBUG:teuthology.orchestra.run.smithi150:> cat /etc/os-release
2024-01-03T02:18:08.901 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="CentOS Stream"
2024-01-03T02:18:08.901 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="9"
2024-01-03T02:18:08.901 INFO:teuthology.orchestra.run.smithi150.stdout:ID="centos"
2024-01-03T02:18:08.901 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE="rhel fedora"
2024-01-03T02:18:08.901 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="9"
2024-01-03T02:18:08.901 INFO:teuthology.orchestra.run.smithi150.stdout:PLATFORM_ID="platform:el9"
2024-01-03T02:18:08.901 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="CentOS Stream 9"
2024-01-03T02:18:08.901 INFO:teuthology.orchestra.run.smithi150.stdout:ANSI_COLOR="0;31"
2024-01-03T02:18:08.901 INFO:teuthology.orchestra.run.smithi150.stdout:LOGO="fedora-logo-icon"
2024-01-03T02:18:08.901 INFO:teuthology.orchestra.run.smithi150.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-01-03T02:18:08.901 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://centos.org/"
2024-01-03T02:18:08.901 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-03T02:18:08.901 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-01-03T02:18:08.902 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-03T02:18:08.902 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server
2024-01-03T02:18:08.921 INFO:teuthology.lock.ops:Updating [smithi157.front.sepia.ceph.com]: set os type and version on server
2024-01-03T02:18:08.921 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com'
2024-01-03T02:18:08.921 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-03T02:18:09.001 DEBUG:teuthology.orchestra.run.smithi157:> true
2024-01-03T02:18:09.066 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi157.front.sepia.ceph.com'
2024-01-03T02:18:09.066 DEBUG:teuthology.orchestra.run.smithi157:> uname -m
2024-01-03T02:18:09.120 INFO:teuthology.orchestra.run.smithi157.stdout:x86_64
2024-01-03T02:18:09.120 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release
2024-01-03T02:18:09.174 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="CentOS Stream"
2024-01-03T02:18:09.174 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="9"
2024-01-03T02:18:09.174 INFO:teuthology.orchestra.run.smithi157.stdout:ID="centos"
2024-01-03T02:18:09.175 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="rhel fedora"
2024-01-03T02:18:09.175 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="9"
2024-01-03T02:18:09.175 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el9"
2024-01-03T02:18:09.175 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="CentOS Stream 9"
2024-01-03T02:18:09.175 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31"
2024-01-03T02:18:09.175 INFO:teuthology.orchestra.run.smithi157.stdout:LOGO="fedora-logo-icon"
2024-01-03T02:18:09.175 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-01-03T02:18:09.175 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://centos.org/"
2024-01-03T02:18:09.175 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-03T02:18:09.175 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-01-03T02:18:09.175 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-03T02:18:09.176 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server
2024-01-03T02:18:09.196 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-03T02:18:09.286 INFO:teuthology.dispatcher.supervisor:Running job 7504643
2024-01-03T02:18:09.287 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/virtualenv/bin/teuthology -v --owner scheduled_sjust@teuthology --archive /home/teuthworker/archive/sjust-2024-01-03_01:38:51-rados:thrash-erasure-code-wip-sjust-msr-testing-2024-01-02-distro-default-smithi/7504643 --name sjust-2024-01-03_01:38:51-rados:thrash-erasure-code-wip-sjust-msr-testing-2024-01-02-distro-default-smithi --description rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} -- /home/teuthworker/archive/sjust-2024-01-03_01:38:51-rados:thrash-erasure-code-wip-sjust-msr-testing-2024-01-02-distro-default-smithi/7504643/orig.config.yaml
2024-01-03T02:18:09.289 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/sjust-2024-01-03_01:38:51-rados:thrash-erasure-code-wip-sjust-msr-testing-2024-01-02-distro-default-smithi/7504643
2024-01-03T02:18:09.290 INFO:teuthology.dispatcher.supervisor:Job PID: 3208593
2024-01-03T02:18:09.290 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-01-03T02:20:09.389 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-03T02:22:09.572 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-03T02:24:09.754 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-03T02:26:09.928 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-03T02:28:10.095 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-03T02:30:10.259 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-03T02:32:10.433 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-03T02:32:10.502 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2024-01-03T02:32:10.628 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2024-01-03T02:32:10.628 INFO:teuthology.nuke:Checking targets against current locks
2024-01-03T02:32:10.676 DEBUG:teuthology.nuke:shortname: smithi150
2024-01-03T02:32:10.677 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-03T02:32:10.698 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi150.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/sjust-2024-01-03_01:38:51-rados:thrash-erasure-code-wip-sjust-msr-testing-2024-01-02-distro-default-smithi/7504643', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-03 02:12:39.788365', 'locked_by': 'scheduled_sjust@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH0aMh1quZFDaUdTdJjj19bdZaRYaWpoljM2OpfJvC/UdlMkIEW0wJcAXiEu4O42HLEWYA7Rpelycc8Xuoftxs0='}
2024-01-03T02:32:10.701 DEBUG:teuthology.nuke:shortname: smithi157
2024-01-03T02:32:10.702 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-03T02:32:10.725 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi157.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/sjust-2024-01-03_01:38:51-rados:thrash-erasure-code-wip-sjust-msr-testing-2024-01-02-distro-default-smithi/7504643', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-03 02:12:39.789990', 'locked_by': 'scheduled_sjust@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ8EEPE67eCpGWENyAEiPyhrVbBtanL7rEnoAOaoBwEEa8a98aQ+8+kqxjv99K0XpVMT/6gj/NUz5IFogjP7lAM='}
2024-01-03T02:32:10.762 INFO:teuthology.orchestra.console.smithi150:Power off
2024-01-03T02:32:10.763 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-03T02:32:10.785 DEBUG:teuthology.orchestra.console.smithi150:power off output: Chassis Power Control: Down/Off
2024-01-03T02:32:10.786 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-03T02:32:10.800 INFO:teuthology.orchestra.console.smithi157:Power off
2024-01-03T02:32:10.800 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-03T02:32:10.809 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is off
2024-01-03T02:32:10.821 DEBUG:teuthology.orchestra.console.smithi157:power off output: Chassis Power Control: Down/Off
2024-01-03T02:32:10.821 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-03T02:32:10.845 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off
2024-01-03T02:32:10.910 INFO:teuthology.orchestra.console.smithi150:Power off completed
2024-01-03T02:32:10.946 INFO:teuthology.orchestra.console.smithi157:Power off completed
2024-01-03T02:32:11.059 INFO:teuthology.lock.ops:unlocked: smithi150.front.sepia.ceph.com
2024-01-03T02:32:11.091 INFO:teuthology.lock.ops:unlocked: smithi157.front.sepia.ceph.com