2024-01-12T18:47:12.698 INFO:root:teuthology version: 0.0.1.dev249+gcd45576
2024-01-12T18:47:12.698 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T18:47:12.843 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fcfa5e4df70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fcfa6db4c10>, signals=[15])
2024-01-12T18:47:12.843 INFO:teuthology.lock.ops:Start node 'smithi087.front.sepia.ceph.com' reimaging
2024-01-12T18:47:12.844 INFO:teuthology.lock.ops:Updating [smithi087.front.sepia.ceph.com]: reset os type and version on server
2024-01-12T18:47:12.844 INFO:teuthology.lock.ops:Updating smithi087.front.sepia.ceph.com on lock server
2024-01-12T18:47:12.862 INFO:teuthology.lock.ops:Start node 'smithi157.front.sepia.ceph.com' reimaging
2024-01-12T18:47:12.862 INFO:teuthology.lock.ops:Updating [smithi157.front.sepia.ceph.com]: reset os type and version on server
2024-01-12T18:47:12.862 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server
2024-01-12T18:47:12.968 DEBUG:teuthology.provision.fog.smithi087:Requesting image smithi_centos_9.stream (ID 10)
2024-01-12T18:47:13.002 DEBUG:teuthology.provision.fog.smithi157:Requesting image smithi_centos_9.stream (ID 10)
2024-01-12T18:47:13.012 INFO:teuthology.provision.fog.smithi087:Scheduling deploy of centos 9.stream
2024-01-12T18:47:13.045 INFO:teuthology.provision.fog.smithi157:Scheduling deploy of centos 9.stream
2024-01-12T18:47:13.229 INFO:teuthology.orchestra.console.smithi087:Power off
2024-01-12T18:47:13.230 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-12T18:47:13.245 INFO:teuthology.orchestra.console.smithi157:Power off
2024-01-12T18:47:13.245 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-12T18:47:13.253 DEBUG:teuthology.orchestra.console.smithi087:power off output: Chassis Power Control: Down/Off
2024-01-12T18:47:13.253 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-12T18:47:13.267 DEBUG:teuthology.orchestra.console.smithi157:power off output: Chassis Power Control: Down/Off
2024-01-12T18:47:13.268 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-12T18:47:13.275 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is on
2024-01-12T18:47:13.290 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on
2024-01-12T18:47:17.280 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-12T18:47:17.291 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-12T18:47:17.389 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is on
2024-01-12T18:47:17.400 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on
2024-01-12T18:47:21.392 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-12T18:47:21.400 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-12T18:47:21.501 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is off
2024-01-12T18:47:21.509 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off
2024-01-12T18:47:21.602 INFO:teuthology.orchestra.console.smithi087:Power off completed
2024-01-12T18:47:21.610 INFO:teuthology.orchestra.console.smithi157:Power off completed
2024-01-12T18:47:21.703 INFO:teuthology.orchestra.console.smithi087:Power on
2024-01-12T18:47:21.704 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-12T18:47:21.711 INFO:teuthology.orchestra.console.smithi157:Power on
2024-01-12T18:47:21.711 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-12T18:47:21.724 DEBUG:teuthology.orchestra.console.smithi087:power on output: Chassis Power Control: Up/On
2024-01-12T18:47:21.725 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-12T18:47:21.735 DEBUG:teuthology.orchestra.console.smithi157:power on output: Chassis Power Control: Up/On
2024-01-12T18:47:21.735 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-12T18:47:21.745 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is off
2024-01-12T18:47:21.756 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off
2024-01-12T18:47:25.750 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-12T18:47:25.758 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-12T18:47:25.860 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is off
2024-01-12T18:47:25.866 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off
2024-01-12T18:47:29.865 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-12T18:47:29.872 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-12T18:47:29.974 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is on
2024-01-12T18:47:29.980 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on
2024-01-12T18:47:30.076 INFO:teuthology.orchestra.console.smithi087:Power on completed
2024-01-12T18:47:30.081 INFO:teuthology.orchestra.console.smithi157:Power on completed
2024-01-12T18:47:30.177 INFO:teuthology.provision.fog.smithi087:Waiting for deploy to finish
2024-01-12T18:47:30.182 INFO:teuthology.provision.fog.smithi157:Waiting for deploy to finish
2024-01-12T18:50:01.059 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-12T18:50:04.128 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87
2024-01-12T18:50:10.132 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-12T18:50:13.216 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87
2024-01-12T18:50:19.220 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-12T18:50:22.304 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87
2024-01-12T18:50:28.309 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-12T18:50:31.177 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-12T18:50:31.388 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87
2024-01-12T18:50:34.236 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157
2024-01-12T18:50:37.392 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-12T18:50:40.240 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-12T18:50:40.444 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87
2024-01-12T18:50:43.292 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157
2024-01-12T18:50:46.448 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-12T18:50:49.296 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-12T18:50:49.504 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87
2024-01-12T18:50:52.348 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157
2024-01-12T18:50:55.509 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-12T18:50:58.352 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-12T18:50:58.588 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87
2024-01-12T18:51:01.408 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157
2024-01-12T18:51:04.589 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-12T18:51:07.412 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-12T18:51:10.492 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157
2024-01-12T18:51:16.496 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-12T18:51:19.552 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157
2024-01-12T18:51:25.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-12T18:51:28.636 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157
2024-01-12T18:51:34.640 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-12T18:51:37.692 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157
2024-01-12T18:51:43.694 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-12T18:52:02.240 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157
2024-01-12T18:52:04.593 WARNING:teuthology.provision.fog.smithi087:timed out
2024-01-12T18:52:08.245 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-12T18:52:10.596 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-12T18:52:10.867 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-12T18:52:10.868 DEBUG:teuthology.orchestra.run.smithi087:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-12T18:52:11.171 INFO:teuthology.provision.fog.smithi087:Node is ready
2024-01-12T18:52:11.171 DEBUG:teuthology.orchestra.run.smithi087:> hostname
2024-01-12T18:52:11.186 INFO:teuthology.orchestra.run.smithi087.stdout:smithi087.front.sepia.ceph.com
2024-01-12T18:52:11.186 DEBUG:teuthology.orchestra.run.smithi087:> grep smithi087.front.sepia.ceph.com /etc/hosts
2024-01-12T18:52:11.242 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87 smithi087.front.sepia.ceph.com smithi087
2024-01-12T18:52:11.242 DEBUG:teuthology.orchestra.run.smithi087:> sudo hostname smithi087
2024-01-12T18:52:11.328 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157
2024-01-12T18:52:11.349 DEBUG:teuthology.orchestra.run.smithi087:> sudo sed -i -e 's/smithi087.front.sepia.ceph.com/smithi087/g' /etc/hosts
2024-01-12T18:52:11.376 DEBUG:teuthology.orchestra.run.smithi087:> sudo sed -i -e 's/172.21.15.87/172.21.15.87/g' /etc/hosts
2024-01-12T18:52:11.444 DEBUG:teuthology.orchestra.run.smithi087:> sudo sed -i -e 's/smithi087.front.sepia.ceph.com/smithi087/g' /etc/hostname
2024-01-12T18:52:11.511 DEBUG:teuthology.orchestra.run.smithi087:> sudo hostname smithi087
2024-01-12T18:52:11.577 DEBUG:teuthology.orchestra.run.smithi087:> cat /etc/os-release
2024-01-12T18:52:11.632 INFO:teuthology.orchestra.run.smithi087.stdout:NAME="CentOS Stream"
2024-01-12T18:52:11.632 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION="9"
2024-01-12T18:52:11.632 INFO:teuthology.orchestra.run.smithi087.stdout:ID="centos"
2024-01-12T18:52:11.632 INFO:teuthology.orchestra.run.smithi087.stdout:ID_LIKE="rhel fedora"
2024-01-12T18:52:11.632 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_ID="9"
2024-01-12T18:52:11.632 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM_ID="platform:el9"
2024-01-12T18:52:11.632 INFO:teuthology.orchestra.run.smithi087.stdout:PRETTY_NAME="CentOS Stream 9"
2024-01-12T18:52:11.632 INFO:teuthology.orchestra.run.smithi087.stdout:ANSI_COLOR="0;31"
2024-01-12T18:52:11.632 INFO:teuthology.orchestra.run.smithi087.stdout:LOGO="fedora-logo-icon"
2024-01-12T18:52:11.633 INFO:teuthology.orchestra.run.smithi087.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-01-12T18:52:11.633 INFO:teuthology.orchestra.run.smithi087.stdout:HOME_URL="https://centos.org/"
2024-01-12T18:52:11.633 INFO:teuthology.orchestra.run.smithi087.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-12T18:52:11.633 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-01-12T18:52:11.633 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-12T18:52:11.633 INFO:teuthology.provision.fog.smithi087:Deploy complete!
2024-01-12T18:52:11.635 DEBUG:teuthology.parallel:result is None
2024-01-12T18:52:17.335 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-12T18:52:20.412 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157
2024-01-12T18:52:26.417 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-12T18:52:26.653 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-12T18:52:26.653 DEBUG:teuthology.orchestra.run.smithi157:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-12T18:52:47.099 INFO:teuthology.provision.fog.smithi157:Node is ready
2024-01-12T18:52:47.100 DEBUG:teuthology.orchestra.run.smithi157:> hostname
2024-01-12T18:52:47.117 INFO:teuthology.orchestra.run.smithi157.stdout:smithi157.front.sepia.ceph.com
2024-01-12T18:52:47.118 DEBUG:teuthology.orchestra.run.smithi157:> grep smithi157.front.sepia.ceph.com /etc/hosts
2024-01-12T18:52:47.176 INFO:teuthology.orchestra.run.smithi157.stdout:172.21.15.157 smithi157.front.sepia.ceph.com smithi157
2024-01-12T18:52:47.176 DEBUG:teuthology.orchestra.run.smithi157:> sudo hostname smithi157
2024-01-12T18:52:47.305 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/smithi157.front.sepia.ceph.com/smithi157/g' /etc/hosts
2024-01-12T18:52:47.336 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/172.21.15.157/172.21.15.157/g' /etc/hosts
2024-01-12T18:52:47.408 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/smithi157.front.sepia.ceph.com/smithi157/g' /etc/hostname
2024-01-12T18:52:47.478 DEBUG:teuthology.orchestra.run.smithi157:> sudo hostname smithi157
2024-01-12T18:52:47.546 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release
2024-01-12T18:52:47.601 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="CentOS Stream"
2024-01-12T18:52:47.602 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="9"
2024-01-12T18:52:47.602 INFO:teuthology.orchestra.run.smithi157.stdout:ID="centos"
2024-01-12T18:52:47.602 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="rhel fedora"
2024-01-12T18:52:47.602 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="9"
2024-01-12T18:52:47.602 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el9"
2024-01-12T18:52:47.602 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="CentOS Stream 9"
2024-01-12T18:52:47.602 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31"
2024-01-12T18:52:47.602 INFO:teuthology.orchestra.run.smithi157.stdout:LOGO="fedora-logo-icon"
2024-01-12T18:52:47.602 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-01-12T18:52:47.603 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://centos.org/"
2024-01-12T18:52:47.603 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-12T18:52:47.603 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-01-12T18:52:47.603 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-12T18:52:47.603 INFO:teuthology.provision.fog.smithi157:Deploy complete!
2024-01-12T18:52:47.607 DEBUG:teuthology.parallel:result is None
2024-01-12T18:52:47.774 INFO:teuthology.lock.ops:Checking smithi087.front.sepia.ceph.com
2024-01-12T18:52:47.775 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-12T18:52:47.806 INFO:teuthology.lock.ops:Checking smithi157.front.sepia.ceph.com
2024-01-12T18:52:47.806 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-12T18:52:47.823 INFO:teuthology.lock.ops:Updating [smithi087.front.sepia.ceph.com]: set os type and version on server
2024-01-12T18:52:47.824 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com'
2024-01-12T18:52:47.824 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-12T18:52:47.918 DEBUG:teuthology.orchestra.run.smithi087:> true
2024-01-12T18:52:48.086 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi087.front.sepia.ceph.com'
2024-01-12T18:52:48.086 DEBUG:teuthology.orchestra.run.smithi087:> uname -m
2024-01-12T18:52:48.140 INFO:teuthology.orchestra.run.smithi087.stdout:x86_64
2024-01-12T18:52:48.141 DEBUG:teuthology.orchestra.run.smithi087:> cat /etc/os-release
2024-01-12T18:52:48.195 INFO:teuthology.orchestra.run.smithi087.stdout:NAME="CentOS Stream"
2024-01-12T18:52:48.195 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION="9"
2024-01-12T18:52:48.195 INFO:teuthology.orchestra.run.smithi087.stdout:ID="centos"
2024-01-12T18:52:48.196 INFO:teuthology.orchestra.run.smithi087.stdout:ID_LIKE="rhel fedora"
2024-01-12T18:52:48.196 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_ID="9"
2024-01-12T18:52:48.196 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM_ID="platform:el9"
2024-01-12T18:52:48.196 INFO:teuthology.orchestra.run.smithi087.stdout:PRETTY_NAME="CentOS Stream 9"
2024-01-12T18:52:48.196 INFO:teuthology.orchestra.run.smithi087.stdout:ANSI_COLOR="0;31"
2024-01-12T18:52:48.196 INFO:teuthology.orchestra.run.smithi087.stdout:LOGO="fedora-logo-icon"
2024-01-12T18:52:48.196 INFO:teuthology.orchestra.run.smithi087.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-01-12T18:52:48.196 INFO:teuthology.orchestra.run.smithi087.stdout:HOME_URL="https://centos.org/"
2024-01-12T18:52:48.196 INFO:teuthology.orchestra.run.smithi087.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-12T18:52:48.196 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-01-12T18:52:48.196 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-12T18:52:48.197 INFO:teuthology.lock.ops:Updating smithi087.front.sepia.ceph.com on lock server
2024-01-12T18:52:48.223 INFO:teuthology.lock.ops:Updating [smithi157.front.sepia.ceph.com]: set os type and version on server
2024-01-12T18:52:48.223 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com'
2024-01-12T18:52:48.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-12T18:52:48.312 DEBUG:teuthology.orchestra.run.smithi157:> true
2024-01-12T18:52:48.380 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi157.front.sepia.ceph.com'
2024-01-12T18:52:48.380 DEBUG:teuthology.orchestra.run.smithi157:> uname -m
2024-01-12T18:52:48.436 INFO:teuthology.orchestra.run.smithi157.stdout:x86_64
2024-01-12T18:52:48.436 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release
2024-01-12T18:52:48.492 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="CentOS Stream"
2024-01-12T18:52:48.492 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="9"
2024-01-12T18:52:48.492 INFO:teuthology.orchestra.run.smithi157.stdout:ID="centos"
2024-01-12T18:52:48.492 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="rhel fedora"
2024-01-12T18:52:48.493 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="9"
2024-01-12T18:52:48.493 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el9"
2024-01-12T18:52:48.493 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="CentOS Stream 9"
2024-01-12T18:52:48.493 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31"
2024-01-12T18:52:48.493 INFO:teuthology.orchestra.run.smithi157.stdout:LOGO="fedora-logo-icon"
2024-01-12T18:52:48.493 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-01-12T18:52:48.493 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://centos.org/"
2024-01-12T18:52:48.493 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-12T18:52:48.493 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-01-12T18:52:48.493 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-12T18:52:48.494 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server
2024-01-12T18:52:48.514 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T18:52:48.608 INFO:teuthology.dispatcher.supervisor:Running job 7514420
2024-01-12T18:52:48.608 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-01-12_15:17:53-fs-main-distro-default-smithi/7514420 --name yuriw-2024-01-12_15:17:53-fs-main-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v1 tasks/strays} -- /home/teuthworker/archive/yuriw-2024-01-12_15:17:53-fs-main-distro-default-smithi/7514420/orig.config.yaml
2024-01-12T18:52:48.611 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-01-12_15:17:53-fs-main-distro-default-smithi/7514420
2024-01-12T18:52:48.612 INFO:teuthology.dispatcher.supervisor:Job PID: 3699034
2024-01-12T18:52:48.612 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-01-12T18:54:48.712 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T18:56:48.873 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T18:58:49.040 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T19:00:49.188 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T19:02:49.356 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T19:04:49.521 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T19:06:49.696 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T19:08:49.872 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T19:10:50.048 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T19:12:50.223 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T19:14:50.398 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T19:16:50.553 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T19:18:50.732 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T19:20:50.896 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T19:22:51.074 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T19:24:51.239 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T19:26:51.414 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T19:28:51.578 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T19:28:51.663 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2024-01-12T19:28:51.828 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2024-01-12T19:28:51.828 INFO:teuthology.nuke:Checking targets against current locks
2024-01-12T19:28:51.873 DEBUG:teuthology.nuke:shortname: smithi087
2024-01-12T19:28:51.874 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-12T19:28:51.903 DEBUG:teuthology.nuke:shortname: smithi157
2024-01-12T19:28:51.903 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-12T19:28:51.904 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi087.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-12_15:17:53-fs-main-distro-default-smithi/7514420', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-12 18:47:11.610149', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK/8jBmRK61oq2YJfljSzlNFLEOM4RmQJ0/H+fFTAthrSI/6BxyDDOCmYLAI9CnNQk3dhJTMVi1+dK4CdI0wAFQ='}
2024-01-12T19:28:51.926 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi157.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-12_15:17:53-fs-main-distro-default-smithi/7514420', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-12 18:47:11.608184', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAE+K3KvNLi9wiXNKRnx7QdCS+ek3f6pcRExkGHG14S62ML10t7BSXRVWixfACuc32vdBq5DuWXXtJyqKkKM18s='}
2024-01-12T19:28:51.955 INFO:teuthology.orchestra.console.smithi087:Power off
2024-01-12T19:28:51.956 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-12T19:28:51.978 DEBUG:teuthology.orchestra.console.smithi087:power off output: Chassis Power Control: Down/Off
2024-01-12T19:28:51.978 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-12T19:28:51.992 INFO:teuthology.orchestra.console.smithi157:Power off
2024-01-12T19:28:51.992 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-12T19:28:52.000 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is off
2024-01-12T19:28:52.015 DEBUG:teuthology.orchestra.console.smithi157:power off output: Chassis Power Control: Down/Off
2024-01-12T19:28:52.015 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-12T19:28:52.036 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off
2024-01-12T19:28:52.102 INFO:teuthology.orchestra.console.smithi087:Power off completed
2024-01-12T19:28:52.137 INFO:teuthology.orchestra.console.smithi157:Power off completed
2024-01-12T19:28:52.254 INFO:teuthology.lock.ops:unlocked: smithi087.front.sepia.ceph.com
2024-01-12T19:28:52.277 INFO:teuthology.lock.ops:unlocked: smithi157.front.sepia.ceph.com