2023-12-06T12:51:13.169 INFO:root:teuthology version: 0.0.1.dev214+gf2de108
2023-12-06T12:51:13.169 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-06T12:51:13.331 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f61f6d79400>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f61f7ce0550>, signals=[15])
2023-12-06T12:51:13.331 INFO:teuthology.lock.ops:Start node 'smithi138.front.sepia.ceph.com' reimaging
2023-12-06T12:51:13.331 INFO:teuthology.lock.ops:Updating [smithi138.front.sepia.ceph.com]: reset os type and version on server
2023-12-06T12:51:13.332 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server
2023-12-06T12:51:13.354 INFO:teuthology.lock.ops:Start node 'smithi150.front.sepia.ceph.com' reimaging
2023-12-06T12:51:13.354 INFO:teuthology.lock.ops:Updating [smithi150.front.sepia.ceph.com]: reset os type and version on server
2023-12-06T12:51:13.354 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server
2023-12-06T12:51:13.468 DEBUG:teuthology.provision.fog.smithi138:Requesting image smithi_ubuntu_22.04 (ID 6)
2023-12-06T12:51:13.487 DEBUG:teuthology.provision.fog.smithi150:Requesting image smithi_ubuntu_22.04 (ID 6)
2023-12-06T12:51:13.524 INFO:teuthology.provision.fog.smithi150:Scheduling deploy of ubuntu 22.04
2023-12-06T12:51:13.531 INFO:teuthology.provision.fog.smithi138:Scheduling deploy of ubuntu 22.04
2023-12-06T12:51:13.808 INFO:teuthology.orchestra.console.smithi138:Power off
2023-12-06T12:51:13.809 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-06T12:51:13.824 INFO:teuthology.orchestra.console.smithi150:Power off
2023-12-06T12:51:13.824 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-06T12:51:13.833 DEBUG:teuthology.orchestra.console.smithi138:power off output: Chassis Power Control: Down/Off
2023-12-06T12:51:13.833 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-06T12:51:13.846 DEBUG:teuthology.orchestra.console.smithi150:power off output: Chassis Power Control: Down/Off
2023-12-06T12:51:13.846 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-06T12:51:13.856 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is off
2023-12-06T12:51:13.868 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is off
2023-12-06T12:51:13.958 INFO:teuthology.orchestra.console.smithi138:Power off completed
2023-12-06T12:51:13.969 INFO:teuthology.orchestra.console.smithi150:Power off completed
2023-12-06T12:51:14.059 INFO:teuthology.orchestra.console.smithi138:Power on
2023-12-06T12:51:14.059 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-06T12:51:14.071 INFO:teuthology.orchestra.console.smithi150:Power on
2023-12-06T12:51:14.071 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-06T12:51:14.082 DEBUG:teuthology.orchestra.console.smithi138:power on output: Chassis Power Control: Up/On
2023-12-06T12:51:14.083 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-06T12:51:14.094 DEBUG:teuthology.orchestra.console.smithi150:power on output: Chassis Power Control: Up/On
2023-12-06T12:51:14.094 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-06T12:51:14.108 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is off
2023-12-06T12:51:14.117 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is off
2023-12-06T12:51:18.113 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-06T12:51:18.123 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-06T12:51:18.225 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is off
2023-12-06T12:51:18.231 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is off
2023-12-06T12:51:22.230 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-06T12:51:22.237 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-06T12:51:22.339 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is on
2023-12-06T12:51:22.345 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is on
2023-12-06T12:51:22.441 INFO:teuthology.orchestra.console.smithi138:Power on completed
2023-12-06T12:51:22.446 INFO:teuthology.orchestra.console.smithi150:Power on completed
2023-12-06T12:51:22.542 INFO:teuthology.provision.fog.smithi138:Waiting for deploy to finish
2023-12-06T12:51:22.547 INFO:teuthology.provision.fog.smithi150:Waiting for deploy to finish
2023-12-06T12:54:38.669 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-06T12:54:38.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-06T12:54:41.730 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138
2023-12-06T12:54:47.732 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-06T12:54:50.786 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138
2023-12-06T12:54:56.787 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-06T12:54:59.842 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138
2023-12-06T12:55:05.844 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-06T12:55:08.902 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138
2023-12-06T12:55:14.903 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-06T12:55:17.958 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138
2023-12-06T12:55:23.959 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-06T12:55:27.010 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138
2023-12-06T12:55:33.013 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-06T12:55:36.070 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138
2023-12-06T12:55:42.071 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-06T12:56:09.299 ERROR:teuthology.orchestra.connection:Error authenticating with smithi150.front.sepia.ceph.com: AuthenticationException('Authentication timeout.')
2023-12-06T12:56:13.670 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138
2023-12-06T12:56:19.673 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-06T12:56:19.675 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138
2023-12-06T12:56:25.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-06T12:56:25.678 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138
2023-12-06T12:56:28.774 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2023-12-06T12:56:31.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-06T12:56:31.681 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138
2023-12-06T12:56:34.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-06T12:56:34.779 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2023-12-06T12:56:37.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-06T12:56:37.685 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138
2023-12-06T12:56:40.780 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-06T12:56:40.783 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2023-12-06T12:56:43.687 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-06T12:56:43.889 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-06T12:56:43.890 DEBUG:teuthology.orchestra.run.smithi138:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-06T12:56:44.372 INFO:teuthology.provision.fog.smithi138:Node is ready
2023-12-06T12:56:44.372 DEBUG:teuthology.orchestra.run.smithi138:> hostname
2023-12-06T12:56:44.422 INFO:teuthology.orchestra.run.smithi138.stdout:smithi138.front.sepia.ceph.com
2023-12-06T12:56:44.422 DEBUG:teuthology.orchestra.run.smithi138:> grep smithi138.front.sepia.ceph.com /etc/hosts
2023-12-06T12:56:44.475 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138 smithi138.front.sepia.ceph.com smithi138
2023-12-06T12:56:44.475 DEBUG:teuthology.orchestra.run.smithi138:> sudo hostname smithi138
2023-12-06T12:56:44.602 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i -e 's/smithi138.front.sepia.ceph.com/smithi138/g' /etc/hosts
2023-12-06T12:56:44.616 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i -e 's/172.21.15.138/172.21.15.138/g' /etc/hosts
2023-12-06T12:56:44.674 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i -e 's/smithi138.front.sepia.ceph.com/smithi138/g' /etc/hostname
2023-12-06T12:56:44.730 DEBUG:teuthology.orchestra.run.smithi138:> sudo hostname smithi138
2023-12-06T12:56:44.785 DEBUG:teuthology.orchestra.run.smithi138:> cat /etc/os-release
2023-12-06T12:56:44.835 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-12-06T12:56:44.835 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="Ubuntu"
2023-12-06T12:56:44.835 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="22.04"
2023-12-06T12:56:44.836 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-12-06T12:56:44.836 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_CODENAME=jammy
2023-12-06T12:56:44.836 INFO:teuthology.orchestra.run.smithi138.stdout:ID=ubuntu
2023-12-06T12:56:44.836 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE=debian
2023-12-06T12:56:44.836 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://www.ubuntu.com/"
2023-12-06T12:56:44.836 INFO:teuthology.orchestra.run.smithi138.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-12-06T12:56:44.837 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-12-06T12:56:44.837 INFO:teuthology.orchestra.run.smithi138.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-12-06T12:56:44.837 INFO:teuthology.orchestra.run.smithi138.stdout:UBUNTU_CODENAME=jammy
2023-12-06T12:56:44.838 INFO:teuthology.provision.fog.smithi138:Deploy complete!
2023-12-06T12:56:44.840 DEBUG:teuthology.parallel:result is None
2023-12-06T12:56:46.784 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-06T12:56:46.786 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2023-12-06T12:56:52.787 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-06T12:56:52.983 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-06T12:56:52.984 DEBUG:teuthology.orchestra.run.smithi150:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-06T12:56:53.451 INFO:teuthology.provision.fog.smithi150:Node is ready
2023-12-06T12:56:53.452 DEBUG:teuthology.orchestra.run.smithi150:> hostname
2023-12-06T12:56:53.499 INFO:teuthology.orchestra.run.smithi150.stdout:smithi150.front.sepia.ceph.com
2023-12-06T12:56:53.499 DEBUG:teuthology.orchestra.run.smithi150:> grep smithi150.front.sepia.ceph.com /etc/hosts
2023-12-06T12:56:53.551 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.15.150 smithi150.front.sepia.ceph.com smithi150
2023-12-06T12:56:53.552 DEBUG:teuthology.orchestra.run.smithi150:> sudo hostname smithi150
2023-12-06T12:56:53.687 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/smithi150.front.sepia.ceph.com/smithi150/g' /etc/hosts
2023-12-06T12:56:53.702 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/172.21.15.150/172.21.15.150/g' /etc/hosts
2023-12-06T12:56:53.755 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/smithi150.front.sepia.ceph.com/smithi150/g' /etc/hostname
2023-12-06T12:56:53.812 DEBUG:teuthology.orchestra.run.smithi150:> sudo hostname smithi150
2023-12-06T12:56:53.871 DEBUG:teuthology.orchestra.run.smithi150:> cat /etc/os-release
2023-12-06T12:56:53.919 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-12-06T12:56:53.919 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="Ubuntu"
2023-12-06T12:56:53.920 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="22.04"
2023-12-06T12:56:53.920 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-12-06T12:56:53.920 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_CODENAME=jammy
2023-12-06T12:56:53.920 INFO:teuthology.orchestra.run.smithi150.stdout:ID=ubuntu
2023-12-06T12:56:53.920 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE=debian
2023-12-06T12:56:53.920 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://www.ubuntu.com/"
2023-12-06T12:56:53.920 INFO:teuthology.orchestra.run.smithi150.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-12-06T12:56:53.920 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-12-06T12:56:53.920 INFO:teuthology.orchestra.run.smithi150.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-12-06T12:56:53.920 INFO:teuthology.orchestra.run.smithi150.stdout:UBUNTU_CODENAME=jammy
2023-12-06T12:56:53.921 INFO:teuthology.provision.fog.smithi150:Deploy complete!
2023-12-06T12:56:53.921 DEBUG:teuthology.parallel:result is None
2023-12-06T12:56:54.112 INFO:teuthology.lock.ops:Checking smithi138.front.sepia.ceph.com
2023-12-06T12:56:54.112 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-06T12:56:54.140 INFO:teuthology.lock.ops:Checking smithi150.front.sepia.ceph.com
2023-12-06T12:56:54.141 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-06T12:56:54.166 INFO:teuthology.lock.ops:Updating [smithi138.front.sepia.ceph.com]: set os type and version on server
2023-12-06T12:56:54.167 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com'
2023-12-06T12:56:54.167 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-06T12:56:54.245 DEBUG:teuthology.orchestra.run.smithi138:> true
2023-12-06T12:56:54.347 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi138.front.sepia.ceph.com'
2023-12-06T12:56:54.347 DEBUG:teuthology.orchestra.run.smithi138:> uname -m
2023-12-06T12:56:54.394 INFO:teuthology.orchestra.run.smithi138.stdout:x86_64
2023-12-06T12:56:54.394 DEBUG:teuthology.orchestra.run.smithi138:> cat /etc/os-release
2023-12-06T12:56:54.443 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-12-06T12:56:54.443 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="Ubuntu"
2023-12-06T12:56:54.443 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="22.04"
2023-12-06T12:56:54.443 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-12-06T12:56:54.444 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_CODENAME=jammy
2023-12-06T12:56:54.444 INFO:teuthology.orchestra.run.smithi138.stdout:ID=ubuntu
2023-12-06T12:56:54.444 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE=debian
2023-12-06T12:56:54.444 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://www.ubuntu.com/"
2023-12-06T12:56:54.444 INFO:teuthology.orchestra.run.smithi138.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-12-06T12:56:54.445 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-12-06T12:56:54.445 INFO:teuthology.orchestra.run.smithi138.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-12-06T12:56:54.445 INFO:teuthology.orchestra.run.smithi138.stdout:UBUNTU_CODENAME=jammy
2023-12-06T12:56:54.446 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server
2023-12-06T12:56:54.466 INFO:teuthology.lock.ops:Updating [smithi150.front.sepia.ceph.com]: set os type and version on server
2023-12-06T12:56:54.466 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com'
2023-12-06T12:56:54.466 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-06T12:56:54.542 DEBUG:teuthology.orchestra.run.smithi150:> true
2023-12-06T12:56:54.650 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi150.front.sepia.ceph.com'
2023-12-06T12:56:54.650 DEBUG:teuthology.orchestra.run.smithi150:> uname -m
2023-12-06T12:56:54.699 INFO:teuthology.orchestra.run.smithi150.stdout:x86_64
2023-12-06T12:56:54.699 DEBUG:teuthology.orchestra.run.smithi150:> cat /etc/os-release
2023-12-06T12:56:54.755 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-12-06T12:56:54.755 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="Ubuntu"
2023-12-06T12:56:54.756 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="22.04"
2023-12-06T12:56:54.756 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-12-06T12:56:54.756 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_CODENAME=jammy
2023-12-06T12:56:54.757 INFO:teuthology.orchestra.run.smithi150.stdout:ID=ubuntu
2023-12-06T12:56:54.758 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE=debian
2023-12-06T12:56:54.758 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://www.ubuntu.com/"
2023-12-06T12:56:54.758 INFO:teuthology.orchestra.run.smithi150.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-12-06T12:56:54.759 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-12-06T12:56:54.759 INFO:teuthology.orchestra.run.smithi150.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-12-06T12:56:54.759 INFO:teuthology.orchestra.run.smithi150.stdout:UBUNTU_CODENAME=jammy
2023-12-06T12:56:54.760 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server
2023-12-06T12:56:54.782 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-06T12:56:54.877 INFO:teuthology.dispatcher.supervisor:Running job 7480002
2023-12-06T12:56:54.878 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-12-06_11:53:13-fs-wip-vshankar-testing-20231206.072835-testing-default-smithi/7480002 --name vshankar-2023-12-06_11:53:13-fs-wip-vshankar-testing-20231206.072835-testing-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mds 2-workunit/suites/fsstress}} -- /home/teuthworker/archive/vshankar-2023-12-06_11:53:13-fs-wip-vshankar-testing-20231206.072835-testing-default-smithi/7480002/orig.config.yaml
2023-12-06T12:56:54.888 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-12-06_11:53:13-fs-wip-vshankar-testing-20231206.072835-testing-default-smithi/7480002
2023-12-06T12:56:54.888 INFO:teuthology.dispatcher.supervisor:Job PID: 64743
2023-12-06T12:56:54.889 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-12-06T12:56:55.654 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2023-12-06T12:58:54.986 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-06T13:00:55.151 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-06T13:02:55.323 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-06T13:04:55.483 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-06T13:06:55.647 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-06T13:08:55.815 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-06T13:10:55.983 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-06T13:12:56.159 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-06T13:14:56.333 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-06T13:16:56.495 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-06T13:18:56.668 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-06T13:20:56.839 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-06T13:22:57.003 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-06T13:24:57.172 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-06T13:26:57.355 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-06T13:26:57.431 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-12-06T13:26:57.598 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-12-06T13:26:57.599 INFO:teuthology.nuke:Checking targets against current locks
2023-12-06T13:26:57.649 DEBUG:teuthology.nuke:shortname: smithi138
2023-12-06T13:26:57.649 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-06T13:26:57.672 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi138.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-06_11:53:13-fs-wip-vshankar-testing-20231206.072835-testing-default-smithi/7480002', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-06 12:51:12.267406', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBYbo+L5KKVHdj/gadpwutKKoWznHAO2hg56R2NfOAmlNL14g4jWKoAxqaGFXsDoWHRw7jLnFqsVpg+CbCA51lM='}
2023-12-06T13:26:57.676 DEBUG:teuthology.nuke:shortname: smithi150
2023-12-06T13:26:57.676 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-06T13:26:57.700 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi150.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-06_11:53:13-fs-wip-vshankar-testing-20231206.072835-testing-default-smithi/7480002', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-06 12:51:12.269231', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOfJTp1ZgORdRXyPhubkeiz8zDecM6BSyYcYKo481wJdfBaF34RaIniAY3MNoPW5vLQFUwWxVf01MEz23potD0w='}
2023-12-06T13:26:57.730 INFO:teuthology.orchestra.console.smithi138:Power off
2023-12-06T13:26:57.730 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-06T13:26:57.753 DEBUG:teuthology.orchestra.console.smithi138:power off output: Chassis Power Control: Down/Off
2023-12-06T13:26:57.754 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-06T13:26:57.771 INFO:teuthology.orchestra.console.smithi150:Power off
2023-12-06T13:26:57.772 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-06T13:26:57.780 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is off
2023-12-06T13:26:57.791 DEBUG:teuthology.orchestra.console.smithi150:power off output: Chassis Power Control: Down/Off
2023-12-06T13:26:57.792 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-06T13:26:57.814 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is off
2023-12-06T13:26:57.881 INFO:teuthology.orchestra.console.smithi138:Power off completed
2023-12-06T13:26:57.916 INFO:teuthology.orchestra.console.smithi150:Power off completed
2023-12-06T13:26:58.038 INFO:teuthology.lock.ops:unlocked: smithi138.front.sepia.ceph.com
2023-12-06T13:26:58.071 INFO:teuthology.lock.ops:unlocked: smithi150.front.sepia.ceph.com