2024-01-02T13:34:30.244 INFO:root:teuthology version: 0.0.1.dev228+g01dd171
2024-01-02T13:34:30.244 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-02T13:34:30.385 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f3f1211f310>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f3f13063940>, signals=[15])
2024-01-02T13:34:30.385 INFO:teuthology.lock.ops:Start node 'smithi026.front.sepia.ceph.com' reimaging
2024-01-02T13:34:30.385 INFO:teuthology.lock.ops:Updating [smithi026.front.sepia.ceph.com]: reset os type and version on server
2024-01-02T13:34:30.386 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server
2024-01-02T13:34:30.406 INFO:teuthology.lock.ops:Start node 'smithi176.front.sepia.ceph.com' reimaging
2024-01-02T13:34:30.406 INFO:teuthology.lock.ops:Updating [smithi176.front.sepia.ceph.com]: reset os type and version on server
2024-01-02T13:34:30.406 INFO:teuthology.lock.ops:Updating smithi176.front.sepia.ceph.com on lock server
2024-01-02T13:34:30.525 DEBUG:teuthology.provision.fog.smithi026:Requesting image smithi_ubuntu_22.04 (ID 6)
2024-01-02T13:34:30.545 DEBUG:teuthology.provision.fog.smithi176:Requesting image smithi_ubuntu_22.04 (ID 6)
2024-01-02T13:34:30.568 INFO:teuthology.provision.fog.smithi026:Scheduling deploy of ubuntu 22.04
2024-01-02T13:34:30.584 INFO:teuthology.provision.fog.smithi176:Scheduling deploy of ubuntu 22.04
2024-01-02T13:34:30.771 INFO:teuthology.orchestra.console.smithi176:Power off
2024-01-02T13:34:30.771 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-02T13:34:30.784 INFO:teuthology.orchestra.console.smithi026:Power off
2024-01-02T13:34:30.784 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-02T13:34:30.793 DEBUG:teuthology.orchestra.console.smithi176:power off output: Chassis Power Control: Down/Off
2024-01-02T13:34:30.793 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-02T13:34:30.804 DEBUG:teuthology.orchestra.console.smithi026:power off output: Chassis Power Control: Down/Off
2024-01-02T13:34:30.804 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-02T13:34:30.815 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is on
2024-01-02T13:34:30.825 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is on
2024-01-02T13:34:34.820 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-02T13:34:34.828 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-02T13:34:34.931 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is on
2024-01-02T13:34:34.939 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is on
2024-01-02T13:34:38.936 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-02T13:34:38.950 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-02T13:34:39.053 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is on
2024-01-02T13:34:39.061 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is on
2024-01-02T13:34:43.058 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-02T13:34:43.070 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-02T13:34:43.172 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is off
2024-01-02T13:34:43.180 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is off
2024-01-02T13:34:43.272 INFO:teuthology.orchestra.console.smithi176:Power off completed
2024-01-02T13:34:43.281 INFO:teuthology.orchestra.console.smithi026:Power off completed
2024-01-02T13:34:43.373 INFO:teuthology.orchestra.console.smithi176:Power on
2024-01-02T13:34:43.374 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-02T13:34:43.381 INFO:teuthology.orchestra.console.smithi026:Power on
2024-01-02T13:34:43.381 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-02T13:34:43.396 DEBUG:teuthology.orchestra.console.smithi176:power on output: Chassis Power Control: Up/On
2024-01-02T13:34:43.396 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-02T13:34:43.404 DEBUG:teuthology.orchestra.console.smithi026:power on output: Chassis Power Control: Up/On
2024-01-02T13:34:43.405 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-02T13:34:43.418 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is off
2024-01-02T13:34:43.425 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is off
2024-01-02T13:34:47.422 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-02T13:34:47.428 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-02T13:34:47.530 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is on
2024-01-02T13:34:47.535 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is on
2024-01-02T13:34:47.631 INFO:teuthology.orchestra.console.smithi176:Power on completed
2024-01-02T13:34:47.636 INFO:teuthology.orchestra.console.smithi026:Power on completed
2024-01-02T13:34:47.732 INFO:teuthology.provision.fog.smithi176:Waiting for deploy to finish
2024-01-02T13:34:47.736 INFO:teuthology.provision.fog.smithi026:Waiting for deploy to finish
2024-01-02T13:37:48.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-02T13:37:51.676 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26
2024-01-02T13:37:57.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-02T13:38:00.732 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26
2024-01-02T13:38:03.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-02T13:38:06.716 WARNING:teuthology.provision.fog.smithi176:[Errno None] Unable to connect to port 22 on 172.21.15.176
2024-01-02T13:38:06.733 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-02T13:38:09.788 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26
2024-01-02T13:38:12.720 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-02T13:38:15.772 WARNING:teuthology.provision.fog.smithi176:[Errno None] Unable to connect to port 22 on 172.21.15.176
2024-01-02T13:38:15.789 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-02T13:38:18.844 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26
2024-01-02T13:38:21.777 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-02T13:38:24.862 WARNING:teuthology.provision.fog.smithi176:[Errno None] Unable to connect to port 22 on 172.21.15.176
2024-01-02T13:38:24.888 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-02T13:38:27.964 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26
2024-01-02T13:38:30.866 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-02T13:38:33.948 WARNING:teuthology.provision.fog.smithi176:[Errno None] Unable to connect to port 22 on 172.21.15.176
2024-01-02T13:38:33.965 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-02T13:38:39.955 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-02T13:38:43.036 WARNING:teuthology.provision.fog.smithi176:[Errno None] Unable to connect to port 22 on 172.21.15.176
2024-01-02T13:38:49.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-02T13:38:52.124 WARNING:teuthology.provision.fog.smithi176:[Errno None] Unable to connect to port 22 on 172.21.15.176
2024-01-02T13:38:58.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-02T13:39:33.968 WARNING:teuthology.provision.fog.smithi026:timed out
2024-01-02T13:39:39.976 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-02T13:39:40.189 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-02T13:39:40.189 DEBUG:teuthology.orchestra.run.smithi026:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-02T13:39:40.827 INFO:teuthology.provision.fog.smithi026:Node is ready
2024-01-02T13:39:40.827 DEBUG:teuthology.orchestra.run.smithi026:> hostname
2024-01-02T13:39:40.874 INFO:teuthology.orchestra.run.smithi026.stdout:smithi026.front.sepia.ceph.com
2024-01-02T13:39:40.874 DEBUG:teuthology.orchestra.run.smithi026:> grep smithi026.front.sepia.ceph.com /etc/hosts
2024-01-02T13:39:40.922 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26 smithi026.front.sepia.ceph.com smithi026
2024-01-02T13:39:40.922 DEBUG:teuthology.orchestra.run.smithi026:> sudo hostname smithi026
2024-01-02T13:39:41.046 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/smithi026.front.sepia.ceph.com/smithi026/g' /etc/hosts
2024-01-02T13:39:41.060 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/172.21.15.26/172.21.15.26/g' /etc/hosts
2024-01-02T13:39:41.118 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/smithi026.front.sepia.ceph.com/smithi026/g' /etc/hostname
2024-01-02T13:39:41.178 DEBUG:teuthology.orchestra.run.smithi026:> sudo hostname smithi026
2024-01-02T13:39:41.237 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release
2024-01-02T13:39:41.286 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-01-02T13:39:41.286 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="Ubuntu"
2024-01-02T13:39:41.286 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="22.04"
2024-01-02T13:39:41.286 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-01-02T13:39:41.286 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_CODENAME=jammy
2024-01-02T13:39:41.286 INFO:teuthology.orchestra.run.smithi026.stdout:ID=ubuntu
2024-01-02T13:39:41.286 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE=debian
2024-01-02T13:39:41.286 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://www.ubuntu.com/"
2024-01-02T13:39:41.286 INFO:teuthology.orchestra.run.smithi026.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-01-02T13:39:41.287 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-01-02T13:39:41.287 INFO:teuthology.orchestra.run.smithi026.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-01-02T13:39:41.287 INFO:teuthology.orchestra.run.smithi026.stdout:UBUNTU_CODENAME=jammy
2024-01-02T13:39:41.288 INFO:teuthology.provision.fog.smithi026:Deploy complete!
2024-01-02T13:39:41.290 DEBUG:teuthology.parallel:result is None
2024-01-02T13:39:58.140 WARNING:teuthology.provision.fog.smithi176:timed out
2024-01-02T13:40:04.148 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-02T13:40:04.359 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-02T13:40:04.360 DEBUG:teuthology.orchestra.run.smithi176:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-02T13:40:04.865 INFO:teuthology.provision.fog.smithi176:Node is ready
2024-01-02T13:40:04.865 DEBUG:teuthology.orchestra.run.smithi176:> hostname
2024-01-02T13:40:04.914 INFO:teuthology.orchestra.run.smithi176.stdout:smithi176.front.sepia.ceph.com
2024-01-02T13:40:04.914 DEBUG:teuthology.orchestra.run.smithi176:> grep smithi176.front.sepia.ceph.com /etc/hosts
2024-01-02T13:40:04.962 INFO:teuthology.orchestra.run.smithi176.stdout:172.21.15.176 smithi176.front.sepia.ceph.com smithi176
2024-01-02T13:40:04.962 DEBUG:teuthology.orchestra.run.smithi176:> sudo hostname smithi176
2024-01-02T13:40:05.079 DEBUG:teuthology.orchestra.run.smithi176:> sudo sed -i -e 's/smithi176.front.sepia.ceph.com/smithi176/g' /etc/hosts
2024-01-02T13:40:05.093 DEBUG:teuthology.orchestra.run.smithi176:> sudo sed -i -e 's/172.21.15.176/172.21.15.176/g' /etc/hosts
2024-01-02T13:40:05.151 DEBUG:teuthology.orchestra.run.smithi176:> sudo sed -i -e 's/smithi176.front.sepia.ceph.com/smithi176/g' /etc/hostname
2024-01-02T13:40:05.206 DEBUG:teuthology.orchestra.run.smithi176:> sudo hostname smithi176
2024-01-02T13:40:05.260 DEBUG:teuthology.orchestra.run.smithi176:> cat /etc/os-release
2024-01-02T13:40:05.306 INFO:teuthology.orchestra.run.smithi176.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-01-02T13:40:05.306 INFO:teuthology.orchestra.run.smithi176.stdout:NAME="Ubuntu"
2024-01-02T13:40:05.306 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION_ID="22.04"
2024-01-02T13:40:05.306 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-01-02T13:40:05.306 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION_CODENAME=jammy
2024-01-02T13:40:05.306 INFO:teuthology.orchestra.run.smithi176.stdout:ID=ubuntu
2024-01-02T13:40:05.306 INFO:teuthology.orchestra.run.smithi176.stdout:ID_LIKE=debian
2024-01-02T13:40:05.306 INFO:teuthology.orchestra.run.smithi176.stdout:HOME_URL="https://www.ubuntu.com/"
2024-01-02T13:40:05.307 INFO:teuthology.orchestra.run.smithi176.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-01-02T13:40:05.307 INFO:teuthology.orchestra.run.smithi176.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-01-02T13:40:05.307 INFO:teuthology.orchestra.run.smithi176.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-01-02T13:40:05.307 INFO:teuthology.orchestra.run.smithi176.stdout:UBUNTU_CODENAME=jammy
2024-01-02T13:40:05.307 INFO:teuthology.provision.fog.smithi176:Deploy complete!
2024-01-02T13:40:05.308 DEBUG:teuthology.parallel:result is None
2024-01-02T13:40:05.498 INFO:teuthology.lock.ops:Checking smithi026.front.sepia.ceph.com
2024-01-02T13:40:05.498 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-02T13:40:05.582 INFO:teuthology.lock.ops:Checking smithi176.front.sepia.ceph.com
2024-01-02T13:40:05.582 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-02T13:40:05.608 INFO:teuthology.lock.ops:Updating [smithi026.front.sepia.ceph.com]: set os type and version on server
2024-01-02T13:40:05.608 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com'
2024-01-02T13:40:05.609 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-02T13:40:05.729 DEBUG:teuthology.orchestra.run.smithi026:> true
2024-01-02T13:40:05.964 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi026.front.sepia.ceph.com'
2024-01-02T13:40:05.965 DEBUG:teuthology.orchestra.run.smithi026:> uname -m
2024-01-02T13:40:06.015 INFO:teuthology.orchestra.run.smithi026.stdout:x86_64
2024-01-02T13:40:06.015 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release
2024-01-02T13:40:06.062 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-01-02T13:40:06.062 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="Ubuntu"
2024-01-02T13:40:06.062 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="22.04"
2024-01-02T13:40:06.062 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-01-02T13:40:06.062 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_CODENAME=jammy
2024-01-02T13:40:06.063 INFO:teuthology.orchestra.run.smithi026.stdout:ID=ubuntu
2024-01-02T13:40:06.063 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE=debian
2024-01-02T13:40:06.063 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://www.ubuntu.com/"
2024-01-02T13:40:06.063 INFO:teuthology.orchestra.run.smithi026.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-01-02T13:40:06.063 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-01-02T13:40:06.063 INFO:teuthology.orchestra.run.smithi026.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-01-02T13:40:06.063 INFO:teuthology.orchestra.run.smithi026.stdout:UBUNTU_CODENAME=jammy
2024-01-02T13:40:06.063 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server
2024-01-02T13:40:06.090 INFO:teuthology.lock.ops:Updating [smithi176.front.sepia.ceph.com]: set os type and version on server
2024-01-02T13:40:06.090 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com'
2024-01-02T13:40:06.091 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-02T13:40:06.168 DEBUG:teuthology.orchestra.run.smithi176:> true
2024-01-02T13:40:06.288 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi176.front.sepia.ceph.com'
2024-01-02T13:40:06.288 DEBUG:teuthology.orchestra.run.smithi176:> uname -m
2024-01-02T13:40:06.333 INFO:teuthology.orchestra.run.smithi176.stdout:x86_64
2024-01-02T13:40:06.334 DEBUG:teuthology.orchestra.run.smithi176:> cat /etc/os-release
2024-01-02T13:40:06.383 INFO:teuthology.orchestra.run.smithi176.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-01-02T13:40:06.406 INFO:teuthology.orchestra.run.smithi176.stdout:NAME="Ubuntu"
2024-01-02T13:40:06.406 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION_ID="22.04"
2024-01-02T13:40:06.406 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-01-02T13:40:06.406 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION_CODENAME=jammy
2024-01-02T13:40:06.406 INFO:teuthology.orchestra.run.smithi176.stdout:ID=ubuntu
2024-01-02T13:40:06.406 INFO:teuthology.orchestra.run.smithi176.stdout:ID_LIKE=debian
2024-01-02T13:40:06.406 INFO:teuthology.orchestra.run.smithi176.stdout:HOME_URL="https://www.ubuntu.com/"
2024-01-02T13:40:06.406 INFO:teuthology.orchestra.run.smithi176.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-01-02T13:40:06.407 INFO:teuthology.orchestra.run.smithi176.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-01-02T13:40:06.407 INFO:teuthology.orchestra.run.smithi176.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-01-02T13:40:06.407 INFO:teuthology.orchestra.run.smithi176.stdout:UBUNTU_CODENAME=jammy
2024-01-02T13:40:06.407 INFO:teuthology.lock.ops:Updating smithi176.front.sepia.ceph.com on lock server
2024-01-02T13:40:06.431 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-02T13:40:06.549 INFO:teuthology.dispatcher.supervisor:Running job 7503540
2024-01-02T13:40:06.549 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/virtualenv/bin/teuthology -v --owner mchangir --archive /home/teuthworker/archive/mchangir-2024-01-02_13:32:53-fs-wip-mchangir-mgr-snap_schedule-support-subvol-and-group-arguments-distro-default-smithi/7503540 --name mchangir-2024-01-02_13:32:53-fs-wip-mchangir-mgr-snap_schedule-support-subvol-and-group-arguments-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v1 tasks/snap-schedule} -- /home/teuthworker/archive/mchangir-2024-01-02_13:32:53-fs-wip-mchangir-mgr-snap_schedule-support-subvol-and-group-arguments-distro-default-smithi/7503540/orig.config.yaml
2024-01-02T13:40:06.553 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/mchangir-2024-01-02_13:32:53-fs-wip-mchangir-mgr-snap_schedule-support-subvol-and-group-arguments-distro-default-smithi/7503540
2024-01-02T13:40:06.553 INFO:teuthology.dispatcher.supervisor:Job PID: 2326304
2024-01-02T13:40:06.553 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-01-02T13:42:06.641 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-02T13:44:06.747 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-02T13:46:06.913 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-02T13:48:07.052 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-02T13:50:07.229 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-02T13:52:07.350 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-02T13:54:07.440 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-02T13:56:07.608 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-02T13:58:07.704 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-02T14:00:07.827 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-02T14:02:07.936 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-02T14:04:08.115 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-02T14:06:08.276 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-02T14:08:08.382 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-02T14:10:08.486 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-02T14:12:08.653 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-02T14:14:08.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-02T14:16:08.912 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-02T14:18:09.017 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-02T14:20:09.157 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-02T14:22:09.268 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-02T14:24:09.546 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-02T14:26:09.725 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-02T14:28:09.981 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-02T14:30:10.164 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-02T14:32:10.332 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-02T14:34:10.487 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-02T14:36:10.663 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-02T14:38:10.743 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-02T14:40:10.879 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-02T14:42:11.128 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-02T14:44:11.301 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-02T14:46:11.473 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-02T14:48:11.645 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-02T14:50:11.834 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-02T14:52:12.012 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-02T14:54:12.177 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-02T14:56:12.362 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-02T14:58:12.536 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-02T15:00:12.704 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-02T15:02:12.859 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-02T15:04:13.016 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-02T15:06:13.176 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-02T15:08:13.345 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-02T15:10:13.520 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-02T15:12:13.684 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-02T15:14:13.860 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-02T15:16:14.035 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-02T15:18:14.213 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-02T15:20:14.380 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-02T15:22:14.555 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-02T15:24:14.728 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-02T15:26:14.880 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-02T15:28:15.007 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-02T15:30:15.219 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-02T15:32:15.368 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-02T15:34:15.532 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-02T15:36:15.771 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-02T15:38:15.944 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-02T15:40:16.104 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-02T15:42:16.272 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-02T15:44:16.452 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-02T15:46:16.615 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-02T15:46:16.689 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2024-01-02T15:46:16.844 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2024-01-02T15:46:16.844 INFO:teuthology.nuke:Checking targets against current locks
2024-01-02T15:46:16.895 DEBUG:teuthology.nuke:shortname: smithi026
2024-01-02T15:46:16.896 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-02T15:46:16.917 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi026.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-01-02_13:32:53-fs-wip-mchangir-mgr-snap_schedule-support-subvol-and-group-arguments-distro-default-smithi/7503540', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-02 13:34:29.502986', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO4aYHhpSvNSa3lmC1euU7Nts+JUD1qZouZmieERgUr+VtQlOn/MBi60h12gLYd54miODVXV/Ab/xErUuJdf69o='}
2024-01-02T15:46:16.920 DEBUG:teuthology.nuke:shortname: smithi176
2024-01-02T15:46:16.920 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-02T15:46:16.943 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi176.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-01-02_13:32:53-fs-wip-mchangir-mgr-snap_schedule-support-subvol-and-group-arguments-distro-default-smithi/7503540', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-02 13:34:29.500953', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGNClUXgxX6ou3qudnym3RE4evtVpkwmo0RoRZm5KCJSCyeZvvd1QvxH7xjAHoOc05BnS1GUIKt6G4/gLHYULA8='}
2024-01-02T15:46:16.974 INFO:teuthology.orchestra.console.smithi026:Power off
2024-01-02T15:46:16.974 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-02T15:46:16.999 DEBUG:teuthology.orchestra.console.smithi026:power off output: Chassis Power Control: Down/Off
2024-01-02T15:46:17.000 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-02T15:46:17.014 INFO:teuthology.orchestra.console.smithi176:Power off
2024-01-02T15:46:17.015 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-02T15:46:17.024 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is off
2024-01-02T15:46:17.036 DEBUG:teuthology.orchestra.console.smithi176:power off output: Chassis Power Control: Down/Off
2024-01-02T15:46:17.037 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-02T15:46:17.057 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is off
2024-01-02T15:46:17.125 INFO:teuthology.orchestra.console.smithi026:Power off completed
2024-01-02T15:46:17.159 INFO:teuthology.orchestra.console.smithi176:Power off completed
2024-01-02T15:46:17.288 INFO:teuthology.lock.ops:unlocked: smithi026.front.sepia.ceph.com
2024-01-02T15:46:17.304 INFO:teuthology.lock.ops:unlocked: smithi176.front.sepia.ceph.com