2023-11-24T01:32:08.129 INFO:root:teuthology version: 0.0.1.dev205+g2442239
2023-11-24T01:32:08.130 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-24T01:32:08.255 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fdb1a417880>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fdb1af18670>, signals=[15])
2023-11-24T01:32:08.256 INFO:teuthology.lock.ops:Start node 'smithi119.front.sepia.ceph.com' reimaging
2023-11-24T01:32:08.256 INFO:teuthology.lock.ops:Updating [smithi119.front.sepia.ceph.com]: reset os type and version on server
2023-11-24T01:32:08.256 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server
2023-11-24T01:32:08.275 INFO:teuthology.lock.ops:Start node 'smithi192.front.sepia.ceph.com' reimaging
2023-11-24T01:32:08.275 INFO:teuthology.lock.ops:Updating [smithi192.front.sepia.ceph.com]: reset os type and version on server
2023-11-24T01:32:08.276 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server
2023-11-24T01:32:08.387 DEBUG:teuthology.provision.fog.smithi119:Requesting image smithi_ubuntu_22.04 (ID 6)
2023-11-24T01:32:08.397 DEBUG:teuthology.provision.fog.smithi192:Requesting image smithi_ubuntu_22.04 (ID 6)
2023-11-24T01:32:08.435 INFO:teuthology.provision.fog.smithi119:Scheduling deploy of ubuntu 22.04
2023-11-24T01:32:08.445 INFO:teuthology.provision.fog.smithi192:Scheduling deploy of ubuntu 22.04
2023-11-24T01:32:08.618 INFO:teuthology.orchestra.console.smithi119:Power off
2023-11-24T01:32:08.618 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-24T01:32:08.640 DEBUG:teuthology.orchestra.console.smithi119:power off output: Chassis Power Control: Down/Off
2023-11-24T01:32:08.640 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-24T01:32:08.652 INFO:teuthology.orchestra.console.smithi192:Power off
2023-11-24T01:32:08.652 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-24T01:32:08.661 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on
2023-11-24T01:32:08.672 DEBUG:teuthology.orchestra.console.smithi192:power off output: Chassis Power Control: Down/Off
2023-11-24T01:32:08.672 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-24T01:32:08.695 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on
2023-11-24T01:32:12.666 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-24T01:32:12.696 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-24T01:32:12.776 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on
2023-11-24T01:32:12.805 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on
2023-11-24T01:32:16.781 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-24T01:32:16.806 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-24T01:32:16.892 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off
2023-11-24T01:32:16.916 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on
2023-11-24T01:32:16.993 INFO:teuthology.orchestra.console.smithi119:Power off completed
2023-11-24T01:32:17.094 INFO:teuthology.orchestra.console.smithi119:Power on
2023-11-24T01:32:17.094 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-24T01:32:17.121 DEBUG:teuthology.orchestra.console.smithi119:power on output: Chassis Power Control: Up/On
2023-11-24T01:32:17.121 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-24T01:32:17.143 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off
2023-11-24T01:32:20.920 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-24T01:32:21.031 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off
2023-11-24T01:32:21.131 INFO:teuthology.orchestra.console.smithi192:Power off completed
2023-11-24T01:32:21.145 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-24T01:32:21.233 INFO:teuthology.orchestra.console.smithi192:Power on
2023-11-24T01:32:21.233 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-24T01:32:21.254 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off
2023-11-24T01:32:21.256 DEBUG:teuthology.orchestra.console.smithi192:power on output: Chassis Power Control: Up/On
2023-11-24T01:32:21.256 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-24T01:32:21.280 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off
2023-11-24T01:32:25.259 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-24T01:32:25.281 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-24T01:32:25.369 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on
2023-11-24T01:32:25.387 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on
2023-11-24T01:32:25.470 INFO:teuthology.orchestra.console.smithi119:Power on completed
2023-11-24T01:32:25.488 INFO:teuthology.orchestra.console.smithi192:Power on completed
2023-11-24T01:32:25.570 INFO:teuthology.provision.fog.smithi119:Waiting for deploy to finish
2023-11-24T01:32:25.588 INFO:teuthology.provision.fog.smithi192:Waiting for deploy to finish
2023-11-24T01:35:41.759 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-24T01:35:41.763 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-24T01:36:00.098 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192
2023-11-24T01:36:00.099 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2023-11-24T01:36:06.105 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-24T01:36:06.107 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-24T01:36:09.186 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192
2023-11-24T01:36:09.187 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2023-11-24T01:36:15.194 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-24T01:36:15.196 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-24T01:36:18.274 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192
2023-11-24T01:36:18.275 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2023-11-24T01:36:24.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-24T01:36:24.278 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-24T01:36:27.330 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192
2023-11-24T01:36:27.331 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2023-11-24T01:36:33.338 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-24T01:36:33.340 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-24T01:36:36.418 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192
2023-11-24T01:36:42.425 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-24T01:36:51.810 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2023-11-24T01:36:57.817 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-24T01:37:00.898 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2023-11-24T01:37:06.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-24T01:37:07.942 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2023-11-24T01:37:13.949 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-24T01:37:13.951 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2023-11-24T01:37:19.954 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-24T01:37:19.957 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2023-11-24T01:37:25.963 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-24T01:37:25.966 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2023-11-24T01:37:31.970 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-24T01:37:31.972 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2023-11-24T01:37:37.978 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-24T01:37:38.181 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-24T01:37:38.182 DEBUG:teuthology.orchestra.run.smithi119:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-24T01:37:38.689 INFO:teuthology.provision.fog.smithi119:Node is ready
2023-11-24T01:37:38.689 DEBUG:teuthology.orchestra.run.smithi119:> hostname
2023-11-24T01:37:38.736 INFO:teuthology.orchestra.run.smithi119.stdout:smithi119.front.sepia.ceph.com
2023-11-24T01:37:38.736 DEBUG:teuthology.orchestra.run.smithi119:> grep smithi119.front.sepia.ceph.com /etc/hosts
2023-11-24T01:37:38.785 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119 smithi119.front.sepia.ceph.com smithi119
2023-11-24T01:37:38.785 DEBUG:teuthology.orchestra.run.smithi119:> sudo hostname smithi119
2023-11-24T01:37:38.928 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/smithi119.front.sepia.ceph.com/smithi119/g' /etc/hosts
2023-11-24T01:37:38.942 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/172.21.15.119/172.21.15.119/g' /etc/hosts
2023-11-24T01:37:38.997 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/smithi119.front.sepia.ceph.com/smithi119/g' /etc/hostname
2023-11-24T01:37:39.057 DEBUG:teuthology.orchestra.run.smithi119:> sudo hostname smithi119
2023-11-24T01:37:39.111 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release
2023-11-24T01:37:39.156 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-11-24T01:37:39.157 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="Ubuntu"
2023-11-24T01:37:39.157 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="22.04"
2023-11-24T01:37:39.157 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-11-24T01:37:39.157 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_CODENAME=jammy
2023-11-24T01:37:39.158 INFO:teuthology.orchestra.run.smithi119.stdout:ID=ubuntu
2023-11-24T01:37:39.158 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE=debian
2023-11-24T01:37:39.158 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://www.ubuntu.com/"
2023-11-24T01:37:39.158 INFO:teuthology.orchestra.run.smithi119.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-11-24T01:37:39.158 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-11-24T01:37:39.158 INFO:teuthology.orchestra.run.smithi119.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-11-24T01:37:39.159 INFO:teuthology.orchestra.run.smithi119.stdout:UBUNTU_CODENAME=jammy
2023-11-24T01:37:39.159 INFO:teuthology.provision.fog.smithi119:Deploy complete!
2023-11-24T01:37:39.161 DEBUG:teuthology.parallel:result is None
2023-11-24T01:37:42.430 WARNING:teuthology.provision.fog.smithi192:timed out
2023-11-24T01:37:48.434 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-24T01:37:48.709 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-24T01:37:48.709 DEBUG:teuthology.orchestra.run.smithi192:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-24T01:37:49.146 INFO:teuthology.provision.fog.smithi192:Node is ready
2023-11-24T01:37:49.146 DEBUG:teuthology.orchestra.run.smithi192:> hostname
2023-11-24T01:37:49.194 INFO:teuthology.orchestra.run.smithi192.stdout:smithi192.front.sepia.ceph.com
2023-11-24T01:37:49.195 DEBUG:teuthology.orchestra.run.smithi192:> grep smithi192.front.sepia.ceph.com /etc/hosts
2023-11-24T01:37:49.242 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.15.192 smithi192.front.sepia.ceph.com smithi192
2023-11-24T01:37:49.243 DEBUG:teuthology.orchestra.run.smithi192:> sudo hostname smithi192
2023-11-24T01:37:49.349 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/smithi192.front.sepia.ceph.com/smithi192/g' /etc/hosts
2023-11-24T01:37:49.364 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/172.21.15.192/172.21.15.192/g' /etc/hosts
2023-11-24T01:37:49.419 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/smithi192.front.sepia.ceph.com/smithi192/g' /etc/hostname
2023-11-24T01:37:49.479 DEBUG:teuthology.orchestra.run.smithi192:> sudo hostname smithi192
2023-11-24T01:37:49.537 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release
2023-11-24T01:37:49.587 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-11-24T01:37:49.587 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="Ubuntu"
2023-11-24T01:37:49.587 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="22.04"
2023-11-24T01:37:49.587 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-11-24T01:37:49.587 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_CODENAME=jammy
2023-11-24T01:37:49.587 INFO:teuthology.orchestra.run.smithi192.stdout:ID=ubuntu
2023-11-24T01:37:49.587 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE=debian
2023-11-24T01:37:49.587 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://www.ubuntu.com/"
2023-11-24T01:37:49.587 INFO:teuthology.orchestra.run.smithi192.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-11-24T01:37:49.587 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-11-24T01:37:49.587 INFO:teuthology.orchestra.run.smithi192.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-11-24T01:37:49.588 INFO:teuthology.orchestra.run.smithi192.stdout:UBUNTU_CODENAME=jammy
2023-11-24T01:37:49.588 INFO:teuthology.provision.fog.smithi192:Deploy complete!
2023-11-24T01:37:49.588 DEBUG:teuthology.parallel:result is None
2023-11-24T01:37:49.762 INFO:teuthology.lock.ops:Checking smithi119.front.sepia.ceph.com
2023-11-24T01:37:49.763 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-24T01:37:49.781 INFO:teuthology.lock.ops:Checking smithi192.front.sepia.ceph.com
2023-11-24T01:37:49.781 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-24T01:37:49.807 INFO:teuthology.lock.ops:Updating [smithi119.front.sepia.ceph.com]: set os type and version on server
2023-11-24T01:37:49.808 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com'
2023-11-24T01:37:49.808 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-24T01:37:49.882 DEBUG:teuthology.orchestra.run.smithi119:> true
2023-11-24T01:37:49.998 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi119.front.sepia.ceph.com'
2023-11-24T01:37:49.998 DEBUG:teuthology.orchestra.run.smithi119:> uname -m
2023-11-24T01:37:50.044 INFO:teuthology.orchestra.run.smithi119.stdout:x86_64
2023-11-24T01:37:50.044 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release
2023-11-24T01:37:50.092 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-11-24T01:37:50.092 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="Ubuntu"
2023-11-24T01:37:50.093 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="22.04"
2023-11-24T01:37:50.093 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-11-24T01:37:50.093 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_CODENAME=jammy
2023-11-24T01:37:50.093 INFO:teuthology.orchestra.run.smithi119.stdout:ID=ubuntu
2023-11-24T01:37:50.093 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE=debian
2023-11-24T01:37:50.093 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://www.ubuntu.com/"
2023-11-24T01:37:50.093 INFO:teuthology.orchestra.run.smithi119.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-11-24T01:37:50.093 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-11-24T01:37:50.093 INFO:teuthology.orchestra.run.smithi119.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-11-24T01:37:50.093 INFO:teuthology.orchestra.run.smithi119.stdout:UBUNTU_CODENAME=jammy
2023-11-24T01:37:50.094 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server
2023-11-24T01:37:50.115 INFO:teuthology.lock.ops:Updating [smithi192.front.sepia.ceph.com]: set os type and version on server
2023-11-24T01:37:50.115 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com'
2023-11-24T01:37:50.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-24T01:37:50.186 DEBUG:teuthology.orchestra.run.smithi192:> true
2023-11-24T01:37:50.283 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi192.front.sepia.ceph.com'
2023-11-24T01:37:50.283 DEBUG:teuthology.orchestra.run.smithi192:> uname -m
2023-11-24T01:37:50.331 INFO:teuthology.orchestra.run.smithi192.stdout:x86_64
2023-11-24T01:37:50.332 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release
2023-11-24T01:37:50.378 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-11-24T01:37:50.378 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="Ubuntu"
2023-11-24T01:37:50.378 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="22.04"
2023-11-24T01:37:50.378 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-11-24T01:37:50.378 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_CODENAME=jammy
2023-11-24T01:37:50.378 INFO:teuthology.orchestra.run.smithi192.stdout:ID=ubuntu
2023-11-24T01:37:50.378 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE=debian
2023-11-24T01:37:50.378 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://www.ubuntu.com/"
2023-11-24T01:37:50.378 INFO:teuthology.orchestra.run.smithi192.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-11-24T01:37:50.378 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-11-24T01:37:50.378 INFO:teuthology.orchestra.run.smithi192.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-11-24T01:37:50.379 INFO:teuthology.orchestra.run.smithi192.stdout:UBUNTU_CODENAME=jammy
2023-11-24T01:37:50.379 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server
2023-11-24T01:37:50.398 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-24T01:37:50.486 INFO:teuthology.dispatcher.supervisor:Running job 7465294
2023-11-24T01:37:50.486 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/virtualenv/bin/teuthology -v --owner mchangir --archive /home/teuthworker/archive/mchangir-2023-11-24_01:30:39-fs-wip-mchangir-mgr-snap_schedule-support-subvol-and-group-arguments-distro-default-smithi/7465294 --name mchangir-2023-11-24_01:30:39-fs-wip-mchangir-mgr-snap_schedule-support-subvol-and-group-arguments-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} -- /home/teuthworker/archive/mchangir-2023-11-24_01:30:39-fs-wip-mchangir-mgr-snap_schedule-support-subvol-and-group-arguments-distro-default-smithi/7465294/orig.config.yaml
2023-11-24T01:37:50.488 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/mchangir-2023-11-24_01:30:39-fs-wip-mchangir-mgr-snap_schedule-support-subvol-and-group-arguments-distro-default-smithi/7465294
2023-11-24T01:37:50.489 INFO:teuthology.dispatcher.supervisor:Job PID: 3276084
2023-11-24T01:37:50.489 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-11-24T01:39:50.590 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-24T01:41:50.763 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-24T01:43:50.927 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-24T01:45:51.084 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-24T01:47:51.167 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-24T01:49:51.239 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-24T01:51:51.538 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-24T01:53:51.775 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-24T01:55:51.896 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-24T01:57:51.988 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-24T01:59:52.147 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-24T02:01:52.351 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-24T02:03:52.468 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-24T02:05:52.645 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-24T02:07:52.800 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-24T02:09:52.907 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-24T02:11:53.066 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-24T02:13:53.286 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-24T02:15:53.451 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-24T02:17:53.642 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-24T02:19:53.755 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-24T02:21:53.852 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-24T02:23:53.963 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-24T02:25:54.276 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-24T02:27:54.711 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-24T02:29:54.900 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-24T02:31:55.169 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-24T02:33:55.238 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-24T02:35:55.390 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-24T02:37:55.599 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-24T02:39:55.852 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-24T02:41:56.013 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-24T02:43:56.088 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-24T02:45:56.159 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-24T02:47:56.325 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-24T02:49:56.492 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-24T02:51:56.653 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-24T02:53:56.799 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-24T02:55:56.920 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-24T02:57:57.101 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-24T02:59:57.169 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-24T03:01:57.311 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-24T03:03:57.482 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-24T03:05:57.607 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-24T03:07:57.777 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-24T03:09:57.931 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-24T03:11:58.082 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-24T03:13:58.276 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-24T03:15:58.364 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-24T03:17:58.439 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-24T03:19:58.604 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-24T03:21:58.669 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-24T03:23:58.797 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-24T03:25:58.927 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-24T03:27:58.991 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-24T03:29:59.091 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-24T03:31:59.178 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-24T03:31:59.295 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-11-24T03:31:59.468 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-11-24T03:31:59.469 INFO:teuthology.nuke:Checking targets against current locks
2023-11-24T03:31:59.513 DEBUG:teuthology.nuke:shortname: smithi119
2023-11-24T03:31:59.514 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-24T03:31:59.539 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi119.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-11-24_01:30:39-fs-wip-mchangir-mgr-snap_schedule-support-subvol-and-group-arguments-distro-default-smithi/7465294', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-24 01:32:07.403691', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL3vg2YhsnzLOr8QJ2xFcUNaydwo9UVhCbhs/BKQdaWbBVSKRKbsXQ8bFft+DlcklIeA8F8RtKwruHcOldU6xak='}
2023-11-24T03:31:59.542 DEBUG:teuthology.nuke:shortname: smithi192
2023-11-24T03:31:59.542 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-24T03:31:59.565 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi192.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-11-24_01:30:39-fs-wip-mchangir-mgr-snap_schedule-support-subvol-and-group-arguments-distro-default-smithi/7465294', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-24 01:32:07.401552', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM7xjFXZXa24thyc0v4t5MCeIgEM10YgbtuetX2ot6ZGedshiRDjZRV3q/JE70VXGsQd0o5jwlZIKPVRONgBpkA='}
2023-11-24T03:31:59.587 INFO:teuthology.orchestra.console.smithi119:Power off
2023-11-24T03:31:59.587 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-24T03:31:59.610 DEBUG:teuthology.orchestra.console.smithi119:power off output: Chassis Power Control: Down/Off
2023-11-24T03:31:59.610 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-24T03:31:59.624 INFO:teuthology.orchestra.console.smithi192:Power off
2023-11-24T03:31:59.624 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-24T03:31:59.633 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off
2023-11-24T03:31:59.644 DEBUG:teuthology.orchestra.console.smithi192:power off output: Chassis Power Control: Down/Off
2023-11-24T03:31:59.644 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-24T03:31:59.664 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off
2023-11-24T03:31:59.734 INFO:teuthology.orchestra.console.smithi119:Power off completed
2023-11-24T03:31:59.765 INFO:teuthology.orchestra.console.smithi192:Power off completed
2023-11-24T03:31:59.894 INFO:teuthology.lock.ops:unlocked: smithi119.front.sepia.ceph.com
2023-11-24T03:31:59.909 INFO:teuthology.lock.ops:unlocked: smithi192.front.sepia.ceph.com