2024-01-24T05:28:38.525 INFO:root:teuthology version: 0.0.1.dev251+gc856e0f
2024-01-24T05:28:38.525 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T05:28:38.657 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f429e6baf40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f429f55fc10>, signals=[15])
2024-01-24T05:28:38.657 INFO:teuthology.lock.ops:Start node 'smithi184.front.sepia.ceph.com' reimaging
2024-01-24T05:28:38.657 INFO:teuthology.lock.ops:Updating [smithi184.front.sepia.ceph.com]: reset os type and version on server
2024-01-24T05:28:38.657 INFO:teuthology.lock.ops:Updating smithi184.front.sepia.ceph.com on lock server
2024-01-24T05:28:38.675 INFO:teuthology.lock.ops:Start node 'smithi204.front.sepia.ceph.com' reimaging
2024-01-24T05:28:38.676 INFO:teuthology.lock.ops:Updating [smithi204.front.sepia.ceph.com]: reset os type and version on server
2024-01-24T05:28:38.677 INFO:teuthology.lock.ops:Updating smithi204.front.sepia.ceph.com on lock server
2024-01-24T05:28:38.811 DEBUG:teuthology.provision.fog.smithi204:Requesting image smithi_ubuntu_22.04 (ID 6)
2024-01-24T05:28:38.815 DEBUG:teuthology.provision.fog.smithi184:Requesting image smithi_ubuntu_22.04 (ID 6)
2024-01-24T05:28:38.856 INFO:teuthology.provision.fog.smithi204:Scheduling deploy of ubuntu 22.04
2024-01-24T05:28:38.861 INFO:teuthology.provision.fog.smithi184:Scheduling deploy of ubuntu 22.04
2024-01-24T05:28:39.085 INFO:teuthology.orchestra.console.smithi204:Power off
2024-01-24T05:28:39.085 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-24T05:28:39.100 INFO:teuthology.orchestra.console.smithi184:Power off
2024-01-24T05:28:39.100 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-24T05:28:39.108 DEBUG:teuthology.orchestra.console.smithi204:power off output: Chassis Power Control: Down/Off
2024-01-24T05:28:39.108 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T05:28:39.122 DEBUG:teuthology.orchestra.console.smithi184:power off output: Chassis Power Control: Down/Off
2024-01-24T05:28:39.122 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T05:28:39.130 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is on
2024-01-24T05:28:39.143 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is on
2024-01-24T05:28:43.132 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T05:28:43.144 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T05:28:43.241 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is on
2024-01-24T05:28:43.253 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is on
2024-01-24T05:28:47.244 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T05:28:47.254 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T05:28:47.354 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is off
2024-01-24T05:28:47.364 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is off
2024-01-24T05:28:47.455 INFO:teuthology.orchestra.console.smithi204:Power off completed
2024-01-24T05:28:47.465 INFO:teuthology.orchestra.console.smithi184:Power off completed
2024-01-24T05:28:47.556 INFO:teuthology.orchestra.console.smithi204:Power on
2024-01-24T05:28:47.556 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-24T05:28:47.565 INFO:teuthology.orchestra.console.smithi184:Power on
2024-01-24T05:28:47.566 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-24T05:28:47.578 DEBUG:teuthology.orchestra.console.smithi204:power on output: Chassis Power Control: Up/On
2024-01-24T05:28:47.578 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T05:28:47.590 DEBUG:teuthology.orchestra.console.smithi184:power on output: Chassis Power Control: Up/On
2024-01-24T05:28:47.590 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T05:28:47.606 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is off
2024-01-24T05:28:47.620 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is off
2024-01-24T05:28:51.608 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T05:28:51.621 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T05:28:51.719 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is off
2024-01-24T05:28:51.732 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is off
2024-01-24T05:28:55.723 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T05:28:55.733 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T05:28:55.834 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is on
2024-01-24T05:28:55.843 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is on
2024-01-24T05:28:55.935 INFO:teuthology.orchestra.console.smithi204:Power on completed
2024-01-24T05:28:55.944 INFO:teuthology.orchestra.console.smithi184:Power on completed
2024-01-24T05:28:56.036 INFO:teuthology.provision.fog.smithi204:Waiting for deploy to finish
2024-01-24T05:28:56.045 INFO:teuthology.provision.fog.smithi184:Waiting for deploy to finish
2024-01-24T05:32:12.406 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T05:32:15.484 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184
2024-01-24T05:32:21.488 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T05:32:24.540 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184
2024-01-24T05:32:27.466 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T05:32:30.528 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204
2024-01-24T05:32:30.541 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T05:32:33.596 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184
2024-01-24T05:32:36.532 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T05:32:39.599 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T05:32:39.616 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204
2024-01-24T05:32:42.652 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184
2024-01-24T05:32:45.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T05:32:48.656 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T05:32:48.704 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204
2024-01-24T05:32:51.711 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184
2024-01-24T05:32:54.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T05:32:57.716 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T05:32:57.788 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204
2024-01-24T05:33:00.800 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184
2024-01-24T05:33:03.792 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T05:33:06.804 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T05:33:06.844 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204
2024-01-24T05:33:12.848 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T05:33:15.903 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204
2024-01-24T05:33:21.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T05:33:24.988 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204
2024-01-24T05:33:30.994 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T05:33:38.236 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184
2024-01-24T05:33:44.240 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T05:33:44.242 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184
2024-01-24T05:33:50.249 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T05:33:50.251 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184
2024-01-24T05:33:56.256 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T05:33:56.258 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184
2024-01-24T05:34:02.264 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T05:34:02.266 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184
2024-01-24T05:34:02.556 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204
2024-01-24T05:34:08.272 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T05:34:08.493 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-24T05:34:08.493 DEBUG:teuthology.orchestra.run.smithi184:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-24T05:34:08.557 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T05:34:08.559 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204
2024-01-24T05:34:08.936 INFO:teuthology.provision.fog.smithi184:Node is ready
2024-01-24T05:34:08.937 DEBUG:teuthology.orchestra.run.smithi184:> hostname
2024-01-24T05:34:08.985 INFO:teuthology.orchestra.run.smithi184.stdout:smithi184.front.sepia.ceph.com
2024-01-24T05:34:08.985 DEBUG:teuthology.orchestra.run.smithi184:> grep smithi184.front.sepia.ceph.com /etc/hosts
2024-01-24T05:34:09.032 INFO:teuthology.orchestra.run.smithi184.stdout:172.21.15.184 smithi184.front.sepia.ceph.com smithi184
2024-01-24T05:34:09.032 DEBUG:teuthology.orchestra.run.smithi184:> sudo hostname smithi184
2024-01-24T05:34:09.143 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i -e 's/smithi184.front.sepia.ceph.com/smithi184/g' /etc/hosts
2024-01-24T05:34:09.157 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i -e 's/172.21.15.184/172.21.15.184/g' /etc/hosts
2024-01-24T05:34:09.211 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i -e 's/smithi184.front.sepia.ceph.com/smithi184/g' /etc/hostname
2024-01-24T05:34:09.268 DEBUG:teuthology.orchestra.run.smithi184:> sudo hostname smithi184
2024-01-24T05:34:09.322 DEBUG:teuthology.orchestra.run.smithi184:> cat /etc/os-release
2024-01-24T05:34:09.367 INFO:teuthology.orchestra.run.smithi184.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-01-24T05:34:09.368 INFO:teuthology.orchestra.run.smithi184.stdout:NAME="Ubuntu"
2024-01-24T05:34:09.368 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_ID="22.04"
2024-01-24T05:34:09.368 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-01-24T05:34:09.368 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_CODENAME=jammy
2024-01-24T05:34:09.368 INFO:teuthology.orchestra.run.smithi184.stdout:ID=ubuntu
2024-01-24T05:34:09.368 INFO:teuthology.orchestra.run.smithi184.stdout:ID_LIKE=debian
2024-01-24T05:34:09.368 INFO:teuthology.orchestra.run.smithi184.stdout:HOME_URL="https://www.ubuntu.com/"
2024-01-24T05:34:09.368 INFO:teuthology.orchestra.run.smithi184.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-01-24T05:34:09.368 INFO:teuthology.orchestra.run.smithi184.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-01-24T05:34:09.368 INFO:teuthology.orchestra.run.smithi184.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-01-24T05:34:09.368 INFO:teuthology.orchestra.run.smithi184.stdout:UBUNTU_CODENAME=jammy
2024-01-24T05:34:09.369 INFO:teuthology.provision.fog.smithi184:Deploy complete!
2024-01-24T05:34:09.370 DEBUG:teuthology.parallel:result is None
2024-01-24T05:34:14.564 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T05:34:14.566 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204
2024-01-24T05:34:20.572 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T05:34:20.574 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204
2024-01-24T05:34:26.580 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T05:34:27.122 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-24T05:34:27.122 DEBUG:teuthology.orchestra.run.smithi204:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-24T05:34:27.877 INFO:teuthology.provision.fog.smithi204:Node is ready
2024-01-24T05:34:27.878 DEBUG:teuthology.orchestra.run.smithi204:> hostname
2024-01-24T05:34:27.927 INFO:teuthology.orchestra.run.smithi204.stdout:smithi204.front.sepia.ceph.com
2024-01-24T05:34:27.927 DEBUG:teuthology.orchestra.run.smithi204:> grep smithi204.front.sepia.ceph.com /etc/hosts
2024-01-24T05:34:27.974 INFO:teuthology.orchestra.run.smithi204.stdout:172.21.15.204 smithi204.front.sepia.ceph.com smithi204
2024-01-24T05:34:27.975 DEBUG:teuthology.orchestra.run.smithi204:> sudo hostname smithi204
2024-01-24T05:34:28.101 DEBUG:teuthology.orchestra.run.smithi204:> sudo sed -i -e 's/smithi204.front.sepia.ceph.com/smithi204/g' /etc/hosts
2024-01-24T05:34:28.114 DEBUG:teuthology.orchestra.run.smithi204:> sudo sed -i -e 's/172.21.15.204/172.21.15.204/g' /etc/hosts
2024-01-24T05:34:28.173 DEBUG:teuthology.orchestra.run.smithi204:> sudo sed -i -e 's/smithi204.front.sepia.ceph.com/smithi204/g' /etc/hostname
2024-01-24T05:34:28.230 DEBUG:teuthology.orchestra.run.smithi204:> sudo hostname smithi204
2024-01-24T05:34:28.285 DEBUG:teuthology.orchestra.run.smithi204:> cat /etc/os-release
2024-01-24T05:34:28.339 INFO:teuthology.orchestra.run.smithi204.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-01-24T05:34:28.339 INFO:teuthology.orchestra.run.smithi204.stdout:NAME="Ubuntu"
2024-01-24T05:34:28.339 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION_ID="22.04"
2024-01-24T05:34:28.339 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-01-24T05:34:28.339 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION_CODENAME=jammy
2024-01-24T05:34:28.339 INFO:teuthology.orchestra.run.smithi204.stdout:ID=ubuntu
2024-01-24T05:34:28.339 INFO:teuthology.orchestra.run.smithi204.stdout:ID_LIKE=debian
2024-01-24T05:34:28.339 INFO:teuthology.orchestra.run.smithi204.stdout:HOME_URL="https://www.ubuntu.com/"
2024-01-24T05:34:28.339 INFO:teuthology.orchestra.run.smithi204.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-01-24T05:34:28.339 INFO:teuthology.orchestra.run.smithi204.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-01-24T05:34:28.340 INFO:teuthology.orchestra.run.smithi204.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-01-24T05:34:28.340 INFO:teuthology.orchestra.run.smithi204.stdout:UBUNTU_CODENAME=jammy
2024-01-24T05:34:28.340 INFO:teuthology.provision.fog.smithi204:Deploy complete!
2024-01-24T05:34:28.341 DEBUG:teuthology.parallel:result is None
2024-01-24T05:34:28.527 INFO:teuthology.lock.ops:Checking smithi184.front.sepia.ceph.com
2024-01-24T05:34:28.528 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-24T05:34:28.552 INFO:teuthology.lock.ops:Checking smithi204.front.sepia.ceph.com
2024-01-24T05:34:28.553 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-24T05:34:28.578 INFO:teuthology.lock.ops:Updating [smithi184.front.sepia.ceph.com]: set os type and version on server
2024-01-24T05:34:28.578 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com'
2024-01-24T05:34:28.578 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T05:34:28.661 DEBUG:teuthology.orchestra.run.smithi184:> true
2024-01-24T05:34:28.895 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi184.front.sepia.ceph.com'
2024-01-24T05:34:28.896 DEBUG:teuthology.orchestra.run.smithi184:> uname -m
2024-01-24T05:34:28.947 INFO:teuthology.orchestra.run.smithi184.stdout:x86_64
2024-01-24T05:34:28.947 DEBUG:teuthology.orchestra.run.smithi184:> cat /etc/os-release
2024-01-24T05:34:28.995 INFO:teuthology.orchestra.run.smithi184.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-01-24T05:34:28.995 INFO:teuthology.orchestra.run.smithi184.stdout:NAME="Ubuntu"
2024-01-24T05:34:28.995 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_ID="22.04"
2024-01-24T05:34:28.995 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-01-24T05:34:28.996 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_CODENAME=jammy
2024-01-24T05:34:28.996 INFO:teuthology.orchestra.run.smithi184.stdout:ID=ubuntu
2024-01-24T05:34:28.996 INFO:teuthology.orchestra.run.smithi184.stdout:ID_LIKE=debian
2024-01-24T05:34:28.996 INFO:teuthology.orchestra.run.smithi184.stdout:HOME_URL="https://www.ubuntu.com/"
2024-01-24T05:34:28.996 INFO:teuthology.orchestra.run.smithi184.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-01-24T05:34:28.996 INFO:teuthology.orchestra.run.smithi184.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-01-24T05:34:28.996 INFO:teuthology.orchestra.run.smithi184.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-01-24T05:34:28.996 INFO:teuthology.orchestra.run.smithi184.stdout:UBUNTU_CODENAME=jammy
2024-01-24T05:34:28.996 INFO:teuthology.lock.ops:Updating smithi184.front.sepia.ceph.com on lock server
2024-01-24T05:34:29.018 INFO:teuthology.lock.ops:Updating [smithi204.front.sepia.ceph.com]: set os type and version on server
2024-01-24T05:34:29.018 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com'
2024-01-24T05:34:29.019 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T05:34:29.096 DEBUG:teuthology.orchestra.run.smithi204:> true
2024-01-24T05:34:29.200 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi204.front.sepia.ceph.com'
2024-01-24T05:34:29.200 DEBUG:teuthology.orchestra.run.smithi204:> uname -m
2024-01-24T05:34:29.245 INFO:teuthology.orchestra.run.smithi204.stdout:x86_64
2024-01-24T05:34:29.246 DEBUG:teuthology.orchestra.run.smithi204:> cat /etc/os-release
2024-01-24T05:34:29.293 INFO:teuthology.orchestra.run.smithi204.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-01-24T05:34:29.294 INFO:teuthology.orchestra.run.smithi204.stdout:NAME="Ubuntu"
2024-01-24T05:34:29.294 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION_ID="22.04"
2024-01-24T05:34:29.294 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-01-24T05:34:29.294 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION_CODENAME=jammy
2024-01-24T05:34:29.294 INFO:teuthology.orchestra.run.smithi204.stdout:ID=ubuntu
2024-01-24T05:34:29.294 INFO:teuthology.orchestra.run.smithi204.stdout:ID_LIKE=debian
2024-01-24T05:34:29.294 INFO:teuthology.orchestra.run.smithi204.stdout:HOME_URL="https://www.ubuntu.com/"
2024-01-24T05:34:29.294 INFO:teuthology.orchestra.run.smithi204.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-01-24T05:34:29.294 INFO:teuthology.orchestra.run.smithi204.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-01-24T05:34:29.294 INFO:teuthology.orchestra.run.smithi204.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-01-24T05:34:29.294 INFO:teuthology.orchestra.run.smithi204.stdout:UBUNTU_CODENAME=jammy
2024-01-24T05:34:29.295 INFO:teuthology.lock.ops:Updating smithi204.front.sepia.ceph.com on lock server
2024-01-24T05:34:29.318 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T05:34:29.412 INFO:teuthology.dispatcher.supervisor:Running job 7530326
2024-01-24T05:34:29.412 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-01-24_05:26:54-fs-wip-valgrind-testing-testing-default-smithi/7530326 --name vshankar-2024-01-24_05:26:54-fs-wip-valgrind-testing-testing-default-smithi --description fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/fsstress validater/valgrind} -- /home/teuthworker/archive/vshankar-2024-01-24_05:26:54-fs-wip-valgrind-testing-testing-default-smithi/7530326/orig.config.yaml
2024-01-24T05:34:29.415 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-01-24_05:26:54-fs-wip-valgrind-testing-testing-default-smithi/7530326
2024-01-24T05:34:29.415 INFO:teuthology.dispatcher.supervisor:Job PID: 573699
2024-01-24T05:34:29.416 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-01-24T05:36:29.517 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T05:38:29.688 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T05:40:29.856 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T05:42:30.024 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T05:44:30.197 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T05:46:30.372 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T05:48:30.541 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T05:50:30.700 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T05:52:30.864 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T05:54:31.040 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T05:56:31.204 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T05:58:31.373 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T06:00:31.544 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T06:02:31.708 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T06:04:31.861 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T06:06:32.019 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T06:08:32.201 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T06:10:32.369 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T06:12:32.514 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T06:14:32.690 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T06:16:32.857 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T06:18:33.028 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T06:20:33.189 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T06:22:33.361 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T06:24:33.544 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T06:26:33.635 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T06:28:33.804 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T06:30:33.973 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T06:32:34.149 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T06:34:34.323 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T06:36:34.497 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T06:38:34.665 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T06:40:34.836 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T06:42:34.977 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T06:44:35.172 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T06:46:35.345 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T06:48:35.517 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T06:50:35.692 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T06:52:35.865 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T06:54:35.993 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T06:56:36.157 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T06:58:36.310 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T07:00:36.450 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T07:02:36.614 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T07:04:36.778 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T07:06:36.952 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T07:08:37.121 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T07:10:37.288 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T07:12:37.433 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T07:14:37.597 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T07:16:37.761 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T07:18:37.932 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T07:20:38.104 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T07:22:38.280 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T07:24:38.453 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T07:26:38.577 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T07:28:38.748 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T07:30:38.928 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T07:32:39.095 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T07:34:39.269 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T07:36:39.439 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T07:38:39.616 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T07:40:39.776 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T07:42:39.959 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T07:44:40.132 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T07:46:40.300 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T07:48:40.464 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T07:50:40.595 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T07:52:40.776 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T07:54:40.948 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T07:56:41.085 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T07:58:41.262 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T08:00:41.433 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T08:02:41.598 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T08:02:41.671 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2024-01-24T08:02:41.863 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2024-01-24T08:02:41.863 INFO:teuthology.nuke:Checking targets against current locks
2024-01-24T08:02:41.913 DEBUG:teuthology.nuke:shortname: smithi184
2024-01-24T08:02:41.913 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-24T08:02:41.933 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi184.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-24_05:26:54-fs-wip-valgrind-testing-testing-default-smithi/7530326', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-24 05:28:37.472234', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMAbqM9c7idJxKH5YGM1ihjAUEJ1lzudeRGCTW4Svb6Mu+iBfB5c6Jr0Fv+Hg2cuNq9WJeLQ2rW6vlKuc4KEF+s='}
2024-01-24T08:02:41.937 DEBUG:teuthology.nuke:shortname: smithi204
2024-01-24T08:02:41.937 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-24T08:02:41.957 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi204.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-24_05:26:54-fs-wip-valgrind-testing-testing-default-smithi/7530326', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-24 05:28:37.470287', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEewD4bmtLoYE0NSbHeUOD4vDeTlAlyBu7WTDtd80KENFfgiWAPzePb+HaSCxh2YdS4Vt+Lr/uylFoY9MgMooCY='}
2024-01-24T08:02:41.988 INFO:teuthology.orchestra.console.smithi184:Power off
2024-01-24T08:02:41.988 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-24T08:02:42.010 DEBUG:teuthology.orchestra.console.smithi184:power off output: Chassis Power Control: Down/Off
2024-01-24T08:02:42.010 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T08:02:42.023 INFO:teuthology.orchestra.console.smithi204:Power off
2024-01-24T08:02:42.023 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-24T08:02:42.031 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is off
2024-01-24T08:02:42.044 DEBUG:teuthology.orchestra.console.smithi204:power off output: Chassis Power Control: Down/Off
2024-01-24T08:02:42.044 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T08:02:42.065 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is off
2024-01-24T08:02:42.132 INFO:teuthology.orchestra.console.smithi184:Power off completed
2024-01-24T08:02:42.167 INFO:teuthology.orchestra.console.smithi204:Power off completed
2024-01-24T08:02:42.293 INFO:teuthology.lock.ops:unlocked: smithi184.front.sepia.ceph.com
2024-01-24T08:02:42.319 INFO:teuthology.lock.ops:unlocked: smithi204.front.sepia.ceph.com