2024-01-17T20:35:12.935 INFO:root:teuthology version: 0.0.1.dev249+gcd45576
2024-01-17T20:35:12.936 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T20:35:13.078 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f17ba446f40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f17bb4abc10>, signals=[15])
2024-01-17T20:35:13.078 INFO:teuthology.lock.ops:Start node 'smithi039.front.sepia.ceph.com' reimaging
2024-01-17T20:35:13.079 INFO:teuthology.lock.ops:Updating [smithi039.front.sepia.ceph.com]: reset os type and version on server
2024-01-17T20:35:13.079 INFO:teuthology.lock.ops:Updating smithi039.front.sepia.ceph.com on lock server
2024-01-17T20:35:13.100 INFO:teuthology.lock.ops:Start node 'smithi196.front.sepia.ceph.com' reimaging
2024-01-17T20:35:13.100 INFO:teuthology.lock.ops:Updating [smithi196.front.sepia.ceph.com]: reset os type and version on server
2024-01-17T20:35:13.100 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server
2024-01-17T20:35:13.231 DEBUG:teuthology.provision.fog.smithi196:Requesting image smithi_ubuntu_22.04 (ID 6)
2024-01-17T20:35:13.237 DEBUG:teuthology.provision.fog.smithi039:Requesting image smithi_ubuntu_22.04 (ID 6)
2024-01-17T20:35:13.280 INFO:teuthology.provision.fog.smithi196:Scheduling deploy of ubuntu 22.04
2024-01-17T20:35:13.283 INFO:teuthology.provision.fog.smithi039:Scheduling deploy of ubuntu 22.04
2024-01-17T20:35:13.583 INFO:teuthology.orchestra.console.smithi196:Power off
2024-01-17T20:35:13.584 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-17T20:35:13.597 INFO:teuthology.orchestra.console.smithi039:Power off
2024-01-17T20:35:13.597 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-17T20:35:13.606 DEBUG:teuthology.orchestra.console.smithi196:power off output: Chassis Power Control: Down/Off
2024-01-17T20:35:13.709 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-17T20:35:13.718 DEBUG:teuthology.orchestra.console.smithi039:power off output: Chassis Power Control: Down/Off
2024-01-17T20:35:13.718 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-17T20:35:13.731 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on
2024-01-17T20:35:13.739 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is on
2024-01-17T20:35:17.736 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-17T20:35:17.742 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-17T20:35:17.845 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on
2024-01-17T20:35:17.851 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is on
2024-01-17T20:35:21.850 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-17T20:35:21.857 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-17T20:35:21.960 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off
2024-01-17T20:35:21.965 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is on
2024-01-17T20:35:22.061 INFO:teuthology.orchestra.console.smithi196:Power off completed
2024-01-17T20:35:22.162 INFO:teuthology.orchestra.console.smithi196:Power on
2024-01-17T20:35:22.162 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-17T20:35:22.183 DEBUG:teuthology.orchestra.console.smithi196:power on output: Chassis Power Control: Up/On
2024-01-17T20:35:22.184 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-17T20:35:22.206 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off
2024-01-17T20:35:25.968 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-17T20:35:26.077 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is off
2024-01-17T20:35:26.178 INFO:teuthology.orchestra.console.smithi039:Power off completed
2024-01-17T20:35:26.207 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-17T20:35:26.279 INFO:teuthology.orchestra.console.smithi039:Power on
2024-01-17T20:35:26.279 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-17T20:35:26.300 DEBUG:teuthology.orchestra.console.smithi039:power on output: Chassis Power Control: Up/On
2024-01-17T20:35:26.300 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-17T20:35:26.316 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off
2024-01-17T20:35:26.322 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is off
2024-01-17T20:35:30.320 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-17T20:35:30.327 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-17T20:35:30.430 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on
2024-01-17T20:35:30.436 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is on
2024-01-17T20:35:30.531 INFO:teuthology.orchestra.console.smithi196:Power on completed
2024-01-17T20:35:30.537 INFO:teuthology.orchestra.console.smithi039:Power on completed
2024-01-17T20:35:30.632 INFO:teuthology.provision.fog.smithi196:Waiting for deploy to finish
2024-01-17T20:35:30.637 INFO:teuthology.provision.fog.smithi039:Waiting for deploy to finish
2024-01-17T20:38:46.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T20:39:05.276 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2024-01-17T20:39:11.283 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T20:39:14.364 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2024-01-17T20:39:16.853 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T20:39:20.368 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T20:39:23.420 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2024-01-17T20:39:29.427 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T20:39:32.508 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2024-01-17T20:39:35.232 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39
2024-01-17T20:39:38.513 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T20:39:41.237 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T20:39:44.316 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39
2024-01-17T20:39:50.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T20:39:53.372 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39
2024-01-17T20:39:59.373 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T20:40:02.428 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39
2024-01-17T20:40:08.432 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T20:40:11.484 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39
2024-01-17T20:40:17.489 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T20:40:20.540 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39
2024-01-17T20:40:26.543 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T20:40:29.596 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39
2024-01-17T20:40:35.603 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T20:40:38.516 WARNING:teuthology.provision.fog.smithi196:timed out
2024-01-17T20:40:44.520 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T20:40:44.755 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-17T20:40:44.756 DEBUG:teuthology.orchestra.run.smithi196:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-17T20:40:45.197 INFO:teuthology.provision.fog.smithi196:Node is ready
2024-01-17T20:40:45.198 DEBUG:teuthology.orchestra.run.smithi196:> hostname
2024-01-17T20:40:45.246 INFO:teuthology.orchestra.run.smithi196.stdout:smithi196.front.sepia.ceph.com
2024-01-17T20:40:45.246 DEBUG:teuthology.orchestra.run.smithi196:> grep smithi196.front.sepia.ceph.com /etc/hosts
2024-01-17T20:40:45.295 INFO:teuthology.orchestra.run.smithi196.stdout:172.21.15.196 smithi196.front.sepia.ceph.com smithi196
2024-01-17T20:40:45.295 DEBUG:teuthology.orchestra.run.smithi196:> sudo hostname smithi196
2024-01-17T20:40:45.412 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/smithi196.front.sepia.ceph.com/smithi196/g' /etc/hosts
2024-01-17T20:40:45.426 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/172.21.15.196/172.21.15.196/g' /etc/hosts
2024-01-17T20:40:45.487 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/smithi196.front.sepia.ceph.com/smithi196/g' /etc/hostname
2024-01-17T20:40:45.547 DEBUG:teuthology.orchestra.run.smithi196:> sudo hostname smithi196
2024-01-17T20:40:45.601 DEBUG:teuthology.orchestra.run.smithi196:> cat /etc/os-release
2024-01-17T20:40:45.654 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-01-17T20:40:45.655 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="Ubuntu"
2024-01-17T20:40:45.655 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="22.04"
2024-01-17T20:40:45.655 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-01-17T20:40:45.655 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_CODENAME=jammy
2024-01-17T20:40:45.655 INFO:teuthology.orchestra.run.smithi196.stdout:ID=ubuntu
2024-01-17T20:40:45.655 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE=debian
2024-01-17T20:40:45.655 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://www.ubuntu.com/"
2024-01-17T20:40:45.655 INFO:teuthology.orchestra.run.smithi196.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-01-17T20:40:45.655 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-01-17T20:40:45.655 INFO:teuthology.orchestra.run.smithi196.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-01-17T20:40:45.655 INFO:teuthology.orchestra.run.smithi196.stdout:UBUNTU_CODENAME=jammy
2024-01-17T20:40:45.656 INFO:teuthology.provision.fog.smithi196:Deploy complete!
2024-01-17T20:40:45.657 DEBUG:teuthology.parallel:result is None
2024-01-17T20:41:35.652 WARNING:teuthology.provision.fog.smithi039:timed out
2024-01-17T20:41:41.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T20:41:42.684 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39
2024-01-17T20:41:48.688 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T20:41:48.864 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-17T20:41:48.864 DEBUG:teuthology.orchestra.run.smithi039:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-17T20:41:49.323 INFO:teuthology.provision.fog.smithi039:Node is ready
2024-01-17T20:41:49.323 DEBUG:teuthology.orchestra.run.smithi039:> hostname
2024-01-17T20:41:49.368 INFO:teuthology.orchestra.run.smithi039.stdout:smithi039.front.sepia.ceph.com
2024-01-17T20:41:49.368 DEBUG:teuthology.orchestra.run.smithi039:> grep smithi039.front.sepia.ceph.com /etc/hosts
2024-01-17T20:41:49.420 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39 smithi039.front.sepia.ceph.com smithi039
2024-01-17T20:41:49.422 DEBUG:teuthology.orchestra.run.smithi039:> sudo hostname smithi039
2024-01-17T20:41:49.570 DEBUG:teuthology.orchestra.run.smithi039:> sudo sed -i -e 's/smithi039.front.sepia.ceph.com/smithi039/g' /etc/hosts
2024-01-17T20:41:49.585 DEBUG:teuthology.orchestra.run.smithi039:> sudo sed -i -e 's/172.21.15.39/172.21.15.39/g' /etc/hosts
2024-01-17T20:41:49.640 DEBUG:teuthology.orchestra.run.smithi039:> sudo sed -i -e 's/smithi039.front.sepia.ceph.com/smithi039/g' /etc/hostname
2024-01-17T20:41:49.696 DEBUG:teuthology.orchestra.run.smithi039:> sudo hostname smithi039
2024-01-17T20:41:49.749 DEBUG:teuthology.orchestra.run.smithi039:> cat /etc/os-release
2024-01-17T20:41:49.797 INFO:teuthology.orchestra.run.smithi039.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-01-17T20:41:49.797 INFO:teuthology.orchestra.run.smithi039.stdout:NAME="Ubuntu"
2024-01-17T20:41:49.797 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION_ID="22.04"
2024-01-17T20:41:49.797 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-01-17T20:41:49.797 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION_CODENAME=jammy
2024-01-17T20:41:49.797 INFO:teuthology.orchestra.run.smithi039.stdout:ID=ubuntu
2024-01-17T20:41:49.797 INFO:teuthology.orchestra.run.smithi039.stdout:ID_LIKE=debian
2024-01-17T20:41:49.797 INFO:teuthology.orchestra.run.smithi039.stdout:HOME_URL="https://www.ubuntu.com/"
2024-01-17T20:41:49.797 INFO:teuthology.orchestra.run.smithi039.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-01-17T20:41:49.798 INFO:teuthology.orchestra.run.smithi039.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-01-17T20:41:49.798 INFO:teuthology.orchestra.run.smithi039.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-01-17T20:41:49.798 INFO:teuthology.orchestra.run.smithi039.stdout:UBUNTU_CODENAME=jammy
2024-01-17T20:41:49.799 INFO:teuthology.provision.fog.smithi039:Deploy complete!
2024-01-17T20:41:49.799 DEBUG:teuthology.parallel:result is None
2024-01-17T20:41:49.983 INFO:teuthology.lock.ops:Checking smithi039.front.sepia.ceph.com
2024-01-17T20:41:49.984 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-17T20:41:50.010 INFO:teuthology.lock.ops:Checking smithi196.front.sepia.ceph.com
2024-01-17T20:41:50.010 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-17T20:41:50.029 INFO:teuthology.lock.ops:Updating [smithi039.front.sepia.ceph.com]: set os type and version on server
2024-01-17T20:41:50.029 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com'
2024-01-17T20:41:50.030 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T20:41:50.109 DEBUG:teuthology.orchestra.run.smithi039:> true
2024-01-17T20:41:50.213 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi039.front.sepia.ceph.com'
2024-01-17T20:41:50.213 DEBUG:teuthology.orchestra.run.smithi039:> uname -m
2024-01-17T20:41:50.260 INFO:teuthology.orchestra.run.smithi039.stdout:x86_64
2024-01-17T20:41:50.260 DEBUG:teuthology.orchestra.run.smithi039:> cat /etc/os-release
2024-01-17T20:41:50.308 INFO:teuthology.orchestra.run.smithi039.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-01-17T20:41:50.308 INFO:teuthology.orchestra.run.smithi039.stdout:NAME="Ubuntu"
2024-01-17T20:41:50.308 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION_ID="22.04"
2024-01-17T20:41:50.308 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-01-17T20:41:50.308 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION_CODENAME=jammy
2024-01-17T20:41:50.308 INFO:teuthology.orchestra.run.smithi039.stdout:ID=ubuntu
2024-01-17T20:41:50.308 INFO:teuthology.orchestra.run.smithi039.stdout:ID_LIKE=debian
2024-01-17T20:41:50.308 INFO:teuthology.orchestra.run.smithi039.stdout:HOME_URL="https://www.ubuntu.com/"
2024-01-17T20:41:50.308 INFO:teuthology.orchestra.run.smithi039.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-01-17T20:41:50.308 INFO:teuthology.orchestra.run.smithi039.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-01-17T20:41:50.309 INFO:teuthology.orchestra.run.smithi039.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-01-17T20:41:50.309 INFO:teuthology.orchestra.run.smithi039.stdout:UBUNTU_CODENAME=jammy
2024-01-17T20:41:50.309 INFO:teuthology.lock.ops:Updating smithi039.front.sepia.ceph.com on lock server
2024-01-17T20:41:50.335 INFO:teuthology.lock.ops:Updating [smithi196.front.sepia.ceph.com]: set os type and version on server
2024-01-17T20:41:50.336 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com'
2024-01-17T20:41:50.336 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T20:41:50.414 DEBUG:teuthology.orchestra.run.smithi196:> true
2024-01-17T20:41:50.660 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi196.front.sepia.ceph.com'
2024-01-17T20:41:50.660 DEBUG:teuthology.orchestra.run.smithi196:> uname -m
2024-01-17T20:41:50.705 INFO:teuthology.orchestra.run.smithi196.stdout:x86_64
2024-01-17T20:41:50.705 DEBUG:teuthology.orchestra.run.smithi196:> cat /etc/os-release
2024-01-17T20:41:50.753 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-01-17T20:41:50.753 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="Ubuntu"
2024-01-17T20:41:50.753 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="22.04"
2024-01-17T20:41:50.753 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-01-17T20:41:50.753 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_CODENAME=jammy
2024-01-17T20:41:50.753 INFO:teuthology.orchestra.run.smithi196.stdout:ID=ubuntu
2024-01-17T20:41:50.753 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE=debian
2024-01-17T20:41:50.754 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://www.ubuntu.com/"
2024-01-17T20:41:50.754 INFO:teuthology.orchestra.run.smithi196.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-01-17T20:41:50.754 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-01-17T20:41:50.754 INFO:teuthology.orchestra.run.smithi196.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-01-17T20:41:50.754 INFO:teuthology.orchestra.run.smithi196.stdout:UBUNTU_CODENAME=jammy
2024-01-17T20:41:50.754 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server
2024-01-17T20:41:50.776 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T20:41:50.867 INFO:teuthology.dispatcher.supervisor:Running job 7519262
2024-01-17T20:41:50.867 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/bin/teuthology -v --owner scheduled_leonidus@teuthology --archive /home/teuthworker/archive/leonidus-2024-01-17_20:20:37-fs-main-distro-default-smithi/7519262 --name leonidus-2024-01-17_20:20:37-fs-main-distro-default-smithi --description fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/3 tasks/fsstress validater/valgrind} -- /home/teuthworker/archive/leonidus-2024-01-17_20:20:37-fs-main-distro-default-smithi/7519262/orig.config.yaml
2024-01-17T20:41:50.870 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/leonidus-2024-01-17_20:20:37-fs-main-distro-default-smithi/7519262
2024-01-17T20:41:50.870 INFO:teuthology.dispatcher.supervisor:Job PID: 2106749
2024-01-17T20:41:50.871 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-01-17T20:43:50.968 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T20:45:51.144 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T20:47:51.312 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T20:49:51.391 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T20:51:51.509 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T20:53:51.663 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T20:55:51.832 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T20:57:51.969 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T20:59:52.081 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T21:01:52.213 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T21:03:52.386 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T21:05:52.549 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T21:07:52.717 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T21:09:52.878 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T21:11:53.026 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T21:13:53.171 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T21:15:53.326 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T21:17:53.494 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T21:19:53.658 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T21:21:53.820 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T21:23:53.972 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T21:25:54.141 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T21:27:54.313 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T21:29:54.476 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T21:31:54.641 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T21:33:54.807 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T21:35:54.938 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T21:37:55.098 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T21:39:55.238 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T21:41:55.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T21:43:55.575 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T21:45:55.731 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T21:47:55.904 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T21:49:56.057 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T21:51:56.213 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T21:53:56.345 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T21:55:56.516 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T21:57:56.636 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T21:59:56.801 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T22:01:56.960 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T22:03:57.116 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T22:05:57.282 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T22:07:57.496 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T22:09:57.633 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T22:11:57.797 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T22:13:57.964 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T22:15:58.132 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T22:17:58.286 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T22:19:58.456 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T22:21:58.623 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T22:23:58.785 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T22:25:59.021 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T22:27:59.185 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T22:29:59.305 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T22:31:59.459 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T22:33:59.627 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T22:35:59.774 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T22:37:59.923 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T22:40:00.081 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T22:42:00.233 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T22:44:00.303 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T22:46:00.470 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T22:48:00.572 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T22:50:00.776 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T22:52:00.972 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T22:54:01.125 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T22:56:01.284 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T22:58:01.437 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T23:00:01.613 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T23:02:01.773 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T23:04:01.921 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T23:06:02.075 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T23:08:02.220 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T23:10:02.382 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T23:12:02.541 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T23:14:02.685 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T23:16:02.843 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T23:18:03.004 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T23:20:03.112 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T23:22:03.197 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T23:24:03.347 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T23:26:03.513 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T23:28:03.837 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T23:30:03.999 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T23:32:04.141 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T23:34:04.286 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T23:36:04.428 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T23:38:04.551 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T23:40:04.715 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T23:42:04.885 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T23:44:05.052 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T23:46:05.216 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T23:48:05.344 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T23:50:05.516 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T23:52:05.645 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T23:54:05.788 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T23:56:05.908 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T23:58:06.075 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T23:58:06.148 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2024-01-17T23:58:06.310 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2024-01-17T23:58:06.310 INFO:teuthology.nuke:Checking targets against current locks
2024-01-17T23:58:06.354 DEBUG:teuthology.nuke:shortname: smithi039
2024-01-17T23:58:06.355 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-17T23:58:06.378 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi039.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-01-17_20:20:37-fs-main-distro-default-smithi/7519262', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-17 20:35:11.898488', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNP0fygyx95NMdInTQYJwlYIA3xbV7lrEafIVcQcg/sMRRHAhZdTQhCDIaHz9m58k3PdSwHSAKDrj/782RFp260='}
2024-01-17T23:58:06.380 DEBUG:teuthology.nuke:shortname: smithi196
2024-01-17T23:58:06.380 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-17T23:58:06.400 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi196.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-01-17_20:20:37-fs-main-distro-default-smithi/7519262', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-17 20:35:11.900319', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNxXjB/yYj5Kjh4EubaMoIXagv7EjBIZm0o3r/P+Mx1QSJoB1bf1/FriVVrR+kGVaxOQGCPOzcLaKn0yhWa+uWE='}
2024-01-17T23:58:06.424 INFO:teuthology.orchestra.console.smithi039:Power off
2024-01-17T23:58:06.424 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-17T23:58:06.445 DEBUG:teuthology.orchestra.console.smithi039:power off output: Chassis Power Control: Down/Off
2024-01-17T23:58:06.446 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-17T23:58:06.456 INFO:teuthology.orchestra.console.smithi196:Power off
2024-01-17T23:58:06.457 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-17T23:58:06.465 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is off
2024-01-17T23:58:06.477 DEBUG:teuthology.orchestra.console.smithi196:power off output: Chassis Power Control: Down/Off
2024-01-17T23:58:06.477 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-17T23:58:06.499 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off
2024-01-17T23:58:06.567 INFO:teuthology.orchestra.console.smithi039:Power off completed
2024-01-17T23:58:06.600 INFO:teuthology.orchestra.console.smithi196:Power off completed
2024-01-17T23:58:06.722 INFO:teuthology.lock.ops:unlocked: smithi039.front.sepia.ceph.com
2024-01-17T23:58:06.755 INFO:teuthology.lock.ops:unlocked: smithi196.front.sepia.ceph.com