2024-01-24T03:19:18.698 INFO:root:teuthology version: 0.0.1.dev251+gc856e0f
2024-01-24T03:19:18.698 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T03:19:18.805 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f05b7984f70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f05b892bc10>, signals=[15])
2024-01-24T03:19:18.806 INFO:teuthology.lock.ops:Start node 'smithi156.front.sepia.ceph.com' reimaging
2024-01-24T03:19:18.806 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: reset os type and version on server
2024-01-24T03:19:18.806 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server
2024-01-24T03:19:18.939 DEBUG:teuthology.provision.fog.smithi156:Requesting image smithi_ubuntu_22.04 (ID 6)
2024-01-24T03:19:18.990 INFO:teuthology.provision.fog.smithi156:Scheduling deploy of ubuntu 22.04
2024-01-24T03:19:19.278 INFO:teuthology.orchestra.console.smithi156:Power off
2024-01-24T03:19:19.279 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-24T03:19:19.303 DEBUG:teuthology.orchestra.console.smithi156:power off output: Chassis Power Control: Down/Off
2024-01-24T03:19:19.303 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T03:19:19.325 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on
2024-01-24T03:19:23.328 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T03:19:23.436 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on
2024-01-24T03:19:27.440 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T03:19:27.549 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on
2024-01-24T03:19:31.552 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T03:19:31.661 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off
2024-01-24T03:19:31.762 INFO:teuthology.orchestra.console.smithi156:Power off completed
2024-01-24T03:19:31.862 INFO:teuthology.orchestra.console.smithi156:Power on
2024-01-24T03:19:31.863 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-24T03:19:31.884 DEBUG:teuthology.orchestra.console.smithi156:power on output: Chassis Power Control: Up/On
2024-01-24T03:19:31.885 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T03:19:31.907 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off
2024-01-24T03:19:35.912 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T03:19:36.021 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off
2024-01-24T03:19:40.024 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T03:19:40.132 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on
2024-01-24T03:19:40.233 INFO:teuthology.orchestra.console.smithi156:Power on completed
2024-01-24T03:19:40.334 INFO:teuthology.provision.fog.smithi156:Waiting for deploy to finish
2024-01-24T03:23:11.677 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T03:23:14.748 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156
2024-01-24T03:23:20.755 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T03:23:23.840 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156
2024-01-24T03:23:29.845 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T03:23:32.924 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156
2024-01-24T03:23:38.930 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T03:23:42.012 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156
2024-01-24T03:23:48.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T03:23:51.068 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156
2024-01-24T03:23:57.072 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T03:24:00.124 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156
2024-01-24T03:24:06.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T03:25:06.193 WARNING:teuthology.provision.fog.smithi156:timed out
2024-01-24T03:25:12.201 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T03:25:12.363 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-24T03:25:12.365 DEBUG:teuthology.orchestra.run.smithi156:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-24T03:25:12.846 INFO:teuthology.provision.fog.smithi156:Node is ready
2024-01-24T03:25:12.846 DEBUG:teuthology.orchestra.run.smithi156:> hostname
2024-01-24T03:25:12.893 INFO:teuthology.orchestra.run.smithi156.stdout:smithi156.front.sepia.ceph.com
2024-01-24T03:25:12.893 DEBUG:teuthology.orchestra.run.smithi156:> grep smithi156.front.sepia.ceph.com /etc/hosts
2024-01-24T03:25:12.942 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.15.156 smithi156.front.sepia.ceph.com smithi156
2024-01-24T03:25:12.942 DEBUG:teuthology.orchestra.run.smithi156:> sudo hostname smithi156
2024-01-24T03:25:13.067 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/smithi156.front.sepia.ceph.com/smithi156/g' /etc/hosts
2024-01-24T03:25:13.080 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/172.21.15.156/172.21.15.156/g' /etc/hosts
2024-01-24T03:25:13.137 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/smithi156.front.sepia.ceph.com/smithi156/g' /etc/hostname
2024-01-24T03:25:13.195 DEBUG:teuthology.orchestra.run.smithi156:> sudo hostname smithi156
2024-01-24T03:25:13.249 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release
2024-01-24T03:25:13.297 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-01-24T03:25:13.297 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="Ubuntu"
2024-01-24T03:25:13.297 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="22.04"
2024-01-24T03:25:13.297 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-01-24T03:25:13.297 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_CODENAME=jammy
2024-01-24T03:25:13.297 INFO:teuthology.orchestra.run.smithi156.stdout:ID=ubuntu
2024-01-24T03:25:13.297 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE=debian
2024-01-24T03:25:13.297 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://www.ubuntu.com/"
2024-01-24T03:25:13.298 INFO:teuthology.orchestra.run.smithi156.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-01-24T03:25:13.298 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-01-24T03:25:13.298 INFO:teuthology.orchestra.run.smithi156.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-01-24T03:25:13.298 INFO:teuthology.orchestra.run.smithi156.stdout:UBUNTU_CODENAME=jammy
2024-01-24T03:25:13.298 INFO:teuthology.provision.fog.smithi156:Deploy complete!
2024-01-24T03:25:13.300 DEBUG:teuthology.parallel:result is None
2024-01-24T03:25:13.427 INFO:teuthology.lock.ops:Checking smithi156.front.sepia.ceph.com
2024-01-24T03:25:13.428 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-24T03:25:13.454 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: set os type and version on server
2024-01-24T03:25:13.454 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com'
2024-01-24T03:25:13.455 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T03:25:13.530 DEBUG:teuthology.orchestra.run.smithi156:> true
2024-01-24T03:25:13.628 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi156.front.sepia.ceph.com'
2024-01-24T03:25:13.628 DEBUG:teuthology.orchestra.run.smithi156:> uname -m
2024-01-24T03:25:13.672 INFO:teuthology.orchestra.run.smithi156.stdout:x86_64
2024-01-24T03:25:13.673 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release
2024-01-24T03:25:13.720 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-01-24T03:25:13.720 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="Ubuntu"
2024-01-24T03:25:13.720 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="22.04"
2024-01-24T03:25:13.720 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-01-24T03:25:13.720 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_CODENAME=jammy
2024-01-24T03:25:13.721 INFO:teuthology.orchestra.run.smithi156.stdout:ID=ubuntu
2024-01-24T03:25:13.721 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE=debian
2024-01-24T03:25:13.721 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://www.ubuntu.com/"
2024-01-24T03:25:13.721 INFO:teuthology.orchestra.run.smithi156.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-01-24T03:25:13.721 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-01-24T03:25:13.721 INFO:teuthology.orchestra.run.smithi156.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-01-24T03:25:13.721 INFO:teuthology.orchestra.run.smithi156.stdout:UBUNTU_CODENAME=jammy
2024-01-24T03:25:13.721 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server
2024-01-24T03:25:13.745 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T03:25:13.838 INFO:teuthology.dispatcher.supervisor:Running job 7530033
2024-01-24T03:25:13.838 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-01-23_23:02:31-rados-wip-yuri5-testing-2024-01-23-0805-distro-default-smithi/7530033 --name yuriw-2024-01-23_23:02:31-rados-wip-yuri5-testing-2024-01-23-0805-distro-default-smithi --description rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{ubuntu_latest}} -- /home/teuthworker/archive/yuriw-2024-01-23_23:02:31-rados-wip-yuri5-testing-2024-01-23-0805-distro-default-smithi/7530033/orig.config.yaml
2024-01-24T03:25:13.842 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-01-23_23:02:31-rados-wip-yuri5-testing-2024-01-23-0805-distro-default-smithi/7530033
2024-01-24T03:25:13.843 INFO:teuthology.dispatcher.supervisor:Job PID: 4008430
2024-01-24T03:25:13.843 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-01-24T03:27:13.941 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T03:29:14.118 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T03:31:14.292 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T03:33:14.477 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T03:35:14.658 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T03:37:14.819 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T03:39:14.988 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T03:41:15.148 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T03:43:15.317 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T03:45:15.485 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T03:47:15.652 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T03:49:15.829 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T03:51:15.998 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T03:53:16.164 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T03:55:16.336 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T03:57:16.514 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T03:59:16.680 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T04:01:16.852 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T04:03:17.028 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T04:05:17.204 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T04:07:17.372 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T04:09:17.548 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T04:09:17.622 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2024-01-24T04:09:17.681 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2024-01-24T04:09:17.681 INFO:teuthology.nuke:Checking targets against current locks
2024-01-24T04:09:17.729 DEBUG:teuthology.nuke:shortname: smithi156
2024-01-24T04:09:17.730 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-24T04:09:17.753 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi156.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-23_23:02:31-rados-wip-yuri5-testing-2024-01-23-0805-distro-default-smithi/7530033', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-24 03:19:17.651813', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO76i4k5JhaOlj2NrdDsr2k6kWST7CTGMT5bxL88IsUM1LYcEUXZ1hfE5V+GSAxvnngexcfHzIpXBfD1n9HPptQ='}
2024-01-24T04:09:17.805 INFO:teuthology.orchestra.console.smithi156:Power off
2024-01-24T04:09:17.806 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-24T04:09:17.826 DEBUG:teuthology.orchestra.console.smithi156:power off output: Chassis Power Control: Down/Off
2024-01-24T04:09:17.827 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T04:09:17.847 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off
2024-01-24T04:09:17.948 INFO:teuthology.orchestra.console.smithi156:Power off completed
2024-01-24T04:09:18.103 INFO:teuthology.lock.ops:unlocked: smithi156.front.sepia.ceph.com