2023-07-25T18:10:59.198 INFO:root:teuthology version: 0.0.1.dev160+g407880c
2023-07-25T18:10:59.200 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-25T18:10:59.201 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-25T18:10:59.334 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7ff8f2789d60>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7ff8f2823280>, signals=[15])
2023-07-25T18:10:59.336 INFO:teuthology.lock.ops:Start node 'smithi144.front.sepia.ceph.com' reimaging
2023-07-25T18:10:59.336 INFO:teuthology.lock.ops:Updating [smithi144.front.sepia.ceph.com]: reset os type and version on server
2023-07-25T18:10:59.337 INFO:teuthology.lock.ops:Updating smithi144.front.sepia.ceph.com on lock server
2023-07-25T18:10:59.363 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /host {"name": "smithi144"}
2023-07-25T18:10:59.440 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /image {"name": "smithi_ubuntu_22.04"}
2023-07-25T18:10:59.480 DEBUG:teuthology.provision.fog.smithi144:Requesting image smithi_ubuntu_22.04 (ID 6)
2023-07-25T18:10:59.481 DEBUG:teuthology.provision.fog.smithi144:FOG request: PUT /host/249 {"imageID": 6}
2023-07-25T18:10:59.527 INFO:teuthology.provision.fog.smithi144:Scheduling deploy of ubuntu 22.04
2023-07-25T18:10:59.527 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None
2023-07-25T18:10:59.583 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /tasktype {"name": "deploy"}
2023-07-25T18:10:59.616 DEBUG:teuthology.provision.fog.smithi144:FOG request: POST /host/249/task {"taskTypeID": 1}
2023-07-25T18:10:59.673 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None
2023-07-25T18:10:59.772 INFO:teuthology.orchestra.console:Power off smithi144
2023-07-25T18:10:59.773 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-25T18:10:59.796 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off
2023-07-25T18:10:59.797 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T18:10:59.820 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on
2023-07-25T18:11:03.825 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T18:11:03.935 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on
2023-07-25T18:11:07.938 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T18:11:08.048 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on
2023-07-25T18:11:12.054 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T18:11:12.165 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off
2023-07-25T18:11:12.266 INFO:teuthology.orchestra.console:Power off for smithi144 completed
2023-07-25T18:11:12.367 INFO:teuthology.orchestra.console:Power on smithi144
2023-07-25T18:11:12.367 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-25T18:11:12.390 DEBUG:teuthology.orchestra.console:power on output: Chassis Power Control: Up/On
2023-07-25T18:11:12.391 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T18:11:12.411 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off
2023-07-25T18:11:16.416 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T18:11:16.526 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on
2023-07-25T18:11:16.627 INFO:teuthology.orchestra.console:Power on for smithi144 completed
2023-07-25T18:11:16.728 INFO:teuthology.provision.fog.smithi144:Waiting for deploy to finish
2023-07-25T18:11:16.729 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None
2023-07-25T18:11:31.808 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None
2023-07-25T18:11:46.884 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None
2023-07-25T18:12:01.964 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None
2023-07-25T18:12:17.050 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None
2023-07-25T18:12:32.124 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None
2023-07-25T18:12:47.192 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None
2023-07-25T18:13:02.260 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None
2023-07-25T18:13:17.336 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None
2023-07-25T18:13:32.410 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None
2023-07-25T18:13:47.480 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None
2023-07-25T18:14:02.548 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None
2023-07-25T18:14:17.640 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None
2023-07-25T18:14:32.713 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None
2023-07-25T18:14:32.786 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-25T18:14:35.860 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144
2023-07-25T18:14:41.862 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-25T18:14:44.912 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144
2023-07-25T18:14:50.916 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-25T18:14:53.968 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144
2023-07-25T18:14:59.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-25T18:15:03.028 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144
2023-07-25T18:15:09.035 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-25T18:15:12.112 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144
2023-07-25T18:15:18.119 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-25T18:15:21.200 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144
2023-07-25T18:15:27.207 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-25T18:15:30.256 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144
2023-07-25T18:15:36.260 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-25T18:16:36.321 WARNING:teuthology.provision.fog.smithi144:timed out
2023-07-25T18:16:42.328 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-25T18:16:42.523 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-25T18:16:42.524 DEBUG:teuthology.orchestra.run.smithi144:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-25T18:16:42.946 INFO:teuthology.provision.fog.smithi144:Node is ready
2023-07-25T18:16:42.947 DEBUG:teuthology.orchestra.run.smithi144:> hostname
2023-07-25T18:16:42.995 INFO:teuthology.orchestra.run.smithi144.stdout:smithi144.front.sepia.ceph.com
2023-07-25T18:16:42.995 DEBUG:teuthology.orchestra.run.smithi144:> grep smithi144.front.sepia.ceph.com /etc/hosts
2023-07-25T18:16:43.043 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.15.144 smithi144.front.sepia.ceph.com smithi144
2023-07-25T18:16:43.043 DEBUG:teuthology.orchestra.run.smithi144:> sudo hostname smithi144
2023-07-25T18:16:43.141 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i -e 's/smithi144.front.sepia.ceph.com/smithi144/g' /etc/hosts
2023-07-25T18:16:43.156 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i -e 's/172.21.15.144/172.21.15.144/g' /etc/hosts
2023-07-25T18:16:43.215 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i -e 's/smithi144.front.sepia.ceph.com/smithi144/g' /etc/hostname
2023-07-25T18:16:43.270 DEBUG:teuthology.orchestra.run.smithi144:> sudo hostname smithi144
2023-07-25T18:16:43.325 DEBUG:teuthology.orchestra.run.smithi144:> cat /etc/os-release
2023-07-25T18:16:43.375 INFO:teuthology.orchestra.run.smithi144.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-07-25T18:16:43.375 INFO:teuthology.orchestra.run.smithi144.stdout:NAME="Ubuntu"
2023-07-25T18:16:43.375 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION_ID="22.04"
2023-07-25T18:16:43.376 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-07-25T18:16:43.376 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION_CODENAME=jammy
2023-07-25T18:16:43.377 INFO:teuthology.orchestra.run.smithi144.stdout:ID=ubuntu
2023-07-25T18:16:43.377 INFO:teuthology.orchestra.run.smithi144.stdout:ID_LIKE=debian
2023-07-25T18:16:43.377 INFO:teuthology.orchestra.run.smithi144.stdout:HOME_URL="https://www.ubuntu.com/"
2023-07-25T18:16:43.377 INFO:teuthology.orchestra.run.smithi144.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-07-25T18:16:43.377 INFO:teuthology.orchestra.run.smithi144.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-07-25T18:16:43.377 INFO:teuthology.orchestra.run.smithi144.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-07-25T18:16:43.379 INFO:teuthology.orchestra.run.smithi144.stdout:UBUNTU_CODENAME=jammy
2023-07-25T18:16:43.380 INFO:teuthology.provision.fog.smithi144:Deploy complete!
2023-07-25T18:16:43.381 DEBUG:teuthology.parallel:result is None
2023-07-25T18:16:43.512 INFO:teuthology.lock.ops:Checking smithi144.front.sepia.ceph.com
2023-07-25T18:16:43.513 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-25T18:16:43.544 INFO:teuthology.lock.ops:Updating [smithi144.front.sepia.ceph.com]: set os type and version on server
2023-07-25T18:16:43.545 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com'
2023-07-25T18:16:43.546 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-25T18:16:43.618 DEBUG:teuthology.orchestra.run.smithi144:> true
2023-07-25T18:16:43.724 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi144.front.sepia.ceph.com'
2023-07-25T18:16:43.725 DEBUG:teuthology.orchestra.run.smithi144:> uname -m
2023-07-25T18:16:43.771 INFO:teuthology.orchestra.run.smithi144.stdout:x86_64
2023-07-25T18:16:43.771 DEBUG:teuthology.orchestra.run.smithi144:> cat /etc/os-release
2023-07-25T18:16:43.823 INFO:teuthology.orchestra.run.smithi144.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-07-25T18:16:43.823 INFO:teuthology.orchestra.run.smithi144.stdout:NAME="Ubuntu"
2023-07-25T18:16:43.823 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION_ID="22.04"
2023-07-25T18:16:43.824 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-07-25T18:16:43.824 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION_CODENAME=jammy
2023-07-25T18:16:43.824 INFO:teuthology.orchestra.run.smithi144.stdout:ID=ubuntu
2023-07-25T18:16:43.824 INFO:teuthology.orchestra.run.smithi144.stdout:ID_LIKE=debian
2023-07-25T18:16:43.824 INFO:teuthology.orchestra.run.smithi144.stdout:HOME_URL="https://www.ubuntu.com/"
2023-07-25T18:16:43.824 INFO:teuthology.orchestra.run.smithi144.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-07-25T18:16:43.824 INFO:teuthology.orchestra.run.smithi144.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-07-25T18:16:43.825 INFO:teuthology.orchestra.run.smithi144.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-07-25T18:16:43.825 INFO:teuthology.orchestra.run.smithi144.stdout:UBUNTU_CODENAME=jammy
2023-07-25T18:16:43.825 INFO:teuthology.lock.ops:Updating smithi144.front.sepia.ceph.com on lock server
2023-07-25T18:16:43.852 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-25T18:16:43.853 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-25T18:16:43.959 INFO:teuthology.dispatcher.supervisor:Running job 7351122
2023-07-25T18:16:43.959 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-07-25_14:29:32-rados-reef-release-distro-default-smithi/7351122 --name yuriw-2023-07-25_14:29:32-rados-reef-release-distro-default-smithi --description rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} -- /home/teuthworker/archive/yuriw-2023-07-25_14:29:32-rados-reef-release-distro-default-smithi/7351122/orig.config.yaml
2023-07-25T18:16:43.963 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-07-25_14:29:32-rados-reef-release-distro-default-smithi/7351122
2023-07-25T18:16:43.963 INFO:teuthology.dispatcher.supervisor:Job PID: 29480
2023-07-25T18:16:43.964 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-07-25T18:18:44.064 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-25T18:18:44.065 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-25T18:20:44.249 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-25T18:20:44.250 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-25T18:22:44.413 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-25T18:22:44.413 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-25T18:24:44.593 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-25T18:24:44.593 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-25T18:26:44.757 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-25T18:26:44.758 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-25T18:28:44.933 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-25T18:28:44.933 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-25T18:30:45.109 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-25T18:30:45.110 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-25T18:32:45.281 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-25T18:32:45.282 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-25T18:34:45.447 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-25T18:34:45.447 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-25T18:36:45.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-25T18:36:45.723 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-25T18:36:45.799 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-07-25T18:36:45.883 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2023-07-25T18:36:45.931 INFO:teuthology.lock.ops:unlocked: smithi144.front.sepia.ceph.com