2023-07-15T14:56:22.036 INFO:root:teuthology version: 0.0.1.dev147+gff9991b 2023-07-15T14:56:22.038 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-15T14:56:22.039 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-15T14:56:22.165 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f56bd3aa820>, signals=[15]) 2023-07-15T14:56:22.166 INFO:teuthology.lock.ops:Start node 'smithi139.front.sepia.ceph.com' reimaging 2023-07-15T14:56:22.166 INFO:teuthology.lock.ops:Updating [smithi139.front.sepia.ceph.com]: reset os type and version on server 2023-07-15T14:56:22.167 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server 2023-07-15T14:56:22.195 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /host {"name": "smithi139"} 2023-07-15T14:56:22.268 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-07-15T14:56:22.309 DEBUG:teuthology.provision.fog.smithi139:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-07-15T14:56:22.310 DEBUG:teuthology.provision.fog.smithi139:FOG request: PUT /host/244 {"imageID": 6} 2023-07-15T14:56:22.356 INFO:teuthology.provision.fog.smithi139:Scheduling deploy of ubuntu 22.04 2023-07-15T14:56:22.356 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-15T14:56:22.447 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /tasktype {"name": "deploy"} 2023-07-15T14:56:22.487 DEBUG:teuthology.provision.fog.smithi139:FOG request: POST /host/244/task {"taskTypeID": 1} 2023-07-15T14:56:22.553 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-15T14:56:22.689 INFO:teuthology.orchestra.console:Power off smithi139 2023-07-15T14:56:22.690 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-15T14:56:22.717 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T14:56:26.744 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T14:56:30.856 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T14:56:31.067 INFO:teuthology.orchestra.console:Power off for smithi139 completed 2023-07-15T14:56:31.168 INFO:teuthology.orchestra.console:Power on smithi139 2023-07-15T14:56:31.168 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-15T14:56:31.188 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T14:56:35.214 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T14:56:39.328 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T14:56:39.579 INFO:teuthology.orchestra.console:Power on for smithi139 completed 2023-07-15T14:56:39.681 INFO:teuthology.provision.fog.smithi139:Waiting for deploy to finish 2023-07-15T14:56:39.681 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-15T14:56:54.756 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-15T14:57:09.848 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-15T14:57:24.928 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-15T14:57:40.000 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-15T14:57:55.064 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-15T14:58:10.132 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-15T14:58:25.216 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-15T14:58:40.298 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-15T14:58:55.387 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-15T14:59:10.472 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-15T14:59:25.540 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-15T14:59:40.615 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-15T14:59:40.672 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T14:59:43.732 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-07-15T14:59:49.738 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T14:59:52.816 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-07-15T14:59:58.820 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T15:00:01.872 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-07-15T15:00:07.876 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T15:00:10.928 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-07-15T15:00:16.932 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T15:00:19.984 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-07-15T15:00:25.989 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T15:00:29.040 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-07-15T15:00:35.045 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T15:00:38.096 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-07-15T15:00:44.101 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T15:01:15.504 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-07-15T15:01:21.508 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T15:01:21.510 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-07-15T15:01:27.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T15:01:27.518 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-07-15T15:01:33.524 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T15:01:33.526 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-07-15T15:01:39.532 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T15:01:39.534 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-07-15T15:01:45.540 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T15:01:45.736 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-15T15:01:45.737 DEBUG:teuthology.orchestra.run.smithi139:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-15T15:01:46.185 INFO:teuthology.provision.fog.smithi139:Node is ready 2023-07-15T15:01:46.186 DEBUG:teuthology.orchestra.run.smithi139:> hostname 2023-07-15T15:01:46.231 INFO:teuthology.orchestra.run.smithi139.stdout:smithi139.front.sepia.ceph.com 2023-07-15T15:01:46.232 DEBUG:teuthology.orchestra.run.smithi139:> grep smithi139.front.sepia.ceph.com /etc/hosts 2023-07-15T15:01:46.279 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139 smithi139.front.sepia.ceph.com smithi139 2023-07-15T15:01:46.279 DEBUG:teuthology.orchestra.run.smithi139:> sudo hostname smithi139 2023-07-15T15:01:46.410 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/smithi139.front.sepia.ceph.com/smithi139/g' /etc/hosts 2023-07-15T15:01:46.424 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/172.21.15.139/172.21.15.139/g' /etc/hosts 2023-07-15T15:01:46.479 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/smithi139.front.sepia.ceph.com/smithi139/g' /etc/hostname 2023-07-15T15:01:46.534 DEBUG:teuthology.orchestra.run.smithi139:> sudo hostname smithi139 2023-07-15T15:01:46.589 DEBUG:teuthology.orchestra.run.smithi139:> cat /etc/os-release 2023-07-15T15:01:46.639 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-07-15T15:01:46.639 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="Ubuntu" 2023-07-15T15:01:46.640 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="22.04" 2023-07-15T15:01:46.640 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-07-15T15:01:46.640 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_CODENAME=jammy 2023-07-15T15:01:46.640 INFO:teuthology.orchestra.run.smithi139.stdout:ID=ubuntu 2023-07-15T15:01:46.640 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE=debian 2023-07-15T15:01:46.640 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-15T15:01:46.641 INFO:teuthology.orchestra.run.smithi139.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-15T15:01:46.641 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-15T15:01:46.641 INFO:teuthology.orchestra.run.smithi139.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-15T15:01:46.641 INFO:teuthology.orchestra.run.smithi139.stdout:UBUNTU_CODENAME=jammy 2023-07-15T15:01:46.642 INFO:teuthology.provision.fog.smithi139:Deploy complete! 2023-07-15T15:01:46.643 DEBUG:teuthology.parallel:result is None 2023-07-15T15:01:46.778 INFO:teuthology.lock.ops:Checking smithi139.front.sepia.ceph.com 2023-07-15T15:01:46.779 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-15T15:01:46.805 INFO:teuthology.lock.ops:Updating [smithi139.front.sepia.ceph.com]: set os type and version on server 2023-07-15T15:01:46.806 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2023-07-15T15:01:46.806 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T15:01:46.880 DEBUG:teuthology.orchestra.run.smithi139:> true 2023-07-15T15:01:46.976 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi139.front.sepia.ceph.com' 2023-07-15T15:01:46.977 DEBUG:teuthology.orchestra.run.smithi139:> uname -m 2023-07-15T15:01:47.027 INFO:teuthology.orchestra.run.smithi139.stdout:x86_64 2023-07-15T15:01:47.028 DEBUG:teuthology.orchestra.run.smithi139:> cat /etc/os-release 2023-07-15T15:01:47.079 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-07-15T15:01:47.080 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="Ubuntu" 2023-07-15T15:01:47.080 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="22.04" 2023-07-15T15:01:47.080 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-07-15T15:01:47.080 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_CODENAME=jammy 2023-07-15T15:01:47.081 INFO:teuthology.orchestra.run.smithi139.stdout:ID=ubuntu 2023-07-15T15:01:47.081 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE=debian 2023-07-15T15:01:47.081 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-15T15:01:47.081 INFO:teuthology.orchestra.run.smithi139.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-15T15:01:47.081 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-15T15:01:47.082 INFO:teuthology.orchestra.run.smithi139.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-15T15:01:47.082 INFO:teuthology.orchestra.run.smithi139.stdout:UBUNTU_CODENAME=jammy 2023-07-15T15:01:47.082 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server 2023-07-15T15:01:47.112 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-15T15:01:47.113 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-15T15:01:47.212 INFO:teuthology.dispatcher.supervisor:Running job 7339040 2023-07-15T15:01:47.212 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-07-14_23:46:34-rados-reef-distro-default-smithi/7339040 --name yuriw-2023-07-14_23:46:34-rados-reef-distro-default-smithi --description rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_read} -- /home/teuthworker/archive/yuriw-2023-07-14_23:46:34-rados-reef-distro-default-smithi/7339040/orig.config.yaml 2023-07-15T15:01:47.216 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-07-14_23:46:34-rados-reef-distro-default-smithi/7339040 2023-07-15T15:01:47.217 INFO:teuthology.dispatcher.supervisor:Job PID: 16490 2023-07-15T15:01:47.217 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-15T15:03:47.316 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-15T15:03:47.318 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-15T15:05:47.504 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-15T15:05:47.505 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-15T15:07:47.677 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-15T15:07:47.678 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-15T15:09:47.853 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-15T15:09:47.854 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-15T15:11:48.025 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-15T15:11:48.026 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-15T15:13:48.205 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-15T15:13:48.205 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-15T15:15:48.377 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-15T15:15:48.378 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-15T15:17:48.554 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-15T15:17:48.555 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-15T15:19:48.737 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-15T15:19:48.737 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-15T15:19:48.810 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-15T15:19:48.911 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2023-07-15T15:19:48.961 INFO:teuthology.lock.ops:unlocked: smithi139.front.sepia.ceph.com