2023-11-08T01:46:48.971 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-08T01:46:48.973 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T01:46:49.087 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7efdadbe2670>, signals=[15]) 2023-11-08T01:46:49.089 INFO:teuthology.lock.ops:Start node 'smithi157.front.sepia.ceph.com' reimaging 2023-11-08T01:46:49.090 INFO:teuthology.lock.ops:Updating [smithi157.front.sepia.ceph.com]: reset os type and version on server 2023-11-08T01:46:49.090 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2023-11-08T01:46:49.118 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /host {"name": "smithi157"} 2023-11-08T01:46:49.182 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-11-08T01:46:49.227 DEBUG:teuthology.provision.fog.smithi157:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-11-08T01:46:49.227 DEBUG:teuthology.provision.fog.smithi157:FOG request: PUT /host/262 {"imageID": 2} 2023-11-08T01:46:49.276 INFO:teuthology.provision.fog.smithi157:Scheduling deploy of ubuntu 20.04 2023-11-08T01:46:49.276 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-11-08T01:46:49.337 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /tasktype {"name": "deploy"} 2023-11-08T01:46:49.374 DEBUG:teuthology.provision.fog.smithi157:FOG request: POST /host/262/task {"taskTypeID": 1} 2023-11-08T01:46:49.444 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-11-08T01:46:49.544 INFO:teuthology.orchestra.console.smithi157:Power off 2023-11-08T01:46:49.545 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-08T01:46:49.568 DEBUG:teuthology.orchestra.console.smithi157:power off output: Chassis Power Control: Down/Off 2023-11-08T01:46:49.569 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T01:46:49.592 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on 2023-11-08T01:46:53.594 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T01:46:53.702 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on 2023-11-08T01:46:57.706 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T01:46:57.815 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off 2023-11-08T01:46:57.916 INFO:teuthology.orchestra.console.smithi157:Power off completed 2023-11-08T01:46:58.017 INFO:teuthology.orchestra.console.smithi157:Power on 2023-11-08T01:46:58.018 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-08T01:46:58.039 DEBUG:teuthology.orchestra.console.smithi157:power on output: Chassis Power Control: Up/On 2023-11-08T01:46:58.040 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T01:46:58.061 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off 2023-11-08T01:47:02.066 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T01:47:02.175 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off 2023-11-08T01:47:06.180 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T01:47:06.288 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on 2023-11-08T01:47:06.389 INFO:teuthology.orchestra.console.smithi157:Power on completed 2023-11-08T01:47:06.490 INFO:teuthology.provision.fog.smithi157:Waiting for deploy to finish 2023-11-08T01:47:06.490 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-11-08T01:47:21.569 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-11-08T01:47:36.646 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-11-08T01:47:51.726 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-11-08T01:48:06.806 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-11-08T01:48:21.886 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-11-08T01:48:36.970 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-11-08T01:48:52.042 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-11-08T01:49:07.122 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-11-08T01:49:22.192 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-11-08T01:49:37.262 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-11-08T01:49:52.338 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-11-08T01:50:07.406 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-11-08T01:50:22.467 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-11-08T01:50:37.545 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-11-08T01:50:52.626 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-11-08T01:51:07.722 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-11-08T01:51:07.791 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T01:51:10.842 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-11-08T01:51:16.846 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T01:51:19.898 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-11-08T01:51:25.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T01:51:28.986 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-11-08T01:51:34.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T01:51:38.042 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-11-08T01:51:44.046 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T01:51:47.098 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-11-08T01:51:53.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T01:51:56.154 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-11-08T01:52:02.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T01:52:05.214 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-11-08T01:52:11.218 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T01:52:14.298 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-11-08T01:52:20.305 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T01:52:23.390 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-11-08T01:52:29.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T01:53:29.455 WARNING:teuthology.provision.fog.smithi157:timed out 2023-11-08T01:53:35.463 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T01:53:35.627 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-08T01:53:35.628 DEBUG:teuthology.orchestra.run.smithi157:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-08T01:53:36.050 INFO:teuthology.provision.fog.smithi157:Node is ready 2023-11-08T01:53:36.051 DEBUG:teuthology.orchestra.run.smithi157:> hostname 2023-11-08T01:53:36.098 INFO:teuthology.orchestra.run.smithi157.stdout:smithi157.front.sepia.ceph.com 2023-11-08T01:53:36.098 DEBUG:teuthology.orchestra.run.smithi157:> grep smithi157.front.sepia.ceph.com /etc/hosts 2023-11-08T01:53:36.105 INFO:teuthology.orchestra.run.smithi157.stdout:172.21.15.157 smithi157.front.sepia.ceph.com smithi157 2023-11-08T01:53:36.106 DEBUG:teuthology.orchestra.run.smithi157:> sudo hostname smithi157 2023-11-08T01:53:36.185 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/smithi157.front.sepia.ceph.com/smithi157/g' /etc/hosts 2023-11-08T01:53:36.204 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/172.21.15.157/172.21.15.157/g' /etc/hosts 2023-11-08T01:53:36.215 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/smithi157.front.sepia.ceph.com/smithi157/g' /etc/hostname 2023-11-08T01:53:36.225 DEBUG:teuthology.orchestra.run.smithi157:> sudo hostname smithi157 2023-11-08T01:53:36.282 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release 2023-11-08T01:53:36.290 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="Ubuntu" 2023-11-08T01:53:36.290 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-11-08T01:53:36.290 INFO:teuthology.orchestra.run.smithi157.stdout:ID=ubuntu 2023-11-08T01:53:36.291 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE=debian 2023-11-08T01:53:36.291 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-11-08T01:53:36.291 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="20.04" 2023-11-08T01:53:36.291 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-08T01:53:36.291 INFO:teuthology.orchestra.run.smithi157.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-08T01:53:36.291 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-08T01:53:36.292 INFO:teuthology.orchestra.run.smithi157.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-08T01:53:36.292 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_CODENAME=focal 2023-11-08T01:53:36.292 INFO:teuthology.orchestra.run.smithi157.stdout:UBUNTU_CODENAME=focal 2023-11-08T01:53:36.293 INFO:teuthology.provision.fog.smithi157:Deploy complete! 2023-11-08T01:53:36.294 DEBUG:teuthology.parallel:result is None 2023-11-08T01:53:36.447 INFO:teuthology.lock.ops:Checking smithi157.front.sepia.ceph.com 2023-11-08T01:53:36.447 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-08T01:53:36.470 INFO:teuthology.lock.ops:Updating [smithi157.front.sepia.ceph.com]: set os type and version on server 2023-11-08T01:53:36.471 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2023-11-08T01:53:36.472 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T01:53:36.522 DEBUG:teuthology.orchestra.run.smithi157:> true 2023-11-08T01:53:36.644 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi157.front.sepia.ceph.com' 2023-11-08T01:53:36.644 DEBUG:teuthology.orchestra.run.smithi157:> uname -m 2023-11-08T01:53:36.650 INFO:teuthology.orchestra.run.smithi157.stdout:x86_64 2023-11-08T01:53:36.651 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release 2023-11-08T01:53:36.657 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="Ubuntu" 2023-11-08T01:53:36.657 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-11-08T01:53:36.657 INFO:teuthology.orchestra.run.smithi157.stdout:ID=ubuntu 2023-11-08T01:53:36.657 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE=debian 2023-11-08T01:53:36.658 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-11-08T01:53:36.658 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="20.04" 2023-11-08T01:53:36.658 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-08T01:53:36.658 INFO:teuthology.orchestra.run.smithi157.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-08T01:53:36.658 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-08T01:53:36.659 INFO:teuthology.orchestra.run.smithi157.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-08T01:53:36.659 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_CODENAME=focal 2023-11-08T01:53:36.659 INFO:teuthology.orchestra.run.smithi157.stdout:UBUNTU_CODENAME=focal 2023-11-08T01:53:36.659 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2023-11-08T01:53:36.677 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T01:53:36.766 INFO:teuthology.dispatcher.supervisor:Running job 7451217 2023-11-08T01:53:36.766 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-11-07_19:34:21-rados-wip-yuri3-testing-2023-11-07-0801-pacific-distro-default-smithi/7451217 --name yuriw-2023-11-07_19:34:21-rados-wip-yuri3-testing-2023-11-07-0801-pacific-distro-default-smithi --description rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} -- /home/teuthworker/archive/yuriw-2023-11-07_19:34:21-rados-wip-yuri3-testing-2023-11-07-0801-pacific-distro-default-smithi/7451217/orig.config.yaml 2023-11-08T01:53:36.770 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-11-07_19:34:21-rados-wip-yuri3-testing-2023-11-07-0801-pacific-distro-default-smithi/7451217 2023-11-08T01:53:36.770 INFO:teuthology.dispatcher.supervisor:Job PID: 683645 2023-11-08T01:53:36.771 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-08T01:55:36.872 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T01:57:37.047 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T01:59:37.219 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T02:01:37.391 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T02:03:37.555 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T02:05:37.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T02:07:37.887 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T02:09:38.051 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T02:09:38.119 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-11-08T02:09:38.200 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2023-11-08T02:09:38.242 INFO:teuthology.lock.ops:unlocked: smithi157.front.sepia.ceph.com