2023-07-31T16:27:08.896 INFO:root:teuthology version: 0.0.1.dev172+g6114016 2023-07-31T16:27:08.898 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-31T16:27:29.017 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc25fd9be50>, signals=[15]) 2023-07-31T16:27:29.018 INFO:teuthology.lock.ops:Start node 'smithi099.front.sepia.ceph.com' reimaging 2023-07-31T16:27:29.019 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: reset os type and version on server 2023-07-31T16:27:29.019 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2023-07-31T16:27:34.046 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /host {"name": "smithi099"} 2023-07-31T16:27:43.937 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-07-31T16:27:43.981 DEBUG:teuthology.provision.fog.smithi099:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-07-31T16:27:43.981 DEBUG:teuthology.provision.fog.smithi099:FOG request: PUT /host/204 {"imageID": 2} 2023-07-31T16:27:44.032 INFO:teuthology.provision.fog.smithi099:Scheduling deploy of ubuntu 20.04 2023-07-31T16:27:44.032 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-07-31T16:27:44.094 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /tasktype {"name": "deploy"} 2023-07-31T16:27:44.128 DEBUG:teuthology.provision.fog.smithi099:FOG request: POST /host/204/task {"taskTypeID": 1} 2023-07-31T16:27:44.189 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-07-31T16:27:44.275 INFO:teuthology.orchestra.console.smithi099:Power off 2023-07-31T16:27:44.276 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-31T16:27:44.298 DEBUG:teuthology.orchestra.console.smithi099:power off output: Chassis Power Control: Down/Off 2023-07-31T16:27:44.299 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-31T16:27:44.320 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2023-07-31T16:27:48.324 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-31T16:27:49.435 DEBUG:teuthology.orchestra.console.smithi099:check power output: 2023-07-31T16:27:53.436 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-31T16:27:54.548 DEBUG:teuthology.orchestra.console.smithi099:check power output: 2023-07-31T16:27:58.550 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-31T16:27:59.661 DEBUG:teuthology.orchestra.console.smithi099:check power output: 2023-07-31T16:28:03.663 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-31T16:28:04.772 DEBUG:teuthology.orchestra.console.smithi099:check power output: 2023-07-31T16:28:08.777 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-31T16:28:09.888 DEBUG:teuthology.orchestra.console.smithi099:check power output: 2023-07-31T16:28:13.892 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-31T16:28:15.004 DEBUG:teuthology.orchestra.console.smithi099:check power output: 2023-07-31T16:28:19.008 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-31T16:28:20.118 DEBUG:teuthology.orchestra.console.smithi099:check power output: 2023-07-31T16:28:24.120 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-31T16:28:25.230 DEBUG:teuthology.orchestra.console.smithi099:check power output: 2023-07-31T16:28:29.232 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-31T16:28:29.341 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2023-07-31T16:28:29.442 INFO:teuthology.orchestra.console.smithi099:Power off completed 2023-07-31T16:28:29.543 INFO:teuthology.orchestra.console.smithi099:Power on 2023-07-31T16:28:29.543 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-31T16:28:39.572 DEBUG:teuthology.orchestra.console.smithi099:power on output: Chassis Power Control: Up/On 2023-07-31T16:28:39.573 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-31T16:28:40.583 DEBUG:teuthology.orchestra.console.smithi099:check power output: 2023-07-31T16:28:44.584 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-31T16:28:45.694 DEBUG:teuthology.orchestra.console.smithi099:check power output: 2023-07-31T16:28:49.696 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-31T16:28:49.806 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2023-07-31T16:28:49.907 INFO:teuthology.orchestra.console.smithi099:Power on completed 2023-07-31T16:28:50.008 INFO:teuthology.provision.fog.smithi099:Waiting for deploy to finish 2023-07-31T16:28:50.008 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-07-31T16:29:10.084 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-07-31T16:29:30.168 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-07-31T16:29:45.252 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-07-31T16:30:05.356 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-07-31T16:30:25.448 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-07-31T16:30:45.560 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-07-31T16:31:00.676 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-07-31T16:31:19.036 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-07-31T16:31:34.143 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-07-31T16:31:54.224 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-07-31T16:32:14.288 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-07-31T16:32:34.373 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-07-31T16:32:39.473 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-31T16:32:42.544 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-07-31T16:32:48.549 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-31T16:32:51.600 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-07-31T16:32:57.607 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-31T16:33:00.692 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-07-31T16:33:06.696 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-31T16:33:09.776 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-07-31T16:33:15.780 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-31T16:33:23.856 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-07-31T16:33:29.863 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-31T16:34:03.441 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-31T16:34:03.443 DEBUG:teuthology.orchestra.run.smithi099:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-31T16:34:24.254 INFO:teuthology.provision.fog.smithi099:Node is ready 2023-07-31T16:34:24.255 DEBUG:teuthology.orchestra.run.smithi099:> hostname 2023-07-31T16:34:24.261 INFO:teuthology.orchestra.run.smithi099.stdout:smithi099.front.sepia.ceph.com 2023-07-31T16:34:24.262 DEBUG:teuthology.orchestra.run.smithi099:> grep smithi099.front.sepia.ceph.com /etc/hosts 2023-07-31T16:34:24.309 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99 smithi099.front.sepia.ceph.com smithi099 2023-07-31T16:34:24.309 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099 2023-07-31T16:34:24.399 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hosts 2023-07-31T16:34:24.415 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/172.21.15.99/172.21.15.99/g' /etc/hosts 2023-07-31T16:34:24.474 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hostname 2023-07-31T16:34:24.491 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099 2023-07-31T16:34:24.503 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2023-07-31T16:34:24.508 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="Ubuntu" 2023-07-31T16:34:24.509 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-31T16:34:24.509 INFO:teuthology.orchestra.run.smithi099.stdout:ID=ubuntu 2023-07-31T16:34:24.509 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE=debian 2023-07-31T16:34:24.509 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-31T16:34:24.509 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="20.04" 2023-07-31T16:34:24.509 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-31T16:34:24.509 INFO:teuthology.orchestra.run.smithi099.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-31T16:34:24.510 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-31T16:34:24.510 INFO:teuthology.orchestra.run.smithi099.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-31T16:34:24.510 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_CODENAME=focal 2023-07-31T16:34:24.510 INFO:teuthology.orchestra.run.smithi099.stdout:UBUNTU_CODENAME=focal 2023-07-31T16:34:24.511 INFO:teuthology.provision.fog.smithi099:Deploy complete! 2023-07-31T16:34:24.512 DEBUG:teuthology.parallel:result is None 2023-07-31T16:34:27.864 INFO:teuthology.lock.ops:Checking smithi099.front.sepia.ceph.com 2023-07-31T16:34:27.865 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-31T16:34:27.885 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: set os type and version on server 2023-07-31T16:34:27.885 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2023-07-31T16:34:27.886 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-31T16:34:27.935 DEBUG:teuthology.orchestra.run.smithi099:> true 2023-07-31T16:34:28.054 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com' 2023-07-31T16:34:28.054 DEBUG:teuthology.orchestra.run.smithi099:> uname -m 2023-07-31T16:34:28.060 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64 2023-07-31T16:34:28.060 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2023-07-31T16:34:28.066 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="Ubuntu" 2023-07-31T16:34:28.066 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-31T16:34:28.067 INFO:teuthology.orchestra.run.smithi099.stdout:ID=ubuntu 2023-07-31T16:34:28.067 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE=debian 2023-07-31T16:34:28.067 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-31T16:34:28.067 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="20.04" 2023-07-31T16:34:28.067 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-31T16:34:28.067 INFO:teuthology.orchestra.run.smithi099.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-31T16:34:28.067 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-31T16:34:28.068 INFO:teuthology.orchestra.run.smithi099.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-31T16:34:28.068 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_CODENAME=focal 2023-07-31T16:34:28.068 INFO:teuthology.orchestra.run.smithi099.stdout:UBUNTU_CODENAME=focal 2023-07-31T16:34:28.068 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2023-07-31T16:34:32.949 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-31T16:34:33.043 INFO:teuthology.dispatcher.supervisor:Running job 7357726 2023-07-31T16:34:33.043 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-07-31_15:32:14-rados-wip-yuri7-testing-2023-07-27-1336-quincy-distro-default-smithi/7357726 --name yuriw-2023-07-31_15:32:14-rados-wip-yuri7-testing-2023-07-27-1336-quincy-distro-default-smithi --description rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read} -- /home/teuthworker/archive/yuriw-2023-07-31_15:32:14-rados-wip-yuri7-testing-2023-07-27-1336-quincy-distro-default-smithi/7357726/orig.config.yaml 2023-07-31T16:34:33.048 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-07-31_15:32:14-rados-wip-yuri7-testing-2023-07-27-1336-quincy-distro-default-smithi/7357726 2023-07-31T16:34:33.049 INFO:teuthology.dispatcher.supervisor:Job PID: 27421 2023-07-31T16:34:33.049 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-31T16:36:33.149 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-31T16:38:38.325 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-31T16:40:43.497 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-31T16:42:48.683 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-31T16:44:52.101 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-31T16:46:57.281 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-31T16:49:02.462 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-31T16:51:07.649 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-31T16:53:07.821 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-31T16:53:12.852 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-31T16:53:12.934 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2023-07-31T16:53:12.985 INFO:teuthology.lock.ops:unlocked: smithi099.front.sepia.ceph.com