2023-08-24T19:41:51.108 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-24T19:41:51.110 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-24T19:41:51.222 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f59ca1bd310>, signals=[15]) 2023-08-24T19:41:51.224 INFO:teuthology.lock.ops:Start node 'smithi169.front.sepia.ceph.com' reimaging 2023-08-24T19:41:51.224 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: reset os type and version on server 2023-08-24T19:41:51.225 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2023-08-24T19:41:51.244 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /host {"name": "smithi169"} 2023-08-24T19:41:51.320 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-08-24T19:41:51.362 DEBUG:teuthology.provision.fog.smithi169:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-08-24T19:41:51.362 DEBUG:teuthology.provision.fog.smithi169:FOG request: PUT /host/274 {"imageID": 6} 2023-08-24T19:41:51.407 INFO:teuthology.provision.fog.smithi169:Scheduling deploy of ubuntu 22.04 2023-08-24T19:41:51.408 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-08-24T19:41:51.479 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /tasktype {"name": "deploy"} 2023-08-24T19:41:51.526 DEBUG:teuthology.provision.fog.smithi169:FOG request: POST /host/274/task {"taskTypeID": 1} 2023-08-24T19:41:51.589 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-08-24T19:41:51.701 INFO:teuthology.orchestra.console.smithi169:Power off 2023-08-24T19:41:51.702 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-24T19:41:51.724 DEBUG:teuthology.orchestra.console.smithi169:power off output: Chassis Power Control: Down/Off 2023-08-24T19:41:51.725 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-24T19:41:51.749 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on 2023-08-24T19:41:55.753 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-24T19:41:55.865 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on 2023-08-24T19:41:59.870 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-24T19:41:59.982 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on 2023-08-24T19:42:03.984 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-24T19:42:04.097 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2023-08-24T19:42:04.199 INFO:teuthology.orchestra.console.smithi169:Power off completed 2023-08-24T19:42:04.299 INFO:teuthology.orchestra.console.smithi169:Power on 2023-08-24T19:42:04.300 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-24T19:42:04.320 DEBUG:teuthology.orchestra.console.smithi169:power on output: Chassis Power Control: Up/On 2023-08-24T19:42:04.321 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-24T19:42:04.344 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2023-08-24T19:42:08.348 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-24T19:42:08.459 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2023-08-24T19:42:12.460 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-24T19:42:12.571 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on 2023-08-24T19:42:12.677 INFO:teuthology.orchestra.console.smithi169:Power on completed 2023-08-24T19:42:12.786 INFO:teuthology.provision.fog.smithi169:Waiting for deploy to finish 2023-08-24T19:42:12.787 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-08-24T19:42:27.892 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-08-24T19:42:42.996 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-08-24T19:42:58.100 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-08-24T19:43:13.208 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-08-24T19:43:28.293 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-08-24T19:43:43.388 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-08-24T19:43:58.474 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-08-24T19:44:13.559 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-08-24T19:44:28.636 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-08-24T19:44:43.752 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-08-24T19:44:58.832 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-08-24T19:45:13.932 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-08-24T19:45:29.024 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-08-24T19:45:29.111 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-24T19:45:32.180 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-08-24T19:45:38.185 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-24T19:45:41.264 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-08-24T19:45:47.268 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-24T19:45:50.325 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-08-24T19:45:56.330 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-24T19:45:59.408 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-08-24T19:46:05.412 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-24T19:46:08.464 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-08-24T19:46:14.469 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-24T19:46:17.520 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-08-24T19:46:23.527 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-24T19:46:26.608 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-08-24T19:46:32.612 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-24T19:47:04.176 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-08-24T19:47:10.182 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-24T19:47:10.183 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-08-24T19:47:16.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-24T19:47:16.190 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-08-24T19:47:22.196 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-24T19:47:22.198 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-08-24T19:47:28.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-24T19:47:28.205 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-08-24T19:47:34.208 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-24T19:47:34.403 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-24T19:47:34.404 DEBUG:teuthology.orchestra.run.smithi169:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-24T19:47:34.921 INFO:teuthology.provision.fog.smithi169:Node is ready 2023-08-24T19:47:34.922 DEBUG:teuthology.orchestra.run.smithi169:> hostname 2023-08-24T19:47:34.969 INFO:teuthology.orchestra.run.smithi169.stdout:smithi169.front.sepia.ceph.com 2023-08-24T19:47:34.970 DEBUG:teuthology.orchestra.run.smithi169:> grep smithi169.front.sepia.ceph.com /etc/hosts 2023-08-24T19:47:35.017 INFO:teuthology.orchestra.run.smithi169.stdout:172.21.15.169 smithi169.front.sepia.ceph.com smithi169 2023-08-24T19:47:35.017 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169 2023-08-24T19:47:35.145 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi169.front.sepia.ceph.com/smithi169/g' /etc/hosts 2023-08-24T19:47:35.160 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/172.21.15.169/172.21.15.169/g' /etc/hosts 2023-08-24T19:47:35.215 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi169.front.sepia.ceph.com/smithi169/g' /etc/hostname 2023-08-24T19:47:35.273 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169 2023-08-24T19:47:35.326 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2023-08-24T19:47:35.378 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-08-24T19:47:35.378 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="Ubuntu" 2023-08-24T19:47:35.378 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="22.04" 2023-08-24T19:47:35.379 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-08-24T19:47:35.379 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_CODENAME=jammy 2023-08-24T19:47:35.379 INFO:teuthology.orchestra.run.smithi169.stdout:ID=ubuntu 2023-08-24T19:47:35.379 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE=debian 2023-08-24T19:47:35.379 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-24T19:47:35.379 INFO:teuthology.orchestra.run.smithi169.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-24T19:47:35.380 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-24T19:47:35.380 INFO:teuthology.orchestra.run.smithi169.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-24T19:47:35.380 INFO:teuthology.orchestra.run.smithi169.stdout:UBUNTU_CODENAME=jammy 2023-08-24T19:47:35.381 INFO:teuthology.provision.fog.smithi169:Deploy complete! 2023-08-24T19:47:35.382 DEBUG:teuthology.parallel:result is None 2023-08-24T19:47:35.503 INFO:teuthology.lock.ops:Checking smithi169.front.sepia.ceph.com 2023-08-24T19:47:35.504 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-24T19:47:35.532 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: set os type and version on server 2023-08-24T19:47:35.532 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2023-08-24T19:47:35.533 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-24T19:47:35.608 DEBUG:teuthology.orchestra.run.smithi169:> true 2023-08-24T19:47:35.721 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi169.front.sepia.ceph.com' 2023-08-24T19:47:35.721 DEBUG:teuthology.orchestra.run.smithi169:> uname -m 2023-08-24T19:47:35.767 INFO:teuthology.orchestra.run.smithi169.stdout:x86_64 2023-08-24T19:47:35.768 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2023-08-24T19:47:35.818 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-08-24T19:47:35.818 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="Ubuntu" 2023-08-24T19:47:35.819 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="22.04" 2023-08-24T19:47:35.819 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-08-24T19:47:35.819 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_CODENAME=jammy 2023-08-24T19:47:35.819 INFO:teuthology.orchestra.run.smithi169.stdout:ID=ubuntu 2023-08-24T19:47:35.819 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE=debian 2023-08-24T19:47:35.819 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-24T19:47:35.820 INFO:teuthology.orchestra.run.smithi169.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-24T19:47:35.820 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-24T19:47:35.820 INFO:teuthology.orchestra.run.smithi169.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-24T19:47:35.820 INFO:teuthology.orchestra.run.smithi169.stdout:UBUNTU_CODENAME=jammy 2023-08-24T19:47:35.821 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2023-08-24T19:47:35.839 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-24T19:47:35.937 INFO:teuthology.dispatcher.supervisor:Running job 7378812 2023-08-24T19:47:35.937 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/bin/teuthology -v --owner scheduled_akupczyk@teuthology --archive /home/teuthworker/archive/akupczyk-2023-08-24_18:30:17-rados-wip-aclamk-bs-esb-5-enabled-distro-default-smithi/7378812 --name akupczyk-2023-08-24_18:30:17-rados-wip-aclamk-bs-esb-5-enabled-distro-default-smithi --description rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} -- /home/teuthworker/archive/akupczyk-2023-08-24_18:30:17-rados-wip-aclamk-bs-esb-5-enabled-distro-default-smithi/7378812/orig.config.yaml 2023-08-24T19:47:35.940 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/akupczyk-2023-08-24_18:30:17-rados-wip-aclamk-bs-esb-5-enabled-distro-default-smithi/7378812 2023-08-24T19:47:35.941 INFO:teuthology.dispatcher.supervisor:Job PID: 21318 2023-08-24T19:47:35.942 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-24T19:49:36.040 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-24T19:51:36.212 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-24T19:53:36.368 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-24T19:55:36.531 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-24T19:57:36.707 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-24T19:59:36.910 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-24T20:01:37.096 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-24T20:03:37.263 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-24T20:05:37.425 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-24T20:05:37.502 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-24T20:05:37.637 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2023-08-24T20:05:37.686 INFO:teuthology.lock.ops:unlocked: smithi169.front.sepia.ceph.com