2024-02-02T04:12:10.621 INFO:root:teuthology version: 0.0.1.dev256+gd9fdb22 2024-02-02T04:12:10.622 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-02T04:12:10.747 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2ef1ee3c10>, signals=[15]) 2024-02-02T04:12:10.748 INFO:teuthology.lock.ops:Start node 'smithi191.front.sepia.ceph.com' reimaging 2024-02-02T04:12:10.748 INFO:teuthology.lock.ops:Updating [smithi191.front.sepia.ceph.com]: reset os type and version on server 2024-02-02T04:12:10.748 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2024-02-02T04:12:10.886 DEBUG:teuthology.provision.fog.smithi191:Requesting image smithi_ubuntu_22.04 (ID 6) 2024-02-02T04:12:10.930 INFO:teuthology.provision.fog.smithi191:Scheduling deploy of ubuntu 22.04 2024-02-02T04:12:11.208 INFO:teuthology.orchestra.console.smithi191:Power off 2024-02-02T04:12:11.208 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-02T04:12:11.231 DEBUG:teuthology.orchestra.console.smithi191:power off output: Chassis Power Control: Down/Off 2024-02-02T04:12:11.231 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-02T04:12:11.257 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on 2024-02-02T04:12:15.262 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-02T04:12:15.371 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on 2024-02-02T04:12:19.375 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-02T04:12:19.485 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on 2024-02-02T04:12:23.487 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-02T04:12:23.597 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off 2024-02-02T04:12:23.698 INFO:teuthology.orchestra.console.smithi191:Power off completed 2024-02-02T04:12:23.798 INFO:teuthology.orchestra.console.smithi191:Power on 2024-02-02T04:12:23.798 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-02T04:12:23.819 DEBUG:teuthology.orchestra.console.smithi191:power on output: Chassis Power Control: Up/On 2024-02-02T04:12:23.819 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-02T04:12:23.839 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off 2024-02-02T04:12:27.843 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-02T04:12:27.953 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on 2024-02-02T04:12:28.054 INFO:teuthology.orchestra.console.smithi191:Power on completed 2024-02-02T04:12:28.154 INFO:teuthology.provision.fog.smithi191:Waiting for deploy to finish 2024-02-02T04:15:44.220 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-02T04:15:47.292 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-02-02T04:15:53.297 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-02T04:15:56.352 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-02-02T04:16:02.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-02T04:16:05.440 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-02-02T04:16:11.444 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-02T04:16:14.524 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-02-02T04:16:20.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-02T04:16:23.580 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-02-02T04:16:29.585 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-02T04:16:32.636 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-02-02T04:16:38.641 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-02T04:17:38.701 WARNING:teuthology.provision.fog.smithi191:timed out 2024-02-02T04:17:44.709 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-02T04:17:45.207 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-02T04:17:45.208 DEBUG:teuthology.orchestra.run.smithi191:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-02T04:17:46.073 INFO:teuthology.provision.fog.smithi191:Node is ready 2024-02-02T04:17:46.074 DEBUG:teuthology.orchestra.run.smithi191:> hostname 2024-02-02T04:17:46.122 INFO:teuthology.orchestra.run.smithi191.stdout:smithi191.front.sepia.ceph.com 2024-02-02T04:17:46.122 DEBUG:teuthology.orchestra.run.smithi191:> grep smithi191.front.sepia.ceph.com /etc/hosts 2024-02-02T04:17:46.170 INFO:teuthology.orchestra.run.smithi191.stdout:172.21.15.191 smithi191.front.sepia.ceph.com smithi191 2024-02-02T04:17:46.170 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname smithi191 2024-02-02T04:17:46.325 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/smithi191.front.sepia.ceph.com/smithi191/g' /etc/hosts 2024-02-02T04:17:46.339 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/172.21.15.191/172.21.15.191/g' /etc/hosts 2024-02-02T04:17:46.394 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/smithi191.front.sepia.ceph.com/smithi191/g' /etc/hostname 2024-02-02T04:17:46.451 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname smithi191 2024-02-02T04:17:46.504 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release 2024-02-02T04:17:46.550 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-02-02T04:17:46.550 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="Ubuntu" 2024-02-02T04:17:46.550 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="22.04" 2024-02-02T04:17:46.550 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-02-02T04:17:46.550 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_CODENAME=jammy 2024-02-02T04:17:46.550 INFO:teuthology.orchestra.run.smithi191.stdout:ID=ubuntu 2024-02-02T04:17:46.551 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE=debian 2024-02-02T04:17:46.551 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://www.ubuntu.com/" 2024-02-02T04:17:46.551 INFO:teuthology.orchestra.run.smithi191.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-02-02T04:17:46.551 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-02-02T04:17:46.551 INFO:teuthology.orchestra.run.smithi191.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-02-02T04:17:46.551 INFO:teuthology.orchestra.run.smithi191.stdout:UBUNTU_CODENAME=jammy 2024-02-02T04:17:46.552 INFO:teuthology.provision.fog.smithi191:Deploy complete! 2024-02-02T04:17:46.553 DEBUG:teuthology.parallel:result is None 2024-02-02T04:17:46.691 INFO:teuthology.lock.ops:Checking smithi191.front.sepia.ceph.com 2024-02-02T04:17:46.691 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-02T04:17:46.716 INFO:teuthology.lock.ops:Updating [smithi191.front.sepia.ceph.com]: set os type and version on server 2024-02-02T04:17:46.716 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-02-02T04:17:46.717 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-02T04:17:46.791 DEBUG:teuthology.orchestra.run.smithi191:> true 2024-02-02T04:17:46.888 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-02-02T04:17:46.888 DEBUG:teuthology.orchestra.run.smithi191:> uname -m 2024-02-02T04:17:46.933 INFO:teuthology.orchestra.run.smithi191.stdout:x86_64 2024-02-02T04:17:46.934 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release 2024-02-02T04:17:46.985 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-02-02T04:17:46.985 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="Ubuntu" 2024-02-02T04:17:46.985 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="22.04" 2024-02-02T04:17:46.985 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-02-02T04:17:46.985 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_CODENAME=jammy 2024-02-02T04:17:46.986 INFO:teuthology.orchestra.run.smithi191.stdout:ID=ubuntu 2024-02-02T04:17:46.986 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE=debian 2024-02-02T04:17:46.986 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://www.ubuntu.com/" 2024-02-02T04:17:46.986 INFO:teuthology.orchestra.run.smithi191.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-02-02T04:17:46.986 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-02-02T04:17:46.986 INFO:teuthology.orchestra.run.smithi191.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-02-02T04:17:46.986 INFO:teuthology.orchestra.run.smithi191.stdout:UBUNTU_CODENAME=jammy 2024-02-02T04:17:46.986 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2024-02-02T04:17:47.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-02T04:17:47.112 INFO:teuthology.dispatcher.supervisor:Running job 7542944 2024-02-02T04:17:47.112 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-02-01_21:56:37-rados-wip-yuri5-testing-2024-01-31-1657-distro-default-smithi/7542944 --name yuriw-2024-02-01_21:56:37-rados-wip-yuri5-testing-2024-01-31-1657-distro-default-smithi --description rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} -- /home/teuthworker/archive/yuriw-2024-02-01_21:56:37-rados-wip-yuri5-testing-2024-01-31-1657-distro-default-smithi/7542944/orig.config.yaml 2024-02-02T04:17:47.115 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-02-01_21:56:37-rados-wip-yuri5-testing-2024-01-31-1657-distro-default-smithi/7542944 2024-02-02T04:17:47.116 INFO:teuthology.dispatcher.supervisor:Job PID: 1692808 2024-02-02T04:17:47.117 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-02-02T04:19:47.217 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-02T04:21:47.388 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-02T04:23:47.565 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-02T04:25:47.741 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-02T04:27:47.907 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-02T04:29:48.069 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-02T04:31:48.237 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-02T04:33:48.409 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-02T04:35:48.571 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-02T04:35:48.643 INFO:teuthology.dispatcher.supervisor:Success! 2024-02-02T04:35:48.728 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi191 but it was locked by another job: /home/teuthworker/archive/yuriw-2024-02-01_21:56:37-rados-wip-yuri5-testing-2024-01-31-1657-distro-default-smithi/7542965