2023-12-26T12:41:50.516 INFO:root:teuthology version: 0.0.1.dev226+g9680d2a 2023-12-26T12:41:50.517 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-26T12:41:50.636 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fde6c692940>, signals=[15]) 2023-12-26T12:41:50.636 INFO:teuthology.lock.ops:Start node 'smithi174.front.sepia.ceph.com' reimaging 2023-12-26T12:41:50.636 INFO:teuthology.lock.ops:Updating [smithi174.front.sepia.ceph.com]: reset os type and version on server 2023-12-26T12:41:50.636 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server 2023-12-26T12:41:50.767 DEBUG:teuthology.provision.fog.smithi174:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-12-26T12:41:50.803 INFO:teuthology.provision.fog.smithi174:Scheduling deploy of ubuntu 22.04 2023-12-26T12:41:51.265 INFO:teuthology.orchestra.console.smithi174:Power off 2023-12-26T12:41:51.265 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-26T12:41:51.285 DEBUG:teuthology.orchestra.console.smithi174:power off output: Chassis Power Control: Down/Off 2023-12-26T12:41:51.285 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-26T12:41:51.306 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off 2023-12-26T12:41:51.407 INFO:teuthology.orchestra.console.smithi174:Power off completed 2023-12-26T12:41:51.507 INFO:teuthology.orchestra.console.smithi174:Power on 2023-12-26T12:41:51.508 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-26T12:41:51.527 DEBUG:teuthology.orchestra.console.smithi174:power on output: Chassis Power Control: Up/On 2023-12-26T12:41:51.527 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-26T12:41:51.548 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off 2023-12-26T12:41:55.549 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-26T12:41:55.658 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2023-12-26T12:41:55.759 INFO:teuthology.orchestra.console.smithi174:Power on completed 2023-12-26T12:41:55.859 INFO:teuthology.provision.fog.smithi174:Waiting for deploy to finish 2023-12-26T12:53:01.866 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T12:53:04.945 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-12-26T12:53:10.950 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T12:53:14.005 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-12-26T12:53:20.010 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T12:53:23.093 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-12-26T12:53:29.098 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T12:53:32.178 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-12-26T12:53:38.184 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T12:53:41.265 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-12-26T12:53:47.270 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T12:53:50.321 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-12-26T12:53:56.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T12:54:27.863 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-12-26T12:54:33.870 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T12:54:33.872 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-12-26T12:54:39.880 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T12:54:39.882 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-12-26T12:54:45.886 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T12:54:45.888 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-12-26T12:54:51.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T12:54:51.896 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-12-26T12:54:57.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T12:54:58.127 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-26T12:54:58.127 DEBUG:teuthology.orchestra.run.smithi174:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-26T12:54:58.665 INFO:teuthology.provision.fog.smithi174:Node is ready 2023-12-26T12:54:58.666 DEBUG:teuthology.orchestra.run.smithi174:> hostname 2023-12-26T12:54:58.713 INFO:teuthology.orchestra.run.smithi174.stdout:smithi174.front.sepia.ceph.com 2023-12-26T12:54:58.714 DEBUG:teuthology.orchestra.run.smithi174:> grep smithi174.front.sepia.ceph.com /etc/hosts 2023-12-26T12:54:58.763 INFO:teuthology.orchestra.run.smithi174.stdout:172.21.15.174 smithi174.front.sepia.ceph.com smithi174 2023-12-26T12:54:58.763 DEBUG:teuthology.orchestra.run.smithi174:> sudo hostname smithi174 2023-12-26T12:54:58.894 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/smithi174.front.sepia.ceph.com/smithi174/g' /etc/hosts 2023-12-26T12:54:58.908 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/172.21.15.174/172.21.15.174/g' /etc/hosts 2023-12-26T12:54:58.960 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/smithi174.front.sepia.ceph.com/smithi174/g' /etc/hostname 2023-12-26T12:54:59.017 DEBUG:teuthology.orchestra.run.smithi174:> sudo hostname smithi174 2023-12-26T12:54:59.072 DEBUG:teuthology.orchestra.run.smithi174:> cat /etc/os-release 2023-12-26T12:54:59.117 INFO:teuthology.orchestra.run.smithi174.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-12-26T12:54:59.117 INFO:teuthology.orchestra.run.smithi174.stdout:NAME="Ubuntu" 2023-12-26T12:54:59.118 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_ID="22.04" 2023-12-26T12:54:59.118 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-12-26T12:54:59.118 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_CODENAME=jammy 2023-12-26T12:54:59.118 INFO:teuthology.orchestra.run.smithi174.stdout:ID=ubuntu 2023-12-26T12:54:59.118 INFO:teuthology.orchestra.run.smithi174.stdout:ID_LIKE=debian 2023-12-26T12:54:59.118 INFO:teuthology.orchestra.run.smithi174.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-26T12:54:59.118 INFO:teuthology.orchestra.run.smithi174.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-26T12:54:59.118 INFO:teuthology.orchestra.run.smithi174.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-26T12:54:59.118 INFO:teuthology.orchestra.run.smithi174.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-26T12:54:59.118 INFO:teuthology.orchestra.run.smithi174.stdout:UBUNTU_CODENAME=jammy 2023-12-26T12:54:59.119 INFO:teuthology.provision.fog.smithi174:Deploy complete! 2023-12-26T12:54:59.120 DEBUG:teuthology.parallel:result is None 2023-12-26T12:54:59.256 INFO:teuthology.lock.ops:Checking smithi174.front.sepia.ceph.com 2023-12-26T12:54:59.256 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-26T12:54:59.279 INFO:teuthology.lock.ops:Updating [smithi174.front.sepia.ceph.com]: set os type and version on server 2023-12-26T12:54:59.279 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2023-12-26T12:54:59.280 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T12:54:59.354 DEBUG:teuthology.orchestra.run.smithi174:> true 2023-12-26T12:54:59.405 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi174.front.sepia.ceph.com' 2023-12-26T12:54:59.406 DEBUG:teuthology.orchestra.run.smithi174:> uname -m 2023-12-26T12:54:59.458 INFO:teuthology.orchestra.run.smithi174.stdout:x86_64 2023-12-26T12:54:59.459 DEBUG:teuthology.orchestra.run.smithi174:> cat /etc/os-release 2023-12-26T12:54:59.506 INFO:teuthology.orchestra.run.smithi174.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-12-26T12:54:59.506 INFO:teuthology.orchestra.run.smithi174.stdout:NAME="Ubuntu" 2023-12-26T12:54:59.506 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_ID="22.04" 2023-12-26T12:54:59.506 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-12-26T12:54:59.506 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_CODENAME=jammy 2023-12-26T12:54:59.506 INFO:teuthology.orchestra.run.smithi174.stdout:ID=ubuntu 2023-12-26T12:54:59.506 INFO:teuthology.orchestra.run.smithi174.stdout:ID_LIKE=debian 2023-12-26T12:54:59.506 INFO:teuthology.orchestra.run.smithi174.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-26T12:54:59.506 INFO:teuthology.orchestra.run.smithi174.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-26T12:54:59.506 INFO:teuthology.orchestra.run.smithi174.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-26T12:54:59.506 INFO:teuthology.orchestra.run.smithi174.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-26T12:54:59.507 INFO:teuthology.orchestra.run.smithi174.stdout:UBUNTU_CODENAME=jammy 2023-12-26T12:54:59.507 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server 2023-12-26T12:54:59.528 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-26T12:54:59.627 INFO:teuthology.dispatcher.supervisor:Running job 7501093 2023-12-26T12:54:59.627 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_9680d2aba1e76f64ade295c81599c97907457848/virtualenv/bin/teuthology -v --owner scheduled_rfriedma@teuthology --archive /home/teuthworker/archive/rfriedma-2023-12-26_12:40:04-rados-wip-rf-be-error-distro-default-smithi/7501093 --name rfriedma-2023-12-26_12:40:04-rados-wip-rf-be-error-distro-default-smithi --description rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} -- /home/teuthworker/archive/rfriedma-2023-12-26_12:40:04-rados-wip-rf-be-error-distro-default-smithi/7501093/orig.config.yaml 2023-12-26T12:54:59.632 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rfriedma-2023-12-26_12:40:04-rados-wip-rf-be-error-distro-default-smithi/7501093 2023-12-26T12:54:59.632 INFO:teuthology.dispatcher.supervisor:Job PID: 649611 2023-12-26T12:54:59.632 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-26T12:56:59.735 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-26T12:58:59.922 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-26T13:01:00.138 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-26T13:03:00.318 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-26T13:05:00.507 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-26T13:07:00.691 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-26T13:09:00.878 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-26T13:11:01.055 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-26T13:13:01.222 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-26T13:15:01.394 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-26T13:17:01.558 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-26T13:19:01.691 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-26T13:21:01.859 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-26T13:23:02.020 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-26T13:23:02.088 INFO:teuthology.dispatcher.supervisor:Success! 2023-12-26T13:23:02.196 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2023-12-26T13:23:02.244 INFO:teuthology.lock.ops:unlocked: smithi174.front.sepia.ceph.com