2023-12-17T11:44:36.522 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-17T11:44:36.523 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-17T11:44:36.624 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fed23830940>, signals=[15]) 2023-12-17T11:44:36.624 INFO:teuthology.lock.ops:Start node 'smithi084.front.sepia.ceph.com' reimaging 2023-12-17T11:44:36.625 INFO:teuthology.lock.ops:Updating [smithi084.front.sepia.ceph.com]: reset os type and version on server 2023-12-17T11:44:36.625 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2023-12-17T11:44:36.745 DEBUG:teuthology.provision.fog.smithi084:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-12-17T11:44:36.792 INFO:teuthology.provision.fog.smithi084:Scheduling deploy of ubuntu 22.04 2023-12-17T11:44:37.037 INFO:teuthology.orchestra.console.smithi084:Power off 2023-12-17T11:44:37.037 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-17T11:44:37.061 DEBUG:teuthology.orchestra.console.smithi084:power off output: Chassis Power Control: Down/Off 2023-12-17T11:44:37.062 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-17T11:44:37.086 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on 2023-12-17T11:44:41.089 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-17T11:44:41.198 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on 2023-12-17T11:44:45.201 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-17T11:44:45.310 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off 2023-12-17T11:44:45.411 INFO:teuthology.orchestra.console.smithi084:Power off completed 2023-12-17T11:44:45.511 INFO:teuthology.orchestra.console.smithi084:Power on 2023-12-17T11:44:45.512 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-17T11:44:45.536 DEBUG:teuthology.orchestra.console.smithi084:power on output: Chassis Power Control: Up/On 2023-12-17T11:44:45.536 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-17T11:44:45.559 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off 2023-12-17T11:44:49.561 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-17T11:44:49.673 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off 2023-12-17T11:44:53.676 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-17T11:44:53.785 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on 2023-12-17T11:44:53.885 INFO:teuthology.orchestra.console.smithi084:Power on completed 2023-12-17T11:44:53.986 INFO:teuthology.provision.fog.smithi084:Waiting for deploy to finish 2023-12-17T11:47:55.152 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:47:58.229 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-12-17T11:48:04.234 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:48:07.313 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-12-17T11:48:13.318 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:48:16.374 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-12-17T11:48:22.381 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:48:25.457 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-12-17T11:48:31.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:48:34.517 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-12-17T11:48:40.522 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:48:43.601 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-12-17T11:48:49.606 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:48:52.661 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-12-17T11:48:58.666 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:49:30.262 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-12-17T11:49:36.266 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:49:36.268 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-12-17T11:49:42.274 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:49:42.276 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-12-17T11:49:48.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:49:48.284 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-12-17T11:49:54.290 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:49:54.530 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-17T11:49:54.531 DEBUG:teuthology.orchestra.run.smithi084:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-17T11:49:55.055 INFO:teuthology.provision.fog.smithi084:Node is ready 2023-12-17T11:49:55.055 DEBUG:teuthology.orchestra.run.smithi084:> hostname 2023-12-17T11:49:55.104 INFO:teuthology.orchestra.run.smithi084.stdout:smithi084.front.sepia.ceph.com 2023-12-17T11:49:55.104 DEBUG:teuthology.orchestra.run.smithi084:> grep smithi084.front.sepia.ceph.com /etc/hosts 2023-12-17T11:49:55.152 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84 smithi084.front.sepia.ceph.com smithi084 2023-12-17T11:49:55.152 DEBUG:teuthology.orchestra.run.smithi084:> sudo hostname smithi084 2023-12-17T11:49:55.279 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/smithi084.front.sepia.ceph.com/smithi084/g' /etc/hosts 2023-12-17T11:49:55.293 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/172.21.15.84/172.21.15.84/g' /etc/hosts 2023-12-17T11:49:55.348 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/smithi084.front.sepia.ceph.com/smithi084/g' /etc/hostname 2023-12-17T11:49:55.405 DEBUG:teuthology.orchestra.run.smithi084:> sudo hostname smithi084 2023-12-17T11:49:55.463 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release 2023-12-17T11:49:55.512 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-12-17T11:49:55.512 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="Ubuntu" 2023-12-17T11:49:55.512 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="22.04" 2023-12-17T11:49:55.512 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-12-17T11:49:55.512 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_CODENAME=jammy 2023-12-17T11:49:55.512 INFO:teuthology.orchestra.run.smithi084.stdout:ID=ubuntu 2023-12-17T11:49:55.512 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE=debian 2023-12-17T11:49:55.512 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-17T11:49:55.513 INFO:teuthology.orchestra.run.smithi084.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-17T11:49:55.513 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-17T11:49:55.513 INFO:teuthology.orchestra.run.smithi084.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-17T11:49:55.513 INFO:teuthology.orchestra.run.smithi084.stdout:UBUNTU_CODENAME=jammy 2023-12-17T11:49:55.513 INFO:teuthology.provision.fog.smithi084:Deploy complete! 2023-12-17T11:49:55.514 DEBUG:teuthology.parallel:result is None 2023-12-17T11:49:55.644 INFO:teuthology.lock.ops:Checking smithi084.front.sepia.ceph.com 2023-12-17T11:49:55.644 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-17T11:49:55.665 INFO:teuthology.lock.ops:Updating [smithi084.front.sepia.ceph.com]: set os type and version on server 2023-12-17T11:49:55.665 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2023-12-17T11:49:55.665 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:49:55.743 DEBUG:teuthology.orchestra.run.smithi084:> true 2023-12-17T11:49:55.837 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi084.front.sepia.ceph.com' 2023-12-17T11:49:55.837 DEBUG:teuthology.orchestra.run.smithi084:> uname -m 2023-12-17T11:49:55.883 INFO:teuthology.orchestra.run.smithi084.stdout:x86_64 2023-12-17T11:49:55.884 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release 2023-12-17T11:49:55.933 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-12-17T11:49:55.934 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="Ubuntu" 2023-12-17T11:49:55.934 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="22.04" 2023-12-17T11:49:55.934 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-12-17T11:49:55.934 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_CODENAME=jammy 2023-12-17T11:49:55.934 INFO:teuthology.orchestra.run.smithi084.stdout:ID=ubuntu 2023-12-17T11:49:55.934 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE=debian 2023-12-17T11:49:55.934 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-17T11:49:55.934 INFO:teuthology.orchestra.run.smithi084.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-17T11:49:55.934 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-17T11:49:55.934 INFO:teuthology.orchestra.run.smithi084.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-17T11:49:55.934 INFO:teuthology.orchestra.run.smithi084.stdout:UBUNTU_CODENAME=jammy 2023-12-17T11:49:55.935 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2023-12-17T11:49:55.955 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-17T11:49:56.031 INFO:teuthology.dispatcher.supervisor:Running job 7495198 2023-12-17T11:49:56.031 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_yuvalif@teuthology --archive /home/teuthworker/archive/yuvalif-2023-12-17_11:43:26-rgw-wip-yuval-test-gsoc-distro-default-smithi/7495198 --name yuvalif-2023-12-17_11:43:26-rgw-wip-yuval-test-gsoc-distro-default-smithi --description rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/kmip 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability s3tests-branch ubuntu_latest} -- /home/teuthworker/archive/yuvalif-2023-12-17_11:43:26-rgw-wip-yuval-test-gsoc-distro-default-smithi/7495198/orig.config.yaml 2023-12-17T11:49:56.035 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuvalif-2023-12-17_11:43:26-rgw-wip-yuval-test-gsoc-distro-default-smithi/7495198 2023-12-17T11:49:56.035 INFO:teuthology.dispatcher.supervisor:Job PID: 88046 2023-12-17T11:49:56.035 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-17T11:51:56.136 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-17T11:53:56.306 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-17T11:55:56.470 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-17T11:57:56.643 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-17T11:59:56.802 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-17T12:01:57.140 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-17T12:03:57.311 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-17T12:03:57.383 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-17T12:03:57.449 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-17T12:03:57.449 INFO:teuthology.nuke:Checking targets against current locks 2023-12-17T12:03:57.493 DEBUG:teuthology.nuke:shortname: smithi084 2023-12-17T12:03:57.493 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-17T12:03:57.513 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi084.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuvalif-2023-12-17_11:43:26-rgw-wip-yuval-test-gsoc-distro-default-smithi/7495198', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-17 11:44:35.727198', 'locked_by': 'scheduled_yuvalif@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDG9oMU64elRaN3vIxdPUY/P6b9sA8I0MVyn69TlqDN9u/hlv2ZdnvByEOFQrS/wmBxkX14oKX379p4PtfsgjdY='} 2023-12-17T12:03:57.560 INFO:teuthology.orchestra.console.smithi084:Power off 2023-12-17T12:03:57.560 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-17T12:03:57.583 DEBUG:teuthology.orchestra.console.smithi084:power off output: Chassis Power Control: Down/Off 2023-12-17T12:03:57.583 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-17T12:03:57.602 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off 2023-12-17T12:03:57.702 INFO:teuthology.orchestra.console.smithi084:Power off completed 2023-12-17T12:03:57.856 INFO:teuthology.lock.ops:unlocked: smithi084.front.sepia.ceph.com