2023-08-17T23:32:05.431 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-17T23:32:05.432 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T23:32:05.529 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb2fdcb2310>, signals=[15]) 2023-08-17T23:32:05.531 INFO:teuthology.lock.ops:Start node 'smithi039.front.sepia.ceph.com' reimaging 2023-08-17T23:32:05.532 INFO:teuthology.lock.ops:Updating [smithi039.front.sepia.ceph.com]: reset os type and version on server 2023-08-17T23:32:05.532 INFO:teuthology.lock.ops:Updating smithi039.front.sepia.ceph.com on lock server 2023-08-17T23:32:05.551 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /host {"name": "smithi039"} 2023-08-17T23:32:05.634 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-08-17T23:32:05.677 DEBUG:teuthology.provision.fog.smithi039:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-08-17T23:32:05.677 DEBUG:teuthology.provision.fog.smithi039:FOG request: PUT /host/144 {"imageID": 6} 2023-08-17T23:32:05.725 INFO:teuthology.provision.fog.smithi039:Scheduling deploy of ubuntu 22.04 2023-08-17T23:32:05.725 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-08-17T23:32:05.798 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /tasktype {"name": "deploy"} 2023-08-17T23:32:05.836 DEBUG:teuthology.provision.fog.smithi039:FOG request: POST /host/144/task {"taskTypeID": 1} 2023-08-17T23:32:05.908 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-08-17T23:32:05.999 INFO:teuthology.orchestra.console.smithi039:Power off 2023-08-17T23:32:06.000 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-17T23:32:06.026 DEBUG:teuthology.orchestra.console.smithi039:power off output: Chassis Power Control: Down/Off 2023-08-17T23:32:06.027 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-17T23:32:06.049 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is on 2023-08-17T23:32:10.052 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-17T23:32:10.162 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is on 2023-08-17T23:32:14.164 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-17T23:32:14.280 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is on 2023-08-17T23:32:18.284 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-17T23:32:18.395 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is off 2023-08-17T23:32:18.497 INFO:teuthology.orchestra.console.smithi039:Power off completed 2023-08-17T23:32:18.597 INFO:teuthology.orchestra.console.smithi039:Power on 2023-08-17T23:32:18.598 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-17T23:32:18.622 DEBUG:teuthology.orchestra.console.smithi039:power on output: Chassis Power Control: Up/On 2023-08-17T23:32:18.623 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-17T23:32:18.648 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is off 2023-08-17T23:32:22.653 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-17T23:32:22.768 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is on 2023-08-17T23:32:22.872 INFO:teuthology.orchestra.console.smithi039:Power on completed 2023-08-17T23:32:22.973 INFO:teuthology.provision.fog.smithi039:Waiting for deploy to finish 2023-08-17T23:32:22.973 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-08-17T23:32:38.060 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-08-17T23:32:53.153 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-08-17T23:33:08.227 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-08-17T23:33:23.297 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-08-17T23:33:38.374 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-08-17T23:33:53.452 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-08-17T23:34:08.524 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-08-17T23:34:23.600 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-08-17T23:34:38.672 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-08-17T23:34:53.756 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-08-17T23:35:08.840 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-08-17T23:35:23.916 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-08-17T23:35:38.996 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-08-17T23:35:54.072 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-08-17T23:36:09.148 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-08-17T23:36:09.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-17T23:36:09.282 ERROR:teuthology.orchestra.connection:Error authenticating with smithi039.front.sepia.ceph.com: Authentication failed. 2023-08-17T23:36:09.284 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-17T23:36:09.285 DEBUG:teuthology.orchestra.run.smithi039:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-17T23:36:09.287 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-17T23:36:10.295 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-17T23:38:51.377 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-08-17T23:38:51.378 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi039 2023-08-17T23:39:00.384 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2023-08-17T23:39:00.385 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-17T23:39:00.561 DEBUG:teuthology.orchestra.run.smithi039:> true 2023-08-17T23:39:01.012 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi039.front.sepia.ceph.com' 2023-08-17T23:39:01.013 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-17T23:39:01.013 DEBUG:teuthology.orchestra.run.smithi039:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-17T23:39:01.062 INFO:teuthology.provision.fog.smithi039:Node is ready 2023-08-17T23:39:01.063 DEBUG:teuthology.orchestra.run.smithi039:> hostname 2023-08-17T23:39:01.111 INFO:teuthology.orchestra.run.smithi039.stdout:smithi039.front.sepia.ceph.com 2023-08-17T23:39:01.111 DEBUG:teuthology.orchestra.run.smithi039:> grep smithi039.front.sepia.ceph.com /etc/hosts 2023-08-17T23:39:01.164 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39 smithi039.front.sepia.ceph.com smithi039 2023-08-17T23:39:01.165 DEBUG:teuthology.orchestra.run.smithi039:> sudo hostname smithi039 2023-08-17T23:39:01.315 DEBUG:teuthology.orchestra.run.smithi039:> sudo sed -i -e 's/smithi039.front.sepia.ceph.com/smithi039/g' /etc/hosts 2023-08-17T23:39:01.331 DEBUG:teuthology.orchestra.run.smithi039:> sudo sed -i -e 's/172.21.15.39/172.21.15.39/g' /etc/hosts 2023-08-17T23:39:01.391 DEBUG:teuthology.orchestra.run.smithi039:> sudo sed -i -e 's/smithi039.front.sepia.ceph.com/smithi039/g' /etc/hostname 2023-08-17T23:39:01.447 DEBUG:teuthology.orchestra.run.smithi039:> sudo hostname smithi039 2023-08-17T23:39:01.505 DEBUG:teuthology.orchestra.run.smithi039:> cat /etc/os-release 2023-08-17T23:39:01.550 INFO:teuthology.orchestra.run.smithi039.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-08-17T23:39:01.551 INFO:teuthology.orchestra.run.smithi039.stdout:NAME="Ubuntu" 2023-08-17T23:39:01.551 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION_ID="22.04" 2023-08-17T23:39:01.551 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-08-17T23:39:01.552 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION_CODENAME=jammy 2023-08-17T23:39:01.552 INFO:teuthology.orchestra.run.smithi039.stdout:ID=ubuntu 2023-08-17T23:39:01.552 INFO:teuthology.orchestra.run.smithi039.stdout:ID_LIKE=debian 2023-08-17T23:39:01.552 INFO:teuthology.orchestra.run.smithi039.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-17T23:39:01.552 INFO:teuthology.orchestra.run.smithi039.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-17T23:39:01.552 INFO:teuthology.orchestra.run.smithi039.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-17T23:39:01.552 INFO:teuthology.orchestra.run.smithi039.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-17T23:39:01.553 INFO:teuthology.orchestra.run.smithi039.stdout:UBUNTU_CODENAME=jammy 2023-08-17T23:39:01.553 INFO:teuthology.provision.fog.smithi039:Deploy complete! 2023-08-17T23:39:01.554 DEBUG:teuthology.parallel:result is None 2023-08-17T23:39:01.682 INFO:teuthology.lock.ops:Checking smithi039.front.sepia.ceph.com 2023-08-17T23:39:01.683 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-17T23:39:01.704 INFO:teuthology.lock.ops:Updating [smithi039.front.sepia.ceph.com]: set os type and version on server 2023-08-17T23:39:01.705 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2023-08-17T23:39:01.706 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-17T23:39:01.778 DEBUG:teuthology.orchestra.run.smithi039:> true 2023-08-17T23:39:01.885 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi039.front.sepia.ceph.com' 2023-08-17T23:39:01.886 DEBUG:teuthology.orchestra.run.smithi039:> uname -m 2023-08-17T23:39:01.939 INFO:teuthology.orchestra.run.smithi039.stdout:x86_64 2023-08-17T23:39:01.939 DEBUG:teuthology.orchestra.run.smithi039:> cat /etc/os-release 2023-08-17T23:39:01.986 INFO:teuthology.orchestra.run.smithi039.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-08-17T23:39:01.987 INFO:teuthology.orchestra.run.smithi039.stdout:NAME="Ubuntu" 2023-08-17T23:39:01.987 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION_ID="22.04" 2023-08-17T23:39:01.987 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-08-17T23:39:01.988 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION_CODENAME=jammy 2023-08-17T23:39:01.988 INFO:teuthology.orchestra.run.smithi039.stdout:ID=ubuntu 2023-08-17T23:39:01.989 INFO:teuthology.orchestra.run.smithi039.stdout:ID_LIKE=debian 2023-08-17T23:39:01.989 INFO:teuthology.orchestra.run.smithi039.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-17T23:39:01.989 INFO:teuthology.orchestra.run.smithi039.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-17T23:39:01.990 INFO:teuthology.orchestra.run.smithi039.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-17T23:39:01.990 INFO:teuthology.orchestra.run.smithi039.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-17T23:39:01.990 INFO:teuthology.orchestra.run.smithi039.stdout:UBUNTU_CODENAME=jammy 2023-08-17T23:39:01.990 INFO:teuthology.lock.ops:Updating smithi039.front.sepia.ceph.com on lock server 2023-08-17T23:39:02.011 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T23:39:02.109 INFO:teuthology.dispatcher.supervisor:Running job 7372343 2023-08-17T23:39:02.109 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-08-17_21:49:52-rgw-wip-yuri-testing-2023-08-14-0749-reef-distro-default-smithi/7372343 --name yuriw-2023-08-17_21:49:52-rgw-wip-yuri-testing-2023-08-14-0749-reef-distro-default-smithi --description rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/barbican 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability s3tests-branch supported-random-distro$/{ubuntu_latest}} -- /home/teuthworker/archive/yuriw-2023-08-17_21:49:52-rgw-wip-yuri-testing-2023-08-14-0749-reef-distro-default-smithi/7372343/orig.config.yaml 2023-08-17T23:39:02.113 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-08-17_21:49:52-rgw-wip-yuri-testing-2023-08-14-0749-reef-distro-default-smithi/7372343 2023-08-17T23:39:02.114 INFO:teuthology.dispatcher.supervisor:Job PID: 27688 2023-08-17T23:39:02.114 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-17T23:41:02.212 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T23:43:02.380 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T23:45:02.541 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T23:47:02.697 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T23:49:02.859 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T23:51:03.034 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T23:53:03.209 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T23:55:03.374 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T23:57:03.531 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T23:59:03.701 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T23:59:03.766 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-17T23:59:03.853 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-17T23:59:03.854 INFO:teuthology.nuke:Checking targets against current locks 2023-08-17T23:59:03.900 DEBUG:teuthology.nuke:shortname: smithi039 2023-08-17T23:59:03.900 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-17T23:59:03.924 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi039.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-17_21:49:52-rgw-wip-yuri-testing-2023-08-14-0749-reef-distro-default-smithi/7372343', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-17 23:32:04.594675', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKe2dcQ4dPlurVqduOrGZtsGMUhEE/OmcvrAO6lZl8uMfW8pFyvQrfUKOAqAosxv7ENqvUUC7trP6/jWMqECaGQ='} 2023-08-17T23:59:03.969 INFO:teuthology.orchestra.console.smithi039:Power off 2023-08-17T23:59:03.970 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-17T23:59:03.995 DEBUG:teuthology.orchestra.console.smithi039:power off output: Chassis Power Control: Down/Off 2023-08-17T23:59:03.996 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-17T23:59:04.018 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is off 2023-08-17T23:59:04.119 INFO:teuthology.orchestra.console.smithi039:Power off completed 2023-08-17T23:59:04.266 INFO:teuthology.lock.ops:unlocked: smithi039.front.sepia.ceph.com