2023-11-09T13:29:02.436 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-09T13:29:02.437 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T13:29:02.584 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f87576e4c10>, signals=[15]) 2023-11-09T13:29:02.585 INFO:teuthology.lock.ops:Start node 'smithi100.front.sepia.ceph.com' reimaging 2023-11-09T13:29:02.586 INFO:teuthology.lock.ops:Updating [smithi100.front.sepia.ceph.com]: reset os type and version on server 2023-11-09T13:29:02.586 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server 2023-11-09T13:29:02.604 INFO:teuthology.lock.ops:Start node 'smithi170.front.sepia.ceph.com' reimaging 2023-11-09T13:29:02.604 INFO:teuthology.lock.ops:Updating [smithi170.front.sepia.ceph.com]: reset os type and version on server 2023-11-09T13:29:02.605 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server 2023-11-09T13:29:02.606 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /host {"name": "smithi100"} 2023-11-09T13:29:02.629 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /host {"name": "smithi170"} 2023-11-09T13:29:02.689 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-11-09T13:29:02.694 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-11-09T13:29:02.730 DEBUG:teuthology.provision.fog.smithi100:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-11-09T13:29:02.730 DEBUG:teuthology.provision.fog.smithi100:FOG request: PUT /host/205 {"imageID": 6} 2023-11-09T13:29:02.734 DEBUG:teuthology.provision.fog.smithi170:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-11-09T13:29:02.734 DEBUG:teuthology.provision.fog.smithi170:FOG request: PUT /host/275 {"imageID": 6} 2023-11-09T13:29:02.774 INFO:teuthology.provision.fog.smithi170:Scheduling deploy of ubuntu 22.04 2023-11-09T13:29:02.774 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-11-09T13:29:02.784 INFO:teuthology.provision.fog.smithi100:Scheduling deploy of ubuntu 22.04 2023-11-09T13:29:02.785 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /task/active None 2023-11-09T13:29:02.970 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /tasktype {"name": "deploy"} 2023-11-09T13:29:02.976 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /tasktype {"name": "deploy"} 2023-11-09T13:29:03.009 DEBUG:teuthology.provision.fog.smithi170:FOG request: POST /host/275/task {"taskTypeID": 1} 2023-11-09T13:29:03.025 DEBUG:teuthology.provision.fog.smithi100:FOG request: POST /host/205/task {"taskTypeID": 1} 2023-11-09T13:29:03.075 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-11-09T13:29:03.089 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /task/active None 2023-11-09T13:29:03.269 INFO:teuthology.orchestra.console.smithi170:Power off 2023-11-09T13:29:03.270 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-09T13:29:03.290 DEBUG:teuthology.orchestra.console.smithi170:power off output: Chassis Power Control: Down/Off 2023-11-09T13:29:03.290 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T13:29:03.304 INFO:teuthology.orchestra.console.smithi100:Power off 2023-11-09T13:29:03.304 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-09T13:29:03.312 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is off 2023-11-09T13:29:03.323 DEBUG:teuthology.orchestra.console.smithi100:power off output: Chassis Power Control: Down/Off 2023-11-09T13:29:03.324 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T13:29:03.343 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is off 2023-11-09T13:29:03.413 INFO:teuthology.orchestra.console.smithi170:Power off completed 2023-11-09T13:29:03.444 INFO:teuthology.orchestra.console.smithi100:Power off completed 2023-11-09T13:29:03.514 INFO:teuthology.orchestra.console.smithi170:Power on 2023-11-09T13:29:03.514 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-09T13:29:03.536 DEBUG:teuthology.orchestra.console.smithi170:power on output: Chassis Power Control: Up/On 2023-11-09T13:29:03.537 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T13:29:03.546 INFO:teuthology.orchestra.console.smithi100:Power on 2023-11-09T13:29:03.547 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-09T13:29:03.558 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is off 2023-11-09T13:29:03.566 DEBUG:teuthology.orchestra.console.smithi100:power on output: Chassis Power Control: Up/On 2023-11-09T13:29:03.566 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T13:29:03.586 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is off 2023-11-09T13:29:07.564 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T13:29:07.587 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T13:29:07.672 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is off 2023-11-09T13:29:07.694 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on 2023-11-09T13:29:07.795 INFO:teuthology.orchestra.console.smithi100:Power on completed 2023-11-09T13:29:07.895 INFO:teuthology.provision.fog.smithi100:Waiting for deploy to finish 2023-11-09T13:29:07.896 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /task/active None 2023-11-09T13:29:11.677 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T13:29:11.785 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is on 2023-11-09T13:29:11.886 INFO:teuthology.orchestra.console.smithi170:Power on completed 2023-11-09T13:29:11.987 INFO:teuthology.provision.fog.smithi170:Waiting for deploy to finish 2023-11-09T13:29:11.987 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-11-09T13:29:23.114 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /task/active None 2023-11-09T13:29:27.174 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-11-09T13:29:38.321 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /task/active None 2023-11-09T13:29:42.390 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-11-09T13:29:53.538 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /task/active None 2023-11-09T13:29:57.664 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-11-09T13:30:08.962 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /task/active None 2023-11-09T13:30:12.936 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-11-09T13:30:24.238 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /task/active None 2023-11-09T13:30:28.298 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-11-09T13:30:39.488 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /task/active None 2023-11-09T13:30:43.513 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-11-09T13:30:54.667 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /task/active None 2023-11-09T13:30:58.757 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-11-09T13:31:09.898 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /task/active None 2023-11-09T13:31:13.938 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-11-09T13:31:25.117 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /task/active None 2023-11-09T13:31:29.110 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-11-09T13:31:40.364 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /task/active None 2023-11-09T13:31:44.315 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-11-09T13:31:55.573 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /task/active None 2023-11-09T13:31:59.482 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-11-09T13:32:10.773 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /task/active None 2023-11-09T13:32:14.634 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-11-09T13:32:25.967 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /task/active None 2023-11-09T13:32:29.790 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-11-09T13:32:41.160 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /task/active None 2023-11-09T13:32:41.316 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T13:32:44.378 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100 2023-11-09T13:32:44.953 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-11-09T13:32:50.386 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T13:32:53.466 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100 2023-11-09T13:32:59.473 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T13:33:00.094 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-11-09T13:33:02.554 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100 2023-11-09T13:33:08.558 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T13:33:11.610 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100 2023-11-09T13:33:15.246 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-11-09T13:33:17.614 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T13:33:20.667 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100 2023-11-09T13:33:26.671 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T13:33:29.722 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100 2023-11-09T13:33:30.402 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-11-09T13:33:35.729 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T13:33:45.559 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-11-09T13:33:54.170 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100 2023-11-09T13:34:00.174 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T13:34:00.685 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-11-09T13:34:03.226 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100 2023-11-09T13:34:09.233 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T13:34:09.235 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100 2023-11-09T13:34:15.239 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T13:34:15.241 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100 2023-11-09T13:34:15.787 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-11-09T13:34:21.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T13:34:21.250 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100 2023-11-09T13:34:27.257 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T13:34:27.259 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100 2023-11-09T13:34:30.882 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-11-09T13:34:33.263 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T13:34:33.435 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-09T13:34:33.435 DEBUG:teuthology.orchestra.run.smithi100:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-09T13:34:34.585 INFO:teuthology.provision.fog.smithi100:Node is ready 2023-11-09T13:34:34.585 DEBUG:teuthology.orchestra.run.smithi100:> hostname 2023-11-09T13:34:34.634 INFO:teuthology.orchestra.run.smithi100.stdout:smithi100.front.sepia.ceph.com 2023-11-09T13:34:34.634 DEBUG:teuthology.orchestra.run.smithi100:> grep smithi100.front.sepia.ceph.com /etc/hosts 2023-11-09T13:34:34.682 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100 smithi100.front.sepia.ceph.com smithi100 2023-11-09T13:34:34.683 DEBUG:teuthology.orchestra.run.smithi100:> sudo hostname smithi100 2023-11-09T13:34:34.847 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i -e 's/smithi100.front.sepia.ceph.com/smithi100/g' /etc/hosts 2023-11-09T13:34:34.861 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i -e 's/172.21.15.100/172.21.15.100/g' /etc/hosts 2023-11-09T13:34:34.914 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i -e 's/smithi100.front.sepia.ceph.com/smithi100/g' /etc/hostname 2023-11-09T13:34:34.970 DEBUG:teuthology.orchestra.run.smithi100:> sudo hostname smithi100 2023-11-09T13:34:35.026 DEBUG:teuthology.orchestra.run.smithi100:> cat /etc/os-release 2023-11-09T13:34:35.074 INFO:teuthology.orchestra.run.smithi100.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-09T13:34:35.074 INFO:teuthology.orchestra.run.smithi100.stdout:NAME="Ubuntu" 2023-11-09T13:34:35.074 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_ID="22.04" 2023-11-09T13:34:35.075 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-09T13:34:35.075 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_CODENAME=jammy 2023-11-09T13:34:35.075 INFO:teuthology.orchestra.run.smithi100.stdout:ID=ubuntu 2023-11-09T13:34:35.075 INFO:teuthology.orchestra.run.smithi100.stdout:ID_LIKE=debian 2023-11-09T13:34:35.075 INFO:teuthology.orchestra.run.smithi100.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-09T13:34:35.076 INFO:teuthology.orchestra.run.smithi100.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-09T13:34:35.076 INFO:teuthology.orchestra.run.smithi100.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-09T13:34:35.076 INFO:teuthology.orchestra.run.smithi100.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-09T13:34:35.076 INFO:teuthology.orchestra.run.smithi100.stdout:UBUNTU_CODENAME=jammy 2023-11-09T13:34:35.077 INFO:teuthology.provision.fog.smithi100:Deploy complete! 2023-11-09T13:34:35.078 DEBUG:teuthology.parallel:result is None 2023-11-09T13:34:45.974 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-11-09T13:35:01.062 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-11-09T13:35:01.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T13:35:04.186 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2023-11-09T13:35:10.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T13:35:13.242 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2023-11-09T13:35:19.249 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T13:35:22.330 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2023-11-09T13:35:28.334 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T13:35:31.386 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2023-11-09T13:35:37.387 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T13:35:40.446 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2023-11-09T13:35:46.448 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T13:35:49.530 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2023-11-09T13:35:55.538 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T13:36:55.599 WARNING:teuthology.provision.fog.smithi170:timed out 2023-11-09T13:37:01.607 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T13:37:01.872 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-09T13:37:01.872 DEBUG:teuthology.orchestra.run.smithi170:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-09T13:37:02.364 INFO:teuthology.provision.fog.smithi170:Node is ready 2023-11-09T13:37:02.364 DEBUG:teuthology.orchestra.run.smithi170:> hostname 2023-11-09T13:37:02.412 INFO:teuthology.orchestra.run.smithi170.stdout:smithi170.front.sepia.ceph.com 2023-11-09T13:37:02.412 DEBUG:teuthology.orchestra.run.smithi170:> grep smithi170.front.sepia.ceph.com /etc/hosts 2023-11-09T13:37:02.460 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170 smithi170.front.sepia.ceph.com smithi170 2023-11-09T13:37:02.460 DEBUG:teuthology.orchestra.run.smithi170:> sudo hostname smithi170 2023-11-09T13:37:02.608 DEBUG:teuthology.orchestra.run.smithi170:> sudo sed -i -e 's/smithi170.front.sepia.ceph.com/smithi170/g' /etc/hosts 2023-11-09T13:37:02.622 DEBUG:teuthology.orchestra.run.smithi170:> sudo sed -i -e 's/172.21.15.170/172.21.15.170/g' /etc/hosts 2023-11-09T13:37:02.675 DEBUG:teuthology.orchestra.run.smithi170:> sudo sed -i -e 's/smithi170.front.sepia.ceph.com/smithi170/g' /etc/hostname 2023-11-09T13:37:02.737 DEBUG:teuthology.orchestra.run.smithi170:> sudo hostname smithi170 2023-11-09T13:37:02.791 DEBUG:teuthology.orchestra.run.smithi170:> cat /etc/os-release 2023-11-09T13:37:02.841 INFO:teuthology.orchestra.run.smithi170.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-09T13:37:02.841 INFO:teuthology.orchestra.run.smithi170.stdout:NAME="Ubuntu" 2023-11-09T13:37:02.842 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_ID="22.04" 2023-11-09T13:37:02.842 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-09T13:37:02.842 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_CODENAME=jammy 2023-11-09T13:37:02.843 INFO:teuthology.orchestra.run.smithi170.stdout:ID=ubuntu 2023-11-09T13:37:02.843 INFO:teuthology.orchestra.run.smithi170.stdout:ID_LIKE=debian 2023-11-09T13:37:02.844 INFO:teuthology.orchestra.run.smithi170.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-09T13:37:02.844 INFO:teuthology.orchestra.run.smithi170.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-09T13:37:02.844 INFO:teuthology.orchestra.run.smithi170.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-09T13:37:02.845 INFO:teuthology.orchestra.run.smithi170.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-09T13:37:02.845 INFO:teuthology.orchestra.run.smithi170.stdout:UBUNTU_CODENAME=jammy 2023-11-09T13:37:02.846 INFO:teuthology.provision.fog.smithi170:Deploy complete! 2023-11-09T13:37:02.847 DEBUG:teuthology.parallel:result is None 2023-11-09T13:37:03.035 INFO:teuthology.lock.ops:Checking smithi100.front.sepia.ceph.com 2023-11-09T13:37:03.036 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-09T13:37:03.060 INFO:teuthology.lock.ops:Checking smithi170.front.sepia.ceph.com 2023-11-09T13:37:03.060 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-09T13:37:03.086 INFO:teuthology.lock.ops:Updating [smithi100.front.sepia.ceph.com]: set os type and version on server 2023-11-09T13:37:03.087 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2023-11-09T13:37:03.087 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T13:37:03.212 DEBUG:teuthology.orchestra.run.smithi100:> true 2023-11-09T13:37:03.434 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi100.front.sepia.ceph.com' 2023-11-09T13:37:03.435 DEBUG:teuthology.orchestra.run.smithi100:> uname -m 2023-11-09T13:37:03.479 INFO:teuthology.orchestra.run.smithi100.stdout:x86_64 2023-11-09T13:37:03.480 DEBUG:teuthology.orchestra.run.smithi100:> cat /etc/os-release 2023-11-09T13:37:03.527 INFO:teuthology.orchestra.run.smithi100.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-09T13:37:03.528 INFO:teuthology.orchestra.run.smithi100.stdout:NAME="Ubuntu" 2023-11-09T13:37:03.528 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_ID="22.04" 2023-11-09T13:37:03.528 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-09T13:37:03.528 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_CODENAME=jammy 2023-11-09T13:37:03.529 INFO:teuthology.orchestra.run.smithi100.stdout:ID=ubuntu 2023-11-09T13:37:03.529 INFO:teuthology.orchestra.run.smithi100.stdout:ID_LIKE=debian 2023-11-09T13:37:03.529 INFO:teuthology.orchestra.run.smithi100.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-09T13:37:03.529 INFO:teuthology.orchestra.run.smithi100.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-09T13:37:03.530 INFO:teuthology.orchestra.run.smithi100.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-09T13:37:03.530 INFO:teuthology.orchestra.run.smithi100.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-09T13:37:03.530 INFO:teuthology.orchestra.run.smithi100.stdout:UBUNTU_CODENAME=jammy 2023-11-09T13:37:03.533 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server 2023-11-09T13:37:03.560 INFO:teuthology.lock.ops:Updating [smithi170.front.sepia.ceph.com]: set os type and version on server 2023-11-09T13:37:03.561 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com' 2023-11-09T13:37:03.561 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T13:37:03.636 DEBUG:teuthology.orchestra.run.smithi170:> true 2023-11-09T13:37:03.743 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi170.front.sepia.ceph.com' 2023-11-09T13:37:03.743 DEBUG:teuthology.orchestra.run.smithi170:> uname -m 2023-11-09T13:37:03.791 INFO:teuthology.orchestra.run.smithi170.stdout:x86_64 2023-11-09T13:37:03.791 DEBUG:teuthology.orchestra.run.smithi170:> cat /etc/os-release 2023-11-09T13:37:03.839 INFO:teuthology.orchestra.run.smithi170.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-09T13:37:03.839 INFO:teuthology.orchestra.run.smithi170.stdout:NAME="Ubuntu" 2023-11-09T13:37:03.840 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_ID="22.04" 2023-11-09T13:37:03.840 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-09T13:37:03.840 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_CODENAME=jammy 2023-11-09T13:37:03.840 INFO:teuthology.orchestra.run.smithi170.stdout:ID=ubuntu 2023-11-09T13:37:03.840 INFO:teuthology.orchestra.run.smithi170.stdout:ID_LIKE=debian 2023-11-09T13:37:03.841 INFO:teuthology.orchestra.run.smithi170.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-09T13:37:03.841 INFO:teuthology.orchestra.run.smithi170.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-09T13:37:03.841 INFO:teuthology.orchestra.run.smithi170.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-09T13:37:03.841 INFO:teuthology.orchestra.run.smithi170.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-09T13:37:03.841 INFO:teuthology.orchestra.run.smithi170.stdout:UBUNTU_CODENAME=jammy 2023-11-09T13:37:03.842 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server 2023-11-09T13:37:03.877 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T13:37:03.970 INFO:teuthology.dispatcher.supervisor:Running job 7452819 2023-11-09T13:37:03.970 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_gsalomon@teuthology --archive /home/teuthworker/archive/gsalomon-2023-11-09_13:26:30-rgw-exception_cause_crash-distro-default-smithi/7452819 --name gsalomon-2023-11-09_13:26:30-rgw-exception_cause_crash-distro-default-smithi --description rgw/verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} -- /home/teuthworker/archive/gsalomon-2023-11-09_13:26:30-rgw-exception_cause_crash-distro-default-smithi/7452819/orig.config.yaml 2023-11-09T13:37:03.973 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/gsalomon-2023-11-09_13:26:30-rgw-exception_cause_crash-distro-default-smithi/7452819 2023-11-09T13:37:03.974 INFO:teuthology.dispatcher.supervisor:Job PID: 70551 2023-11-09T13:37:03.975 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-09T13:39:04.075 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T13:41:04.247 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T13:43:04.434 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T13:45:04.628 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T13:47:04.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T13:49:05.003 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T13:51:05.168 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T13:53:05.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T13:55:05.508 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T13:57:05.671 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T13:59:05.835 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T14:01:06.000 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T14:03:06.175 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T14:05:06.352 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T14:07:06.523 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T14:09:06.696 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T14:11:06.863 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T14:13:07.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T14:15:07.195 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T14:17:07.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T14:19:07.580 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T14:21:07.744 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T14:23:07.875 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T14:25:08.047 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T14:27:08.212 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T14:29:08.420 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T14:31:08.597 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T14:33:08.761 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T14:35:08.934 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T14:37:09.103 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T14:39:09.321 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T14:41:09.495 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T14:43:09.659 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T14:45:09.820 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T14:47:09.993 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T14:49:10.175 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T14:51:10.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T14:53:10.511 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T14:55:10.679 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T14:57:10.851 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T14:59:11.019 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T15:01:11.187 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T15:03:11.359 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T15:05:11.530 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T15:07:11.693 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T15:09:11.861 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T15:09:11.934 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-11-09T15:09:12.138 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-09T15:09:12.139 INFO:teuthology.nuke:Checking targets against current locks 2023-11-09T15:09:12.191 DEBUG:teuthology.nuke:shortname: smithi100 2023-11-09T15:09:12.191 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-09T15:09:12.209 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi100.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gsalomon-2023-11-09_13:26:30-rgw-exception_cause_crash-distro-default-smithi/7452819', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-09 13:29:01.675012', 'locked_by': 'scheduled_gsalomon@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIQnieQGNtIxUTH1QTDTNXHM/JZNS6Y/w2hbOyJlbC2rjk5txgdz9RkZPLgZ2O6PmZyqDUdIygMEIQu9CKQcugY='} 2023-11-09T15:09:12.213 DEBUG:teuthology.nuke:shortname: smithi170 2023-11-09T15:09:12.213 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-09T15:09:12.231 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi170.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gsalomon-2023-11-09_13:26:30-rgw-exception_cause_crash-distro-default-smithi/7452819', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-09 13:29:01.676797', 'locked_by': 'scheduled_gsalomon@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMMAxlrXUyHWDxRAD5WgnKkiYksi1tOzGs+nOwH9QV6Z9pvVu6lkrr84TdwY+QgnRad9BvLVW9sdmul/Qvxa2W8='} 2023-11-09T15:09:12.259 INFO:teuthology.orchestra.console.smithi100:Power off 2023-11-09T15:09:12.260 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-09T15:09:12.272 INFO:teuthology.orchestra.console.smithi170:Power off 2023-11-09T15:09:12.272 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-09T15:09:12.283 DEBUG:teuthology.orchestra.console.smithi100:power off output: Chassis Power Control: Down/Off 2023-11-09T15:09:12.284 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T15:09:12.292 DEBUG:teuthology.orchestra.console.smithi170:power off output: Chassis Power Control: Down/Off 2023-11-09T15:09:12.293 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T15:09:12.304 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is off 2023-11-09T15:09:12.313 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is off 2023-11-09T15:09:12.405 INFO:teuthology.orchestra.console.smithi100:Power off completed 2023-11-09T15:09:12.415 INFO:teuthology.orchestra.console.smithi170:Power off completed 2023-11-09T15:09:12.557 INFO:teuthology.lock.ops:unlocked: smithi100.front.sepia.ceph.com 2023-11-09T15:09:12.564 INFO:teuthology.lock.ops:unlocked: smithi170.front.sepia.ceph.com