2023-09-21T21:09:11.279 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc
2023-09-21T21:09:11.280 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T21:09:11.417 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fdfd6276bb0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fdfd6d60670>, signals=[15])
2023-09-21T21:09:11.418 INFO:teuthology.lock.ops:Start node 'smithi110.front.sepia.ceph.com' reimaging
2023-09-21T21:09:11.418 INFO:teuthology.lock.ops:Updating [smithi110.front.sepia.ceph.com]: reset os type and version on server
2023-09-21T21:09:11.418 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server
2023-09-21T21:09:11.436 INFO:teuthology.lock.ops:Start node 'smithi138.front.sepia.ceph.com' reimaging
2023-09-21T21:09:11.436 INFO:teuthology.lock.ops:Updating [smithi138.front.sepia.ceph.com]: reset os type and version on server
2023-09-21T21:09:11.436 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server
2023-09-21T21:09:11.437 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /host {"name": "smithi110"}
2023-09-21T21:09:11.461 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /host {"name": "smithi138"}
2023-09-21T21:09:11.499 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /image {"name": "smithi_ubuntu_20.04"}
2023-09-21T21:09:11.525 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /image {"name": "smithi_ubuntu_20.04"}
2023-09-21T21:09:11.541 DEBUG:teuthology.provision.fog.smithi110:Requesting image smithi_ubuntu_20.04 (ID 2)
2023-09-21T21:09:11.541 DEBUG:teuthology.provision.fog.smithi110:FOG request: PUT /host/215 {"imageID": 2}
2023-09-21T21:09:11.571 DEBUG:teuthology.provision.fog.smithi138:Requesting image smithi_ubuntu_20.04 (ID 2)
2023-09-21T21:09:11.571 DEBUG:teuthology.provision.fog.smithi138:FOG request: PUT /host/243 {"imageID": 2}
2023-09-21T21:09:11.585 INFO:teuthology.provision.fog.smithi110:Scheduling deploy of ubuntu 20.04
2023-09-21T21:09:11.585 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-09-21T21:09:11.617 INFO:teuthology.provision.fog.smithi138:Scheduling deploy of ubuntu 20.04
2023-09-21T21:09:11.617 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-09-21T21:09:11.647 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /tasktype {"name": "deploy"}
2023-09-21T21:09:11.662 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /tasktype {"name": "deploy"}
2023-09-21T21:09:11.681 DEBUG:teuthology.provision.fog.smithi110:FOG request: POST /host/215/task {"taskTypeID": 1}
2023-09-21T21:09:11.697 DEBUG:teuthology.provision.fog.smithi138:FOG request: POST /host/243/task {"taskTypeID": 1}
2023-09-21T21:09:11.727 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-09-21T21:09:11.741 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-09-21T21:09:11.815 INFO:teuthology.orchestra.console.smithi110:Power off
2023-09-21T21:09:11.815 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-21T21:09:11.827 INFO:teuthology.orchestra.console.smithi138:Power off
2023-09-21T21:09:11.827 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-21T21:09:11.836 DEBUG:teuthology.orchestra.console.smithi110:power off output: Chassis Power Control: Down/Off
2023-09-21T21:09:11.836 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T21:09:11.847 DEBUG:teuthology.orchestra.console.smithi138:power off output: Chassis Power Control: Down/Off
2023-09-21T21:09:11.847 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T21:09:11.856 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is on
2023-09-21T21:09:11.871 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is on
2023-09-21T21:09:15.858 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T21:09:15.872 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T21:09:15.967 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is on
2023-09-21T21:09:15.980 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is on
2023-09-21T21:09:19.970 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T21:09:19.981 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T21:09:20.078 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off
2023-09-21T21:09:20.088 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is off
2023-09-21T21:09:20.179 INFO:teuthology.orchestra.console.smithi110:Power off completed
2023-09-21T21:09:20.189 INFO:teuthology.orchestra.console.smithi138:Power off completed
2023-09-21T21:09:20.280 INFO:teuthology.orchestra.console.smithi110:Power on
2023-09-21T21:09:20.280 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-21T21:09:20.290 INFO:teuthology.orchestra.console.smithi138:Power on
2023-09-21T21:09:20.290 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-21T21:09:20.299 DEBUG:teuthology.orchestra.console.smithi110:power on output: Chassis Power Control: Up/On
2023-09-21T21:09:20.300 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T21:09:20.310 DEBUG:teuthology.orchestra.console.smithi138:power on output: Chassis Power Control: Up/On
2023-09-21T21:09:20.310 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T21:09:20.320 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off
2023-09-21T21:09:20.328 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is off
2023-09-21T21:09:24.324 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T21:09:24.330 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T21:09:24.433 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off
2023-09-21T21:09:24.437 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is off
2023-09-21T21:09:28.438 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T21:09:28.444 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T21:09:28.546 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is on
2023-09-21T21:09:28.551 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is on
2023-09-21T21:09:28.648 INFO:teuthology.orchestra.console.smithi110:Power on completed
2023-09-21T21:09:28.652 INFO:teuthology.orchestra.console.smithi138:Power on completed
2023-09-21T21:09:28.749 INFO:teuthology.provision.fog.smithi110:Waiting for deploy to finish
2023-09-21T21:09:28.749 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-09-21T21:09:28.753 INFO:teuthology.provision.fog.smithi138:Waiting for deploy to finish
2023-09-21T21:09:28.753 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-09-21T21:09:43.824 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-09-21T21:09:43.826 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-09-21T21:09:58.898 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-09-21T21:09:58.900 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-09-21T21:10:13.974 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-09-21T21:10:13.975 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-09-21T21:10:29.040 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-09-21T21:10:29.042 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-09-21T21:10:44.114 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-09-21T21:10:44.115 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-09-21T21:10:59.186 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-09-21T21:10:59.188 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-09-21T21:11:14.266 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-09-21T21:11:14.267 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-09-21T21:11:29.339 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-09-21T21:11:29.340 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-09-21T21:11:44.426 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-09-21T21:11:44.427 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-09-21T21:11:59.505 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-09-21T21:11:59.507 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-09-21T21:12:14.582 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-09-21T21:12:14.583 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-09-21T21:12:29.654 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-09-21T21:12:29.655 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-09-21T21:12:44.717 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-09-21T21:12:44.719 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-09-21T21:12:59.783 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-09-21T21:12:59.785 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-09-21T21:13:14.859 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-09-21T21:13:14.861 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-09-21T21:13:14.909 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-21T21:13:14.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-21T21:13:33.310 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110
2023-09-21T21:13:33.311 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138
2023-09-21T21:13:39.314 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-21T21:13:39.316 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-21T21:13:42.394 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110
2023-09-21T21:13:42.395 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138
2023-09-21T21:13:48.398 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-21T21:13:48.400 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-21T21:13:51.450 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138
2023-09-21T21:13:51.451 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110
2023-09-21T21:13:57.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-21T21:13:57.456 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-21T21:14:00.506 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110
2023-09-21T21:14:00.507 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138
2023-09-21T21:14:06.513 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-21T21:14:06.515 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-21T21:14:38.775 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-09-21T21:14:38.776 DEBUG:teuthology.orchestra.run.smithi110:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-09-21T21:15:00.445 INFO:teuthology.provision.fog.smithi110:Node is ready
2023-09-21T21:15:00.445 DEBUG:teuthology.orchestra.run.smithi110:> hostname
2023-09-21T21:15:00.493 INFO:teuthology.orchestra.run.smithi110.stdout:smithi110.front.sepia.ceph.com
2023-09-21T21:15:00.493 DEBUG:teuthology.orchestra.run.smithi110:> grep smithi110.front.sepia.ceph.com /etc/hosts
2023-09-21T21:15:00.500 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110 smithi110.front.sepia.ceph.com smithi110
2023-09-21T21:15:00.501 DEBUG:teuthology.orchestra.run.smithi110:> sudo hostname smithi110
2023-09-21T21:15:00.576 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/smithi110.front.sepia.ceph.com/smithi110/g' /etc/hosts
2023-09-21T21:15:00.592 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/172.21.15.110/172.21.15.110/g' /etc/hosts
2023-09-21T21:15:00.606 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/smithi110.front.sepia.ceph.com/smithi110/g' /etc/hostname
2023-09-21T21:15:00.619 DEBUG:teuthology.orchestra.run.smithi110:> sudo hostname smithi110
2023-09-21T21:15:00.627 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release
2023-09-21T21:15:00.676 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="Ubuntu"
2023-09-21T21:15:00.676 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="20.04.4 LTS (Focal Fossa)"
2023-09-21T21:15:00.676 INFO:teuthology.orchestra.run.smithi110.stdout:ID=ubuntu
2023-09-21T21:15:00.676 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE=debian
2023-09-21T21:15:00.676 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS"
2023-09-21T21:15:00.676 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="20.04"
2023-09-21T21:15:00.676 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://www.ubuntu.com/"
2023-09-21T21:15:00.676 INFO:teuthology.orchestra.run.smithi110.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-09-21T21:15:00.676 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-09-21T21:15:00.676 INFO:teuthology.orchestra.run.smithi110.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-09-21T21:15:00.677 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_CODENAME=focal
2023-09-21T21:15:00.677 INFO:teuthology.orchestra.run.smithi110.stdout:UBUNTU_CODENAME=focal
2023-09-21T21:15:00.677 INFO:teuthology.provision.fog.smithi110:Deploy complete!
2023-09-21T21:15:00.678 DEBUG:teuthology.parallel:result is None
2023-09-21T21:15:06.522 WARNING:teuthology.provision.fog.smithi138:timed out
2023-09-21T21:15:12.526 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-21T21:15:12.615 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-09-21T21:15:12.615 DEBUG:teuthology.orchestra.run.smithi138:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-09-21T21:15:13.080 INFO:teuthology.provision.fog.smithi138:Node is ready
2023-09-21T21:15:13.081 DEBUG:teuthology.orchestra.run.smithi138:> hostname
2023-09-21T21:15:13.087 INFO:teuthology.orchestra.run.smithi138.stdout:smithi138.front.sepia.ceph.com
2023-09-21T21:15:13.087 DEBUG:teuthology.orchestra.run.smithi138:> grep smithi138.front.sepia.ceph.com /etc/hosts
2023-09-21T21:15:13.094 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138 smithi138.front.sepia.ceph.com smithi138
2023-09-21T21:15:13.094 DEBUG:teuthology.orchestra.run.smithi138:> sudo hostname smithi138
2023-09-21T21:15:13.222 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i -e 's/smithi138.front.sepia.ceph.com/smithi138/g' /etc/hosts
2023-09-21T21:15:13.239 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i -e 's/172.21.15.138/172.21.15.138/g' /etc/hosts
2023-09-21T21:15:13.254 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i -e 's/smithi138.front.sepia.ceph.com/smithi138/g' /etc/hostname
2023-09-21T21:15:13.268 DEBUG:teuthology.orchestra.run.smithi138:> sudo hostname smithi138
2023-09-21T21:15:13.323 DEBUG:teuthology.orchestra.run.smithi138:> cat /etc/os-release
2023-09-21T21:15:13.330 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="Ubuntu"
2023-09-21T21:15:13.330 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="20.04.4 LTS (Focal Fossa)"
2023-09-21T21:15:13.330 INFO:teuthology.orchestra.run.smithi138.stdout:ID=ubuntu
2023-09-21T21:15:13.330 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE=debian
2023-09-21T21:15:13.331 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS"
2023-09-21T21:15:13.331 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="20.04"
2023-09-21T21:15:13.331 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://www.ubuntu.com/"
2023-09-21T21:15:13.331 INFO:teuthology.orchestra.run.smithi138.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-09-21T21:15:13.331 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-09-21T21:15:13.331 INFO:teuthology.orchestra.run.smithi138.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-09-21T21:15:13.331 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_CODENAME=focal
2023-09-21T21:15:13.331 INFO:teuthology.orchestra.run.smithi138.stdout:UBUNTU_CODENAME=focal
2023-09-21T21:15:13.331 INFO:teuthology.provision.fog.smithi138:Deploy complete!
2023-09-21T21:15:13.332 DEBUG:teuthology.parallel:result is None
2023-09-21T21:15:13.581 INFO:teuthology.lock.ops:Checking smithi110.front.sepia.ceph.com
2023-09-21T21:15:13.581 INFO:teuthology.lock.ops:New key found. Updating...
2023-09-21T21:15:13.597 INFO:teuthology.lock.ops:Checking smithi138.front.sepia.ceph.com
2023-09-21T21:15:13.597 INFO:teuthology.lock.ops:New key found. Updating...
2023-09-21T21:15:13.615 INFO:teuthology.lock.ops:Updating [smithi110.front.sepia.ceph.com]: set os type and version on server
2023-09-21T21:15:13.615 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com'
2023-09-21T21:15:13.616 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-21T21:15:13.665 DEBUG:teuthology.orchestra.run.smithi110:> true
2023-09-21T21:15:13.876 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi110.front.sepia.ceph.com'
2023-09-21T21:15:13.876 DEBUG:teuthology.orchestra.run.smithi110:> uname -m
2023-09-21T21:15:13.882 INFO:teuthology.orchestra.run.smithi110.stdout:x86_64
2023-09-21T21:15:13.882 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release
2023-09-21T21:15:13.889 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="Ubuntu"
2023-09-21T21:15:13.889 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="20.04.4 LTS (Focal Fossa)"
2023-09-21T21:15:13.889 INFO:teuthology.orchestra.run.smithi110.stdout:ID=ubuntu
2023-09-21T21:15:13.889 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE=debian
2023-09-21T21:15:13.889 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS"
2023-09-21T21:15:13.889 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="20.04"
2023-09-21T21:15:13.889 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://www.ubuntu.com/"
2023-09-21T21:15:13.889 INFO:teuthology.orchestra.run.smithi110.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-09-21T21:15:13.889 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-09-21T21:15:13.889 INFO:teuthology.orchestra.run.smithi110.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-09-21T21:15:13.890 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_CODENAME=focal
2023-09-21T21:15:13.890 INFO:teuthology.orchestra.run.smithi110.stdout:UBUNTU_CODENAME=focal
2023-09-21T21:15:13.890 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server
2023-09-21T21:15:13.914 INFO:teuthology.lock.ops:Updating [smithi138.front.sepia.ceph.com]: set os type and version on server
2023-09-21T21:15:13.914 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com'
2023-09-21T21:15:13.915 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-21T21:15:13.961 DEBUG:teuthology.orchestra.run.smithi138:> true
2023-09-21T21:15:14.084 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi138.front.sepia.ceph.com'
2023-09-21T21:15:14.084 DEBUG:teuthology.orchestra.run.smithi138:> uname -m
2023-09-21T21:15:14.090 INFO:teuthology.orchestra.run.smithi138.stdout:x86_64
2023-09-21T21:15:14.091 DEBUG:teuthology.orchestra.run.smithi138:> cat /etc/os-release
2023-09-21T21:15:14.096 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="Ubuntu"
2023-09-21T21:15:14.096 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="20.04.4 LTS (Focal Fossa)"
2023-09-21T21:15:14.096 INFO:teuthology.orchestra.run.smithi138.stdout:ID=ubuntu
2023-09-21T21:15:14.096 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE=debian
2023-09-21T21:15:14.097 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS"
2023-09-21T21:15:14.097 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="20.04"
2023-09-21T21:15:14.097 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://www.ubuntu.com/"
2023-09-21T21:15:14.097 INFO:teuthology.orchestra.run.smithi138.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-09-21T21:15:14.097 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-09-21T21:15:14.097 INFO:teuthology.orchestra.run.smithi138.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-09-21T21:15:14.097 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_CODENAME=focal
2023-09-21T21:15:14.097 INFO:teuthology.orchestra.run.smithi138.stdout:UBUNTU_CODENAME=focal
2023-09-21T21:15:14.097 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server
2023-09-21T21:15:14.122 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T21:15:14.200 INFO:teuthology.dispatcher.supervisor:Running job 7400335
2023-09-21T21:15:14.200 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_cbodley@teuthology --archive /home/teuthworker/archive/cbodley-2023-09-21_19:55:28-rgw-main-distro-default-smithi/7400335 --name cbodley-2023-09-21_19:55:28-rgw-main-distro-default-smithi --description rgw/multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/two-zonegroup supported-random-distro$/{ubuntu_20.04} tasks/test_multi} -- /home/teuthworker/archive/cbodley-2023-09-21_19:55:28-rgw-main-distro-default-smithi/7400335/orig.config.yaml
2023-09-21T21:15:14.203 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/cbodley-2023-09-21_19:55:28-rgw-main-distro-default-smithi/7400335
2023-09-21T21:15:14.203 INFO:teuthology.dispatcher.supervisor:Job PID: 1197582
2023-09-21T21:15:14.203 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-09-21T21:17:14.302 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T21:19:14.460 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T21:21:14.627 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T21:23:14.791 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T21:25:14.958 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T21:27:15.203 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T21:29:15.366 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T21:31:15.535 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T21:33:15.854 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T21:35:16.027 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T21:37:16.191 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T21:39:16.355 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T21:41:16.511 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T21:43:16.686 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T21:45:16.859 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T21:47:17.026 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T21:49:17.192 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T21:51:17.355 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T21:53:17.518 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T21:55:17.679 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T21:57:17.844 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T21:59:18.006 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T22:01:18.270 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T22:03:18.433 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T22:05:18.599 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T22:07:18.770 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T22:09:18.939 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T22:11:19.109 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T22:13:19.279 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T22:15:19.438 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T22:17:19.603 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T22:19:19.764 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T22:21:19.932 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T22:23:20.094 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T22:25:20.212 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T22:27:20.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T22:29:20.570 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T22:31:20.699 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T22:33:20.766 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T22:35:20.924 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T22:37:21.095 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T22:39:21.248 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T22:41:21.411 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T22:43:21.588 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T22:45:21.748 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T22:47:21.907 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T22:49:22.071 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T22:51:22.239 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T22:53:22.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T22:55:22.575 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T22:57:22.740 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T22:59:22.806 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T23:01:22.967 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T23:03:23.147 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T23:05:23.306 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T23:07:23.425 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T23:09:23.583 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T23:11:23.735 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T23:13:23.891 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T23:15:24.050 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T23:17:24.215 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T23:19:24.374 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T23:19:24.438 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-09-21T23:19:24.546 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-09-21T23:19:24.546 INFO:teuthology.nuke:Checking targets against current locks
2023-09-21T23:19:24.596 DEBUG:teuthology.nuke:shortname: smithi110
2023-09-21T23:19:24.596 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-09-21T23:19:24.618 DEBUG:teuthology.nuke:shortname: smithi138
2023-09-21T23:19:24.618 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-09-21T23:19:24.622 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi110.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2023-09-21_19:55:28-rgw-main-distro-default-smithi/7400335', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-21 21:09:10.515627', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}
2023-09-21T23:19:24.646 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi138.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2023-09-21_19:55:28-rgw-main-distro-default-smithi/7400335', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-21 21:09:10.517551', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}
2023-09-21T23:19:24.674 INFO:teuthology.orchestra.console.smithi110:Power off
2023-09-21T23:19:24.675 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-21T23:19:24.698 DEBUG:teuthology.orchestra.console.smithi110:power off output: Chassis Power Control: Down/Off
2023-09-21T23:19:24.698 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T23:19:24.711 INFO:teuthology.orchestra.console.smithi138:Power off
2023-09-21T23:19:24.711 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-21T23:19:24.719 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off
2023-09-21T23:19:24.731 DEBUG:teuthology.orchestra.console.smithi138:power off output: Chassis Power Control: Down/Off
2023-09-21T23:19:24.732 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T23:19:24.751 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is off
2023-09-21T23:19:24.820 INFO:teuthology.orchestra.console.smithi110:Power off completed
2023-09-21T23:19:24.853 INFO:teuthology.orchestra.console.smithi138:Power off completed
2023-09-21T23:19:24.980 INFO:teuthology.lock.ops:unlocked: smithi110.front.sepia.ceph.com
2023-09-21T23:19:24.996 INFO:teuthology.lock.ops:unlocked: smithi138.front.sepia.ceph.com