2023-10-16T01:30:50.601 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07
2023-10-16T01:30:50.602 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-16T01:30:50.731 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f295832dac0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f29580ceca0>, signals=[15])
2023-10-16T01:30:50.732 INFO:teuthology.lock.ops:Start node 'smithi111.front.sepia.ceph.com' reimaging
2023-10-16T01:30:50.733 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: reset os type and version on server
2023-10-16T01:30:50.733 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server
2023-10-16T01:30:50.759 INFO:teuthology.lock.ops:Start node 'smithi155.front.sepia.ceph.com' reimaging
2023-10-16T01:30:50.759 INFO:teuthology.lock.ops:Updating [smithi155.front.sepia.ceph.com]: reset os type and version on server
2023-10-16T01:30:50.760 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server
2023-10-16T01:30:50.761 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /host {"name": "smithi111"}
2023-10-16T01:30:50.784 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /host {"name": "smithi155"}
2023-10-16T01:30:50.832 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /image {"name": "smithi_ubuntu_22.04"}
2023-10-16T01:30:50.859 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /image {"name": "smithi_ubuntu_22.04"}
2023-10-16T01:30:50.883 DEBUG:teuthology.provision.fog.smithi111:Requesting image smithi_ubuntu_22.04 (ID 6)
2023-10-16T01:30:50.883 DEBUG:teuthology.provision.fog.smithi111:FOG request: PUT /host/216 {"imageID": 6}
2023-10-16T01:30:50.916 DEBUG:teuthology.provision.fog.smithi155:Requesting image smithi_ubuntu_22.04 (ID 6)
2023-10-16T01:30:50.917 DEBUG:teuthology.provision.fog.smithi155:FOG request: PUT /host/260 {"imageID": 6}
2023-10-16T01:30:50.934 INFO:teuthology.provision.fog.smithi111:Scheduling deploy of ubuntu 22.04
2023-10-16T01:30:50.935 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-10-16T01:30:50.960 INFO:teuthology.provision.fog.smithi155:Scheduling deploy of ubuntu 22.04
2023-10-16T01:30:50.961 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None
2023-10-16T01:30:51.002 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /tasktype {"name": "deploy"}
2023-10-16T01:30:51.016 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /tasktype {"name": "deploy"}
2023-10-16T01:30:51.034 DEBUG:teuthology.provision.fog.smithi111:FOG request: POST /host/216/task {"taskTypeID": 1}
2023-10-16T01:30:51.049 DEBUG:teuthology.provision.fog.smithi155:FOG request: POST /host/260/task {"taskTypeID": 1}
2023-10-16T01:30:51.092 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-10-16T01:30:51.096 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None
2023-10-16T01:30:51.199 INFO:teuthology.orchestra.console.smithi111:Power off
2023-10-16T01:30:51.200 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-16T01:30:51.213 INFO:teuthology.orchestra.console.smithi155:Power off
2023-10-16T01:30:51.214 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-16T01:30:51.222 DEBUG:teuthology.orchestra.console.smithi111:power off output: Chassis Power Control: Down/Off
2023-10-16T01:30:51.222 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-16T01:30:51.237 DEBUG:teuthology.orchestra.console.smithi155:power off output: Chassis Power Control: Down/Off
2023-10-16T01:30:51.237 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-16T01:30:51.245 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off
2023-10-16T01:30:51.260 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is off
2023-10-16T01:30:51.346 INFO:teuthology.orchestra.console.smithi111:Power off completed
2023-10-16T01:30:51.362 INFO:teuthology.orchestra.console.smithi155:Power off completed
2023-10-16T01:30:51.448 INFO:teuthology.orchestra.console.smithi111:Power on
2023-10-16T01:30:51.448 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-10-16T01:30:51.463 INFO:teuthology.orchestra.console.smithi155:Power on
2023-10-16T01:30:51.463 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-10-16T01:30:51.472 DEBUG:teuthology.orchestra.console.smithi111:power on output: Chassis Power Control: Up/On
2023-10-16T01:30:51.472 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-16T01:30:51.486 DEBUG:teuthology.orchestra.console.smithi155:power on output: Chassis Power Control: Up/On
2023-10-16T01:30:51.487 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-16T01:30:51.495 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off
2023-10-16T01:30:51.507 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is off
2023-10-16T01:30:55.500 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-16T01:30:55.508 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-16T01:30:55.610 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off
2023-10-16T01:30:55.619 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is off
2023-10-16T01:30:59.615 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-16T01:30:59.622 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-16T01:30:59.724 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on
2023-10-16T01:30:59.745 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is on
2023-10-16T01:30:59.826 INFO:teuthology.orchestra.console.smithi111:Power on completed
2023-10-16T01:30:59.846 INFO:teuthology.orchestra.console.smithi155:Power on completed
2023-10-16T01:30:59.927 INFO:teuthology.provision.fog.smithi111:Waiting for deploy to finish
2023-10-16T01:30:59.928 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-10-16T01:30:59.948 INFO:teuthology.provision.fog.smithi155:Waiting for deploy to finish
2023-10-16T01:30:59.948 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None
2023-10-16T01:31:15.027 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-10-16T01:31:15.028 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None
2023-10-16T01:31:30.114 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-10-16T01:31:30.116 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None
2023-10-16T01:31:45.197 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-10-16T01:31:45.198 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None
2023-10-16T01:32:00.302 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None
2023-10-16T01:32:00.305 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-10-16T01:32:15.412 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-10-16T01:32:15.414 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None
2023-10-16T01:32:30.504 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None
2023-10-16T01:32:30.505 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-10-16T01:32:45.616 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-10-16T01:32:45.618 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None
2023-10-16T01:33:00.696 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None
2023-10-16T01:33:00.699 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-10-16T01:33:15.805 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None
2023-10-16T01:33:15.806 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-10-16T01:33:30.903 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None
2023-10-16T01:33:30.905 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-10-16T01:33:45.994 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-10-16T01:33:45.996 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None
2023-10-16T01:34:01.078 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-10-16T01:34:01.079 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None
2023-10-16T01:34:16.164 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None
2023-10-16T01:34:16.166 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-10-16T01:34:16.237 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-16T01:34:16.240 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-16T01:34:16.328 ERROR:teuthology.orchestra.connection:Error authenticating with smithi111.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-10-16T01:34:34.618 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155
2023-10-16T01:34:40.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-16T01:34:43.674 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155
2023-10-16T01:34:49.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-16T01:34:52.730 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155
2023-10-16T01:34:58.735 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-16T01:35:01.786 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155
2023-10-16T01:35:07.788 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-16T01:35:10.846 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155
2023-10-16T01:35:16.847 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-16T01:35:19.898 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155
2023-10-16T01:35:20.333 WARNING:teuthology.provision.fog.smithi111:timed out
2023-10-16T01:35:25.900 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-16T01:35:26.335 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-16T01:36:25.903 WARNING:teuthology.provision.fog.smithi155:timed out
2023-10-16T01:36:26.337 WARNING:teuthology.provision.fog.smithi111:timed out
2023-10-16T01:36:31.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-16T01:36:32.202 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-10-16T01:36:32.203 DEBUG:teuthology.orchestra.run.smithi155:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-10-16T01:36:32.339 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-16T01:36:32.341 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-10-16T01:36:32.668 INFO:teuthology.provision.fog.smithi155:Node is ready
2023-10-16T01:36:32.668 DEBUG:teuthology.orchestra.run.smithi155:> hostname
2023-10-16T01:36:32.713 INFO:teuthology.orchestra.run.smithi155.stdout:smithi155.front.sepia.ceph.com
2023-10-16T01:36:32.713 DEBUG:teuthology.orchestra.run.smithi155:> grep smithi155.front.sepia.ceph.com /etc/hosts
2023-10-16T01:36:32.765 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155 smithi155.front.sepia.ceph.com smithi155
2023-10-16T01:36:32.766 DEBUG:teuthology.orchestra.run.smithi155:> sudo hostname smithi155
2023-10-16T01:36:32.892 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i -e 's/smithi155.front.sepia.ceph.com/smithi155/g' /etc/hosts
2023-10-16T01:36:32.906 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i -e 's/172.21.15.155/172.21.15.155/g' /etc/hosts
2023-10-16T01:36:32.961 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i -e 's/smithi155.front.sepia.ceph.com/smithi155/g' /etc/hostname
2023-10-16T01:36:33.018 DEBUG:teuthology.orchestra.run.smithi155:> sudo hostname smithi155
2023-10-16T01:36:33.072 DEBUG:teuthology.orchestra.run.smithi155:> cat /etc/os-release
2023-10-16T01:36:33.121 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-10-16T01:36:33.121 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="Ubuntu"
2023-10-16T01:36:33.121 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="22.04"
2023-10-16T01:36:33.122 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-10-16T01:36:33.122 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_CODENAME=jammy
2023-10-16T01:36:33.122 INFO:teuthology.orchestra.run.smithi155.stdout:ID=ubuntu
2023-10-16T01:36:33.122 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE=debian
2023-10-16T01:36:33.122 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://www.ubuntu.com/"
2023-10-16T01:36:33.123 INFO:teuthology.orchestra.run.smithi155.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-10-16T01:36:33.123 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-10-16T01:36:33.123 INFO:teuthology.orchestra.run.smithi155.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-10-16T01:36:33.123 INFO:teuthology.orchestra.run.smithi155.stdout:UBUNTU_CODENAME=jammy
2023-10-16T01:36:33.124 INFO:teuthology.provision.fog.smithi155:Deploy complete!
2023-10-16T01:36:33.125 DEBUG:teuthology.parallel:result is None
2023-10-16T01:36:38.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-16T01:36:38.594 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-10-16T01:36:38.594 DEBUG:teuthology.orchestra.run.smithi111:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-10-16T01:36:39.016 INFO:teuthology.provision.fog.smithi111:Node is ready
2023-10-16T01:36:39.016 DEBUG:teuthology.orchestra.run.smithi111:> hostname
2023-10-16T01:36:39.065 INFO:teuthology.orchestra.run.smithi111.stdout:smithi111.front.sepia.ceph.com
2023-10-16T01:36:39.066 DEBUG:teuthology.orchestra.run.smithi111:> grep smithi111.front.sepia.ceph.com /etc/hosts
2023-10-16T01:36:39.114 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111 smithi111.front.sepia.ceph.com smithi111
2023-10-16T01:36:39.114 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname smithi111
2023-10-16T01:36:39.250 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/smithi111.front.sepia.ceph.com/smithi111/g' /etc/hosts
2023-10-16T01:36:39.264 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/172.21.15.111/172.21.15.111/g' /etc/hosts
2023-10-16T01:36:39.321 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/smithi111.front.sepia.ceph.com/smithi111/g' /etc/hostname
2023-10-16T01:36:39.382 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname smithi111
2023-10-16T01:36:39.440 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release
2023-10-16T01:36:39.493 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-10-16T01:36:39.493 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="Ubuntu"
2023-10-16T01:36:39.494 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="22.04"
2023-10-16T01:36:39.494 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-10-16T01:36:39.494 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_CODENAME=jammy
2023-10-16T01:36:39.494 INFO:teuthology.orchestra.run.smithi111.stdout:ID=ubuntu
2023-10-16T01:36:39.494 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE=debian
2023-10-16T01:36:39.495 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://www.ubuntu.com/"
2023-10-16T01:36:39.495 INFO:teuthology.orchestra.run.smithi111.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-10-16T01:36:39.495 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-10-16T01:36:39.495 INFO:teuthology.orchestra.run.smithi111.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-10-16T01:36:39.495 INFO:teuthology.orchestra.run.smithi111.stdout:UBUNTU_CODENAME=jammy
2023-10-16T01:36:39.496 INFO:teuthology.provision.fog.smithi111:Deploy complete!
2023-10-16T01:36:39.496 DEBUG:teuthology.parallel:result is None
2023-10-16T01:36:39.702 INFO:teuthology.lock.ops:Checking smithi111.front.sepia.ceph.com
2023-10-16T01:36:39.703 INFO:teuthology.lock.ops:New key found. Updating...
2023-10-16T01:36:39.727 INFO:teuthology.lock.ops:Checking smithi155.front.sepia.ceph.com
2023-10-16T01:36:39.727 INFO:teuthology.lock.ops:New key found. Updating...
2023-10-16T01:36:39.744 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: set os type and version on server
2023-10-16T01:36:39.744 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com'
2023-10-16T01:36:39.745 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-16T01:36:39.816 DEBUG:teuthology.orchestra.run.smithi111:> true
2023-10-16T01:36:39.906 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi111.front.sepia.ceph.com'
2023-10-16T01:36:39.906 DEBUG:teuthology.orchestra.run.smithi111:> uname -m
2023-10-16T01:36:39.952 INFO:teuthology.orchestra.run.smithi111.stdout:x86_64
2023-10-16T01:36:39.953 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release
2023-10-16T01:36:40.000 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-10-16T01:36:40.001 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="Ubuntu"
2023-10-16T01:36:40.001 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="22.04"
2023-10-16T01:36:40.001 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-10-16T01:36:40.001 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_CODENAME=jammy
2023-10-16T01:36:40.002 INFO:teuthology.orchestra.run.smithi111.stdout:ID=ubuntu
2023-10-16T01:36:40.002 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE=debian
2023-10-16T01:36:40.002 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://www.ubuntu.com/"
2023-10-16T01:36:40.002 INFO:teuthology.orchestra.run.smithi111.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-10-16T01:36:40.002 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-10-16T01:36:40.003 INFO:teuthology.orchestra.run.smithi111.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-10-16T01:36:40.003 INFO:teuthology.orchestra.run.smithi111.stdout:UBUNTU_CODENAME=jammy
2023-10-16T01:36:40.003 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server
2023-10-16T01:36:40.018 INFO:teuthology.lock.ops:Updating [smithi155.front.sepia.ceph.com]: set os type and version on server
2023-10-16T01:36:40.019 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com'
2023-10-16T01:36:40.020 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-16T01:36:40.094 DEBUG:teuthology.orchestra.run.smithi155:> true
2023-10-16T01:36:40.186 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi155.front.sepia.ceph.com'
2023-10-16T01:36:40.187 DEBUG:teuthology.orchestra.run.smithi155:> uname -m
2023-10-16T01:36:40.236 INFO:teuthology.orchestra.run.smithi155.stdout:x86_64
2023-10-16T01:36:40.237 DEBUG:teuthology.orchestra.run.smithi155:> cat /etc/os-release
2023-10-16T01:36:40.285 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-10-16T01:36:40.285 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="Ubuntu"
2023-10-16T01:36:40.286 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="22.04"
2023-10-16T01:36:40.286 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-10-16T01:36:40.286 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_CODENAME=jammy
2023-10-16T01:36:40.286 INFO:teuthology.orchestra.run.smithi155.stdout:ID=ubuntu
2023-10-16T01:36:40.287 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE=debian
2023-10-16T01:36:40.287 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://www.ubuntu.com/"
2023-10-16T01:36:40.287 INFO:teuthology.orchestra.run.smithi155.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-10-16T01:36:40.287 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-10-16T01:36:40.287 INFO:teuthology.orchestra.run.smithi155.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-10-16T01:36:40.287 INFO:teuthology.orchestra.run.smithi155.stdout:UBUNTU_CODENAME=jammy
2023-10-16T01:36:40.288 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server
2023-10-16T01:36:40.301 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-16T01:36:40.379 INFO:teuthology.dispatcher.supervisor:Running job 7428496
2023-10-16T01:36:40.379 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-10-15_15:14:14-upgrade:octopus-x-quincy-release-distro-default-smithi/7428496 --name yuriw-2023-10-15_15:14:14-upgrade:octopus-x-quincy-release-distro-default-smithi --description upgrade:octopus-x/rgw-multisite/{clusters frontend overrides realm tasks upgrade/secondary} -- /home/teuthworker/archive/yuriw-2023-10-15_15:14:14-upgrade:octopus-x-quincy-release-distro-default-smithi/7428496/orig.config.yaml
2023-10-16T01:36:40.383 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-10-15_15:14:14-upgrade:octopus-x-quincy-release-distro-default-smithi/7428496
2023-10-16T01:36:40.383 INFO:teuthology.dispatcher.supervisor:Job PID: 1838829
2023-10-16T01:36:40.384 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-10-16T01:38:40.384 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-16T01:40:40.455 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-16T01:42:40.512 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-16T01:44:40.590 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-16T01:46:40.654 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-16T01:48:40.721 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-16T01:48:40.783 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-10-16T01:48:40.879 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-10-16T01:48:40.879 INFO:teuthology.nuke:Checking targets against current locks
2023-10-16T01:48:40.933 DEBUG:teuthology.nuke:shortname: smithi111
2023-10-16T01:48:40.933 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-10-16T01:48:40.951 DEBUG:teuthology.nuke:shortname: smithi155
2023-10-16T01:48:40.952 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-10-16T01:48:40.956 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi111.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-15_15:14:14-upgrade:octopus-x-quincy-release-distro-default-smithi/7428496', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-16 01:30:49.731805', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGOXokT89qPT8oe+WdGjhwH4lBXagSJ1H9lFpOOfBemG6FzZvSRnVl+Ql6Y61mPT1w8FqoB61VE4gijgLW+xaDE='}
2023-10-16T01:48:40.972 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi155.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-15_15:14:14-upgrade:octopus-x-quincy-release-distro-default-smithi/7428496', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-16 01:30:49.730470', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFTieNH0WA5g5T89PfJDV4i1H3iBPZ6Bt363P5am2abKsIFMcUoDPKUcSKtf2kLtIWxlfPsBs2Th8BLX2J8G7iQ='}
2023-10-16T01:48:41.001 INFO:teuthology.orchestra.console.smithi111:Power off
2023-10-16T01:48:41.001 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-16T01:48:41.022 DEBUG:teuthology.orchestra.console.smithi111:power off output: Chassis Power Control: Down/Off
2023-10-16T01:48:41.022 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-16T01:48:41.037 INFO:teuthology.orchestra.console.smithi155:Power off
2023-10-16T01:48:41.038 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-16T01:48:41.047 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off
2023-10-16T01:48:41.060 DEBUG:teuthology.orchestra.console.smithi155:power off output: Chassis Power Control: Down/Off
2023-10-16T01:48:41.060 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-16T01:48:41.081 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is off
2023-10-16T01:48:41.149 INFO:teuthology.orchestra.console.smithi111:Power off completed
2023-10-16T01:48:41.182 INFO:teuthology.orchestra.console.smithi155:Power off completed
2023-10-16T01:48:41.309 INFO:teuthology.lock.ops:unlocked: smithi111.front.sepia.ceph.com
2023-10-16T01:48:41.324 INFO:teuthology.lock.ops:unlocked: smithi155.front.sepia.ceph.com