2023-11-04T01:04:37.971 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2
2023-11-04T01:04:37.971 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-04T01:04:38.100 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fed156e0b50>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fed153dcdc0>, signals=[15])
2023-11-04T01:04:38.100 INFO:teuthology.lock.ops:Start node 'smithi040.front.sepia.ceph.com' reimaging
2023-11-04T01:04:38.100 INFO:teuthology.lock.ops:Updating [smithi040.front.sepia.ceph.com]: reset os type and version on server
2023-11-04T01:04:38.100 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server
2023-11-04T01:04:38.120 INFO:teuthology.lock.ops:Start node 'smithi091.front.sepia.ceph.com' reimaging
2023-11-04T01:04:38.120 INFO:teuthology.lock.ops:Updating [smithi091.front.sepia.ceph.com]: reset os type and version on server
2023-11-04T01:04:38.120 INFO:teuthology.lock.ops:Updating smithi091.front.sepia.ceph.com on lock server
2023-11-04T01:04:38.121 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /host {"name": "smithi040"}
2023-11-04T01:04:38.145 DEBUG:teuthology.provision.fog.smithi091:FOG request: GET /host {"name": "smithi091"}
2023-11-04T01:04:38.181 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /image {"name": "smithi_ubuntu_22.04"}
2023-11-04T01:04:38.210 DEBUG:teuthology.provision.fog.smithi091:FOG request: GET /image {"name": "smithi_ubuntu_22.04"}
2023-11-04T01:04:38.223 DEBUG:teuthology.provision.fog.smithi040:Requesting image smithi_ubuntu_22.04 (ID 6)
2023-11-04T01:04:38.223 DEBUG:teuthology.provision.fog.smithi040:FOG request: PUT /host/145 {"imageID": 6}
2023-11-04T01:04:38.261 DEBUG:teuthology.provision.fog.smithi091:Requesting image smithi_ubuntu_22.04 (ID 6)
2023-11-04T01:04:38.262 DEBUG:teuthology.provision.fog.smithi091:FOG request: PUT /host/196 {"imageID": 6}
2023-11-04T01:04:38.274 INFO:teuthology.provision.fog.smithi040:Scheduling deploy of ubuntu 22.04
2023-11-04T01:04:38.274 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None
2023-11-04T01:04:38.312 INFO:teuthology.provision.fog.smithi091:Scheduling deploy of ubuntu 22.04
2023-11-04T01:04:38.312 DEBUG:teuthology.provision.fog.smithi091:FOG request: GET /task/active None
2023-11-04T01:04:38.350 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /tasktype {"name": "deploy"}
2023-11-04T01:04:38.369 DEBUG:teuthology.provision.fog.smithi091:FOG request: GET /tasktype {"name": "deploy"}
2023-11-04T01:04:38.383 DEBUG:teuthology.provision.fog.smithi040:FOG request: POST /host/145/task {"taskTypeID": 1}
2023-11-04T01:04:38.405 DEBUG:teuthology.provision.fog.smithi091:FOG request: POST /host/196/task {"taskTypeID": 1}
2023-11-04T01:04:38.467 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None
2023-11-04T01:04:38.480 DEBUG:teuthology.provision.fog.smithi091:FOG request: GET /task/active None
2023-11-04T01:04:38.596 INFO:teuthology.orchestra.console.smithi040:Power off
2023-11-04T01:04:38.596 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-04T01:04:38.607 INFO:teuthology.orchestra.console.smithi091:Power off
2023-11-04T01:04:38.607 DEBUG:teuthology.orchestra.console.smithi091:pexpect command: ipmitool -H smithi091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-04T01:04:38.617 DEBUG:teuthology.orchestra.console.smithi040:power off output: Chassis Power Control: Down/Off
2023-11-04T01:04:38.617 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T01:04:38.627 DEBUG:teuthology.orchestra.console.smithi091:power off output: Chassis Power Control: Down/Off
2023-11-04T01:04:38.627 DEBUG:teuthology.orchestra.console.smithi091:pexpect command: ipmitool -H smithi091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T01:04:38.642 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on
2023-11-04T01:04:38.647 DEBUG:teuthology.orchestra.console.smithi091:check power output: Chassis Power is on
2023-11-04T01:04:42.646 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T01:04:42.653 DEBUG:teuthology.orchestra.console.smithi091:pexpect command: ipmitool -H smithi091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T01:04:42.755 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on
2023-11-04T01:04:42.760 DEBUG:teuthology.orchestra.console.smithi091:check power output: Chassis Power is on
2023-11-04T01:04:46.761 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T01:04:46.768 DEBUG:teuthology.orchestra.console.smithi091:pexpect command: ipmitool -H smithi091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T01:04:46.870 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on
2023-11-04T01:04:46.875 DEBUG:teuthology.orchestra.console.smithi091:check power output: Chassis Power is off
2023-11-04T01:04:46.976 INFO:teuthology.orchestra.console.smithi091:Power off completed
2023-11-04T01:04:47.077 INFO:teuthology.orchestra.console.smithi091:Power on
2023-11-04T01:04:47.077 DEBUG:teuthology.orchestra.console.smithi091:pexpect command: ipmitool -H smithi091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-04T01:04:47.096 DEBUG:teuthology.orchestra.console.smithi091:power on output: Chassis Power Control: Up/On
2023-11-04T01:04:47.097 DEBUG:teuthology.orchestra.console.smithi091:pexpect command: ipmitool -H smithi091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T01:04:47.115 DEBUG:teuthology.orchestra.console.smithi091:check power output: Chassis Power is off
2023-11-04T01:04:50.875 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T01:04:50.985 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is off
2023-11-04T01:04:51.085 INFO:teuthology.orchestra.console.smithi040:Power off completed
2023-11-04T01:04:51.116 DEBUG:teuthology.orchestra.console.smithi091:pexpect command: ipmitool -H smithi091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T01:04:51.187 INFO:teuthology.orchestra.console.smithi040:Power on
2023-11-04T01:04:51.187 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-04T01:04:51.208 DEBUG:teuthology.orchestra.console.smithi040:power on output: Chassis Power Control: Up/On
2023-11-04T01:04:51.208 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T01:04:51.224 DEBUG:teuthology.orchestra.console.smithi091:check power output: Chassis Power is off
2023-11-04T01:04:51.227 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is off
2023-11-04T01:04:55.229 DEBUG:teuthology.orchestra.console.smithi091:pexpect command: ipmitool -H smithi091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T01:04:55.236 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T01:04:55.338 DEBUG:teuthology.orchestra.console.smithi091:check power output: Chassis Power is on
2023-11-04T01:04:55.344 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is off
2023-11-04T01:04:55.440 INFO:teuthology.orchestra.console.smithi091:Power on completed
2023-11-04T01:04:55.540 INFO:teuthology.provision.fog.smithi091:Waiting for deploy to finish
2023-11-04T01:04:55.540 DEBUG:teuthology.provision.fog.smithi091:FOG request: GET /task/active None
2023-11-04T01:04:59.349 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T01:04:59.458 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on
2023-11-04T01:04:59.558 INFO:teuthology.orchestra.console.smithi040:Power on completed
2023-11-04T01:04:59.659 INFO:teuthology.provision.fog.smithi040:Waiting for deploy to finish
2023-11-04T01:04:59.659 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None
2023-11-04T01:05:10.669 DEBUG:teuthology.provision.fog.smithi091:FOG request: GET /task/active None
2023-11-04T01:05:14.765 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None
2023-11-04T01:05:25.780 DEBUG:teuthology.provision.fog.smithi091:FOG request: GET /task/active None
2023-11-04T01:05:29.866 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None
2023-11-04T01:05:40.874 DEBUG:teuthology.provision.fog.smithi091:FOG request: GET /task/active None
2023-11-04T01:05:45.048 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None
2023-11-04T01:05:56.219 DEBUG:teuthology.provision.fog.smithi091:FOG request: GET /task/active None
2023-11-04T01:06:00.285 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None
2023-11-04T01:06:11.458 DEBUG:teuthology.provision.fog.smithi091:FOG request: GET /task/active None
2023-11-04T01:06:15.512 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None
2023-11-04T01:06:26.736 DEBUG:teuthology.provision.fog.smithi091:FOG request: GET /task/active None
2023-11-04T01:06:30.780 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None
2023-11-04T01:06:41.984 DEBUG:teuthology.provision.fog.smithi091:FOG request: GET /task/active None
2023-11-04T01:07:17.103 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None
2023-11-04T01:07:17.124 DEBUG:teuthology.provision.fog.smithi091:FOG request: GET /task/active None
2023-11-04T01:07:37.069 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None
2023-11-04T01:07:37.797 DEBUG:teuthology.provision.fog.smithi091:FOG request: GET /task/active None
2023-11-04T01:07:53.783 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None
2023-11-04T01:07:55.022 DEBUG:teuthology.provision.fog.smithi091:FOG request: GET /task/active None
2023-11-04T01:08:09.646 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None
2023-11-04T01:08:10.505 DEBUG:teuthology.provision.fog.smithi091:FOG request: GET /task/active None
2023-11-04T01:08:25.459 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None
2023-11-04T01:08:25.946 DEBUG:teuthology.provision.fog.smithi091:FOG request: GET /task/active None
2023-11-04T01:08:43.970 DEBUG:teuthology.provision.fog.smithi091:FOG request: GET /task/active None
2023-11-04T01:08:44.183 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None
2023-11-04T01:08:48.357 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-04T01:08:51.418 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40
2023-11-04T01:08:57.425 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-04T01:09:00.506 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40
2023-11-04T01:09:03.330 DEBUG:teuthology.provision.fog.smithi091:FOG request: GET /task/active None
2023-11-04T01:09:06.511 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-04T01:09:07.041 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-04T01:09:09.562 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40
2023-11-04T01:09:10.106 WARNING:teuthology.provision.fog.smithi091:[Errno None] Unable to connect to port 22 on 172.21.15.91
2023-11-04T01:09:15.569 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-04T01:09:16.108 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-04T01:09:18.650 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40
2023-11-04T01:09:19.162 WARNING:teuthology.provision.fog.smithi091:[Errno None] Unable to connect to port 22 on 172.21.15.91
2023-11-04T01:09:24.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-04T01:09:25.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-04T01:09:28.218 WARNING:teuthology.provision.fog.smithi091:[Errno None] Unable to connect to port 22 on 172.21.15.91
2023-11-04T01:09:34.225 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-04T01:09:37.306 WARNING:teuthology.provision.fog.smithi091:[Errno None] Unable to connect to port 22 on 172.21.15.91
2023-11-04T01:09:43.310 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-04T01:09:46.362 WARNING:teuthology.provision.fog.smithi091:[Errno None] Unable to connect to port 22 on 172.21.15.91
2023-11-04T01:09:52.367 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-04T01:09:55.418 WARNING:teuthology.provision.fog.smithi091:[Errno None] Unable to connect to port 22 on 172.21.15.91
2023-11-04T01:10:01.425 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-04T01:10:19.771 WARNING:teuthology.provision.fog.smithi091:[Errno None] Unable to connect to port 22 on 172.21.15.91
2023-11-04T01:10:24.662 WARNING:teuthology.provision.fog.smithi040:timed out
2023-11-04T01:10:25.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-04T01:10:28.826 WARNING:teuthology.provision.fog.smithi091:[Errno None] Unable to connect to port 22 on 172.21.15.91
2023-11-04T01:10:30.665 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-04T01:10:33.691 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40
2023-11-04T01:10:34.829 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-04T01:10:37.883 WARNING:teuthology.provision.fog.smithi091:[Errno None] Unable to connect to port 22 on 172.21.15.91
2023-11-04T01:10:39.693 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-04T01:10:39.873 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-04T01:10:39.874 DEBUG:teuthology.orchestra.run.smithi040:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-04T01:10:40.285 INFO:teuthology.provision.fog.smithi040:Node is ready
2023-11-04T01:10:40.286 DEBUG:teuthology.orchestra.run.smithi040:> hostname
2023-11-04T01:10:40.331 INFO:teuthology.orchestra.run.smithi040.stdout:smithi040.front.sepia.ceph.com
2023-11-04T01:10:40.332 DEBUG:teuthology.orchestra.run.smithi040:> grep smithi040.front.sepia.ceph.com /etc/hosts
2023-11-04T01:10:40.380 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40 smithi040.front.sepia.ceph.com smithi040
2023-11-04T01:10:40.380 DEBUG:teuthology.orchestra.run.smithi040:> sudo hostname smithi040
2023-11-04T01:10:40.555 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/smithi040.front.sepia.ceph.com/smithi040/g' /etc/hosts
2023-11-04T01:10:40.570 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/172.21.15.40/172.21.15.40/g' /etc/hosts
2023-11-04T01:10:40.627 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/smithi040.front.sepia.ceph.com/smithi040/g' /etc/hostname
2023-11-04T01:10:40.684 DEBUG:teuthology.orchestra.run.smithi040:> sudo hostname smithi040
2023-11-04T01:10:40.740 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release
2023-11-04T01:10:40.787 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-11-04T01:10:40.787 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="Ubuntu"
2023-11-04T01:10:40.787 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="22.04"
2023-11-04T01:10:40.788 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-11-04T01:10:40.788 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_CODENAME=jammy
2023-11-04T01:10:40.788 INFO:teuthology.orchestra.run.smithi040.stdout:ID=ubuntu
2023-11-04T01:10:40.788 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE=debian
2023-11-04T01:10:40.788 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://www.ubuntu.com/"
2023-11-04T01:10:40.788 INFO:teuthology.orchestra.run.smithi040.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-11-04T01:10:40.788 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-11-04T01:10:40.788 INFO:teuthology.orchestra.run.smithi040.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-11-04T01:10:40.788 INFO:teuthology.orchestra.run.smithi040.stdout:UBUNTU_CODENAME=jammy
2023-11-04T01:10:40.789 INFO:teuthology.provision.fog.smithi040:Deploy complete!
2023-11-04T01:10:40.790 DEBUG:teuthology.parallel:result is None
2023-11-04T01:10:43.887 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-04T01:10:43.890 WARNING:teuthology.provision.fog.smithi091:[Errno None] Unable to connect to port 22 on 172.21.15.91
2023-11-04T01:10:49.893 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-04T01:10:49.894 WARNING:teuthology.provision.fog.smithi091:[Errno None] Unable to connect to port 22 on 172.21.15.91
2023-11-04T01:10:55.901 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-04T01:10:55.903 WARNING:teuthology.provision.fog.smithi091:[Errno None] Unable to connect to port 22 on 172.21.15.91
2023-11-04T01:11:01.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-04T01:11:01.912 WARNING:teuthology.provision.fog.smithi091:[Errno None] Unable to connect to port 22 on 172.21.15.91
2023-11-04T01:11:07.919 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-04T01:11:08.140 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-04T01:11:08.140 DEBUG:teuthology.orchestra.run.smithi091:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-04T01:11:08.812 INFO:teuthology.provision.fog.smithi091:Node is ready
2023-11-04T01:11:08.812 DEBUG:teuthology.orchestra.run.smithi091:> hostname
2023-11-04T01:11:08.860 INFO:teuthology.orchestra.run.smithi091.stdout:smithi091.front.sepia.ceph.com
2023-11-04T01:11:08.861 DEBUG:teuthology.orchestra.run.smithi091:> grep smithi091.front.sepia.ceph.com /etc/hosts
2023-11-04T01:11:08.909 INFO:teuthology.orchestra.run.smithi091.stdout:172.21.15.91 smithi091.front.sepia.ceph.com smithi091
2023-11-04T01:11:08.909 DEBUG:teuthology.orchestra.run.smithi091:> sudo hostname smithi091
2023-11-04T01:11:09.058 DEBUG:teuthology.orchestra.run.smithi091:> sudo sed -i -e 's/smithi091.front.sepia.ceph.com/smithi091/g' /etc/hosts
2023-11-04T01:11:09.072 DEBUG:teuthology.orchestra.run.smithi091:> sudo sed -i -e 's/172.21.15.91/172.21.15.91/g' /etc/hosts
2023-11-04T01:11:09.129 DEBUG:teuthology.orchestra.run.smithi091:> sudo sed -i -e 's/smithi091.front.sepia.ceph.com/smithi091/g' /etc/hostname
2023-11-04T01:11:09.183 DEBUG:teuthology.orchestra.run.smithi091:> sudo hostname smithi091
2023-11-04T01:11:09.239 DEBUG:teuthology.orchestra.run.smithi091:> cat /etc/os-release
2023-11-04T01:11:09.284 INFO:teuthology.orchestra.run.smithi091.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-11-04T01:11:09.284 INFO:teuthology.orchestra.run.smithi091.stdout:NAME="Ubuntu"
2023-11-04T01:11:09.284 INFO:teuthology.orchestra.run.smithi091.stdout:VERSION_ID="22.04"
2023-11-04T01:11:09.284 INFO:teuthology.orchestra.run.smithi091.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-11-04T01:11:09.284 INFO:teuthology.orchestra.run.smithi091.stdout:VERSION_CODENAME=jammy
2023-11-04T01:11:09.284 INFO:teuthology.orchestra.run.smithi091.stdout:ID=ubuntu
2023-11-04T01:11:09.285 INFO:teuthology.orchestra.run.smithi091.stdout:ID_LIKE=debian
2023-11-04T01:11:09.285 INFO:teuthology.orchestra.run.smithi091.stdout:HOME_URL="https://www.ubuntu.com/"
2023-11-04T01:11:09.285 INFO:teuthology.orchestra.run.smithi091.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-11-04T01:11:09.285 INFO:teuthology.orchestra.run.smithi091.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-11-04T01:11:09.285 INFO:teuthology.orchestra.run.smithi091.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-11-04T01:11:09.285 INFO:teuthology.orchestra.run.smithi091.stdout:UBUNTU_CODENAME=jammy
2023-11-04T01:11:09.285 INFO:teuthology.provision.fog.smithi091:Deploy complete!
2023-11-04T01:11:09.285 DEBUG:teuthology.parallel:result is None
2023-11-04T01:11:09.468 INFO:teuthology.lock.ops:Checking smithi040.front.sepia.ceph.com
2023-11-04T01:11:09.468 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-04T01:11:09.498 INFO:teuthology.lock.ops:Checking smithi091.front.sepia.ceph.com
2023-11-04T01:11:09.498 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-04T01:11:09.516 INFO:teuthology.lock.ops:Updating [smithi040.front.sepia.ceph.com]: set os type and version on server
2023-11-04T01:11:09.516 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com'
2023-11-04T01:11:09.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-04T01:11:09.592 DEBUG:teuthology.orchestra.run.smithi040:> true
2023-11-04T01:11:09.814 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi040.front.sepia.ceph.com'
2023-11-04T01:11:09.814 DEBUG:teuthology.orchestra.run.smithi040:> uname -m
2023-11-04T01:11:09.859 INFO:teuthology.orchestra.run.smithi040.stdout:x86_64
2023-11-04T01:11:09.859 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release
2023-11-04T01:11:09.907 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-11-04T01:11:09.908 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="Ubuntu"
2023-11-04T01:11:09.908 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="22.04"
2023-11-04T01:11:09.908 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-11-04T01:11:09.908 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_CODENAME=jammy
2023-11-04T01:11:09.908 INFO:teuthology.orchestra.run.smithi040.stdout:ID=ubuntu
2023-11-04T01:11:09.908 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE=debian
2023-11-04T01:11:09.908 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://www.ubuntu.com/"
2023-11-04T01:11:09.908 INFO:teuthology.orchestra.run.smithi040.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-11-04T01:11:09.908 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-11-04T01:11:09.908 INFO:teuthology.orchestra.run.smithi040.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-11-04T01:11:09.908 INFO:teuthology.orchestra.run.smithi040.stdout:UBUNTU_CODENAME=jammy
2023-11-04T01:11:09.909 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server
2023-11-04T01:11:09.940 INFO:teuthology.lock.ops:Updating [smithi091.front.sepia.ceph.com]: set os type and version on server
2023-11-04T01:11:09.940 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi091.front.sepia.ceph.com'
2023-11-04T01:11:09.940 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-04T01:11:10.015 DEBUG:teuthology.orchestra.run.smithi091:> true
2023-11-04T01:11:10.118 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi091.front.sepia.ceph.com'
2023-11-04T01:11:10.118 DEBUG:teuthology.orchestra.run.smithi091:> uname -m
2023-11-04T01:11:10.167 INFO:teuthology.orchestra.run.smithi091.stdout:x86_64
2023-11-04T01:11:10.168 DEBUG:teuthology.orchestra.run.smithi091:> cat /etc/os-release
2023-11-04T01:11:10.216 INFO:teuthology.orchestra.run.smithi091.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-11-04T01:11:10.216 INFO:teuthology.orchestra.run.smithi091.stdout:NAME="Ubuntu"
2023-11-04T01:11:10.216 INFO:teuthology.orchestra.run.smithi091.stdout:VERSION_ID="22.04"
2023-11-04T01:11:10.216 INFO:teuthology.orchestra.run.smithi091.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-11-04T01:11:10.216 INFO:teuthology.orchestra.run.smithi091.stdout:VERSION_CODENAME=jammy
2023-11-04T01:11:10.216 INFO:teuthology.orchestra.run.smithi091.stdout:ID=ubuntu
2023-11-04T01:11:10.216 INFO:teuthology.orchestra.run.smithi091.stdout:ID_LIKE=debian
2023-11-04T01:11:10.216 INFO:teuthology.orchestra.run.smithi091.stdout:HOME_URL="https://www.ubuntu.com/"
2023-11-04T01:11:10.216 INFO:teuthology.orchestra.run.smithi091.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-11-04T01:11:10.216 INFO:teuthology.orchestra.run.smithi091.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-11-04T01:11:10.216 INFO:teuthology.orchestra.run.smithi091.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-11-04T01:11:10.217 INFO:teuthology.orchestra.run.smithi091.stdout:UBUNTU_CODENAME=jammy
2023-11-04T01:11:10.217 INFO:teuthology.lock.ops:Updating smithi091.front.sepia.ceph.com on lock server
2023-11-04T01:11:10.240 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-04T01:11:10.333 INFO:teuthology.dispatcher.supervisor:Running job 7445923
2023-11-04T01:11:10.333 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445923 --name pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi --description fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snapshots} -- /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445923/orig.config.yaml
2023-11-04T01:11:10.336 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445923
2023-11-04T01:11:10.337 INFO:teuthology.dispatcher.supervisor:Job PID: 3087375
2023-11-04T01:11:10.337 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-11-04T01:13:10.411 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-04T01:24:49.896 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-04T01:26:50.179 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-04T01:28:50.347 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-04T01:30:50.538 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-04T01:32:50.759 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-04T01:34:51.011 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-04T01:36:51.203 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-04T01:38:51.379 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-04T01:40:51.543 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-04T01:42:51.716 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-04T01:44:51.867 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-04T01:46:52.027 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-04T01:48:52.191 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-04T01:50:52.424 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-04T01:52:52.587 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-04T01:54:52.755 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-04T01:56:52.927 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-04T01:58:53.084 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-04T02:00:53.239 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-04T02:00:53.305 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-11-04T02:00:53.413 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-11-04T02:00:53.414 INFO:teuthology.nuke:Checking targets against current locks
2023-11-04T02:00:53.459 DEBUG:teuthology.nuke:shortname: smithi040
2023-11-04T02:00:53.460 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-04T02:00:53.483 DEBUG:teuthology.nuke:shortname: smithi091
2023-11-04T02:00:53.484 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-04T02:00:53.487 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi040.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445923', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-04 01:04:37.139718', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBObjzkOIRGUA/IGRZGae37U/XDfCXtLtiK/EkhveSRNXY05XcUpf0WEB+mPgaqfQVuR3/mzKeWsP7F092gmawQc='}
2023-11-04T02:00:53.507 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi091.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445923', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-04 01:04:37.138360', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEGp5T0z04DJrPMtyLJse+C9AA/f1IUwrnreXuSXlkCBjRW4LDq6ssOWsdbrX8AQSoEspz75IP7kWmHJtBc1K1Q='}
2023-11-04T02:00:53.540 INFO:teuthology.orchestra.console.smithi040:Power off
2023-11-04T02:00:53.541 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-04T02:00:53.574 INFO:teuthology.orchestra.console.smithi091:Power off
2023-11-04T02:00:53.575 DEBUG:teuthology.orchestra.console.smithi091:pexpect command: ipmitool -H smithi091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-04T02:00:53.584 DEBUG:teuthology.orchestra.console.smithi040:power off output: Chassis Power Control: Down/Off
2023-11-04T02:00:53.585 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T02:00:53.598 DEBUG:teuthology.orchestra.console.smithi091:power off output: Chassis Power Control: Down/Off
2023-11-04T02:00:53.598 DEBUG:teuthology.orchestra.console.smithi091:pexpect command: ipmitool -H smithi091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T02:00:53.610 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is off
2023-11-04T02:00:53.622 DEBUG:teuthology.orchestra.console.smithi091:check power output: Chassis Power is off
2023-11-04T02:00:53.711 INFO:teuthology.orchestra.console.smithi040:Power off completed
2023-11-04T02:00:53.723 INFO:teuthology.orchestra.console.smithi091:Power off completed
2023-11-04T02:00:53.863 INFO:teuthology.lock.ops:unlocked: smithi040.front.sepia.ceph.com
2023-11-04T02:00:53.870 INFO:teuthology.lock.ops:unlocked: smithi091.front.sepia.ceph.com