2023-09-04T11:53:09.329 INFO:root:teuthology version: 0.0.1.dev192+gf9a8556
2023-09-04T11:53:09.330 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-04T11:53:09.469 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f819b250d30>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f819aff8ca0>, signals=[15])
2023-09-04T11:53:09.470 INFO:teuthology.lock.ops:Start node 'smithi098.front.sepia.ceph.com' reimaging
2023-09-04T11:53:09.471 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: reset os type and version on server
2023-09-04T11:53:09.471 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server
2023-09-04T11:53:09.491 INFO:teuthology.lock.ops:Start node 'smithi204.front.sepia.ceph.com' reimaging
2023-09-04T11:53:09.492 INFO:teuthology.lock.ops:Updating [smithi204.front.sepia.ceph.com]: reset os type and version on server
2023-09-04T11:53:09.492 INFO:teuthology.lock.ops:Updating smithi204.front.sepia.ceph.com on lock server
2023-09-04T11:53:09.493 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /host {"name": "smithi098"}
2023-09-04T11:53:09.516 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /host {"name": "smithi204"}
2023-09-04T11:53:09.562 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /image {"name": "smithi_ubuntu_22.04"}
2023-09-04T11:53:09.580 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /image {"name": "smithi_ubuntu_22.04"}
2023-09-04T11:53:09.602 DEBUG:teuthology.provision.fog.smithi098:Requesting image smithi_ubuntu_22.04 (ID 6)
2023-09-04T11:53:09.604 DEBUG:teuthology.provision.fog.smithi098:FOG request: PUT /host/203 {"imageID": 6}
2023-09-04T11:53:09.630 DEBUG:teuthology.provision.fog.smithi204:Requesting image smithi_ubuntu_22.04 (ID 6)
2023-09-04T11:53:09.630 DEBUG:teuthology.provision.fog.smithi204:FOG request: PUT /host/308 {"imageID": 6}
2023-09-04T11:53:09.649 INFO:teuthology.provision.fog.smithi098:Scheduling deploy of ubuntu 22.04
2023-09-04T11:53:09.650 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-04T11:53:09.669 INFO:teuthology.provision.fog.smithi204:Scheduling deploy of ubuntu 22.04
2023-09-04T11:53:09.670 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None
2023-09-04T11:53:09.746 DEBUG:teuthology.provision.fog.smithi204:Canceling deploy task with ID 477571
2023-09-04T11:53:09.747 DEBUG:teuthology.provision.fog.smithi204:FOG request: DELETE /task/cancel {"id": 477571}
2023-09-04T11:53:09.753 DEBUG:teuthology.provision.fog.smithi098:Canceling deploy task with ID 477570
2023-09-04T11:53:09.753 DEBUG:teuthology.provision.fog.smithi098:FOG request: DELETE /task/cancel {"id": 477570}
2023-09-04T11:53:09.796 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /tasktype {"name": "deploy"}
2023-09-04T11:53:09.830 DEBUG:teuthology.provision.fog.smithi098:FOG request: POST /host/203/task {"taskTypeID": 1}
2023-09-04T11:53:09.837 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /tasktype {"name": "deploy"}
2023-09-04T11:53:09.870 DEBUG:teuthology.provision.fog.smithi204:FOG request: POST /host/308/task {"taskTypeID": 1}
2023-09-04T11:53:09.891 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-04T11:53:09.923 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None
2023-09-04T11:53:10.010 INFO:teuthology.orchestra.console.smithi098:Power off
2023-09-04T11:53:10.011 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-04T11:53:10.033 DEBUG:teuthology.orchestra.console.smithi098:power off output: Chassis Power Control: Down/Off
2023-09-04T11:53:10.033 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-04T11:53:10.049 INFO:teuthology.orchestra.console.smithi204:Power off
2023-09-04T11:53:10.049 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-04T11:53:10.057 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off
2023-09-04T11:53:10.069 DEBUG:teuthology.orchestra.console.smithi204:power off output: Chassis Power Control: Down/Off
2023-09-04T11:53:10.069 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-04T11:53:10.089 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is off
2023-09-04T11:53:10.159 INFO:teuthology.orchestra.console.smithi098:Power off completed
2023-09-04T11:53:10.191 INFO:teuthology.orchestra.console.smithi204:Power off completed
2023-09-04T11:53:10.260 INFO:teuthology.orchestra.console.smithi098:Power on
2023-09-04T11:53:10.261 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-04T11:53:10.281 DEBUG:teuthology.orchestra.console.smithi098:power on output: Chassis Power Control: Up/On
2023-09-04T11:53:10.282 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-04T11:53:10.292 INFO:teuthology.orchestra.console.smithi204:Power on
2023-09-04T11:53:10.292 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-04T11:53:10.302 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off
2023-09-04T11:53:10.311 DEBUG:teuthology.orchestra.console.smithi204:power on output: Chassis Power Control: Up/On
2023-09-04T11:53:10.311 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-04T11:53:10.331 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is off
2023-09-04T11:53:14.307 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-04T11:53:14.333 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-04T11:53:14.416 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off
2023-09-04T11:53:14.442 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is on
2023-09-04T11:53:14.543 INFO:teuthology.orchestra.console.smithi204:Power on completed
2023-09-04T11:53:14.643 INFO:teuthology.provision.fog.smithi204:Waiting for deploy to finish
2023-09-04T11:53:14.644 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None
2023-09-04T11:53:18.421 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-04T11:53:18.529 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on
2023-09-04T11:53:18.630 INFO:teuthology.orchestra.console.smithi098:Power on completed
2023-09-04T11:53:18.731 INFO:teuthology.provision.fog.smithi098:Waiting for deploy to finish
2023-09-04T11:53:18.731 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-04T11:53:29.752 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None
2023-09-04T11:53:33.820 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-04T11:53:44.858 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None
2023-09-04T11:53:48.910 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-04T11:53:59.962 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None
2023-09-04T11:54:04.012 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-04T11:54:15.064 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None
2023-09-04T11:54:19.100 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-04T11:54:30.170 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None
2023-09-04T11:54:34.202 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-04T11:54:45.270 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None
2023-09-04T11:54:49.298 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-04T11:55:00.382 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None
2023-09-04T11:55:04.406 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-04T11:55:15.481 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None
2023-09-04T11:55:19.504 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-04T11:55:30.578 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None
2023-09-04T11:55:34.607 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-04T11:55:45.684 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None
2023-09-04T11:55:49.702 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-04T11:56:00.787 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None
2023-09-04T11:56:04.814 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-04T11:56:15.882 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None
2023-09-04T11:56:19.924 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-04T11:56:30.970 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None
2023-09-04T11:56:35.031 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-04T11:56:46.069 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None
2023-09-04T11:56:50.125 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-04T11:57:01.180 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None
2023-09-04T11:57:05.222 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-04T11:57:16.292 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None
2023-09-04T11:57:20.319 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-04T11:57:31.396 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None
2023-09-04T11:57:35.412 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-04T11:57:46.504 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None
2023-09-04T11:57:50.505 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-04T11:58:01.598 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None
2023-09-04T11:58:05.596 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-04T11:58:16.690 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None
2023-09-04T11:58:20.689 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-04T11:58:31.798 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None
2023-09-04T11:58:35.799 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-04T11:58:46.898 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None
2023-09-04T11:58:50.891 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-04T11:59:02.002 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None
2023-09-04T11:59:05.999 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-04T11:59:17.102 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None
2023-09-04T11:59:21.086 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-04T11:59:32.210 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None
2023-09-04T11:59:36.186 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-04T11:59:47.302 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None
2023-09-04T11:59:51.274 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-04T12:00:02.402 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None
2023-09-04T12:00:06.369 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-04T12:00:17.490 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None
2023-09-04T12:00:21.468 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-04T12:00:32.598 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None
2023-09-04T12:00:36.578 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-04T12:00:47.698 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None
2023-09-04T12:00:51.674 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-04T12:01:02.792 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None
2023-09-04T12:01:06.762 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-04T12:01:17.893 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None
2023-09-04T12:01:21.850 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-04T12:01:32.986 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None
2023-09-04T12:01:33.063 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-04T12:01:36.932 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-04T12:01:37.045 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-04T12:01:51.514 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204
2023-09-04T12:01:55.610 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98
2023-09-04T12:01:57.518 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-04T12:02:00.570 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204
2023-09-04T12:02:01.612 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-04T12:02:04.666 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98
2023-09-04T12:02:06.573 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-04T12:02:09.626 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204
2023-09-04T12:02:10.668 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-04T12:02:13.722 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98
2023-09-04T12:02:15.629 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-04T12:02:18.686 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204
2023-09-04T12:02:19.725 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-04T12:02:22.778 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98
2023-09-04T12:02:24.690 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-04T12:02:27.770 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204
2023-09-04T12:02:28.780 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-04T12:02:31.841 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98
2023-09-04T12:02:33.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-04T12:02:36.826 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204
2023-09-04T12:02:37.844 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-04T12:02:42.830 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-04T12:03:37.881 WARNING:teuthology.provision.fog.smithi098:timed out
2023-09-04T12:03:42.838 WARNING:teuthology.provision.fog.smithi204:timed out
2023-09-04T12:03:43.884 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-04T12:03:44.062 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-09-04T12:03:44.063 DEBUG:teuthology.orchestra.run.smithi098:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-09-04T12:03:44.608 INFO:teuthology.provision.fog.smithi098:Node is ready
2023-09-04T12:03:44.608 DEBUG:teuthology.orchestra.run.smithi098:> hostname
2023-09-04T12:03:44.654 INFO:teuthology.orchestra.run.smithi098.stdout:smithi098.front.sepia.ceph.com
2023-09-04T12:03:44.655 DEBUG:teuthology.orchestra.run.smithi098:> grep smithi098.front.sepia.ceph.com /etc/hosts
2023-09-04T12:03:44.702 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98 smithi098.front.sepia.ceph.com smithi098
2023-09-04T12:03:44.703 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname smithi098
2023-09-04T12:03:44.852 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/smithi098.front.sepia.ceph.com/smithi098/g' /etc/hosts
2023-09-04T12:03:44.867 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/172.21.15.98/172.21.15.98/g' /etc/hosts
2023-09-04T12:03:44.927 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/smithi098.front.sepia.ceph.com/smithi098/g' /etc/hostname
2023-09-04T12:03:44.983 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname smithi098
2023-09-04T12:03:45.045 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release
2023-09-04T12:03:45.094 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-09-04T12:03:45.095 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="Ubuntu"
2023-09-04T12:03:45.095 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="22.04"
2023-09-04T12:03:45.095 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-09-04T12:03:45.095 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_CODENAME=jammy
2023-09-04T12:03:45.096 INFO:teuthology.orchestra.run.smithi098.stdout:ID=ubuntu
2023-09-04T12:03:45.096 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE=debian
2023-09-04T12:03:45.096 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://www.ubuntu.com/"
2023-09-04T12:03:45.096 INFO:teuthology.orchestra.run.smithi098.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-09-04T12:03:45.097 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-09-04T12:03:45.097 INFO:teuthology.orchestra.run.smithi098.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-09-04T12:03:45.097 INFO:teuthology.orchestra.run.smithi098.stdout:UBUNTU_CODENAME=jammy
2023-09-04T12:03:45.098 INFO:teuthology.provision.fog.smithi098:Deploy complete!
2023-09-04T12:03:45.099 DEBUG:teuthology.parallel:result is None
2023-09-04T12:03:48.842 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-04T12:03:49.082 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-09-04T12:03:49.083 DEBUG:teuthology.orchestra.run.smithi204:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-09-04T12:03:49.529 INFO:teuthology.provision.fog.smithi204:Node is ready
2023-09-04T12:03:49.530 DEBUG:teuthology.orchestra.run.smithi204:> hostname
2023-09-04T12:03:49.577 INFO:teuthology.orchestra.run.smithi204.stdout:smithi204.front.sepia.ceph.com
2023-09-04T12:03:49.577 DEBUG:teuthology.orchestra.run.smithi204:> grep smithi204.front.sepia.ceph.com /etc/hosts
2023-09-04T12:03:49.625 INFO:teuthology.orchestra.run.smithi204.stdout:172.21.15.204 smithi204.front.sepia.ceph.com smithi204
2023-09-04T12:03:49.626 DEBUG:teuthology.orchestra.run.smithi204:> sudo hostname smithi204
2023-09-04T12:03:49.759 DEBUG:teuthology.orchestra.run.smithi204:> sudo sed -i -e 's/smithi204.front.sepia.ceph.com/smithi204/g' /etc/hosts
2023-09-04T12:03:49.774 DEBUG:teuthology.orchestra.run.smithi204:> sudo sed -i -e 's/172.21.15.204/172.21.15.204/g' /etc/hosts
2023-09-04T12:03:49.829 DEBUG:teuthology.orchestra.run.smithi204:> sudo sed -i -e 's/smithi204.front.sepia.ceph.com/smithi204/g' /etc/hostname
2023-09-04T12:03:49.884 DEBUG:teuthology.orchestra.run.smithi204:> sudo hostname smithi204
2023-09-04T12:03:49.943 DEBUG:teuthology.orchestra.run.smithi204:> cat /etc/os-release
2023-09-04T12:03:49.992 INFO:teuthology.orchestra.run.smithi204.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-09-04T12:03:49.993 INFO:teuthology.orchestra.run.smithi204.stdout:NAME="Ubuntu"
2023-09-04T12:03:49.993 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION_ID="22.04"
2023-09-04T12:03:49.993 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-09-04T12:03:49.993 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION_CODENAME=jammy
2023-09-04T12:03:49.993 INFO:teuthology.orchestra.run.smithi204.stdout:ID=ubuntu
2023-09-04T12:03:49.994 INFO:teuthology.orchestra.run.smithi204.stdout:ID_LIKE=debian
2023-09-04T12:03:49.994 INFO:teuthology.orchestra.run.smithi204.stdout:HOME_URL="https://www.ubuntu.com/"
2023-09-04T12:03:49.994 INFO:teuthology.orchestra.run.smithi204.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-09-04T12:03:49.994 INFO:teuthology.orchestra.run.smithi204.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-09-04T12:03:49.995 INFO:teuthology.orchestra.run.smithi204.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-09-04T12:03:49.995 INFO:teuthology.orchestra.run.smithi204.stdout:UBUNTU_CODENAME=jammy
2023-09-04T12:03:49.995 INFO:teuthology.provision.fog.smithi204:Deploy complete!
2023-09-04T12:03:49.996 DEBUG:teuthology.parallel:result is None
2023-09-04T12:03:50.174 INFO:teuthology.lock.ops:Checking smithi098.front.sepia.ceph.com
2023-09-04T12:03:50.174 INFO:teuthology.lock.ops:New key found. Updating...
2023-09-04T12:03:50.197 INFO:teuthology.lock.ops:Checking smithi204.front.sepia.ceph.com
2023-09-04T12:03:50.198 INFO:teuthology.lock.ops:New key found. Updating...
2023-09-04T12:03:50.214 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: set os type and version on server
2023-09-04T12:03:50.215 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com'
2023-09-04T12:03:50.215 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-04T12:03:50.286 DEBUG:teuthology.orchestra.run.smithi098:> true
2023-09-04T12:03:50.402 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi098.front.sepia.ceph.com'
2023-09-04T12:03:50.402 DEBUG:teuthology.orchestra.run.smithi098:> uname -m
2023-09-04T12:03:50.450 INFO:teuthology.orchestra.run.smithi098.stdout:x86_64
2023-09-04T12:03:50.450 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release
2023-09-04T12:03:50.498 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-09-04T12:03:50.498 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="Ubuntu"
2023-09-04T12:03:50.498 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="22.04"
2023-09-04T12:03:50.498 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-09-04T12:03:50.499 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_CODENAME=jammy
2023-09-04T12:03:50.499 INFO:teuthology.orchestra.run.smithi098.stdout:ID=ubuntu
2023-09-04T12:03:50.499 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE=debian
2023-09-04T12:03:50.499 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://www.ubuntu.com/"
2023-09-04T12:03:50.499 INFO:teuthology.orchestra.run.smithi098.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-09-04T12:03:50.500 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-09-04T12:03:50.500 INFO:teuthology.orchestra.run.smithi098.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-09-04T12:03:50.500 INFO:teuthology.orchestra.run.smithi098.stdout:UBUNTU_CODENAME=jammy
2023-09-04T12:03:50.500 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server
2023-09-04T12:03:50.522 INFO:teuthology.lock.ops:Updating [smithi204.front.sepia.ceph.com]: set os type and version on server
2023-09-04T12:03:50.522 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com'
2023-09-04T12:03:50.523 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-04T12:03:50.601 DEBUG:teuthology.orchestra.run.smithi204:> true
2023-09-04T12:03:50.705 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi204.front.sepia.ceph.com'
2023-09-04T12:03:50.706 DEBUG:teuthology.orchestra.run.smithi204:> uname -m
2023-09-04T12:03:50.752 INFO:teuthology.orchestra.run.smithi204.stdout:x86_64
2023-09-04T12:03:50.753 DEBUG:teuthology.orchestra.run.smithi204:> cat /etc/os-release
2023-09-04T12:03:50.804 INFO:teuthology.orchestra.run.smithi204.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-09-04T12:03:50.804 INFO:teuthology.orchestra.run.smithi204.stdout:NAME="Ubuntu"
2023-09-04T12:03:50.805 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION_ID="22.04"
2023-09-04T12:03:50.805 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-09-04T12:03:50.805 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION_CODENAME=jammy
2023-09-04T12:03:50.805 INFO:teuthology.orchestra.run.smithi204.stdout:ID=ubuntu
2023-09-04T12:03:50.805 INFO:teuthology.orchestra.run.smithi204.stdout:ID_LIKE=debian
2023-09-04T12:03:50.806 INFO:teuthology.orchestra.run.smithi204.stdout:HOME_URL="https://www.ubuntu.com/"
2023-09-04T12:03:50.806 INFO:teuthology.orchestra.run.smithi204.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-09-04T12:03:50.806 INFO:teuthology.orchestra.run.smithi204.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-09-04T12:03:50.806 INFO:teuthology.orchestra.run.smithi204.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-09-04T12:03:50.806 INFO:teuthology.orchestra.run.smithi204.stdout:UBUNTU_CODENAME=jammy
2023-09-04T12:03:50.807 INFO:teuthology.lock.ops:Updating smithi204.front.sepia.ceph.com on lock server
2023-09-04T12:03:50.830 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-04T12:03:50.910 INFO:teuthology.dispatcher.supervisor:Running job 7388025
2023-09-04T12:03:50.910 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-09-04_11:52:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7388025 --name rishabh-2023-09-04_11:52:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/acls} -- /home/teuthworker/archive/rishabh-2023-09-04_11:52:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7388025/orig.config.yaml
2023-09-04T12:03:50.913 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-09-04_11:52:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7388025
2023-09-04T12:03:50.913 INFO:teuthology.dispatcher.supervisor:Job PID: 2423122
2023-09-04T12:03:50.913 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-09-04T12:05:51.010 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-04T12:07:51.181 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-04T12:09:51.324 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-04T12:11:51.491 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-04T12:13:51.655 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-04T12:15:51.815 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-04T12:17:52.125 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-04T12:19:52.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-04T12:21:52.531 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-04T12:23:52.697 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-04T12:25:52.904 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-04T12:25:52.976 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-09-04T12:25:53.082 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-09-04T12:25:53.083 INFO:teuthology.nuke:Checking targets against current locks
2023-09-04T12:25:53.129 DEBUG:teuthology.nuke:shortname: smithi098
2023-09-04T12:25:53.130 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-09-04T12:25:53.154 DEBUG:teuthology.nuke:shortname: smithi204
2023-09-04T12:25:53.154 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-09-04T12:25:53.157 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi098.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-09-04_11:52:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7388025', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-04 11:53:08.541797', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNlBzUWlVBx4zV8bQjBJpvbcJyiQYbP8pXFwZyL0na75yY3kKmPIeh8KcgRnO+PE6RuhIyYrTIP85r3RbOCBP6o='}
2023-09-04T12:25:53.177 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi204.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-09-04_11:52:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7388025', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-04 11:53:08.543578', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGSdYAyE8vpQ3RhG1N2r6J6qGsxYl57MIyzGot9TKCCi'}
2023-09-04T12:25:53.204 INFO:teuthology.orchestra.console.smithi098:Power off
2023-09-04T12:25:53.205 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-04T12:25:53.226 DEBUG:teuthology.orchestra.console.smithi098:power off output: Chassis Power Control: Down/Off
2023-09-04T12:25:53.227 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-04T12:25:53.239 INFO:teuthology.orchestra.console.smithi204:Power off
2023-09-04T12:25:53.240 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-04T12:25:53.247 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off
2023-09-04T12:25:53.259 DEBUG:teuthology.orchestra.console.smithi204:power off output: Chassis Power Control: Down/Off
2023-09-04T12:25:53.259 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-04T12:25:53.278 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is off
2023-09-04T12:25:53.349 INFO:teuthology.orchestra.console.smithi098:Power off completed
2023-09-04T12:25:53.379 INFO:teuthology.orchestra.console.smithi204:Power off completed
2023-09-04T12:25:53.497 INFO:teuthology.lock.ops:unlocked: smithi098.front.sepia.ceph.com
2023-09-04T12:25:53.523 INFO:teuthology.lock.ops:unlocked: smithi204.front.sepia.ceph.com