2023-10-18T18:17:16.439 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07
2023-10-18T18:17:16.441 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-18T18:17:16.609 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7efe0e320af0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7efe0ee11670>, signals=[15])
2023-10-18T18:17:16.611 INFO:teuthology.lock.ops:Start node 'smithi033.front.sepia.ceph.com' reimaging
2023-10-18T18:17:16.611 INFO:teuthology.lock.ops:Updating [smithi033.front.sepia.ceph.com]: reset os type and version on server
2023-10-18T18:17:16.611 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server
2023-10-18T18:17:16.633 INFO:teuthology.lock.ops:Start node 'smithi049.front.sepia.ceph.com' reimaging
2023-10-18T18:17:16.633 INFO:teuthology.lock.ops:Updating [smithi049.front.sepia.ceph.com]: reset os type and version on server
2023-10-18T18:17:16.633 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server
2023-10-18T18:17:16.635 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /host {"name": "smithi033"}
2023-10-18T18:17:16.657 INFO:teuthology.lock.ops:Start node 'smithi136.front.sepia.ceph.com' reimaging
2023-10-18T18:17:16.657 INFO:teuthology.lock.ops:Updating [smithi136.front.sepia.ceph.com]: reset os type and version on server
2023-10-18T18:17:16.657 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server
2023-10-18T18:17:16.659 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /host {"name": "smithi049"}
2023-10-18T18:17:16.684 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /host {"name": "smithi136"}
2023-10-18T18:17:16.707 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /image {"name": "smithi_ubuntu_20.04"}
2023-10-18T18:17:16.733 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /image {"name": "smithi_ubuntu_20.04"}
2023-10-18T18:17:16.746 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /image {"name": "smithi_ubuntu_20.04"}
2023-10-18T18:17:16.756 DEBUG:teuthology.provision.fog.smithi033:Requesting image smithi_ubuntu_20.04 (ID 2)
2023-10-18T18:17:16.756 DEBUG:teuthology.provision.fog.smithi033:FOG request: PUT /host/138 {"imageID": 2}
2023-10-18T18:17:16.776 DEBUG:teuthology.provision.fog.smithi049:Requesting image smithi_ubuntu_20.04 (ID 2)
2023-10-18T18:17:16.776 DEBUG:teuthology.provision.fog.smithi049:FOG request: PUT /host/154 {"imageID": 2}
2023-10-18T18:17:16.799 DEBUG:teuthology.provision.fog.smithi136:Requesting image smithi_ubuntu_20.04 (ID 2)
2023-10-18T18:17:16.799 DEBUG:teuthology.provision.fog.smithi136:FOG request: PUT /host/241 {"imageID": 2}
2023-10-18T18:17:16.811 INFO:teuthology.provision.fog.smithi049:Scheduling deploy of ubuntu 20.04
2023-10-18T18:17:16.811 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None
2023-10-18T18:17:16.817 INFO:teuthology.provision.fog.smithi033:Scheduling deploy of ubuntu 20.04
2023-10-18T18:17:16.817 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-10-18T18:17:16.841 INFO:teuthology.provision.fog.smithi136:Scheduling deploy of ubuntu 20.04
2023-10-18T18:17:16.841 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None
2023-10-18T18:17:16.852 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /tasktype {"name": "deploy"}
2023-10-18T18:17:16.864 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /tasktype {"name": "deploy"}
2023-10-18T18:17:16.888 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /tasktype {"name": "deploy"}
2023-10-18T18:17:16.893 DEBUG:teuthology.provision.fog.smithi049:FOG request: POST /host/154/task {"taskTypeID": 1}
2023-10-18T18:17:16.904 DEBUG:teuthology.provision.fog.smithi033:FOG request: POST /host/138/task {"taskTypeID": 1}
2023-10-18T18:17:16.923 DEBUG:teuthology.provision.fog.smithi136:FOG request: POST /host/241/task {"taskTypeID": 1}
2023-10-18T18:17:16.943 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None
2023-10-18T18:17:16.962 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-10-18T18:17:16.979 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None
2023-10-18T18:17:17.025 INFO:teuthology.orchestra.console.smithi049:Power off
2023-10-18T18:17:17.026 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-18T18:17:17.044 INFO:teuthology.orchestra.console.smithi033:Power off
2023-10-18T18:17:17.045 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-18T18:17:17.053 DEBUG:teuthology.orchestra.console.smithi049:power off output: Chassis Power Control: Down/Off
2023-10-18T18:17:17.054 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-18T18:17:17.065 DEBUG:teuthology.orchestra.console.smithi033:power off output: Chassis Power Control: Down/Off
2023-10-18T18:17:17.065 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-18T18:17:17.079 INFO:teuthology.orchestra.console.smithi136:Power off
2023-10-18T18:17:17.079 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-18T18:17:17.086 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off
2023-10-18T18:17:17.087 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off
2023-10-18T18:17:17.101 DEBUG:teuthology.orchestra.console.smithi136:power off output: Chassis Power Control: Down/Off
2023-10-18T18:17:17.102 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-18T18:17:17.123 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off
2023-10-18T18:17:17.187 INFO:teuthology.orchestra.console.smithi033:Power off completed
2023-10-18T18:17:17.188 INFO:teuthology.orchestra.console.smithi049:Power off completed
2023-10-18T18:17:17.225 INFO:teuthology.orchestra.console.smithi136:Power off completed
2023-10-18T18:17:17.289 INFO:teuthology.orchestra.console.smithi033:Power on
2023-10-18T18:17:17.290 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-10-18T18:17:17.298 INFO:teuthology.orchestra.console.smithi049:Power on
2023-10-18T18:17:17.298 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-10-18T18:17:17.313 DEBUG:teuthology.orchestra.console.smithi033:power on output: Chassis Power Control: Up/On
2023-10-18T18:17:17.314 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-18T18:17:17.322 DEBUG:teuthology.orchestra.console.smithi049:power on output: Chassis Power Control: Up/On
2023-10-18T18:17:17.322 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-18T18:17:17.329 INFO:teuthology.orchestra.console.smithi136:Power on
2023-10-18T18:17:17.329 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-10-18T18:17:17.337 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off
2023-10-18T18:17:17.342 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off
2023-10-18T18:17:17.349 DEBUG:teuthology.orchestra.console.smithi136:power on output: Chassis Power Control: Up/On
2023-10-18T18:17:17.350 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-18T18:17:17.369 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off
2023-10-18T18:17:21.342 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-18T18:17:21.349 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-18T18:17:21.370 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-18T18:17:21.451 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on
2023-10-18T18:17:21.457 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off
2023-10-18T18:17:21.477 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on
2023-10-18T18:17:21.553 INFO:teuthology.orchestra.console.smithi033:Power on completed
2023-10-18T18:17:21.579 INFO:teuthology.orchestra.console.smithi136:Power on completed
2023-10-18T18:17:21.654 INFO:teuthology.provision.fog.smithi033:Waiting for deploy to finish
2023-10-18T18:17:21.655 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-10-18T18:17:21.680 INFO:teuthology.provision.fog.smithi136:Waiting for deploy to finish
2023-10-18T18:17:21.680 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None
2023-10-18T18:17:25.462 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-18T18:17:25.570 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is on
2023-10-18T18:17:25.671 INFO:teuthology.orchestra.console.smithi049:Power on completed
2023-10-18T18:17:25.772 INFO:teuthology.provision.fog.smithi049:Waiting for deploy to finish
2023-10-18T18:17:25.772 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None
2023-10-18T18:17:36.726 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-10-18T18:17:36.734 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None
2023-10-18T18:17:40.848 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None
2023-10-18T18:17:51.795 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-10-18T18:17:51.797 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None
2023-10-18T18:17:55.916 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None
2023-10-18T18:18:06.870 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-10-18T18:18:06.871 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None
2023-10-18T18:18:10.978 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None
2023-10-18T18:18:21.942 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None
2023-10-18T18:18:21.944 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-10-18T18:18:26.040 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None
2023-10-18T18:18:37.014 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-10-18T18:18:37.016 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None
2023-10-18T18:18:41.104 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None
2023-10-18T18:18:52.090 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-10-18T18:18:52.092 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None
2023-10-18T18:18:56.178 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None
2023-10-18T18:19:07.194 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-10-18T18:19:07.195 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None
2023-10-18T18:19:11.279 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None
2023-10-18T18:19:22.278 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None
2023-10-18T18:19:22.279 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-10-18T18:19:26.364 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None
2023-10-18T18:19:37.354 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None
2023-10-18T18:19:37.356 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-10-18T18:19:41.458 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None
2023-10-18T18:19:52.435 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-10-18T18:19:52.437 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None
2023-10-18T18:19:56.542 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None
2023-10-18T18:20:07.514 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-10-18T18:20:07.516 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None
2023-10-18T18:20:11.626 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None
2023-10-18T18:20:22.594 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None
2023-10-18T18:20:22.596 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-10-18T18:20:26.706 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None
2023-10-18T18:20:37.682 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-10-18T18:20:37.684 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None
2023-10-18T18:20:41.798 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None
2023-10-18T18:20:52.774 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None
2023-10-18T18:20:52.776 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-10-18T18:20:52.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-18T18:20:56.894 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None
2023-10-18T18:21:07.882 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None
2023-10-18T18:21:07.954 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-18T18:21:11.422 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33
2023-10-18T18:21:11.973 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None
2023-10-18T18:21:17.425 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-18T18:21:20.506 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33
2023-10-18T18:21:26.513 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-18T18:21:26.526 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136
2023-10-18T18:21:27.066 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None
2023-10-18T18:21:29.594 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33
2023-10-18T18:21:32.530 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-18T18:21:35.598 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-18T18:21:35.610 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136
2023-10-18T18:21:41.616 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-18T18:21:42.155 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None
2023-10-18T18:21:44.702 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136
2023-10-18T18:21:50.706 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-18T18:21:53.786 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136
2023-10-18T18:21:53.914 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33
2023-10-18T18:21:57.230 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None
2023-10-18T18:21:59.790 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-18T18:21:59.916 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-18T18:22:02.970 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33
2023-10-18T18:22:08.974 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-18T18:22:12.026 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33
2023-10-18T18:22:12.296 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None
2023-10-18T18:22:12.352 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-18T18:22:18.034 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-18T18:22:19.275 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-10-18T18:22:19.276 DEBUG:teuthology.orchestra.run.smithi033:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-10-18T18:22:19.814 INFO:teuthology.provision.fog.smithi033:Node is ready
2023-10-18T18:22:19.815 DEBUG:teuthology.orchestra.run.smithi033:> hostname
2023-10-18T18:22:19.861 INFO:teuthology.orchestra.run.smithi033.stdout:smithi129
2023-10-18T18:22:19.861 DEBUG:teuthology.orchestra.run.smithi033:> grep smithi129 /etc/hosts
2023-10-18T18:22:19.868 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.129 smithi129 smithi129
2023-10-18T18:22:19.868 DEBUG:teuthology.orchestra.run.smithi033:> sudo hostname smithi033
2023-10-18T18:22:19.933 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/smithi129/smithi033/g' /etc/hosts
2023-10-18T18:22:19.951 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/172.21.15.129/172.21.15.33/g' /etc/hosts
2023-10-18T18:22:19.964 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/smithi129/smithi033/g' /etc/hostname
2023-10-18T18:22:19.981 DEBUG:teuthology.orchestra.run.smithi033:> sudo hostname smithi033
2023-10-18T18:22:20.038 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release
2023-10-18T18:22:20.042 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="Ubuntu"
2023-10-18T18:22:20.043 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="20.04.4 LTS (Focal Fossa)"
2023-10-18T18:22:20.043 INFO:teuthology.orchestra.run.smithi033.stdout:ID=ubuntu
2023-10-18T18:22:20.043 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE=debian
2023-10-18T18:22:20.044 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS"
2023-10-18T18:22:20.044 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="20.04"
2023-10-18T18:22:20.044 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://www.ubuntu.com/"
2023-10-18T18:22:20.044 INFO:teuthology.orchestra.run.smithi033.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-10-18T18:22:20.044 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-10-18T18:22:20.044 INFO:teuthology.orchestra.run.smithi033.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-10-18T18:22:20.045 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_CODENAME=focal
2023-10-18T18:22:20.045 INFO:teuthology.orchestra.run.smithi033.stdout:UBUNTU_CODENAME=focal
2023-10-18T18:22:20.046 INFO:teuthology.provision.fog.smithi033:Deploy complete!
2023-10-18T18:22:20.047 DEBUG:teuthology.parallel:result is None
2023-10-18T18:22:30.779 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49
2023-10-18T18:22:31.951 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-10-18T18:22:31.951 DEBUG:teuthology.orchestra.run.smithi136:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-10-18T18:22:36.780 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-18T18:22:39.834 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49
2023-10-18T18:22:45.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-18T18:22:48.890 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49
2023-10-18T18:22:53.363 INFO:teuthology.provision.fog.smithi136:Node is ready
2023-10-18T18:22:53.363 DEBUG:teuthology.orchestra.run.smithi136:> hostname
2023-10-18T18:22:53.370 INFO:teuthology.orchestra.run.smithi136.stdout:smithi136.front.sepia.ceph.com
2023-10-18T18:22:53.370 DEBUG:teuthology.orchestra.run.smithi136:> grep smithi136.front.sepia.ceph.com /etc/hosts
2023-10-18T18:22:53.377 INFO:teuthology.orchestra.run.smithi136.stdout:172.21.15.136 smithi136.front.sepia.ceph.com smithi136
2023-10-18T18:22:53.378 DEBUG:teuthology.orchestra.run.smithi136:> sudo hostname smithi136
2023-10-18T18:22:53.461 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/smithi136.front.sepia.ceph.com/smithi136/g' /etc/hosts
2023-10-18T18:22:53.476 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/172.21.15.136/172.21.15.136/g' /etc/hosts
2023-10-18T18:22:53.491 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/smithi136.front.sepia.ceph.com/smithi136/g' /etc/hostname
2023-10-18T18:22:53.549 DEBUG:teuthology.orchestra.run.smithi136:> sudo hostname smithi136
2023-10-18T18:22:53.558 DEBUG:teuthology.orchestra.run.smithi136:> cat /etc/os-release
2023-10-18T18:22:53.564 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="Ubuntu"
2023-10-18T18:22:53.564 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="20.04.4 LTS (Focal Fossa)"
2023-10-18T18:22:53.564 INFO:teuthology.orchestra.run.smithi136.stdout:ID=ubuntu
2023-10-18T18:22:53.565 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE=debian
2023-10-18T18:22:53.565 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS"
2023-10-18T18:22:53.565 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="20.04"
2023-10-18T18:22:53.565 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://www.ubuntu.com/"
2023-10-18T18:22:53.566 INFO:teuthology.orchestra.run.smithi136.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-10-18T18:22:53.566 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-10-18T18:22:53.566 INFO:teuthology.orchestra.run.smithi136.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-10-18T18:22:53.567 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_CODENAME=focal
2023-10-18T18:22:53.567 INFO:teuthology.orchestra.run.smithi136.stdout:UBUNTU_CODENAME=focal
2023-10-18T18:22:53.567 INFO:teuthology.provision.fog.smithi136:Deploy complete!
2023-10-18T18:22:53.568 DEBUG:teuthology.parallel:result is None
2023-10-18T18:22:54.893 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-18T18:22:57.946 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49
2023-10-18T18:23:03.950 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-18T18:23:07.002 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49
2023-10-18T18:23:13.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-18T18:23:16.058 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49
2023-10-18T18:23:22.063 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-18T18:23:25.118 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49
2023-10-18T18:23:31.123 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-18T18:23:34.206 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49
2023-10-18T18:23:40.210 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-18T18:23:43.290 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49
2023-10-18T18:23:49.294 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-18T18:24:49.355 WARNING:teuthology.provision.fog.smithi049:timed out
2023-10-18T18:24:55.362 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-18T18:24:55.566 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-10-18T18:24:55.566 DEBUG:teuthology.orchestra.run.smithi049:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-10-18T18:24:56.094 INFO:teuthology.provision.fog.smithi049:Node is ready
2023-10-18T18:24:56.098 DEBUG:teuthology.orchestra.run.smithi049:> hostname
2023-10-18T18:24:56.106 INFO:teuthology.orchestra.run.smithi049.stdout:smithi049.front.sepia.ceph.com
2023-10-18T18:24:56.106 DEBUG:teuthology.orchestra.run.smithi049:> grep smithi049.front.sepia.ceph.com /etc/hosts
2023-10-18T18:24:56.154 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49 smithi049.front.sepia.ceph.com smithi049
2023-10-18T18:24:56.154 DEBUG:teuthology.orchestra.run.smithi049:> sudo hostname smithi049
2023-10-18T18:24:56.262 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i -e 's/smithi049.front.sepia.ceph.com/smithi049/g' /etc/hosts
2023-10-18T18:24:56.279 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i -e 's/172.21.15.49/172.21.15.49/g' /etc/hosts
2023-10-18T18:24:56.291 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i -e 's/smithi049.front.sepia.ceph.com/smithi049/g' /etc/hostname
2023-10-18T18:24:56.351 DEBUG:teuthology.orchestra.run.smithi049:> sudo hostname smithi049
2023-10-18T18:24:56.364 DEBUG:teuthology.orchestra.run.smithi049:> cat /etc/os-release
2023-10-18T18:24:56.369 INFO:teuthology.orchestra.run.smithi049.stdout:NAME="Ubuntu"
2023-10-18T18:24:56.370 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION="20.04.4 LTS (Focal Fossa)"
2023-10-18T18:24:56.370 INFO:teuthology.orchestra.run.smithi049.stdout:ID=ubuntu
2023-10-18T18:24:56.371 INFO:teuthology.orchestra.run.smithi049.stdout:ID_LIKE=debian
2023-10-18T18:24:56.371 INFO:teuthology.orchestra.run.smithi049.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS"
2023-10-18T18:24:56.371 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_ID="20.04"
2023-10-18T18:24:56.371 INFO:teuthology.orchestra.run.smithi049.stdout:HOME_URL="https://www.ubuntu.com/"
2023-10-18T18:24:56.372 INFO:teuthology.orchestra.run.smithi049.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-10-18T18:24:56.372 INFO:teuthology.orchestra.run.smithi049.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-10-18T18:24:56.373 INFO:teuthology.orchestra.run.smithi049.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-10-18T18:24:56.373 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_CODENAME=focal
2023-10-18T18:24:56.373 INFO:teuthology.orchestra.run.smithi049.stdout:UBUNTU_CODENAME=focal
2023-10-18T18:24:56.373 INFO:teuthology.provision.fog.smithi049:Deploy complete!
2023-10-18T18:24:56.374 DEBUG:teuthology.parallel:result is None
2023-10-18T18:24:56.711 INFO:teuthology.lock.ops:Checking smithi033.front.sepia.ceph.com
2023-10-18T18:24:56.712 INFO:teuthology.lock.ops:New key found. Updating...
2023-10-18T18:24:56.751 INFO:teuthology.lock.ops:Checking smithi049.front.sepia.ceph.com
2023-10-18T18:24:56.751 INFO:teuthology.lock.ops:New key found. Updating...
2023-10-18T18:24:56.767 INFO:teuthology.lock.ops:Checking smithi136.front.sepia.ceph.com
2023-10-18T18:24:56.767 INFO:teuthology.lock.ops:New key found. Updating...
2023-10-18T18:24:56.785 INFO:teuthology.lock.ops:Updating [smithi033.front.sepia.ceph.com]: set os type and version on server
2023-10-18T18:24:56.785 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com'
2023-10-18T18:24:56.786 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-18T18:24:56.836 DEBUG:teuthology.orchestra.run.smithi033:> true
2023-10-18T18:24:57.039 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi033.front.sepia.ceph.com'
2023-10-18T18:24:57.040 DEBUG:teuthology.orchestra.run.smithi033:> uname -m
2023-10-18T18:24:57.086 INFO:teuthology.orchestra.run.smithi033.stdout:x86_64
2023-10-18T18:24:57.086 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release
2023-10-18T18:24:57.093 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="Ubuntu"
2023-10-18T18:24:57.093 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="20.04.4 LTS (Focal Fossa)"
2023-10-18T18:24:57.093 INFO:teuthology.orchestra.run.smithi033.stdout:ID=ubuntu
2023-10-18T18:24:57.093 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE=debian
2023-10-18T18:24:57.093 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS"
2023-10-18T18:24:57.094 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="20.04"
2023-10-18T18:24:57.094 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://www.ubuntu.com/"
2023-10-18T18:24:57.094 INFO:teuthology.orchestra.run.smithi033.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-10-18T18:24:57.094 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-10-18T18:24:57.094 INFO:teuthology.orchestra.run.smithi033.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-10-18T18:24:57.095 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_CODENAME=focal
2023-10-18T18:24:57.095 INFO:teuthology.orchestra.run.smithi033.stdout:UBUNTU_CODENAME=focal
2023-10-18T18:24:57.095 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server
2023-10-18T18:24:57.117 INFO:teuthology.lock.ops:Updating [smithi049.front.sepia.ceph.com]: set os type and version on server
2023-10-18T18:24:57.118 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com'
2023-10-18T18:24:57.118 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-18T18:24:57.170 DEBUG:teuthology.orchestra.run.smithi049:> true
2023-10-18T18:24:57.283 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi049.front.sepia.ceph.com'
2023-10-18T18:24:57.284 DEBUG:teuthology.orchestra.run.smithi049:> uname -m
2023-10-18T18:24:57.290 INFO:teuthology.orchestra.run.smithi049.stdout:x86_64
2023-10-18T18:24:57.291 DEBUG:teuthology.orchestra.run.smithi049:> cat /etc/os-release
2023-10-18T18:24:57.337 INFO:teuthology.orchestra.run.smithi049.stdout:NAME="Ubuntu"
2023-10-18T18:24:57.338 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION="20.04.4 LTS (Focal Fossa)"
2023-10-18T18:24:57.338 INFO:teuthology.orchestra.run.smithi049.stdout:ID=ubuntu
2023-10-18T18:24:57.338 INFO:teuthology.orchestra.run.smithi049.stdout:ID_LIKE=debian
2023-10-18T18:24:57.338 INFO:teuthology.orchestra.run.smithi049.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS"
2023-10-18T18:24:57.339 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_ID="20.04"
2023-10-18T18:24:57.339 INFO:teuthology.orchestra.run.smithi049.stdout:HOME_URL="https://www.ubuntu.com/"
2023-10-18T18:24:57.339 INFO:teuthology.orchestra.run.smithi049.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-10-18T18:24:57.339 INFO:teuthology.orchestra.run.smithi049.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-10-18T18:24:57.339 INFO:teuthology.orchestra.run.smithi049.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-10-18T18:24:57.340 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_CODENAME=focal
2023-10-18T18:24:57.340 INFO:teuthology.orchestra.run.smithi049.stdout:UBUNTU_CODENAME=focal
2023-10-18T18:24:57.340 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server
2023-10-18T18:24:57.358 INFO:teuthology.lock.ops:Updating [smithi136.front.sepia.ceph.com]: set os type and version on server
2023-10-18T18:24:57.358 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com'
2023-10-18T18:24:57.359 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-18T18:24:57.409 DEBUG:teuthology.orchestra.run.smithi136:> true
2023-10-18T18:24:57.611 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi136.front.sepia.ceph.com'
2023-10-18T18:24:57.612 DEBUG:teuthology.orchestra.run.smithi136:> uname -m
2023-10-18T18:24:57.661 INFO:teuthology.orchestra.run.smithi136.stdout:x86_64
2023-10-18T18:24:57.661 DEBUG:teuthology.orchestra.run.smithi136:> cat /etc/os-release
2023-10-18T18:24:57.668 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="Ubuntu"
2023-10-18T18:24:57.668 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="20.04.4 LTS (Focal Fossa)"
2023-10-18T18:24:57.668 INFO:teuthology.orchestra.run.smithi136.stdout:ID=ubuntu
2023-10-18T18:24:57.668 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE=debian
2023-10-18T18:24:57.669 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS"
2023-10-18T18:24:57.669 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="20.04"
2023-10-18T18:24:57.669 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://www.ubuntu.com/"
2023-10-18T18:24:57.669 INFO:teuthology.orchestra.run.smithi136.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-10-18T18:24:57.669 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-10-18T18:24:57.670 INFO:teuthology.orchestra.run.smithi136.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-10-18T18:24:57.670 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_CODENAME=focal
2023-10-18T18:24:57.670 INFO:teuthology.orchestra.run.smithi136.stdout:UBUNTU_CODENAME=focal
2023-10-18T18:24:57.671 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server
2023-10-18T18:24:57.692 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-18T18:24:57.783 INFO:teuthology.dispatcher.supervisor:Running job 7429192
2023-10-18T18:24:57.783 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-10-16_12:48:28-fs-wip-vshankar-testing-pacific-20231016.091648-testing-default-smithi/7429192 --name vshankar-2023-10-16_12:48:28-fs-wip-vshankar-testing-pacific-20231016.091648-testing-default-smithi --description fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse ms_mode/{secure} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/3 scrub/yes standby-replay subvolume/{with-namespace-isolated-and-quota} tasks/{0-check-counter workunit/suites/iogen} wsync/{yes}} -- /home/teuthworker/archive/vshankar-2023-10-16_12:48:28-fs-wip-vshankar-testing-pacific-20231016.091648-testing-default-smithi/7429192/orig.config.yaml
2023-10-18T18:24:57.788 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-10-16_12:48:28-fs-wip-vshankar-testing-pacific-20231016.091648-testing-default-smithi/7429192
2023-10-18T18:24:57.788 INFO:teuthology.dispatcher.supervisor:Job PID: 2041964
2023-10-18T18:24:57.789 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-10-18T18:26:57.886 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-18T18:28:58.052 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-18T18:30:58.215 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-18T18:32:58.383 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-18T18:34:58.551 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-18T18:36:58.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-18T18:38:58.887 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-18T18:40:59.066 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-18T18:42:59.275 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-18T18:44:59.439 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-18T18:44:59.500 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-10-18T18:44:59.632 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-10-18T18:44:59.632 INFO:teuthology.nuke:Checking targets against current locks
2023-10-18T18:44:59.678 DEBUG:teuthology.nuke:shortname: smithi033
2023-10-18T18:44:59.679 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-10-18T18:44:59.706 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi033.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-10-16_12:48:28-fs-wip-vshankar-testing-pacific-20231016.091648-testing-default-smithi/7429192', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-18 18:17:15.593319', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}
2023-10-18T18:44:59.710 DEBUG:teuthology.nuke:shortname: smithi049
2023-10-18T18:44:59.711 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-10-18T18:44:59.732 DEBUG:teuthology.nuke:shortname: smithi136
2023-10-18T18:44:59.733 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-10-18T18:44:59.737 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi049.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-10-16_12:48:28-fs-wip-vshankar-testing-pacific-20231016.091648-testing-default-smithi/7429192', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-18 18:17:15.594494', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}
2023-10-18T18:44:59.758 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi136.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-10-16_12:48:28-fs-wip-vshankar-testing-pacific-20231016.091648-testing-default-smithi/7429192', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-18 18:17:15.591962', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}
2023-10-18T18:44:59.766 INFO:teuthology.orchestra.console.smithi033:Power off
2023-10-18T18:44:59.766 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-18T18:44:59.788 DEBUG:teuthology.orchestra.console.smithi033:power off output: Chassis Power Control: Down/Off
2023-10-18T18:44:59.789 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-18T18:44:59.805 INFO:teuthology.orchestra.console.smithi049:Power off
2023-10-18T18:44:59.805 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-18T18:44:59.814 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off
2023-10-18T18:44:59.825 DEBUG:teuthology.orchestra.console.smithi049:power off output: Chassis Power Control: Down/Off
2023-10-18T18:44:59.826 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-18T18:44:59.838 INFO:teuthology.orchestra.console.smithi136:Power off
2023-10-18T18:44:59.838 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-18T18:44:59.846 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off
2023-10-18T18:44:59.861 DEBUG:teuthology.orchestra.console.smithi136:power off output: Chassis Power Control: Down/Off
2023-10-18T18:44:59.861 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-18T18:44:59.881 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off
2023-10-18T18:44:59.915 INFO:teuthology.orchestra.console.smithi033:Power off completed
2023-10-18T18:44:59.947 INFO:teuthology.orchestra.console.smithi049:Power off completed
2023-10-18T18:44:59.983 INFO:teuthology.orchestra.console.smithi136:Power off completed
2023-10-18T18:45:00.064 INFO:teuthology.lock.ops:unlocked: smithi033.front.sepia.ceph.com
2023-10-18T18:45:00.089 INFO:teuthology.lock.ops:unlocked: smithi049.front.sepia.ceph.com
2023-10-18T18:45:00.122 INFO:teuthology.lock.ops:unlocked: smithi136.front.sepia.ceph.com